Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “big data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Development of an Airspace Simulation and Modeling Tool for Enhanced Spectrum Management

The emergence of new aerial vehicles into the National Airspace System creates an increased demand for aeronautical communications to support aviation operations. However, the issue of spectrum scarcity remains an ever-present concern, and the growing demand cannot be supported using existing spectrum allocation strategies. As a result, a new spectrum management approach is required, and the National Aeronautics and Space Administration (NASA) is investigating advanced concepts to modernize the management and use of aviation spectrum by leveraging the latest advancements in wireless communications, big data and machine learning. This research proposes an autonomous spectrum allocation concept, which allocates communications resources, such as spectrum and power, based on the predicted communications and air traffic demands throughout the airspace, as opposed to the use of fixed allocations as is done today. This approach will result in improved spectrum utilization efficiency and enhanced airspace capacity. The autonomous spectrum allocation concept decomposes into three research areas: demand prediction, resource allocation, and use case evaluation. As part of the use case evaluation effort, a modeling and simulation capability is currently under development. This simulation capability includes the implementation of various features, including visualization of both live or virtually-generated airspace traffic, simulation scenario development, simulation management with data collection, and flight plan creation with corresponding trajectory generation. This modeling and simulation capability will continue to evolve as new and advanced airspace applications are introduced into existing and emerging operational environments.

Eric J. Knoblock↗
NASA NTRSDate not supplied

Scientific Content Curation in an Open Science Era

Today’s open science environment, in combination with the Big Data era, means more scientific data, software, tools, documentation, publications and other resources are available than ever. The promise of the open science era is that scientists will spend less time reinventing the wheel and more time doing actionable research. Yet navigating this vast and complex information landscape can feel overwhelming to scientists trying to get their bearings. In this presentation, we define and discuss the importance of scientific content curation for enhancing discovery and use of scientific data and information. We also share two examples of scientific content curation in action: the Catalog of Archived Suborbital Earth Science Investigations (CASEI) and the Science Discovery Engine (SDE).

Kaylin Bugbee↗
NASA NTRSDate not supplied

Improvements on Low-Density Parity-Check (LDPC) Codes and High-Performance Neuromorphic Engineering for Communication Systems

Belief propagation (BP) on LDPC codes is an iterative decoding algorithm that performs information transfer on the Tanner graph, which represents the code. In each iteration, the algorithm exchanges information (LLR) between variable nodes and check nodes through the edges of the graph. LLR values represent the probability that a given bit in a transmitted codeword equals 0 or 1, given a received word. In the hardware part, recent advancements in intelligent technologies, such as artificial intelligence, big data analytics, autonomous vehicles, and speech/image recognition, have heightened the demand for faster calculations and reduced energy consumption.

Danilo Barrionuevo↗
NASA NTRS2024

End-to-End Mission Design & Trajectory Optimization

Need: A need exists for a generalized, robust, user-friendly and accessible end-to-end mission design optimization tool. Solution: Our solution to developing this capability was to interface two JSC tools—Copernicus and Genesis. Each of these tools has a specific area of the mission design process that it excels at. By utilizing them both, we can gain performance benefits not seen by either on their own. - Copernicus is a trajectory design and optimization software used for in-space trajectories around multiple bodies. - Genesis is a flight mechanics tool used to model ascent, entry, descent, and landing trajectories around a single planetary body. Year 1 was focused on combining these 2 software packages—allowing Copernicus to incorporate the ascent/descent capabilities of Genesis into the optimization problem—and developing this end-to-end mission design capability. Year 2 we focused on increasing the robustness of this capability by building the initial guess generator (IGG), which produces initial guesses based on simplifying assumptions and the physics of the problem. Year 3 of our project focused on utilizing the end-to-end mission design and optimization capabilities developed in the previous 2 years to analyze specific mission scenarios—scaling up from proof of concept to real analyses—capturing any resulting performance benefits, as well as addressing the Big Data challenges we’re faced with—namely, how we’re going to manage and interpret all the data that’s generated.

Kristin Nichols↗
DOE OSTI2014

SCALING AN URBAN EMERGENCY EVACUATION FRAMEWORK: CHALLENGES AND PRACTICES

Critical infrastructure disruption, caused by severe weather events, natural disasters, terrorist attacks, etc., has significant impacts on urban transportation systems. We built a computational framework to simulate urban transportation systems under critical infrastructure disruption in order to aid real-time emergency evacuation. This framework will use large scale datasets to provide a scalable tool for emergency planning and management. Our framework, World-Wide Emergency Evacuation (WWEE), integrates population distribution and urban infrastructure networks to model travel demand in emergency situations at global level. Also, a computational model of agent-based traffic simulation is used to provide an optimal evacuation plan for traffic operation purpose [1]. In addition, our framework provides a web-based high resolution visualization tool for emergency evacuation modelers and practitioners. We have successfully tested our framework with scenarios in both United States (Alexandria, VA) and Europe (Berlin, Germany) [2]. However, there are still some major drawbacks for scaling this framework to handle big data workloads in real time. On our back-end, lack of proper infrastructure limits us in ability to process large amounts of data, run the simulation efficiently and quickly, and provide fast retrieval and serving of data. On the front-end, the visualization performance of microscopic evacuation results is still not efficient enough due to high volume data communication between server and client. We are addressing these drawbacks by using cloud computing and next-generation web technologies, namely Node.js, NoSQL, WebGL, Open Layers 3 and HTML5 technologies. We will describe briefly about each one and how we are using and leveraging these technologies to provide an efficient tool for emergency management organizations. Our early experimentation demonstrates that using above technologies is a promising approach to build a scalable and high performance urban emergency evacuation framework that can improve traffic mobility and safety under critical infrastructure disruption in today s socially connected world.

cloud computing↗
DOE OSTI2015

Near Field Intensity Trends of Main Laser Alignment Images in the National Ignition Facility (NIF)

The National Ignition Facility (NIF) utilizes 192 high-energy laser beams focused with enough power and precision on a hydrogen-filled spherical, cryogenic target to potentially initiate a fusion reaction. NIF has been operational for six years; during that time, thousands of successful laser firings or shots have been executed. Critical instrument measurements and camera images are carefully recorded for each shot. The result is a massive and complex database or ‘big data’ archive that can be used to investigate the state of the laser system at any point in its history or to locate and track trends in the laser operation over time. In this study, the optical light throughput for more than 1600 NIF shots for each of the 192 main laser beams and 48 quads was measured over a three year period from January 2009 to October 2012. The purpose was to verify that the variation in the transmission of light through the optics over time performed within design expectations during this time period. Differences between average or integrated intensity from images recorded by the input sensor package (ISP) and by the output sensor package (OSP) in the NIF beam-line were examined. A metric is described for quantifying changes in the integrated intensity measurements and was used to view potential trends. Results are presented for the NIF input and output sensor package trends and changes over the three year time-frame.

42 ENGINEERING↗
DOE OSTI2014

Genomic Island Identification Software v 1.0

Genomic islands are key mobile DNA elements in bacterial evolution, that can distinguish pathogenic strains from each other, or distinguish pathogenic strains from non-pathogenic strains. Their detection in genomes is a challenging problem. We present 3 main software components that attack the island detection problem on two different bases: 1) the preference of islands to insert in chromosomal tRNA or tmRNA genes (islander.pl), and 2) islands' sporadic occurrence among closely related strains. The latter principle is employed in both an algorithm (learnedPhyloblocks.pl) and a visualization method (panGenome.pl). Component islander.pl finds islands based on their preference for a particular target gene type. We annotate each tRNA and tmRNA gene, find fragments of each such gene as candidates for the distal ends of islands, and filter candidates to remove false positives. Component learnedPhyloblocks.pl uses islands found by islander.pl and other methods as a training set to find new islands. Reference genomes are aligned using mugsy, then the "phylotypes" or patterns of occurrence in the reference set are determined for each position in the target genome, and those phylotypes most enriched in the training set of islands are followed to detect yet more islands. Component panGenome.pl produces a big-data visualization of the chromosomally-ordered "pan-genome", that includes every gene of every reference genome (x-axis, pan-genome order; y-axis, reference genomes; color-coding, gene presence/absence etc.), islands appearing as dark patches.

Source record↗
DOE OSTI2017

Los Alamos on Radio Café: Ludmil Alexandrov

In a creative breakthrough in cancer research, Ludmil Alexandrov, the J. Robert Oppenheimer Distinguished Postdoctoral Fellow at Los Alamos National Laboratory, combines Big Data, supercomputing and machine-learning to identify the telltale mutations of cancer. Knowing these mutational signatures can help researchers develop new methods of prevention.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Collaborative Computing Center (C3)

High Performance Computing (HPC) compliments theory and informs experimental processes in support of NE programs Big Data Analytics capabilities aid in the discovery of science-relevant relationships in data The C520 staff is made up of 19 Staff – Engineering, Basic Sciences, Computer Science, Statistics, Data Science, Technology Computer Computing Hardware Operations include: Falcon is fully utilized with an average 3X over subscription of waiting jobs over the past year Lemhi recently deployed in Feb 2019 Sawtooth procurement underway with Fall 2019 delivery 509 HPC accounts, lab, industry, university users 1.2 PB disk storage, 1.0 PB scratch storage, 0.8 PB disaster recovery storage Collaborative Computing Center nearing completion with approximately 200 staff -- Office space and 200 racks -- Data Center space for computer equipment

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2016

Accelerating Science: A Computing Research Agenda

The emergence of "big data" offers unprecedented opportunities for not only accelerating scientific advances but also enabling new modes of discovery. Scientific progress in many disciplines is increasingly enabled by our ability to examine natural phenomena through the computational lens, i.e., using algorithmic or information processing abstractions of the underlying processes; and our ability to acquire, share, integrate and analyze disparate types of data. However, there is a huge gap between our ability to acquire, store, and process data and our ability to make effective use of the data to advance discovery. Despite successful automation of routine aspects of data management and analytics, most elements of the scientific process currently require considerable human expertise and effort. Accelerating science to keep pace with the rate of data acquisition and data processing calls for the development of algorithmic or information processing abstractions, coupled with formal methods and tools for modeling and simulation of natural processes as well as major innovations in cognitive tools for scientists, i.e., computational tools that leverage and extend the reach of human intellect, and partner with humans on a broad range of tasks in scientific discovery (e.g., identifying, prioritizing formulating questions, designing, prioritizing and executing experiments designed to answer a chosen question, drawing inferences and evaluating the results, and formulating new questions, in a closed-loop fashion). This calls for concerted research agenda aimed at: Development, analysis, integration, sharing, and simulation of algorithmic or information processing abstractions of natural processes, coupled with formal methods and tools for their analyses and simulation; Innovations in cognitive tools that augment and extend human intellect and partner with humans in all aspects of science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Exploring Intentional Driving Volatility in Naturalistic Driving Environment Prior to Involvement in Unsafe Events

The sequence of instantaneous driving decisions and its variations prior to involvement in safety critical events, defined as event-based volatility, can be a leading indicator of safety. The research issue is characterizing volatility in instantaneous driving decisions in longitudinal and lateral directions, and how it varies across drivers involved in normal driving, crash, and near-crash events. A rigorous quasi-experimental study design is adopted to help compare driving behaviors in normal vs unsafe outcomes. Using a unique real-world naturalistic driving database from the SHRP 2, a test set of 9,593 driving events featuring 2.2 million temporal samples of real-world driving are analyzed. Twenty-four aggregate and segmented driving volatility measures based on acceleration and vehicular jerk are proposed, capturing variations in intentional and unintentional extreme instantaneous driving decisions. Given the possibility of unobserved heterogeneity/omitted variable bias, fixed- and random-parameter discrete choice models are developed that relate crash propensity to driving volatility and other factors. Statistically significant evidence is found that driver volatilities in near-crash and crash events are significantly greater than volatility in normal driving events. After controlling for traffic, roadway, and unobserved factors, the results suggest that greater intentional volatility increases the likelihood of both crash and near-crash events. Importantly, intentional volatility in longitudinal negative jerk has more negative consequences than intentional volatility in positive vehicular jerk. Compared to acceleration/deceleration, vehicular jerk can better characterize the volatility in microscopic driving decisions. The study demonstrates the value of big data analytics for understanding extreme driving behaviors in safe vs. unsafe driving outcomes.

Wali, Behram↗
DOE OSTI2020

NREL Transforms Energy for Innovative Smart and Connected Communities

Smart and connected communities use technology to better manage their urban energy systems and improve the quality and performance of government services by leveraging big data for data-driven decisions. NREL helps these communities reach their clean energy goals through cutting-edge expertise in planning, data, analytical tools, and technical support.

partnering with cities↗
DOE OSTI2020

Coffea -- Columnar Object Framework For Effective Analysis

The coffea framework provides a new approach to High-Energy Physics analysis, via columnar operations, that improves time-to-insight, scalability, portability, and reproducibility of analysis. It is implemented with the Python programming language, the scientific python package ecosystem, and commodity big data technologies. To achieve this suite of improvements across many use cases, coffea takes a factorized approach, separating the analysis implementation and data delivery scheme. All analysis operations are implemented using the NumPy or awkward-array packages which are wrapped to yield user code whose purpose is quickly intuited. Various data delivery schemes are wrapped into a common front-end which accepts user inputs and code, and returns user defined outputs. We will discuss our experience in implementing analysis of CMS data using the coffea framework along with a discussion of the user experience and future directions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Raman Microscopy Analysis of Wyoming CarbonSAFE Pilot Well Thin Sections for Mineralogy and Organic Matter Characterization

Scanning confocal Raman microspectroscopy (RMS) was used to analyze thin sections for inorganic mineral content and for evaluation of organic material (OM). Thin sections were selected from a stratigraphic test well core in the Powder River Basin, Wyoming under the Wyoming CarbonSAFE project. The well was analyzed with a variety of rock and fluid characterization techniques to determine the feasibility of a commercial-scale CO2 storage site. RMS complements other analyses, including traditional petrography, SEM, porosity and permeability, and XRD For this aspect of the study, RMS is especially important in the evaluation of OM in sealing lithologies. At prospective geologic CO2 storage sites, it is imperative to assess the unconventional oil and gas potential of seals to ensure that any future development would not compromise the integrity of the seals. Whole-slide mineralogical surveys were performed on thin sections from various shale and sandstone formations. Surveys were analyzed with Direct Classical Least Squares to identify and quantify minerals. The location and concentration of minerals was color-coded and overlaid on optical images for visualization of the distribution of minerals. Dense hyperspectral Raman mapping of OM was performed on five thin sections. Eleven spectral parameters diagnostic of organic type and thermal maturity were used to train a Partial Least Squares (PLS) calibration against a set of artificially matured samples spanning the pre- to mid-oil window. The PLS was applied to the study set and a post-mature set. Additionally, the PLS was applied to each point in hyperspectral maps for visualization of trends in maturity across sample sets and discrimination of organic matter types within a given map. In inorganic surveys on thin sections, a total of 14 unique inorganic minerals were identified in Raman spectra including quartz, dolomite, calcite, hematite and anhydrite. Shale thin sections tended to be dominated by organic material. OM was often observed mixed with inorganic minerals. Sand- and mudstones were dominated by inorganic minerals. The PLS extrapolated the post-mature set to reflectances >1.2%. The study set ranged from very immature to postmature in the median of map fit-peak parameters. However, point maturity maps indicate that matrix OM in all study samples is immature and that discreet organic particles selected for mapping, which may be inertinites, bias medians towards more-mature. The work demonstrates the capabilities of RMS to perform both whole-slide mineralogy and OM analysis with applications to formation evaluation in oil & gas, carbon sequestration and mining. Here, analysis of sealing formations in the well indicates high levels of immature organic matter that would not be a viable target for future oil production that could compromise the CO2 storage site. The work brings together diverse disciplines from geology and petrography to analytical chemistry, big data and microscopy.

Myers, Grant↗
DOE OSTI2022

Inferring Structural Parameters of Low-Surface-Brightness-Galaxies with Uncertainty Quantification using Bayesian Neural Networks

Measuring the structural parameters (size, total brightness, light concentration, etc.) of galaxies is a significant first step towards a quantitative description of different galaxy populations. In this work, we demonstrate that a Bayesian Neural Network (BNN) can be used for the inference, with uncertainty quantification, of such morphological parameters from simulated low-surface-brightness galaxy images. Compared to traditional profile-fitting methods, we show that the uncertainties obtained using BNNs are comparable in magnitude, well-calibrated, and the point estimates of the parameters are closer to the true values. Our method is also significantly faster, which is very important with the advent of the era of large galaxy surveys and big data in astrophysics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Toward designing effective exascale scientific computing workflows: experiences and best practices

Many fields within scientific computing have embraced advances in big-data analysis and machine learning, which often requires the deployment of large, distributed and complicated workflows that may combine training neural networks, performing simulations, running inference, and performing database queries and data analysis in asynchronous, parallel and pipelined execution frameworks. Such a shift has brought into focus the need for scalable, efficient workflow management solutions with reproducibility, error and provenance handling, traceability, and checkpoint-restart capabilities, among other needs. Here, we discuss challenges and best-practices for deploying exascale-generation computational science workflows on resources at the Oak Ridge Leadership Computing Facility (OLCF). We present our experiences with large-scale deployment of distributed workflows on the Summit supercomputer, including for bioinformatics and computational biophysics, materials science, and deep learning model optimization. We also present problems and solutions created by working within a Python-centric software base on traditional HPC systems, and discuss steps that will be required before the convergence of HPC, AI, and data science can be fully realized. Our results point to a wealth of exciting new possibilities for harnessing this convergence to tackle new scientific challenges.

Coletti, Mark↗
DOE OSTI2016

Development and Application of Virtual Nuclear Power Plant Platform Concerning Environment and Society Digitally

Virtual Nuclear Power Plant, named Virtual4DS, which is developed by the advanced nuclear energy research team (FDS Team), is a platform for full range, whole cycle safety assessment and emergency decision of nuclear power plant in the digital environment and society. The function framework of Virtual4DS is shown in Fig. 1, and it is designed to ensure an overall optimization design of nuclear power plant, achieve comprehensive evaluation of safety and control of risk, and supply the decision support for accident emergency by the accident probability analysis, environmental consequence assessment and public risk evaluation built on the core of digital reactor and the foundation of the nuclear energy big data. Therefore, Virtual4DS is eligible to be applied in reactor safety, radiation safety and environment impact, emergency and public safety. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗