Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data intensive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A HPC Theory-Guided Machine Learning Cyberinfrastructure for Communicating Hydrometeorological Data Across Scales

High-resolution predictions of hydrometeorological variables are critical for supporting hydropower generation decisions and flood control at hydroelectric power plants. Traditional climate and hydrologic models rely on the numerical simulation of detailed physical processes. Therefore, running these simulations is time-, labor-, and computation-intensive. Improving the spatial and temporal resolution in these modeling outputs could lead to cubic increases in both the simulation time and computational demands, rendering high-resolution hydrometeorological predictions expensive and impractical. Many past studies apply the super resolution (SR) technique to downscale climate models using deep learners. However, deep learners are deemed “black-boxes,” as their derivation processes from low-resolution outputs to high-resolution outputs are often hidden. Their results are difficult for domain scientists to interpret and validate. Thus, there is a need for an exploratory machine learning approach that can partially integrate domain-specific theory and knowledge into the data-driven mapping process between simulation outputs of different spatial scales. The domain-specific theory and knowledge can be incorporated into the data model through an inductive approach in which process-related environmental variables are used and analyzed as key drivers (i.e., environmental surrogates) to reflect the complex physical processes. Many of these variables, such as land use land cover, soil types, topography, digital elevation, air temperature, and various watershed characteristics, can be directly measured through sensors or remote sensing techniques. Additionally, SR applications that can downscale hydrological and hydrodynamics models to efficiently produce high-resolution (1 m) flood depth grids are still rare. Since the flood depth grid can be used to support critical decisions for flood control operation at hydroelectric power plants, it is crucial to enable an SR-based capability for interpolating high-resolution flood inundation maps.

13 HYDRO ENERGY↗
DOE OSTI2019

Efficient surrogate modeling methods for large-scale Earth system models based on machine-learning techniques

Abstract. Improving predictive understanding of Earth system variability and change requires data–model integration. Efficient data–model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a surrogate of a large-scale Earth system model (ESM) with many output variables is computationally intensive because it involves a large number of expensive ESM simulations. In this effort, we propose an efficient surrogate method capable of using a few ESM runs to build an accurate and fast-to-evaluate surrogate system of model outputs over large spatial and temporal domains. We first use singular value decomposition to reduce the output dimensions and then use Bayesian optimization techniques to generate an accurate neural network surrogate model based on limited ESM simulation samples. Our machine-learning-based surrogate methods can build and evaluate a large surrogate system of many variables quickly. Thus, whenever the quantities of interest change, such as a different objective function, a new site, and a longer simulation time, we can simply extract the information of interest from the surrogate system without rebuilding new surrogates, which significantly reduces computational efforts. We apply the proposed method to a regional ecosystem model to approximate the relationship between eight model parameters and 42 660 carbon flux outputs. Results indicate that using only 20 model simulations, we can build an accurate surrogate system of the 42 660 variables, wherein the consistency between the surrogate prediction and actual model simulation is 0.93 and the mean squared error is 0.02. This highly accurate and fast-to-evaluate surrogate system will greatly enhance the computational efficiency of data–model integration to improve predictions and advance our understanding of the Earth system.

58 GEOSCIENCES↗
DOE OSTI2024

Convolutional Non-Homogeneous Poisson Process and its Application to Wildfire Ignition Risk Quantification for Power Delivery Networks

To quantify wildfire ignition risks on power delivery networks, the current practice predominantly relies on the empirically calculated fire danger indices, which may not well capture the effects of dynamically changing environmental factors. This article proposes a spatio-temporal point process model, known as the Convolutional Non-homogeneous Poisson Process (cNHPP), and applies the model to quantify wildfire ignition risks for power delivery networks. The proposed model captures both the current (i.e., instantaneous) and cumulative (i.e., historical) effects of key environmental processes (i.e., covariates) on wildfire risks, as well as the spatio-temporal dependency among different segments of the power delivery network. The computation and interpretation of the intensity function are thoroughly investigated. We apply the proposed approach to estimate wildfire ignition risks on major transmission lines in California, using historical fire data, meteorological and vegetation data obtained from the National Oceanic and Atmospheric Administration and National Aeronautics and Space Administration. Here, a comprehensive comparison study is performed to show the applicability and predictive capability of the proposed approach.

Non-homogeneous Poisson Process↗
DOE OSTI2022

Lighting System Control Data to Improve Design and Operation: Tunable Lighting System Data from NICU Patient Rooms

The advancement of LED and controls technology, computing capacity, and software provides new opportunities for researchers and designers to work together to further optimize spaces for occupant benefit. Here, lighting system control data from five neonatal intensive care unit patient rooms was collected over a 25-week monitoring period and analyzed to better understand occupant response to a tunable lighting system with automatic transitions throughout the day. Lighting systems are very rarely refined after installation based on actual use. Objective data detailing how the lighting system is used by the actual occupants highlights the opportunities for optimization after installation and provides insight for improving the next design. As use of the data becomes more commonplace, it can be leveraged for design recommendations. The collection of the data required no additional cost beyond the time for examining the data. The analysis revealed several clear opportunities for improvement, including adjustments to the default control setting at night, re-labeling of the control stations, and adjustments to the nighttime fade rate. The patient room occupants were active users of the different zones, dimming options, and manual overrides made available by the lighting system.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1972

An investigation of satellites to the resonance lines in some hydrogen-like ions

An experimental and theoretical investigation was conducted on the origin of satellite to resonance lines of the hydrogen-like ions of boron, carbon, and nitrogen. A theta pinch was employed with a grazing incidence spectrograph to measure the wavelengths of the satellites. The spectroscopic data also provided an estimate of the satellite/resonance line intensity ratio. Wavelengths of spectral lines due to transition from doubly excited states were calculated by a Hartree-Fock computer program. Wave functions were also calculated and were used to obtain the oscillator strengths of the transitions. Experimental work confirmed that the lines investigated were not satellites but were due to highly ionized argon which was present as an impurity in the filling gas.

Jalufka, N. W.↗
NASA NTRS1983

Contributions of divergent and nondivergent winds to the kinetic energy balance of a severe storm environment

Divergent and rotational components of the synoptic scale kinetic energy balance are presented using rawinsonde data at 3 and 6 h intervals from the Atmospheric Variability Experiment (AVE 4). Two intense thunderstorm complexes occurred during the period. Energy budgets are described for the entire computational region and for limited volumes that enclose and move with the convection. Although small in magnitude, the divergent wind component played an important role in the cross contour generation and horizontal flux divergence of kinetic energy. The importance of V sub D appears directly to the presence and intensity of convection within the area. Although K sub D usually comprised less than 10 percent of the total kinetic energy content within the storm environment, as much as 87 percent of the total horizontal flux divergence and 68 percent of the total cross contour generation was due to the divergent component in the upper atmosphere. Generation of kinetic energy by the divergent component appears to be a major factor in the creation of an upper level wind maximum on the poleward side of one of the complexes. A random error analysis is presented to assess confidence limits in the various energy parameters.

Browning, P. A.↗
NASA NTRS1983

Roles of divergent and rotational winds in the kinetic energy balance during intense convective activity

Contributions of divergent and rotational wind components to the synoptic-scale kinetic energy balance are described using rawinsonde data at 3 and 6 h intervals from NASA's fourth Atmospheric Variability experiment. Two intense thunderstorm complexes occurred during the period. Energy budgets are described for the entire computational region and for limited volumes that enclosed storm-induced, upper level wind maxima located poleward of convection. Although small in magnitude, the divergent wind component played an important role in the cross-contour generation and horizontal flux divergence of kinetic energy. The importance of V(D) appears directly related to the presence and intensity of convection. Although K(D) usually comprised less than 10 percent of the total kinetic energy content, generation of kinetic energy by V(D) was a major factor in the creation of upper-level wind maxima to the north of the storm complexes. Omission of the divergent wind apparently would lead to serious misrepresentations of the energy balance. A random error analysis is presented to assess confidence limits in the various energy parameters.

Fuelberg, H. E.↗
NASA NTRS1985

Microwave responses of the western North Atlantic

Features and objects in the Western North Atlantic Ocean - the Eastern Seaboard of the United States - are observed from Earth orbit by passive microwaves. The intensities of their radiated flux signatures are measured and displayed in color as a microwave flux image. The features of flux emitting objects such as the course of the Gulf Stream and the occurrence of cold eddies near the Gulf Stream are identified by contoured patterns of relative flux intensities. The flux signatures of ships and their wakes are displayed and discussed. Metal data buoys and aircraft are detected. Signal to clutter ratios and probabilities of detection are computed from their measured irradiances. Theoretical models and the range equations that explain passive microwave detection using the irradiances of natural sources are summarized.

Stacey, J. M.↗
NASA NTRS2007

Predicting Rocket or Jet Noise in Real Time

A semi-empirical theoretical model and a C++ computer program that implements the model have been developed for use in predicting the noise generated by a rocket or jet engine. The computer program, entitled the Realtime Rocket and Jet Engine Noise Analysis and Prediction Software, is one of two main subsystems of the Acoustic Prediction/Measurement Tool, which comprises software, acoustic instrumentation, and electronic hardware combined to afford integrated capabilities for real-time prediction and measurement of noise emitted by rocket and jet engines. [The other main subsystem, consisting largely of acoustic instrumentation and electronic hardware, is described in Wireless Acoustic Measurement System, which appears elsewhere in this section.] The theoretical model was derived from the fundamental laws of fluid mechanics, as first was done by M. J. Lighthill in his now famous theory of aerodynamically generated sound. The far-field approximation of the Lighthill theory is incorporated into this model. Many other contributions from various researchers have also been introduced into the model. The model accounts for two noise components: shear noise and self noise. The final result of the model is expressed in terms of a volume integral of the acoustic intensities attributable to these two components, subject to various directivity coefficients. The computer program was written to solve the volume integral. The inputs required by the program are two data files from a computational fluid dynamics (CFD) simulation of the flow of interest: the computational-grid file and the solution file. The CFD solution should be one that has been obtained for conditions that closely approximate those of an experimental test that is yet to be performed. In the current state of development of the model and software, it is recommended that the observation points lie along a radius at an angle >60 from the jet axis. The software provides, and is driven via, a graphical user interface, which facilitates its use. Optionally, the program accepts additional input in the form of data on the measured sound pressure level as a function of frequency at a given far-field location, preferably at an angle of 90 from the jet axis. The user is prompted to use default empirical constants or to choose constants based the measurement data. The user can view the results and compare them with other computational or experimental data. Once satisfied with the results, the user can save a graph of the results in a file that can be imported into documents.

Frendi, Kader↗
NASA NTRS2022

Introduction to Analysis Methods for Big Earth Data

Big Earth Data are too big to be tractable to simple data inspection. Thus, they typically require models to make sense of all the data. Useful models for Big Earth Data may be physical, statistical, or machine learning based. While physical models are ideal for understanding the data, they are not always feasible, particularly when our ability to observe at finer scales exceeds our ability to incorporate the physics. Statistical models are more generalized, but computationally intensive for many Earth Observation datasets. Machine Learning models generally scale well but are sometimes limited in the physical understanding they can offer. Hybrid models combine attributes—and advantages—of two or more of these types.

Christopher Lynnes↗
NASA NTRS2019

Automatic Incorporation of Flaws into Cad and FEA Models Based On Measured NDE Data

Automatic incorporation of non-destructive evaluation (NDE) data into CAD and finite element (FE) models for structural analysis is essential for accurate residual-life and strength analyses of composite structures. Currently, two significant but independent challenges exist for incorporating NDE data in such analyses: interpretation of the NDE signals to locate and characterize the structural defects and the incorporation of that information into structural analysis tools. The first challenge will be addressed through linear inversion of calculated synthetic responses generated by a simulation engine to evaluate flaw size, location, and other characteristics. The second challenge will be addressed by building on prior and parallel defect modeling efforts to integrate suitable flaw models into the CAD/finite-element representation of a specimen. Ultrasonic NDE information is usually represented using C-Scans of time-of-flight or intensity information. Other modalities such as thermography and computed tomography (CT) could also be used to characterize the structure. This information will first be projected into material coordinates and then aligned with the specimen’s finite element mesh. The NDE data can then be incorporated by inserting flaw geometry into the CAD and FE analysis model and automatic modification of local material properties and boundary conditions. This process will enable the use of structural analysis tools even for practical modalities such as ultrasound and thermography which may not directly give accurate-enough geometric information to fully define the flaw. The full flaw characteristics will be inferred using prior expert and modeling knowledge to categorize flaw signatures. Outputs for this project will include demonstrated methods for creating structural analysis geometric models that incorporate flaw characterization information; these models can then be used directly in popular commercial FEA software. In addition, the primary deliverable for the project will include a software that will be able to automatically incorporate different kinds of flaws into an existing FE models. The models will be generated in standard file formats to enable direct import into the analysis software.

Adarsh Krishnamurthy↗
DOE OSTI2016

SFU-Driven Transparent Approximation Acceleration on GPUs

Approximate computing, the technique that sacrifices certain amount of accuracy in exchange for substantial performance boost or power reduction, is one of the most promising solutions to enable power control and performance scaling towards exascale. Although most existing approximation designs target the emerging data-intensive applications that are comparatively more error-tolerable, there is still high demand for the acceleration of traditional scientific applications (e.g., weather and nuclear simulation), which often comprise intensive transcendental function calls and are very sensitive to accuracy loss. To address this challenge, we focus on a very important but often ignored approximation unit on GPUs.

Approximate computing↗
DOE OSTI2022

Persistent memory as an effective alternative to random access memory in metagenome assembly

Abstract Background The assembly of metagenomes decomposes members of complex microbe communities and allows the characterization of these genomes without laborious cultivation or single-cell metagenomics. Metagenome assembly is a process that is memory intensive and time consuming. Multi-terabyte sequences can become too large to be assembled on a single computer node, and there is no reliable method to predict the memory requirement due to data-specific memory consumption pattern. Currently, out-of-memory (OOM) is one of the most prevalent factors that causes metagenome assembly failures. Results In this study, we explored the possibility of using Persistent Memory (PMem) as a less expensive substitute for dynamic random access memory (DRAM) to reduce OOM and increase the scalability of metagenome assemblers. We evaluated the execution time and memory usage of three popular metagenome assemblers (MetaSPAdes, MEGAHIT, and MetaHipMer2) in datasets up to one terabase. We found that PMem can enable metagenome assemblers on terabyte-sized datasets by partially or fully substituting DRAM. Depending on the configured DRAM/PMEM ratio, running metagenome assemblies with PMem can achieve a similar speed as DRAM, while in the worst case it showed a roughly two-fold slowdown. In addition, different assemblers displayed distinct memory/speed trade-offs in the same hardware/software environment. Conclusions We demonstrated that PMem is capable of expanding the capacity of DRAM to allow larger metagenome assembly with a potential tradeoff in speed. Because PMem can be used directly without any application-specific code modification, these findings are likely to be generalized to other memory-intensive bioinformatics applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Capabilities of multivariate Bayesian inference toward seismic hazard assessment

Multivariate Bayesian analysis can bring significant benefits to seismic hazard analysis: Its multivariate feature enables computing scalar and vector hazard without making any approximations; Correlations between intensity measures are implicitly modeled, permitting direct simulation of ground motion selection tools such as the conditional mean spectrum and the generalized conditioning intensity measure; and Its updating feature enables a seamless integration of new ground motion data into the hazard results. Here, we first develop a multivariate Bayesian ground motion model through the NGA-West2 database. The model functional form considers fault-type, magnitude, and distance dependencies, and also the linear and the rock intensity dependent site response. We use a hybrid Markov Chain Monte Carlo sampling to perform Bayesian inference consisting of Gibbs step and a multilevel Metropolis-Hastings step. We then perform several checks on the model and note that its performance is satisfactory. Finally, we illustrate the merits of this multivariate Bayesian analysis, which include: ground motion model updating with ground motion data recorded in the last four years not part of the NGA-West2 database; computation of scalar and vector seismic hazard using the un-updated and updated ground motion models for Los Angeles, CA; and simulation of the conditional mean spectrum under scalar and vector IM conditioning while accounting for different sources of aleatoric and epistemic uncertainties.

58 GEOSCIENCES↗
DOE OSTI2018

Towards district scale flood simulations using conventional and anisotropic porosity shallow water models with high-resolution topographic information

Current topographic survey technology provides high-resolution (HR) datasets for urban environments. Incorporating this HR information in models aiming to provide flood risk assessment is desirable because the flood wave propagation is depending on the urban topographic features, i.e. buildings, bridges and street networks. Conceptual, numerical and practical challenges arise from the application of shallow water models to HR urban flood modeling. For example, numerical challenges are occurrence of wet-dry fronts, geometric discontinuities in the urban environment and discontinuous solutions, i.e. shock waves. These challenges can be overcome by using a Godunov-type scheme. However, the computational cost of this type of schemes is high, such that HR two-dimensional shallow water simulations with practical relevance have to be run on supercomputers. The porous shallow water model is an alternative approach that aims to reduce computational cost by using a coarse resolution and accounting for unresolved processes by means of the porosity terms. Usually, a speedup between two and three orders of magnitude in comparison to HR simulations can be obtained. This study presents preliminary results of a practical test case concerning pluvial flooding in a district of the city of Nice, France, caused by the intense rainfall event on October 3rd, 2015. HR topography data set on a 1 m resolution is available for the district, whereby street features of infra-metric dimensions have been included. A reference solution is calculated by a HR shallow water model on a 1 m by 1 m structured computational grid. The porous shallow water model is run on a 10 m by 10 m grid and the influence of the drag source term is studied. The model calculations show a large deviation, which is caused by the poor meshing strategy of the porous shallow water (AP) model. The study also summarizes practical challenges that arise during the application of the AP and HR models to a large urban catchment. The main difficulty is to obtain a good mesh. In smaller scale investigations, the mesh is currently constructed by hand such that the cell edges align with buildings. This approach is not feasible for large scale urban catchments with a large number of buildings. Future steps that have to be taken, such as a strategy for automatic mesh generation, are reported on.

42 ENGINEERING↗
DOE OSTI2015

Final Report for Grant DOE DE-FG02-08ER64573 (Relating to Turbulence Modeling)

Turbulence enhances transport and mixing. Turbulent ocean currents can increase the encounter rate between fish larvae and their prey. Without turbulence, the fuel and air injected into the cylinder of an internal combustion engine would mix too slowly to be effective. Birds extract energy from turbulent winds to soar for great distances without flapping their wings. Turbulence can be detrimental as well. The efficiencies of vehicles, pipelines, and industrial equipment are all hindered by turbulence. Turbulence can also cause structural fatigue, generate unwanted noise, and distort the propagation of electromagnetic signals. These observations highlight the importance of turbulence research. Our ability to predict and control turbulence and, thus, to intensify or suppress its effects as circumstances warrant is contingent on our understanding of the underlying mechanisms. Turbulence is also immensely interesting from a purely scientific perspective and is a great source of fundamentally important, challenging problems for physicists, engineers, and mathematicians. Moreover, various methods and tools developed in the field have found applications in other fields, including nonlinear optics, nonlinear acoustics, pattern formation, image processing, data compression, and econophysics. It is possible, at least away from walls, to derive LES models of very high-order accuracy. However, these models also lead to correspondingly intense computational complexity for their numerical solution. Some also introduce yet more questions on the already difficult problem of specifying needed and sometimes artificial local boundary conditions for the inherently nonlocal flow averages. For these two (and other) reasons, there has been a resurgence of interest in basing simulations of turbulent flows on much simpler regularizations of the Navier–Stokes equations rather than on full models of local averages--i.e., LES models. Initially these were developed as pure theoretical tools. The influx of ideas from LES and the added constraint that the regularization be amenable to numerical simulation have breathed new perspective and thus new life into this thread of ideas.Over the past year, a significant portion of our research activity has focused on numerical studies of the Navier–Stokes-$αβ$ model and extensions thereof. Our results regarding these and other approaches to turbulence modeling are described below.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

The QuakeSim Project: Numerical Simulations for Active Tectonic Processes

In order to develop a solid earth science framework for understanding and studying of active tectonic and earthquake processes, this task develops simulation and analysis tools to study the physics of earthquakes using state-of-the art modeling, data manipulation, and pattern recognition technologies. We develop clearly defined accessible data formats and code protocols as inputs to the simulations. these are adapted to high-performance computers because the solid earth system is extremely complex and nonlinear resulting in computationally intensive problems with millions of unknowns. With these tools it will be possible to construct the more complex models and simulations necessary to develop hazard assessment systems critical for reducing future losses from major earthquakes.

tectonic processes↗
DOE OSTI2024

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗