Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

Strategies for concurrent processing of complex algorithms in data driven architectures

The results of ongoing research directed at developing a graph theoretical model for describing data and control flow associated with the execution of large grained algorithms in a spatial distributed computer environment is presented. This model is identified by the acronym ATAMM (Algorithm/Architecture Mapping Model). The purpose of such a model is to provide a basis for establishing rules for relating an algorithm to its execution in a multiprocessor environment. Specifications derived from the model lead directly to the description of a data flow architecture which is a consequence of the inherent behavior of the data and control flow described by the model. The purpose of the ATAMM based architecture is to optimize computational concurrency in the multiprocessor environment and to provide an analytical basis for performance evaluation. The ATAMM model and architecture specifications are demonstrated on a prototype system for concept validation.

Stoughton, John W.↗
DOE OSTI2021

Data-driven estimation of energy consumption for electric bus under real-world driving conditions

Reliable and accurate estimation of an electric bus’s instantaneous energy consumption is critical in evaluating energy impacts of planning and control of electric bus operations. In this study, we developed machine learning-based long short-term memory (LSTM) and artificial neural network (ANN) models to estimate 1 Hz energy consumption of electric buses based on continuous monitoring data of electric buses in Chattanooga, Tennessee, in 2019 and 2020. We propose a data-partitioning algorithm to separate energy charging and discharging modes before applying data-driven estimation models. Here, a K-fold cross-validation-based model selection process was conducted to identify the optimal model structure and input variables in terms of prediction accuracy. The estimation results show the predicted mean absolute percentage error rates of LSTM and ANN models were 3% and 5%, respectively. We compared the proposed models with existing models in the literature based on the same testing data to demonstrate the predictability of our models.

Artificial neural network↗
DOE OSTI2022

Seismic Tomographic Modeling of the Crust and Upper Mantle beneath Israel and the Middle East: Improved Resolution through Optimized Model Parameterization

Accurate regional seismic travel-time (RSTT) predictions rely on regional phases (e.g., Pg, Lg, Pn, Sn ) to account for 3D effects in the crust and upper mantle that are not captured by 1D models traditionally used for real-time location. The RSTT prediction model accounts for regional-scale crust and upper mantle structure globally by incorporating regional seismic phases into its travel-time calculations. Previous versions of the RSTT model have used a constant grid cell size of 1°. To improve the tomographic accuracy of recovering velocity structure at regional scales, we, in this study, perform data-driven grid refinement on the RSTT model down to a 0.125° grid (~14 km) in pursuit of two main goals: (1) to test the limits of RSTT capability and accuracy of determined velocity structure through variable grid refinement and (2) to image smaller structures in Israel and the Middle East and illuminate upper mantle dynamics operating in this complex tectonic area. We investigate the effects of model parameterization as grid cell size decreases and the trade-offs between recovered velocity structures. Our final dataset includes 4751 events and 499 stations that recorded 79,344 Pn and 7489 Pg . The variable grid refinement method allows recovery of finer-scale velocity structures and reduces travel-time residuals in areas with the highest data coverage. At smaller grid cell sizes, longer paths need to be upweighted to stabilize the inversion. Results illuminate tectonic features undefined in coarser grid-size models; in particular, we observe mantle perturbations related to the subduction zone around the Cyprian arc and crustal anomalies near the Dead Sea fault and throughout the Anatolian plate.

58 GEOSCIENCES↗
DOE OSTI2022

Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data

Attaining Industry 4.0 for manufacturing operations requires advanced monitoring systems and real-time data analytics of plant data, among other topics. We propose a Probabilistic Bidirectional Recurrent Network (PBRN) for industrial process monitoring for the early detection of faults. The model is based on a Gated Recurrent Unit (GRU) neural network that allows the model to retain long-term dependencies between sensor data along a time horizon, hence learning the dynamic behavior of the process. To reduce the false-positive detection rate of the model, we compel the model to learn from a highly noisy sensor reading while outputting noise-free sensor outputs. The performance of the proposed model is compared to other data-driven statistical process monitoring schemes using real plant data from an industrial Air Separations Unit (ASU) containing noisy sensor readings. We show that the model can learn from noisy data without reducing its performance. Using two different fault cases, we demonstrate the model’s ability to carry out early fault detection with average false-positive rates of 2.9% and 4.9% for both fault cases. The missed detection rates are 0.1% and 0.2%, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Machine learning assisted modeling of mixing timescale for LES/PDF of high-Karlovitz turbulent premixed combustion

Accurate modeling of mixing in the transported probability density function (PDF) method remains a great challenge, especially for turbulent premixed combustion under extreme conditions such as high Karlovitz number Ka. Recently, a power-law based mixing timescale model was developed for the large-eddy simulations (LES)/PDF modeling of high-Ka number turbulent premixed flames. It is found in this work that the power-law mixing timescale model is highly sensitive to the model parameters. It is thus critically needed to develop accurate calibration of these model parameters. The empirical specification of the model parameters developed in Zhang et. al. is found to be inadequate for accurate modeling of the mixing timescale. Here, machine learning is introduced as an attractive alternative in this work for the specification of the model parameters. A high-Ka number DNS jet flame is used as the training and validation of the machine learning models. The choices of the input parameters are discussed and compared for the machine learning models. The effect of differential molecular diffusion on mixing is examined by including the effect of the Lewis number in the training of the machine learning models. The performance of different machine learning algorithms is compared for the specification of the mixing model parameters. Overall, excellent performance of the machine learning models is observed for assisting the mixing modeling. The feasibility, interpretability, applicability, generality, and portability of using machine learning are discussed in general to provide a perspective on applying data-driven machine learning for turbulent combustion modeling studies.

42 ENGINEERING↗
DOE OSTI2023

Hierarchical Model Reduction Driven by Machine Learning for Parametric Advection-Diffusion-Reaction Problems in the Presence of Noisy Data

Abstract We propose a new approach to generate a reliable reduced model for a parametric elliptic problem, in the presence of noisy data. The reference model reduction procedure is the directional HiPOD method, which combines Hierarchical Model reduction with a standard Proper Orthogonal Decomposition, according to an offline/online paradigm. In this paper we show that directional HiPOD looses in terms of accuracy when problem data are affected by noise. This is due to the interpolation driving the online phase, since it replicates, by definition, the noise trend. To overcome this limit, we replace interpolation with Machine Learning fitting models which better discriminate relevant physical features in the data from irrelevant unstructured noise. The numerical assessment, although preliminary, confirms the potentialities of the new approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Data-driven insights into the fluorescence of asphaltene aggregates using extended Frenkel exciton model

The origin of the fluorescence redshift during asphaltene aggregation remains debated due to the great diversity of asphaltene molecules, while the extended Frenkel exciton model provided a theoretical framework for studying multi-chromophore systems, such as asphaltene aggregates. We investigated the fluorescence energy of hundreds of asphaltene dimers based on 133 experimental revealed asphaltene monomer structures. Our result shows that the dimer's fluorescence energy is always lower than both of its monomers regardless of its intermolecular conformation, with its redshift dominated by superexchange. The dimer oscillator strength predominantly depends on the monomer with the lower fluorescence energy, and the involvement of charge-transfer states and the cancellation between monomer transition dipole moments suppressed the fluorescence especially when two monomers have similar fluorescence energy. The above-mentioned findings hold for all asphaltene dimers despite their diversity, which offers a theoretical interpretation for comprehending the relationship between asphaltene aggregation and its fluorescence variation. Furthermore, this work provides theoretical guidance to other research areas related to organic planar conjugated systems with multiple chromophores.

Chemistry↗
DOE OSTI2026

High-Performance Semiempirical Excited-State Molecular Dynamics Powered by Graphics Processing Units

Here, this Letter introduces excited-state molecular dynamics in PYSEQM, a GPU-accelerated semiempirical quantum chemistry engine implemented in PyTorch. The new module enables Born–Oppenheimer molecular dynamics (BOMD) using configuration-interaction singles and random phase approximation for excited states, allowing long trajectories and large statistical ensembles to be simulated efficiently on a single GPU. We also implement an extended Lagrangian excited-state BOMD (XL-ESMD) scheme that propagates auxiliary electronic variables, enabling relaxed ground and excited-state convergence thresholds without compromising energy conservation. The excited-state BOMD implementation scales smoothly from small chromophores to a nearly 900-atom dendrimer (taking 6.5 s per MD step). PYSEQM also supports batched execution, allowing many geometries or trajectories to be evaluated in a single GPU launch, substantially increasing throughput and making ensemble-based protocols routine. As a demonstration, we compute absorption, emission, and infrared spectra from trajectories propagated on the ground and first excited states. The XL-ESMD scheme yields identical spectra at significantly lower computational cost, establishing the role of extended Lagrangian based dynamics for efficient excited-state BOMD simulations. Beyond raw performance, PYSEQM’s PyTorch foundation provides automatic differentiation for forces, efficient GPU batching, and seamless interfacing with machine learning models. These capabilities position PYSEQM as a practical platform for machine learning-augmented excited-state dynamics and lay the foundation for future data-driven nonadiabatic excited-state dynamics modeling of ultrafast spectroscopic probes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

Logan, Jeremy↗
NASA NTRS2010

Shorebird Migration Patterns in Response to Climate Change: A Modeling Approach

The availability of satellite remote sensing observations at multiple spatial and temporal scales, coupled with advances in climate modeling and information technologies offer new opportunities for the application of mechanistic models to predict how continental scale bird migration patterns may change in response to environmental change. In earlier studies, we explored the phenotypic plasticity of a migratory population of Pectoral sandpipers by simulating the movement patterns of an ensemble of 10,000 individual birds in response to changes in stopover locations as an indicator of the impacts of wetland loss and inter-annual variability on the fitness of migratory shorebirds. We used an individual based, biophysical migration model, driven by remotely sensed land surface data, climate data, and biological field data. Mean stop-over durations and stop-over frequency with latitude predicted from our model for nominal cases were consistent with results reported in the literature and available field data. In this study, we take advantage of new computing capabilities enabled by recent GP-GPU computing paradigms and commodity hardware (general purchase computing on graphics processing units). Several aspects of our individual based (agent modeling) approach lend themselves well to GP-GPU computing. We have been able to allocate compute-intensive tasks to the graphics processing units, and now simulate ensembles of 400,000 birds at varying spatial resolutions along the central North American flyway. We are incorporating additional, species specific, mechanistic processes to better reflect the processes underlying bird phenotypic plasticity responses to different climate change scenarios in the central U.S.

Smith, James A.↗
DOE OSTI2023

Computational insights into the interaction of water with the UiO-66 metal–organic framework and its functionalized derivatives

The UiO-66 metal–organic framework (MOF) has been identified as a promising hydrophilic material for water harvesting. Recent studies show that its water uptake ability at low relative humidity (RH) can be improved by incorporating hydrophilic functional groups into the framework. In this work, we provide computational insights into the adsorption of water in UiO-66 and its functionalized derivatives to reveal the role played by different adsorption sites and functional groups in the adsorption mechanism. We started by developing molecular models for UiO-66, UiO-66-NH 2 , UiO-66-OH, and UiO-66-(OH) 2 compatible with the MB-pol data-driven many-body potential of water. We then benchmarked these models against ab initio data. Here we used these models to perform molecular dynamics simulations and calculate radial distribution functions, IR spectra, and two-dimensional density distribution maps for water in the MOFs. These results consistently show that the μ 3 -OH sites are the preferential interaction sites for water in UiO-66 and all its variants, and the formation of localised water clusters inside the octahedral pores is responsible for the abrupt step in the experimental adsorption isotherms. Furthermore, the presence of functional groups in the framework allows water to cluster in the octahedral pores at lower RH, thus making the MOF a more efficient water harvester. Overall, this study provides molecular-level insights into the pore filling process of UiO-66 and its functionalized derivatives, which are needed for the design of efficient water harvesting materials based on MOFs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Parameterizations of Entrainment-Mixing Mechanisms and their Effects on Cloud Droplet Spectral Width Based on Numerical Simulations

Entrainment-mixing mechanisms significantly affect cloud droplet number concentration, radius, and spectral shape. Quantitative examination of entrainment-mixing effects on cloud droplet spectral width is lacking. Here, we examine the effects of entrainment-mixing processes on cloud microphysics by 12,218 different setups, each simulated 10 times using the Explicit Mixing Parcel Model (EMPM) driven by the observational data from the Third Tibetan Plateau Atmospheric Scientific Experiment (TIPEX-III) campaign. Parameterizations of entrainment-mixing mechanisms are developed by relating homogeneous mixing degree to transition scale number that depends on the dissipation rate and droplet evaporation time scale. The correlation between relative dispersion of cloud droplet size distribution and homogeneous mixing degree changes from negative to positive with the decreasing homogeneous mixing degree. The different relationships are closely related to the competition between complete and partial droplet evaporation and the number concentration of small droplets, which are quantitatively described by two newly introduced dimensionless numbers. The competition is significantly affected by relative humidity and mixing fraction of entrained air as well as turbulence dissipation rate, but not much by cloud droplet number concentration. Especially, when relative humidity and dissipation rate are high, there is only a negative correlation. This study sheds new light on generalizing the homogeneous/inhomogeneous concept by considering relative dispersion, and also provides parameterizations of entrainment-mixing processes and relative dispersion for atmospheric models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Scalable Data-Intensive Geocomputation: A Design for Real-Time Continental Flood Inundation Mapping

The convergence of data-intensive and extreme-scale computing enables an integrated software and data ecosystem for scientific discovery. Developments in this realm will fuel transformative research in data-driven interdisciplinary domains. Geocomputation provides computing paradigms in Geographic Information Systems (GIS) for interactive computing of geographic data, processes, models, and maps. Because GIS is data-driven, the computational scalability of a geocomputation workflow is directly related to the scale of the GIS data layers, their resolution and extent, as well as the velocity of the geo-located data streams to be processed. Unique in high user interactivity and low end-to-end latency requirements, geocomputation applications will dramatically benefit from the convergence of high-end data analytics (HDA) and high-performance computing (HPC). The application level challenge, however, is to identify and eliminate computational bottlenecks that arise along a geocomputation workflow. Indeed, poor scalability at any of the workflow components is detrimental to the entire end-to-end pipeline. Here, we study a large geocomputation use case in flood inundation mapping that handles multiple national-scale geospatial datasets and targets low end-to-end latency. We discuss benefits and challenges for harnessing both HDA and HPC for data-intensive geospatial data processing and intensive numerical modeling of geographic processes. We propose an HDA+HPC geocomputation architecture design that couples HDA (e.g., Spark)-based spatial data handling and HPC-based parallel data modeling. Key techniques for coupling HDA and HPC to bridge the two different software stacks are reviewed and discussed.

Liu, Yan↗
DOE OSTI2020

GIS-Based Modeling of Contaminated Soil Volumes at Multiple Sites in the Formerly Utilized Sites Remedial Action Program - 20149

The remediation of hazardous, toxic, and radioactive waste (HTRW) sites produces cost-related risks associated with the estimation of contaminated soil or debris volumes. Historical risk-management techniques include cost contingencies to cover volume uncertainties that affect project budgeting and decision-making. The Buffalo District teamed with project partners to lessen volume uncertainty and reduce project risks at multiple HTRW sites managed under the Formerly Utilized Sites Remedial Action Program (FUSRAP). Historical remedial investigations under FUSRAP commonly identified the presence of radiological material in site media, the associated human health risk, and then areas of remediation. To manage remedial execution and reduce risk, pre-design or remediation-phase sampling essentially 'chased' contamination, which was not conducive to efficient predictive budgeting derived from Feasibility Study (FS) cost analyses. The Buffalo District first optimized their approach to better understand volume uncertainty by utilizing the Argonne National Laboratory's Bayesian Approaches for Adaptive Spatial Sampling (BAASS) software [1]. BAASS processed soft data (e.g., gamma walk-over data) and spatial sampling data to estimate the lateral extent of contaminated soil irrespective of depth (i.e., gross contamination extent) and define areas of contaminant uncertainty. The software performed a binary transformation of contaminant concentrations at all sampling points based upon remedial action goals or a sum of ratios approach (i.e., clean, impacted, or range of impacts in soil). The model produced two-dimensional (horizontal) contaminant probability contours and statistical uncertainty in the sampling coverage and resulting contaminant extents. This method was translated vertically by partitioning the sampling data into depth brackets that produced a stacked representation of contaminant extents and uncertainty in the subsurface (i.e., similar to construction lifts). The results commonly led to a better understanding of project uncertainty and the need for sampling strategies that produce high-confidence soil volumes, which control costs. The BAASS-based delineations were eventually replaced by Empirical Bayesian Kriging (EBK) methods available in ArcGIS Spatial or 3D Analysts [2]. The EBK method calculates contaminant probability zones derived from user-controlled semivariograms of the spatial datasets. The resulting probability zones (e.g., 50% or 80% of contaminant probability) represent the two-dimensional surface delineation of the overall horizontal remedial area, similarly to BAASS. However, unlike BAASS, the vertical sampling data within these probability zones became vertical control points to contour a subterranean surface that connects subsurface points to the land-surface delineations of contamination. The resulting representation of horizontal and vertical impacts within an enclosed envelop (volume) of soil included uncertainty distributions that are used to plan uncertainty-reduction sampling. These data-driven and math-based models of three-dimensional sampling results produced well-bounded remedial volumes for project planning and better uncertainty predictions during project budgeting. The EBK method was applied to several FUSRAP sites managed by the Buffalo District and compared to less rigorously modeled sites previously remediated by the District. The comparison of modeled to actual remediated volumes provide a basis for validating the volume-estimation method. This comparison is important to ensure modeled volumes match physical boundaries of site remediation. FUSRAP sites with denser investigative sampling and lesser volume uncertainty proved useful in remedial planning and contracting. The Buffalo District noted that historical sites with sparser sampling arrays had greater disparity between estimated volumes and final remedial volumes. The benefit achieved over the cost of detailed soil sampling appears positive for FUSRAP projects, especially where impacts vary widely and appear unbounded by investigation-phase sampling. The subsequent Empirical Bayesian Kriging of contamination coupled with vertical contouring for soil estimations reduces uncertainty in soil volumes or indicates where sampling is required to reduce uncertainty, which together optimize remedial planning and budgeting. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2012

NASA's Carbon Monitoring System Flux-Pilot Project: A Multi-Component Analysis System for Carbon-Cycle Research and Monitoring

The importance of greenhouse gas increases for climate motivates NASA s observing strategy for CO2 from space, including the forthcoming Orbiting Carbon Observatory (OCO-2) mission. Carbon cycle monitoring, including attribution of atmospheric concentrations to regional emissions and uptake, requires a robust modeling and analysis infrastructure to optimally extract information from the observations. NASA's Carbon-Monitoring System Flux-Pilot Project (FPP) is a prototype for such analysis, combining a set of unique tools to facilitate analysis of atmospheric CO2 along with fluxes between the atmosphere and the terrestrial biosphere or ocean. NASA's analysis system is unique, in that it combines information and expertise from the land, oceanic, and atmospheric branches of the carbon cycle and includes some estimates of uncertainty. Numerous existing space-based missions provide information of relevance to the carbon cycle. This study describes the components of the FPP framework, assessing the realism of computed fluxes, thus providing the basis for research and monitoring applications. Fluxes are computed using data-constrained terrestrial biosphere models and physical ocean models, driven by atmospheric observations and assimilating ocean-color information. Use of two estimates provides a measure of uncertainty in the fluxes. Along with inventories of other emissions, these data-derived fluxes are used in transport models to assess their consistency with atmospheric CO2 observations. Closure is achieved by using a four-dimensional data assimilation (inverse) approach that adjusts the terrestrial biosphere fluxes to make them consistent with the atmospheric CO2 observations. Results will be shown, illustrating the year-to-year variations in land biospheric and oceanic fluxes computed in the FPP. The signals of these surface-flux variations on atmospheric CO2 will be isolated using forward modeling tools, which also incorporate estimates of transport error. The results will be discussed in the context of interannual variability of observed atmospheric CO2 distributions.

Pawson, S.↗
DOE OSTI2026

Knowledge-guided learning with curated prior genetic biomarkers for robust model interpretation

Abstract Motivation Knowledge-guided learning offers effective and robust model training strategies in data-scarce settings by incorporating established domain knowledge, thereby enhancing generalization, robustness, and interpretability. By contrast, conventional deep learning approaches rely purely on data-driven learning, which can limit robust model interpretability, particularly in high-dimensional settings with limited size samples. In computational biology, knowledge-guided learning has primarily leveraged network- and structural-based knowledge, leading to biologically interpretable representations and enhanced predictive performance compared to conventional approaches. However, curated biomarkers, one of the most accessible forms of biological knowledge, remain largely unexplored within knowledge-guided paradigms. Results In this study, we propose a model-agnostic training paradigm, Biomarker-driven Explainable Prior-guided Learning (BioExPL), that can be applied to any neural networks that incorporates curated prior knowledge. BioExPL enforces neural networks to reflect curated biomarker priors in their latent representations through a novel knowledge-alignment loss. BioExPL consistently demonstrated significantly improved predictive performance and enhanced model interpretability with minimized computational overhead in simulation studies and intensive experiments on multiple cancer datasets. BioExPL not only integrates prior curated knowledge into the model but also accurately identifies unknown associated signals additionally. BioExPL is model-agnostic and domain-independent, enabling its integration into diverse neural network architectures. Availability and implementation The open-source is publicly available at: https://github.com/datax-lab/BioExPL.

Baek, Beomsu [Department of Computer Science, Univ↗
NASA NTRS1988

Improved canopy reflectance modeling and scene inference through improved understanding of scene pattern

The Li-Strahler reflectance model, driven by LANDSAT Thematic Mapper (TM) data, provided regional estimates of tree size and density within 20 percent of sampled values in two bioclimatic zones in West Africa. This model exploits tree geometry in an inversion technique to predict average tree size and density from reflectance data using a few simple parameters measured in the field (spatial pattern, shape, and size distribution of trees) and in the imagery (spectral signatures of scene components). Trees are treated as simply shaped objects, and multispectral reflectance of a pixel is assumed to be related only to the proportions of tree crown, shadow, and understory in the pixel. These, in turn, are a direct function of the number and size of trees, the solar illumination angle, and the spectral signatures of crown, shadow and understory. Given the variance in reflectance from pixel to pixel within a homogeneous area of woodland, caused by the variation in the number and size of trees, the model can be inverted to give estimates of average tree size and density. Because the inversion is sensitive to correct determination of component signatures, predictions are not accurate for small areas.

Franklin, Janet↗