Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

On the parameter combinations that matter and on those that do not: data-driven studies of parameter (non)identifiability

Abstract We present a data-driven approach to characterizing nonidentifiability of a model’s parameters and illustrate it through dynamic as well as steady kinetic models. By employing Diffusion Maps and their extensions, we discover the minimal combinations of parameters required to characterize the output behavior of a chemical system: a set of effective parameters for the model. Furthermore, we introduce and use a Conformal Autoencoder Neural Network technique, as well as a kernel-based Jointly Smooth Function technique, to disentangle the redundant parameter combinations that do not affect the output behavior from the ones that do. We discuss the interpretability of our data-driven effective parameters, and demonstrate the utility of the approach both for behavior prediction and parameter estimation. In the latter task, it becomes important to describe level sets in parameter space that are consistent with a particular output behavior. We validate our approach on a model of multisite phosphorylation, where a reduced set of effective parameters (nonlinear combinations of the physical ones) has previously been established analytically.

Evangelou, Nikolaos↗
DOE OSTI2026

Automated and High-Throughput Phase Separation Control for Supramolecular Polymer Blends Enabled by Machine Learning

Supramolecular polymer blends (SPBs) offer tunable morphologies that dictate their macroscopic properties, yet their rational design is limited by the absence of predictive structure−morphology models. Here, we introduce a data-driven highthroughput workflow that integrates modular polymer synthesis, robotic formulation, automated morphology characterization, and machine learning (ML) for accelerated SPB discovery. Using a plug-and-play synthetic strategy, 33 hydrogen-bonding endfunctional homopolymers were prepared and orthogonally combined to generate 260 SPBs in 1 day. A fully automated atomic force microscopy (AFM) pipeline enabled systematic imaging, producing 2340 morphology data sets with minimal human intervention. Domain spacings were extracted through complementary imageprocessing methods and used to train ML models. A support vector regression (SVR) model accurately predicted target phase-separation sizes (50, 100, and 150 nm), which were experimentally validated. This work demonstrates the power of coupling high-throughput experimentation with ML to accelerate morphology discovery and provides one of the first large-scale experimental data sets for supramolecular polymer systems.

ML-guided polymer design↗
DOE OSTI2025

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Preliminary Results for Using Uncertainty and Out-of-distribution Detection to Identify Unreliable Predictions.

As machine learning (ML) models are deployed into an ever-diversifying set of application spaces, ranging from self-driving cars to cybersecurity to climate modeling, the need to carefully evaluate model credibility becomes increasingly important. Uncertainty quantification (UQ) provides important information about the ability of a learned model to make sound predictions, often with respect to individual test cases. However, most UQ methods for ML are themselves data-driven and therefore susceptible to the same knowledge gaps as the models themselves. Specifically, UQ helps to identify points near decision boundaries where the models fit the data poorly, yet predictions can score as certain for points that are under-represented by the training data and thus out-of-distribution (OOD). One method for evaluating the quality of both ML models and their associated uncertainty estimates is out-of-distribution detection (OODD). We combine OODD with UQ to provide insights into the reliability of the individual predictions made by an ML model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Neutron detector response modeling in NOvA

Neutrons can present a significant challenge for neutrino experiments in which energy reconstruction is critical. With the ability to escape detection completely and with a weak correlation between their kinetic energy and any eventual energy deposition, it is difficult to fully account for neutrons produced in neutrino interactions. This in turn leads to significant model dependence when evaluating neutron-related systematic uncertainties. The NOvA experiment is a long-baseline neutrino oscillation experiment with a high-statistics sample of antineutrino data collected by its near detector. We report an excess relative to data of simulated neutron candidates with low energy depositions when using standard Geant4 physics lists. The simulation excess is traced to an overabundance of secondary photons produced from interactions of neutrons with kinetic energy greater than \SI{20}{\mega\eV}. Improved agreement with data is obtained by applying the data-driven neutron-on-carbon \menate model for neutrons between \SI{20}{\mega\eV} and ${\sim}$\SI{100}{\mega\eV}. With \menate, the residual oversimulation is more uniform across the calorimetric neutron energy spectrum, suggesting possible overproduction of primary neutrons by the GENIE neutrino interaction generator. These results motivate the adoption of \menate-supplemented Geant4 simulation as the nominal simulation in the production of future \nova simulation.

Abubakar, S.↗
DOE OSTI2025

Discovering CO Adsorption and Desorption Pathways from Chemical Reaction Neural Network Modeling of Transient Kinetics Spectroscopy

Here, we demonstrate a data-driven approach to interpreting surface reactions by combining time-resolved gas pulsing infrared spectroscopy with chemical reaction neural networks (CRNNs). Using CO adsorption and desorption on Pd(111) at 460–490 K as a model system, we show how transient kinetic data can reveal detailed reaction mechanisms. Starting with a simple one-species model, we systematically evaluate increasingly complex mechanisms involving hollow and bridge site adsorption. Despite the similar goodness of fit to the same experimental absorbance data, our models predict distinct coverage dynamics for different adsorption sites. Through analysis of spectral peak stability and predicted dynamics, we identify a mechanism in which CO primarily adsorbs on bridge sites followed by rapid conversion to hollow sites as being the most physically consistent with experimental observations. This work provides a framework for extracting mechanistic insights from limited experimental data, demonstrating how machine learning can bridge the gap between transient kinetic measurements and a molecular-level understanding of surface reactions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Data-driven learning of Mori–Zwanzig operators for isotropic turbulence

Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori–Zwanzig (MZ) formalism provides a mathematically exact procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully resolved isotropic turbulence datasets to extract the Mori–Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the generalized fluctuation–dissipation relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluate the memory effects on prediction. The results show that the prediction errors are strongly affected by the choice of observables and can be further reduced by including the past history of the observables in the memory kernel.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Foundations of machine learning for low-temperature plasmas: methods and case studies

Abstract Machine learning (ML) and artificial intelligence have proven to be an invaluable tool in tackling a vast array of scientific, engineering, and societal problems. The main drivers behind the recent proliferation of ML in practically all aspects of science and technology can be attributed to: (a) improved data acquisition and inexpensive data storage; (b) exponential growth in computing power; and (c) availability of open-source software and resources that have made the use of state-of-the-art ML algorithms widely accessible. The impact of ML on the field of low-temperature plasmas (LTPs) could be particularly significant in the emerging applications that involve plasma treatment of complex interfaces in areas ranging from the manufacture of microelectronics and processing of quantum materials, to the LTP-driven electrification of the chemical industry, and to medicine and biotechnology. This is primarily due to the complex and poorly-understood nature of the plasma-surface interactions in these applications that pose unique challenges to the modeling, diagnostics, and predictive control of LTPs. As the use of ML is becoming more prevalent, it is increasingly paramount for the LTP community to be able to critically analyze and assess the concepts and techniques behind data-driven approaches. To this end, the goal of this paper is to provide a tutorial overview of some of the widely-used ML methods that can be useful, amongst others, for discovering and correlating patterns in the data that may be otherwise impractical to decipher by human intuition alone, for learning multivariable nonlinear data-driven prediction models that are capable of describing the complex behavior of plasma interacting with interfaces, and for guiding the design of experiments to explore the parameter space of plasma-assisted processes in a systematic and resource-efficient manner. We illustrate the utility of various supervised, unsupervised and active learning methods using LTP datasets consisting of commonly-available, information-rich measurements (e.g. optical emission spectra, current–voltage characteristics, scanning electron microscope images, infrared surface temperature measurements, Fourier transform infrared spectra). All the ML demonstrations presented in this paper are carried out using open-source software; the datasets and codes are made publicly available. The FAIR guiding principles for scientific data management and stewardship can accelerate the adoption and development of ML in the LTP community.

Physics↗
DOE OSTI2022

Multi-site assessment of the potential of fine resolution red-edge vegetation indices for estimating gross primary production

Gross primary production (GPP) models driven by fine resolution remote sensing data characterize the spatial and temporal heterogeneities in plant photosynthesis, which is largely dependent on biome-specific maximum photosynthetic capacity. The red-edge reflectance, sensitive to leaf chlorophyll content, is a good proxy of maximum photosynthetic capacity. More importantly, studies show that the red-edge reflectance-related chlorophyll content index (CIr) multiplied by the incident photosynthetic active radiation (PAR in ) strongly correlates to GPP estimated at carbon flux towers (GPP flux ). Yet, to the best of our knowledge, there is no systematic study investigating the general relationship between fine spatial resolution CIr and GPP among biomes and the relationship between CIr and maximum photosynthetic capacity in GPP models. To provide an overview on incorporating space-borne CIr into a GPP model, we applied fine resolution Sentinel-2-derived CIr and GPP flux over 57 flux sites representative of 10 biomes. We investigated the relationship between CIr and GPP flux , and the spatio-temporal relationship between CIr and ecosystem maximum photosynthetic capacity indicated by the potential ecosystem light use efficiency (LUE pot ). We also evaluated the relationship between other five vegetation indices (VIs) and GPP flux . Results showed that the CIr multiplied by PARin has a higher agreement (R 2 > 0.5) with GPP than other VIs. A universal relationship exists between the CIr multiplied by PARin and GPP, except for forest biomes. The CIr also strongly (R 2 > 0.5) relates to the LUE pot during the peak of the growing season. The CIr has a low spatial variance (CV = 0.25) among biomes, highlighting that CIr can be a proxy of maximum photosynthetic capacity in GPP models that do not require biome-dependent coefficients. This study provides insight for incorporating CIr into GPP models and better quantifying global terrestrial photosynthesis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

An Efficient 1-D Thermal Stratification Model for Pool-Type Sodium-Cooled Fast Reactors

Investigating thermal stratification in the upper plenum of a sodium fast reactor (SFR) is presently a technology gap in SFR safety analysis. Understanding thermal stratification will promote safe operation of the SFR before its commercial deployment. Stratified layers of liquid sodium with a large vertical temperature gradient could be established in the upper plenum of an SFR during a down-power or a loss-of-flow transient. These stratified layers are unstable and could result in uncertainties for the core safety of an SFR. In order to predict the occurrence of the thermal stratification efficiently, we developed a one-dimensional (1-D) transport model to estimate the temperature profile of the ambient fluid in the upper plenum. This model demands much less computational effort than computational fluid dynamics (CFD) codes and provides calculations with higher fidelity than historical system-level codes. Two flow conditions were considered separately in the current study depending on if in-vessel components are presented in the upper plenum. For the condition where in-vessel components, specifically the upper internal structure, are presented, we assumed that the impinging sodium was evenly dispersed in the ambient fluid within the distance between the bottom of the in-vessel component and the jet inlet surface. For the condition where no in-vessel components are presented, we assumed that the impinging sodium was evenly dispersed in the ambient fluid within the jet length, which was determined through data-driven trainings. The newly developed 1-D model showed similar performance with the CFD model in both cases. However, due to the assumption of flat profiles of the impinging jet axial dispersion rate, nonnegligible discrepancies between the 1-D prediction and the measured data were observed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Experimental Setup and Learning-Based AI Model for Developing Accurate PV Inverter Models

The integration of power electronics-based interfaces presents challenges due to the absence of detailed models and the high computational complexity. Generic models used in system studies lack accuracy in capturing converter dynamics. This paper proposes a data-driven approach developed from experimental setup data. This approach enhances accuracy in photovoltaic inverter modeling. We used two types of PV inverters in the experiment. The recorded experimental data undergo processing through a machine learning model. Results from the model trained through machine learning is also presented.

artificial intelligence↗
DOE OSTI2023

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado

Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A data-driven framework for predicting machining stability: employing simulated data, operational modal analysis, and enhanced transfer learning

Chatter, a self-excited vibration phenomenon, presents a significant challenge in machining operations, particularly in high-speed milling, where it can degrade tool life, reduce material removal efficiency, and compromise workpiece quality. Addressing this challenge requires a reliable predictive model that can accommodate the complex dynamics of various machining scenarios. This study introduces a novel, data-driven approach to predicting machining stability, leveraging over 140,000 simulated datasets and employing advanced techniques such as operational modal analysis (OMA), enhanced transfer learning (TL), and receptance coupling substructure analysis (RCSA). By integrating these methodologies, the framework effectively classifies and predicts chatter across diverse operational modes, achieving robust and accurate outcomes. Our model utilizes a Random Forest (RF) classifier trained with the comprehensive dataset, which demonstrates substantial improvements in both predictive accuracy and robustness. Specifically, the RF model achieved an accuracy rate of 85%, an area under the curve (AUC) of 0.90, and an F1 score of 0.88, underscoring its capability to adapt to varying machining configurations. These results highlight the framework’s potential to enhance operational efficiency and machining quality by providing reliable chatter predictions across a broad range of machining parameters. In conclusion, this research thus offers a significant advancement in predictive maintenance for machining processes, enabling more stable and efficient manufacturing operations.

42 ENGINEERING↗
DOE OSTI2020

Modeling and Control Using Stochastic Distribution Control Theory for Intersection Traffic Flow

In this work, we investigated stochastic distribution control theory-based traffic signal optimization to achieve a smooth and uniform flow of vehicles through signalized intersections. In this context, the static and linear dynamic stochastic distribution models were developed to express the relationship between the signal timing and the traffic queue length together with its probability density function. Two stochastic distribution control algorithms were designed to control the signal timing at intersections such that the probability density function of the traffic queue of each intersection road segment is made as narrow and as small as possible. Also, a recursive input-output traffic queue estimation model was proposed, which is data-driven and dynamic in nature, to calculate real-time traffic queue length using traffic signal timings and loop-detector data. The control algorithms were evaluated for a one-signal corridor, two-signal corridor, and 2 x 2 network of signalized intersections. MATLAB simulation examples are provided to demonstrate the use of the proposed algorithms and comparison to the existing widely-used semi-actuated control has been made. Desired results were obtained.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Automated vehicle microscopic energy consumption study (AV-Micro): Data collection and model development

While the Adaptive Cruise Control (ACC) system in automated vehicles (AVs) is expected to impact transportation energy significantly, existing AV energy consumption models only directly adopt those developed with Human-driven Vehicle (HV) data without even slight adaptation or calibration to accommodate unique AV energy consumption features. This study will investigate how accurately HV data-based models can predict the energy consumption of AVs. Empirical trajectory data and corresponding instantaneous energy consumption rates from both AVs and HVs were collected. We adopted two classical HV data-based models to fit these data. The calibration results indicated that these models yield around 20 30% prediction errors for AVs. To further improve the prediction accuracy, this study designed an AV-Micro model by incorporating components of multiple classic energy consumption models that better capture ACC energy consumption features, including piecewise driving behavior. With this, the AV-Micro model achieves lower than 10% prediction errors. The AV-Micro model’s high consistency across different test runs was verified with statistical significance tests, demonstrating its adaptability in different driving profiles. To confirm the discrepancies between the energy consumption features of AVs and HVs, more statistical significance tests were conducted to show that the AV-Micro model cannot be directly applied to HV data. The findings by calibrated AV-Micro models revealed that AVs consume approximately 80.5–146.4 J more energy than HVs for each meter traveled. Furthermore, the frequency analysis of energy consumption indicates that there is still some room for AVs to improve energy efficiency, particularly given their larger amplitude high-frequency fluctuations.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Integration of physiologically relevant photosynthetic energy flows into whole genome models of light‐driven metabolism

SUMMARY Characterizing photosynthetic productivity is necessary to understand the ecological contributions and biotechnology potential of plants, algae, and cyanobacteria. Light capture efficiency and photophysiology have long been characterized by measurements of chlorophyll fluorescence dynamics. However, these investigations typically do not consider the metabolic network downstream of light harvesting. By contrast, genome‐scale metabolic models capture species‐specific metabolic capabilities but have yet to incorporate the rapid regulation of the light harvesting apparatus. Here, we combine chlorophyll fluorescence parameters defining photosynthetic and non‐photosynthetic yield of absorbed light energy with a metabolic model of the pennate diatom Phaeodactylum tricornutum. This integration increases the model predictive accuracy regarding growth rate, intracellular oxygen production and consumption, and metabolic pathway usage. Through the quantification of excess electron transport, we uncover the sequential activation of non‐radiative energy dissipation processes, cross‐compartment electron shuttling, and non‐photochemical quenching as the rapid photoacclimation strategy in P. tricornutum. Interestingly, the photon absorption thresholds that trigger the transition between these mechanisms were consistent at low and high incident photon fluxes. We use this understanding to explore engineering strategies for rerouting cellular resources and excess light energy towards bioproducts in silico . Overall, we present a methodology for incorporating a common, informative data type into computational models of light‐driven metabolism and show its utilization within the design–build–test–learn cycle for engineering of photosynthetic organisms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Field‐scale analysis of miscanthus production indicates climate change may increase the opportunity for water quality improvement in a key Iowa watershed

Abstract The Raccoon River Basin is the primary source for drinking water in Iowa's largest city and plays a major role in the Mississippi River Basin's high nutrient exports. Future climate change may have major impacts on the biological, physiological, and agronomic processes imposing a threat to ecosystem services. Efforts to reduce nitrogen (N) loads within this basin have included local litigation and the implementation of the Iowa Nutrient Reduction Strategy, which suggest incorporating bioenergy crops (i.e., miscanthus) within the current corn–soybean landscape to reach a 41% reduction in nitrate loads. This study focuses on simulating N export for historical and future land use scenarios by using an agroecosystem model (Agro‐IBIS) and a hydrology model (THMB) at the 500‐m resolution, similar to the scale of agricultural fields. Model simulations are driven by CMIP5 climate data for historical, mid‐century, and late‐century under the RCP 4.5 and 8.5 warming projections. Using recent crop profit analyses for the state of Iowa, profitability maps were generated and nitrogen leaching thresholds were used to determine where miscanthus should replace corn–soybean area to maximize reductions in N pollution. Our results show that miscanthus inclusion on low profit and high N leaching areas can result in a 4% reduction of N loss under current climate conditions and may reduce N loss by 21%–26% under future climate conditions, implying that water quality has the potential continue to improve under future climate conditions when strategically implemented conservation practices are included in future farm management plans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Accelerated, scalable and reproducible AI-driven gravitational wave detection

The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware-Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery. By combining a repository for artificial intelligence models and a supercomputing cluster, an entire month's worth of advanced LIGO data is analysed in just 7 min, finding all binary black hole mergers previously identified in this dataset and reporting no misclassifications.

79 ASTRONOMY AND ASTROPHYSICS↗