Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Physics-Informed Machine Learning for Predictive Turbulence Modeling: Towards a Complete Framework

Although increased availability of computational resources has enabled high-fidelity simulations (e.g., large eddy simulations) of turbulent flows, the Reynolds-Averaged Navier–Stokes (RANS) models are still the dominant tools in industrial applications. However, the predictive capabilities of RANS models are limited by large model-form discrepancies due to the Reynolds stress closure. Recently, a Physics-Informed Machine Learning (PIML) approach has been proposed to learn the functional form of Reynolds stress discrepancy in RANS simulations based on available data. It has been demonstrated that the learned discrepancy function can be used to improve Reynolds stresses in new flows where data are not available. However, due to a number of challenges, the improvements are only demonstrated in the Reynolds stress prediction but not in corresponding propagated quantities of interest (e.g., velocity field). In this work, we investigate the prediction performance on the velocity field by propagating the corrected Reynolds stresses in PIML approach. To enrich the input features, an integrity basis of invariants is implemented. The fully developed turbulent flow in a square duct is used as the test case. The discrepancy model is trained on flow fields from several Reynolds numbers and evaluated on a duct flow at a higher Reynolds number than any of the training cases. The predicted Reynolds stresses are propagated to velocity field via RANS equations. Numerical results show excellent predictive performances in both Reynolds stresses and their propagated velocities, demonstrating the merits of the PIML approach in predictive turbulence modeling.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2024

Calculating the High-Latitude Ionospheric Electrodynamics Using A Machine Learning-Based Field-Aligned Current Model

We introduce a new framework called Machine Learning (ML) based Auroral Ionospheric electrodynamics Model (ML-AIM). ML-AIM solves a current continuity equation by utilizing the ML model of Field Aligned Currents of Kunduri et al. (2020, https://doi.org/10.1029/2020JA027908), the FAC-derived auroral conductance model of Robinson et al. (2020, https://doi.org/10.1029/2020JA028008), and the solar irradiance conductance model of Moen and Brekke (1993, https://doi.org/10.1029/92gl02109). The ML-AIM inputs are 60-min time histories of solar wind plasma, interplanetary magnetic fields (IMF), and geomagnetic indices, and its outputs are ionospheric electric potential, electric fields, Pedersen/Hall currents, and Joule Heating. We conduct two ML-AIM simulations for a weak geomagnetic activity interval on 14 May 2013 and a geomagnetic storm on 7–8 September 2017. ML-AIM produces physically accurate ionospheric potential patterns such as the two-cell convection pattern and the enhancement of electric potentials during active times. The cross polar cap potentials (ΦPC) from ML-AIM, the Weimer (2005, https://doi.org/10.1029/2004ja010884) model, and the Super Dual Auroral Radar Network (SuperDARN) data-assimilated potentials, are compared to the ones from 3204 polar crossings of the Defense Meteorological Satellite Program F17 satellite, showing better performance of ML-AIM than others. ML-AIM is unique and innovative because it predicts ionospheric responses to the time-varying solar wind and geomagnetic conditions, while the other traditional empirical models like Weimer (2005, https://doi.org/10.1029/2004ja010884) designed to provide a quasi-static ionospheric condition under quasi-steady solar wind/IMF conditions. Plans are underway to improve ML-AIM performance by including a fully ML network of models of aurora precipitation and ionospheric conductance, targeting its characterization of geomagnetically active times.

auroral electrodynamics↗
DOE OSTI2022

Machine learning for surrogate process models of bioproduction pathways

Technoeconomic analysis and life-cycle assessment are critical to guiding and prioritizing bench-scale experiments and to evaluating economic and environmental performance of biofuel or biochemical production processes at scale. Traditionally, commercial process simulation tools have been used to develop detailed models for these purposes. However, developing and running such models can be costly and computationally intensive, which limits the degree to which they can be shared and reproduced in the broader research community. This study evaluates the potential of an automated machine learning approach to develop surrogate models based on conventional process simulation models. The analysis focuses on several high-value biofuels and bioproducts for which pathways of production from biomass feedstocks have been well-established. The results demonstrate that surrogate models can be an accurate and effective tool for approximating the cost, mass and energy balance outputs of more complex process simulations at a fraction of the computational expense.

09 BIOMASS FUELS↗
DOE OSTI2023

Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging: Theory, algorithms, and applications

Plug-and-play (PnP) priors constitute one of the most widely used frameworks for solving computational imaging problems through the integration of physical models and learned models. PnP leverages high-fidelity physical sensor models and powerful machine learning methods for prior modeling of data to provide state-of-the-art reconstruction algorithms. PnP algorithms alternate between minimizing a data fidelity term to promote data consistency and imposing a learned regularizer in the form of an image denoiser. Recent highly successful applications of PnP algorithms include biomicroscopy, computerized tomography (CT), magnetic resonance imaging (MRI), and joint ptychotomography. This article presents a unified and principled review of PnP by tracing its roots, describing its major variations, summarizing main results, and discussing applications in computational imaging. Additionally, we also point the way toward further developments by discussing recent results on equilibrium equations that formulate the problem associated with PnP algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Design and analysis of machine learning exchange-correlation functionals via rotationally invariant convolutional descriptors

Here, we explore the potential of a data-driven approach to the design of exchange-correlation (xc) functionals. The approach, inspired by convolutional filters in computer vision and surrogate functions from optimization, utilizes convolutions of the electron density to form a feature space to represent local electronic environments and neural networks to map the features to the exchange-correlation energy density. These features are orbital free, and provide a systematic route to including information at various length scales. This work shows that convolutional descriptors are theoretically capable of an exact representation of the electron density, and proposes Maxwell-Cartesian spherical harmonic kernels as a class of rotationally invariant descriptors for the construction of machine learned functionals. The approach is demonstrated using data from the B3LYP functional on a number of small molecules containing C, H, O, and N along with a neural network regression model. The machine learned functionals are compared to standard physical approximations and the accuracy is assessed for the absolute energy of each molecular system as well as formation energies. The results indicate that it is possible to reproduce the exchange-correlation portion of B3LYP formation energies to within chemical accuracy using orbital-free descriptors with a spatial extent of 0.2 Å. The findings provide empirical insight into the spatial range of electron exchange, and suggest that the combination of convolutional descriptors and machine learning regression models is a promising framework for xc functional design, although challenges remain in obtaining training data and generating models consistent with pseudopotentials.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A Machine Learning-based Reliability Evaluation Model for Integrated Power-Gas Systems

This article proposes a hybrid machine learning method for the reliability evaluation of integrated power-gas systems (IPGS) under the uncertain component failure probability distributions. The Random Forest (RF) method is designed to select important features to solve the insufficient quantity of data and the curse of dimensionality problems. The Extreme Gradient Boosting (XGBoost) regression algorithm is developed to quantify the relationship between the uncertain parameters and reliability metrics. Moreover, a ten-fold cross-validation method is employed to further improve the accuracy of the regression model. Simulation results on three test systems show that the proposed method can achieve high accuracy for the reliability evaluation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

A Remote Sensing Technique to Upscale Methane Emission Flux in a Subtropical Peatland

Abstract Quantification of methane (CH 4 ) gas emission from peat is critical to understand CH 4 budget from natural wetlands under a climate warming scenario. Previous studies have focused on prediction and mapping of CH 4 emission flux using process‐based models, while application of statistical‐empirical models for upscaling spatially sparse in situ measurements is scarce. In this study, we developed an empirical remote sensing upscaling approach to estimate CH 4 emission flux in the Everglades using limited in situ point‐based CH 4 emission flux measurements and Landsat data during 2013–2018. We spatially and temporally linked in situ data with Landsat surface reflectance based on temporally composite data sets and developed an object‐based machine learning framework to model and map CH 4 emission flux. An ensemble analysis of two machine learning models, k ‐Nearest Neighbor ( k ‐NN) and Support Vector Machine (SVM), shows that the upscaling approach is promising for predicting CH 4 emission flux with a R 2 of 0.65 and 0.87 based on a fivefold cross‐validation for a dry season and wet season estimation, respectively. We generated emission flux map products that successfully revealed the spatial and temporal heterogeneity of CH 4 emission within the dominant freshwater marsh ecosystem in the Everglades. We conclude that Landsat is promising for upscaling and monitoring CH 4 emission flux and reducing the uncertainty in emission estimates from wetlands.

Zhang, Caiyun↗
DOE OSTI2019

Demonstration of Machine Learning-Based Model-Independent Stabilization of Source Properties in Synchrotron Light Sources

Synchrotron light sources, arguably among the most powerful tools of modern scientific discovery, are presently undergoing a major transformation to provide orders of magnitude higher brightness and transverse coherence enabling the most demanding experiments. In these experiments, overall source stability will soon be limited by achievable levels of electron beam size stability, presently on the order of several microns, which is still 1–2 orders of magnitude larger than already demonstrated stability of source position and current. Until now source size stabilization has been achieved through corrections based on a combination of static predetermined physics models and lengthy calibration measurements, periodically repeated to counteract drift in the accelerator and instrumentation. In this paper, we now demonstrate for the first time how the application of machine learning allows for a physics- and model-independent stabilization of source size relying only on previously existing instrumentation. Such feed-forward correction based on a neural network that can be continuously online retrained achieves source size stability as low as 0.2 μm (0.4%) rms, which results in overall source stability approaching the subpercent noise floor of the most sensitive experiments.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Progressive transfer learning for advancing machine learning-based reduced-order modeling

Abstract To maximize knowledge transfer and improve the data requirement for data-driven machine learning (ML) modeling, a progressive transfer learning for reduced-order modeling (p-ROM) framework is proposed. A key concept of p-ROM is to selectively transfer knowledge from previously trained ML models and effectively develop a new ML model(s) for unseen tasks by optimizing information gates in hidden layers. The p-ROM framework is designed to work with any type of data-driven ROMs. For demonstration purposes, we evaluate the p-ROM with specific Barlow Twins ROMs (p-BT-ROMs) to highlight how progress learning can apply to multiple topological and physical problems with an emphasis on a small training set regime. The proposed p-BT-ROM framework has been tested using multiple examples, including transport, flow, and solid mechanics, to illustrate the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. In both similar and different topologies, p-BT-ROM achieves improved model accuracy with much less training data. For instance, p-BT-ROM with four-parent (i.e., pre-trained models) outperforms the no-parent counterpart trained on data nine times larger. The p-ROM framework is poised to significantly enhance the capabilities of ML-based ROM approaches for scientific and engineering applications by mitigating data scarcity through progressively transferring knowledge.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Using machine learning to improve efficiency and accuracy of burnup measurements at PBR reactors [Slides]

The outline of the slides include: Motivations of the work; Modeling and simulation; Machine learning model; Results and comparison study with linear regression; and Conclusions. This work was done to help PBR designers and operators understand the burnup measurement better. We look forward to discussing the results in detail with industrial collaborators.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Developing predictive models for µ opioid receptor binding using machine learning and deep learning techniques

Opioids exert their analgesic effect by binding to the µ opioid receptor (MOR), which initiates a downstream signaling pathway, eventually inhibiting pain transmission in the spinal cord. However, current opioids are addictive, often leading to overdose contributing to the opioid crisis in the United States. Therefore, understanding the structure-activity relationship between MOR and its ligands is essential for predicting MOR binding of chemicals, which could assist in the development of non-addictive or less-addictive opioid analgesics. This study aimed to develop machine learning and deep learning models for predicting MOR binding activity of chemicals. Chemicals with MOR binding activity data were first curated from public databases and the literature. Molecular descriptors of the curated chemicals were calculated using software Mold2. The chemicals were then split into training and external validation datasets. Random forest, k-nearest neighbors, support vector machine, multi-layer perceptron, and long short-term memory models were developed and evaluated using 5-fold cross-validations and external validations, resulting in Matthews correlation coefficients of 0.528–0.654 and 0.408, respectively. Furthermore, prediction confidence and applicability domain analyses highlighted their importance to the models’ applicability. Our results suggest that the developed models could be useful for identifying MOR binders, potentially aiding in the development of non-addictive or less-addictive drugs targeting MOR.

Research & Experimental Medicine↗
NASA NTRSDate not supplied

Machine Learning Approach for Aircraft Performance Model Parameter Estimation for Trajectory Prediction Applications

Inaccurate prediction of aircraft trajectory by ground-based decision support tools (DST) is a major concern in air traffic management (ATM). Aircraft trajectory prediction tools rely on a simplified point-mass aircraft performance model (APM) to make their predictions. Even though the performance coefficients and weight of an aircraft are a vital part of the APM’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to DSTs. Current ATM research focuses on improving the estimate of some APM parameters by freezing all other coefficients. This simplified approach introduces unwanted sources of bias and negatively impacts the accuracy of the performance model. In this paper, we apply machine learning (ML) techniques for the simultaneous prediction of three key APM parameters (two drag coefficients and the initial aircraft weight). To accomplish this, we employ an ordinary differential equation (ODE) fitting approach to generate optimized APM parameter labels customized to each individual flight record. Subsequently, we train ML models to capture the relationship between the historical data and the optimized APM parameters. Two different ML model solutions are applied and APM coefficients are predicted for unseen flights. The results indicate that the ML models are able to capture the relationship between APM parameters and flight-related features with good accuracy.

trajectory prediction, machine learning, aircraft ↗
DOE OSTI2020

Spectroscopic Probe Molecule Selection Using Quantum Theory, First-Principles Calculations, and Machine Learning

Probe molecule vibrational spectra have a long history of being used to characterize materials including metals, oxides, metal-organic frameworks, and even human proteins. Furthermore, recent advances in machine learning have enabled computationally generated spectra to aid in detailed characterization of complex surfaces with probe molecules. Despite widespread use of probe molecules, the science of probe molecule selection is underdeveloped. Here, we develop physical concepts, including orbital interaction energy and the energy overlap integral, to explain and predict the ability of probe molecules to discriminate structural descriptors. We resolve the crystal orbital overlap population (COOP) to specific molecular orbitals and quantify their bonding character, which directly influences vibrational frequencies. Using only a single adsorbate calculation from density function theory (DFT), we compute the interaction energy of individual adsorbate molecular orbitals with adsorption site atomic orbitals across many different sites. Combining the molecular orbital resolved COOP and changes in orbital interaction energy enables probe molecule selection for improved discrimination of various sites. We demonstrate these concepts by comparing the predicted effectiveness of carbon monoxide (CO), nitric oxide (NO), and ethylene (C 2 H 4 ) to probe Pt adsorption sites. Finally, using a previously developed machine learning framework, we show that models trained on hundreds of thousand C 2 H 4 spectra, computed from DFT, which regress surface binding-type and generalized coordination number (GCN), outperform those trained using CO and NO spectra. Lastly, a python package, pDOS_overlap, for implementing the electron density based analysis on any combination of adsorbates and materials, is also made available.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

Machine learning surrogates for surface complexation model of uranium sorption to oxides

Abstract The safety assessments of the geological storage of spent nuclear fuel require understanding the underground radionuclide mobility in case of a leakage from multi-barrier canisters. Uranium, the most common radionuclide in non-reprocessed spent nuclear fuels, is immobile in reduced form (U(IV) and highly mobile in an oxidized state (U(VI)). The latter form is considered one of the most dangerous environmental threats in the safety assessments of spent nuclear fuel repositories. The sorption of uranium to mineral surfaces surrounding the repository limits their mobility. We quantify uranium sorption using surface complexation models (SCMs). Unfortunately, numerical SCM solvers often encounter convergence problems due to the complex nature of convoluted equations and correlations between model parameters. This study explored two machine learning surrogates for the 2-pK Triple Layer Model of uranium retention by oxide surfaces if released as U(IV) in the oxidizing conditions: random forest regressor and deep neural networks. Our surrogate models, particularly DNN, accurately reproduce SCM model predictions at a fraction of the computational cost without any convergence issues. The safety assessment of spent fuel repositories, specifically the migration of leaked radioactive waste, will benefit from having ultrafast AI/ML surrogates for the computationally expensive sorption models that can be easily incorporated into larger-scale contaminant migration models. One such model is presented here.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2018

Fast Learning for Immersive Engagement in Energy Simulations

The fast computation which is critical for immersive engagement with and learning from energy simulations would be furthered by developing a general method for creating rapidly computed simplified versions of NREL's computation-intensive energy simulations. Created using machine learning techniques, these 'reduced form' simulations can provide statistically sound estimates of the results of the full simulations at a fraction of the computational cost with response times - typically less than one minute of wall-clock time - suitable for real-time human-in-the-loop design and analysis. Additionally, uncertainty quantification techniques can document the accuracy of the approximate models and their domain of validity. Approximation methods are applicable to a wide range of computational models, including supply-chain models, electric power grid simulations, and building models. These reduced-form representations cannot replace or re-implement existing simulations, but instead supplement them by enabling rapid scenario design and quality assurance for large sets of simulations. We present an overview of the framework and methods we have implemented for developing these reduced-form representations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Machine Learning-Based Regression Models for Ironmaking Blast Furnace Automation

Computational fluid dynamics (CFD)-based simulation has been the traditional way to model complex industrial systems and processes. One very large and complex industrial system that has benefited from CFD-based simulations is the steel blast furnace system. The problem with the CFD-based simulation approach is that it tends to be very slow for generating data. The CFD-only approach may not be fast enough for use in real-time decisionmaking. To address this issue, in this work, the authors propose the use of machine learning techniques to train and test models based on data generated via CFD simulation. Regression models based on neural networks are compared with tree-boosting models. In particular, several areas (tuyere, raceway, and shaft) of the blast furnace are modeled using these approaches. The results of the model training and testing are presented and discussed. The obtained R 2 metrics are, in general, very high. The results appear promising and may help to improve the efficiency of operator and process engineer decisionmaking when running a blast furnace.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Machine-Learning Assisted Identification of Accurate Battery Lifetime Models with Uncertainty

Reduced-order battery lifetime models, which consist of algebraic expressions for various aging modes, are widely utilized for extrapolating degradation trends from accelerated aging tests to real-world aging scenarios. Identifying models with high accuracy and low uncertainty is crucial for ensuring that model extrapolations are believable, however, it is difficult to compose expressions that accurately predict multivariate data trends; a review of cycling degradation models from literature reveals a wide variety of functional relationships. Here, a machine-learning assisted model identification method is utilized to fit degradation in a stand-out LFP-Gr aging data set, with uncertainty quantified by bootstrap resampling. The model identified in this work results in approximately half the mean absolute error of a human expert model. Models are validated by converting to a state-equation form and comparing predictions against cells aging under varying loads. Parameter uncertainty is carried forward into an energy storage system simulation to estimate the impact of aging model uncertainty on system lifetime. The new model identification method used here reduces life-prediction uncertainty by more than a factor of three (86% ± 5% relative capacity at 10 years for human-expert model, 88.5% ± 1.5% for machine-learning assisted model), empowering more confident estimates of energy storage system lifetime.

25 ENERGY STORAGE↗
DOE OSTI2015

Metabolome of human gut microbiome is predictive of host dysbiosis

Background: Humans live in constant and vital symbiosis with a closely linked bacterial ecosystem called the microbiome, which influences many aspects of human health. When this microbial ecosystem becomes disrupted, the health of the human host can suffer; a condition called dysbiosis. However, the community compositions of human microbiomes also vary dramatically from individual to individual, and over time, making it difficult to uncover the underlying mechanisms linking the microbiome to human health. We propose that a microbiome’s interaction with its human host is not necessarily dependent upon the presence or absence of particular bacterial species, but instead is dependent on its community metabolome; an emergent property of the microbiome. Results: Using data from a previously published, longitudinal study of microbiome populations of the human gut, we extrapolated information about microbiome community enzyme profiles and metabolome models. Using machine learning techniques, we demonstrated that the aggregate predicted community enzyme function profiles and modeled metabolomes of a microbiome are more predictive of dysbiosis than either observed microbiome community composition or predicted enzyme function profiles. Conclusions: Specific enzyme functions and metabolites predictive of dysbiosis provide insights into the molecular mechanisms of microbiome–host interactions. The ability to use machine learning to predict dysbiosis from microbiome community interaction data provides a potentially powerful tool for understanding the links between the human microbiome and human health, pointing to potential microbiome-based diagnostics and therapeutic interventions.

human microbiome↗