Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Development of Gamma Background Radiation Digital Twin with Machine Learning Algorithms: Application of Unsupervised Machine Learning to Detection of Anomalies and Nuisances in Gamma Background Radiation Environmental Screening Data

Environmental screening of gamma radiation consists of detecting weak nuisance and anomaly signal in the presence of strong and highly varying background. In a typical scenario, a mobile detector-spectrometer continuously measures gamma radiation spectra in short, e.g., one-second, signal acquisition intervals. The measurement data is a 2D matrix, where one dimension is gamma ray energy, and the other dimension is the number of measurements or total time. In principle, gamma radiation sources can be detected and identified from the measured data by their unique spectral lines. Detecting sources from data measured in a search scenario is difficult due to the highly varying background because of naturally occurring radioactive material (NORM), and low signal-to-noise ratio (S/N) of spectral signal measured during one-second acquisition intervals. The objective of this work is to explore unsupervised machine learning (ML) algorithms for development of a digital twin of gamma radiation background, and for detection and identification of weak nuisances and anomalies events in the presence of highly fluctuating background. In one segment of work, we developed a gamma background estimation model using a Longshort term memory (LSTM) network for one-step CPS time series prediction. The LSTM model was validated with two data sets of measurements from two independent NaI detectors positioned on a mobile platform. The data sets contained background radiation only and no orphan isotope sources. The LSTM model was constructed and tested using data from one of the detectors. Performance of the LSTM model was validate through one-step prediction of CPS time series of another NaI detector without re-training. This approach allows to create a digital twin for nuclear background estimation. Using LSTM, it could be possible to detect a source through subtraction of the estimated counts from the measured background. In another segment of work, we investigated detection of gamma emitting sources in the presence of complex background using unsupervised machine learning. Spectral lines of isotopes are difficult to observe in one-second measurements. Averaging over the entire measurement campaign data set reveals spectral lines of most common background isotopes. Spectral lines of orphan sources, which might appear only in a few measurements during the campaign, will be washed out if averaging is performed over the entire measurement data set. The approach we have explored consists of extracting one-second measurements containing weak spectral features through data clustering. Averaging one-second spectra in a cluster should reveal the presence of anomaly sources. We created two ML models using K-means clustering and Neural Network Self-organizing Map (SOM). Performance of these ML models was benchmarked using search data. One data set contained 137 Cs source, and another dataset contained 131 I source.

54 ENVIRONMENTAL SCIENCES↗

Developing predictive models for µ opioid receptor binding using machine learning and deep learning techniques

Opioids exert their analgesic effect by binding to the µ opioid receptor (MOR), which initiates a downstream signaling pathway, eventually inhibiting pain transmission in the spinal cord. However, current opioids are addictive, often leading to overdose contributing to the opioid crisis in the United States. Therefore, understanding the structure-activity relationship between MOR and its ligands is essential for predicting MOR binding of chemicals, which could assist in the development of non-addictive or less-addictive opioid analgesics. This study aimed to develop machine learning and deep learning models for predicting MOR binding activity of chemicals. Chemicals with MOR binding activity data were first curated from public databases and the literature. Molecular descriptors of the curated chemicals were calculated using software Mold2. The chemicals were then split into training and external validation datasets. Random forest, k-nearest neighbors, support vector machine, multi-layer perceptron, and long short-term memory models were developed and evaluated using 5-fold cross-validations and external validations, resulting in Matthews correlation coefficients of 0.528–0.654 and 0.408, respectively. Furthermore, prediction confidence and applicability domain analyses highlighted their importance to the models’ applicability. Our results suggest that the developed models could be useful for identifying MOR binders, potentially aiding in the development of non-addictive or less-addictive drugs targeting MOR.

Research & Experimental Medicine↗

Learning Spectral Templates for Photometric Redshift Estimation from Broadband Photometry

Estimating redshifts from broadband photometry is often limited by how accurately we can map the colors of galaxies to an underlying spectral template. Current techniques utilize spectrophotometric samples of galaxies or spectra derived from spectral synthesis models. Both of these approaches have their limitations: either the sample sizes are small and often not representative of the diversity of galaxy colors, or the model colors can be biased (often as a function of wavelength), which introduces systematics in the derived redshifts. In this paper, we learn the underlying spectral energy distributions from an ensemble of ∼100 K galaxies with measured redshifts and colors. We show that we are able to reconstruct emission and absorption lines at a significantly higher resolution than the broadband filters used to measure the photometry for a sample of 20 spectral templates. We find that our training algorithm reduces the fraction of outliers in the derived photometric redshifts by up to 28%, bias up to 91%, and scatter up to 25%, when compared to estimates using a standard set of spectral templates. We discuss the current limitations of this approach and its applicability for recovering the underlying properties of galaxies. Our derived templates and the code used to produce these results are publicly available in a dedicated Github repository: https://github.com/dirac-institute/photoz-template-learning.

79 ASTRONOMY AND ASTROPHYSICS↗

167-PFlops deep learning for electron microscopy: from learning physics to atomic manipulation

An artificial intelligence system called MENNDL, which used 25,200 NVIDIA Volta GPUs on Oak Ridge National Laboratory's Summit machine, automatically designed an optimal deep learning network in order to extract structural information from raw atomic-resolution microscopy data. In a few hours, MENNDL creates and evaluates millions of networks using a scalable, parallel, asynchronous genetic algorithm augmented with a support vector machine to automatically find a superior deep learning network topology and hyper-parameter set than a human expert can find in months. For the application of electron microscopy, the system furthers the goal of improving our understanding of the electron-beam-matter interactions and real-time image-based feedback, which enables a huge step beyond human capacity towards nanofabricating materials automatically. MENNDL has been scaled to the 4,200 available nodes of Summit achieving a measured 152.5 PFlops, with an estimated sustained performance of 167 PFlops when the entire machine is available.

Patton, Robert↗

Learning to Branch with Interpretable Machine Learning Models

Machine learning is being increasingly used in improving decisions made within branch-and-bound algorithms for solving mixed-integer programs (MIPs). Branching is a key component in branch-and-bound algorithms, this work presents IDAES-core project update on building simple and interpretable machine learning models for branching and improving decision-making tools applied for the optimization of advanced energy systems.

Bayramoglu, Selin↗

Lessons Learned from the Clean Energy to Communities (C2C) Peer-Learning Cohort Enhancing Resilience at Critical Facilities through Solar, Storage, and Microgrids

The National Renewable Energy Laboratory (NREL), with support from World Resources Institute (WRI), designed and led a six-month peer-learning cohort from January through July 2024 on "Enhancing Resilience at Critical Facilities through Solar, Storage, and Microgrids" as part of the U.S Department of Energy's Clean Energy to Communities (nrel.gov/c2c) (C2C) program. Representatives from 15 municipalities, municipal utilities, colleges, and Tribes from across the United States participated in monthly workshops covering best practices for planning and deploying local resilience projects. This document shares key takeaways, lessons learned, and resources from the cohort including considerations for planning, proposing, designing, procuring, and funding microgrid projects for resilience.

C2C↗

Lessons Learned from the Clean Energy to Communities (C2C) Peer-Learning Cohort Evaluating and Prioritizing Municipal Buildings for Energy Efficiency and Decarbonization Investment

The National Renewable Energy Laboratory (NREL), with support from World Resources Institute (WRI), designed and led a six-month peer-learning cohort from January through July 2024 on "Enhancing Resilience at Critical Facilities through Solar, Storage, and Microgrids" as part of the U.S Department of Energy's Clean Energy to Communities (nrel.gov/c2c) (C2C) program. Representatives from 15 municipalities, municipal utilities, colleges, and Tribes from across the United States participated in monthly workshops covering best practices for planning and deploying local resilience projects. This document shares key takeaways, lessons learned, and resources from the cohort.

buildings↗

Lessons Learned from the Clean Energy to Communities (C2C) Peer-Learning Cohort Incorporating Community Priorities into Electric Vehicle Plans and Projects

The National Renewable Energy Laboratory (NREL), with support from World Resources Institute (WRI), designed and led a six-month peer-learning cohort from January through July 2024 on "Enhancing Resilience at Critical Facilities through Solar, Storage, and Microgrids" as part of the U.S Department of Energy's Clean Energy to Communities (nrel.gov/c2c) (C2C) program. Representatives from 15 municipalities, municipal utilities, colleges, and Tribes from across the United States participated in monthly workshops covering best practices for planning and deploying local resilience projects. This document shares key takeaways, lessons learned, and resources from the cohort including key steps that can be taken to help entities design effective community engagement processes around clean mobility.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

Machine learning coupled multi-scale modeling for redox flow batteries

The reaction distribution in macro or device-scale has been studied for redox flow batteries. The reaction distribution on electrode pore-scale structure however is not well understood, lacking especially on how the reaction distribution on the pore-scale may impact the overall performance of a flow battery. This study introduces for the first time a framework of a multi-scale model that provides understanding of the relationship between the pore-scale electrode structure reaction and the device-scale electrochemical reaction uniformity within the flow battery. A reduced order model is constructed based on 128 pore-scale simulations, which provide a quantitative relationship between the battery operation conditions (inlet velocity, current density, inlet concentration) and the surface reaction uniformity for the pore-scale sample. The multi-scale framework upscales this pore-scale surface reaction uniformity to device-scale combined uniformity. Based on the multi-scale model, a time-varying optimization of the inlet velocity is established, leading to significant reduction on pump power consumption with targeted surface reaction uniformity. The multi-scale model establishes the critical link between the micro-structure of a flow battery component and its performance at the macro-scale, therefore providing rationale for further operational or material optimization.

flow batteries, machine learning, multi-scale mode↗

Error modeling for surrogates of dynamical systems using machine learning: Machine-learning-based error model for surrogates of dynamical systems

A machine learning–based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (eg, random forests, and LASSO) to map a large set of inexpensively computed “error indicators” (ie, features) produced by the surrogate model at a given time instance to a prediction of the surrogate-model error in a quantity of interest (QoI). This eliminates the need for the user to hand-select a small number of informative features. The methodology requires a training set of parameter instances at which the time-dependent surrogate-model error is computed by simulating both the high-fidelity and surrogate models. Using these training data, the method first determines regression-model locality (via classification or clustering) and subsequently constructs a “local” regression model to predict the time-instantaneous error within each identified region of feature space. We consider 2 uses for the resulting error model: (1) as a correction to the surrogate-model QoI prediction at each time instance and (2) as a way to statistically model arbitrary functions of the time-dependent surrogate-model error (eg, time-integrated errors). We then apply the proposed framework to model errors in reduced-order models of nonlinear oil-water subsurface flow simulations, with time-varying well-control (bottom-hole pressure) parameters. The reduced-order models used in this work entail application of trajectory piecewise linearization in conjunction with proper orthogonal decomposition. Moreover, when the first use of the method is considered, numerical experiments demonstrate consistent improvement in accuracy in the time-instantaneous QoI prediction relative to the original surrogate model, across a large number of test cases. When the second use is considered, results show that the proposed method provides accurate statistical predictions of the time- and well-averaged errors.

97 MATHEMATICS AND COMPUTING↗

Machine learning for international freight transportation management: A comprehensive review

Machine learning (ML) offers a promising avenue for international freight transportation management (IFTM) given its capability to harness the power of data that have become increasingly available to freight transportation researchers and practitioners. This paper conducts a comprehensive investigation of the state-of-the-art in developing ML models for applications to different aspects of IFTM. We start by giving an overview of various fundamental ML methods. Then, how different ML methods have been employed, adapted, and applied to a multitude of subject areas in IFTM are discussed, including demand forecast, operation and asset maintenance, and vehicle trajectory and on-time performance prediction. The potential data sources that may be used to develop ML models are further examined. Subsequently, a synthesis of the exiting work is performed to identify the specific topics addressed in the existing research, ML methods used, the trends of research, and opportunities for further explorations. Four directions for future research are proposed in the end.

Data sources↗

Machine Learning Reduced Order Model for Cost and Emission Assessment of a Pyrolysis System

Biomass pyrolysis is a promising approach for producing economic and environmentally-friendly fuels and bioproducts. Biomass pyrolysis experiments show that feedstock properties have a significant impact on product yields and composition. Scientists are developing detailed chemical reaction mechanisms to capture the relationships between biomass composition and pyrolysis yields. These mechanisms can be computationally intensive. In this study, we investigate the use of a machine learning reduced order model (ROM) for assessing the costs and emissions of a pyrolysis biorefinery. Here, we developed a Kriging-based ROM to predict pyrolysis yields of 314 feedstock samples based on the results of a detailed chemical kinetic pyrolysis mechanism. The ROM is integrated into a chemical process model for calculating mass and energy yields in a commercial-scale (2000 tonne/day) biorefinery. The ROM estimated biofuel yields of 65 to 130 gallons per ton of dry biomass. This results in biofuel minimum fuel-selling prices of $2.62 to $5.43 per gallon and emissions of -13.62 to 145 kg of CO 2 per MJ. The ROM achieved an average mean square error of 1.8e-20 and a mean absolute error of 0.53%. These results suggest that ROMs can facilitate rapid feedstock screening for biorefinery systems.

09 BIOMASS FUELS↗

Machine Learning Accelerated First-Principles Study of the Hydrodeoxygenation of Propanoic Acid

The complex reaction network of catalytic biomass conversions often involves hundreds of surface intermediates and thousands of reaction steps, greatly hindering the rational design of metal catalysts for these conversions. Here, we present a framework of machine learning (ML)-accelerated first-principles studies for the hydrodeoxygenation (HDO) of propanoic acid over transition metal surfaces. The microkinetic model (MKM) is initially parametrized by ML-predicted energies and iteratively improved by identifying the rate-determining species and steps (RDS), computing their energies by density functional theory (DFT), and reparameterizing the MKM until all the RDS are computed by DFT. The Gaussian process (GP) model performs significantly better than the linear ridge regression model for predicting both the adsorption free energies and transition state free energies. Parameterized with energies from the GP model, only 5–20% of the full reaction network has to be computed by DFT for the MKM to possess DFT-level accuracy for the TOF and dominant reaction pathway. While the linear ridge regression model performs worse than the GP model, its performance is greatly improved when only transition states are predicted by the regression model and adsorption energies are computed by DFT. Overall, we find that a high accuracy in adsorption free energies is more important for a reliable MKM than a high accuracy in TS free energies. Lastly, based on the GP model with GOH and GCHCHCO as catalyst descriptors, we build two-dimensional volcano plots in activity and selectivity that can help design promising alloy catalysts for HDO reactions of organic acids.

adsorption↗