Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Chemical composition based machine learning model to predict defect formation in additive manufacturing

With a goal of exploiting additive manufacturing to improve the manufacturing of existing reactor materials, we developed a chemical composition-based machine learning model to predict the printability of any given alloy in laser powder bed fusion (L-PBF) using experimental data from peer-reviewed literature. We defined printability as the ability to avoid defects like cracking, balling, porosity, and lack of fusion, that are caused by thermal stresses (during solidification or liquation), molten pool disintegration into disconnected small beads or lack of heat input respectively. Our models predict the tendency of balling defect formation and porosity percentage for a given composition, under a given set of processing conditions. To predict the likelihood of balling defect, three models: a random forest classifier, a gradient boost regressor and a neural network were trained on a dataset containing both traditional alloys and high entropy alloys. The neural network model showed the highest accuracy of 92.3 % in predicting the balling defect formation. A random forest regressor, gradient boost regressor and neural network were trained and tested on a dataset of various alloys to predict porosity. The random forest regressor showed the best predictions with an R 2 score of 0.97. The models also revealed the relative importance of the input descriptors on defect-formation tendency. Of particular significance was the identification of carbon as an important element in determining the occurrence of balling and percent porosity in alloys like steel, as well as being moderately important to the percentage porosity in other alloys as well as steel. Manganese was also identified as a key descriptor for the percentage of porosity in steel and other alloys. Manganese’s low thermal conductivity and consistent presence in the dataset is the likely cause for its contribution. Carbon’s role is attributable to its relatively high specific heat and high melting temperature. In conclusion, our model serves as a swift, chemistry-based tool to design experiments and find modified compositions better suited for additive manufacturing.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Discovery of peculiar radio morphologies with ASKAP using unsupervised machine learning

Abstract We present a set of peculiar radio sources detected using an unsupervised machine learning method. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope to train a self-organizing map (SOM). The radio maps from three ASKAP surveys, Evolutionary Map of Universe pilot survey (EMU-PS), Deep Investigation of Neutral Gas Origins pilot survey (DINGO), and Survey With ASKAP of GAMA-09 + X-ray (SWAG-X), are used to search for the rarest or unknown radio morphologies. We use an extension of the SOM algorithm that implements rotation and flipping invariance on astronomical sources. The SOM is trained using the images of all ‘complex’ radio sources in the EMU-PS which we define as all sources catalogued as ‘multi-component’. The trained SOM is then used to estimate a similarity score for complex sources in all surveys. We select 0.5% of the sources that are most complex according to the similarity metric and visually examine them to find the rarest radio morphologies. Among these, we find two new odd radio circle (ORC) candidates and five other peculiar morphologies. We discuss multiwavelength properties and the optical/infrared counterparts of selected peculiar sources. In addition, we present examples of conventional radio morphologies including: diffuse emission from galaxy clusters, and resolved, bent-tailed, and FR-I and FR-II type radio galaxies. We discuss the overdense environment that may be the reason behind the circular shape of ORC candidates.

Astronomy & Astrophysics↗
DOE OSTI2025

A Comprehensive Machine Learning Model for Metal–Ligand Binding Prediction: Applications in Chemistry and Biology

A machine-learning (ML) model that predicts metal–ligand binding constants was developed using the open-source Chemprop software. The model was trained on over 30,000 experimental log K 1 values, which include both protonation and metal–ligand stability constants, comprising over 3500 ligands and 10 2 metal ions from 73 total elements, thus generalizing beyond existing limited approaches, which focus only on specific metals or ligand families. The best-performing model included a combination of SMILES-based molecular representations along with descriptors for the metal ion and experimental conditions. It had an external test R 2 value of 0.942, and MAE value of 0.834. A “SMILES-only” simpler version also produced accurate predictions and preserved the binding trends, serving as a quick and easily accessible alternative for users without computational expertise. The SMILES-only model performed comparably to density functional theory (DFT) calculations but utilized a fraction of the computational resources. The model was successfully applied across diverse domains, including bioinorganic chemistry, heavy metal remediation, and sensor development and demonstrated its effectiveness as a rapid and reliable screening tool for both academic and industrial uses.

Ligands↗
DOE OSTI2022

Physics‐Informed Machine Learning Method for Large‐Scale Data Assimilation Problems

Abstract We develop a physics‐informed machine learning approach for large‐scale data assimilation and parameter estimation and apply it for estimating transmissivity and hydraulic head in the two‐dimensional steady‐state subsurface flow model of the Hanford Site given synthetic measurements of said variables. In our approach, we extend the physics‐informed conditional Karhunen‐Loéve expansion (PICKLE) method to modeling subsurface flow with unknown flux (Neumann) and varying head (time‐dependent Dirichlet) boundary conditions. We demonstrate that the PICKLE method is comparable in accuracy with the standard maximum a posteriori (MAP) method, but is significantly faster than MAP for large‐scale problems. Both methods use a mesh to discretize the computational domain. In MAP, the parameters and states are discretized on the mesh; therefore, the size of the MAP parameter estimation problem directly depends on the mesh size. In PICKLE, the mesh is used to evaluate the residuals of the governing equation, while the parameters and states are approximated by the truncated conditional Karhunen‐Loéve expansions with the number of parameters controlled by the smoothness of the parameter and state fields, and not by the mesh size. For a considered example, we demonstrate that the computational cost of PICKLE increases near linearly (as N 1.15 ) with the number of grid nodes N , while that of MAP increases much faster (as N 3.28 ). We also show that once trained for one set of Dirichlet boundary conditions (i.e., one river stage), the PICKLE method provides accurate estimates of the hydraulic head for any value of the Dirichlet boundary conditions (i.e., for any river stage).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Efficient computational design of two-dimensional van der Waals heterostructures: Band alignment, lattice mismatch, and machine learning

Here, we develop a computational database, website applications (web-apps), and machine-learning (ML) models to accelerate the design and discovery of two-dimensional (2D) heterostructures. Using density functional theory (DFT) based lattice parameters and electronic band energies for 674 nonmetallic exfoliable 2D materials, we generate 226 779 possible bilayer heterostructures. We classify these heterostructures into type-I, -II, and -III systems according to Anderson’s rule, which is based on the relative band alignments of the noninteracting monolayers. We find that type II is the most common and type III the least common heterostructure type. We subsequently analyze the chemical trends for each heterostructure type in terms of the Periodic Table of constituent elements. The band alignment data can also be used for identifying photocatalysts and high-work-function 2D metals for contacts. We validate our results by comparing them to experimental data as well as hybrid-functional predictions. Additionally, we carry out DFT calculations of a few selected systems (MoS 2 /WSe 2 , MoS 2 /h-BN, and MoSe 2 /CrI 3 ), to compare the band-alignment description with the predictions from Anderson’s rule. We develop web-apps to enable users to virtually create combinations of 2D materials and predict their properties. Additionally, we use ML tools to predict band-alignment information for 2D materials. The web-apps, tools, and associated data will be distributed through the JARVIS-HETEROSTRUCTURE website. Our analysis, results, and the developed web-apps can be applied to the screening and design applications, such as finding alternative photocatalysts, photodetectors, and high-work-function (WF) 2D-metal contacts.

2-dimensional systems↗
DOE OSTI2021

Multiscale Machine-Learned Modeling Infrastructure RAS

MuMMI RAS is the application component of the Multiscale Machine-Learned Modeling Infrastructure (MuMMI). It simulates RAS protein interactions at three scales of resolution coupled with ML-based selection and in-situ feedback. MuMMI RAS is particularly configured for massive scale, running thousands of simultaneous jobs with several terabytes of data on Lassen and Summit.

Moon, JosephY.↗
NASA NTRS2017

A Machine Learning Concept for DTN Routing

This paper discusses the concept and architecture of a machine learning based router for delay tolerant space networks. The techniques of reinforcement learning and Bayesian learning are used to supplement the routing decisions of the popular Contact Graph Routing algorithm. An introduction to the concepts of Contact Graph Routing, Q-routing and Naive Bayes classification are given. The development of an architecture for a cross-layer feedback framework for DTN (Delay-Tolerant Networking) protocols is discussed. Finally, initial simulation setup and results are given.

Delay Tolerant Networks↗
NASA NTRS2021

Toward Certification of Machine-Learning Systems for Low Criticality Airborne Applications

The exceptional progress in the field of machine learning (ML) in recent years has attracted a lot of interest in using this technology in aviation. Possible airborne applications of ML include safety-critical functions, which must be developed in compliance with rigorous certification standards of the aviation industry. Current certification standards for the aviation industry were developed prior to the ML renaissance without taking specifics of ML technology into account. There are some fundamental incompatibilities between traditional design assurance approaches and certain aspects of ML-based systems. In this paper, we analyze the current airborne certification standards and show that all objectives of the standards can be achieved for a low-criticality ML-based system if certain assumptions about ML development workflow are applied.

Avionics↗
NASA NTRS2022

Coevolution of Machine Learning and Process-Based Modelling to Revolutionize Earth and Environmental Sciences: A Perspective

Machine learning (ML) applications in Earth and environmental sciences (EES) have gained incredible momentum in recent years. However, these ML applications have largely evolved in ‘isolation’ from the mechanistic, process-based modelling (PBM) paradigms, which have historically been the cornerstone of scientific discovery and policy support. In this perspective, we assert that the cultural barriers between the ML and PBM communities limit the potential of ML, and even its ‘hybridization’ with PBM, for EES applications. Fundamental, but often ignored, differences between ML and PBM are discussed as well as their strengths and weaknesses in light of three overarching modelling objectives in EES, (1) nowcasting and prediction, (2) scenario analysis, and (3) diagnostic learning. The paper ponders over a ‘coevolutionary’ approach to model building, shifting away from a borrowing to a co-creation culture, to develop a generation of models that leverage the unique strengths of ML such as scalability to big data and high-dimensional mapping, while remaining faithful to process-based knowledge base and principles of model explainability and interpretability, and therefore, falsifiability.

Saman Razavi↗
DOE OSTI2021

MACHINE LEARNING BASED CHEMICAL EXPLOSIVE MODE ANALYSIS (ML-CEMA)

The software consists of a Machine Learning based Chemical Explosive Mode Analysis (ML-CEMA) tool for advanced computational flame diagnostics. CEMA, originally based on eigen-analysis of the local thermochemical system, is capable of identifying reaction fronts and limit phenomena such as auto-ignition and extinction in practical combustion systems, such as internal combustion engines and gas turbine combustors. However, the original CEMA is computationally expensive for large reaction mechanisms that are typically needed to describe fuel chemistry of practical large-hydrocarbon fuels. This novel ML-CEMA tool employs a ML technique to accelerate the eigen-analysis of the basic CEMA approach by orders of magnitude, thus making it suitable for practical fuels. In ML-CEMA,zero-dimensional (0D) reactors and one-dimensional (1D) premixed flames are first used to generate a large number of data points for neural network based ML training. The trained ML model is then used to perform CEMA prediction. This ML-CEMA tool has been demonstrated in canonical 0D and 1D configurations as well as highly-transient three-dimensional spray flames exhibiting multi-mode turbulent combustion, showing promising results. ML-CEMA, as a standalone tool, can be used for computationally-efficient diagnostics of massive datasets generated from both experiments and simulations. For example, based on spatially resolved measurements of a small set of reactive scalars(such as temperature, hydroxyl radical and formaldehyde), ML-CEMA can effectively identify flame fronts and rare events. ML-CEMA also provides a robust online or offline flame feature detection tool. When used for on-the-fly simulations, ML-CEMA further enables zone-adaptive combustion modeling, in which the predicted eigenvalue is used as a robust mode indicator for judicious assignment of locally-valid combustion models. This ML-CEMA based zone-adaptive model can lead to substantial computational cost savings when used for large-scale simulations of multi-mode combustion systems. Third Party Code Web Page to Download Code Web Page Location of Third Party License

Xu, Chao↗
DOE OSTI2026

Solidification cracking of refractory alloys: a computational and machine learning study to investigate composition-dependence for improved weldability and additive manufacturability

Large-batch numerical, CALculation of PHAse Diagrams (CALPHAD)-based solidification cracking calculations are performed and then analyzed with machine learning methods to generate models that relate chemistry of refractory alloys to cracking susceptibility. Kou’s solidification cracking index is used to study the refractory alloys including O, N, C binary mixtures with Mo, Ta, Nb, and W, the molybdenum-based TZM, Niobium-based C103, and Tantalum-based T111 and Ta-10 W, as well as hypothetical refractory ternary alloys. Findings strongly validate Kou’s Crack Susceptibility Index (CSI) against Varestraint test data for Nb- and Ta-based alloys, establishing CSI thresholds where refractory alloys with CSI < 15,000 K are likely weldable, CSI > 15,000 K are prone to cracking, and CSI > 25,000 K are likely unweldable (or unprintable). Furthermore, interstitial elements C, N, and O significantly increase crack susceptibility, with some existing material specifications coinciding with peak cracking susceptibility concentrations. Finally, machine learning-derived elemental potency factors enable rapid prediction of CSI from alloy chemistry for C103, TZM, Ta-10 W, and T-111 alloys. These results provide practical guidance for feedstock selection, powder reuse limits, and alloy specification amendments for welding and additive manufacturing applications.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Machine learning methods for particle stress development in suspension Poiseuille flows

Numerical simulations are used to study the dynamics of a developing suspension Poiseuille flow with monodispersed and bidispersed neutrally buoyant particles in a planar channel, and machine learning is applied to learn the evolving stresses of the developing suspension. The particle stresses and pressure develop on a slower time scale than the volume fraction, indicating that once the particles reach a steady volume fraction profile, they rearrange to minimize the contact pressure on each particle. Here we consider how the stress development leads to particle migration, time scales for stress development, and present a new physics-informed Galerkin neural network that allows for learning the particle stresses when direct measurements are not possible. The particle fluxes are compared with the Suspension Balance Model with good agreement. We show that when stress measurements are possible, the MOR-physics operator learning method can also capture the particle stresses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Detecting Large Explosions With Machine Learning Models Trained on Synthetic Infrasound Data

Explosions produce low-frequency acoustic (infrasound) waves capable of propagating globally, but the spatio-temporal variability of the atmosphere makes detecting events difficult. Machine learning (ML) is well-suited to identify the subtle and nonlinear patterns in explosion infrasound signals, but a previous lack of ground-truth data inhibited training of generalized models. We introduce a physics-based method that propagates infrasound sources through realistic atmospheres to create 28,000 synthetic events, which are used to train ML classifiers. A simple artificial neural network and modern temporal convolutional network discriminate synthetic events from background noise with >90% accuracy and, more importantly, successfully identify the majority of real-world explosion signals recorded during the Humming Road Runner experiment. ML models trained entirely on physics-based synthetics advance explosion detection capabilities and make ML more viable to related fields lacking training data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Evaluating Production Implications of Pressure Maintenance in Unconventional Oil and Gas Wells using a Machine Learning Modeling Approach: Case Study in the Permian Basin

This study implements the proprietary machine learning-based model (model) developed under the 2022 study titled “Evaluating the Impact of Proprietary Oil & Gas Data on Machine Learning Model Performance Using a Quasi-Experimental Analytical Approach” for forecasting unconventional oil and gas production using well data from the Permian Basin. The model, developed using an exclusive dataset that includes time series production data from an operator in the Permian Basin, is designed to jointly predict daily oil, gas, and water production for horizontal wells as a function of bottomhole pressure drawdown, spatial placement across the study domain, and well-completion attributes. In this study, the model was explicitly applied to explore its utility to evaluate the impact of varying drawdown strategies on the production forecast of a well in the Permian Basin dataset. Managing pressure drawdown has been identified as a way to improve estimated ultimate recovery (EUR) from unconventional shale wells due to the stress-dependent nature of fractures in shale reservoirs. Research has shown that applying a lower pressure drawdown helps to maintain the reservoir conductivity, resulting in higher productivity over the life of a well. Historic bottomhole pressure data from the well over time was used as a benchmark from which to set more and less aggressive pressure decline rates as bounding modeling cases. All pressure decline rates/strategies were forecasted over 5 years, and the model was used to generate oil, water, and gas prediction over the same timeframe. This report presents the results from the production forecast and discusses potential operational and economic implications, with contrasting perspectives between well productivity and profitability given typical oil and gas economics and the volatility in the oil and gas market.

02 PETROLEUM↗
DOE OSTI2020

Machine learning assisted hybrid models can improve streamflow simulation in diverse catchments across the conterminous US

Incomplete representations of physical processes often lead to structural errors in process-based (PB) hydrologic models. Machine learning (ML) algorithms can reduce streamflow modeling errors but do not enforce physical consistency. As a result, ML algorithms may be unreliable if used to provide future hydroclimate projections where climates and land use patterns are outside the range of training data. Here we test hybrid models built by integrating PB model outputs with a ML algorithm known as Long Short-Term Memory (LSTM) network on their ability to simulate streamflow in 531 catchments representing diverse conditions across the Conterminous United States. Model performance of hybrid models as measured by Nash-Sutcliffe efficiency (NSE) improved relative to standalone PB and LSTM models. More importantly, hybrid models provide highest improvement in catchments where PB models fail completely (i.e., NSE < 0). However, all models performed poorly in catchments with extended low flow periods, suggesting need for additional research.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A comprehensive techno-eco-assessment of CO 2 enhanced oil recovery projects using a machine-learning assisted workflow

Carbon dioxide enhanced oil recovery (CO 2 -EOR) projects not only extract residual oil but also sequestrate CO 2 in the depleted reservoirs. Here, this study develops a machine-learning-based workflow to co-optimize the hydrocarbon recovery, CO 2 sequestration volume and project net present value (NPV) simultaneously. Considering the trade-off relationships among the objective functions, support vector regression with Gaussian kernel (Gaussian- SVR) proxies are coupled with multi-objective particle swarm optimization (PSO) protocol and generate Pareto optimal solutions. Taking advantage of the high computational efficacy of the proxy model, economic uncertainties introduced by tax credits, capital costs and oil price are investigated by this study. The results indicate that the tax incentive policy (Section 45Q) plays a vital role in enhancing the economic returns of CO 2 -EOR projects, especially under the depression of crude oil market. The proposed workflow has been successfully implemented to optimize a water alternative CO 2 (CO 2 -WAG) injection project in a depleted oil sand in the US. The optimization results yield an incremental oil production of 15.8 MM STB and 1.37 MM metric tons of CO 2 storage in a 20-year development strategy, with the highest project NPV to be 205.6 MM US dollars.

03 NATURAL GAS↗