SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This document describes the Impeded (ITOM) and Unimpeded Taxi Out Time Prediction Model (UTOM) Machine Learning (ML) services developed under the ATD-2 subproject as a reference implementation and released by NASA as Open Source software on github.
The root cause of post-weld baking on the mechanical performance of Al-steel dissimilar resistance spot welds (RSWs) has been determined by machine learning (ML) and finite element modeling (FEM) in this study. A deep neural network (DNN) model was constructed to associate the spot weld performance with the joint attributes, stacking materials, and other conditions, using a comprehensive experimental dataset. The DNN model positively identified that the post-weld baking reduces the joint performance, and the extent of degradation depends on the thickness of stacking materials. A three-dimensional finite element (FE) model was then used to investigate the root cause and the mechanism of the baking effect. It revealed that the formation of high thermal stresses during baking, from the mismatch of thermal expansion between steel and Al alloy, causes damage and cracking of the brittle intermetallic compound (IMC) formed at the interface of the weld nugget during welding. This in turn reduces the joint performance by promoting undesirable interfacial fracture when the welds were subjected to externally applied loads. The FEM model further revealed that increase in structural stiffness, because of increase in steel sheet thickness, reduces the thermal stresses at the interface caused by the thermal expansion mismatch and consequently lessens the detrimental effect of post-weld baking on the joint performance.
The movement of solutes in a watershed is a complex process with multiple interactions and feedbacks across spatial and temporal scales. Modeling the dynamics of solute transport along diverse hydrologic pathways within watersheds – from hillslopes to stream channels and in and out of the hyporheic zones – is challenging but critically important, as these processes integrate and contribute to the biogeochemical functioning of the river corridor up to the river network scale. Here we use results from a long-term network-scale tracer test at the H.J. Andrews experimental forest in western Cascade Mountains, Oregon, USA to inform a multiscale framework for transport in stream corridors. The framework uses a Lagrangian-based subgrid model to represent the effects of hyporheic exchange flow and advective transport at stream network scales. The spatially and temporally resolved stream discharge needed for the transport model is imputed across the river system by an entity-aware long short-term memory network. Modeled concentrations show good agreements with the observations and exhibit power scaling laws indicative of a very wide range of timescales over which hyporheic exchange flow occurs. Our results demonstrate a data-informed modeling framework that links dynamical processes occurring at small scales to a network context to help understand how changes at reach scale cascade into network-scale effects, providing a useful tool for sustainable river basin management.
Final project briefing from PingThings for FOA 1861
Machine learning (ML) algorithms have been increasingly successful in their applications to solve energy and environmental engineering problems. ML algorithms have the advantage of being able to solve highly nonlinear issues effectively. Furthermore, considering the limited sample size of data collected in energy and environmental engineering, obtaining a ML model with reasonable accuracy is simple. Unfortunately, the vast majority of the current applications of ML algorithms lack effective screening of dominant factors and comprehensive model validation, which weakens the predictive ability of the models. The present study takes the minimum miscible pressure (MMP) of CO 2 - oil systems as an example. It establishes a systematic and robust predictive model to address this issue. Based on 147 sets of slim tube tests, the predictive models of the MMPs are investigated by application of eight ML algorithms. The paper concludes that most of the published ML models in the field of energy and environmental engineering prediction are not reliable. Furthermore, it addresses the main reasons for the poor performance of some predictive models built by ML and provides guidelines on how to make such models robust. Further, to the best of our knowledge, this is the first study to point out the defects of current ML modeling methods and propose countermeasures for their application in energy and environmental engineering problems.
Generating high-fidelity geological models is essential for advancing machine learning (ML) methods in automated seismic interpretation. For instance, seismic images paired with corresponding fault labels are foundational for ML-based fault detection from seismic migration sections. While several open-access datasets of random geological models exist, open-source tools specifically designed to produce large volumes of such models for ML applications remain scarce. To address this gap, we present RGM (Random Geological Model), an open-source software package for efficiently generating 2D and 3D synthetic geological models tailored for ML workflows. RGM supports the creation of diverse model components, including medium property distributions (P-/S-wave velocities and density), seismic reflectivity images (i.e., synthetic migration sections), relative geological time, and discrete fault attributes such as probability, dip, strike, rake, and displacement. It also accommodates the creation of complex geological features such as salt bodies and unconformities. The model generation algorithm employs a multi-randomization strategy, yielding an effectively infinite-dimensional model space that encompasses a wide range of geological scenarios and associated seismic features. Furthermore, RGM incorporates a method to generate synthetic elastic migration images using analytical elastic reflection coefficients combined with frequency-dependent scaling. This functionality enables the creation of training datasets for ML models that leverage elastic seismic images. RGM is implemented in modern object-oriented Fortran, allowing users to flexibly control statistical parameters governing model variability. We demonstrate the capability, performance, and geological realism of the package through comprehensive 2D and 3D examples.
Atomic disorder can strongly influence material properties such as charge transport, optical response, and catalytic activity. However, efficiently modeling these disorder effects remains challenging for first-principles methods due to the cost of sampling large configurational spaces and computing complex physical quantities. Recent advances of machine learning techniques, particularly graph neural networks (GNNs), has enabled the efficient and accurate predictions of complex material properties, offering promising tools for studying disordered systems. In this work, we present a general machine-learning-assisted computational framework that integrates equivariant GNNs with Monte Carlo simulations to compute the thermodynamic and ensemble-averaged functional properties of disordered materials. Using the surface-termination-disordered MXene monolayer Ti 3 C 2 T 2–x as a representative system, we find that electrical conductivity exhibits an emergent peak near the order–disorder phase transition temperature due to the interplay between electron scattering and doping. In contrast, optical conductivity remains largely insensitive to local atomic disorder and reflects the global surface chemical composition. These results highlight the role of atomic disorder in affecting material properties and demonstrate the potential of our approach for statistically modeling disorder effects in a wide range of materials such as high-entropy alloys and spin liquids.
Metal organic frameworks (MOFs) are a large class of porous materials and have garnered significant interest due to their large surface areas and their tunable physical and chemical properties. Numerous prior studies have been performed to screen large databases of this material class for promising DAC sorbent materials. These studies have often relied on classical model potentials. While density functional theory (DFT) calculations have been shown to be very accurate for modeling the interaction of CO2 with MOFs, such calculations are too computationally demanding for statistically significant adsorption predictions. To overcome this barrier, we developed methods for training models to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption using machine learned force fields (MLFFs). These methods were parametrized based on DFT calculations of CO2 in a flexible MOF and used to predict MOF structural properties as well as CO2 adsorption in several MOFs.
Abstract Atmospheric radiation is the main driver of weather and climate, yet due to a complicated absorption spectrum, the precise treatment of radiative transfer in numerical weather and climate models is computationally unfeasible. Radiation parameterizations need to maximize computational efficiency as well as accuracy, and for predicting the future climate many greenhouse gases need to be included. In this work, neural networks (NNs) were developed to replace the gas optics computations in a modern radiation scheme (RTE+RRTMGP) by using carefully constructed models and training data. The NNs, implemented in Fortran and utilizing BLAS for batched inference, are faster by a factor of 1–6, depending on the software and hardware platforms. We combined the accelerated gas optics with a refactored radiative transfer solver, resulting in clear‐sky longwave (shortwave) fluxes being 3.5 (1.8) faster to compute on an Intel platform. The accuracy, evaluated with benchmark line‐by‐line computations across a large range of atmospheric conditions, is very similar to the original scheme with errors in heating rates and top‐of‐atmosphere radiative forcings typically below 0.1 K day −1 and 0.5 W m −2 , respectively. These results show that targeted machine learning, code restructuring techniques, and the use of numerical libraries can yield material gains in efficiency while retaining accuracy.
Chemically reacting flows play a key role in a wide range of engineered systems, from chemical and polymer processing to combustion-based energy conversion technologies. Simulations of these flows involve solving a coupled set of partial differential equations for mass, momentum, energy, and all relevant chemical species in the system. Chemical reaction pathways may be extremely complex and involve hundreds or more intermediate species, with reactions that occur over timescales varying by several orders of magnitude - presenting a significant numerical stiffness challenge. The combination of these factors makes simulation of chemically reacting flows vastly more expensive than nonreactive simulations, and often makes direct solution of the governing equations intractable. It is necessary to apply lower-fidelity models in place of the detailed governing equations in order to reduce computational cost to enable reacting flow simulation tools to be used in the engineering design process. Many of the models employed for this purpose are based on reducing the dimension of the thermochemical state, motivated by the observation that the observed thermochemical states in a system lie on a low-dimensional manifold in thermochemical state space. This behavior occurs due to the fast equilibration of certain reactive and transport processes, and physics-based manifold models rely on idealized assumptions about the balance of timescales and the way in which chemistry and transport are coupled. In this work, we apply a novel method for data-driven manifold-based modeling that can leverage data from high-fidelity reacting flow simulations to improve model accuracy in cases where the physics-based modeling assumptions break down. The approach is designed to be broadly applicable across chemically reacting flow systems but is applied here to turbulent combustion modeling.
Ten established, data-driven dynamic algorithms are surveyed and a practical guide for understanding these methods generated. Existing Python programming packages for implementing each algorithm are acknowledged, and the model equations necessary for prediction are presented. A case study on a coal-fired power plant’s NO x emission rates is performed, directly comparing each modeling method’s performance on a mutual system. Each model is evaluated by its root mean squared error (RMSE) on out-of-sample future horizon predictions. Optimal hyperparameters are identified using either an exhaustive search or genetic algorithm. The top five model structures of each method are used to recursively predict future NO x emission rates over a 60-step time horizon. The RMSE at each future timestep is determined, and the recursive output prediction trends compared against measurements in time. The GRU neural network is identified as the best candidate for representing the system, demonstrating accurate and stable predictions across the future horizon by all considered models, while satisfactory performance was observed in several of the ARX/NARX formulations. Finally, these efforts have contributed 1) a concise resource of multiple proven dynamic machine learning methods, 2) a practical guide explaining the use of these methods, effectively lowering the “barrier-to-entry” of deploying such models in control systems, 3) a comparison study evaluating each method’s performance on a mutual system, 4) demonstration of accurate multi-timestep emissions modeling suitable for systems-level control, and 5) generalizable results demonstrating the suitability of each method for prediction over a multi-step future horizon to other complex dynamic systems.
We report modeling the sudden depressurization of superheated liquids through nozzles is a challenge because the pressure drop causes rapid flash boiling of the liquid. The resulting jet usually demonstrates a wide range of structures, including ligaments and droplets, due to both mechanical and thermodynamic effects. As the simulation comprises increasingly numerous phenomena, the computational cost begins to increase. One way to moderate the additional cost is to use machine learning surrogacy for specific elements of the calculation. This study presents a machine learning-assisted computational fluid dynamics approach for simulating the atomization of flashing liquids accounting for distinct stages, from primary atomization to secondary breakup to small droplets using the Σ - Y model coupled with the homogeneous relaxation model. Notably, the models for thermodynamic non-equilibrium (HRM) and Σ - Y are coupled, for the first time, with a deep neural network that simulates the turbulence quantities, which are then used in the prediction of superheated liquid jet atomization. The data-driven component of this method is used for turbulence modeling, avoiding the solution of the two-equation turbulence model typically used for Reynolds-averaged Navier-Stokes simulations for these problems. Both the accuracy and speed of the hybrid approach are evaluated, demonstrating adequate accuracy and at least 25% faster computational fluid dynamics simulations than the traditional approach. This acceleration suggests that perhaps additional components of the calculation could be replaced for even further benefit. Published under an exclusive license by AIP Publishing.
The search for evidence of new physics via its signatures in the cosmos is a cornerstone goal of the Office of High Energy Physics in the DOE Office of Science. Indeed, the current concordance cosmological model provides intriguing hints for beyond-the-standard-model (BSM) physics, such as dark matter and dark energy. Recently, a potential breakdown has appeared in this model, which could be initial evidence toward a further important revision in our fundamental theoretical understanding of cosmology. This breakdown is reflected in disagreements between inferences of the current expansion rate of the universe, H 0 (the Hubble constant), based on indirect, cosmological data (e.g., from the early universe) and based on direct, local measurements. Despite significant effort, a compelling new concordance cosmological model has yet to be found; achieving significant progress on this front was the first major focus of the project. Theoretical considerations indicate that if the observational discrepancies are not due to systematic errors, they strongly suggest new physics operating in the redshift range just prior to recombination, when cosmic microwave background (CMB) photons last scattered. Crucially, almost all such models produce unique signatures in the CMB temperature and polarization power spectra, which will be measured with unprecedented precision by ongoing and upcoming experiments, including the DOE-supported CMB-S4 project. However, these subtle hints of new physics must be uncovered from beneath a swath of Galactic and extragalactic foreground contamination. Current CMB analysis methods, although powerful, do not optimally infer the CMB power spectrum in the presence of non-Gaussian foregrounds. There is thus scope for theoretical improvement in this foundational challenge of cosmological inference, which formed the second major focus of the project. The primary objectives of the project were two-fold: (1) to develop new theoretical models in cosmology that can restore concordance amongst the full suite of cosmological data sets, thereby potentially providing evidence of novel BSM physics; (2) to develop new theoretical machinery to enable significant sensitivity improvements in searches for new physics in cosmology, particularly via the CMB power spectrum. The two objectives are intertwined, as the analysis methodology improvements in (2) will enable the tightest possible constraints on the signatures of new physics predicted by the novel scenarios in (1). The theoretical approaches to restore concordance focused on models involving novel scalar field dynamics in the pre-recombination universe (the “early dark energy” scenario and modifications thereof), as well as couplings between this field and other components in the standard cosmological model, such as dark matter. We also studied a model featuring a generalization of the decaying dark matter scenario, in which a sub-component of dark matter converts into dark radiation at late times in cosmic history. While these ideas are mostly driven by phenomenological considerations, this tactic has proven extremely successful in cosmology throughout the past few decades, including in the early history of evidence for dark matter and dark energy. The new theoretical machinery envisioned in (2) is undergirded by developments in signal processing and machine learning, which will enable improvements in CMB power spectrum estimation in the presence of non-Gaussian foreground contaminants. In turn, this will yield optimal sensitivity in searches for new physics in the CMB, by maximizing the cosmological information that is extracted from this observable. The most ambitious outcome of this work would be the construction of a new cosmological model that restores concordance amongst data sets. Although the individual models studied here did not fully achieve that goal, significant progress in narrowing down the model space was made, as described below. Moreover, the outcome of the methodological improvements in (2) will significantly impact a wide range of theoretical cosmology, by enabling the tightest possible constraints on any model that leaves novel signatures in the CMB temperature and polarization power spectra.
Subsurface data analysis, reservoir modeling, and machine learning (ML) techniques have been applied to the Brady Hot Springs (BHS) geothermal field in Nevada, USA to further characterize the subsurface and assist with optimizing reservoir management. Hundreds of reservoir simulations have been conducted in TETRAD-G and CMG STARS to explore different injection and production fluid flow rates and allocations and to develop a training data set for ML. This process included simulating the historical injection and production since 1979 and prediction of future performance through 2040. ML networks were created and trained using TensorFlow based on multilayer perceptron (MLP), long short-term memory (LSTM), and convolutional neural network (CNN) architectures. These networks took as input selected flow rates, injection temperatures, and historical field operation data and produced estimates of future production temperatures. This approach was first successfully tested on a simplified single fracture doublet system, followed by the application to the BHS reservoir. Using an initial BHS dataset with 37 simulated scenarios, the trained and validated network predicted the production temperature for 6 production wells with the mean absolute percentage error of less than 8%. In a complementary analysis effort, the principal component analysis applied to 13 BHS geological parameters revealed that vertical fracture permeability shows the strongest correlation with fault density and fault intersection density. A new BHS reservoir model was developed considering the fault intersection density as proxy for permeability. This new reservoir model helps to explore under-exploited zones in the reservoir. A data gathering plan to obtain additional subsurface data was developed; it includes temperature surveying for three idle injection wells, at which the reservoir simulations indicate high bottom-hole temperatures. The collected data assist with calibrating the reservoir model and may lead to converting these wells to producers to access under-exploited zones in the reservoir. Data gathering activities are planned for the first quarter of 2021.
Direct air capture (DAC) is a method for removing CO2 directly from air. Metal organic frameworks (MOFs) have been studied as DAC sorbent materials because of their structural and chemical diversity. Thermodynamic calculations using classical force fields are often used to evaluate MOFs for their performance in separations such as CO2 capture. Machine-learned force fields (MLFFs) can use machine learning to form quantitative relationships between a material’s chemical structure and the forces and energies predicted by more accurate quantum mechanical calculations, such as dispersion-corrected density functional theory (DFT). These descriptions of forces and energies can be used to improve the accuracy of adsorption calculations. In this work, classical models were used to pre-screen MOFs for CO2 capture. DFT calculations were then used to examine the adsorption mechanism. Next, MLFF models were developed for MOFs to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption. These methods were parametrized based on thousands of DFT calculations of CO2 in flexible MOFs and used to predict MOF structural properties as well as CO2 adsorption properties.
Not Available
To cope with legacy greenhouse gas emissions and to achieve net-zero emissions by 2050, the U.S. Department of Energy (DOE) is funding efforts to develop direct air capture (DAC), a method for removing CO2 directly from air. Metal organic frameworks (MOFs) have been studied as DAC sorbent materials because of their structural and chemical diversity. Thermodynamic calculations using classical force fields are often used to screen MOFs for their performance in separations such as CO2 capture. Machine-learned force fields (MLFFs) can use machine learning to form quantitative relationships between a material’s chemical structure and the forces and energies predicted by more accurate quantum mechanical calculations, such as dispersion-corrected density functional theory (DFT). These descriptions of forces and energies can be used to improve the accuracy of adsorption calculations. In this work, MLFF models were developed for MOFs to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption. These methods were parametrized based on thousands of DFT calculations of CO2 in flexible MOFs and used to predict MOF structural properties as well as CO2 adsorption properties.
Heterogeneous membranes or films are thin and soft structures with spatial variations in material property and thickness. Mechanical behavior of heterogeneous membranes is not well understood, mainly due to the difficulty in obtaining accurate and reliable material property data. To understand the mechanical behavior of these materials, accurate and efficient characterization methods for heterogeneous membranes are needed. Here, in this paper, an inverse method based on machine learning is developed to efficiently extract mechanical properties from full-field strain distributions. This approach is demonstrated on a flat heterogeneous membrane with uniform thickness formed by up to four linear elastic synthetic materials in a grid arrangement, and deforming in a moderate strain range (true strain ~10%). The results show that the machine learning method achieves accuracy comparable to the traditional inverse finite element method, and is 6 orders of magnitude faster in the demonstrated case studies.