Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Targeted Chemical Looping Materials Discovery by an Inverse Design

Chemical looping with oxygen uncoupling (CLOU) materials is actively sought for combustion of carbonaceous materials to achieve complete conversion and capture of carbon dioxide. These materials may play a vital role in reducing atmospheric carbon via negative carbon output. However, there is no one‐size‐fits‐all approach as different operating conditions and feedstocks may require different CLOU materials. As a result, the exploration and discovery of high‐performance CLOU materials can be a slow process. To address this challenge, a high‐throughput inverse machine learning workflow that identifies optimum materials from perovskite oxides for a given set of targets is developed—temperature and Gibbs free energy of oxygen formation. The model is trained on high‐throughput density functional theory calculations of CLOU materials and inverts the materials design process using a genetic algorithm to produce realistic substituted SrFeO 3‐δ compositions as output. Using the inverse model, it is able to identify several interesting new families of CLOU materials: Sr 1‐ x A x Fe 1‐ y B y O 3‐δ (e.g., A = Ca or K; B = Mg, Bi, Mn, Ni, Co, Cu, or Zn). These materials have shown promising properties, and some of them even outperform the benchmark material in terms of oxygen release kinetics under relevant CLOU operating conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Predicting Critical Transitions in Multiscale Data

Predicting the dynamics of complex nonlinear systems remains a challenging problem both in dynamical systems theory as well as real world science and engineering applications. Data-driven methods utilizing the latest advances in machine learning (ML) provide a promising new paradigm for this task. Our work centered on Reservoir Computing (RC), which has shown itself to be capable of skillfully predicting chaotic dynamics in multiscale systems. In the first part of the work, the focus is on how to improve predictions of critical transitions in a class of slow-fast metastable systems in which the equations are known. An additional goal was to determine whether a relationship exists between RC and Koopman operator theory, to improve the efficiency and broaden the applicability of the approach. In the second part of this work, a variation on the RC model known as Reconstructive Reservoir Computing (RRC) is applied to real-world data to identify anomalies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

An atomic cluster expansion potential for twisted multilayer graphene

Twisted multilayer graphene, characterized by its moiré patterns arising from inter-layer rotational misalignment, serves as a rich platform for exploring quantum phenomena. Machine learning interatomic potentials (MLIPs) are a promising approach to model such systems. Our work develops a method to generate training and test datasets for fitting MLIPs that capture all possible misalignments but remain small-scale to facilitate efficient data generation and parameter estimation. To achieve this, we generate configurations with periodic boundary conditions suitable for density functional theory calculations, and then introduce an internal twist and shift within those supercell structures. Using this technique, supplemented with an active learning workflow, we fit an Atomic Cluster Expansion potential for simulating twisted multilayer graphene and test it for accuracy and robustness on a range of simulation tasks.

2D materials↗
DOE OSTI2026

The Use of Machine Learning Models for Predicting the Dielectric Strength of Gases

Technological advancements in high voltage systems have pushed sulfur hexafluoride (SF6) to its operational limits. Furthermore, this gas has other drawbacks including a high liquefaction temperature and a high global warming potential. Therefore, there has been an urgent need to find alternative gases with high dielectric strength (DS). In this work, density functional theory (DFT) is used to calculate molecular descriptors that are fed into an artificial neural network (ANN) and a random forest (RF). These machine learning (ML) models are then used to predict the DS for hundreds of molecules. A finite element model (FEM) is also used to calculate the electric field profile of multiple simple electrode geometries as the applied voltage to the system is increased. Results indicate that the random forest model has better generalization to unseen data than the neural network. The highest DS value predicted by the RF was 2.16 relative to the experimental DS of SF6. The results also demonstrate how choosing a gas with a higher DS and a geometry with minimal edges and corners can significantly increase the operating voltage of an electrical system. Due to its superior generalization, the RF represents the most promising path toward an accurate DS predictor once sufficient experimental data are available.

Mileski, Matthew [AFIT]↗
DOE OSTI2024

Toward a Machine Learning Approach to Interpreting X-ray Spectra of Trace Impurities by Converting XANES to EXAFS

The fact that the photoabsorption spectrum of a material contains information about the atomic structure, commonly understood in terms of multiple scattering theory, is the basis of the popular extended X-ray absorption spectroscopy (EXAFS) technique. How much of the same structural information is present in other complementary spectroscopic signals is not obvious. Here we use a machine learning approach to demonstrate that within theoretical models that accurately predict the EXAFS signal, the extended near-edge region does indeed contain the EXAFS-accessible structural information. We do this by exhibiting deep operator neural networks (DeepONets) that have learned the relationship between the extended and near edge portions of the X-ray absorption spectrum to predict the former from the latter. We find that we can accurately predict the EXAFS spectrum between 6 and 14 Å –1 from the first 6 Å –1 (≈100 eV) of the absorption spectrum of Cu 2 + substitutional defects in the Fe 3+ mineral hematite (α-Fe 2 O 3 ). This surprising finding implies that theoretical analyses of X-ray absorption spectra could be implemented that extract the same conclusions as high-quality EXAFS studies from spectra collected over a much smaller range of photon energies. This relaxes a host of experimental limitations related to the X-ray source and measurement sample, including collection time, minimum dopant concentration, source brilliance, and energy range. We describe the theoretical data sets and DeepONet construction and show that the resulting DeepONets produce EXAFS that recovers linear combination fits to experimental data with accuracy approaching the original ab initio calculations. We discuss the implications of our findings for minor constituent characterization and for understanding the information content of spectroscopic data more broadly, including how this approach might be applied to measured experimental spectra. In conclusion, to encourage similar efforts, the simulated X-ray spectra, machine learning, and fitting code are publicly available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Automation of Active Space Selection for Multireference Methods via Machine Learning on Chemical Bond Dissociation

Predicting and understanding the chemical bond is one of the major challenges of computational quantum chemistry. Kohn–Sham density functional theory (KS-DFT) is the most common method, but approximate density functionals may not be able to describe systems where multiple electronic configurations are equally important. Multiconfigurational wave functions, on the other hand, can provide a detailed understanding of the electronic structures and chemical bonds of such systems. In the complete active space self-consistent field (CASSCF) method, one performs a full configuration interaction calculation in an active space consisting of active electrons and active orbitals. However, CASSCF and its variants require the selection of these active spaces. This choice is not black box; it requires significant experience and testing by the user, and thus active space methods are not considered particularly user-friendly and are employed only by a minority of quantum chemists. Our goal is to popularize these methods by making it easier to make good active space choices. Here, we present a machine learning protocol that performs an automated selection of active spaces for chemical bond dissociation calculations of main group diatomic molecules. The protocol shows high prediction performance for a given target system as long as a properly correlated system is chosen for training. Good active spaces are correctly predicted with a considerably better success rate than random guess (larger than 80% precision for most systems studied). Our automated machine learning protocol shows that a “black-box” mode is possible for facilitating and accelerating the large-scale calculations on multireference systems where single-reference methods such as KS-DFT cannot be applied.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Nonperturbative Guiding Center Model for Magnetized Plasmas

Perturbative guiding center theory adequately describes the slow drift motion of charged particles in the strongly magnetized regime characteristic of thermal particle populations in various magnetic fusion devices. However, it breaks down for particles with large-enough energy. Here, we report on a data-driven method for learning a nonperturbative guiding center model from full-orbit particle simulation data. We show the data-driven model significantly outperforms traditional asymptotic theory in magnetization regimes appropriate for fusion-born α particles in stellarators, thus opening the door to nonperturbative guiding center calculations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Reaction processes at step edges on S-decorated Cu(111) and Ag(111) surfaces: MD analysis utilizing machine learning derived potentials

We report a variety of complexation, reconstruction, and sulfide formation processes can occur at step edges on the {111} surfaces of coinage metals (M) in the presence of adsorbed S under ultra-high vacuum conditions. Given the cooperative many-atom nature of these reaction processes, Molecular Dynamics (MD) simulation of the associated dynamics is instructive. However, only quite restricted Density Functional Theory (DFT)-level ab initio MD is viable. Thus, for M = Ag and Cu, we instead utilize the DeePMD framework to develop machine-learning derived potentials, retaining near-DFT accuracy for the M–S systems, which should have broad applicability. These potentials are validated by comparison with DFT predictions for various key quantities related to the energetics of S on M(111) surfaces. The potentials are then utilized to perform extensive MD simulations elucidating the above diverse restructuring and reaction processes at step edges. Key observations from MD simulations include the formation of small metal–sulfur complexes, especially MS 2 ; development of a local reconstruction at A-steps featuring an S-decorated {100} motif; and 3D sulfide formation. Additional analysis yields further information on the kinetics for metal–sulfur complex formation, where these complexes can strongly enhance surface mass transport, and on the propensity for sulfide formation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Learning how structures form in drift-wave turbulence

Drift-wave turbulence produces anomalous transport via cross-correlations between fluctuations. This transport has profound implications for confinement, structure formation, and virtually all aspects of the non-linear turbulent dynamics. Herein, we use a data-driven method based on deep learning in order to study turbulent transport in the 2D Hasegawa–Wakatani system and infer a reduced mean-field model from numerical solution. In addition to the usual turbulent diffusion, we find an effect which couples the particle flux to the local gradient of vorticity, which tends to modulate the density profile. The direct coupling to the shear is relatively weak. In addition, the deep learning method finds a model for spontaneous zonal flow generation by negative viscosity, stabilized by non-linear and hyperviscous terms. We compare these results to analytic calculations using quasilinear theory and wave kinetics, finding qualitative agreement, though the calculations miss certain higher-order effects. A simplified, 1-D model for the evolution of the profile, flow, and intensity based on the deep learning results is solved numerically and compared to previous models for staircasing based on bistability. We see that the physics uncovered by the deep learning method provided simple explanations for the formation of zonal structures in the density, flow, and turbulence fields. We highlight the important role of symmetry in the deep learning method and speculate on the portability of the method to other applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Methods and Experiences for Developing Abstractions for Data-intensive, Scientific Applications

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need to integrate various programming and computational models with evolving and heterogeneous infrastructure. Pervasive and effective abstractions for distributed infrastructures are thus critical; however, the process of developing abstractions for scientific applications and infrastructures is not well understood. While theory-based approaches for system development are suited for well-defined, closed environments, they have severe limitations for designing abstractions for scientific systems and applications. The design science research (DSR) method provides the basis for designing practical systems that can handle real-world complexities at all levels. In contrast to theory-centric approaches, DSR emphasizes both practical relevance and knowledge creation by building and rigorously evaluating all artifacts. In this work, we show how DSR provides a well-defined framework for developing abstractions and middleware systems for distributed systems. Specifically, we address the critical problem of distributed resource management on heterogeneous infrastructure over a dynamic range of scales, a challenge that currently limits many scientific applications. We use the pilot-abstraction, a widely used resource management abstraction for high-performance, high throughput, big data, and streaming applications, as a case study for evaluating the DSR activities. For this purpose, we analyze the research process and artifacts produced during the design and evaluation of the pilot-abstraction. We find DSR provides a concise framework for iteratively designing and evaluating systems. Finally, we capture our experiences and formulate different lessons learned.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗
DOE OSTI2024

Equivariant, safe and sensitive — graph networks for new physics

This study introduces a novel Graph Neural Network (GNN) architecture that leverages infrared and collinear (IRC) safety and equivariance to enhance the analysis of collider data for Beyond the Standard Model (BSM) discoveries. By integrating equivariance in the rapidity-azimuth plane with IRC-safe principles, our model significantly reduces computational overhead while ensuring theoretical consistency in identifying BSM scenarios amidst Quantum Chromodynamics backgrounds. The proposed GNN architecture demonstrates superior performance in tagging semi-visible jets, highlighting its potential as a robust tool for advancing BSM search strategies at high-energy colliders.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Weighted Composition Operators for Learning Nonlinear Dynamics

Operator theoretic methods in dynamical system have been dominated by the use of Koopman operators and their continuous time counterparts, such as Koopman Generators and Liouville Operators. The advantage gained from their use primarily stems from the ability to extract subspaces and eigenfunctions within a space of observables that are invariant with respect to the Koopman operator over that space. When this occurs, a dynamic mode decomposition of the systems state provides a linear model for the dynamical system. Not all Koopman operators have eigenfunctions that may be exploited in this manner. However, the framework can still be leveraged for approximations using other operators. In this setting, we present a different operator for the study of dynamical systems, the weighted composition operator. These operators are compact for a wide range of dynamics and spaces, and through their interactions with occupation kernels and vector valued kernels, they admit an estimation of the underlying dynamics. Here, this manuscript presents a new algorithm for the data driven study of dynamical systems from data, and also provides two numerical experiments where convergence is achieved as a proof of concept.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Machine-Learned Force Field for Molecular Dynamics Simulations of Nonequilibrium Ammonia Synthesis on Iron Catalysts

Ammonia (NH 3 ) is one of the most important industrial chemicals. The conventional NH 3 synthesis method-the Haber–Bosch process-converts atmospheric nitrogen (N 2 ) into NH 3 using H 2 with an iron (Fe) catalyst. However, this process requires high pressures (100–200 atm) and temperatures (700–800 K) near thermal equilibrium. Recently, Fe-based nanocatalysts have been reported to produce promising NH 3 yields under atmospheric pressures and temperature-modulated nonequilibrium conditions. Understanding the mechanism of nonequilibrium catalysis with programmed temperature variation could help to optimize this fully electrified and less energy-intensive process. Although reactive molecular dynamics (RMD) simulations can be a useful tool to model nonequilibrium catalytic processes, they require the development of accurate force fields (i.e., interatomic potentials). Here, we present a machine-learned (ML) force field within the Deep Potential MD (DPMD) framework, trained using periodic density functional theory (DFT) calculations, to model NH 3 synthesis on Fe catalysts with various surface adsorbates such as *N, *H, *N 2 , *H 2 , *NH, *NH 2 , and *NH 3 . Here, we generated the DFT data from static models of elementary reactions on the most stable (110) surface of body-centered cubic Fe, which then were augmented by data from constant number of particles–volume–temperature (NVT) DFT-MD trajectories at various temperatures. Finally, we utilized the fully optimized ML force field to investigate reaction dynamics at an Fe(110) surface at linearly increasing temperatures using NVT-DPMD simulations. Our simulations indicate that pulsed temperature ramping could prove favorable for NH3 synthesis. For example, we conducted ramping under multiple sets of conditions: (i) from 900 to 1200 K over periods of 0.1–0.3 ns for Fe surfaces precovered with N or NH along with H; and (ii) from 300 to 600 K over 0.1–0.3 ns for Fe surfaces precovered with NH 3 . While our simulations so far are limited to short time scales (very rapid heating), these observations shed light on the mechanism of the high NH 3 synthesis rate achieved in a novel temperature-modulated nonequilibrium catalytic reactor using pulsed heating and cooling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Machine learning-assisted crystal engineering of a zeolite

Abstract It is shown that Machine Learning (ML) algorithms can usefully capture the effect of crystallization composition and conditions (inputs) on key microstructural characteristics (outputs) of faujasite type zeolites (structure types FAU, EMT, and their intergrowths), which are widely used zeolite catalysts and adsorbents. The utility of ML (in particular, Geometric Harmonics) toward learning input-output relationships of interest is demonstrated, and a comparison with Neural Networks and Gaussian Process Regression, as alternative approaches, is provided. Through ML, synthesis conditions were identified to enhance the Si/Al ratio of high purity FAU zeolite to the hitherto highest level (i.e., Si/Al = 3.5) achieved via direct (not seeded), and organic structure-directing-agent-free synthesis from sodium aluminosilicate sols. The analysis of the ML algorithms’ results offers the insight that reduced Na 2 O content is key to formulating FAU materials with high Si/Al ratio. An acid catalyst prepared by partial ion exchange of the high-Si/Al-ratio FAU (Si/Al = 3.5) exhibits improved proton reactivity (as well as specific activity, per unit mass of catalyst) in propane cracking and dehydrogenation compared to the catalyst prepared from the previously reported highest Si/Al ratio (Si/Al = 2.8).

36 MATERIALS SCIENCE↗
DOE OSTI2020

Data-driven recovery of hidden physics in reduced order modeling of fluid flows

In this article, we introduce a modular hybrid analysis and modeling (HAM) approach to account for hidden physics in reduced order modeling (ROM) of parameterized systems relevant to fluid dynamics. The hybrid ROM framework is based on using first principles to model the known physics in conjunction with utilizing the data-driven machine learning tools to model the remaining residual that is hidden in data. This framework employs proper orthogonal decomposition as a compression tool to construct orthonormal bases and Galerkin projection (GP) as a model to build the dynamical core of the system. Our proposed methodology hence compensates structural or epistemic uncertainties in models and utilizes the observed data snapshots to compute true modal coefficients spanned by these bases. The GP model is then corrected at every time step with a data-driven rectification using a long short-term memory (LSTM) neural network architecture to incorporate hidden physics. A Grassmannian manifold approach is also adopted for interpolating basis functions to unseen parametric conditions. The control parameter governing the system's behavior is thus implicitly considered through true modal coefficients as input features to the LSTM network. The effectiveness of the HAM approach is then discussed through illustrative examples that are generated synthetically to take hidden physics into account. Furthermore, our approach thus provides insights addressing a fundamental limitation of the physics-based models when the governing equations are incomplete to represent underlying physical processes.

42 ENGINEERING↗
DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗