Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A kinetic-based regularization method for data science applications

We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce corrections that impose constraints on the lower-order moments of the data distribution. This minimizes the discrepancy between the discrete and continuum representations of the data, in turn allowing to access more favorable energy landscapes, thus improving the accuracy of the interpolator. Our approach improves performance in both interpolation and regression tasks, even in high-dimensional spaces. Unlike traditional methods, it does not require empirical parameter tuning, making it particularly effective for handling noisy data. We also show that thanks to its local nature, the method offers computational and memory efficiency advantages over Radial Basis Function interpolators, especially for large datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

AENET–LAMMPS and AENET–TINKER : Interfaces for accurate and efficient molecular dynamics simulations with machine learning potentials

Machine-learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular dynamics and Monte Carlo simulations, an integration of the MLPs with sampling software is needed. Here, we develop two interfaces that link the atomic energy network (ænet) MLP package with the popular sampling packages TINKER and LAMMPS. The three packages, ænet, TINKER, and LAMMPS, are free and open-source software that enable, in combination, accurate simulations of large and complex systems with low computational cost that scales linearly with the number of atoms. Scaling tests show that the parallel efficiency of the ænet–TINKER interface is nearly optimal but is limited to shared-memory systems. The ænet–LAMMPS interface achieves excellent parallel efficiency on highly parallel distributed memory systems and benefits from the highly optimized neighbor list implemented in LAMMPS. We demonstrate the utility of the two MLP interfaces for two relevant example applications: the investigation of diffusion phenomena in liquid water and the equilibration of nanostructured amorphous battery materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Cu–Ni Oxidation Mechanism Unveiled: A Machine Learning-Accelerated First-Principles and in Situ TEM Study

Here, the development of accurate methods for determining how alloy surfaces spontaneously restructure under reactive and corrosive environments is a key, long-standing, grand challenge in materials science. Using machine learning-accelerated density functional theory and rare-event methods, in conjunction with in situ environmental transmission electron microscopy (ETEM), we examine the interplay between surface reconstructions and preferential segregation tendencies of CuNi(100) surfaces under oxidation conditions. Our modeling approach predicts that oxygen-induced Ni segregation in CuNi alloys favors Cu(100)-O c(2 × 2) reconstruction and destabilizes the Cu(100)-O (2√2 × √2)R45° missing row reconstruction (MRR). In situ ETEM experiments validate these predictions and show Ni segregation followed by NiO nucleation and growth in regions without MRR, with secondary nucleation and growth of Cu 2 O in MRR regions. Our approach based on combining disparate computational components and in situ ETEM provides a holistic description of the oxidation mechanism in CuNi, which applies to other alloy systems.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Predicting resistive wall mode stability in NSTX through balanced random forests and counterfactual explanations

Abstract Recent progress in the disruption event characterization and forecasting framework has shown that machine learning guided by physics theory can be easily implemented as a supporting tool for fast computations of ideal stability properties of spherical tokamak plasmas. In order to extend that idea, a customized random forest (RF) classifier that takes into account imbalances in the training data is hereby employed to predict resistive wall mode (RWM) stability for a set of high beta discharges from the NSTX spherical tokamak. More specifically, with this approach each tree in the forest is trained on samples that are balanced via a user-defined over/under-sampler. The proposed approach outperforms classical cost-sensitive methods for the problem at hand, in particular when used in conjunction with a random under-sampler, while also resulting in a threefold reduction in the training time. In order to further understand the model’s decisions, a diverse set of counterfactual explanations based on determinantal point processes (DPP) is generated and evaluated. Via the use of DPP, the underlying RF model infers that the presence of hypothetical magnetohydrodynamic activity would have prevented the RWM from concurrently going unstable, which is a counterfactual that is indeed expected by prior physics knowledge. Given that this result emerges from the data-driven RF classifier and the use of counterfactuals without hand-crafted embedding of prior physics intuition, it motivates the usage of counterfactuals to simulate real-time control by generating the β N levels that would have kept the RWM stable for a set of unstable discharges.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Improved loss functions for machine-learned atomic potentials

Machine learning (ML) has become an invaluable tool across a wide array of domains in science as researchers find new ways to leverage its predictive power. This is especially true in chemistry, where ML is used to fit chemical properties or desirable attributes to the local structure of molecules and materials. In the pursuit of greater accuracy, it is relatively simple to increase the size or complexity of such models, although this often requires simultaneously seeking larger datasets in order to both fit and interpret the larger number of parameters. However, it is equally important to assess the quality and relative importance of the data and how these factors impact the training process. We, therefore, investigate the impact of using different loss functions for training neural network potentials (NNPs), as the loss function defines the error and parameter gradients used to train the NNP. In particular, we test the mean-squared error and Huber loss functions and, using insight from these functions, derive a new loss function based on the Asinh function, which yields significant improvement in the accuracy and generality of NNPs. We show that by discounting/minimizing errors and anomalies in the optimization process, both the Huber and Asinh loss functions improve the training of NNPs, leading to a final potential with a greater effective dimensionality.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Revealing Local Structures through Machine-Learning-Fused Multimodal Spectroscopy

Atomistic structures of materials offer valuable insights into their functionality. Determining these structures remains a fundamental challenge in materials science, especially for systems with defects. While both experimental and computational methods exist, each has limitations in resolving nanoscale structures. Core-level spectroscopies, such as X-ray absorption (XAS) or electron energy-loss spectroscopies (EELS), have been used to determine the local bonding environment and structure of materials. Recently, machine learning (ML) methods have been applied to extract structural and bonding information from XAS/EELS data. However, frameworks relying solely on a single data stream, defined as characterization data derived from a single element using one technique, are often insufficient because multiple local environments can yield similar spectral features, making it challenging to differentiate between competing structural hypotheses. Here, in this work, we address this challenge by integrating multimodal ab initio simulations, experimental data acquisition, and ML techniques for structure characterization. Our goal is to determine local structures and properties using EELS and XAS data from multiple elements and edges. To showcase our approach, we use various lithium nickel manganese cobalt (NMC) oxide compounds which are used for lithium ion batteries, including those with oxygen vacancies and antisite defects, as the sample material system. We successfully inferred local element content, ranging from lithium to transition metals, with quantitative agreement with experimental data. Beyond local element inference, we find that ML model based on multimodal spectroscopic data is able to determine whether local defects such as oxygen vacancy and antisites are present, a task which is impossible for single mode spectra or other experimental techniques. Furthermore, our framework is able to provide physical interpretability, bridging spectroscopy with the local atomic and electronic structures.

battery↗
DOE OSTI2025

Quantum graph learning and algorithms applied in quantum computer sciences and image classification

Graph and network theory play a fundamental role in quantum computer sciences, including quantum information and computation. Random graphs and complex network theory are pivotal in predicting novel quantum phenomena, where entangled links are represented by edges. Quantum algorithms have been developed to enhance solutions for various network problems, giving rise to quantum graph computing and quantum graph learning (QGL). Here, in this review, we explore graph theory and graph learning methods as powerful tools for quantum computers to generate efficient solutions to problems beyond the reach of classical systems. We delve into the development of quantum complex network theory and its applications in quantum computation, materials discovery, and research. We also discuss quantum machine learning (QML) methodologies for effective image classification using qubits, quantum gates, and quantum circuits. Additionally, the paper addresses the challenges of QGL and algorithms, emphasizing the steps needed to develop flexible QGL solvers. This review presents a comprehensive overview of the fields of QGL and QML, highlights recent advancements, and identifies opportunities for future research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Machine Learning‐Guided Discovery of High‐Entropy Perovskite Oxide Electrocatalysts via Oxygen Vacancy Engineering

Abstract High‐entropy perovskite oxides (HEPOs) have recently emerged as multifunctional catalysts. However, the HEPOs’ structural and compositional complexity hinders the easy and accurate extrapolation of activity indicators, which are essential for establishing structure‐property correlations. Here, OxiGraphX, is introduced as a novel graph neural network (GNN) model designed to capture the complex relationships among structure, composition, and atomic chemical environments for accurate prediction of oxygen vacancy formation energies (OVFEs) in HEPOs. By integrating machine learning (ML), density functional theory (DFT), and experimental validation, this work demonstrates an efficient framework for rapidly and accurately screening HEPO electrocatalysts for oxygen evolution reaction (OER). The OxiGraphX predicts OVFEs with a precision exceeding existing data, enabling the identification of compositions of higher oxygen vacancy content (OVC) and, thus, higher catalytic activity. Furthermore, the model explores latent spaces that translate effectively into experimental domains, bridging computational predictions with real‐world applications. This approach accelerates the discovery of high‐performance HEPO catalysts while providing deeper insights into their catalytic mechanisms.

Chemistry↗
DOE OSTI2025

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗
DOE OSTI2026

Constraining Hamiltonians from chiral effective field theory with neutron-star data

Multi-messenger observations of neutron stars (NSs) and their mergers have placed strong constraints on the dense-matter equation of state (EOS). The EOS, in turn, depends on microscopic nuclear interactions that are described by nuclear Hamiltonians. These Hamiltonians are commonly derived within chiral effective field theory (EFT). Ideally, multi-messenger observations of NSs could be used to directly inform our understanding of EFT interactions, but such a direct inference necessitates millions of model evaluations. This is computationally prohibitive because each evaluation requires us to calculate the EOS from a Hamiltonian by solving the quantum many-body problem with methods such as auxiliary-field diffusion Monte Carlo (AFDMC), which provides very accurate and precise solutions but at a significant computational cost. Additionally, we need to solve the stellar structure equations for each EOS which further slows down each model evaluation by a few seconds. In this work, we combine emulators for AFDMC calculations of neutron matter, built using parametric matrix models, and for the stellar structure equations, built using multilayer perceptron neural networks, with the PyCBC data-analysis framework to enable a direct inference of coupling constants in an EFT Hamiltonian using multi-messenger observations of NSs. We find that astrophysical data can provide informative constraints on two-nucleon couplings despite the high densities probed in NS interiors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Computational Analysis of the Energetic Stability of High-Entropy Structures of a Prototypical Lanthanide-Based Metal–Organic Framework

High-entropy materials are characterized by their complex compositions, typically comprising five or more elements in near-equiatomic proportions. Applying this concept to metal ions in metal−organic frameworks (MOFs) has paved the way for exploring a new class of high-entropy MOFs. While the compositional strategy of high-entropy materials leverages configurational entropy to aid thermodynamic stability, it also poses significant analytical challenges due to the vast compositional landscape and diverse phases that these materials can adopt. We present a computational study of several complexities associated with selecting potential high-entropy versions of a prototype lanthanidebased MOF. We compute the energetics of metal mixing of these heterometallic MOFs using density functional theory (DFT) and machine learning interatomic potential (MLIP) methods. The use of MLIP methods allows a systematic exploration of the convex hull of thermodynamically stable MOF structures containing up to 5 distinct metals.

Chemical structure↗
DOE OSTI2023

Mechanisms of Ethylene Epoxidation over Silver from Machine Learning-Accelerated First-Principles Modeling and Microkinetic Simulations

In this work we employed machine learning-augmented density functional theory (DFT) thermodynamic calculations to assess the stability of different AgO x structures under catalytic ethylene epoxidation reaction conditions. We found that there are multiple AgO x surface motifs that could co-exist under the relevant conditions. These included Ag surface oxides (e.g., AgO_p(4 × 4) and Ag 1.83 O) and atomic oxygen-covered Ag(111) surfaces. Furthermore, we employed DFT calculations to evaluate the energetics of different reaction mechanisms by which ethylene and oxygen can react on these surfaces. These studies revealed several energetically viable reaction pathways for ethylene epoxidation. Microkinetic modeling analyses, based on the DFT-calculated reaction pathways, showed that ethylene epoxidation can proceed on all surfaces and that multiple pathways, including those involving Langmuir–Hinshelwood and Eley–Rideal mechanisms, could be involved in selective and unselective reactions. The diversity of mechanisms that we discovered in the context of the relatively simple ethylene epoxidation reaction on Ag suggests that the richness and complexity of surface chemistry are most likely a rule rather than an exception in heterogeneous catalytic chemical transformations on metal surfaces and that the concept of a single or even a dominant mechanism and reaction intermediates might need to be revisited for many reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Microscopic Mechanisms of Superionic Na-ion Conductivity in Crystalline and Amorphous NaMOCl 4 (M = Nb, Ta) Solid Electrolytes

Sodium-ion solid electrolytes offer a sustainable route toward next-generation batteries, but few match the performance of their lithium counterparts. Halide-based NaMOCl 4 (M = Nb, Ta) has recently emerged as a promising analogue to LiMOCl 4 , yet its structure–transport relationships remain unclear due to poor crystallinity in experiments. Here, we combine density functional theory and machine-learned molecular dynamics to reveal that crystalline NaMOCl 4 exhibits negligible room-temperature conductivity with high activation barriers arising from vacancy-mediated diffusion below an order–disorder transition. Above this transition, rotational and translational motion of the [MO 2/2 Cl 4 – ] ∞ chains create new Na sites and enhances transport. In contrast, the amorphous phase inherently supports facile, three-dimensional Na diffusion through dynamic framework flexibility. These results show that ordered crystalline phases hinder ionic transport, while disorder – either thermally induced or structural – facilitates it, revising prior assumptions from the Li system and providing design principles for high-conductivity Na halide electrolytes.

Wei, Grace [University of California, Berkeley, CA↗
DOE OSTI2022

Dissolving salt is not equivalent to applying a pressure on water

Abstract Salt water is ubiquitous, playing crucial roles in geological and physiological processes. Despite centuries of investigations, whether or not water’s structure is drastically changed by dissolved ions is still debated. Based on density functional theory, we employ machine learning based molecular dynamics to model sodium chloride, potassium chloride, and sodium bromide solutions at different concentrations. The resulting reciprocal-space structure factors agree quantitatively with neutron diffraction data. Here we provide clear evidence that the ions in salt water do not distort the structure of water in the same way as neat water responds to elevated pressure. Rather, the computed structural changes are restricted to the ionic first solvation shells intruding into the hydrogen bond network, beyond which the oxygen radial-distribution function does not undergo major change relative to neat water. Our findings suggest that the widely cited pressure-like effect on the solvent in Hofmeister series ionic solutions should be carefully revisited.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Polarization-driven band topology evolution in twisted MoTe 2 and WSe 2

Motivated by recent experimental observations of opposite Chern numbers in R-type twisted MoTe 2 and WSe 2 homobilayers, we perform large-scale density-functional-theory calculations with machine learning force fields to investigate moiré band topology across a range of twist angles in both materials. We find that the Chern numbers of the moiré frontier bands change sign as a function of twist angle, and this change is driven by the competition between moiré ferroelectricity and piezoelectricity. Our large-scale calculations, enabled by machine learning methods, reveal crucial insights into interactions across different scales in twisted bilayer systems. The interplay between atomic-level relaxation effects and moiré-scale electrostatic potential variation opens new avenues for the design of intertwined topological and correlated states, including the possibility of mimicking higher Landau level physics in the absence of magnetic field.

36 MATERIALS SCIENCE↗
DOE OSTI2020

High-throughput investigation of the formation of double spinels

Spinel compounds, with the general chemical formula AB 2 O 4 , are a wide class of materials, where A and B can be a variety of cations, providing this structure with a great deal of functional flexibility and giving rise to its considerable scientific interest. Recently, a spinel with the general formula ABB'O 4 has been predicted, increasing the possible usability of the spinels due to the higher cation diversity in the so-called double spinel structure. In this study, we use density functional theory calculations to predict if double spinels can be formed between experimentally synthesized normal and inverse single spinels. Our computations reveal that 49 double spinels have negative mixing enthalpies and are thus thermodynamically stable, with most of the stable compounds being formed from one of two distinct cation orderings. We show that the 17 different cations that form the different double spinels have a preferred site, tetrahedral or octahedral, except for Mn, Fe and Co which can occupy both sites interchangeably. We also study the relation between mixing enthalpies and cation-specific properties, as well as ways to classify the double spinels into distinct types and spinel groups depending on the cation ordering and cation oxidation states, respectively. Furthermore, by applying the Sure Independence Screening and Sparsifying Operator (SISSO) approach on the coordination-dependent ionic radii of the elemental constituents, we show that an interplay of local strain and electrostatic dominated terms can be used to separate the double spinels into distinct structural types depending on the cation order and their oxidation states.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Electronic structure of strongly correlated systems: recent developments in multiconfiguration pair-density functional theory and multiconfiguration nonclassical-energy functional theory

Strong electron correlation plays an important role in transition-metal and heavy-metal chemistry, magnetic molecules, bond breaking, biradicals, excited states, and many functional materials, but it provides a significant challenge for modern electronic structure theory. The treatment of strongly correlated systems usually requires a multireference method to adequately describe spin densities and near-degeneracy correlation. However, quantitative computation of dynamic correlation with multireference wave functions is often difficult or impractical. Multiconfiguration pair-density functional theory (MC-PDFT) provides a way to blend multiconfiguration wave function theory and density functional theory to quantitatively treat both near-degeneracy correlation and dynamic correlation in strongly correlated systems; it is more affordable than multireference perturbation theory, multireference configuration interaction, or multireference coupled cluster theory and more accurate for many properties than Kohn–Sham density functional theory. This perspective article provides a brief introduction to strongly correlated systems and previously reviewed progress on MC-PDFT followed by a discussion of several recent developments and applications of MC-PDFT and related methods, including localized-active-space MC-PDFT, generalized active-space MC-PDFT, density-matrix-renormalization-group MC-PDFT, hybrid MC-PDFT, multistate MC-PDFT, spin–orbit coupling, analytic gradients, and dipole moments. We also review the more recently introduced multiconfiguration nonclassical-energy functional theory (MC-NEFT), which is like MC-PDFT but allows for other ingredients in the nonclassical-energy functional. We discuss two new kinds of MC-NEFT methods, namely multiconfiguration density coherence functional theory and machine-learned functionals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗