Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

AP-Net: An atomic-pairwise neural network for smooth and transferable interaction potentials

Intermolecular interactions are critical to many chemical phenomena, but their accurate computation using ab initio methods is often limited by computational cost. The recent emergence of machine learning (ML) potentials may be a promising alternative. Useful ML models should not only estimate accurate interaction energies but also predict smooth and asymptotically correct potential energy surfaces. However, existing ML models are not guaranteed to obey these constraints. Indeed, systemic deficiencies are apparent in the predictions of our previous hydrogen-bond model as well as the popular ANI-1X model, which we attribute to the use of an atomic energy partition. As a solution, we propose an alternative atomic-pairwise framework specifically for intermolecular ML potentials, and we introduce AP-Net—a neural network model for interaction energies. The AP-Net model is developed using this physically motivated atomic-pairwise paradigm and also exploits the interpretability of symmetry adapted perturbation theory (SAPT). We show that in contrast to other models, AP-Net produces smooth, physically meaningful intermolecular potentials exhibiting correct asymptotic behavior. Initially trained on only a limited number of mostly hydrogen-bonded dimers, AP-Net makes accurate predictions across the chemically diverse S66x8 dataset, demonstrating significant transferability. On a test set including experimental hydrogen-bonded dimers, AP-Net predicts total interaction energies with a mean absolute error of 0.37 kcal mol−1, reducing errors by a factor of 2–5 across SAPT components from previous neural network potentials. The pairwise interaction energies of the model are physically interpretable, and an investigation of predicted electrostatic energies suggests that the model “learns” the physics of hydrogen-bonded interactions.

Glick, Zachary L. (ORCID:0000000309002849)↗

Gold–Thiolate Nanocluster Dynamics and Intercluster Reactions Enabled by a Machine Learned Interatomic Potential

Monolayer protected metal clusters comprise a rich class of molecular systems and are promising candidate materials for a variety of applications. While a growing number of protected nanoclusters have been synthesized and characterized in crystalline forms, their dynamical behavior in solution, including prenucleation cluster formation, is not well understood due to limitations both in characterization and first-principles modeling techniques. Recent advancements in machine-learned interatomic potentials are rapidly enabling the study of complex interactions such as dynamical behavior and reactivity on the nanoscale. Here, we develop an Au-S-C-H atomic cluster expansion (ACE) interatomic potential for efficient and accurate molecular dynamics simulations of thiolate-protected gold nanoclusters (Au n (SCH 3 ) m ). Trained on more than 30,000 density functional theory calculations of gold nanoclusters, the interatomic potential exhibits ab initio level accuracy in energies and forces and replicates nanocluster dynamics including thermal vibration and chiral inversion. Long dynamics simulations (up to 0.1 μs time scale) reveal a mechanism explaining the thermal instability of neutral Au 25 (SR) 18 clusters. Specifically, we observe multiple stages of isomerization of the Au 25 (SR) 18 cluster, including a chiral isomer. Additionally, we simulate coalescence of two Au 25 (SR) 18 clusters and observe series of clusters where the formation mechanisms are critically mediated by ligand exchange in the form of [Au-S] n rings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning reveals factors that control ion mobility in anti-perovskite solid electrolytes

Solid-state batteries are projected to exhibit improved energy densities and safety compared to liquid-electrolyte-based systems. Consequently, the development of solid electrolytes that can conduct cations at rates comparable to that of liquid electrolytes is an active area of research. To facilitate this search it is desirable to understand the chemical and structural features that control ion transport through a crystalline lattice. Here, machine learning (ML) is used to identify features that influence ion mobility in solids, quantify the relative importance of those features, and demonstrate how the variation of individual features alters ion mobility. Adopting the anti-perovskite lattice as a model system, ML algorithms were trained to predict migration barriers from a data set containing hundreds of barriers calculated using density functional theory. In this study, more than 10 6 feature sets of non-redundant descriptors were evaluated for their ability to predict migration barriers. The present analysis correctly reiterates the importance of several features that are known to influence mobility – for example, anion polarizability – but also identifies others whose importance is not widely recognized. Lattice properties such as hopping distance and channel width exhibit the greatest influence on cation mobility. Individual conditional expectation analyses performed on these features shows that barriers decrease as hopping distance decreases and as channel width increases. The defect formation energy – which is commonly associated with the concentration of defects, but not with their mobility – is identified as an important feature for interstitial migration. In sum, this analysis aids in the design of optimal solid electrolytes by simplifying the multi-dimensional design space to a sub-set of properties that are the most important.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Neutron-antineutron oscillation search with MicroBooNE and DUNE

The Deep Underground Neutrino Experiment (DUNE) is an international project aiming at neutrino physics and astrophysics and a search for phenomena predicted by theories beyond the standard model (BSM). The excellent imaging capability of Liquid Argon Time Projection Chamber (LArTPC) technology, particle tracking and identification utilized in the Far Detector, as well as the Far Detector size and underground placement, allow the experiment to achieve high sensitivity to various rare processes. BSM theories predict the existence of baryon number non-conservation effects, in particular when the baryon number changes by 2. Here we discuss the sensitivity of DUNE to neutron-antineutron oscillation. With full event simulation and reconstruction using the LArSoft package, we have investigated the background to potential signal events from atmospheric neutrino interactions and particle misidentification, and utilized machine learning techniques to enhance the discrimination between signal and background. The methodologies being developed for a high-sensitivity search for neutron-antineutron oscillation in DUNE can also be demonstrated with the currently running MicroBooNE LArTPC. We discuss progress on demonstrating the developed techniques with the first-ever search for neutron-antineutron oscillation in a LArTPC using MicroBooNE data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Revisiting Theoretical Tools and Approaches for the Valorization of Recalcitrant Lignocellulosic Biomass to Value-Added Chemicals

Biorefinery processes for converting lignocellulosic biomass to fuels and chemicals proceed via an integrated series of steps. Biomass is first pretreated and deconstructed using chemical catalysts and/or enzymes to liberate sugar monomers and lignin fragments. Deconstruction is followed by a conversion step in which engineered host organisms assimilate the released sugar monomers and lignin fragments, and produce value-added fuels and chemicals. Over the past couple of decades, a significant amount of work has been done to develop innovative biomass deconstruction and conversion processes that efficiently solubilize biomass, separate lignin from the biomass, maximize yields of bioavailable sugars and lignin fragments and convert the majority of these carbon sources into fuels, commodity chemicals, and materials. Herein, we advocate that advanced in silico approaches provide a theoretical framework for developing efficient processes for lignocellulosic biomass valorization and maximizing yields of sugars and lignin fragments during deconstruction and fuel and chemical titers during conversion. This manuscript surveys the latest developments in lignocellulosic biomass valorization with special attention given to highlighting computational approaches used in process optimization for lignocellulose pretreatment; enzyme engineering for enhanced saccharification and delignification; and prediction of the genome modification necessary for desired pathway fine-tuning to upgrade products from biomass deconstruction into value-added products. Physics-based modeling approaches such as density functional theory calculations and molecular dynamics simulations have been most impactful in studies aimed at exploring the molecular level details of solvent-biomass interactions, reaction mechanisms occurring in biomass-solvent systems, and the catalytic mechanisms and engineering of enzymes involved in biomass degradation. More recently, with ever increasing amounts of data from, for example, advanced mutli-omics experiments, machine learning approaches have begun to make important contributions in synthetic biology and optimization of metabolic pathways for production of biofuels and chemicals.

09 BIOMASS FUELS↗

Generalization Equations for Machine Learners Based on Physical and Abstract Laws

The physical and abstract laws derived from the first principles have been recently exploited to customize and sharpen machine learning (ML) methods and also derive their generalization equations. These laws often encapsulate knowledge that complements datasets and ML models. We present a generic framework that uses these laws to provide ML codes that are transferable across multiple areas, including data transport infrastructures and thermal hydraulics analytics of nuclear reactors. By anchoring on datasets from these areas and the statistical generalization theory, we present a rigorous approach to co-develop ML solutions and the generalization equations that characterize them, by exploiting the structure and constraints from the laws. We present illustrative examples using practical problems from existing literature on the performance characterization of data transport infrastructures, and the sensor error and power level estimation in nuclear reactor systems using sensor measurements of primary and secondary coolant systems, respectively.

Rao, Nageswara↗

It takes a village: using a crowdsourced approach to investigate organic matter composition in global rivers through the lens of ecological theory

Though community-based scientific approaches are becoming more common, many scientific efforts are conducted by small groups of researchers that together develop a concept, analyze data, and interpret results that ultimately translate into a publication. Here, we present a community effort that breaks these traditional boundaries of the publication process by engaging the scientific community from initial hypothesis generation to final publication. We leverage community-generated data from the Worldwide Hydrobiogeochemistry Observation Network for Dynamic River Systems (WHONDRS) consortium to study organic matter composition through the lens of ecological theory. This community endeavor will use a suite of paired physical and chemical datasets collected from 97 river corridors across the globe. With our first step aimed at ideation, we engaged a community of scientists from 20 countries and 60 institutions, spanning disciplines and career stages by holding a virtual workshop (April 2021). In the workshop, participants generated content for questions, hypotheses, and proposed analyses based on the WHONDRS dataset. These ideation efforts resulted in several narratives investigating different questions led by different teams, which will be the basis for research articles in a Frontiers in Water collection. Currently, the community is collectively analyzing, interpreting, and synthesizing these data that will result in seven crowdsourced articles using a single, existing WHONDRS dataset. The use of a shared dataset across articles not only lowers barriers for broad participation by not requiring generation of new data, but also provides unique opportunities for emergent learning by connecting outcomes across studies. Here we will explain methods used to enable this community endeavor aimed to promote a greater diversity of thinking on river corridor biogeochemistry through community science.

Borton, Mikayla A.↗

Efficient, automated Monte Carlo methods for radiation transport

Monte Carlo simulations provide an indispensible model for solving radiative transport problems, but their slow convergence inhibits their use as an everyday computational tool. In this paper, we present two new ideas for accelerating the convergence of Monte Carlo algorithms based upon an efficient algorithm that couples simulations of forward and adjoint transport equations. Forward random walks are first processed in stages, each using a fixed sample size, and information from stage k is used to alter the sampling and weighting procedure in stage k+1. This produces rapid geometric convergence and accounts for dramatic gains in the efficiency of the forward computation. In case still greater accuracy is required in the forward solution, information from an adjoint simulation can be added to extend the geometric learning of the forward solution. The resulting new approach should find widespread use when fast, accurate simulations of the transport equation are needed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Chemistry-mediated Ostwald ripening in carbon-rich C/O systems at extreme conditions

Abstract There is significant interest in establishing a capability for tailored synthesis of next-generation carbon-based nanomaterials due to their broad range of applications and high degree of tunability. High pressure (e.g., shockwave-driven) synthesis holds promise as an effective discovery method, but experimental challenges preclude elucidating the processes governing nanocarbon production from carbon-rich precursors that could otherwise guide efforts through the prohibitively expansive design space. Here we report findings from large scale atomistically-resolved simulations of carbon condensation from C/O mixtures subjected to extreme pressures and temperatures, made possible by machine-learned reactive interatomic potentials. We find that liquid nanocarbon formation follows classical growth kinetics driven by Ostwald ripening (i.e., growth of large clusters at the expense of shrinking small ones) and obeys dynamical scaling in a process mediated by carbon chemistry in the surrounding reactive fluid. The results provide direct insight into carbon condensation in a representative system and pave the way for its exploration in higher complexity organic materials. They also suggest that simulations using machine-learned interatomic potentials could eventually be employed as in-silico design tools for new nanomaterials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Residual symmetries and scalar multiplet vacuum alignment in non-Abelian flavour models

We demonstrate that, upon minimizing a renormalizable, single-scalar potential invariant under a non-Abelian symmetry, special orientations in the associated vacuum alignment of the scalar multiplet correspond to the preservation of a discrete residual flavour symmetry in the broken phase of the theory. Conversely, we show that these special scalar alignments are perturbed when additional Lagrangian operators (e.g. renormalizable, multi-flavon operators and/or effective, higher-dimensional operators) are present that break said residual symmetry, leading to a vacuum reorientation and phenomenological consequences. We therefore construct a one-to-one correspondence principle between broken residual symmetries and vacuum alignment corrections, providing a mechanism to identify (and correct) a subtle but persistent form of phenomenologically relevant fine-tuning embedded in — but often ignored by — most successful non-Abelian flavour models. We first establish this correspondence in a set of toy models based on the S4 permutation symmetry, and then apply the lessons learned to the more realistic A4 Altarelli-Feruglio and ∆(27) Universal Texture Zero models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantum Software Engineering (Dagstuhl Seminar 24512)

The Dagstuhl Seminar 24512 on "Quantum Software Engineering" was held from December 15 to 20, 2024. It brought together 26 participants from industry and academia from 13 different countries, including senior and junior researchers as well as practitioners in the field of Quantum Software Engineering. The aim of the seminar was to advance software engineering methods and tools for the engineering of hybrid quantum systems by promoting personal interaction and open discussion among researchers who are already working in this emerging area of knowledge. The first day of the seminar was devoted to the topic "When software engineering meets quantum mechanics", while the second day focused on "Quantum software engineering and its challenges." During both days, 16 invited presentations were given. The rest of the seminar was organized into three working groups to address the topics "Quantum Software Design, Modelling and Architecturing", "Adaptive Hybrid Quantum Systems", and "Quantum Software Quality Assurance". The seminar was a very fruitful experience for all participants both in terms of scientific outcomes and in terms of the personal relationships that were generated to jointly address future experiences.

97 MATHEMATICS AND COMPUTING↗

Elucidating Abnormal Grain Growth in Thermomagnetic Processed Materials with Transfer Learning and Reinforcement Learning

The goal of this research program is to establish the mechanism governing local grain boundary motion, which is needed to design and process desirable microstructures for better performance, by identifying the relative contributions of grain boundary (GB) energy and mobility to grain growth. Classical models for grain growth assume that the primary mechanism for reducing the total interfacial energy is area reduction and that GB restructuring is not significant. This assumption implies that grain growth is locally driven by curvature. However, recent experimental observations using new non-destructive 3D x-ray diffraction microscopy techniques (3D-XRM) reveal that classic descriptors (i.e., curvature, number of neighbors, grain size) do not predict real grain growth. Instead, local GB motion appears to be governed by its energy relative to its neighbors such that low-energy boundaries replace those of higher energy. However, simulations that incorporate GB energy anisotropy still fail to reproduce these observations. These discrepancies suggest that the common assumption for grain growth theory must be re-examined to predict and, thus, control microstructure evolution in real polycrystals. A significant challenge to testing this assumption is due to anisotropic GB mobility. Mobility may cause abnormal grain growth or affect the final grain shapes or growth rate but its true contributions are unknown because it is difficult to measure. For example, observations in Fe have found that grains associated with high energy and high mobility boundaries tend to experience abnormal grain growth, whereas abnormal grain growth is associated with low energy and high mobility boundaries in alumina. As mobility and energy both control GB motion, it is challenging to isolate the local driving forces necessary to test the common assumption that the primary mechanism is area reduction. The novelty of this work is the use of machine learning tools to capture GB mobility and energy from 3D-XRM measurements in polycrystals to test the common assumption used in grain growth models. Machine learning can capture high-order correlations in dynamic systems like those found in the evolving GB topology. The PIs have developed a physics-regularized interpretable machine learning microstructure evolution (PRIMME) model that accurately replicates the grain growth behavior of its trained data set.

36 MATERIALS SCIENCE↗

Simulations with machine learning potentials identify the ion conduction mechanism mediating non-Arrhenius behavior in LGPS

Abstract Li 10 Ge(PS 6 ) 2 (LGPS) is a highly concentrated solid electrolyte, in which Coulombic repulsion between neighboring cations is hypothesized as the underlying reason for concerted ion hopping, a mechanism common among superionic conductors such as Li 7 La 3 Zr 2 O 12 (LLZO) and Li 1.3 Al 0.3 Ti 1.7 (PO 4 ) 3 (LATP). While first principles simulations using molecular dynamics (MD) provide insight into the Li + transport mechanism, historically, there has been a gap in the temperature ranges studied in simulations and experiments. Here, we used a neural network potential trained on density functional theory (DFT) simulations, to run up to 40-nanosecond long MD simulations at DFT-like accuracy to characterize the ion conduction mechanisms across a range of temperatures that includes previous simulations and experimental studies. We have confirmed a Li + sublattice phase transition in LGPS around 400 K, below which the ab -plane diffusivity D a b ∗ is drastically reduced. Concomitant with the sublattice phase transition near 400 K, there is less cation-cation (cross) correlation, as characterized by Haven ratios closer to 1, and the vibrations in the system are more harmonic at lower temperature. Intuitively, at high temperature, the collection of vibrational modes may be sufficient to drive concerted ion hops. However, near room temperature, the vibrational modes available may be insufficient to overcome electrostatic repulsion, thus resulting in less correlated ion motion and comparatively slower ion conduction. Such phenomena of a sublattice phase transition, below which concerted hopping plays a less significant role, may be extended to other highly concentrated solid electrolytes such as LLZO and LATP.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Generalizable machine learning potentials for quantum-accurate predictions of non-equilibrium behavior in 2D materials

Machine learning interatomic potentials (ML-IAPs) are emerging as transformative tools in materials modeling, promising quantum-level accuracy at a fraction of the computational cost. However, their ability to generalize beyond equilibrium configurations and to reliably capture defect- and temperature-driven behavior remains underexplored. Here, we develop and benchmark two state-of-the-art ML-IAPs, Spectral Neighbor Analysis Potential (SNAP) and Allegro, on a comprehensive dataset for monolayer MoSe₂. Using density functional theory (DFT) as the reference, we evaluate their performance in capturing stress–strain behavior, phase transition energetics, defect evolution, edge stability, and fracture toughness. Allegro, a deep equivariant neural network potential, surpasses both SNAP and the classical Tersoff potential in accuracy, efficiency, and transferability. Importantly, both ML potentials accurately reproduce experimental fracture measurements and ab initio predictions of inversion domain formation—phenomena well beyond their training sets. Our findings establish ML-IAPs as viable replacements for traditional force fields in the study of non-equilibrium mechanical phenomena, enabling large-scale, high-fidelity simulations in 2D materials and beyond. In conclusion, this work provides a broadly applicable framework for data-driven modeling of structural and functional transformations under extreme conditions.

2D materials↗

High-throughput validation of phase formability and simulation accuracy of Cantor alloys

High-throughput methods enable accelerated discovery of novel materials in complex systems such as high-entropy alloys, which exhibit intricate phase stability across vast compositional spaces. Computational approaches, including Density Functional Theory (DFT) and calculation of phase diagrams (CALPHAD), facilitate screening of phase formability as a function of composition and temperature. However, the integration of computational predictions with experimental validation remains challenging in high-throughput studies. In this work, we introduce a quantitative confidence metric to assess the agreement between predictions and experimental observations, providing a quantitative measure of the confidence of machine learning models trained on either DFT or CALPHAD input in accounting for experimental evidence. The experimental dataset was generated via high-throughput in-situ synchrotron X-ray diffraction on compositionally varied FeNiMnCr alloy libraries, heated from room temperature to ~1000 °C. Agreement between the observed and predicted phases was evaluated using either temperature-independent phase classification or a model that incorporates a temperature-dependent probability of phase formation. This integrated approach demonstrates where strong overall agreement between computation and experiment exists, while also identifying key discrepancies, particularly in FCC/BCC predictions at Mn-rich regions to inform future model refinement.

36 - MATERIALS SCIENCE↗

Probing Sulfur Chemical and Electronic Structure with Experimental Observation and Quantitative Theoretical Prediction of Kα and Valence-to-Core Kβ X-ray Emission Spectroscopy

An extensive experimental and theoretical study of the Kα and Kβ high-resolution X-ray emission spectroscopy (XES) of sulfur-bearing systems is presented here. This study encompasses a wide range of organic and inorganic compounds, including numerous experimental spectra from both prior published work and new measurements. Employing a linear-response time-dependent density functional theory (LR-TDDFT) approach, strong quantitative agreement is found in the calculation of energy shifts of the core-to-core Kα as well as the full range of spectral features in the valence-to-core Kβ spectrum. The ability to accurately calculate the sulfur Kα energy shift supports the use of sulfur Kα XES as a bulk-sensitive tool for assessing sulfur speciation. The fine structure of the sulfur Kβ spectrum, in conjunction with the theoretical results, is shown to be sensitive to the local electronic structure including effects of symmetry, ligand type and number, and, in the case of organosulfur compounds, to the nature of the bonded organic moiety. This agreement between theory and experiment, augmented by the potential for high-access XES measurements with the latest generation of laboratory-based spectrometers, demonstrates the possibility of broad analytical use of XES for sulfur and nearby third-row elements. The effective solution of the forward problem, i.e., successful prediction of detailed spectra from known molecular structure, also suggests future use of supervised machine learning approaches to experimental inference, as has seen recent interest for interpretation of X-ray absorption near-edge structure (XANES).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmarking graph neural networks for materials chemistry

Graph neural networks (GNNs) have received intense interest as a rapidly expanding class of machine learning models remarkably well-suited for materials applications. To date, a number of successful GNNs have been proposed and demonstrated for systems ranging from crystal stability to electronic property prediction and to surface chemistry and heterogeneous catalysis. However, a consistent benchmark of these models remains lacking, hindering the development and consistent evaluation of new models in the materials field. Here, we present a workflow and testing platform, MatDeepLearn, for quickly and reproducibly assessing and comparing GNNs and other machine learning models. We use this platform to optimize and evaluate a selection of top performing GNNs on several representative datasets in computational materials chemistry. From our investigations we note the importance of hyperparameter selection and find roughly similar performances for the top models once optimized. We identify several strengths in GNNs over conventional models in cases with compositionally diverse datasets and in its overall flexibility with respect to inputs, due to learned rather than defined representations. Meanwhile several weaknesses of GNNs are also observed including high data requirements, and suggestions for further improvement for applications in materials chemistry are discussed.

36 MATERIALS SCIENCE↗

Online real-time learning of dynamical systems from noisy streaming data

Abstract Recent advancements in sensing and communication facilitate obtaining high-frequency real-time data from various physical systems like power networks, climate systems, biological networks, etc. However, since the data are recorded by physical sensors, it is natural that the obtained data is corrupted by measurement noise. In this paper, we present a novel algorithm for online real-time learning of dynamical systems from noisy time-series data, which employs the Robust Koopman operator framework to mitigate the effect of measurement noise. The proposed algorithm has three main advantages: (a) it allows for online real-time monitoring of a dynamical system; (b) it obtains a linear representation of the underlying dynamical system, thus enabling the user to use linear systems theory for analysis and control of the system; (c) it is computationally fast and less intensive than the popular extended dynamic mode decomposition (EDMD) algorithm. We illustrate the efficiency of the proposed algorithm by applying it to identify the Van der Pol oscillator, the chaotic attractor of the Henon map, the IEEE 68 bus system, and a ring network of Van der Pol oscillators.

97 MATHEMATICS AND COMPUTING↗