Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Predicting electronic structures at any length scale with machine learning

The properties of electrons in matter are of fundamental importance. They give rise to virtually all material properties and determine the physics at play in objects ranging from semiconductor devices to the interior of giant gas planets. Modeling and simulation of such diverse applications rely primarily on density functional theory (DFT), which has become the principal method for predicting the electronic structure of matter. While DFT calculations have proven to be very useful, their computational scaling limits them to small systems. We have developed a machine learning framework for predicting the electronic structure on any length scale. It shows up to three orders of magnitude speedup on systems where DFT is tractable and, more importantly, enables predictions on scales where DFT calculations are infeasible. Our work demonstrates how machine learning circumvents a long-standing computational bottleneck and advances materials science to frontiers intractable with any current solutions.

36 MATERIALS SCIENCE↗

Hydrogen in disordered titania: connecting local chemistry, structure, and stoichiometry through accelerated exploration

Hydrogen incorporation in native surface oxides of metal alloys often controls the onset of metal hydriding, with implications for materials corrosion and hydrogen storage. A key representative example is titania, which forms as a passivating layer on a variety of titanium alloys for structural and functional applications. These oxides tend to be structurally diverse, featuring polymorphic phases, grain boundaries, and amorphous regions that generate a disparate set of unique local environments for hydrogen. Here, we introduce a workflow that can efficiently and accurately navigate this complexity. First, a machine learning force field, trained on ab initio molecular dynamics simulations, was used to generate amorphous configurations. Density functional theory calculations were then performed on these structures to identify local oxygen environments, which were compared against experimental observations. Second, to classify subtle differences across the disordered configuration space, we employ a graph-based sampling procedure. Finally, local hydrogen binding energies and hopping kinetics are computed using exhaustive density functional theory calculations on representative configurations. Here, we leverage this methodology to show that hydrogen binding energetics are described by local oxygen coordination, which in turn is affected by stoichiometry, and form the basis of hopping kinetics and diffusion. Together these results imply that hydrogen incorporation and transport in TiO x can be tailored through compositional engineering, with implications for improving the performance and durability of titanium-derived alloys in hydrogen environments.

36 MATERIALS SCIENCE↗

DESI mock challenge: Halo and galaxy catalogues with the bias assignment method

We present a novel approach to the construction of mock galaxy catalogues for large-scale structure analysis based on the distribution of dark matter halos obtained with effective bias models at the field level. We aim to produce mock galaxy catalogues capable of generating accurate covariance matrices for a number of cosmological probes that are expected to be measured in current and forthcoming galaxy redshift surveys (e.g. two- and three-point statistics). The construction of the catalogues shown in this paper is part of a mock-comparison project within the Dark Energy Spectroscopic Instrument (DESI) collaboration. We use the bias assignment method ( BAM ) to model the statistics of halo distribution through a learning algorithm using a few detailed N-body simulations, and approximated gravity solvers based on Lagrangian perturbation theory. We introduce cosmic-web-dependent corrections to modelling redshift-space distortions at the N-body level – both in the halo and galaxy distributions –, as well as a multi-scale approach for accurate assignment of halo properties. Using specific models of halo occupation distributions to populate halos, we generate galaxy mocks with the expected number density and central-satellite fraction of emission-line galaxies, which are a key target of the DESI experiment. BAM generates mock catalogues with per cent accuracy in a number of summary statistics, such as the abundance, the two- and three-point statistics of halo distributions, both in real and redshift space. In particular, the mock galaxy catalogues display ~3%-10% accuracy in the multipoles of the power spectrum up to scales of k ~ 0.4 h -1 Mpc. We show that covariance matrices of two- and three-point statistics obtained with BAM display a similar structure to the reference simulation. BAM offers an efficient way to produce mock halo catalogues with accurate two- and three-point statistics and is able to generate a variety of multi-tracer catalogues with precise covariance matrices of several cosmological probes. We discuss future developments of the algorithm towards mock production in DESI and other galaxy-redshift surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Genarris: Random generation of molecular crystal structures and fast screening with a Harris approximation

Herein, we present Genarris, a Python package that performs configuration space screening for molecular crystals of rigid molecules by random sampling with physical constraints. For fast energy evaluations, Genarris employs a Harris approximation, whereby the total density of a molecular crystal is constructed via superposition of single molecule densities. Dispersion-inclusive density functional theory is then used for the Harris density without performing a self-consistency cycle. Genarris uses machine learning for clustering, based on a relative coordinate descriptor developed specifically for molecular crystals, which is shown to be robust in identifying packing motif similarity. In addition to random structure generation, Genarris offers three workflows based on different sequences of successive clustering and selection steps: the "Rigorous" workflow is an exhaustive exploration of the potential energy landscape, the "Energy" workflow produces a set of low energy structures, and the "Diverse" workflow produces a maximally diverse set of structures. The latter is recommended for generating initial populations for genetic algorithms. Here, the implementation of Genarris is reported and its application is demonstrated for three test cases. Published by AIP Publishing.

74 ATOMIC AND MOLECULAR PHYSICS↗

Machine learning methods for probabilistic locked-mode predictors in tokamak plasmas

A rotating tokamak plasma can interact resonantly with the external helical magnetic perturbations, also known as error fields. This can lead to locking and then to disruptions. We leverage machine learning (ML) methods to predict the locking events. We use a coupled third-order nonlinear ordinary differential equation model to represent the interaction of the magnetic perturbation and the plasma rotation with the error field. This model is sufficient to describe qualitatively the locking and unlocking bifurcations. Here, we explore using ML algorithms with the simulation data and experimental data, focusing on the methods that can be used with sparse datasets. These methods lead to the possibility of the avoidance of locking in real-time operations. We describe the operational space in terms of two control parameters: the magnitude of the error field and the rotation frequency associated with the momentum source that maintains the plasma rotation. The outcomes are quan- tified by order parameters that completely characterize the state, whether locked or unlocked. We use unsupervised ML methods to classify locked/unlocked states and note the usefulness of a certain normalization of the order parameters. Three supervised ML classifiers are used in suite to estimate the probability of locking in the region of control parameter space with hysteresis, i.e., the set of control parameters for which both locked and unlocked states can exist. The results show that a neural network gives the best estimate of the locking probability. An analogy of the present locking model with the van der Waals equation of state is also provided.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗

Optimization of the generator coordinate method with machine-learning techniques for nuclear spectra and neutrinoless double- β decay: Ridge regression for nuclei with axial deformation

The generator coordinate method (GCM) is an important tool of choice for modeling large-amplitude collective motion in atomic nuclei. The computational complexity of the GCM increases rapidly with the number of collective coordinates. It imposes a strong restriction on the applicability of the method. In this work, we propose a subspace-reduction algorithm that employs optimal statistical ML models as surrogates for exact quantum-number projection calculations for norm and Hamiltonian kernels. The model space of the original GCM is reduced to a subspace relevant for nuclear low energy spectra and the NME of ground state to ground state 0νββ decay based on the orthogonality condition (OC) and the energy-transition-orthogonality procedure (ENTROP), respectively. For simplicity, the polynomial ridge regression (RR) algorithm is used to learn the norm and Hamiltonian kernels of axially deformed configurations. The efficiency and accuracy of this algorithm are illustrated for 76 Ge and 76 Se by comparing results obtained using the optimal RR models to direct GCM calculations. The low-lying energy spectra of 76 Ge and 76 Se, as well as the 0νββ-decay NME between their ground states, are computed. Furthermore, the results show that the performance of the GCM+OC/ENTROP+RR is more robust than that of the GCM+RR alone, and the former can reproduce the results of the original GCM calculation accurately with a significantly reduced computational cost.

59 ≤ A ≤ 89↗

Laplacian-level meta-generalized gradient approximation for solid and liquid metals

In this work, we derive and motivate a Laplacian-level, orbital-free meta-generalized-gradient approximation (LL-MGGA) for the exchange-correlation energy, targeting accurate ground-state properties of sp and sd metallic condensed matter, in which the density functional for the exchange-correlation energy is only weakly nonlocal due to perfect long-range screening. Our model for the orbital-free kinetic energy density restores the fourth-order gradient expansion for exchange to the r 2 SCAN meta-GGA [Furness et al., J. Phys. Chem. Lett. 11, 8208 (2020)], yielding a LL-MGGA we call OFR2. OFR2 matches the accuracy of SCAN for prediction of common lattice constants and improves the equilibrium properties of alkali metals, transition metals, and intermetallics that were degraded relative to the PBE GGA values by both SCAN and r 2 SCAN. We compare OFR2 to the r 2 SCAN -L LL-MGGA [Mejia-Rodriguez and Trickey, Phys. Rev. B 102, 121109(R) (2020)] and show that OFR2 tends to outperform r 2 SCAN -L for the equilibrium properties of solids, but r 2 SCAN -L much better describes the atomization energies of molecules than OFR2 does. For best accuracy in molecules and nonmetallic condensed matter, we continue to recommend SCAN and r 2 SCAN. Numerical performance is discussed in detail, and our paper provides an outlook to machine learning.

36 MATERIALS SCIENCE↗

Efficient computational design of two-dimensional van der Waals heterostructures: Band alignment, lattice mismatch, and machine learning

Here, we develop a computational database, website applications (web-apps), and machine-learning (ML) models to accelerate the design and discovery of two-dimensional (2D) heterostructures. Using density functional theory (DFT) based lattice parameters and electronic band energies for 674 nonmetallic exfoliable 2D materials, we generate 226 779 possible bilayer heterostructures. We classify these heterostructures into type-I, -II, and -III systems according to Anderson’s rule, which is based on the relative band alignments of the noninteracting monolayers. We find that type II is the most common and type III the least common heterostructure type. We subsequently analyze the chemical trends for each heterostructure type in terms of the Periodic Table of constituent elements. The band alignment data can also be used for identifying photocatalysts and high-work-function 2D metals for contacts. We validate our results by comparing them to experimental data as well as hybrid-functional predictions. Additionally, we carry out DFT calculations of a few selected systems (MoS 2 /WSe 2 , MoS 2 /h-BN, and MoSe 2 /CrI 3 ), to compare the band-alignment description with the predictions from Anderson’s rule. We develop web-apps to enable users to virtually create combinations of 2D materials and predict their properties. Additionally, we use ML tools to predict band-alignment information for 2D materials. The web-apps, tools, and associated data will be distributed through the JARVIS-HETEROSTRUCTURE website. Our analysis, results, and the developed web-apps can be applied to the screening and design applications, such as finding alternative photocatalysts, photodetectors, and high-work-function (WF) 2D-metal contacts.

2-dimensional systems↗

Effects of noise on the overparametrization of quantum neural networks

Overparametrization is one of the most surprising and notorious phenomena in machine learning. Recently, there have been several efforts to study if, and how, quantum neural networks (QNNs) acting in the absence of hardware noise can be overparametrized. In particular, it has been proposed that a QNN can be defined as overparametrized if it has enough parameters to explore all available directions in state space. That is, if the rank of the quantum Fisher information matrix (QFIM) for the QNN's output state is saturated. Here, we explore how the presence of noise affects the overparametrization phenomenon. Our results show that noise can “turn on” previously zero eigenvalues of the QFIM. This enables the parametrized state to explore directions that were otherwise inaccessible, thus potentially turning an overparametrized QNN into an underparametrized one. For small noise levels, the QNN is quasioverparametrized, as large eigenvalues coexists with small ones. Then, we prove that as the magnitude of noise increases all the eigenvalues of the QFIM become exponentially suppressed, indicating that the state becomes insensitive to any change in the parameters. As such, there is a pull-and-tug effect where noise can enable new directions but also suppress the sensitivity to parameter updates. Finally, our results imply that current QNN capacity measures are ill-defined when hardware noise is present. Published by the American Physical Society 2024

97 MATHEMATICS AND COMPUTING↗

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗

Artificial neural network correction for density-functional tight-binding molecular dynamics simulations

In this paper, the authors developed a Behler–Parrinello-type neural network (NN) to improve the density-functional tight-binding (DFTB) energy and force prediction. The Δ-machine learning approach was adopted and the NN was designed to predict the energy differences between the density functional theory (DFT) quantum chemical potential and DFTB for a given molecular structure. Most notably, the DFTB-NN method is capable of improving the energetics of intramolecular hydrogen bonds and torsional potentials without modifying the framework of DFTB itself. This improvement enables considerably larger simulations of complex chemical systems that currently could not easily been accomplished using DFT or higher level ab initio quantum chemistry methods alone.

36 MATERIALS SCIENCE↗

Quantifying Uncertainties of Microscopic Nuclear Theories

The goal of this project was to produce modernized nuclear data libraries of light ion fusion reactions and actinide fission product yields. Such libraries are essential input in both stockpile science but also fundamental science (nucleosynthesis, superheavy nuclei). When such libraries are used to model complex processes involving exotic, very short-lived nuclei that have not been measured experimentally, the underlying nuclear data come from theoretical models, the predictive power of which needs to be quantified, together with its uncertainties. By teaming up nuclear theorists and statisticians, we built comprehensive theoretical frameworks based on the most fundamental theories of fusion and fission that we coupled for the first time with a Bayesian framework with machine learning techniques for uncertainty quantification. Our results include: (1) statistical emulators for neutron-alpha scattering, and the fission product mass yields of neutron-induced fission of 239 Pu, which will enable developers to generate random realizations of the corresponding data for uncertainty quantification (UQ) in applications; (2) the first complete and most accurate ab initio prediction of the S-factor for proton capture on 7 Be, which – combined with UQ – may become the recommended value at solar energies in the next review of solar fusion cross sections; (3) statistical emulators for fission mass yields in the neutron-induced fission of 239 Pu; (4) the first quantification of how uncertainties in nuclear forces impact fission properties that are relevant in nucleosynthesis simulations to explain how heavy elements are formed in the Cosmos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stochastic Neutronics Primer (Volume I)

The purpose of this document is to introduce the elementary concepts and to build a concrete understanding of the stochastic theory of neutron transport to the motivated undergraduate student, the Ph.D. engineer/physicist/mathematician, and the staff scientist or professor learning yet another new skill. The authors understand that there are many learning types- from visual to analytical to repetitive to word-based to analogy-based (and combinations thereof)- and so we have tasked ourselves with providing as many representations as possible within to ensure every reader a fruitful endeavor. This document is written as a set of chapters that continually build upon the previous chapter. In this chapter, we provide the discussion, motivation, and background topics for the remainder of the text.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

LLM Generation of Online Courses from a Curated Set of Documents in the Nuclear Safeguards Domain

A multidisciplinary team at Argonne National Laboratory explores the application of advanced technologies to enhance knowledge transfer and retention within the nuclear safeguards domain. Specifically, it examines the feasibility of leveraging secure large language models (LLMs) to streamline the creation of e-learning modules for the U.S. National Nuclear Security Administration (NNSA) Office of International Nuclear Safeguards (NA-241). The initiative addresses the critical need for preserving institutional memory and accelerating skill development amidst the imminent retirement of senior professionals in the field in addition to supporting good knowledge management practices. The project integrates instructional design theory with cutting-edge AI technologies to transform curated document sets from the Safeguards Knowledge Repository (SKR) into modular online courses. By automating the generation of learning objectives and instructional content, the effort aims to reduce manual effort while maintaining high-quality educational outcomes. A limited measure of human supervision, however, ensures accuracy, relevance, and alignment with NNSA’s strategic priorities. Key findings highlight the potential of AI-assisted course generation to support safeguards professionals by creating structured, interactive learning experiences. The report underscores the importance of SME validation to address limitations in AI-generated content, such as terminology errors and gaps in coverage. Recommendations include adopting a structured workflow combining LLM acceleration with expert oversight to ensure accuracy, usability, and alignment with learner needs. This work demonstrates Argonne’s commitment to advancing national security and scientific excellence through innovative knowledge management solutions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Preview control behavior and optimal control norms

Model based on optimal control theory for characterizing human operator in preview control task to provide reference frame for studying performance value and learning in manual control

HUMAN PERFORMANCE↗