Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quantifying Uncertainties of Microscopic Nuclear Theories

The goal of this project was to produce modernized nuclear data libraries of light ion fusion reactions and actinide fission product yields. Such libraries are essential input in both stockpile science but also fundamental science (nucleosynthesis, superheavy nuclei). When such libraries are used to model complex processes involving exotic, very short-lived nuclei that have not been measured experimentally, the underlying nuclear data come from theoretical models, the predictive power of which needs to be quantified, together with its uncertainties. By teaming up nuclear theorists and statisticians, we built comprehensive theoretical frameworks based on the most fundamental theories of fusion and fission that we coupled for the first time with a Bayesian framework with machine learning techniques for uncertainty quantification. Our results include: (1) statistical emulators for neutron-alpha scattering, and the fission product mass yields of neutron-induced fission of 239 Pu, which will enable developers to generate random realizations of the corresponding data for uncertainty quantification (UQ) in applications; (2) the first complete and most accurate ab initio prediction of the S-factor for proton capture on 7 Be, which – combined with UQ – may become the recommended value at solar energies in the next review of solar fusion cross sections; (3) statistical emulators for fission mass yields in the neutron-induced fission of 239 Pu; (4) the first quantification of how uncertainties in nuclear forces impact fission properties that are relevant in nucleosynthesis simulations to explain how heavy elements are formed in the Cosmos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Stochastic Neutronics Primer (Volume I)

The purpose of this document is to introduce the elementary concepts and to build a concrete understanding of the stochastic theory of neutron transport to the motivated undergraduate student, the Ph.D. engineer/physicist/mathematician, and the staff scientist or professor learning yet another new skill. The authors understand that there are many learning types- from visual to analytical to repetitive to word-based to analogy-based (and combinations thereof)- and so we have tasked ourselves with providing as many representations as possible within to ensure every reader a fruitful endeavor. This document is written as a set of chapters that continually build upon the previous chapter. In this chapter, we provide the discussion, motivation, and background topics for the remainder of the text.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

LLM Generation of Online Courses from a Curated Set of Documents in the Nuclear Safeguards Domain

A multidisciplinary team at Argonne National Laboratory explores the application of advanced technologies to enhance knowledge transfer and retention within the nuclear safeguards domain. Specifically, it examines the feasibility of leveraging secure large language models (LLMs) to streamline the creation of e-learning modules for the U.S. National Nuclear Security Administration (NNSA) Office of International Nuclear Safeguards (NA-241). The initiative addresses the critical need for preserving institutional memory and accelerating skill development amidst the imminent retirement of senior professionals in the field in addition to supporting good knowledge management practices. The project integrates instructional design theory with cutting-edge AI technologies to transform curated document sets from the Safeguards Knowledge Repository (SKR) into modular online courses. By automating the generation of learning objectives and instructional content, the effort aims to reduce manual effort while maintaining high-quality educational outcomes. A limited measure of human supervision, however, ensures accuracy, relevance, and alignment with NNSA’s strategic priorities. Key findings highlight the potential of AI-assisted course generation to support safeguards professionals by creating structured, interactive learning experiences. The report underscores the importance of SME validation to address limitations in AI-generated content, such as terminology errors and gaps in coverage. Recommendations include adopting a structured workflow combining LLM acceleration with expert oversight to ensure accuracy, usability, and alignment with learner needs. This work demonstrates Argonne’s commitment to advancing national security and scientific excellence through innovative knowledge management solutions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Effects of Aluminum and Molybdenum on the Phase Stability of Iron-Chromium Alloys: A First-Principles Study

The interaction between solute atoms is critical to the thermodynamic behavior of Fe-Cr alloys, but the effects of non-dilute Al and Mo on the Fe-Cr phase stability and vacancy formation energy are not clearly understood. In this study, density functional theory, cluster expansion, and Monte Carlo simulation are used to predict the effects of ternary solute elements on the thermodynamic properties in multicomponent Fe-Cr alloys. The machine learning regression approach is applied to train and construct energy models that accurately describe the complex chemical interactions. The computational outcomes include the prediction of the partial ternary phase diagram, mixing enthalpy, and vacancy formation energy for different compositions. The phase boundary calculation predicts a pronounced change of Cr solubility in bcc Fe by the addition of Al and the rejection of Al atoms from a’ precipitates. The mixing enthalpy calculation shows that Mo may also reduce the Cr solubility in bcc Fe. Additionally, the simulations show that non-dilute Cr decreases the vacancy formation energy in bcc Fe, while adding Al results in a less significant effect. Finally, the results demonstrate important applications of using machine learning energy models to study model or commercial alloys with multicomponent solute species and point defects.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Infinite neural network quantum states: entanglement and training dynamics

We study infinite limits of neural network quantum states (∞-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics. Ensemble averages of entanglement entropies are expressed in terms of neural network correlators, and architectures that exhibit volume-law entanglement are presented. The analytic calculations of entanglement entropy bound are tractable because the ensemble statistics are simplified in the Gaussian process limit. A general framework is developed for studying the gradient descent dynamics of neural network quantum states (NNQS), using a quantum state neural tangent kernel (QS-NTK). For ∞-NNQS the training dynamics is simplified, since the QS-NTK becomes deterministic and constant. An analytic solution is derived for quantum state supervised learning, which allows an ∞-NNQS to recover any target wavefunction. Numerical experiments on finite and infinite NNQS in the transverse field Ising model and Fermi Hubbard model demonstrate excellent agreement with theory. ∞-NNQS opens up new opportunities for studying entanglement and training dynamics in other physics applications, such as in finding ground states.

quantum state supervised learning↗
DOE OSTI2021

High-throughput search for magnetic topological materials using spin-orbit spillage, machine learning, and experiments

Magnetic topological insulators and semi-metals have a variety of properties that make them attractive for applications including spintronics and quantum computation. Here, we use systematic high-throughput density functional theory calculations to identify magnetic topological materials from the ≈ 40000 three-dimensional materials in the JARVIS-DFT database. First, we screen materials with net magnetic moment > 0.5 μB and spin-orbit spillage > 0.25, resulting in 25 insulating and 564 metallic candidates. The spillage acts as a signature of spin-orbit induced band-inversion. Then, we carry out calculations of Wannier charge centers, Chern numbers, anomalous Hall conductivities, surface bandstructures, and Fermi-surfaces to determine interesting topological characteristics of the screened compounds. We also train machine learning models for predicting the spillage, bandgaps, and magnetic moments of new compounds, to further accelerate the screening process. We experimentally synthesize and characterize a few candidate materials to support our theoretical predictions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

In-Silico Analysis of High Refractive Index Materials Through Principles of Materials Design

The intent of the paper is to use specific principles of Materials Design that were developed and applied in the electronics industry for enabling understanding and design of improved high refractive index materials. Further, by combining first-principle based ab-initio, semiempirical interatomic potential methods, and machine learning approaches in conjunction with experimental data, we identified specific determinants of high refractive index materials, which can be critically applied for informing materials design and accelerating discovery. Specifically, it was demonstrated that chalcogenides and perovskites as bulk materials can exhibit higher refractive indices with appropriate engineering of specific aspects of the materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Generative deep-learning reveals collective variables of Fermionic systems

Complex processes of fermionic systems ranging from protein folding to nuclear fission often follow a low-dimensional reaction path parametrized in terms of a few collective variables. In nuclear theory, variables related to the shape of the nuclear density in a mean-field picture are key to describing the large amplitude collective motion of the neutrons and protons. Exploring the adiabatic energy landscape spanned by these degrees of freedom reveals the possible reaction channels while simulating the dynamics in this reduced space yields their respective probabilities. Unfortunately, this theoretical framework breaks down whenever the systems encounters a quantum phase transition with respect to the collective variables. Here, in this study, we introduce a novel generative deep-learning algorithm designed to build reaction paths that ensure that the many-fermion wave function stays differentiable with respect to the collective variables. This approach is applicable to any fermionic system described by a coherent state. We use the case of potential energy curves in the 16 O nucleus within the Hartree-Fock theory to illustrate its main features.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Nature of molybdenum carbide surfaces for catalytic hydrogen dissociation using machine-learned potentials: an ensemble-averaged perspective

Molybdenum carbides with an electronic structure similar to noble metals have gained attention as a promising low-cost catalyst for biomass valorization and the hydrogen evolution reaction. However, our fundamental understanding of the catalyst surface and how different phases of these catalysts behave at varying reaction conditions is limited to ground state density functional theory calculations as ab initio molecular dynamics (AIMD) is computationally prohibitive at relevant length and time scales. Here, in this work, we train a multi-atomic cluster expansion (MACE) machine-learned interatomic potentials (MLIP) to study hydrogen dissociation and dynamics over Mo, δ-MoC, α-Mo 2 C, and β-Mo 2 C surfaces at varying temperatures and hydrogen partial pressures. Our simulations identify unique and different molecular and atomic hydrogen adsorption sites on different surfaces that do not depend on the temperature. At low hydrogen pressures, the surface coverage is monolayer, which transitions to two-layer adsorption at higher pressures. We find that atomic hydrogen diffusion and recombinations are preferred over molybdenum atom hollow sites, while the diffusion over carbon-terminated facets was negligible, signifying particularly strong C–H interactions. In contrast, molecular hydrogen adsorption occurs mostly atop Mo or the bridging sites. At a comparable hydrogen loading, β-Mo 2 C (001) is the most active surface for hydrogen dissociation reaction. This work provides insights into the dynamic nature of the hydrogen dissociation chemistry and the diversity of hydrogen adsorption sites on molybdenum carbides.

08 HYDROGEN↗
DOE OSTI2022

Elucidating the temperature and density dependence of silver chloride hydration numbers in high-temperature water vapor: A first-principles molecular simulation study

Hydration numbers of metal complexes in low-density aqueous solutions are required for developing geochemical models for ore-forming metals and for designing supercritical desalination processes. In this study, we investigate the temperature and density dependence of the hydration numbers of silver chloride at 623 K, 673 K, and 713 K and densities of 10–100 kg/m 3 . Experimental estimates of the hydration number in the literature for AgCl at these conditions are inconclusive and possibly contradictory as to the temperature and density dependence. First-principles molecular simulation presents an attractive alternative to experimental measurements. Specifically, recent work shows that machine-learning-accelerated nested Monte Carlo simulations provide reliable estimates for the hydration numbers of CuCl at 623 K from 10 to 100 kg/m 3 . Using the same technique, we find a monotonic temperature dependence, with the hydration number decreasing slightly with increasing temperature. In addition, the simulation-predicted hydration numbers steadily increase with increasing density. These temperature and density trends are in agreement with certain experimental data sets. Therefore, this work demonstrates how first-principles Monte Carlo simulations assist in resolving discrepancies between experimental data sets. Our simulation results also correctly predict that the hydration number, and thus also the solubility, of AgCl is lower than that of CuCl under the same conditions. Furthermore, the bond length and angle formed between the water complex and AgCl differ from those for CuCl, consistent with the lower solubility of AgCl.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Example on how to (intelligently) augment the nuclear-data pipeline with machine learning [Slides]

The presentation discusses how machine learning has helped the Los Alamos National Laboratory (LANL) nuclear-data pipeline. It also discusses the strengths of machine learning as it finds trends in large amounts of data where human brains are overwhelmed and that this information may be crucial to improve our nuclear data. It does stress, however, that machine learning is no "silver bullet" and that it is critical to feed it expert knowledge and use physics intuition to interpret the results. The presentation discusses the need to develop infrastructure and tools to provide data in an easily readable and unambiguously interpretable format (e.g., EXFOR format), to develop experimental data and theory to solve physics questions, and that statisticians and nuclear-data experts must be brought together to correctly interpret the results. The presentation concludes by stating that machine learning is a great tool and that LANL needs to use the algorithms along with developing physics data, tools and infrastructure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?

Physics-informed neural networks (PINNs) have become a popular choice for solving high-dimensional partial differential equations (PDEs) due to their excellent approximation power and generalization ability. Recently, extended PINNs (XPINNs) based on domain decomposition methods have attracted considerable attention due to their effectiveness in modeling multiscale and multiphysics problems and their parallelization. However, theoretical understanding of their convergence and generalization properties remains unexplored. In this study, we take an initial step towards understanding how and when XPINNs outperform PINNs. Specifically, for general multilayer PINNs and XPINNs, we first provide a prior generalization bound via the complexity of the target functions in the PDE problem and a posterior generalization bound via the posterior matrix norms of the networks after optimization. Moreover, based on our bounds, we analyze the conditions under which XPINNs improve generalization. Concretely, our theory shows that the key building block of XPINN, namely, the domain decomposition, introduces a tradeoff for generalization. On the one hand, XPINNs decompose the complex PDE solution into several simple parts, which decreases the complexity needed to learn each part and boosts generalization. On the other hand, decomposition leads to less training data being available in each subdomain, and hence such a model is typically prone to overfitting and may become less generalizable. Empirically, we choose five PDEs to show when XPINNs perform better than, similar to, or worse than PINNs, hence demonstrating and justifying our new theory.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Theoretical Prediction of Thermal Expansion Anisotropy for Y 2 Si 2 O 7 Environmental Barrier Coatings Using a Deep Neural Network Potential and Comparison to Experiment

Environmental barrier coatings (EBCs) are an enabling technology for silicon carbide (SiC)-based ceramic matrix composites (CMCs) in extreme environments such as gas turbine engines. However, the development of new coating systems is hindered by the large design space and difficulty in predicting the properties for these materials. Density Functional Theory (DFT) has successfully been used to model and predict some thermodynamic and thermo-mechanical properties of high-temperature ceramics for EBCs, although these calculations are challenging due to their high computational costs. In this work, we use machine learning to train a deep neural network potential (DNP) for Y 2 Si 2 O 7 , which is then applied to calculate the thermodynamic and thermo-mechanical properties at near-DFT accuracy much faster and using less computational resources than DFT. We use this DNP to predict the phonon-based thermodynamic properties of Y 2 Si 2 O 7 with good agreement to DFT and experiments. We also utilize the DNP to calculate the anisotropic, lattice direction-dependent coefficients of thermal expansion (CTEs) for Y 2 Si 2 O 7 . Molecular dynamics trajectories using the DNP correctly demonstrate the accurate prediction of the anisotropy of the CTE in good agreement with the diffraction experiments. In the future, this DNP could be applied to accelerate additional property calculations for Y 2 Si 2 O 7 compared to DFT or experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Ab Initio Modeling of Aqueous Methanol Mixtures at DFT-SCAN Level Using Machine Learning Interatomic Potentials

Abstract Methanol–water mixtures find use in many applications, particularly catalytic energy conversion processes. Their importance has motivated numerous computational studies, most of which employed molecular dynamics based on classical force fields. These enable simulations of large systems on long time scales but do not reliably describe reactive dynamics involving bond breaking and bond formation. In contrast, ab initio molecular dynamics (AIMD) based on density functional theory (DFT) is generally more reliable for such applications but has a high computational cost, which discourages systematic studies of alcohol-water mixtures. To remedy this, we trained a machine learning interatomic potential capable of probing the properties of aqueous methanol mixtures at the DFT level using the SCAN functional. Our results show that SCAN qualitatively reproduces multiple key experimental features arising from the amphiphilic nature of methanol, including density, diffusion coefficients, X-ray structure factors, and Kirkwood–Buff integrals. We also find that structural correlations between water molecules are somewhat overestimated, leading to a stronger preferential association than that predicted by experiments. However, increasing the temperature by 30 K mitigates this effect and also recovers the correct mobilities of both methanol and water. These results indicate that SCAN provides an accurate description of methanol–water mixtures, making it a reliable choice for investigating the reactive dynamics in such systems.

Park, Sanghyun J. [Princeton University , , , ,]↗
DOE OSTI2020

Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys

We present a scale-bridging approach based on a multi-fidelity (MF) machine-learning (ML) framework leveraging Gaussian processes (GP) to fuse atomistic computational model predictions across multiple levels of fidelity. Through the posterior variance of the MFGP, our framework naturally enables uncertainty quantification, providing estimates of confidence in the predictions. We used density functional theory as high-fidelity prediction, while a ML interatomic potential is used as low-fidelity prediction. Practical materials’ design efficiency is demonstrated by reproducing the ternary composition dependence of a quantity of interest (bulk modulus) across the full aluminum–niobium–titanium ternary random alloy composition space. The MFGP is then coupled to a Bayesian optimization procedure, and the computational efficiency of this approach is demonstrated by performing an on-the-fly search for the global optimum of bulk modulus in the ternary composition space. The framework presented in this manuscript is the first application of MFGP to atomistic materials simulations fusing predictions between density functional theory and classical interatomic potential calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Real classical shadows

Efficiently learning expectation values of a quantum state using classical shadow tomography has become a fundamental task in quantum information theory. In a classical shadows protocol, one measures a state in a chosen basis $\mathcal{W}$ after it has evolved under a unitary transformation randomly sampled from a chosen distribution $\mathcal{U}$. In this work we study the case where $\mathcal{U}$ corresponds to either local or global orthogonal Clifford gates, and $\mathcal{W}$ consists of real-valued vectors. Our results show that for various situations of interest, this ‘real’ classical shadow protocol improves the sample complexity over the standard scheme based on general Clifford unitaries. For example, when one is interested in estimating the expectation values of arbitrary real-valued observables, global orthogonal Cliffords typically decrease the required number of samples by a factor of two. More dramatically, for k-local observables composed only of real-valued Pauli operators, sampling local orthogonal Cliffords leads to a reduction by an exponential-in-k factor in the sample complexity over local unitary Cliffords. Finally, we show that by measuring in a basis containing complex-valued vectors, orthogonal shadows can, in the limit of large system size, exactly reproduce the original unitary shadows protocol.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗