Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Developments in Physics-Based Modeling and Machine Learning for Environmental Effects in Nuclear Materials [Slides]

This presentation is part of an annual review for the new Advanced Materials and Manufacturing Technologies program under the Office of Nuclear Energy within the Department of Energy. This presentation covers advances in physics-based modeling and machine learning for environmental effects in nuclear materials. It discusses efforts in combining density functional theory with machine learning to predict material properties, studying irradiation defect recombination, and improving MOOSE-based tools for crystal plasticity modeling and the Stochastic Tools Module.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Density functional theory of water with the machine-learned DM21 functional

The delicate interplay between functional-driven and density-driven errors in density functional theory (DFT) has hindered traditional density functional approximations (DFAs) from providing an accurate description of water for over 30 years. Recently, the deep-learned DeepMind 21 (DM21) functional has been shown to overcome the limitations of traditional DFAs as it is free of delocalization error. To determine if DM21 can enable a molecular-level description of the physical properties of aqueous systems within Kohn–Sham DFT, we assess the accuracy of the DM21 functional for neutral, protonated, and deprotonated water clusters. Furthermore, we find that the ability of DM21 to accurately predict the energetics of aqueous clusters varies significantly with cluster size. Additionally, we introduce the many-body MB-DM21 potential derived from DM21 data within the many-body expansion of the energy and use it in simulations of liquid water as a function of temperature at ambient pressure. We find that size-dependent functional-driven errors identified in the analysis of the energetics of small clusters calculated with the DM21 functional result in the MB-DM21 potential systematically overestimating the hydrogen-bond strength and, consequently, predicting a more ice-like local structure of water at room temperature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learned synthesizability predictions aided by density functional theory

Abstract A grand challenge of materials science is predicting synthesis pathways for novel compounds. Data-driven approaches have made significant progress in predicting a compound’s synthesizability; however, some recent attempts ignore phase stability information. Here, we combine thermodynamic stability calculated using density functional theory with composition-based features to train a machine learning model that predicts a material’s synthesizability. Our model predicts the synthesizability of ternary 1:1:1 compositions in the half-Heusler structure, achieving a cross-validated precision of 0.82 and recall of 0.82. Our model shows improvement in predicting non-half-Heuslers compared to a previous study’s model, and identifies 121 synthesizable candidates out of 4141 unreported ternary compositions. More notably, 39 stable compositions are predicted unsynthesizable while 62 unstable compositions are predicted synthesizable; these findings otherwise cannot be made using density functional theory stability alone. This study presents a new approach for accurately predicting synthesizability, and identifies new half-Heuslers for experimental synthesis.

Lee, Andrew (ORCID:0000000153014295)↗

A machine learning approach for increased throughput of density functional theory substitutional alloy studies

In this study, a machine learning-based technique is developed to reduce the computational cost required to explore large design spaces of substitutional alloys. The first advancement is based on a neural network (NN) approach to predict the initial position of minority and majority ions prior to DFT relaxation. The second advancement is to allow the NN to predict the total energy for every possibility minority ion position and select the most stable configuration in the absence of relaxing each trial minority configuration. A bismuth oxide materials system, (Bi x La y Yb z ) 2 MoO 6 , was used as the model system to demonstrate the developed methods and quantify the resulting computational speedup. Compared to a brute force method that requires the calculation of every permutation of minority configuration and subsequent DFT relaxation, a 1.3× speedup was realized if the NN predicted the initial configuration of ions prior to relaxation. Implementation of the second advancement allowed the NN to predict the total energy for all possible trial configurations and downselect the most stable configurations prior to relaxation, resulting in a speedup of approximately 37×. Validation was done by comparing position and energy between the NN and DFT predictions. A maximum position vector mean squared error (MSE) of 1.6 × 10 -2 and a maximum energy MSE of 2.3 × 10 -7 was predicted for the worst case configuration. This method demonstrates a significant computational speedup, which has the potential for even greater computational savings for larger compositional design spaces.

36 MATERIALS SCIENCE↗

Efficient sampling of free energy landscapes with functions in Sobolev spaces

Molecular simulations of biological and physical phenomena generally involve sampling complicated, rough energy landscapes characterized by multiple local minima. In this work, we introduce a new family of methods for advanced sampling that draw inspiration from functional representations used in machine learning and approximation theory. As shown here, such representations are particularly well suited for learning free energies using artificial neural networks. As a system evolves through phase space, the proposed methods gradually build a model for the free energy as a function of one or more collective variables, from both the frequency of visits to distinct states and generalized force estimates corresponding to such states. Implementation of the methods is relatively simple and, more importantly, for the representative examples considered in this work, they provide computational efficiency gains of up to several orders of magnitude over other widely used simulation techniques.

Approximation theory↗

Atikokan Digital Twin: Machine learning in a biomass energy system

The Atikokan Generating Station, operated by Ontario Power Generation, has a 200 MW, biomass-fired tower boiler that operates on a dispatch schedule with a five-minute cycle. The boiler is generally operated in the range of 40–100 MW using two of five burner levels. In order to optimize boiler performance, we propose the implementation of a unique digital twin. Our digital twin abstraction couples Bayesian inference from science-based models and from observations (machine learning) with decision theory to predict operating-variable set points that optimize the physical asset (the boiler) in the presence of uncertainty (artificial intelligence). We focus this paper on the continuous Bayesian machine learning part of the Atikokan Digital Twin; we discuss decision theory in a companion paper. We identify and learn about 12 operational, model, and measured-output parameters and their uncertainties from high-fidelity, science-based simulations of the Atikokan boiler and from the observed measurements at the power plant. Since the goal of the Atikokan Digital Twin is to implement it online in real time, we require fast function evaluations for the quantities of interest extracted from the simulations in the Bayesian analysis. We use Gaussian process regression/interpolation to create accurate, robust surrogate models. We define the Bayesian priors and likelihood function and solve for the posterior distributions of the 12 parameters. Here we then propagate these distributions (i.e., parameters with uncertainty) into the predicted distributions of 790 quantities of interest to learn about the relative importance of various sources of error including experimental, model, and operating-parameter errors.

09 BIOMASS FUELS↗

Machine learning and algebraic approaches towards complete matter spectra in 4d F-theory

Motivated by engineering vector-like (Higgs) pairs in the spectrum of 4d F-theory compactifications, we combine machine learning and algebraic geometry techniques to analyze line bundle cohomologies on families of holomorphic curves. To quantify jumps of these cohomologies, we first generate 1.8 million pairs of line bundles and curves embedded in dP 3 , for which we compute the cohomologies. A white-box machine learning approach trained on this data provides intuition for jumps due to curve splittings, which we use to construct additional vector-like Higgs-pairs in an F-Theory toy model. We also find that, in order to explain quantitatively the full dataset, further tools from algebraic geometry, in particular Brill-Noether theory, are required. Using these ingredients, we introduce a diagrammatic way to express cohomology jumps across the parameter space of each family of matter curves, which reflects a stratification of the F-theory complex structure moduli space in terms of the vector-like spectrum. Furthermore, these insights provide an algorithmically efficient way to estimate the possible cohomology dimensions across the entire parameter space.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Molecular dynamics simulation of Fe-Si alloys using a neural network machine learning potential

Interatomic potential development using machine learning (ML) approaches has attracted a lot of attention in recent years because these potentials can effectively describe the structural and dynamical properties of complex materials at the atomistic level. Here, in this work, we present the development of a neural network (NN) deep ML interatomic potential for Fe-Si alloys, and we demonstrate the effectiveness of the NN-ML potential in predicting the structures and energies of liquid and crystalline phases of Fe-Si alloys in comparison with the results from ab initio molecular dynamics simulations or experimental data. The developed NN-ML potential is also used to perform molecular dynamics simulations to study the structures of Fe-Si alloys with various compositions under rapid solidification conditions. The short-ranged orders in the rapidly solidified Fe-Si alloys are also analyzed by a cluster alignment method.

36 MATERIALS SCIENCE↗

Geometry and Strings 2023

The proposal details plans for an upcoming meeting as part of the annual Geometry and Strings conference series. This series was formerly known as the ``F-theory'' conference series and has since broadened to include more general approaches to high energy physics centered on geometry, quantum field theory and string theory. The University of Pennsylvania has agreed to host the 2023 installment of the conference, which will take place on the UPenn campus in March 2023. The main thrust of the activities will center on several interconnected areas within the subject, including: The Swampland Program in quantum gravity and its geometric manifestations. The Geometric Engineering Program in string theory and its application to numerous question in quantum field theory. The Generalized Symmetries Program in quantum field theory and string theory. The Machine Learning Program aimed at understanding the large number of vacua present in string theory. The conference will adhere to a code of conduct aimed at making the event accessible to all participants. Additionally, particular attention will be paid to having a balanced mix of junior, mid-level and senior speakers from diverse backgrounds.

Lust, Dieter↗

Machine learning of superconducting critical temperature from Eliashberg theory

Abstract The Eliashberg theory of superconductivity accounts for the fundamental physics of conventional superconductors, including the retardation of the interaction and the Coulomb pseudopotential, to predict the critical temperature T c . McMillan, Allen, and Dynes derived approximate closed-form expressions for the critical temperature within this theory, which depends on the electron–phonon spectral function α 2 F ( ω ). Here we show that modern machine-learning techniques can substantially improve these formulae, accounting for more general shapes of the α 2 F function. Using symbolic regression and the SISSO framework, together with a database of artificially generated α 2 F functions and numerical solutions of the Eliashberg equations, we derive a formula for T c that performs as well as Allen–Dynes for low- T c superconductors and substantially better for higher- T c ones. This corrects the systematic underestimation of T c while reproducing the physical constraints originally outlined by Allen and Dynes. This equation should replace the Allen–Dynes formula for the prediction of higher-temperature superconductors.

36 MATERIALS SCIENCE↗

Machine Learning Predictions of Transition Probabilities in Atomic Spectra

Forward modeling of optical spectra with absolute radiometric intensities requires knowledge of the individual transition probabilities for every transition in the spectrum. In many cases, these transition probabilities, or Einstein A-coefficients, quickly become practically impossible to obtain through either theoretical or experimental methods. Complicated electronic orbitals with higher order effects will reduce the accuracy of theoretical models. Experimental measurements can be prohibitively expensive and are rarely comprehensive due to physical constraints and sheer volume of required measurements. Due to these limitations, spectral predictions for many element transitions are not attainable. In this work, we investigate the efficacy of using machine learning models, specifically fully connected neural networks (FCNN), to predict Einstein A-coefficients using data from the NIST Atomic Spectra Database. For simple elements where closed form quantum calculations are possible, the data-driven modeling workflow performs well but can still have lower precision than theoretical calculations. For more complicated nuclei, deep learning emerged more comparable to theoretical predictions, such as Hartree–Fock. Unlike experiment or theory, the deep learning approach scales favorably with the number of transitions in a spectrum, especially if the transition probabilities are distributed across a wide range of values. It is also capable of being trained on both theoretical and experimental values simultaneously. In addition, the model performance improves when training on multiple elements prior to testing. The scalability of the machine learning approach makes it a potentially promising technique for estimating transition probabilities in previously inaccessible regions of the spectral and thermal domains on a significantly reduced timeline.

74 ATOMIC AND MOLECULAR PHYSICS↗

Prediction of O and OH Adsorption on Transition Metal Oxide Surfaces from Bulk Descriptors

In the search for stable and active catalysts, density functional theory and machine learning (ML) based models can accelerate the screening of materials. While stability is conveniently addressed on the bulk level of computation, the modelling of catalytic activity requires expensive surface simulations. Here, in this work, we develop models for the surface adsorption energy of O and OH intermediates across a consistent and extensive dataset of pure transition metal oxide surfaces. We show that adsorption energies across metal oxidation states of +2 to +6 are well captured from the metal-oxygen bond strength extracted from the bulk level calculation. Specifically, we calculate the integrated crystal orbital Hamiltonian population (ICOHP) of the metal-oxygen bond in the bulk oxide and employ a simple normalization scheme to obtain a strong correlation with adsorption energetics. By combining our ICOHP descriptor with non DFT features in a Gaussian Process regression (GPR) model, we achieve high model accuracy with mean absolute errors of 0.166 and 0.219 eV for OH and O adsorption, respectively. By targeting the O-OH adsorption energy difference with our GPR model, we predict the the oxygen evolution reaction (OER) activity from bulk descriptors only. Furthermore, we utilize the strong correlation between the COHP and metal oxygen bond lengths to rapidly predict adsorption energetics and catalytic activity from the optimized bulk geometry. Our approach can enable an efficient search for active catalysts by eliminating the need for surface calculations in the initial screening phase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Materials Learning Algorithms (MALA): Scalable machine learning for electronic structure calculations in large-scale atomistic simulations

We present the Materials Learning Algorithms (MALA) package, a scalable machine learning framework designed to accelerate density functional theory (DFT) calculations suitable for large-scale atomistic simulations. Using local descriptors of the atomic environment, MALA models efficiently predict key electronic observables, including local density of states, electronic density, density of states, and total energy. The package integrates data sampling, model training and scalable inference into a unified library, while ensuring compatibility with standard DFT and molecular dynamics codes. We demonstrate MALA's capabilities with examples including boron clusters, aluminum across its solid-liquid phase boundary, and predicting the electronic structure of a stacking fault in a large beryllium slab. Scaling analyses reveal MALA's computational efficiency and identify bottlenecks for future optimization. With its ability to model electronic structures at scales far beyond standard DFT, MALA is well suited for modeling complex material systems, making it a versatile tool for advanced materials research.

Density functional theory↗

Entanglement and the double copy

We construct entangled states of gluons that scatter exactly as if they were gravitons. Operationally, these objects implement the double copy at the level of the wave function. Our analysis begins with a general ansatz for a wave function characterizing gluons in two copies of SU(N ) gauge theory. Given relatively minimal assumptions following from permutation invariance and dimensional analysis, the three- and four-particle wave functions generate scattering amplitudes that automatically coincide exactly with gravity, modulo normalization. For five-particle scattering the match is not automatic but imposing certain known selection rules on the amplitude is sufficient to uniquely reproduce gravity. The resulting amplitudes exhibit a color-dressed and permutation-invariant form of the usual double copy relations. We compute the entanglement entropy between the two gauge theory copies and learn that these states are maximally-entangled at large N. Moreover, this approach extends immediately to effective field theories, where Born-Infeld photons and Galileons can be similarly recast as entangled gluons and pions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The Rise of Neural Networks for Materials and Chemical Dynamics

Machine learning (ML) is quickly becoming a premier tool for modeling chemical processes and materials. ML-based force fields, trained on large data sets of high-quality electron structure calculations, are particularly attractive due their unique combination of computational efficiency and physical accuracy. This Perspective summarizes some recent advances in the development of neural network-based interatomic potentials. Designing high-quality training data sets is crucial to overall model accuracy. One strategy is active learning, in which new data are automatically collected for atomic configurations that produce large ML uncertainties. Another strategy is to use the highest levels of quantum theory possible. Transfer learning allows training to a data set of mixed fidelity. A model initially trained to a large data set of density functional theory calculations can be significantly improved by retraining to a relatively small data set of expensive coupled cluster theory calculations. These advances are exemplified by applications to molecules and materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗