Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Lattice Duality: The Origin of Probability and Entropy

Bayesian probability theory is an inference calculus, which originates from a generalization of inclusion on the Boolean lattice of logical assertions to a degree of inclusion represented by a real number. Dual to this lattice is the distributive lattice of questions constructed from the ordered set of down-sets of assertions, which forms the foundation of the calculus of inquiry-a generalization of information theory. In this paper we introduce this novel perspective on these spaces in which machine learning is performed and discuss the relationship between these results and several proposed generalizations of information theory in the literature.

Knuth, Kevin H.↗

When more data hurts: Optimizing data coverage while mitigating diversity-induced underfitting in an ultrafast machine-learned potential

Machine-learned interatomic potentials (MLIPs) are becoming an essential tool in materials modeling. However, optimizing the generation of training data used to parametrize the MLIPs remains a significant challenge. This is because MLIPs can fail when encountering local environments too different from those present in the training data. The difficulty of determining a priori the environments that will be encountered during molecular dynamics simulation necessitates diverse, high-quality training data. Here, this study investigates how training data diversity affects the performance of MLIPs using the Ultra-Fast force field (UF 3 ) to model amorphous silicon nitride. We employ expert and autonomously generated data to create the training data and fit four force field variants to subsets of the data. Our findings reveal a critical balance in training data diversity: insufficient diversity hinders generalization, while excessive diversity can exceed the MLIP's learning capacity, reducing simulation accuracy. Specifically, we found that the UF 3 variant trained on a subset of the training data, in which nitrogen-rich structures were removed, offered vastly better prediction and simulation accuracy than any other variant. By comparing these UF 3 variants, we highlight the nuanced requirements for creating accurate MLIPs, emphasizing the importance of application-specific training data to achieve optimal performance in modeling complex material behaviors.

ab initio molecular dynamics↗

Representing local atomic environment using descriptors based on local correlations

Statistical learning of material properties is an emerging topic of research and has been tremendously successful in areas such as representing complex energy landscapes as well as in technologically relevant areas, like identification of better catalysts and electronic materials. However, analysis of large data sets to efficiently learn characteristic features of a complex energy landscape, for example, depends on the ability of descriptors to effectively screen different local atomic environments. Thus, discovering appropriate descriptors of bulk or defect properties and the functional dependence of such properties on these descriptors remains a difficult and tedious process. To this end, we develop here a framework to generate descriptors based on many-body correlations that can effectively capture intrinsic geometric features of the local environment of an atom. These descriptors are based on the spectrum of two-body, three-body, four-body, and higher order correlations between an atom and its neighbors and are evaluated by calculating the corresponding two-body, three-body, and four-body overlap integrals. They are invariant to global translation, global rotation, reflection, and permutations of atomic indices. By systematically testing the ability to capture the local atomic environment, it is shown that the local correlation descriptors are able to successfully reconstruct structures containing 10-25 atoms which was previously not possible.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computational evolution of high-performing unfused non-fullerene acceptors for organic solar cells

Materials optimization for organic solar cells (OSCs) is a highly active field, with many approaches using empirical experimental synthesis, computational brute force to screen a subset of chemical space, or generative machine learning methods that often require significant training sets. While these methods may find high-performing materials, they can be inefficient and time-consuming. Genetic algorithms (GAs) are an alternative approach, allowing for the “virtual synthesis” of molecules and a prediction of their “fitness” for some property, with new candidates suggested based on good characteristics of previously generated molecules. In this work, a GA is used to discover high-performing unfused non-fullerene acceptors (NFAs) based on an empirical prediction of power conversion efficiency (PCE) and provides design rules for future work. The electron-withdrawing/donating strength, as well as the sequence and symmetry, of those units are examined. The utilization of a GA over a brute-force approach resulted in speedups up to 1.8 × 10 12 . New types of units, not frequently seen in OSCs, are suggested, and in total 5426 NFAs are discovered with the GA. Of these, 1087 NFAs are predicted to have a PCE greater than 18%, which is roughly the current record efficiency. While the symmetry of the sequence showed no correlation with PCE, analysis of the sequence arrangement revealed that higher performance can be achieved with a donor core and acceptor end groups. Future NFA designs should consider this strategy as an alternative to the current A-D-A'-D-A architecture.

14 SOLAR ENERGY↗

Deep potential molecular dynamics simulations of ion-enhanced etching of silicon by atomic chlorine

The continued development of plasma-assisted processing techniques requires a fundamental understanding of plasma-surface interactions. Molecular dynamics (MD) simulations have been employed to complement experimental studies and better understand the properties of such systems. Recently, machine learning (ML) methods have enabled the development of ab initio-based interatomic potentials, which can be generalized to complex combinations of multiple atom types. In this work, we use ML potentials developed using the Deep Potential Molecular Dynamics (DeepMD) framework to provide a model of ion-enhanced etching of Si by Cl atoms. We demonstrate the importance of proper selection of the training data set to the accuracy of the DeepMD model and compare our results to MD results using empirical potentials, as well as to experimental measurements. Exposure of undoped Si at 300 K to thermal Cl atoms yields a steady-state Cl coverage of 1.25 monolayers, which is slightly lower than the value obtained in previous experimental studies. Predictions of Si etch yields by simultaneous Cl atom and Ar + ion impacts as a function of ion energy, neutral to ion flux ratio, and angle of incidence of the ions are in reasonably good agreement with classical MD results and experimental measurements. Finally, etch yields and SiCl x mixed layer thicknesses during simultaneous bombardment of the Si(100) surface by Cl atoms and Cl + ions are in good agreement with experimental data. In conclusion, the present work is a necessary condition for the extension of the DeepMD procedure to more complex systems of interest in plasma-surface interactions.

Artificial neural networks↗

Prediction of Solute Segregation at Metal/Oxide Interfaces Using Machine Learning Approaches

The atomic structure and chemistry at metal/oxide interfaces play a crucial role in determining their properties. However, studying semi-coherent metal/oxide interfaces that include misfit dislocations through density functional theory (DFT) is often computationally expensive due to the large number of atoms involved, ranging from hundreds to thousands. In this study, we explore solute segregation behavior at the Fe/Y 2 O 3 interface—an important model interface for cladding applications in nuclear fission reactors—by combining DFT calculations with a machine learning (ML) approach. ML models are trained using DFT-calculated segregation energies (𝐸 𝑆𝑒𝑔 ) to identify the key chemical and geometric factors influencing solute segregation at metal/oxide interfaces, revealing the competition between these features in determining 𝐸 𝑆𝑒𝑔 . Moreover, the segregation behavior at a specific Fe/Y 2 O 3 interface is predicted with high accuracy using ML models trained on data from this interface. Furthermore, it is found that the ML models could also predict solute segregation at a different Fe/Y 2 O 3 interface with a new orientation relationship (OR), at a computational cost of less than 1/45 of that required for similar DFT calculations.

36 - MATERIALS SCIENCE↗

Deep potential molecular dynamics simulations of low-temperature plasma-surface interactions

Machine learning approaches to potential generation for molecular dynamics (MD) simulations of low-temperature plasma-surface interactions could greatly extend the range of chemical systems that can be modeled. Empirical potentials are difficult to generalize to complex combinations of multiple elements with interactions that might include covalent, ionic, and metallic bonds. This work demonstrates that a specific machine learning approach, Deep Potential Molecular Dynamics (DeepMD), can generate potentials that provide a good model of plasma etching in the Si-Cl-Ar system. Comparisons are made between MD results using DeepMD models and empirical potentials, as well as experimental measurements. Pure Si properties predicted by the DeepMD model are in reasonable agreement with experimental results. Simulations of Si bombardment by Ar + ions demonstrate the ability of the DeepMD method to predict sputtering yields as well as the depth of the amorphous-crystalline interface. Etch yields as a function of flux ratio and ion energy for simultaneous Cl 2 and Ar + impacts are in good agreement with previous simulation results and experiment. Predictions of etch yields and etch products during plasma-assisted atomic layer etching of Si-Cl 2 -Ar are shown to be in good agreement with MD predictions using empirical potentials and with experiment. Finally, good agreement was also seen with measurements for the spontaneous etching of Si by Cl atoms at 300 K. Further, the demonstration that DeepMD can reproduce results from MD simulations using empirical potentials is a necessary condition to future efforts to extend the method to a much wider range of systems for which empirical potentials may be difficult or impossible to obtain.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Machine learning assisted derivation of minimal low-energy models for metallic magnets

Abstract We consider the problem of extracting a low-energy spin Hamiltonian from a triangular Kondo Lattice Model (KLM). The non-analytic dependence of the effective spin-spin interactions on the Kondo exchange excludes the use of perturbation theory beyond the second order. We then introduce a Machine Learning (ML) assisted protocol to extract effective two- and four-spin interactions. The resulting spin model reproduces the phase diagram of the original KLM as a function of magnetic field and single-ion anisotropy and reveals the effective four-spin interactions that stabilize the field-induced skyrmion crystal phase. Moreover, this model enables the computation of static and dynamical properties with a much lower numerical cost relative to the original KLM. A comparison of the dynamical spin structure factor in the fully polarized phase computed with both models reveals a good agreement for the magnon dispersion even though this information was not included in the training data set.

Sharma, Vikram (ORCID:0000000189105519)↗

Data-driven Distributed Learning of Multi-agent Systems: A Koopman Operator Approach

Koopman operator theory provides a model-free technique for studying nonlinear dynamical systems purely from data. Since the Koopman operator is infinite-dimensional, researchers have developed several methods that provide a finite-dimensional approximation of the Koopman operator so that it can be applied for practical use cases. One common thing with most of the methods is that their solutions are obtained by solving a centralized minimization problem. In this work, we treat the dynamical system to be a multi-agent system and propose an algorithm to compute the finite-dimensional approximation of the Koopman operator in a distributed manner using the knowledge of the topology of the underlying multi-agent system. The proposed distributed approach is shown to be equivalent to the centralized learning problem and results in a sparse Koopman whose block structure mimics the Laplacian of the multi-agent system. Extensive simulation studies illustrate the proposed framework on the network of oscillators and the IEEE 68 bus system.

Nandanoori, Sai Pushpak↗

Improving inference with matrix elements and machine learning

Particle physics processes bring together a high-energy amplitude described by quantum field theory and nonperturbative effects and detector interactions described by complex computer simulations. We review some recently developed multivariate inference techniques that leverage this structure and combine matrix-element information with machine learning. Automated by the MadMiner package, the new techniques have been applied to multiple problems in particle physics, allowing for stronger limits than traditional analysis methods and showing their potential to improve the sensitivity of the LHC legacy measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Duality of parity doublets of helicity {+-}2 in D=2+1 dimensions

In D=2+1 dimensions there are two dual descriptions of parity singlets of helicity {+-}1, namely, the self-dual model of first order (in derivatives) and the Maxwell-Chern-Simons theory of second order. Correspondingly, for helicity {+-}2 there are four models S{sub SD{+-}}{sup (r)} describing parity singlets of helicities {+-}2. They are of first, second, third, and fourth order (r=1, 2, 3, 4), respectively. Here we show that the generalized soldering of the opposite helicity models S{sub SD+}{sup (4)} and S{sub SD-}{sup (4)} leads to the linearized form of the new massive gravity suggested by Bergshoeff, Hohm, and Townsend (BHT) similarly to the soldering of S{sub SD+}{sup (3)} and S{sub SD-}{sup (3)}. We argue why in both cases we have the same result. We also find out a triple master action which interpolates between the three dual models: linearized BHT theory, S{sub SD+}{sup (3)}+S{sub SD-}{sup (3)}, and S{sub SD+}{sup (4)}+S{sub SD-}{sup (4)}. By comparing gauge invariant correlation functions we deduce dual maps between those models. In particular, we learn how to decompose the field of the linearized BHT theory in helicity eigenstates of the dual models up to gauge transformations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Tackling Disorder in γ‐Ga 2 O 3

Abstract Ga 2 O 3 and its polymorphs are attracting increasing attention. The rich structural space of polymorphic oxide systems such as Ga 2 O 3 offers potential for electronic structure engineering, which is of particular interest for a range of applications, such as power electronics. γ‐Ga 2 O 3 presents a particular challenge across synthesis, characterization, and theory due to its inherent disorder and resulting complex structure–electronic‐structure relationship. Here, density functional theory is used in combination with a machine‐learning approach to screen nearly one million potential structures, thereby developing a robust atomistic model of the γ‐phase. Theoretical results are compared with surface and bulk sensitive soft and hard X‐ray photoelectron spectroscopy, X‐ray absorption spectroscopy, spectroscopic ellipsometry, and photoluminescence excitation spectroscopy experiments representative of the occupied and unoccupied states of γ‐Ga 2 O 3 . The first onset of strong absorption at room temperature is found at 5.1 eV from spectroscopic ellipsometry, which agrees well with the excitation maximum at 5.17 eV obtained by photoluminescence excitation spectroscopy, where the latter shifts to 5.33 eV at 5 K. This work presents a leap forward in the treatment of complex, disordered oxides and is a crucial step toward exploring how their electronic structure can be understood in terms of local coordination and overall structure.

36 MATERIALS SCIENCE↗

Role of Wadsley Defects and Cation Disorder to Enhance MoNb 12 O 33 Diffusion

Wadsley-Roth (WR) niobates have emerged as high-rate anode materials that can combine rapid ionic diffusion with good electronic conductivity. WR compounds have been defect-enhanced by limited annealing, however, such materials often contain multiple types of defects. In particular, both Wadsley defects (variable block size) and transition metal disorder have the potential to modify transport rates, however the corresponding effects are not well understood mechanistically. Here, MoNb 12 O 33 (MNO) was calcined at two different temperatures to compare a defect-rich condition (MNO-800) with a proximal order-rich condition (MNO-900) as assessed through XRD, XANES, EXAFS, and STEM characterizations. Galvanostatically cycled lithium half cells of MNO-800 exhibited additional capacity (307 mAhg −1 at 0.1C, 4.66% higher) and improved high-rate capacity of 200 mAhg −1 at 10C. ICI-based overpotential analysis identified solid state diffusion as the dominant rate limiting process where MNO-800 correspondingly exhibited ∼3X faster capacity-weighted diffusivity. A machine-learning interatomic potential was trained to density functional theory and then applied with molecular dynamics (MLIP-MD) to examine the possible roles of Wadsley defects and transition metal disorder. For both defect-types, Li was found to populate and activate fast diffusion paths from window sites at lower extents of lithiation as compared to the order-rich model.

defect↗

On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks

Physics-informed neural networks (PINNs) are demonstrating remarkable promise in integrating physical models with gappy and noisy observational data, but they still struggle in cases where the target functions to be approximated exhibit high-frequency or multi-scale features. Here in this work we investigate this limitation through the lens of Neural Tangent Kernel (NTK) theory and elucidate how PINNs are biased towards learning functions along the dominant eigen-directions of their limiting NTK. Using this observation, we construct novel architectures that employ spatio-temporal and multi-scale random Fourier features, and justify how such coordinate embedding layers can lead to robust and accurate PINN models. Numerical examples are presented for several challenging cases where conventional PINN models fail, including wave propagation and reaction–diffusion dynamics, illustrating how the proposed methods can be used to effectively tackle both forward and inverse problems involving partial differential equations with multi-scale behavior.

42 ENGINEERING↗

GPR_calculator: An on-the-fly surrogate model to accelerate massive nudged elastic band calculations

We present GPR_calculator, a package based on Python and C++ programming languages to build an on-the-fly surrogate model using Gaussian Process Regression (GPR) to approximate computationally expensive electronic structure calculations. The key idea is to dynamically train a GPR model during the simulation that can accurately predict energies and forces with uncertainty quantification. When the uncertainty is high, the costly electronic structure calculation is performed to obtain the ground truth data, which is then used to update the GPR model. To illustrate the effectiveness of GPR_calculator, we demonstrate its application in Nudged Elastic Band (NEB) simulations of surface diffusion and reactions, achieving 3-10 times acceleration compared to pure ab initio calculations. The source code is available at https://github.com/MaterSim/GPR_calculator.

Gaussian process regression↗

A Cellular Automaton Simulation for Predicting Phase Evolution in Solid-State Reactions

New computational tools for solid-state synthesis recipe design are needed in order to accelerate the experimental realization of novel functional materials proposed by high-throughput materials discovery workflows. This work contributes a cellular automaton simulation framework for predicting the time-dependent evolution of intermediate and product phases during solid-state reactions as a function of precursor choice and amount, reaction atmosphere, and heating profile. The simulation captures the effects of reactant particle spatial distribution, particle melting, and reaction atmosphere. Reaction rates based on rudimentary kinetics are estimated using density functional theory data from the Materials Project and machine learning estimators for the melting point and the vibrational entropy component of the Gibbs free energy. The resulting simulation framework allows for the prediction of the likely outcome of a reaction recipe before any experiments are performed. We analyze five experimental solid-state recipes for BaTiO 3 , CaZrN 2 , and YMnO 3 found in the literature to illustrate the performance of the model in capturing reaction selectivity and reaction pathways as a function of temperature and precursor choice. This simulation framework offers an easier way to optimize existing recipes, aid in the identification of intermediates, and design effective recipes for yet unrealized inorganic solids in silico .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗