Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Putting Priors in Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. We describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using predefined kernels. These data adaptive kernels can en- code prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS). The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains template for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic- algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code. The results show that the Mixture Density Mercer-Kernel described here outperforms tree-based classification in distinguishing high-redshift galaxies from low- redshift galaxies by approximately 16% on test data, bagged trees by approximately 7%, and bagged trees built on a much larger sample of data by approximately 2%.

Srivastava, Ashok N.↗
DOE OSTI2020

Machine learning study of magnetism in uranium-based compounds

Actinide and lanthanide-based materials display exotic properties that originate from the presence of itinerant or localized f electrons and include unconventional superconductivity and magnetism, hidden order, and heavy-fermion behavior. Due to the strongly correlated nature of the 5f electrons, magnetic properties of these compounds depend sensitively on applied magnetic field and pressure, as well as on chemical doping. However, precise connection between the structure and magnetism in actinide-based materials is currently unclear. In this investigation, we established such structure-property links by assembling and mining two datasets that aggregate, respectively, the results of high-throughput density functional theory simulations and experimental measurements for the families of uranium- and neptunium-based binary compounds. Various regression algorithms were utilized to identify correlations among accessible attributes (features or descriptors) of the material systems and predict their cation magnetic moments and general forms of magnetic ordering. Descriptors representing compound structural parameters and cation f-subshell occupation numbers were identified as most important for accurate predictions. The best machine learning model developed employs the random forest regression algorithm. It can predict both spin and orbit moment size with root-mean-square error of 0.17 μ B and 0.19 μ B , respectively. Lastly, the random forest classification algorithm is used to predict the ordering (paramagnetic, ferromagnetic, and antiferromagnetic) of such systems with 76% accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Predicting the chemical reactivity of organic materials using a machine-learning approach

Stability and compatibility between chemical components are essential parameters that need to be considered in the selection of functional materials in configuring a system. In configuring devices such as batteries or solar cells, not only the functionality of individual constituting materials such as electrodes or electrolyte but also an appropriate combination of materials which do not undergo unwanted side reactions is critical in ensuring their reliable performance in long-term operation. While the universal theory that can predict the general chemical reactivity between materials is long awaited and has been the subject of studies with a rich history, traditional ways proposed to date have been mostly based on simple electronic properties of materials such as electronegativity, ionization energy, electron affinity and hardness/softness, and could be applied to only a small group of materials. Moreover, prediction has often been far from accurate and has failed to offer general implications; thus it was practically inadequate as a selection criterion from a large material database, i.e. data-driven material discovery. Herein, we propose a new model for predicting the general reactivity and chemical compatibility among a large number of organic materials, realized by a machine-learning approach. As a showcase, we demonstrate that our new implemented model successfully reproduces previous experimental results reported on side-reactions occurring in lithium–oxygen electrochemical cells. Furthermore, the mapping of chemical stability among more than 90 available electrolyte solvents and the representative redox mediators is realized by this approach, presenting an important guideline in the development of stable electrolyte/redox mediator couples for lithium–oxygen batteries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Active Learning Guided Computational Discovery of Plant-Based Redoxmers for Organic Nonaqueous Redox Flow Batteries

Organic nonaqueous redox flow batteries (ONRFBs) are promising energy storage devices due to their scalability and reliance on sourceable materials. However, finding suitable redox-active organic molecules (redoxmers) for these batteries remains a challenge. Using plant-based compounds as precursors for these redoxmers can decrease their costs and environmental toxicity. In this computational study, flavonoid molecules have been examined as potential redoxmers for ONRFBs. Flavone and isoflavone derivatives were selected as catholyte (positive charge carrier) and anolyte (negative charge carrier) molecules, respectively. To drive their redox potentials to the opposite extremes, in silico derivatization was performed using a novel algorithm to generate a library of > 40000 candidate molecules that penalizes overly complex structures. A multiobjective Bayesian optimization based active learning algorithm was then used to identify best redoxmer candidates in these search spaces. Furthermore, our study provides methodologies for molecular design and optimization of natural scaffolds and highlights the need of incorporating expert chemistry awareness of the natural products and the basic rules of synthetic chemistry in machine learning.

25 ENERGY STORAGE↗
DOE OSTI2026

Comparison of DeePMD, MTP, GAP, ACE and MACE Machine‐Learned Potentials for Radiation‐Damage Simulations: A User Perspective

Accurate and efficient interatomic potentials are essential for molecular dynamics (MD) simulations of radiation damage, gas diffusion, and phase stability in complex ceramics such as LiAlO 2 , especially under extreme conditions relevant to tritium production. Here, we evaluate the performance of six machine-learned interatomic potentials (MLIPs), moment tensor potential (MTP), Gaussian approximation potential, deep potential (DeePMD), atomic cluster expansion (ACE), message-passing ACE (multilayer atomic cluster expansion (MACE) pretrained) and MACE (trained from-scratch), all trained on the same density functional theory dataset with inclusion of tritium. The MLIPs are benchmarked against traditional Buckingham and ReaxFF potentials in terms of energy accuracy, density predictions, thermal equilibration behavior, threshold displacement energy (E d ), tritium diffusivity, and computational cost. Among the models, MTP shows the best overall balance between efficiency and accuracy, with low force and energy errors and realistic E d values for Li and Al. The ACE and MACE (pretrained and trained from scratch) models exhibit high E d (>200 eV) and unphysical pair interactions. DeePMD underestimates Ed due to overly repulsive behavior even at equilibrium distances. All models over-estimate tritium diffusion but the pretrained MACE model behaves well during tritium-diffusion simulations up to 500 K, maintaining diffusivities in the physically consistent 10 −11 m 2 /s range. Finally, we quantify the computational cost of each potential in large-scale atomic/molecular massively parallel simulator, finding that only MTP is more efficient than traditional empirical potentials, while others are significantly more expensive. These findings explain the trade-offs between accuracy and computational cost in MLIP development and provide essential guidance for use in high-throughput radiation damage and gas diffusion simulations in nuclear ceramics.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Machine Learning Potentials with the Iterative Boltzmann Inversion: Training to Experiment

Methodologies for training machine learning potentials (MLPs) with quantum-mechanical simulation data have recently seen tremendous progress. Experimental data have a very different character than simulated data, and most MLP training procedures cannot be easily adapted to incorporate both types of data into the training process. Here, we investigate a training procedure based on iterative Boltzmann inversion that produces a pair potential correction to an existing MLP using equilibrium radial distribution function data. By applying these corrections to an MLP for pure aluminum based on density functional theory, we observe that the resulting model largely addresses previous overstructuring in the melt phase. Interestingly, the corrected MLP also exhibits improved performance in predicting experimental diffusion constants, which are not included in the training procedure. The presented method does not require autodifferentiating through a molecular dynamics solver and does not make assumptions about the MLP architecture. Our results suggest a practical framework for incorporating experimental data into machine learning models to improve the accuracy of molecular dynamics simulations.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Computational Framework to Accelerate the Discovery of Perovskites for Solar Thermochemical Hydrogen Production: Identification of Gd Perovskite Oxide Redox Mediators

A high-throughput computational framework to identify novel multinary perovskite redox mediators is presented, and this framework is applied to discover the Gd-containing perovskite oxide compositions Gd 2 BB'O 6 , GdA'B 2 O 6 , and GdA'BB'O 6 that split water. The computational scheme uses a sequence of empirical approaches to evaluate the stabilities, electronic properties, and oxygen vacancy thermodynamics of these materials, including contributions to the enthalpies and entropies of reduction, ΔH TR and ΔS TR . This scheme uses the machine-learned descriptor τ to identify compositions that are likely stable as perovskites, the bond valence method to estimate the magnitude and phase of BO 6 octahedral tilting and provide accurate initial estimates of perovskite geometries, and density functional theory including magnetic- and defect-sampling to predict STCH-relevant properties. Eighty-three promising STCH candidate perovskite oxides down-selected from 4392 Gd-containing compositions are reported, three of which are referred to experimental collaborators for characterization and exhibit STCH activity. Our results demonstrate that the high-throughput computational scheme described herein—which is used to evaluate Gd-containing compositions but can be applied to any multinary perovskite oxide compositional space(s) of interest—accelerates the discovery of novel STCH active redox mediators with reasonable computational expense.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Predictive Design of Hybrid Improper Ferroelectric Double Perovskite Oxides

The computational design of suitable multiferroic double perovskite oxides requires finding materials that exhibit sizable polarization, magnetization, and coupling between them. Oxides with the chemical formula of AA'BB'O 6 with building blocks of ABO 3 single perovskite oxides in centrosymmetric Pnma symmetry are strong candidates that have been reported to satisfy such criteria. The system lowers to noncentrosymmetric, polar P2 1 symmetry if A/A' layered and B/B' rocksalt cation orderings are imposed. A detailed compositional search over a variety of chemical spaces followed by evaluating their polarization may lead to the identification of more of these compounds with ferroelectric ordering. The standard density functional theory practices to estimate polarization within the Berry phase formalism require the systems to be perfectly insulating. The number of compounds that can be evaluated using this method is therefore limited. In this work, we introduce a predictive learning strategy based on importance sampling to build a series of machine learning models using results from first-principles simulations to predict polarization and the corresponding switching barrier. The geometry-driven features related to charge states and cationic radii play key roles in predicting the switching barrier with complementary contributions from the key structural mode-based order parameters. These modes become important to draw reasonable predictions of polarization components from machine learning models. In conclusion, our predictive models identify candidates with high polarizations and low switching barriers from a pool of double perovskite oxides, suitable for future investigation for their potential applications in spintronic devices.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Operando probing dynamic migration of copper carbonyl during electrocatalytic CO2 reduction

Single crystals and shape-controlled nanocrystals are well known to exhibit facet-dependent catalytic properties. However, few studies have investigated how those nanocrystals evolve and (de)activate during reactions, calling for the development of nanoscale time-resolved operando methods. In this context, we have designed Cu nanocubes as a model system to elucidate the underlying driving force of dynamic nanocatalyst reconstruction during the CO2 reduction reaction (CO2RR). Operando electrochemical liquid-cell scanning transmission electron microscopy (EC-STEM) and synchrotron-based X-ray spectroscopy reveal the size- and potential-dependent complete transformation from (100)-oriented Cu@Cu2O nanocubes to polycrystalline metallic Cu nanograins under CO2RR conditions. In addition, machine learning-assisted operando four-dimensional STEM reveals that large Cu nanograins derived from nanocubes form mainly crystalline domains, while their smaller counterparts are more amorphous due to faster evolution kinetics. In situ Raman spectroscopy and density functional theory calculations suggest that CO drives the ejection of single Cu atoms, resulting in few-nanometre Cu clusters and the surface migration of highly mobile copper carbonyl (Cu–CO) species. Combined, these multimodal operando methods and theoretical approaches pave the way for understanding the complex structural evolution of energy-related nanocatalysts under electrochemical conditions.

Yang, Yao↗
DOE OSTI2021

First principles reactive simulation for equation of state prediction

The high cost of density functional theory (DFT) has hitherto limited the ab initio prediction of the equation of state (EOS). In this article, we employ a combination of large scale computing, advanced simulation techniques, and smart data science strategies to provide an unprecedented ab initio performance analysis of the high explosive pentaerythritol tetranitrate (PETN). Comparison to both experiment and thermochemical predictions reveals important quantitative limitations of DFT for EOS prediction and thus the assessment of high explosives. In particular, we find that DFT predicts the energy of PETN detonation products to be systematically too high relative to the unreacted neat crystalline material, resulting in an underprediction of the detonation velocity, pressure, and temperature at the Chapman–Jouguet state. The energetic bias can be partially accounted for by high-level electronic structure calculations of the product molecules. Furthermore we demonstrate a modeling strategy for mapping chemical composition across a wide parameter space with limited numerical data, the results of which suggest additional molecular species to consider in thermochemical modeling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Physics-informed neural networks for inverse problems in nano-optics and metamaterials

In this paper, we employ the emerging paradigm of physics-informed neural networks (PINNs) for the solution of representative inverse scattering problems in photonic metamaterials and nano-optics technologies. In particular, we successfully apply mesh-free PINNs to the difficult task of retrieving the effective permittivity parameters of a number of finite-size scattering systems that involve many interacting nanostructures as well as multi-component nanoparticles. Our methodology is fully validated by numerical simulations based on the finite element method (FEM). The development of physics-informed deep learning techniques for inverse scattering can enable the design of novel functional nanostructures and significantly broaden the design space of metamaterials by naturally accounting for radiation and finite-size effects beyond the limitations of traditional effective medium theories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Ab initio generalized Langevin equation

We introduce a machine learning–based approach called ab initio generalized Langevin equation (AIGLE) to model the dynamics of slow collective variables (CVs) in materials and molecules. In this scheme, the parameters are learned from atomistic simulations based on ab initio quantum mechanical models. Force field, memory kernel, and noise generator are constructed in the context of the Mori–Zwanzig formalism, under the constraint of the fluctuation–dissipation theorem. Combined with deep potential molecular dynamics and electronic density functional theory, this approach opens the way to multiscale modeling in a variety of situations. Here, we demonstrate this capability with a study of two mesoscale processes in crystalline lead titanate, namely the field-driven dynamics of a planar ferroelectric domain wall, and the dynamics of an extensive lattice of coarse-grained electric dipoles. In the first case, AIGLE extends the reach of ab initio simulations to a regime of noise-driven motions not accessible to molecular dynamics. In the second case, AIGLE deals with an extensive set of CVs by adopting a local approximation for the memory kernel and retaining only short-range noise correlations. The scheme is computationally more efficient than molecular dynamics by several orders of magnitude and mimics the microscopic dynamics at low frequencies where it reproduces accurately the dominant far-infrared absorption frequency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Data-driven learning of nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. Here, we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity — it is particularly challenging to extract surrogates which are provably well-posed and numerically stable. Our scheme not only yields a convex optimization problem, but also allows extraction of nonlocal models whose kernels may be partially negative while maintaining well-posedness even in small-data regimes. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints to meet the requisite conditions of the nonlocal theory. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

42 ENGINEERING↗
DOE OSTI2021

Physics-Based Feature Extraction from Bulk Time-Series PMU Datasets for Event Detection

In this work, two physics-based feature extraction techniques are developed for bulk time-series phasor measurement unit (PMU) datasets collected from the field to train the machine learning model for anomaly detection. Two approaches have been developed to extract useful features for different types of events. An admittance-based feature extraction technique is developed to detect events that involve line outages and system topology variations. The developed algorithm extracts the system equivalent admittance variation. Additionally, Fielder’s Theory is utilized to further reduce the potential computation burden by sectionalizing large-scale grids and datasets into smaller areas. Second, an oscillation-based feature extraction technique is developed to detect low-frequency oscillations in power grids. The dominant oscillation modes in the grids are extracted using energy-sorted Prony analysis. The extracted dominant oscillation modes by the developed work exhibit a high fitting resolution. Finally, the developed techniques have been validated using large-scale and real-world datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Reducing Urban Traffic Congestion Using Deep Learning and Model Predictive Control

This article proposes a deep learning (DL)-based control algorithm—DL velocity-based model predictive control (VMPC)—for reducing traffic congestion with slowly time-varying traffic signal controls. This control algorithm consists of system identification using DL and traffic signal control using VMPC. For the training process of DL, we established a modeling error entropy loss as the criteria inspired by the theory of stochastic distribution control (SDC) originated by the fourth author. Herein, simulation results show that the proposed algorithm can reduce traffic congestion with a slowly varying traffic signal control input. Results of an ablation study demonstrate that this algorithm compares favorably to other model-based controllers in terms of prediction error, signal varying speed, and control effectiveness.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Chromium-doped uranium dioxide fuels: A review

UO 2 doped with parts per million CR 2 O 3 powder is considered a potential near term accident tolerant fuel candidate. Here, the results of decades of industry and academic research into Cr-doped UO 2 are analyzed and their shortcomings are critiqued. Focusing on the incorporation mechanisms of Cr into the fuel matrix, we explore a mechanistic understanding of the characteristic properties of Cr-doped UO 2 , notably, enhanced fission gas retention attributed to enlarged grain sizes following sintering, along with marginal improvements in the thermophysical properties. The findings of recent X-ray Adsorption Near Edge Spectroscopy studies were compared and put into conversation with historic data regarding the incorporation of Cr in UO 2 . On the basis of defect mechanisms, the case is made for the substitutional incorporation of Cr governing the lattice solubility but not the enhanced U diffusivity. Instead, Cr/CR 2 O 3 redox chemistry in a well-defined oxygen potential explains the differences in the U diffusivity and O/M ratio. The primary mechanism of doping enhanced grain growth is found to be liquid assisted sintering due to a CRO (1) eutectic phase at the grain boundaries. The role of inhomogeneities in Cr concentration in UO 2 at various length scales across the materials microstructure is highlighted and connected to promising experimental and modeling work to fill in the gaps in the current understanding of Cr-doped UO 2 . The review considers both the open scientific questions and engineering applications to illustrate the deep connections between the practice and theory in the design of accident tolerant nuclear fuels. In conclusion, the review ends with an outline of future works that combine meticulous irradiation studies and high resolution experiments with next generation modeling and simulations techniques empowered by machine learning advances to accelerate the fabrication and adoption of Cr-doped UO 2 light water reactors.

Cleveland, Mack Wesley [Massachusetts Inst. of Tec↗
DOE OSTI2026

Finite-element-based simulations of electrodes for CO 2 cascade reduction reactions

The multielectron reduction of CO 2 to liquid fuels could be a path to scalable energy storage, but reaching this goal requires major advances in catalysis and systems engineering. Cascade catalysis, which couples sequential reactions without isolating intermediates, has emerged as a promising route to enhance selectivity and efficiency in CO 2 reduction (CO 2 R). In this review, we examine how finite-element-based simulations of continuum model [finite element method (FEM)] approaches are being used to analyze and guide CO 2 R cascade systems. We first outline the fundamentals of cascade catalysis and recent advances in catalytic materials (metallic, molecular, and hybrid architectures). We then focus on FEM developments at the electrode and device scales, emphasizing how these models capture transport phenomena, local microenvironments, and geometry-dependent effects. To clarify design principles, we present case studies of cascade electrodes organized in systems without and with integrated semiconductors. We further emphasize the integration of FEM with multiscale frameworks (density functional theory, molecular dynamics, kinetic Monte Carlo) and its role in bridging atomic-level insights with device-level performance. Finally, we identify current limitations and future prospects, including improved boundary conditions, coupling with operando experiments, and machine learning-accelerated model development. Together, these insights provide design principles for next-generation CO 2 R cascade systems for efficient solar fuel production.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Bridging the time scale in exascale computing of chemical systems (Final Technical Report)

This report summarizes the work carried out with support of the United States Department of Energy under Award DE-SC0019441. The theme of this project was to develop and apply methods that allowed for the acceleration of atomistic calculations, particularly in challenging areas such as multiphase systems, electrified interfaces, uncertainty estimation, and applications requiring chemical accuracy, which tend to be applications where simulation time is severely bottlenecked by the computational time requirements. Much of the focus was on the application of emerging machine-learning methodologies, although a wide range of methodologies were employed. This report has two major sections. The first focuses on the methodological advances themselves. Within this part, we report a number of major advances, a few examples of which are described here. We report the first machine-learning scheme for the acceleration of electronically grand-canonical calculations (that is, those applicable to electrochemistry). We report new methods of performing transfer learning, in which physics-based priors can be used to provide predictions, often with uncertainty estimates, of images well outside of training sets; we also offer ways to fine-tune these transfer-learning models. We provide a new systematic means to generate and apply minimal training data sets to very large (10,000’s of atoms) systems, with only small training sets appropriate for electronic structure. We developed new methodologies to integrate surface vibrations into surface adsorption calculations. We made advances to the applicability of diffusion Monte Carlo methods to allow (learned) force prediction, finite-size error correction, and force-free means of searching for transition states. We integrated machine-learned atomistic predictions into mechanism generation codes. Additionally, we released new software including AmpTorch, a modernized version of our original atomistic machine-learning code Amp. The second part of this report focuses on the scientific applications that accompanied, and were often enabled by, the methodological advances described earlier. A few examples follow, but full details are in the individual chapters of the report. For example, we developed a general theory of phonon-induced friction on molecular adsorbates. We showed fundamentally how solvent influences the adsorption and desorption process and how it differs from the processes typically involved at the solid–gas interface, making aqueous-phase and electrocatalysis different from traditional thermocatalysis. We examined how metal–insulator and magnetic transitions can be probed, and accelerated exciton dynamics via Frenkel Hamiltonian parameters. We showed that the nearsighted force-training approach, developed within this project, can predict both the stability and reactivity of large nanoparticles, and can also lead to insights on catalyst coverage on binding energies and entropies. These applied studies, which generally integrated with our method development, allowed us to push forward the theoretical understanding of several reaction classes.

08 HYDROGEN↗