Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Computational design of high entropy alloy coating for hydrogen turbine applications

This project aims to develop novel high entropy alloy (HEA)-based coatings to protect critical components in hydrogen-fueled turbine power system. The HEA-coatings will demonstrate superior performance in hydrogen combustion environment to commercial NiCoCrAlY coating in current natural gas turbine system. The HEA coating facilitates the formation of a protective scale of alpha-alumina to slow down the inward diffusion of oxidizing species and the outward diffusion of metal elements, and possesses ultrahigh corrosion and spallation resistance to prolong the service lifetime of critical components in hydrogen turbine power system. Aimed to accelerate the discovery of novel HEA coating compositions, high throughput computational modeling including CALPHAD and density functional theory and machine learning are performed to predict phase stability, oxygen permeability, oxidation rate constant, coefficient of thermal expansion, and mechanical properties. Based on the modeling and machine learning prediction, experimental validation is performed. Preliminary results will be presented and approaches to minimize oxidation will be discussed.

alloy design↗
DOE OSTI2023

Robust Resilient Signal Reconstruction under Adversarial Attacks

We consider the problem of signal reconstruction for a system under sparse signal corruption by a malicious agent. The reconstruction problem follows the standard error coding problem that has been studied extensively in the literature. We include a new challenge of robust estimation of the attack support. The problem is then cast as a constrained optimization problem merging promising techniques in the area of deep learning and estimation theory. A pruning algorithm is developed to reduce the "false positive" uncertainty of data-driven attack localization results, thereby improving the probability of correct signal reconstruction. Sufficient conditions for the correct reconstruction and the associated reconstruction error bounds are obtained for both exact and inexact attack support estimation. Moreover, a simulation of a water distribution system is presented to validate the proposed techniques.

Robust, Signal reconstruction, Resilient estimator↗
DOE OSTI2020

A Bayesian framework for adsorption energy prediction on bimetallic alloy catalysts

Abstract For high-throughput screening of materials for heterogeneous catalysis, scaling relations provides an efficient scheme to estimate the chemisorption energies of hydrogenated species. However, conditioning on a single descriptor ignores the model uncertainty and leads to suboptimal prediction of the chemisorption energy. In this article, we extend the single descriptor linear scaling relation to a multi-descriptor linear regression models to leverage the correlation between adsorption energy of any two pair of adsorbates. With a large dataset, we use Bayesian Information Criteria (BIC) as the model evidence to select the best linear regression model. Furthermore, Gaussian Process Regression (GPR) based on the meaningful convolution of physical properties of the metal-adsorbate complex can be used to predict the baseline residual of the selected model. This integrated Bayesian model selection and Gaussian process regression, dubbed as residual learning, can achieve performance comparable to standard DFT error (0.1 eV) for most adsorbate system. For sparse and small datasets, we propose an ad hoc Bayesian Model Averaging (BMA) approach to make a robust prediction. With this Bayesian framework, we significantly reduce the model uncertainty and improve the prediction accuracy. The possibilities of the framework for high-throughput catalytic materials exploration in a realistic setting is illustrated using large and small sets of both dense and sparse simulated dataset generated from a public database of bimetallic alloys available in Catalysis-Hub.org.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Machine learning pipeline to predict defect behavior in metallic alloy systems

The interaction between defect and solute atoms is critical to the thermodynamic and kinetic behavior of metallic alloys under exposure to high-energy radiation, causing irradiation damage in materials. Radiation can generate non-equilibrium concentrations of point defects such as vacancies and interstitials. The excess point defects not only accelerate diffusional processes such as precipitation that cause radiation embrittlement, but also change the pathway of phase transformations, including nucleation processes. Understanding these defect behaviors is complicated by the challenge and complexity of addressing each possible local and discrete distribution of environments and chemical interactions around targeted defects-solute or solute-solute complexes. To resolve the challenge, machine learning regression techniques have emerged as powerful tools that can train and construct an energy model to accurately describe the chemical interactions of solutes and defects. In Fiscal Year 2022, the work focused on the workflow development and demonstration using machine learning regression, density functional theory, cluster expansion, and Monte Carlo simulation to predict the effects of ternary solute elements (e.g., aluminum and molybdenum) and point defects on the Cr-rich $\alpha^{\prime}$ precipitation in multicomponent FeCr model alloys. The computational outcomes include the prediction of the ternary phase diagram, vacancy formation energy for different compositions, and the effect of vacancies on the nucleation of Cr-rich clusters. The simulations predict a pronounced change of Cr solubility in bcc Fe by the addition of Al and the rejection of Al atoms from $\alpha^{\prime}$ precipitates. Additionally, the simulations show the formation of Cr-vacancy clusters as the initial nuclei for stable nucleation and growth of $\alpha^{\prime}$ particles. The results demonstrate important outcomes and applications of using machine learning pipeline to study model or commercial alloys with multicomponent solute species and point defects.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Cyber-Attack Detection and Accommodation for the Energy Delivery System

The goals of this project were to create a software system with a suite of key algorithms for cyber-attack detection and accommodation providing domain layer protection for critical power generation assets. Example assets included gas and steam turbines, heat recovery steam generators, and electrical generators. The aggressive algorithm goals were aimed at reducing the false positive rates in threat detection to <1% using learnings from many evolving disciplines (power turbine and generator physics, power system modeling, modern control theory, system identification, machine learning, deep learning, mathematics and data science). Additional goals for the algorithms involved localizing threats on-the-fly to know in which monitoring node the effects of attacks are present, and then providing accommodation to keep the system running uninterrupted much of the time in the presence of the attack. Accommodation had a performance goal of providing resiliency when up to 50% of monitoring nodes are in an attack state.

cybersecurity, cyber-physical↗
DOE OSTI2024

Characterizing 4-string contact interaction using machine learning

Abstract The geometry of 4-string contact interaction of closed string field theory is characterized using machine learning. We obtain Strebel quadratic differentials on 4-punctured spheres as a neural network by performing unsupervised learning with a custom-built loss function. This allows us to solve for local coordinates and compute their associated mapping radii numerically. We also train a neural network distinguishing vertex from Feynman region. As a check, 4-tachyon contact term in the tachyon potential is computed and a good agreement with the results in the literature is observed. We argue that our algorithm is manifestly independent of number of punctures and scaling it to characterize the geometry ofn-string contact interaction is feasible.

Physics↗
DOE OSTI2026

Machine-learned quantum molecular dynamics calculations of warm dense equation of state and ionic transport coefficients of deuterated water

White dwarf models require accurate equations of state and ionic transport coefficients in the warm dense matter regime, where kinetic theory models and tabulated equations of state are often inaccurate. In this work, spectral-partitioned density functional theory and machine-learned interatomic potentials are combined to perform large-scale, first-principles quantum molecular dynamics simulations of deuterated water (D 2 O) near the principal Hugoniot. This approach retains Kohn-Sham accuracy while achieving orders-of-magnitude speedup, yielding converged equation of state and transport properties over a broad pressure and temperature range. The results reveal the thermodynamic conditions under which ionic transport models for interdiffusivity and shear viscosity converge and identify those in closest agreement with density functional theory benchmarks at temperatures in the warm dense matter regime. The present framework extends first-principles transport calculations to higher temperatures than previously achieved, and provides an efficient, scalable, and general approach for studying transport properties in complex multicomponent mixtures.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Machine learning-enhanced design of lead-free halide perovskite materials using density functional theory

The investigation of emerging non-toxic perovskite materials has been undertaken to advance the fabrication of environmentally sustainable lead-free perovskite solar cells. This study introduces a machine learning methodology aimed at predicting innovative halide perovskite materials that hold promise for use in photovoltaic applications. The seven newly predicted materials are as follows: CsMnCl 4 , Rb 3 Mn 2 Cl 9 , Rb 4 MnCl 6 , Rb 3 MnCl 5 , RbMn 2 Cl 7 , RbMn 4 Cl 9 , and CsIn 2 Cl 7 . The predicted compounds are first screened using a machine learning approach, and their validity is subsequently verified through density functional theory calculations. CsMnCl 4 is notable among them, displaying a bandgap of 1.37 eV, falling within the Shockley-Queisser limit, making it suitable for photovoltaic applications. Here, through the integration of machine learning and density functional theory, this study presents a methodology that is more effective and thorough for the discovery and design of materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Surrogate models for linear response

Linear response theory is a well-established method in physics and chemistry for exploring excitations of many-body systems. In particular, the quasiparticle random-phase approximation (QRPA) provides a powerful microscopic framework by building excitations on top of the mean-field vacuum; however, its high computational cost limits model calibration and uncertainty quantification studies. Here, we present two complementary QRPA surrogate models and apply them to study response functions of finite nuclei. One is a reduced-order model that exploits the underlying QRPA structure, while the other utilizes the recently developed parametric matrix model algorithm to construct a map between the system’s Hamiltonian and observables. Our benchmark applications, the calculation of the electric dipole polarizability of 180 Yb and the 𝛽-decay half-life of 80 Ni, show that both emulators can achieve 0.1%–1% accuracy while offering a 6–7 orders of magnitude speedup compared to state-of-the-art QRPA solvers. These results demonstrate that the developed QRPA emulators are well positioned to enable Bayesian calibration and large-scale studies of computationally expensive physics models describing the properties of many-body systems.

Beta decay↗
DOE OSTI2023

Double-Atom Catalysts Featuring Inverse Sandwich Structure for CO 2 Reduction Reaction: A Synergetic First-Principles and Machine Learning Investigation

Electrocatalytic CO 2 reduction reactions (CO 2 RR) based on scalable and highly efficient catalysis provide an attractive strategy for reducing CO 2 emissions. Here in this work, we combined first-principles density functional theory (DFT) and machine learning (ML) to comprehensively explore the potential of double-atom catalysts (DACs) featuring an inverse sandwich structure anchored on defective graphene (gra) to catalyze CO 2 RR to generate C 1 products. We started with five homonuclear M 2 ⊥gra (M = Co, Ni, Rh, Ir, and Pt), followed by 127 heteronuclear MM'⊥gra (M = Co, Ni, Rh, Ir, and Pt, M' = Sc–Au). Stable DACs were screened by evaluating their binding energy, formation energy, and dissolution potential of metal atoms, as well as conducting first-principles molecular dynamics simulations with and without solvent water molecules. Based on DFT calculations, Rh 2 ⊥gra DAC was found to outperform the other four homonuclear DACs and the Rh-based single- and double-atom catalysts of noninverse sandwich structures. Out of the 127 heteronuclear DACs, 14 were found to be stable and have good catalytic performance. An ML approach was adopted to correlate key factors with the activity and stability of the DACs, including the sum of radii of metal and ligand atoms (d M–M' , d M–C , and d M'–C ), the sum and difference of electronegativity of two metal atoms (P M + P M' , P M – P M '), the sum and difference of first ionization energy of two metal atoms (I M + I M' , I M – I M '), the sum and difference of electron affinity of two metal atoms (A M + A M' , A M – A M '), and the number of d-electrons of the two metal atoms (Nd). The obtained ML models were further used to predict 154 potential electrocatalysts out of 784 possible DACs featuring the same inverse sandwich configuration. Overall, this work not only identified promising CO 2 RR DACs featuring the reported inverse sandwich structure but also provided insights into key atomic characteristics associated with high CO 2 RR activity.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2023

Mapping out the thermodynamic stability of a QCD equation of state with a critical point using active learning

The Beam Energy Scan Theory (BEST) collaboration's equation of state (EoS) incorporates a three-dimensional Ising model critical point into the quantum chromodynamics (QCD) equation of state from lattice simulations. Furthermore, it contains four free parameters related to the size and location of the critical region in the QCD phase diagram. Certain combinations of the free parameters lead to acausal or unstable realizations of the EoS that should not be considered. In this work, we use an active learning framework to rule out pathological EoS efficiently. We find that checking stability and causality for a small portion of the parameters' range is sufficient to construct algorithms that perform with > 96 % accuracy across the entire parameter space. Though in this work we focus on a specific case, our approach can be generalized to any EoS containing a parameter space-class correspondence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗
DOE OSTI2024

Learning together: Towards foundation models for machine learning interatomic potentials with meta-learning

Abstract The development of machine learning models has led to an abundance of datasets containing quantum mechanical (QM) calculations for molecular and material systems. However, traditional training methods for machine learning models are unable to leverage the plethora of data available as they require that each dataset be generated using the same QM method. Taking machine learning interatomic potentials (MLIPs) as an example, we show that meta-learning techniques, a recent advancement from the machine learning community, can be used to fit multiple levels of QM theory in the same training process. Meta-learning changes the training procedure to learn a representation that can be easily re-trained to new tasks with small amounts of data. We then demonstrate that meta-learning enables simultaneously training to multiple large organic molecule datasets. As a proof of concept, we examine the performance of a MLIP refit to a small drug-like molecule and show that pre-training potentials to multiple levels of theory with meta-learning improves performance. This difference in performance can be seen both in the reduced error and in the improved smoothness of the potential energy surface produced. We therefore show that meta-learning can utilize existing datasets with inconsistent QM levels of theory to produce models that are better at specializing to new datasets. This opens new routes for creating pre-trained, foundation models for interatomic potentials.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Tunable Topological Phonon for Next-generation Quantum Transduction

This project aims to understand the critical factors that determine transduction performance of topological phonons across an oxide perovskite/tungsten diselenide heterojunction. We will investigate mechanisms of their propagation and interfacial coupling using modeling and machine learning approaches. Methods include density functional theory, molecular dynamics, numerical transport simulations, and active learning for building up a training dataset for force field development.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Organic Photovoltaic Efficiency Predictor: Data-Driven Models for Non-Fullerene Acceptor Organic Solar Cells

In the design of organic solar cells, there has been a need for materials with high power conversion efficiencies. Scharber’s model is commonly used to predict efficiency; however, it exhibits poor performance with new non-fullerene acceptor (NFA) devices, since it was designed for fullerene-based devices. In this work, an empirical model is proposed that can be a more accurate alternative for NFA organic solar cells. Additionally, many screening studies use computationally expensive methods. A model based on using semiempirical simplified time-dependent density functional theory (sTD-DFT) as an alternative method can accelerate the calculations and yield a similar accuracy. The models presented in this paper, termed organic photovoltaic efficiency predictor (OPEP) models, have shown significantly lower errors than previous models, with OPEP/B3LYP yielding errors of 1.53% and OPEP/sTD- DFT of 1.55%. As a result, the proposed computational models can be used for the fast and accurate screening of new high-efficiency NFAs/donor pairs.

14 SOLAR ENERGY↗
DOE OSTI2024

Density functional theory of material design: fundamentals and applications—II

Abstract This is the second and the final part of the review on density functional theory (DFT), referred to as DFT-II. In the first review, DFT-I, we have discussed wavefunction-based methods, their complexity, and basics of density functional theory. In DFT-II, we focus on fundamentals of DFT and their implications for the betterment of the theory. We start our presentation with the exact DFT results followed by the concept of exchange-correlation (xc) or Fermi-Coulomb hole and its relationship with xc energy functional. We also provide the exact conditions for the xc-hole, xc-energy and xc-potential along with their physical interpretation. Next, we describe the extension of DFT for non-integer number of electrons, the piecewise linearity of total energy and discontinuity of chemical potential at integer particle numbers, and derivative discontinuity of the xc potential, which has consequences on fundamental gap of solids. After that, we present how one obtains more accurate xc energy functionals by going beyond the LDA. We discuss the gradient expansion approximation (GEA), generalized gradient approximation (GGA), and hybrid functional approaches to designing better xc energy functionals that give accurate total energies. However, these functionals fail to predict properties like the ionization potential and the band gap. Thus, we next describe different methods of modelling these potentials and results of their application for calculation of the band gaps of different solids to highlight accuracy of different xc potentials. Finally, we conclude with a glimpse on orbital-free density functional theory and the machine learning approach.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Investigating 3,4-bis(3-nitrofurazan-4-yl)furoxan detonation with a rapidly tuned density functional tight binding model

In this work, we describe a machine learning approach to rapidly tune density functional tight binding models for the description of detonation chemistry in organic molecular materials. Resulting models enable simulations on the several 10s of ps scales characteristic to these processes, with “quantum-accuracy.” We use this approach to investigate early shock chemistry in 3,4-bis(3-nitrofurazan-4-yl)furoxan, a hydrogen-free energetic material known to form onion-like nanocarbon particulates following detonation. We find that the ensuing chemistry is significantly characterized by the formation of large C x N y O z species, which are likely precursors to the experimentally observed carbon condensates. Beyond utility as a means of investigating detonation chemistry, the present approach can be used to generate quantum-based reference data for the development of full machine-learned interatomic potentials capable of simulation on even greater time and length scales, i.e., for applications where characteristic time scales exceed the reach of methods including Kohn–Sham density functional theory, which are commonly used for reference data generation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Machine learning-accelerated path integral molecular dynamics simulations of reactive organic electrolytes

Hydrogen bonded electrolytes that exhibit accelerated proton transport via sequential reactive hops have drawn interest for their promise in clean energy applications. Molecular dynamics simulations of these electrolytes offer the opportunity to uncover microscopic mechanistic details that could be used to design and tune the properties of candidate electrolyte technologies. However, accurately modeling the proton transfer reactions and transport properties that give rise to high charge conductivites in these electrolytes proves computationally challenging because of the need to perform lengthy condensed phase simulations, treating both the electronic and nuclear degrees of freedom quantum mechanically. In this paper, we demonstrate that such a modeling task can be efficiently achieved with the use of density functional theory (DFT)-trained machine learning potentials (MLP) to accelerate path integral molecular dynamics (PIMD) simulations. We highlight the practical utility of this approach by using it to benchmark how closely PIMD simulations employing different DFT exchange–correlation functionals reproduce the composition-dependent densities, diffusion coefficients, and electrical conductivities of mixtures consisting of imidazole and levulinic acid. Even with the speedup afforded by our MLPs, PIMD simulations remain quite expensive. Furthermore, in order to render PIMD more computationally tractable, we introduce and benchmark the accuracy of a ring polymer contraction approach that leverages a computationally efficient short-range MLP to accelerate our PIMD simulations by an additional factor of four.

Chemical bonding↗