Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Exact constraints and appropriate norms in machine-learned exchange-correlation functionals

Machine learning techniques have received growing attention as an alternative strategy for developing general-purpose density functional approximations, augmenting the historically successful approach of human-designed functionals derived to obey mathematical constraints known for the exact exchange-correlation functional. More recently, efforts have been made to reconcile the two techniques, integrating machine learning and exact-constraint satisfaction. We continue this integrated approach, designing a deep neural network that exploits the exact constraint and appropriate norm philosophy to de-orbitalize the strongly constrained and appropriately normed (SCAN) functional. The deep neural network is trained to replicate the SCAN functional from only electron density and local derivative information, avoiding the use of the orbital-dependent kinetic energy density. The performance and transferability of the machine-learned functional are demonstrated for molecular and periodic systems.

Artificial neural networks↗

Nuclear Quantum Effects on the Electronic Structure of Water and Ice

The electronic properties and optical response of ice and water are intricately shaped by their molecular structure, including the quantum mechanical nature of the hydrogen atoms. Despite numerous previous studies, a comprehensive understanding of the nuclear quantum effects (NQEs) on the electronic structure of water and ice at finite temperatures remains elusive. Here, we utilize molecular simulations that harness efficient machine-learning potentials and many-body perturbation theory to assess how NQEs impact the electronic bands of water and hexagonal ice. By comparing path-integral and classical simulations, we find that NQEs lead to a larger renormalization of the fundamental gap of ice, compared to that of water, ultimately yielding similar bandgaps in the two systems, consistent with experimental estimates. Our calculations suggest that the increased quantum mechanical delocalization of protons in ice, relative to water, is a key factor leading to the enhancement of NQEs on the electronic structure of ice.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Li + /H + Exchange in Solid-State Oxide Li-Ion Conductors

Understanding the moisture stability of oxide Li-ion conductors is important for their practical applications in solid-state batteries. Unlike sulfide or halide conductors, oxide conductors generally better resist degradation when in contact with water but can still undergo topotactic Li + /H + exchange (LHX). Here, we combine density functional theory (DFT) calculations with a machine-learning interatomic potential model to investigate the thermodynamic driving force of the LHX reaction for two representative oxide Li-ion conductor families: garnets and NASICONs. Li-stuffed garnets exhibit a strong driving force for proton exchange due to their high Li chemical potential. In contrast, NASICONs demonstrate a higher resistance against proton exchange due to the lower Li chemical potential and the lower O–H bond covalency for polyanion-bonded oxygens. Our findings reveal a critical trade-off: Li stuffing enhances conductivity but increases moisture susceptibility. This study underscores the importance of designing Li-ion conductors that possess both high conductivity and high stability in practical environments.

Li, Zhuohan [Lawrence Berkeley National Laboratory↗

Uncovering the True Active Sites in Ni–N–C Catalysts for CO 2 Electroreduction

Understanding and designing active sites in single-atom catalysts (SACs) requires going beyond static models to capture their dynamic evolution under realistic electrochemical conditions. Here, in this work, we develop an integrated theoretical framework that accounts for operational conditions, by combining grand canonical density functional theory (GC-DFT) with machine-learning-accelerated sampling, to uncover structure–activity–stability relationships in Ni–N–C SACs for the CO 2 reduction reaction (CO 2 RR). A library of NiN x C 4–x (x = 0–4) motifs─representing coordination defects likely formed during high-temperature synthesis─was systematically evaluated. Under working conditions, these sites were found to undergo hydrogenation, and NiN 3 C 1_ H 1 was identified as the most probable active site. At reducing potentials, hydrogen adsorbs spontaneously at C–Ni bridge sites rather than Ni top sites, while subsurface hydrogen facilitates bent CO 2 adsorption crucial for activation. High CO 2 RR selectivity toward CO arises from site separation: Ni centers drive CO2RR, while the hydrogen evolution reaction (HER) occurs at the C–Ni bridge or N sites and from thermodynamic suppression of HER at moderate hydrogen coverage. At more negative potentials, a shift in the CO 2 RR rate-determining process (RDP) and Ni out-of-surface displacement induced by coadsorption of H and H 2 O jointly reduce activity and selectivity. Thus, both the high CO2RR selectivity of Ni–N–C catalysts and its reversal with more negative potentials can be rationalized by accounting for hydrogenated surfaces. This highlights the necessity of modeling realistic; in situ conditions. This framework provides generalizable insights into the dynamic behavior of active sites in SACs, offering guidance for the rational design of active and robust catalysts for a wide range of electrochemical reactions.

25 ENERGY STORAGE↗

Computing chemical potentials with machine-learning-accelerated simulations to accurately predict thermodynamic properties of molten salts

The successful design and deployment of next-generation nuclear technologies heavily rely on thermodynamic data for relevant molten salt systems. However, the lack of accurate force fields and efficient methods has limited the quality of thermodynamic predictions from atomistic simulations. Here we propose an efficient free energy framework for computing chemical potentials, which is the central free energy quantity behind many thermodynamic properties. We accelerate our simulations without sacrificing accuracy by using machine learning interatomic potentials trained on density functional theory (DFT) data. Using lithium chloride as our model system, we compute chemical potentials with DFT-accuracy for solid and liquid phases by transmuting ions into noninteracting particles. Notably, in the liquid phase, we demonstrate consistency whether we transmute one ion pair or the entire system into ideal gas particles. By locating the temperature where the chemical potential of solid and liquid phases cross, we predict a melting point of 880 ± 18 K for lithium chloride, which is remarkably close to the experimental value of 883 K. With this successful demonstration, we lay the foundation for high-throughput thermodynamic predictions of many properties that can be derived from the chemical potentials of the minority and majority components in molten salts.

Gibson, Luke D. [Oak Ridge National Laboratory (OR↗

Secondary structure determines electron transport in peptides

Proteins play a key role in biological electron transport, but the structure–function relationships governing the electronic properties of peptides are not fully understood. Despite recent progress, understanding the link between peptide conformational flexibility, hierarchical structures, and electron transport pathways has been challenging. Here, we use single-molecule experiments, molecular dynamics (MD) simulations, nonequilibrium Green’s function-density functional theory (NEGF-DFT), and unsupervised machine learning to understand the role of secondary structure on electron transport in peptides. Our results reveal a two-state molecular conductance behavior for peptides across several different amino acid sequences. MD simulations and Gaussian mixture modeling are used to show that this two-state molecular conductance behavior arises due to the conformational flexibility of peptide backbones, with a high-conductance state arising due to a more defined secondary structure (beta turn or 3 10 helices) and a low-conductance state occurring for extended peptide structures. These results highlight the importance of helical conformations on electron transport in peptides. Conformer selection for the peptide structures is rationalized using principal component analysis of intramolecular hydrogen bonding distances along peptide backbones. Molecular conformations from MD simulations are used to model charge transport in NEGF-DFT calculations, and the results are in reasonable qualitative agreement with experiments. Projected density of states calculations and molecular orbital visualizations are further used to understand the role of amino acid side chains on transport. Overall, our results show that secondary structure plays a key role in electron transport in peptides, which provides broad avenues for understanding the electronic properties of proteins.

Science & Technology - Other Topics↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Predicting initial dissolution rates using structural features from molecular dynamics simulations

Predicting chemical durability of glass materials is important for various applications from daily life such as drink glass and kitchen ware to advanced technologies such as nuclear waste disposal and biomedicine. In this work, we explored prediction of initial dissolution rate through structural features from molecular dynamics (MD) simulations for a wide range of glass compositions (total 28) including borosilicate and aluminosilicate glasses, ZrO 2 -containing and V 2 O 5 -containing boroaluminosilicate glasses. The initial dissolution rates (r 0 ) measured experimentally at 90 °C with varying solution conditions were correlated with structural features (e.g., polyhedral linkages and non-bridging oxygen species) obtained from MD simulations, either from this study or from literature. Since hydrolysis of the glass network through breaking of the network former linkages (e.g., Si-O-Si, Si-O-Al, etc.) is a critical step of network glass dissolution, the statistics of these linkages obtained from MD were correlated to r0 through linear regression, where the coefficient of determination (R 2 ) and root mean square error are found to be 0.949 and 0.681, respectively. This model was compared and discussed with existing models developed by various approaches including machine learning, the kinetic rate equation, topological constraint theory, and other descriptors from MD simulations. The discussion provides insights on future model improvements to predict glass dissolution. In addition, the impact of V 2 O 5 on the glass dissolution was examined in detail, implicating that the impact is not the same across all glass compositions and test conditions.

36 MATERIALS SCIENCE↗

Intelligent control based on fuzzy logic and neural net theory

In the conception and design of intelligent systems, one promising direction involves the use of fuzzy logic and neural network theory to enhance such systems' capability to learn from experience and adapt to changes in an environment of uncertainty and imprecision. Here, an intelligent control scheme is explored by integrating these multidisciplinary techniques. A self-learning system is proposed as an intelligent controller for dynamical processes, employing a control policy which evolves and improves automatically. One key component of the intelligent system is a fuzzy logic-based system which emulates human decision making behavior. It is shown that the system can solve a fairly difficult control learning problem. Simulation results demonstrate that improved learning performance can be achieved in relation to previously described systems employing bang-bang control. The proposed system is relatively insensitive to variations in the parameters of the system environment.

Lee, Chuen-Chien↗

Data Mining at NASA: From Theory to Applications

This slide presentation demonstrates the data mining/machine learning capabilities of NASA Ames and Intelligent Data Understanding (IDU) group. This will encompass the work done recently in the group by various group members. The IDU group develops novel algorithms to detect, classify, and predict events in large data streams for scientific and engineering systems. This presentation for Knowledge Discovery and Data Mining 2009 is to demonstrate the data mining/machine learning capabilities of NASA Ames and IDU group. This will encompass the work done re cently in the group by various group members.

Srivastava, Ashok N.↗

Contrasting Size Distributions of Chondrules and Inclusions in Allende CV3

There are several leading theories on the processes that led to the formation of chondrites, e.g., sorting by mass, by X-winds, turbulent concentration, and by photophoresis. The juxtaposition of refractory inclusions (CAIs) and less refractory chondrules is central to these theories and there is much to be learned from their relative size distributions. There have been a number of studies into size distributions of particles in chondrites but only on relatively small scales primarily for chondrules, and rarely for both Calcium Aluminum-rich Inclusions (CAIs) and chondrules in the same sample. We have implemented macro-scale (25 cm diameter sample) and high-resolution microscale sampling of the Allende CV3 chondrite to create a complete data set of size frequencies for CAIs and chondrules.

Fisher, Kent R.↗

Machine learning interatomic potential for predicting the thermal properties of uranium nitride

We present a combined computational and experimental investigation of the thermal properties of uranium nitride (UN), focusing on the development of a machine learning interatomic potential (MLIP) using the moment tensor potential framework. The MLIP was trained on density functional theory (DFT) data and validated against various quantities including energies, forces, elastic constants, phonon dispersion, and defect formation energies, achieving excellent agreement with DFT calculations, prior experimental results, and our thermal conductivity measurement. The potential was then employed in molecular dynamics simulations to predict key thermal properties such as melting point, thermal expansion, specific heat, and lattice thermal conductivity. To further assess model accuracy, we fabricated a UN sample and performed new thermal conductivity measurements representative of single-crystal properties, which showed strong agreement with the MLIP predictions. This work confirms the reliability and predictive capability of the developed potential for determining the thermal properties of UN.

36 - MATERIALS SCIENCE↗

On-shell correlators and color-kinematics duality in curved symmetric spacetimes

We define a perturbatively calculable quantity — the on-shell correlator — which furnishes a unified description of particle dynamics in curved spacetime. Specializing to the case of flat and anti-de Sitter space, on-shell correlators coincide precisely with on-shell scattering amplitudes and boundary correlators, respectively. Remarkably, we find that symmetric manifolds admit a generalization of on-shell kinematics in which the corresponding momenta are literally the isometry generators of the spacetime acting on the external kinematic data. These isometric momenta are intrinsically non-commutative but exhibit on-shell conditions that are identical to those of flat space, thus providing a common language for computing and representing on-shell correlators which is agnostic about the underlying geometry. Afterwards, we compute tree-level on-shell correlators for biadjoint scalar (BAS) theory and the nonlinear sigma model (NLSM) and learn that color-kinematics duality is manifested at the level of fields under a mapping of the color algebra to the algebra of gauged isometries on the spacetime manifold. Last but not least, we present a field theoretic derivation of the fundamental BCJ relations for on-shell correlators following from the existence of certain conserved currents in BAS theory and the NLSM.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fluorine spillover for ceria- vs silica-supported palladium nanoparticles: A MD study using machine learning potentials

Supported metallic nanoparticles play a central role in catalysis. However, predictive modeling is particularly challenging due to the structural and dynamic complexity of the nanoparticle and its interface with the support, given that the sizes of interest are often well beyond those accessible via traditional ab initio methods. With recent advances in machine learning, it is now feasible to perform MD simulations with potentials retaining near-density-functional theory (DFT) accuracy, which can elucidate the growth and relaxation of supported metal nanoparticles, as well as reactions on those catalysts, at temperatures and time scales approaching those relevant to experiments. Furthermore, the surfaces of the support materials can also be modeled realistically through simulated annealing to include effects such as defects and amorphous structures. We study the adsorption of fluorine atoms on ceria and silica supported palladium nanoparticles using machine learning potential trained by DFT data using the DeePMD framework. We show defects on ceria and Pd/ceria interfaces are crucial for the initial adsorption of fluorine, while the interplay between Pd and ceria and the reverse oxygen migration from ceria to Pd control spillover of fluorine from Pd to ceria at later stages. In contrast, silica supports do not induce fluorine spillover from Pd particles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Applications of Nickelate perovskites for neuromorphic computing from electronic structure and Machine Learning

While the limit of Moore's law is presently being reached with current microelectronic technologies, we need to develop new paradigms that overcome this limitation. In that respect, neuromorphic computing is a concept that emulates the neural behavior and response of the human brain, and it has been recognized as a promising alternative approach. In this research project, we will perform multi-fidelity scale bridging to explore the potential use of materials with metal to insulator transition for neuromorphic applications. In particular, rare earth nickelates are promising for such purposes, as the transition in these materials is quite sensitive to a broad set of different external stimuli. Our multi-fidelity approach will bridge the high-fidelity electronic structure calculations with classical potentials. We will bridge dynamical mean field theory with a classical atomistic representation via a deep learning force field. The neural network is trained with energies, charges, and forces obtained by accurate electronic structure theories based on Dynamical Mean Field Theory. The configurational space is generated from known crystal phases, ab initio molecular dynamics with exchange-correlation functionals corrected with the Hubbard model, disordered phases with different concentrations of oxygen vacancies, and nonsymmetrical positions and induced strain by grain interfaces or contact with a substrate. Strategies to train the model with a reduced number of training examples are obtained from active learning methods, and new structures for improving the learning process are generated by using machine learning autoencoders. This classical potential will be validated through a diversity of electronic structure methods and represents an important step to combine the flexibility and accuracy of first-principles with the speed of classical potentials. The generated multi-fidelity surrogate model will be used to understand the role of strain, oxygen vacancies, proton doping, the variation of the crystal phase, substrate effects, vibrational effects as the octahedral rotation, grain boundaries and defect effects on the response of a Metal to Insulator Transition (MIT) in correlated materials. Long time and large-scale simulations will help understand the role of different stimuli to control the hysteresis of the MIT, as it has been experimentally suggested. Selected configurations will be analyzed with higher-level theories to provide an accurate electronic description and to study how the orbitals and charges are rearranged under different conditions.

36 MATERIALS SCIENCE↗

Graph reinforcement learning for exploring model spaces beyond the standard model

We present a methodology for performing scans of beyond the standard model (BSM) parameter spaces with reinforcement learning. We identify a novel procedure using graph neural networks that is capable of exploring spaces of models without the user specifying a fixed particle content, allowing broad classes of BSM models to be explored—in theory, the technique is applicable to nearly any model space with a prespecified gauge group. We provide a generic procedure by which a suitable graph grammar can be developed for any BSM model that features user-specified symmetry groups and a finite number of different possible particle species, the use of which is applicable to a variety of machine learning tasks over the actions of BSM theories beyond our particular reinforcement learning use case. As a proof of concept, we construct the graph grammar for theories with vectorlike leptons that may or may not be charged under a dark U ( 1 ) group, inspired by portal matter extensions of the sub-GeV vector portal/kinetic mixing simplified dark matter models. We then use this graph grammar to create a reinforcement learning environment tasked with creating models with these vectorlike leptons that are consistent with a list of a variety of precision observables. The reinforcement learning agent succeeds in developing models that can address the observed muon anomalous magnetic moment discrepancy while remaining consistent with flavor violation and electroweak precision observables, including both constructions that have previously been studied as well as new models that have not, to our knowledge, previously been identified. By inspecting the resulting ensembles of models that the agent produces and experimenting with different configurations for our reinforcement learning environment and graph grammar, we also infer various lessons about the development of these environments that can be transferable to reinforcement learning scans of more complicated model spaces and comment on future directions for the development of this technique into a more mature tool. Published by the American Physical Society 2025

Wojcik, George N.↗

Augmenting Molecular Graphs with Geometries via Machine Learning Interatomic Potentials

Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine learning interatomic potential (MLIP) models. To this end, we first curate a large-scale molecular relaxation dataset comprising 3.5 million molecules and 300 million snapshots. Then MLIP pre-trained models are trained with supervised learning to predict energy and forces given 3D molecular structures. Once trained, we show that the pre-trained models can be used in different ways to obtain geometries either explicitly or implicitly. First, it can be used to obtain approximate low-energy 3D geometries via geometry optimization. While these geometries do not consistently reach DFT-level chemical accuracy or convergence, they can still improve downstream performance compared to non-relaxed structures. To mitigate potential biases and enhance downstream predictions, we introduce geometry fine-tuning based on the relaxed 3D geometries. Second, the pre-trained models can be directly fine-tuned for property prediction when ground truth 3D geometries are available. Our results demonstrate that MLIP pre-trained models trained on relaxation data can learn transferable molecular representations to improve downstream molecular property prediction and can provide practically valuable but approximate molecular geometries that benefit property predictions. Our code is publicly available at: https://github.com/divelab/AIRS/.

Fu, Cong [Texas A & M Univ., College Station, TX (↗