Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Secondary structure determines electron transport in peptides

Proteins play a key role in biological electron transport, but the structure–function relationships governing the electronic properties of peptides are not fully understood. Despite recent progress, understanding the link between peptide conformational flexibility, hierarchical structures, and electron transport pathways has been challenging. Here, we use single-molecule experiments, molecular dynamics (MD) simulations, nonequilibrium Green’s function-density functional theory (NEGF-DFT), and unsupervised machine learning to understand the role of secondary structure on electron transport in peptides. Our results reveal a two-state molecular conductance behavior for peptides across several different amino acid sequences. MD simulations and Gaussian mixture modeling are used to show that this two-state molecular conductance behavior arises due to the conformational flexibility of peptide backbones, with a high-conductance state arising due to a more defined secondary structure (beta turn or 3 10 helices) and a low-conductance state occurring for extended peptide structures. These results highlight the importance of helical conformations on electron transport in peptides. Conformer selection for the peptide structures is rationalized using principal component analysis of intramolecular hydrogen bonding distances along peptide backbones. Molecular conformations from MD simulations are used to model charge transport in NEGF-DFT calculations, and the results are in reasonable qualitative agreement with experiments. Projected density of states calculations and molecular orbital visualizations are further used to understand the role of amino acid side chains on transport. Overall, our results show that secondary structure plays a key role in electron transport in peptides, which provides broad avenues for understanding the electronic properties of proteins.

Science & Technology - Other Topics↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Predicting initial dissolution rates using structural features from molecular dynamics simulations

Predicting chemical durability of glass materials is important for various applications from daily life such as drink glass and kitchen ware to advanced technologies such as nuclear waste disposal and biomedicine. In this work, we explored prediction of initial dissolution rate through structural features from molecular dynamics (MD) simulations for a wide range of glass compositions (total 28) including borosilicate and aluminosilicate glasses, ZrO 2 -containing and V 2 O 5 -containing boroaluminosilicate glasses. The initial dissolution rates (r 0 ) measured experimentally at 90 °C with varying solution conditions were correlated with structural features (e.g., polyhedral linkages and non-bridging oxygen species) obtained from MD simulations, either from this study or from literature. Since hydrolysis of the glass network through breaking of the network former linkages (e.g., Si-O-Si, Si-O-Al, etc.) is a critical step of network glass dissolution, the statistics of these linkages obtained from MD were correlated to r0 through linear regression, where the coefficient of determination (R 2 ) and root mean square error are found to be 0.949 and 0.681, respectively. This model was compared and discussed with existing models developed by various approaches including machine learning, the kinetic rate equation, topological constraint theory, and other descriptors from MD simulations. The discussion provides insights on future model improvements to predict glass dissolution. In addition, the impact of V 2 O 5 on the glass dissolution was examined in detail, implicating that the impact is not the same across all glass compositions and test conditions.

36 MATERIALS SCIENCE↗

Machine learning interatomic potential for predicting the thermal properties of uranium nitride

We present a combined computational and experimental investigation of the thermal properties of uranium nitride (UN), focusing on the development of a machine learning interatomic potential (MLIP) using the moment tensor potential framework. The MLIP was trained on density functional theory (DFT) data and validated against various quantities including energies, forces, elastic constants, phonon dispersion, and defect formation energies, achieving excellent agreement with DFT calculations, prior experimental results, and our thermal conductivity measurement. The potential was then employed in molecular dynamics simulations to predict key thermal properties such as melting point, thermal expansion, specific heat, and lattice thermal conductivity. To further assess model accuracy, we fabricated a UN sample and performed new thermal conductivity measurements representative of single-crystal properties, which showed strong agreement with the MLIP predictions. This work confirms the reliability and predictive capability of the developed potential for determining the thermal properties of UN.

36 - MATERIALS SCIENCE↗

On-shell correlators and color-kinematics duality in curved symmetric spacetimes

We define a perturbatively calculable quantity — the on-shell correlator — which furnishes a unified description of particle dynamics in curved spacetime. Specializing to the case of flat and anti-de Sitter space, on-shell correlators coincide precisely with on-shell scattering amplitudes and boundary correlators, respectively. Remarkably, we find that symmetric manifolds admit a generalization of on-shell kinematics in which the corresponding momenta are literally the isometry generators of the spacetime acting on the external kinematic data. These isometric momenta are intrinsically non-commutative but exhibit on-shell conditions that are identical to those of flat space, thus providing a common language for computing and representing on-shell correlators which is agnostic about the underlying geometry. Afterwards, we compute tree-level on-shell correlators for biadjoint scalar (BAS) theory and the nonlinear sigma model (NLSM) and learn that color-kinematics duality is manifested at the level of fields under a mapping of the color algebra to the algebra of gauged isometries on the spacetime manifold. Last but not least, we present a field theoretic derivation of the fundamental BCJ relations for on-shell correlators following from the existence of certain conserved currents in BAS theory and the NLSM.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fluorine spillover for ceria- vs silica-supported palladium nanoparticles: A MD study using machine learning potentials

Supported metallic nanoparticles play a central role in catalysis. However, predictive modeling is particularly challenging due to the structural and dynamic complexity of the nanoparticle and its interface with the support, given that the sizes of interest are often well beyond those accessible via traditional ab initio methods. With recent advances in machine learning, it is now feasible to perform MD simulations with potentials retaining near-density-functional theory (DFT) accuracy, which can elucidate the growth and relaxation of supported metal nanoparticles, as well as reactions on those catalysts, at temperatures and time scales approaching those relevant to experiments. Furthermore, the surfaces of the support materials can also be modeled realistically through simulated annealing to include effects such as defects and amorphous structures. We study the adsorption of fluorine atoms on ceria and silica supported palladium nanoparticles using machine learning potential trained by DFT data using the DeePMD framework. We show defects on ceria and Pd/ceria interfaces are crucial for the initial adsorption of fluorine, while the interplay between Pd and ceria and the reverse oxygen migration from ceria to Pd control spillover of fluorine from Pd to ceria at later stages. In contrast, silica supports do not induce fluorine spillover from Pd particles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Applications of Nickelate perovskites for neuromorphic computing from electronic structure and Machine Learning

While the limit of Moore's law is presently being reached with current microelectronic technologies, we need to develop new paradigms that overcome this limitation. In that respect, neuromorphic computing is a concept that emulates the neural behavior and response of the human brain, and it has been recognized as a promising alternative approach. In this research project, we will perform multi-fidelity scale bridging to explore the potential use of materials with metal to insulator transition for neuromorphic applications. In particular, rare earth nickelates are promising for such purposes, as the transition in these materials is quite sensitive to a broad set of different external stimuli. Our multi-fidelity approach will bridge the high-fidelity electronic structure calculations with classical potentials. We will bridge dynamical mean field theory with a classical atomistic representation via a deep learning force field. The neural network is trained with energies, charges, and forces obtained by accurate electronic structure theories based on Dynamical Mean Field Theory. The configurational space is generated from known crystal phases, ab initio molecular dynamics with exchange-correlation functionals corrected with the Hubbard model, disordered phases with different concentrations of oxygen vacancies, and nonsymmetrical positions and induced strain by grain interfaces or contact with a substrate. Strategies to train the model with a reduced number of training examples are obtained from active learning methods, and new structures for improving the learning process are generated by using machine learning autoencoders. This classical potential will be validated through a diversity of electronic structure methods and represents an important step to combine the flexibility and accuracy of first-principles with the speed of classical potentials. The generated multi-fidelity surrogate model will be used to understand the role of strain, oxygen vacancies, proton doping, the variation of the crystal phase, substrate effects, vibrational effects as the octahedral rotation, grain boundaries and defect effects on the response of a Metal to Insulator Transition (MIT) in correlated materials. Long time and large-scale simulations will help understand the role of different stimuli to control the hysteresis of the MIT, as it has been experimentally suggested. Selected configurations will be analyzed with higher-level theories to provide an accurate electronic description and to study how the orbitals and charges are rearranged under different conditions.

36 MATERIALS SCIENCE↗

Graph reinforcement learning for exploring model spaces beyond the standard model

We present a methodology for performing scans of beyond the standard model (BSM) parameter spaces with reinforcement learning. We identify a novel procedure using graph neural networks that is capable of exploring spaces of models without the user specifying a fixed particle content, allowing broad classes of BSM models to be explored—in theory, the technique is applicable to nearly any model space with a prespecified gauge group. We provide a generic procedure by which a suitable graph grammar can be developed for any BSM model that features user-specified symmetry groups and a finite number of different possible particle species, the use of which is applicable to a variety of machine learning tasks over the actions of BSM theories beyond our particular reinforcement learning use case. As a proof of concept, we construct the graph grammar for theories with vectorlike leptons that may or may not be charged under a dark U ( 1 ) group, inspired by portal matter extensions of the sub-GeV vector portal/kinetic mixing simplified dark matter models. We then use this graph grammar to create a reinforcement learning environment tasked with creating models with these vectorlike leptons that are consistent with a list of a variety of precision observables. The reinforcement learning agent succeeds in developing models that can address the observed muon anomalous magnetic moment discrepancy while remaining consistent with flavor violation and electroweak precision observables, including both constructions that have previously been studied as well as new models that have not, to our knowledge, previously been identified. By inspecting the resulting ensembles of models that the agent produces and experimenting with different configurations for our reinforcement learning environment and graph grammar, we also infer various lessons about the development of these environments that can be transferable to reinforcement learning scans of more complicated model spaces and comment on future directions for the development of this technique into a more mature tool. Published by the American Physical Society 2025

Wojcik, George N.↗

Augmenting Molecular Graphs with Geometries via Machine Learning Interatomic Potentials

Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine learning interatomic potential (MLIP) models. To this end, we first curate a large-scale molecular relaxation dataset comprising 3.5 million molecules and 300 million snapshots. Then MLIP pre-trained models are trained with supervised learning to predict energy and forces given 3D molecular structures. Once trained, we show that the pre-trained models can be used in different ways to obtain geometries either explicitly or implicitly. First, it can be used to obtain approximate low-energy 3D geometries via geometry optimization. While these geometries do not consistently reach DFT-level chemical accuracy or convergence, they can still improve downstream performance compared to non-relaxed structures. To mitigate potential biases and enhance downstream predictions, we introduce geometry fine-tuning based on the relaxed 3D geometries. Second, the pre-trained models can be directly fine-tuned for property prediction when ground truth 3D geometries are available. Our results demonstrate that MLIP pre-trained models trained on relaxation data can learn transferable molecular representations to improve downstream molecular property prediction and can provide practically valuable but approximate molecular geometries that benefit property predictions. Our code is publicly available at: https://github.com/divelab/AIRS/.

Fu, Cong [Texas A & M Univ., College Station, TX (↗

Learning continuous models for continuous physics

Abstract Dynamical systems that evolve continuously over time are ubiquitous throughout science and engineering. Machine learning (ML) provides data-driven approaches to model and predict the dynamics of such systems. A core issue with this approach is that ML models are typically trained on discrete data, using ML methodologies that are not aware of underlying continuity properties. This results in models that often do not capture any underlying continuous dynamics—either of the system of interest, or indeed of any related system. To address this challenge, we develop a convergence test based on numerical analysis theory. Our test verifies whether a model has learned a function that accurately approximates an underlying continuous dynamics. Models that fail this test fail to capture relevant dynamics, rendering them of limited utility for many scientific prediction tasks; while models that pass this test enable both better interpolation and better extrapolation in multiple ways. Our results illustrate how principled numerical analysis methods can be coupled with existing ML training/testing methodologies to validate models for science and engineering applications.

97 MATHEMATICS AND COMPUTING↗

Uncovering turbulent plasma dynamics via deep learning from partial observations

One of the most intensely studied aspects of magnetic confinement fusion is edge plasma turbulence which is critical to reactor performance and operation. Drift-reduced Braginskii two-fluid theory has for decades been widely applied to model boundary plasmas with varying success. Towards better understanding edge turbulence in both theory and experiment, we demonstrate that a novel multi-network physics-informed deep learning framework constrained by partial differential equations can accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure which is not otherwise possible using conventional equilibrium models. Furthermore, this technique presents a novel paradigm for the advanced design of plasma diagnostics and validation of magnetized plasma turbulence theories in challenging thermonuclear environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Uncovering turbulent plasma dynamics via deep learning from partial observations

One of the most intensely studied aspects of magnetic confinement fusion is edge plasma turbulence which is critical to reactor performance and operation. Drift-reduced Braginskii two-fluid theory has for decades been widely applied to model boundary plasmas with varying success. Towards better understanding edge turbulence in both theory and experiment, we demonstrate that a novel multi-network physics-informed deep learning framework constrained by partial differential equations can accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure which is not otherwise possible using conventional equilibrium models. This technique presents a novel paradigm for the advanced design of plasma diagnostics and validation of magnetized plasma turbulence theories in challenging thermonuclear environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Effect of Zn Addition on Phase Evolution in AlCrFeCoNiZn High–Entropy Alloy

The addition of Zn to AlCrFeCoNi high-entropy alloy (HEA) poses intriguing questions as to how it would affect phase evolution. Herein, the phase evolution in AlCrFeCoNiZn is studied using a combination of experimental techniques (X-ray diffraction, scanning electron microscopy, energy-dispersive spectroscopy, and differential scanning calorimetry) and computational (density-functional theory [DFT], calculation of phase diagrams, and machine-learning) methods. Mechanically alloyed and spark-plasma-sintered AlCrFeCoNiZn assumes a metastable single-phase, body-centered-cubic (BCC) structure that undergoes diffusion-controlled phase separation upon subsequent heat treatment to form separate (Al, Cr)-rich, (Fe, Co)-rich, and (Zn, Ni)-rich phases. The formation of (Al, Cr)-rich phase, not reported previously in AlCrFeCoNi-based HEAs, is attributed to strong clustering tendency of Cr–Zn and Cr–Ni pairs, combined with the strong ordering of Zn–Ni pair, driving out Cr that in turn combines with Al to form a (Al, Cr)-rich phase. In the DFT results, the formation of thermodynamically stable L1 2 phase is shown wherein Cr–Fe–Zn [Al–Ni-Co] preferably occupy1a (000) [3c (0 ½ ½)] positions. Furthermore, the sluggish diffusional transformation to L1 2 phase from BCC precursors is attributed to the small stacking-fault energy of AlCrFeCoNiZn. The equilibrated HEA exhibits a high microhardness of 8.24 GPa with an elastic modulus of 184 GPa.

36 MATERIALS SCIENCE↗

Machine learning guided prediction of solute segregation at coherent and semi-coherent metal/oxide interfaces

Investigation of semi-coherent metal/oxide interfaces with misfit dislocations using density functional theory (DFT) is computationally intensive to the point of being prohibitive, as it involves several hundreds to many thousands of atoms. In this study, we examined the solute segregation behavior at the Fe/Y 2 O 3 interface—a model interface for cladding applications in nuclear fission reactors—using a combination of DFT calculations and machine learning (ML) approaches. Both coherent and semi-coherent interfaces were considered. ML models were trained on DFT-calculated segregation energies to identify the key chemical, geometric and strain energy related features that govern solute segregation behavior at coherent Fe/Y 2 O 3 interfaces. Furthermore, it was found that ML models when trained on DFT calculated segregation energy of elements at a coherent interface, comprising of about a hundred-atom supercell, can predict the segregation energy of elements at a semi-coherent Fe/Y 2 O 3 interface (with multiple hundreds of atoms) at a fraction of computational cost (1/35th), with an accuracy comparable to DFT calculations.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Facet-dependent structure and dissociation of water at pristine IrO 2 /water interfaces

Understanding the microscopic structure of water at metal oxide interfaces is crucial for advancing electrocatalysis. IrO 2 , specifically, has shown exceptional activity for electrochemical water oxidation, but we currently lack a fundamental understanding of how the surface structure of IrO 2 impacts water reactivity. In this work, we developed a machine learning potential trained to first-principles accuracy for modeling IrO 2 /water interfaces across different facets: (110), (100), (101), and (001). Using extensive machine learning molecular dynamics simulations, we investigated the spontaneous dissociation of water molecules at these interfaces. Our results reveal a distinct dissociation probability trend: (110) > (100) ≈ (101) > (001), which we attribute primarily to the reaction thermodynamics of surface water dissociation. A strong correlation is observed between the surface Ir–O bond distances and the dissociation probabilities, highlighting the role of surface geometry in modulating reactivity. As a consequence, the interfacial solvation structures and hydrogen bonding environments are dynamically tuned by the varying water dissociation capabilities across facets. This work elucidates how water dissociation energetics depend on surface orientation and interfacial structure, offering atomistic insights into manipulating reaction chemistry at electrocatalytic interfaces.

organic↗

Interpretable machine learning-guided design of Fe-based soft magnetic alloys

Here, we present a machine learning (ML) guided approach to predict saturation magnetization (𝑀 S ) and coercivity (𝐻 C ) in Fe-rich soft magnetic alloys, particularly Fe-Si-B systems. ML models trained on experimental data reveal that increasing Si and B content reduces 𝑀 S from 1.81 T (DFT ≈ 2.04 T) to ≈1.54 T (DFT ≈ 1.56T) in Fe-Si-B, which is attributed to decreased magnetic density and structural modifications. Experimental validation of ML predicted magnetic saturation on Fe-1Si-1B (2.09 T), Fe-5Si-5B (2.01 T), and Fe-10Si-10B (1.54 T) alloy compositions further supports our findings. These trends are consistent with density functional theory predictions, which link increased electronic disorder and band broadening to lower 𝑀 S values. Experimental validation on selected alloys confirms the predictive accuracy of the ML model, with good agreement across compositions. Beyond predictive accuracy, detailed uncertainty quantification and model interpretability including through feature importance and partial dependence analysis reveal that 𝑀 S is governed by a nonlinear interplay between Fe content and early transition metal ratios, while 𝐻 C is more sensitive to processing conditions such as ribbon thickness and thermal treatment windows. The ML framework was further applied to Fe-Si-B/Cr/Cu/Zr/Nb alloys in a pseudoquaternary compositional space, which shows comparable magnetic properties to NANOMET (Fe 84.8 ⁢Si 0.5 ⁢B 9.4 ⁢Cu 0.8⁢ P 3.5 ⁢C 1 ), FINEMET (Fe 73.5 ⁢Si 13.5 ⁢B 9 Cu 1 ⁢Nb 3 ), NANOPERM (Fe 88 ⁢Zr 7⁢ B 4 ⁢Cu 1 ), and HITPERM (Fe 44 ⁢Co 44 ⁢Zr 7⁢ B 4 ⁢Cu 1 . Our findings demonstrate the potential of the ML framework for accelerated search of high-performance soft magnetic materials.

density functional theory↗

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗

Deep learning insights into cosmological structure formation

The evolution of linear initial conditions present in the early Universe into extended halos of dark matter at late times can be computed using cosmological simulations. However, a theoretical understanding of this complex process remains elusive; in particular, the role of anisotropic information in the initial conditions in establishing the final mass of dark matter halos remains a long-standing puzzle. Here, we build a deep learning framework to investigate this question. We train a three-dimensional convolutional neural network to predict the mass of dark matter halos from the initial conditions, and quantify in full generality the amounts of information in the isotropic and anisotropic aspects of the initial density field about final halo masses. We find that anisotropies add a small, albeit statistically significant amount of information over that contained within spherical averages of the density field about final halo mass. However, the overall scatter in the final mass predictions does not change qualitatively with this additional information, only decreasing from 0.9 dex to 0.7 dex. Given such a small improvement, our results demonstrate that isotropic aspects of the initial density field essentially saturate the relevant information about final halo mass. Therefore, instead of searching for information directly encoded in initial conditions anisotropies, a more promising route to accurate, fast halo mass predictions is to add approximate dynamical information based e.g. on perturbation theory. More broadly, our results indicate that deep learning frameworks can provide a powerful tool for extracting physical insight into cosmological structure formation. Published by the American Physical Society 2024

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗