Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Machine learning reveals factors that control ion mobility in anti-perovskite solid electrolytes

Solid-state batteries are projected to exhibit improved energy densities and safety compared to liquid-electrolyte-based systems. Consequently, the development of solid electrolytes that can conduct cations at rates comparable to that of liquid electrolytes is an active area of research. To facilitate this search it is desirable to understand the chemical and structural features that control ion transport through a crystalline lattice. Here, machine learning (ML) is used to identify features that influence ion mobility in solids, quantify the relative importance of those features, and demonstrate how the variation of individual features alters ion mobility. Adopting the anti-perovskite lattice as a model system, ML algorithms were trained to predict migration barriers from a data set containing hundreds of barriers calculated using density functional theory. In this study, more than 10 6 feature sets of non-redundant descriptors were evaluated for their ability to predict migration barriers. The present analysis correctly reiterates the importance of several features that are known to influence mobility – for example, anion polarizability – but also identifies others whose importance is not widely recognized. Lattice properties such as hopping distance and channel width exhibit the greatest influence on cation mobility. Individual conditional expectation analyses performed on these features shows that barriers decrease as hopping distance decreases and as channel width increases. The defect formation energy – which is commonly associated with the concentration of defects, but not with their mobility – is identified as an important feature for interstitial migration. In sum, this analysis aids in the design of optimal solid electrolytes by simplifying the multi-dimensional design space to a sub-set of properties that are the most important.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Deep-learning atomistic semi-empirical pseudopotential model for nanomaterials

The semi-empirical pseudopotential method (SEPM) has been widely applied to provide computational insights into the electronic structure, photophysics, and charge carrier dynamics of nanoscale materials. We present “DeepPseudopot”, a machine-learned atomistic pseudopotential model that extends the SEPM framework by combining a flexible neural network representation of the local pseudopotential with parameterized non-local and spin-orbit coupling terms. Trained on bulk quasiparticle band structures and deformation potentials from GW calculations, the model captures many-body and relativistic effects with very high accuracy across diverse semiconducting materials, as illustrated for silicon and group III-V semiconductors. DeepPseudopot’s accuracy, efficiency, and transferability make it well-suited for data-driven in silico design and discovery of novel optoelectronic nanomaterials.

Lin, Kailai [University of California, Berkeley, C↗
DOE OSTI2023

Machine Learning Prediction of Fracture Toughness in Hydrogen-charged Stainless Steels

Austenitic stainless steels are structural materials utilized in tritium gas pressure boundaries since they are resistant to hydrogen isotope embrittlement [1-3]. However, exposure to tritium over long periods of time leads to tritium uptake which decays to result in helium ingrowth. This helium ingrowth results in further embrittlement effects which are synergistic with that from the hydrogen isotope [4]. Therefore, it is important for tritium facilities to understand the material limitations of stainless steel in this environment. The Savannah River National Laboratory (SRNL) has available a large experimental data set of austenitic stainless steels which have been exposed to tritium environments for various lengths of time. With the availability of this data set, machine learning (ML) algorithms provide an opportunity to model the embrittlement of stainless steel due to the algorithm’s ability to identify patterns in data sets that are difficult and costly to identify in other manners [5]. Ultimately, the amount and quality of the available data is one defining force in the ability of a ML model to accurately predict the desired outputs. The models developed herein will illustrate the ability for the various algorithms to predict the change in fracture toughness in stainless steels due to hydrogen-isotope embrittlement.

Hoar, Eric T.↗
DOE OSTI2025

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

X-ray free-electron lasers offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate free-electron lasers enable single particle imaging, where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray single particle reconstruction algorithms, which estimate the particle orientation for each image independently, are slow and memory-intensive when handling the massive datasets generated by emerging free-electron lasers. Here, we introduce X-RAI (X-Ray single particle imaging with Amortized Inference), an online reconstruction framework that estimates the structure of 3D macromolecules from large X-ray single particle datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray single particle imaging towards real-time reconstruction.

Computer science↗
DOE OSTI2026

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗
DOE OSTI2019

A generalized deep learning approach for local structure identification in molecular simulations

Identifying local structure in molecular simulations is of utmost importance. The most common existing approach to identify local structure is to calculate some geometrical quantity referred to as an order parameter. In simple cases order parameters are physically intuitive and trivial to develop (e.g., ion-pair distance), however in most cases, order parameter development becomes a much more difficult endeavor (e.g., crystal structure identification). Using ideas from computer vision, we adapt a specific type of neural network called a PointNet to identify local structural environments in molecular simulations. A primary challenge in applying machine learning techniques to simulation is selecting the appropriate input features. This challenge is system-specific and requires significant human input and intuition. In contrast, our approach is a generic framework that requires no system-specific feature engineering and operates on the raw output of the simulations, i.e., atomic positions. We demonstrate the method on crystal structure identification in Lennard-Jones (four different phases), water (eight different phases), and mesophase (six different phases) systems. The method achieves as high as 99.5% accuracy in crystal structure identification. The method is applicable to heterogeneous nucleation and it can even predict the crystal phases of atoms near external interfaces. We demonstrate the versatility of our approach by using our method to identify surface hydrophobicity based solely upon positions and orientations of surrounding water molecules. Our results suggest the approach will be broadly applicable to many types of local structure in simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Multi-reward reinforcement learning based development of inter-atomic potential models for silica

Abstract Silica is an abundant and technologically attractive material. Due to the structural complexities of silica polymorphs coupled with subtle differences in Si–O bonding characteristics, the development of accurate models to predict the structure, energetics and properties of silica polymorphs remain challenging. Current models for silica range from computationally efficient Buckingham formalisms (BKS, CHIK, Soules) to reactive (ReaxFF) and more recent machine-learned potentials that are flexible but computationally costly. Here, we introduce an improved formalism and parameterization of BKS model via a multireward reinforcement learning (RL) using an experimental training dataset. Our model concurrently captures the structure, energetics, density, equation of state, and elastic constants of quartz (equilibrium) as well as 20 other metastable silica polymorphs. We also assess its ability in capturing amorphous properties and highlight the limitations of the BKS-type functional forms in simultaneously capturing crystal and amorphous properties. We demonstrate ways to improve model flexibility and introduce a flexible formalism, machine-learned ML-BKS, that outperforms existing empirical models and is on-par with the recently developed 50 to 100 times more expensive Gaussian approximation potential (GAP) in capturing the experimental structure and properties of silica polymorphs and amorphous silica.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Structure and dynamics of $\mathrm{Fe_{90}}$$\mathrm{Si_3}$$\mathrm{O_7}$ liquids close to Earth's liquid core conditions

Using an artificial neural-network machine learning interatomic potential, we have performed molecular dynamics simulations to study the structure and dynamics of $\mathrm{Fe_{90}}$$\mathrm{Si_3}$$\mathrm{O_7}$ liquid close to the Earth's liquid core conditions. Here, the simulation results reveal that the short-range structural order (SRO) in the $\mathrm{Fe_{90}}$$\mathrm{Si_3}$$\mathrm{O_7}$ liquid is very strong. About 80% of the atoms are arranged in crystallinelike SRO motifs. In particular, ~ $70$% of Fe-centered clusters can be classified as either hexagonal-close-packed-like or icosahedrallike SRO motifs. The SRO clusters centered on Fe, Si, or O atoms are strongly intermixed and homogenously distributed throughout the liquid. The atomic structure of the liquid and the fractions of dominant SRO clusters are not sensitive to pressure/temperature used in the simulations except that the SRO of the O-centered clusters is enhanced close to inner core pressures. The O-diffusion coefficient is about two to three times larger than the Fe and Si ions and increases more rapidly in the deeper core regions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Big Data Framework with Machine Learning for D and D Applications - 19108

The nuclear industry is experiencing a steady increase in maintenance costs even though plants are maintained under high levels of safety, capability and reliability. Nuclear power plants are expected to run every unit at maximum capacity at all times, efficiently utilizing assets with minimal downtime. Surveillance and maintenance of nuclear decommissioning infrastructure provides lot challenges with respect to maintenance or decommissioning of the buildings. There is a need for a framework to analyze the huge amount of data generated by the sensors on the nuclear reactor components as well as structures, to monitor the conditions of these building over a period of time. Emerging technologies such as big data analytics have become a requirement in the nuclear industry to improve structural health monitoring and diagnostics. FIU will make use of existing mature technologies in the areas of imaging, robotics, big data, and machine learning/deep learning to assess the structural integrity of aging facilities at DOE sites. As these facilities await decommissioning, there is a need to understand the structural health of these structures. Many of these facilities were built over 50 years ago and in some cases these facilities have gone beyond the operational life expectancy. In other cases, the facilities have been placed in a state of 'cold and dark' and they are sitting unused, awaiting decommissioning. Finally, some older facilities are one-of-a-kind operational/production facilities supporting critical DOE missions and cannot be shut down. In any of these scenarios, the structural integrity of these facilities may be compromised, so it is imperative that adequate inspections and data collection/analysis be performed on a continuous and ongoing basis. The primary goals of the research include collecting various formats of data such as structured, unstructured and streaming data from the various sensors deployed in buildings, collect videos/pictures from various imaging sources, ingest them using a Hadoop distributed file system and process the data using Spark to perform batch processing and real time analytics. Research and development on various machine learning/deep learning algorithms will also be performed to analyze the heterogeneous data collected from nuclear decommission infrastructure. FIU will design the big data framework to ingest, store and process huge amounts of heterogeneous data collected from many sources and optimize the algorithms to provide insights into the data and predict anomalies observed when compared against baseline conditions. Various modules of this framework will include heterogeneous data sources, message broker, Hadoop distributed file system, Spark for stream and batch processing, machine learning/ deep learning, Cassandra - persistent data store and visualization. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Investigating phase transitions from local crystallographic analysis based on statistical learning of atomic environments in 2D MoS 2 -ReS 2

Traditionally, phase transitions are explored using a combination of macroscopic functional characterization and scattering techniques, providing insight into the average properties and symmetries of the lattice but local atomic level mechanisms during phase transitions generally remain unknown. Here, we explore the mechanisms of a phase transition between the trigonal prismatic and distorted octahedral phases of layered chalcogenides in the 2D MoS 2 - ReS 2 system from the observations of local degrees of freedom, namely atomic positions by Scanning Transmission Electron Microscopy (STEM). We employ local crystallographic analysis based on statistical learning of atomic environments to build a picture of the transition from the atomic level up and determine local and global variables controlling the local symmetry breaking. In particular, we argue that the dependence of the average symmetry breaking distortion amplitude on global and local concentration can be used to separate local chemical as well as global electronic effects on transition. This approach allows exploring atomic mechanisms beyond the traditional macroscopic descriptions, utilizing the imaging of compositional fluctuations in solids to explore phase transitions over a range of realized and observed local stoichiometries and atomic configurations.

25 ENERGY STORAGE↗
DOE OSTI2025

SpectraCodec: A Hilbert curve-based method for encoding metadata in mass spectra for machine learning applications (SpectraCodec) v1

Machine learning approaches to mass spectrometry (MS) data analysis require structured metadata for optimal performance. However, current MS file formats necessitate external metadata sources, creating integration challenges that impede analytical workflows. Here, we present a novel approach for encoding metadata directly within mzML files using one-hot encoding of ASCII characters mapped via Hilbert space-filling curves. This strategy embeds metadata in the first spectrum's m/z-intensity space, ensuring persistence with the primary data, eliminating the need for external metadata files, and maintaining compatibility with existing MS software. We demonstrate that the Hilbert curve mapping efficiently utilizes the two-dimensional spectral space while maintaining robust data recovery. This method offers a practical solution for machine learning applications in mass spectrometry by ensuring metadata and spectral data remain unified through all stages of analysis.

Bowen, Benjamin [Lawrence Berkeley National Labora↗
DOE OSTI2022

Observing flow of He II with unsupervised machine learning

Abstract Time dependent observations of point-to-point correlations of the velocity vector field (structure functions) are necessary to model and understand fluid flow around complex objects. Using thermal gradients, we observed fluid flow by recording fluorescence of $${\text{He}}_{2}^{*}$$ He 2 ∗ excimers produced by neutron capture throughout a ~ cm 3 volume. Because the photon emitted by an excited excimer is unlikely to be recorded by the camera, the techniques of particle tracking (PTV) and particle imaging (PIV) velocimetry cannot be applied to extract information from the fluorescence of individual excimers. Therefore, we applied an unsupervised machine learning algorithm to identify light from ensembles of excimers (clusters) and then tracked the centroids of the clusters using a particle displacement determination algorithm developed for PTV.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Exploring the $A$-V-Sb landscape beyond $A$$\mathrm{V_3}$ $\mathrm{Sb_5}$: A case study on the $\mathrm{KV_6}$ $\mathrm{Sb_6}$ Kagome compound

Kagome compounds have garnered attention in the past few years for their intriguing magnetic properties arising from spin frustration dictated by the geometry of the Kagome sublattice. In this paper, we highlight the success of the unconventional hydride route for the fast and easy synthesis of the Kagome compound $\mathrm{KV_6}$ $\mathrm{Sb_6}$. Here, high-temperature in situ powder x-ray diffraction (PXRD) studies proved to be useful in hinting at the existence of $\mathrm{KV_6}$ $\mathrm{Sb_6}$, identifying its synthesis conditions, and understanding the reaction mechanism. The crystal structure for $\mathrm{KV_6}$ $\mathrm{Sb_6}$ was determined from high-resolution PXRD data. The compound has a layered structure [$R\overline{3}m, a = 5.5318$ (9) Å, $c = 34.23$ (3)Å 3 $Z = 3$] at room temperature] and features a Kagome bilayer of V atoms. $\mathrm{KV_6}$ $\mathrm{Sb_6}$ is isostructural to the previously reported $\mathrm{RbV_6}$ $\mathrm{Sb_6}$ and $\mathrm{CsV_6}$ $\mathrm{Sb_6}$ compounds. $\mathrm{KV_6}$ $\mathrm{Sb_6}$ is thermally stable in vacuum up to 1173 K, as evident from the high-temperature in situ PXRD and differential scanning calorimetric analysis. Investigation of magnetic properties for $\mathrm{KV_6}$ $\mathrm{Sb_6}$ between 2 and 300 K reveals temperature-independent paramagnetism and an absence of superconductivity, like the Rb and Cs analogs. Furthermore, we compare the magnetic properties of K V 3 Sb 5 , another ternary Kagome compound, synthesized via two different methods: the hydride route and the traditional route from elements. Low-temperature transport property measurements of $\mathrm{KV_6}$ $\mathrm{Sb_6}$ indicate metallic behavior and an intrinsically low thermal conductivity of $\mathrm{1.0 W K^-1}$ $\mathrm{m^-1}$ at 300 K. The layered structure of $\mathrm{KV_6}$ $\mathrm{Sb_6}$ makes it an attractive candidate for deintercalation and doping studies to tune both magnetic and transport properties, laying a foundation for further studies.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Reconstructing patchy reionization with deep learning

The precision anticipated from next-generation cosmic microwave background (CMB) surveys will create opportunities for characteristically new insights into cosmology. Secondary anisotropies of the CMB will have an increased importance in forthcoming surveys, due both to the cosmological information they encode and the role they play in obscuring our view of the primary fluctuations. Quadratic estimators have become the standard tools for reconstructing the fields that distort the primary CMB and produce secondary anisotropies. While successful for lensing reconstruction with current data, quadratic estimators will be suboptimal for the reconstruction of lensing and other effects at the expected sensitivity of the upcoming CMB surveys. In this paper we describe a convolutional neural network, ResUNet-CMB, that is capable of the simultaneous reconstruction of two sources of secondary CMB anisotropies, gravitational lensing and patchy reionization. Furthermore, we show that the ResUNet-CMB network significantly outperforms the quadratic estimator at low noise levels and is not subject to the lensing-induced bias on the patchy reionization reconstruction that would be present with a straightforward application of the quadratic estimator.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Improved representation of black carbon mixing structures suggests stronger direct radiative heating

Black carbon significantly influences the Earth system because of its strong solar radiation absorption. However, its direct radiative effect remains poorly understood in current climate models, partly because current climate models oversimplify the diverse structures formed when black carbon mixes with other atmospheric components. Here we show that incorporating more realistic, multi-mixing-structure representations of black carbon increases the direct radiative effect. We find that aged black carbon particles, with thicker coatings and higher embedded fractions, enhance the direct radiative effect more efficiently. Using machine learning alongside the Community Earth System Model, we show that the direct radiative effect at the top of the atmosphere in regions with heavy black carbon pollution is 31.6% greater when multi-mixing structures are considered. These findings highlight the importance of modeling complex mixing structures of particle-resolved black carbon to accurately capture their warming impacts on global atmosphere, particularly in highly polluted regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Enhancing stability, magnetic anisotropy, and coercivity of manganese aluminum: Machine learning, ab initio , and micromagnetic modeling

The binary manganese aluminum (MnAl) alloy with L⁢1 0 crystal structure is a promising rare earth (RE) element-free permanent magnetic material because of its exceptional magnetic properties. However, experimentally synthesizing it in a stable bulk form is extremely challenging. Here, in this study, an alternative method of stabilizing the material, a pathway for experimental synthesis and validation, is proposed and theoretically verified. This is done by partially substituting Mn and Al sites with Fe and Ni and identifying its enhanced phase stability, saturation magnetization density, magnetic anisotropy, and coercivity from density functional theory (DFT), machine learning (ML) crystal graph convolution neural network (CGCNN), and micro-magnetic modeling. When considering a fixed 50% Ni, the magnetic anisotropy increases with the increasing Fe content but decreases the formation energy. The calculated formation energies, elastic constants, and phonon frequencies demonstrate that the binary and quaternary compositions are stable. Most importantly, in 50% Fe and Ni-substituted-equiatomic phase, magnetic anisotropy constants and saturation magnetization density increase by 56% and 23% as compared to the MnAl. Further, the coercivity of the equiatomic phase predicted with micro-magnetic modeling is higher by 17% than the parent compound.

Bhandari, Churna [Ames National Laboratory, and Io↗
DOE OSTI2018

Machine-Learning Prediction of CO Adsorption in Thiolated, Ag-Alloyed Au Nanoclusters

Here we propose a machine-learning model, based on the random-forest method, to predict CO adsorption in thiolate protected nanoclusters. Two phases of feature selection and training, based initially on the Au 25 nanocluster, are utilized in our model. One advantage to a machine-learning approach is that correlations in defined features disentangle relationships among the various structural parameters. For example, in Au 25 , we find that features based on the distribution of Ag atoms relative to the CO adsorption site are the most important in predicting adsorption energies. Our machine-learning model is easily extended to other Au-based nanoclusters, and we demonstrate predictions about CO adsorption on Ag-alloyed Au 36 and Au 133 nanoclusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Discovering invariant spatial features in electron energy loss spectroscopy images on the mesoscopic and atomic levels

Over the last two decades, Electron Energy Loss Spectroscopy (EELS) imaging with a scanning transmission electron microscope has emerged as a technique of choice for visualizing complex chemical, electronic, plasmonic, and phononic phenomena in complex materials and structures. The availability of the EELS data necessitates the development of methods to analyze multidimensional data sets with complex spatial and energy structures. Traditionally, the analysis of these data sets has been based on analysis of individual spectra, one at a time, whereas the spatial structure and correlations between individual spatial pixels containing the relevant information of the physics of underpinning processes have generally been ignored and analyzed only via the visualization as 2D maps. Here, we develop a machine learning-based approach and workflows for the analysis of spatial structures in 3D EELS data sets using a combination of dimensionality reduction and multichannel rotationally invariant variational autoencoders. This approach is illustrated for the analysis of both the plasmonic phenomena in a system of nanowires and in the core excitations in functional oxides using low loss and core-loss EELS, respectively. The code developed in this manuscript is open sourced and freely available and provided as a Jupyter notebook for the interested reader.

36 MATERIALS SCIENCE↗