Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Disentangling Rotational Dynamics and Ordering Transitions in a System of Self-Organizing Protein Nanorods via Rotationally Invariant Latent Representations

The dynamics of complex ordering systems with active rotational degrees of freedom exemplified by protein self-assembly is explored using a machine learning workflow that combines deep learning-based semantic segmentation and rotationally invariant variational autoencoder-based analysis of orientation and shape evolution. The latter allows for disentanglement of the particle orientation from other degrees of freedom and compensates for lateral shifts. The disentangled representations in the latent space encode the rich spectrum of local transitions that can now be visualized and explored via continuous variables. The time dependence of ensemble averages allows insight into the time dynamics of the system and, in particular, illustrates the presence of the potential ordering transition. Finally, analysis of the latent variables along the single-particle trajectory allows tracing these parameters on a single-particle level. The proposed approach is expected to be universally applicable for the description of the imaging data in optical, scanning probe, and electron microscopy seeking to understand the dynamics of complex systems where rotations are a significant part of the process.

representation learning↗
DOE OSTI2025

Structural origin of disorder-induced ion conduction in NaFePO 4 cathode materials

Diffusion in NaFePO 4 can be enhanced through amorphization. Based on computations using DFT and machine learning potentials, we ascribe this phenomenon to the formation of less constrained Na-ion environments upon disordering. Most modern battery technologies depend on solid-state crystalline cathode materials. However, some of these materials are constrained by the low ionic conductivity of their most stable phases. An example of this is maricite (NaFePO 4 ). Interestingly, experiments have shown that maricite can improve its rate capability through disordering (amorphization). However, experimental characterization of amorphous cathode materials remains a major challenge, hindering a clear understanding of the structural origin of the disorder-induced improvement in sodium-ion mobility. To address this, we here employ molecular dynamics simulations by first training a machine learning potential for NaFePO 4 based on the atomic cluster expansion approach and a batch active learning potential parameterization scheme. This potential is then applied to explore the structural and dynamical properties of NaFePO 4 glasses as cathode materials. Specifically, we investigate the effect of glass structure on sodium-ion diffusion, revealing the relative influences of short-range and medium-range order features. We find significant heterogeneity in sodium-ion diffusivity in the glass, with fast-conducting ions residing in less constrained atomic environments with fewer P and Fe neighbors. These more mobile ions are also surrounded by larger ring-type structures. Overall, the results and developed approach present promising avenues for developing high-performance glassy cathodes for next-generation batteries.

Christensen, Rasmus↗
DOE OSTI2021

Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks

Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

PayamDiba/CoNSEPT

Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference.

Dibaeinia, Payam↗
DOE OSTI2025

Keeping LAMMPS cutting edge

Since its inception 30 years ago, LAMMPS has grown to be a world-class molecular dynamics code and a cornerstone of computational materials science research. This project aimed to keep LAMMPS at the forefront of molecular dynamics simulations by adapting LAMMPS to the latest developments in machine learning technology and hardware. Initially, the project set out to provide a unified implementation of active learning for efficient training data generation in LAMMPS, but the research trajectory pivoted to address more immediate and impactful opportunities. On the hardware side, recent record-breaking molecular dynamics simulations were developed on the Cerebras wafer-scale AI chip, and this project has developed an interface between LAMMPS and the hardware-specific molecular dynamics code to accelerate and simplify development and user adoption. On the software side, PyTorch’s Ahead-of-Time (AOT) compilation features promised increased performance for state-of-the-art equivariant neural network potentials, and this project laid the groundwork for their adoption in LAMMPS, resulting in a nearly 20x acceleration in extreme cases. Combined with a comprehensive benchmark study of LAMMPS across all current exascale systems, this project has reinforced LAMMPS’s role as a versatile, high-performance tool for current and future materials science applications.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Mapping Glacier Basal Sliding Applying Machine Learning

During the RESOLVE project (“High-resolution imaging in subsurface geophysics: development of a multi-instrument platform for interdisciplinary research”), continuous surface displacement and seismic array observations were obtained on Glacier d’Argentière in the French Alps for 35 days in May 2018. The data set is used to perform a detailed study of targeted processes within the highly dynamic cryospheric environment. In particular, the physical processes controlling glacial basal motion are poorly understood and remain challenging to observe directly. Especially in the Alpine region for temperate based glaciers where the ice rapidly responds to changing climatic conditions and thus, processes are strongly intermittent in time and heterogeneous in space. Spatially dense seismic and Global Positioning System (GPS) measurements are analyzed applying machine learning to gain insight into the processes controlling glacial motions of Glacier d’Argentière. Using multiple bandpass-filtered copies of the continuous seismic waveforms, we compute energy-based features, develop a matched field beamforming catalog and include meteorological observations. Features describing the data are analyzed with a gradient boosting decision tree model to directly estimate the GPS displacements from the seismic noise. We posit that features of the seismic noise provide direct access to the dominant parameters that drive displacement on the highly variable and unsteady surface of the glacier. The machine learning model infers daily fluctuations and longer term trends. The results show on-ice displacement rates are strongly modulated by activity at the base of the glacier. The techniques presented provide a new approach to study glacial basal sliding and discover its full complexity.

58 GEOSCIENCES↗
DOE OSTI2022

Advancing Vision-based Feedback and Convolutional Neural Networks for Visual Outlier Detection

Machine learning has matured into a technology that has immediate applicability to the surveillance needs of nuclear material storage containers. These containers at LANL are the barrier preventing release of radioactive material to the workers, public, and environment during the storage period of the material. Annual surveillance activities can only provide coverage on a handful of containers. There is a significant need for surveillance tools to identify potential issues and precursors to containment failure that can be used during opportunistic inspections and, more generally, outside of annual surveillance activities. In this report we provide details on the advancement of our proposed embodiment that combines an automation system for taking pictures and a high-accuracy machine learning-driven object detection software. We further showcase the improvements on the software side with progress on extracting unique identification features and advances in detecting damage. The current state of the system captures subject matter expert training and a space-conscious design whose implementation is envisioned in the near future.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

MADE3D: Enabling the next generation of high-torque density wind generators by additive design and 3D printing

Direct-drive wind turbine generators are increasing in popularity, thanks to recent project developments—especially offshore, where reliability and efficiency are major cost drivers. Yet, high capital costs are forcing many original equipment manufacturers to consider lightweight, high-torque density generators for next-generation multi-megawatt turbines that may be difficult to realize by traditional design or manufacturing methods. In this study, we present a new design framework enabled by advanced machine learning and multimaterial additive manufacturing to perform a magnetic topology optimization that maximizes the torque per rotor active mass for a 15-megawatt direct-drive permanent magnet wind generator. A comparison of the proposed approach against conventional topology optimization demonstrated a significant increase in computational efficiency and accuracy in performance predictions. Results using single and multimaterial compositions for rotor core and magnets identify a wider choice of 3D printable designs for a given specification. A hybrid combination of sintered and dysprosium-free polymer-bonded magnets shows good potential for torque performance by saving material costs up to 8.75%. More than 30% improvement in rotor torque densities is identified which can marginally improve the overall generator torque density. With the rapid evolution of multipowder deposition technolgies, this study can greatly inspire a new paradigm for design-driven manufacturing with novel material compositions and lightweight, low-cost, high-strength multimaterial geometries that were previously unexplored for direct-drive generators.

17 WIND ENERGY↗
DOE OSTI2022

KGML-ag: a modeling framework of knowledge-guided machine learning to simulate agroecosystems: a case study of estimating N<sub>2</sub>O emission using data from mesocosm experiments

Abstract. Agricultural nitrous oxide (N2O) emission accounts for a non-trivial fraction of global greenhouse gas (GHG) budget. To date, estimating N2O fluxes from cropland remains a challenging task because the related microbial processes (e.g., nitrification and denitrification) are controlled by complex interactions among climate, soil, plant and human activities. Existing approaches such as process-based (PB) models have well-known limitations due to insufficient representations of the processes or uncertainties of model parameters, and due to leverage recent advances in machine learning (ML) a new method is needed to unlock the “black box” to overcome its limitations such as low interpretability, out-of-sample failure and massive data demand. In this study, we developed a first-of-its-kind knowledge-guided machine learning model for agroecosystems (KGML-ag) by incorporating biogeophysical and chemical domain knowledge from an advanced PB model, ecosys, and tested it by comparing simulating daily N2O fluxes with real observed data from mesocosm experiments. The gated recurrent unit (GRU) was used as the basis to build the model structure. To optimize the model performance, we have investigated a range of ideas, including (1) using initial values of intermediate variables (IMVs) instead of time series as model input to reduce data demand; (2) building hierarchical structures to explicitly estimate IMVs for further N2O prediction; (3) using multi-task learning to balance the simultaneous training on multiple variables; and (4) pre-training with millions of synthetic data generated from ecosys and fine-tuning with mesocosm observations. Six other pure ML models were developed using the same mesocosm data to serve as the benchmark for the KGML-ag model. Results show that KGML-ag did an excellent job in reproducing the mesocosm N2O fluxes (overall r2=0.81, and RMSE=3.6 mgNm-2d-1 from cross validation). Importantly, KGML-ag always outperforms the PB model and ML models in predicting N2O fluxes, especially for complex temporal dynamics and emission peaks. Besides, KGML-ag goes beyond the pure ML models by providing more interpretable predictions as well as pinpointing desired new knowledge and data to further empower the current KGML-ag. We believe the KGML-ag development in this study will stimulate a new body of research on interpretable ML for biogeochemistry and other related geoscience processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Protonation Dynamics of Confined Ethanol–Water Mixtures in H-ZSM-5 from Machine Learning-Driven Metadynamics

Zeolites are indispensable heterogeneous catalysts in industrial chemical processes, valued for their strong Brønsted acidity, well-defined microporous frameworks, and tunable pore structures. Their catalytic activity arises primarily from Brønsted acid sites (BAS), typically present as bridging hydroxyl groups (Si–OH–Al). Under aqueous reaction conditions, these protons interact dynamically with water and alcohol molecules, leading to complex solvation and protonation behavior within confined pores. In this study, we investigate the protonation equilibrium occurring between ethanol and water at the BAS of acidic zeolites under varying hydration levels, i.e., C2H5OH–(H2O)n, n=1–4. Local structure was analyzed through an adaptive-learning global optimization algorithm, while enhanced sampling molecular dynamics simulations with Well-Tempered Metadynamics (WMetaD) and machine learning interatomic potentials (MLPs) provide free-energy surfaces (FES) at variable hydration levels. The results reveal a strong dependence of proton localization on the degree of hydration. At low hydration (1 water molecule), the proton resides predominantly on ethanol; with 2 water molecules, it shifts toward water, and at higher hydration (3 or more water molecules), it becomes extensively delocalized over the water cluster. These findings underscore the critical role of solvation in modulating acid site behavior and suggest that a minimum of three water molecules is necessary to fully stabilize the proton on water within the zeolite framework. This solvation threshold has significant implications for catalytic processes, particularly in biomass conversion reactions where alcohol protonation is a key step in dehydration mechanisms.

machine learning↗
DOE OSTI2024

Exploring Li-Ion Transport Properties of Li 3 TiCl 6 : A Machine Learning Molecular Dynamics Study

We performed large-scale molecular dynamics simulations based on a machine-learning force field (MLFF) to investigate the Li-ion transport mechanism in cation-disordered Li 3 TiCl 6 cathode at six different temperatures, ranging from 25°C to 100°C. In this work, deep neural network method and data generated by ab − initio molecular dynamics (AIMD) simulations were deployed to build a high-fidelity MLFF. Radial distribution functions, Li-ion mean square displacements (MSD), diffusion coefficients, ionic conductivity, activation energy, and crystallographic direction-dependent migration barriers were calculated and compared with corresponding AIMD and experimental data to benchmark the accuracy of the MLFF. From MSD analysis, we captured both the self and distinct parts of Li-ion dynamics. The latter reveals that the Li-ions are involved in anti-correlation motion that was rarely reported for solid-state materials. Similarly, the self and distinct parts of Li-ion dynamics were used to determine Haven’s ratio to describe the Li-ion transport mechanism in Li 3 TiCl 6 . Obtained trajectory from molecular dynamics infers that the Li-ion transportation is mainly through interstitial hopping which was confirmed by intra- and inter-layer Li-ion displacement with respect to simulation time. Ionic conductivity (1.06 mS/cm) and activation energy (0.29eV) calculated by our simulation are highly comparable with that of experimental values. Overall, the combination of machine-learning methods and AIMD simulations explains the intricate electrochemical properties of the Li 3 TiCl 6 cathode with remarkably reduced computational time. Thus, our work strongly suggests that the deep neural network-based MLFF could be a promising method for large-scale complex materials.

Selvaraj, Selva Chandrasekaran (ORCID:000000029023↗
DOE OSTI2020

Review of heat transfer enhancement techniques for single phase flows

The thermal energy exchange between a flowing fluid and its confining channel is a ubiquitous process in modern society. To enhance the fluid-to-wall or wall-to-fluid heat transfer, several techniques have been developed to maximize the contact area between the fluid and the inner wall and/or disrupt the flow to enhance circulation or induce turbulence. Deployment of channels having features capable of enhancing heat transfer enables the reduction of heat exchanger size while maintaining performance. Reduction in equipment size is critical due to the ability to minimize the required volume of costly working fluids and to mitigate potential safety concerns associated with total system fluid volume. Here, a comprehensive review of single-phase heat transfer enhancement techniques is presented. The article provides a thorough comparison by analyzing the heat transfer rate, pressure drop, and other operational aspects. Single-phase heat transfer enhancement methods are divided into active and passive techniques. Active methods such as electrohydrodynamic (EHD), magnetohydrodynamics (MHD), or mechanical motion require external power to create enhancement. Passive methods such as dimples, fins, or tape inserts do not require external input and rely only on surface modification. Although active methods are more expensive and difficult to implement compared to passive techniques, it enables active control of heat transfer augmentation. Finally, this review develops and summarizes key learning data for design optimization enabled by additive manufacturing and machine learning algorithms, helping to inform these next-generation heat exchanger design methodologies for a plethora of modern applications such as electrification of vehicles, computing, and classical industries.

42 ENGINEERING↗
DOE OSTI2026

Unraveling Fundamental Activity–Stability Relationships in Rutile Oxides

The oxygen evolution reaction (OER) is a key anodic half-cell reaction that accompanies several critical electrochemical reduction reactions of interest to a variety of applications. Despite steady advances in understanding and qualitatively predicting OER activity and selectivity trends, a comprehensive description or prediction of material aqueous (in)stability and degradation mechanisms remains elusive, even though these processes critically influence device lifetime and economic feasibility. In this work, we investigate the interplay, or lack thereof, between OER activity and material aqueous stability across rutile oxides, with a particular focus on iridium oxide (IrO 2 ). By applying a Born–Haber cycle, we calculate the thermodynamic driving force for metal dissolution as a function of the applied bias and electrolyte conditions. We apply interpretable machine learning techniques, including principal component analysis and symbolic regression, to analyze trends across rutile oxides and find that key thermodynamic descriptors for OER activity and surface stability are only very weakly correlated. Instead, the local atomic environment─especially electronic structure signatures for interactions between the active site and its neighbors─plays a more important role in predicting material stability. Leveraging these insights, we investigate the impact of doping IrO 2 with a range of transition metals and show that the stability of Ir active sites can be tuned largely independently of its predicted OER activity. These insights lay the foundation for material design to improve stability with respect to corrosion, with the ultimate aim to enhance long-term stability without sacrificing catalytic performance in the OER.

evolution reactions↗
DOE OSTI2023

CoolPINNs: A physics-informed neural network modeling of active cooling in vascular systems

Emerging technologies like hypersonic aircraft, space exploration vehicles, and batteries avail fluid circulation in embedded microvasculatures for efficient thermal regulation. Modeling is vital during the design and operational phases of these engineered systems. However, many challenges exist in developing a modeling framework. What is lacking is an accurate framework that (i) captures sharp jumps in the thermal flux across complex vasculature layouts, (ii) deals with oblique derivatives (involving tangential and normal components), (iii) handles nonlinearity because of radiative heat transfer, (iv) provides a high-speed forecast for real-time monitoring, and (v) facilitates robust inverse modeling. Here, this paper addresses these challenges by availing the power of physics-informed neural networks (PINNs). We develop a fast, reliable, and accurate Scientific Machine Learning (SciML) framework for vascular-based thermal regulation—called CoolPINNs: a PINNs-based modeling framework for active cooling. The proposed mesh-less framework elegantly overcomes all the mentioned challenges. The significance of the reported research is multi-fold. First, the framework is valuable for real-time monitoring of thermal regulatory systems because of rapid forecasting. Second, researchers can address complex thermoregulation designs since the approach is meshless. Finally, the framework facilitates systematic parameter identification and inverse modeling studies, perhaps the most significant utility of the current framework.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Solid-state NMR and theoretical studies illuminate lanthanum borohydride C–H borylation catalysts confined within a zeolite

Zeolite-supported single-site lanthanum borohydride catalyzes C–H borylation of hydrocarbons, while the related silica-supported complex is inactive under comparable conditions. The identical composition of support-La(BH 4 ) 2 (THF) 2 sites in the two materials implies that the support bestows underlying structural features onto La that are required for bond activation catalysis, yet the nature of these effects, which could include confinement effects and/or electronic modulation of the site itself, remains to be identified. We used solid-state nuclear magnetic resonance (SSNMR) spectroscopy and molecular dynamics simulations with machine-learning potentials (ML-MD) to analyze the electronic and steric effects imparted by the faujasite support on the precatalyst structure to correlate with catalytic activity. ML-MD simulations show that THF dissociates from La under the influence of confinement, leading to coordinatively unsaturated sites in the zeolite pores. Then, the La complex grafts on Brønsted acid sites (La BAS ) or isolated silanols (La SiO ) or remains physisorbed in the zeolite pores. Catalytic studies comparing compounds supported on faujasite zeolites containing or lacking BAS and/or silanols show that only the former complexes lead to active sites, ruling out confinement as the sole requirement for catalysis. The DFT calculations and ML-MD simulations also reveal that the surface-lanthanum coordination number is two (bidentate) for La BAS , with the metal center forming long, flexible bonds to two oxygen atoms bridging Si and Al, but only one oxygen atom (monodentate) for La SiO . The structure–activity relationship identifies confined, BAS-grafted species as active sites and provides important guidance for the design of enhanced atom-efficient catalysts.

Cui, Jinlei [Ames Laboratory, and Iowa State Univ.↗
DOE OSTI2022

Predicting Catalyst Surface Stability Under Reaction Conditions Using Deep Reinforcement Learning and Machine Learning Potentials

Catalysts are critical for most large-scale energy intensive chemical transformation processes, such as energy storage, liquid fuel production, and the formation of chemical building blocks. The catalyst composition, structure, and morphology impact the performance under reaction conditions and influences properties like activity and selectivity. Many industrial catalysts offer imperfect activity/selectivity, or contain expensive metals. Further, catalysts can deactivate over time as the morphology changes or harsh reactive environments alter the surface structure. Methods to automatically model and predict the kinetics of how catalyst surfaces will restructure would enable engineers to design around these challenges, improve performance, increase longevity. This project investigated a specific type of machine learning model, deep reinforcement learning, machine learning models to act as surrogates for the physical system, and compared the results of these approaches with a specialized high-throughput experimental synthesis and measurement platform.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

FracML: A Machine Learning Based Tool to Quantify Reservoir Scale Fracture Network for CO2 Storage

Poster on “FRACML: A Machine Learning Based Tool to Quantify Reservoir Scale Fracture Network for CO2 Storage” for the CCUS 2025 conference held in Houston, Texas March 3-5, 2025. The accurate characterization of subsurface fracture networks is essential for the secure operation of carbon capture, utilization, and storage (CCUS) projects. A thorough understanding of the spatial distribution of subsurface faults and fractures is crucial for predicting CO2 plume evolution and minimizing risks such as potential leakage into overlying formations or induced seismicity. In this context, robust fracture network quantification plays a pivotal role in reservoir management, providing the data necessary to fine-tune operational parameters, and ensure the environmental and economic viability of CCUS projects. As part of the U.S. Department of Energy’s SMART (Science-informed Machine Learning for Accelerating Real-time Decisions in Subsurface Applications) initiative, we focused on the development and application of a machine learning-based tool (FRACML) designed to quantify and map fracture networks using real-world (non-synthetic) data from an active CO2 injection site. Our objective is to demonstrate the utility of this tool in improving operational efficiency and safety across CCUS sites.

artifical intelligence / machine learning (AI/ML)↗