Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

MultiLoad-GAN: A GAN-Based Synthetic Load Group Generation Method Considering Spatial-Temporal Correlations

This paper presents a deep-learning framework, Multi-load Generative Adversarial Network (MultiLoad-GAN), for generating a group of synthetic load profiles (SLPs) simultaneously. The main contribution of MultiLoad-GAN is the capture of spatial-temporal correlations among a group of loads that are served by the same distribution transformer. This enables the generation of a large amount of correlated SLPs required for microgrid and distribution system studies. Here, the novelty and uniqueness of the MultiLoad-GAN framework are three-fold. First, to the best of our knowledge, this is the first method for generating a group of load profiles bearing realistic spatial- temporal correlations simultaneously. Second, two complementary realisticness metrics for evaluating generated load profiles are developed: computing statistics based on domain knowledge and comparing high-level features via a deep-learning classifier. Third, to tackle data scarcity, a novel iterative data augmentation mechanism is developed to generate training samples for enhancing the training of both the classifier and the MultiLoad-GAN model. Simulation results show that MultiLoad- GAN can generate more realistic load profiles than existing approaches, especially in group level characteristics. With little finetuning, MultiLoad-GAN can be readily extended to generate a group of load or PV profiles for a feeder or a service area.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Controlling extrapolations of nuclear properties with feature selection

Predictions of nuclear properties far from measured data are inherently inaccurate because of uncertainties in our knowledge of nuclear forces and in our treatment of quantum many-body effects in strongly-interacting systems. While the model bias can be directly calculated when experimental data is available, only an estimate can be made in the absence of such measurements. Current approaches to compute the estimated bias quickly lose predictive power when their input variables are taken far from the training region, resulting in uncontrolled uncertainties in applications such as nucleosynthesis simulations. In this letter, we present a novel technique to identify the input variables of machine learning algorithms that can provide robust estimates of model bias. Our process is based on selecting input variables, or features, based on their probability distribution functions across the entire nuclear chart. We illustrate our approach on the problem of quantifying the model bias in nuclear binding energies calculated with Density Functional Theory (DFT). We prove that building model biases with only Z and N as features leads to highly unreliable extrapolations. Conversely, we show that proper feature selection can systematically improve theoretical predictions without increasing uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Modeling the aqueous interface of amorphous TiO 2 using deep potential molecular dynamics

Amorphous titanium dioxide (a-TiO 2 ) is widely used as a coating material in applications such as electrochemistry and self-cleaning surfaces where its interface with water has a central role. However, little is known about the structures of the a-TiO 2 surface and aqueous interface, particularly at the microscopic level. In this work, we construct a model of the a-TiO 2 surface via a cut-melt-and-quench procedure based on molecular dynamics simulations with deep neural network potentials (DPs) trained on density functional theory data. After interfacing the a-TiO 2 surface with water, we investigate the structure and dynamics of the resulting system using a combination of DP-based molecular dynamics (DPMD) and ab initio molecular dynamics (AIMD) simulations. Both AIMD and DPMD simulations reveal that the distribution of water on the a-TiO 2 surface lacks distinct layers normally found at the aqueous interface of crystalline TiO 2 , leading to an ~10 times faster diffusion of water at the interface. Bridging hydroxyls (Ti 2 –O b H) resulting from water dissociation decay several times more slowly than terminal hydroxyls (Ti–O w H) due to fast Ti–O w H 2 → Ti–O w H proton exchange events. These results provide a basis for a detailed understanding of the properties of a-TiO 2 in electrochemical environments. Moreover, the procedure of generating the a-TiO 2 -interface employed here is generally applicable to studying the aqueous interfaces of amorphous metal oxides.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Portable chemical detection platform for on-site monitoring of odorant levels in natural gas

The adequate odorization of natural gas is critical to identify gas leaks and to reduce accidents. To ensure odorization, natural gas utility companies collect samples to be processed at core facilities or a trained human technician smells a diluted natural gas sample. In this work, we report a detection platform that addresses the lack of mobile solutions capable of providing quantitative analysis of mercaptans, a class of compounds used to odorize natural gas. Detailed description of the platform hardware and software components is provided. Designed to be portable, the platform hardware facilitates extraction of mercaptans from natural gas, separation of individual mercaptan species, and quantification of odorant concentration, with results reported at point-of-sampling. The software was developed to accommodate skilled users as well as minimally trained operators. Detection and quantification of six commonly used mercaptan compounds (ethyl mercaptan, dimethyl sulfide, n-propylmercaptan, isopropyl mercaptan, tert–butyl mercaptan, and tetrahydrothiophene) at typical odorizing concentrations of 0.1–5 ppm was performed using the device. We demonstrate the potential of this technology to ensure natural gas odorizing concentrations throughout distribution systems.

03 NATURAL GAS↗
DOE OSTI2024

Convolution Neural Network for Fault Identification in Distribution Feeder with High Penetration Solar PV

Identification and zonal classification of the faults is a decisive factor in the relay’s decision to trip or not. Different types of fault like three-phase, line-to-line-to-ground and single-line-to-ground can occur at various locations in the feeder. These faults are seen as the variation in the instantaneous values of three-phase voltages and currents, i.e., waveforms, that are measured at the relay location. The objective of this work is to develop a machine learning model that can identify a fault and classify it to various protection zones based on measured waveforms. In this work, a data-driven relay based on Convolutional Neural Network (CNN) is proposed for fault identification in distribution feeders with high penetration solar PV. The proposed CNN model takes local current and voltage waveforms as input and classify it into fault, no-fault or a capacitor switching. Further, the CNN also attempts to identify fault zones based on the images of waveforms. The overall testing accuracy of the trained model exceeds 95%.

Ramesh, Meghana↗
DOE OSTI2026

A Guide for Public Utility Commissions: Building Internal Technical Capacity and Recruiting Talent for Grid Resilience

This guide offers insight into how PUCs can strategically expand their technical workforce to meet evolving gird resilience demands. It outlines critical skill sets needed to support informed regulatory decision-making around resilience, such as modeling and weather forecasting, electric power systems analysis, and advanced data interpretation. In addition, it provides strategies for developing technical talent both internally and through additional recruitment efforts. Two appendices provide a list of grid resilience training resources and a compendium of sample job descriptions that reflect grid resilience technical expertise for PUC consideration.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case

In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Characterization of mechanical discontinuities based on data-driven classification of compressional-wave travel times

Wave propagation and diffusive transport phenomena are influenced by the mechanical discontinuities in material. Here this study shows that certain bulk properties of the network of low-velocity mechanical discontinuities (e.g. air-filled cracks) in a material can be characterized by processing compressional-wave travel times using traditional data-driven classification techniques. To that end, we perform three tasks in chronological order: (1) use the discrete fracture network (DFN) method to create two-dimensional (2D) numerical models of crack-bearing material embedded with various types of low-velocity mechanical discontinuities, (2) use the fast marching method (FMM) to simulate the propagation of the wave/diffusion front from a single source through the 2D crack-bearing material to multiple receivers placed on the boundary of the material, and (3) train 9 data-driven classifiers to characterize the crack-bearing materials (i.e. bulk properties of the network of mechanical discontinuities in the crack-bearing material) by learning from the simulations of travel times detected by multiple receivers placed around the crack-bearing material. The classifiers identified the orientation, spatial distribution, and dispersion of the low-velocity mechanical discontinuities. Voting classifier performs the best among the 9 classifiers. For the characterization of bulk dispersion and distribution of discontinuities, the sensors located on the adjacent boundaries are more important; whereas for the characterization of bulk orientation of discontinuities, the sensors located on the opposite side are more important.

42 ENGINEERING↗
DOE OSTI2024

Prediction of the Cu oxidation state from EELS and XAS spectra using supervised machine learning

Abstract Electron energy loss spectroscopy (EELS) and X-ray absorption spectroscopy (XAS) provide detailed information about bonding, distributions and locations of atoms, and their coordination numbers and oxidation states. However, analysis of XAS/EELS data often relies on matching an unknown experimental sample to a series of simulated or experimental standard samples. This limits analysis throughput and the ability to extract quantitative information from a sample. In this work, we have trained a random forest model capable of predicting the oxidation state of copper based on its L-edge spectrum. Our model attains an R 2 score of 0.85 and a root mean square error of 0.24 on simulated data. It has also successfully predicted experimental L-edge EELS spectra taken in this work and XAS spectra extracted from the literature. We further demonstrate the utility of this model by predicting simulated and experimental spectra of mixed valence samples generated by this work. This model can be integrated into a real-time EELS/XAS analysis pipeline on mixtures of copper-containing materials of unknown composition and oxidation state. By expanding the training data, this methodology can be extended to data-driven spectral analysis of a broad range of materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Designing a quantum-accurate machine-learning potential to enable large-scale simulations of deuterium under shock

Large-scale molecular dynamics of deuterium under shock can elucidate kinetic processes vital to the target design in inertial confinement fusion and high-energy-density experiments. However, modeling the complex evolution of this material from an insulating molecular state at ambient pressure to an ionized, atomic fluid under strong shock is beyond the capability of simple pair and even bond order potentials. We thus train a quantum-accurate and broadly transferable machine-learning interatomic potential for deuterium using the Chebyshev Interaction Model for Efficient Simulations framework. We show that due to an improved description of the molecular-to-atomic transition, our model is able to better reproduce the ab initio equation of state, radial distribution functions, and principal Hugoniot than bond order potentials. This represents an important step toward large-scale quantum-accurate and nonequilibrium simulations of complicated systems under dynamic changes including phase transitions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensembles

Visualizing the uncertainty of ensemble simulations is challenging due to the large size and multivariate and temporal features of en-semble data sets. One popular approach to studying the uncertainty of ensembles is analyzing the positional uncertainty of the level sets. Probabilistic marching cubes is a technique that performs Monte Carlo sampling of multivariate Gaussian noise distributions for positional uncertainty visualization of level sets. However, the technique suffers from high computational time, making interactive visualization and analysis impossible to achieve. This paper introduces a deep-learning-based approach to learning the level-set uncertainty for two-dimensional ensemble data with a multivariate Gaussian noise assumption. We train the model using the first few time steps from time-varying ensemble data in our workflow. We demonstrate that our trained model accurately infers uncertainty in level sets for new time steps and is up to 170X faster than that of the original probabilistic model with serial computation and 10X faster than that of the original parallel computation.

Han, Mengjiao↗
DOE OSTI2021

Improve Learning from Crowds via Generative Augmentation

Crowdsourcing provides an efficient label collection schema for supervised machine learning. However, to control annotation cost, each instance in the crowdsourced data is typically annotated by a small number of annotators. This creates a sparsity issue and limits the quality of machine learning models trained on such data. In this paper, we study how to handle sparsity in crowdsourced data using data augmentation. Specifically, we propose to directly learn a classifier by augmenting the raw sparse annotations. We implement two principles of high-quality augmentation using Generative Adversarial Networks: 1) the generated annotations should follow the distribution of authentic ones, which is measured by a discriminator; 2) the generated annotations should have high mutual information with the ground-truth labels, which is measured by an auxiliary network. Extensive experiments and comparisons against an array of state-of-the-art learning from crowds methods on three real-world datasets proved the effectiveness of our data augmentation framework. It shows the potential of our algorithm for low-budget crowdsourcing in general.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

Machine Learning the Sixth Dimension: Stellar Radial Velocities from 5D Phase-space Correlations

The Gaia satellite will observe the positions and velocities of over a billion Milky Way stars. In the early data releases, the majority of observed stars do not have complete 6D phase-space information. In this Letter, we demonstrate the ability to infer the missing line-of-sight velocities until more spectroscopic observations become available. Here, we utilize a novel neural network architecture that, after being trained on a subset of data with complete phase-space information, takes in a star's 5D astrometry (angular coordinates, proper motions, and parallax) and outputs a predicted line-of-sight velocity with an associated uncertainty. Working with a mock Gaia catalog, we show that the network can successfully recover the distributions and correlations of each velocity component for stars that fall within ~5 kpc of the Sun. We also demonstrate that the network can accurately reconstruct the velocity distribution of a kinematic substructure in the stellar halo that is spatially uniform, even when it comprises a small fraction of the total star count.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Lessons Learned in Employing Data Analytics to Predict Oxidation Kinetics and Spallation Behavior of High-Temperature NiCr-Based Alloys

Machine learning (ML) can offer many advantages in predicting material properties over traditional materials development methods based solely on limited experimental investigations or physical-based simulations with the capability to reduce development cost, risk, and time. However, so far, limited efforts have been made to predict alloy oxidation kinetics and spallation behavior via ML due to the lack of consistently measured and sufficient experimental data and the inherent complexity in oxidation behavior of multicomponent high-temperature alloys. A previous study reported the ability of ML to predict oxidation kinetics of NiCr-based alloys as a function of alloy composition and operating conditions. Here, the performance of a ML model in predicting rate constants and spallation probability was evaluated in light of the roles of the data distribution of the experimental dataset (data analytics), the alloy composition, the exposure environment and the chosen oxidation approach to extracting kinetic values from the measured mass changes (but using either a simple parabolic law or a statistical cyclic oxidation model). Potential strategies to improve the predictions and enhance the extrapolative capability of the previously trained model will be discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Enhanced dynamic equivalent identification method of large-scale power systems using multiple events

The increasing complexity of the interconnected power system makes high-fidelity dynamic simulation models computationally more intensive. To improve computation efficiency, model reduction techniques have been investigated to only preserve the dynamics in a limited area of interest (study area), while deriving equivalent representation for the external area. For this purpose, a measurement-based reduction approach using system identification techniques has been previously proposed. Accordingly, external areas are represented by dynamic equivalent loads using transfer function estimation. In this paper, in order to enhance the accuracy of the reduced model in preserving dynamics of the study area, multiple “grid” events of different types and at different locations are considered for identifying the parameters of the equivalent loads. Additionally, case studies are carried out in the NPCC 140-bus system. Comparisons are made between multiple events training and single event training, highlighting the advantages of the proposed method in providing a better representation of the grid dynamics under different operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗