Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Foundation models for atomistic simulation of chemistry and materials

Conventional computational methods for modeling chemical and materials systems are limited by system size and timescale, forcing a trade-off between quantum-mechanical accuracy and the sampling needed for realistic observables. Large language and vision foundation models — pre-trained on massive datasets using transformer architectures — have revolutionized many fields. It is thus interesting to ask whether a foundation model — subject to suitable data, parameter scaling and training — could enable learned simulations of chemistry and materials. Here, in this study, we review the field of machine-learned interatomic potentials (MLIPs) and posit that scaling up large and diverse chemical and materials datasets and highly expressive architectures using advanced training strategies should result in models that are: more efficient, transferable, robust to out-of-distribution scenarios, and easier to fine-tune to a variety of downstream physical observables than models trained from scratch on small datasets corresponding to specific, targeted atomistic simulation tasks. We provide specific criteria for creating such large-scale MLIP foundation models, coordinated strategies for their development, evaluation and deployment, and highlight potential emergent capabilities that could transform predictive simulations in chemistry and materials science and accelerate discovery across multiple technological domains.

Yuan, Eric C.-Y. [University of California, Berkel↗

Synthetic data generation for machine learning model training for energy theft scenarios using cosimulation

Abstract Technical and non‐technical losses in distribution circuits result in significant economic costs to power utilities. One type of non‐technical loss is energy theft by various means including illegal tapping of feeders, bypassing the meter, and billing fraud. These losses are usually hard to detect, and can remain undetected for long periods of time. Machine learning models have been proven effective in detecting these conditions, but rely on the availability of large, good‐quality training data sets. The problem is exacerbated by the imbalanced nature of data related to these conditions—energy theft, though costly, is very rare. The available data sets generally have very few samples of theft with most of the data pertaining to normal operation. Such data sets are generally not suitable to train machine learning models. In this paper, an overview of energy theft detection techniques, the challenges with their data needs, and the limitations of current techniques to bridge such data limitations is presented. A co‐simulation framework is proposed to generate reliable training data for machine learning algorithms for theft detection. An example scenario is presented and a machine learning model is built to detect certain kinds of energy theft.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of an Interactive Valuation Model for Distributed Energy Resource Value

The Oklahoma Secretary of Commerce & Tourism (OSCT) seeks to address perceived challenges and barriers to the deployment of distributed energy generation resources (DERs), including solar and other technologies, in the state of Oklahoma. The Scope of Work (SOW) outlines follow-on tasks related to the previous CRADA # CRD-18-762. The first task will finalize the Interactive Valuation Model Requirements Document, the final draft of which was provided in June 2018. The second task includes the building, validation, and finalization of the interactive valuation model for expressing distributed energy resource value based on user inputs to be completed by June 30, 2019. Training for how to prepare the data inputs and use the model will also be provided. To address perceived challenges and barriers to the deployment of distributed energy generation resources (DERs), including solar and other technologies, in the state of Oklahoma, the work under this CRADA will: 1) finalize the draft Interactive Valuation Model Requirements Document delivered in June 2018; 2) finish building and validating the interactive valuation model for expressing DER value based on user inputs, and 3) provide training for use of this model.

14 SOLAR ENERGY↗

Using Satellite Observations of Cloud Vertical Distribution to Improve Global Model Estimates of Cloud Radiative Effect on Key Tropospheric Oxidants

Radiative effect of clouds is one of the major factors that affect tropospheric OH. Large differences in cloud distributions among current (chemistry-climate or chemical transport) models could contribute significantly to the wide model spread of tropospheric OH, which was reported by the ACCMIP activity (Voulgarakis et al., ACP 2013). CCCM, a 3-D cloud data product developed at NASA Langley and merged from multiple A-Train satellite observations, provides unprecedentedly strong constraints on the vertical distribution of clouds and therefore simulated effects of clouds on key tropospheric oxidants.

Liu, Hongyu↗

An adaptable product for material processing and life science missions

The Experiment Control System II (ECS-II) is designed to make available to the microgravity research community the same tools and mode of automated experimentation that their ground-based counterparts have enjoyed for the last two decades. The design goal was accomplished by combining commercial automation tools familiar to the experimenter community with system control components that interface with the on-orbit platform in a distributed architecture. The architecture insulates the tools necessary for managing a payload. By using commercial software and hardware components whenever possible, development costs were greatly reduced when compared to traditional space development projects. Using commercial-off-the-shelf (COTS) components also improved the usability documentation, and reducing the need for training of the system by providing familiar user interfaces, providing a wealth of readily available documentation, and reducing the need for training on system-specific details. The modularity of the distributed architecture makes it very amenable for modification to different on-orbit experiments requiring robotics-based automation.

Wassick, Gregory↗

Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning

We reconstruct the extra-galactic gamma-ray source-count distribution, or dN/dS, of resolved and unresolved sources by adopting machine learning techniques. Specifically, we train a convolutional neural network on synthetic 2-dimensional sky-maps, which are built by varying parameters of underlying source-counts models and incorporate the Fermi-LAT instrumental response functions. The trained neural network is then applied to the Fermi-LAT data, from which we estimate the source count distribution down to flux levels a factor of 50 below the Fermi-LAT threshold. We perform our analysis using 14 years of data collected in the (1,10) GeV energy range. The results we obtain show a source count distribution which, in the resolved regime, is in excellent agreement with the one derived from cataloged sources, and then extends as dN/dS ~ S -2 in the unresolved regime, down to fluxes of 5 · 10 -12 cm -2 s -1 . The neural network architecture and the devised methodology have the flexibility to enable future analyses to study the energy dependence of the source-count distribution.

79 ASTRONOMY AND ASTROPHYSICS↗

Vehicle Dynamics due to Magnetic Launch Propulsion

The field of Magnetic Levitation Lind Propulsion (MagLev) has been around for over 30 years, primarily in high-speed rail service. In recent years, however, NASA has been looking closely at MagLev as a possible first stage propulsion system for spacecraft. This approach creates a variety of new problems that don't currently exist with the present MagLev trains around the world. NASA requires that a spacecraft of approximately 120,000 lbs be accelerated at two times the acceleration of gravity (2g's). This produces a greater demand on power over the normal MagLev trains that accelerate at around 0.1g. To be able to store and distribute up to 3,000 Mega Joules of energy in less than 10 seconds is a technical challenge. Another problem never addressed by the train industry and, peculiar only to NASA, is the control of a lifting body through the acceleration of and separation from the MagLev track. Very little is understood about how a lifting body will react with external forces, Such as wind gusts and ground effects, while being propelled along on soft springs such as magnetic levitators. Much study needs to be done to determine spacecraft control requirements as well as what control mechanisms and aero-surfaces should be placed on the carrier. Once the spacecraft has been propelled down the track another significant event takes place, the separation of the spacecraft from the carrier. The dynamics involved for both the carrier and the spacecraft are complex and coupled. Analysis of the reaction of the carrier after losing, a majority of its mass must be performed to insure control of the carrier is maintained and a safe separation of the spacecraft is achieved. The spacecraft angle of attack required for lift and how it will affect the carriage just prior to separation, along with the impacts of around effect and aerodynamic forces at ground level must be modeled and analyzed to define requirements on the launch vehicle design. Mechanisms, which can withstand the expected forces and allow the spacecraft to separate at the desired time must be developed. Modeling and analysis of the full-scale system must be developed to derive the requirements for design of the separation mechanisms. A description of several MagLev demonstrators will be presented and the testing and analysis to model the demonstrators will be included.

Galaboff, Zachary J.↗

Impact of the Dominant Large-scale Teleconnections on Winter Temperature Variability over East Asia

Monthly mean geopotential height for the past 33 DJF seasons archived in Modern Era Retrospective analysis for Research and Applications reanalysis is decomposed into the large-scale teleconnection patterns to explain their impacts on winter temperature variability over East Asia. Following Arctic Oscillation (AO) that explains the largest variance, East Atlantic/West Russia (EA/WR), West Pacific (WP) and El Nino-Southern Oscillation (ENSO) are identified as the first four leading modes that significantly explain East Asian winter temperature variation. While the northern part of East Asia north of 50N is prevailed by AO and EA/WR impacts, temperature in the midlatitudes (30N-50N), which include Mongolia, northeastern China, Shandong area, Korea, and Japan, is influenced by combined effect of the four leading teleconnections. ENSO impact on average over 33 winters is relatively weaker than the impact of the other three teleconnections. WP impact, which has received less attention than ENSO in earlier studies, characterizes winter temperatures over Korea, Japan, and central to southern China region south of 30N mainly by advective process from the Pacific. Upper level wave activity fluxes reveal that, for the AO case, the height and circulation anomalies affecting midlatitude East Asian winter temperature is mainly located at higher latitudes north of East Asia. Distribution of the fluxes also explains that the stationary wave train associated with EA/WR propagates southeastward from the western Russia, affecting the East Asian winter temperature. Investigation on the impact of each teleconnection for the selected years reveals that the most dominant teleconnection over East Asia is not the same at all years, indicating a great deal of interannual variability. Comparison in temperature anomaly distributions between observation and temperature anomaly constructed using the combined effect of four leading teleconnections clearly show a reasonable consistency between them, demonstrating that the seasonal winter temperature distributions over East Asia are substantially explained by these four large-scale circulation impacts.

El Nino-Southern Oscillation↗

Improving Solar and Solar+Storage Screening Techniques to Reduce Utility Interconnection Time and Costs (Final Technical Report)

Residential PV installations have increased rapidly over the last decade, and the increased application volume has caused permitting delays and lower overall adoption rates. In this project, we developed and evaluated whether data-driven secondary modeling and screening techniques can help utilities assess customer applications more accurately than traditional screening shortcuts. Secondary topologies are predicted using decision trees and commonly available information, such as service transformer, customer, and street locations. Conductors were predicted using a logistic regression method based on real world object (RWO) types, service transformer ratings, conductor length, and distance to transformer. After developing the combined primary and secondary distribution network model, hosting capacity results were used to train a random forest model to predict the pass/fail likelihood of a customer application. Powerflow based models with predicted secondaries and data-driven methods both increased the screening success rate, relative to common utility heuristics, by as much as 55 percentage points. Data-driven screening techniques were described by one utility as a "right-sized" approach for residential customers given the low-risk of small errors and the high-cost of accurate modeling.

14 SOLAR ENERGY↗

Generative adversarial networks for scintillation signal simulation in EXO-200

Generative Adversarial Networks trained on samples of simulated or actual events have been proposed as a way of generating large simulated datasets at a reduced computational cost. In this work, a novel approach to perform the simulation of photodetector signals from the time projection chamber of the EXO-200 experiment is demonstrated. The method is based on a Wasserstein Generative Adversarial Network — a deep learning technique allowing for implicit non-parametric estimation of the population distribution for a given set of objects. Our network is trained on real calibration data using raw scintillation waveforms as input. We find that it is able to produce high-quality simulated waveforms an order of magnitude faster than the traditional simulation approach and, importantly, generalize from the training sample and discern salient high-level features of the data. In particular, the network correctly deduces position dependency of scintillation light response in the detector and correctly recognizes dead photodetector channels. Furthermore, the network output is then integrated into the EXO-200 analysis framework to show that the standard EXO-200 reconstruction routine processes the simulated waveforms to produce energy distributions comparable to that of real waveforms. Finally, the remaining discrepancies and potential ways to improve the approach further are highlighted.

47 OTHER INSTRUMENTATION↗

Solving inverse problems in stochastic models using deep neural networks and adversarial training

Inverse problems associated with stochastic models constitute a significant portion of scientific and engineering applications. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their demanding assumptions or prohibitive computational consumption; for example, maximum likelihood methods require closed-form density functions, and Markov Chain Monte Carlo needs a large number of simulations. We propose a new method that estimates the unknown distribution by matching the statistical properties between observed and simulated random processes. We leverage the expressive power of neural networks to approximate the unknown distribution and use a discriminative neural network for computing the statistical discrepancies between the observed and simulated random processes. Here we demonstrated numerically that the proposed methods can estimate both the model parameters and learn complicated unknown distributions.

42 ENGINEERING↗

Voltage Calculations in Secondary Distribution Networks via Physics-Inspired Neural Network Using Smart Meter Data

The increasing penetration of distributed energy resources (DERs) leads to voltage issues across distribution networks, necessitating voltage calculations by utilities. Electric model-free voltage calculation offers an enticing solution. However, most researches mainly focus on primary distribution networks ignoring secondary distribution networks and commonly overlook extreme voltage case calculations, which require the model’s extrapolation abilities. Here, in addressing the gaps, this paper presents a customized physics-inspired neural network (PINN) model, the structure of which is inspired by the derived coupled power flow model of primary-secondary distribution networks. To ensure precision and rapid convergence, a crafted training framework for the PINN model is proposed. The PINN’s “structure-mimetic” design enables superior extrapolation for unseen scenarios and enhances physical information awareness. We demonstrate this through two applications: hosting capacity analysis and customer-transformer connectivity. The effectiveness and advantages of the proposed PINN model are validated on two public testing systems and one utility distribution feeder model.

Distribution network↗

Three-Dimensional Structure and Modeling of a Normal Bifurcated Shock Train from Experimental Measurements

An asymmetric, bifurcated normal shock train in a Mach 2 constant area, rectangular duct is investigated in the University of Michigan Direct Connect Isolator facility. High-speed schlieren imaging, wall static pressure measurements, surface oil flow visualization, and particle image velocimetry of a shock train are synthesized into a three-dimensional representation of shock train structure. This visualization is then used to inform the underlying flow physics of the distributed fluid dynamical processes along the structure. The detailed, three-dimensional morphology of the flow profile entering the shock train is shown to have a significant impact on the separated flow morphology of the shock train. This results in skewed supersonic core flow with alternating separation bubbles in the surrounding boundary layers. Finally, the efficacy of the prevailing pseudo-shock models in the literature is analyzed with the support of the available flow measurements. None are found to simultaneously model both the pressure and streamwise Mach number profile of the UMDCI pseudo-shock.

Hypersonics↗

Reinforcement Learning for Volt- Var Control: A Novel Two-stage Progressive Training Strategy

This paper develops a reinforcement learning (RL) approach to solve a cooperative, multi-agent Volt-Var Control (VVC) problem for high solar penetration distribution systems. The ingenuity of our RL method lies in a novel two-stage progressive training strategy that can effectively improve training speed and convergence of the machine learning algorithm. In Stage 1 (individual training), while holding all the other agents inactive, we separately train each agent to obtain its own optimal VVC actions in the action space: fconsume, generate, do-nothingg. In Stage 2 (cooperative training), all agents are trained again coordinatively to share VVC responsibility. Rewards and costs in our RL scheme include (i) a system-level reward (for taking an action), (ii) an agent-level reward (for doing-nothing), and (iii) an agent-level action cost function. This new framework allows rewards to be dynamically allocated to each agent based on their contribution while accounting for the trade-off between control effectiveness and action cost. The proposed methodology is tested and validated in a modified IEEE 123-bus system using realistic PV and load profiles. Simulation results confirm that the proposed approach is robust and computationally efficient; and it achieves desirable volt-var control performance under a wide range of operation conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

This paper proposes a model-free decentralized control framework for the voltage regulation of large-scale distribution systems through the coordinated control of PV inverters. This is achieved by developing a novel interaction mechanism between the surrogate model and the centralized training and decentralized execution multiagent deep reinforcement learning framework. Specifically, the sparse Gaussian processes regression method is first utilized to develop the surrogate model of the original distribution system for reward calculation during the training stage, where each agent represents a sub-region in the centralized fashion for coordination strategy learning. After that, the learned control rules are used to inform controllers within each sub-region for real-time decisions with only local measurements. Comparative tests among various methods on the EPRI Ckt5 test system demonstrate the effectiveness of the proposed method.

distribution system↗

Object detection with deep learning for rare event search in the GADGET II TPC

In the pursuit of identifying rare two-particle events within the GADGET II Time Projection Chamber (TPC), this paper presents a comprehensive approach for leveraging Convolutional Neural Networks (CNNs) and various data processing methods. To address the inherent complexities of 3D TPC track reconstructions, the data is expressed in 2D projections and 1D quantities. This approach capitalizes on the diverse data modalities of the TPC, allowing for the efficient representation of the distinct features of the 3D events, with no loss in topology uniqueness. Additionally, it leverages the computational efficiency of 2D CNNs and benefits from the extensive availability of pre-trained models. Given the scarcity of real training data for the rare events of interest, simulated events are used to train the models to detect real events. To account for potential distribution shifts when predominantly depending on simulations, significant perturbations are embedded within the simulations. This produces a broad parameter space that works to account for potential physics parameter and detector response variations and uncertainties. These parameter-varied simulations are used to train sensitive 2D CNN object detectors. When combined with 1D histogram peak detection algorithms, this multi-modal detection framework is highly adept at identifying rare, two-particle events in data taken during experiment 21072 at the Facility for Rare Isotope Beams (FRIB), demonstrating a 100% recall for events of interest. Here, we present the methods and outcomes of our investigation and discuss the potential future applications of these techniques.

Convolutional neural network↗

Harnessing Machine Learning and Data Fusion for Accurate Undocumented Well Identification in Satellite Images

This study utilizes satellite data to detect undocumented oil and gas wells, which pose significant environmental concerns, including greenhouse gas emissions. Three key findings emerge from the study. Firstly, the problem of imbalanced data is addressed by recommending oversampling techniques like Rotation–GaussianBlur–Solarization data augmentation (RGS), the Synthetic Minority Over-Sampling Technique (SMOTE), or ADASYN (an extension of SMOTE) over undersampling techniques. The performance of borderline SMOTE is less effective than that of the rest of the oversampling techniques, as its performance relies heavily on the quality and distribution of data near the decision boundary. Secondly, incorporating pre-trained models trained on large-scale datasets enhances the models’ generalization ability, with models trained on one county’s dataset demonstrating high overall accuracy, recall, and F1 scores that can be extended to other areas. This transferability of models allows for wider application. Lastly, including persistent homology (PH) as an additional input improves performance for in-distribution testing but may affect the model’s generalization for out-of-distribution testing. A careful consideration of PH’s impact on overall performance and generalizability is recommended. Overall, this study provides a robust approach to identifying undocumented oil and gas wells, contributing to the acceleration of a net-zero economy and supporting environmental sustainability efforts.

SMOTE↗

Updimensioning strategy derived from synthetic equiaxed grain structures for approximating 3D grain size distributions from 2D visualizations with 1D parameters

We generated synthetic equiaxed grain structures using computer graphics software to explore the relationship between various grain size determination methods and true three-dimensional (3D) grain diameters. Mirroring grain measurement techniques, the synthetic 3D grain structures are imaged as 2D micrographs which are measured to yield 1D grain size parameters. Synthetic grain structures provide data at a mass scale and permit exploration of both polished and fractured surface micrographs, revealing one-to-one correspondence between exposed 2D grain cross-sections and individual 3D grains. Analysis of this correspondence yielded a procedure to approximate 3D equiaxed grain size and volume distributions based on the mode of the 2D fractograph grain size distribution. The 3D approximation procedure is shown to be less susceptible to different imaging conditions that affect small, undiscernible grains compared to the standard planimetric and linear intercept methods, which by design also tend to underestimate the 3D grain diameter. The procedure requires larger sample sizes to lower variance and a deeper analysis which could become more practical with machine learning (ML) models for grain boundary segmentation, which synthetic grain structures can help train. This work lays the foundation for analyzing other grain distributions such as columnar and composite grains in similar depth.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗