Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Angularly resolved photoionization dynamics in atoms and molecules combining temporally and spectrally resolved experiments at ATTOLab and Synchrotron SOLEIL

We report results for XUV-IR two-photon ionization of Ar, Ne, NO, and O2, where an XUV attosecond pulse train is superimposed with a synchronized IR pulse, obtained at the ATTOLab laser facility using electron–ion coincidence 3D momentum spectroscopy. Temporally resolved photoelectron angular distributions providing angle-resolved time-delays for np ionization of Ar and Ne, achieved by reconstruction of attosecond beating by interference of two-photon transitions through a unified formalism (Joseph et al. in J Phys B At Mol Opt Phys 53:184007, 2020), are summarized. For inner valence XUV-IR dissociative photoionization of NO and O2 molecules, we report electron–ion kinetic energy correlation diagrams and disentangle the dissociative photoionization processes relying on parallel XUV experiments at Synchrotron SOLEIL. For ionization into the NO+(c3Π) ionic state, extending the formalism developed for single-photon ionization, we focus on photoelectron angular distributions averaged on the delay between the XUV and the IR field in the field frame, molecular frame, and electron frame of reference.

Joseph, J↗
DOE OSTI2020

Probabilistic predictions and uncertainty estimation for radiological and nuclear effects modeling

Better characterization of meteorological uncertainty is needed to predict the effects of radiological and nuclear releases in the atmosphere. Multi-physics ensembles of atmospheric simulations can estimate uncertainty of physical processes, but they are often limited for computational reasons. Because weather uncertainty is important for emergency response applications, but the conventional way of running multi-physics ensembles is infeasible, we have developed new machine learning-based methods that quickly estimate and identify key sources of meteorological uncertainty. Machine learning accelerates the analysis of weather uncertainty by iteratively learning about model physics options that affect plume predictions. We have demonstrated the power of machine learning by creating a large multi-physics weather and dispersion ensemble dataset containing 1,200 simulations for two hypothetical radiological release scenarios. By training on less than 10% of the ensemble, we can quickly and accurately predict different outcomes, including the mass of radiological material deposited and spatial distribution and extent of contaminated areas.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Hyperspectral remote sensing-based plant community map for region around NGEE-Arctic intensive research watersheds at Seward Peninsula, Alaska, 2017-2019

Using airborne hyperspectral remote sensing data from NASA Airborne Visible-Infrared Imaging Spectrometer- Next Generation (AVIRIS-NG) platforms in a region near NGEE-Arctic intensive watersheds at Seward peninsula of Alaska, high resolution (5m) maps of plant community distribution were developed and included in this data collected. AVIRIS-NG data collected over 2017-2019 period were used to develop deep neural networks, trained using vegetation plot observations collected at NGEE-Arctic watersheds at Kougarok, Council and Teller. A hierarchical vegetation classification scheme consisting of six classes at Level I, and 16 classes at Level II contained in two .txt files were used to developed the plant community maps for the region. Two geospatial raster data files (.tif) at both thematic levels are shared in this data collection. Data files in this collection use Alaska Albers Equal Area projection. Readme files available in three formats (*.html, *.md, *.pdf) and one *.png visualization map.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Tangible Solutions for Grid Operation Upgrade

Many countries worldwide are setting clean energy targets to decarbonize the energy sector and add higher wind and solar capacities. Given their distributed nature, variable renewable energy (VRE) assets can have unique grid integration considerations, and require grid operation practices to be modernized. When transitioning to higher renewable energy levels, many system operators configure a dedicated renewable energy desk to manage renewable energy resource operation in the system control center. Further, system operation planning is conducted with VRE and load forecasting to enable reliable real-time system operation. NREL has partnered with many system operators in the region to identify appropriate technology and grid modernization solutions. NREL and partners from system operators in the region will present on the challenges and some solutions that have been applied and share best practices such as energy management system upgrades, VRE forecasting framework, grid flexibility improvements, and staff training.

emerging economies↗
DOE OSTI2021

DSP Implementation of a Novel Recurrent Neural Network Controller into a TI Solar Microinverter

Single-phase grid-tied inverters are widely used to integrate small-scale renewable energy sources and distributed generations to the utility grid. A novel Recurrent Neural Network (RNN) current controller is introduced to solve the resonant problem associated with LCL based inverters. The well-trained RNN controller was validated through a Texas Instruments (TI) LCL filter based solar microinverter kit that contains a C2000 TI microcontroller. The inverter closed current loop test without the grid connection was conducted in a laboratory setup to verify the RNN contoller functionality. The laboratory waveform results verified that the RNN current controller produced the strong tracking of the measured inverter AC current to its reference value even at a low sampling frequency of 5KHz. The proposed RNN current controller also proved to perform better than the built-in three-pole-three-zero (3P3Z) current controller provided by TI and produce lower values of Total Harmonic Distortion (THD).

digital signal processor↗
DOE OSTI2020

Spatial Mapping of Riverbed Grain-Size Distribution Using Machine Learning

Recent alluvial sediments in riverbeds play a significant role in controlling hydrologic exchange flows (HEFs) in river systems. The alluvial layer is usually associated with strong heterogeneity in physical properties (e.g., permeability and hydraulic conductivity), which affects local HEFs and therefore biogeochemical processes. The spatial distribution of these physical properties needs to be determined to inform the numerical models used to reveal the realistic hydro-biogeochemical behaviors. Such information can be obtained based on the intrinsic link between sediment grain-size distribution and hydraulic properties where sediment texture information is available. However, grain-size measurements are usually spatially sparse and do not have adequate coverage and resolution, particularly for a relatively large domain such as the Hanford Reach of the Columbia River. In this paper, we adopted machine learning (ML) approaches for categorizing and mapping the spatial distributions of riverbed substrate grain size and filling in missing areas of substrate data using the ML models along the reach. Such ML models for substrate size mapping were trained at 13,372 locations using measured substrate sizes along with observed and simulated attributes, including bathymetric attributes (e.g., elevation, slope, and aspect ratio) from LIDAR and bathymetric surveys, and hydrodynamic properties (e.g., water depth, velocity, shear stress, and their statistical moments). An ensemble bagging-based ML technique, Random Forest, was adopted to identify the most influential factors as predictors to develop the predictive models with over-fitting issues addressed. The models were evaluated with respect to each individual substrate size class and the lumped group, and then used to generate the final substrate size maps covering all the grid cells in the numerical modeling domain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Business Continuity, Cybersecurity, and Backup Control Center: Standards, References, and Recommendations (White Paper)

This Whitepaper provides an overview and synopsis of relevant standards for Control Center, Cyber Security and Continuity of Operations for electric power utilities. It also provides suggestions and recommendations for the outline of a cybersecurity plan and a business continuity plan, and suggests training and certification opportunities for both cybersecurity and business continuity.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We suggest a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118-and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118- and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

alternating direction method of multipliers↗
DOE OSTI2024

Visibility-enhanced model-free deep reinforcement learning algorithm for voltage control in realistic distribution systems using smart inverters

Increasing integration of distributed solar photovoltaic (PV) into distribution networks could result in adverse effects on grid operation. Traditional model-based control algorithms require accurate model information that is difficult to acquire and thus are challenging to implement in practice. Here, this paper proposes a surrogate model-enabled grid visibility scheme to empower deep reinforcement learning (DRL) approach for distribution network voltage regulation using PV inverters with minimal system knowledge. In contrast to existing DRL methods, this paper presents and corroborates the adverse impact of missing load information on DRL performance and, based on this finding, proposes a surrogate model methodology to impute load information utilizing observable data. Additionally, a multi-fidelity neural network is utilized to construct the DRL training environment, chosen for its efficient data utilization and enhanced robustness to data uncertainty. The feasibility and effectiveness of the proposed algorithm are assessed by considering DRL testing across varying degrees of observable load information and diverse training environments on a realistic power system.

14 SOLAR ENERGY↗
DOE OSTI2025

Fast meta-solvers for 3D complex-shape scatterers using neural operators trained on a non-scattering problem

Three-dimensional target identification using scattering techniques requires high accuracy solutions and very fast computations for real-time predictions in some critical applications. We first train a deep neural operator (DeepONet) to solve wave propagation problems described by the Helmholtz equation in a domain without scatterers but at different wavenumbers and with a complex absorbing boundary condition. We then design two classes of fast meta-solvers by combining DeepONet with either relaxation methods, such as Jacobi and Gauss-Seidel, or with Krylov methods, such as GMRES and BiCGStab, using the trunk basis of DeepONet as a coarse-scale preconditioner. We leverage the spectral bias of neural networks to account for the lower part of the spectrum in the error distribution while the upper part is handled inexpensively using relaxation methods or fine-scale preconditioners. The meta-solvers are then applied to solve scattering problems with different shape of scatterers, at no extra training cost. We first demonstrate that the resulting meta-solvers are shape-agnostic, fast, and robust, whereas the standard standalone solvers may even fail to converge without the DeepONet. We then apply both classes of meta-solvers to scattering from a submarine, a complex three-dimensional problem. We achieve very fast solutions, especially with the DeepONet-Krylov methods, which require orders of magnitude fewer iterations than any of the standalone solvers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Transfer learning for probabilistic localization of hidden cracks in concrete structures

Abstract The utility of discriminative supervised learning models built using multiple training-data sources is investigated for hidden crack localization in concrete. Feed-forward neural network (FFNN) is chosen as the model architecture, and transfer learning is used to assimilate the information obtained from different sources (computational physics simulations and laboratory experiments). The labeled training data consists of values of a damage index and the known locations of hidden cracks. The classification models need to learn how the presence of damage (hidden cracks) affects the damage index at different sensors for different test conditions. To this end, diagnostic FFNN models are built by sequentially adding and training new hidden layers to assimilate labeled information from computer models (different model geometries, test conditions, crack lengths, crack locations) and laboratory experiments on a plain cement slab. These transfer learning-based models are then used to localize damage in concrete specimens that reflect real-world conditions (i.e., specimens with steel reinforcement and randomly distributed aggregate). The actual damage state in these specimens is determined by extracting cores and performing petrographic studies on the extracted cores. The damage probability estimated by transfer learning-based models is compared with the petrographic damage rating index (DRI) to identify the most suitable approach to train the diagnostic models. The transfer learning-based diagnostic methodology shows promise and could be used in various structural health monitoring applications, where sufficient labeled data are typically not available from a single data source.

Miele, S.↗
DOE OSTI2021

Application of machine learning for the estimation of electron energy distribution from optical emission spectra

Abstract This paper discusses the use of probabilistic deep neural networks for the prediction of the electron energy probability function in low-temperature non-thermal plasmas. The neural networks are trained using optical emission spectroscopy and Langmuir probe measurements, with the goal of providing a reliable estimate of the electron energy probability function solely from optical emission data. The performance of both non-Bayesian and Bayesian networks is evaluated. It is found that Bayesian models are preferable as they assign a higher level of uncertainty to their prediction especially when the dataset used to train them is small. This work describes one of the many potential applications of machine learning in plasma science and technology.

Physics↗
DOE OSTI2024

Convolutional Neural Network-Based Protection-Zone Classification of Faults in Distribution Feeders with Photovoltaics.

Fault detection and isolation is critical for reliable operation of distribution systems. The ride-through requirements for the distributed energy resources (DER), mandated by the IEEE 1547-2018 standard, makes it challenging to use undervoltage (UV) conditions for fault detection. In addition, with low fault current contribution from these inverter-based DERs, the time-overcurrent relays are also less effective. Thus motivated, this paper presents a learning-based approach for fault detection and localization. A convolutional neural network (CNN)-based model is proposed which uses local voltage and current waveforms from DER locations and feeder substations, for training a zonal classifier. The classifier can be adopted into any relay-like device for discriminating between faults originating from different protection zones. The performance of the proposed approach was tested on publicly available test feeders with distributed photovoltaics (PVs).

Fault localization, convolutional neural networks,↗
DOE OSTI2024

Physics-coupled data-driven design of high-temperature alloys

We present a materials design loop, which streamlines physics-coupled machine learning (ML) surrogate models to discover new alloy chemistries with improved properties. The efficacy is demonstrated by discovering a high-temperature alumina-forming austenitic (AFA) stainless steel with enhanced creep, followed by experimental validation. The ML models have been trained using a well-curated, highly consistent experimental dataset augmented with synthetic microstructural features from a computational thermodynamic approach. We have populated a large number of hypothetical AFA alloys to explore the high-dimensional composition space and have predicted their creep properties by providing the same synthetic input features obtained from the trained ML models. Uncertainties from the ML training were taken as thresholds for truncating predicted results to identify alloys with improved or deteriorated creep. Individual elemental compositions have been determined via probability density distribution analysis from the group of alloys at the top and bottom of the predicted creep values for further virtual and experimental validations. In conclusion, we anticipate that this workflow can be applied to screen desired conditions, such as chemistry and processing parameters, in high-dimensional space through physics-guided data analytics.

Alloy design↗
DOE OSTI2024

At Risk Population Estimates for Belarus, Poland and Slovakia with Machine Learning

High-resolution gridded population modeling is crucial for various applications, including disaster response planning, infectious disease spread modeling, climate change impact estimation, policy development, and more. Multiple gridded population datasets have been developed, each tailored to meet specific objectives. Among them, LandScan Global dataset is designed to represent ambient and unwarned population distributions. However, this dataset relies on a statistical approach that requires manual adjustments, making it time consuming and labour intensive. Existing machine learning (ML) methods often train and test at different spatial resolutions, potentially leading to inflated results, and they rely on Census population totals for disaggregation. To address these limitations, in this study we developed population estimates using ML models trained and tested at a consistent 30 arc-second resolution (≈1 square kilometer), specifically using Random Forest (RF) and XGBoost. These models were trained on 2020 datum to predict for 2021 for three countries: Belarus, Poland, and Slovakia. Our findings show that both RF (MAE varies from 5.75 to 13.25) and XGBoost (MAE varies from 8.15 to 23.44) model performance is close to LandScan Global estimates. Furthermore, neither of the models performed the best across all grid cells: the RF model was more effective in areas with lower populations, while XGBoost excelled in more densely populated regions. The proposed approach can be used for countries where the Census data is not available.

Lebakula, Viswadeep [ORNL] (ORCID:0000000152935914↗
DOE OSTI2021

Branching Dueling Q-Network Based Online Scheduling of a Microgrid With Distributed Energy Storage Systems

This letter investigates a Branching Dueling Q-Network (BDQ) based online operation strategy for a microgrid with distributed battery energy storage systems (BESSs) operating under uncertainties. Additionally, the developed deep reinforcement learning (DRL) based microgrid online optimization strategy can achieve a linear increase in the number of neural network outputs with the number of distributed BESSs, which overcomes the curse of dimensionality caused by the charge and discharge decisions of multiple BESSs. Numerical simulations validate the effectiveness of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

NNSA Minority Serving Institute Partnership Program (MSIPP)— Advanced Synergistic Program for Indigenous Research in Engineering (ASPIRE) (FY22 Q1 Progress Report)

In 2016, the National Nuclear Security Agency (NNSA) initiated the Minority Serving Institution Partnership Plan (MSIPP) targeting Tribal Colleges and Universities (TCUs) to offer programs that will prepare students for technical careers in NNSA’s laboratories and production plants. The MSIPP consortium’s approach is as follows: 1) align investments at the college and university level to develop a curriculum and workforce needed to support NNSA’s nuclear weapon enterprise mission, and 2) to enhance research and education at under-represented colleges and universities. The first TCU consortium that MSIPP launched was known as the Advanced Manufacturing Network Initiative (AMNI) whose purpose was to develop additive manufacturing (AM) learning opportunities. The AMNI consortium consisted of Bay Mills Community College, Cankdeska Cikana Community College, Navajo Tech University, Salish Kootenai Community College, Turtle Mountain Community College, and United Tribes Technical College. In 2016, the American Indian Higher Education Consortium (AIHEC), the AMNI consortium and the Southwestern Indian Polytechnic Institute (SIPI), in collaboration with Sandia National Labs, using a grant by NNSA hosted the first TCU Advanced Manufacturing Technology Summer Institute (TCU AMTSI). The AMNI consortium will officially end Sept. 2022. However, building on the successes of AMNI, in FY22 NNSA’s MSIPP launched three additional consortiums: (1) the Indigenous Mutual Partnership to Advanced Cybersecurity Technology (IMPACT), which focuses on STEM and cybersecurity, (2) the Advanced Synergistic Program for Indigenous Research in Engineering (ASPIRE), which focuses on STEM and the electrical and mechanical engineering skills set needed for renewable and distributed energy systems, and (3) the Partnership for Advanced Manufacturing Education and Research (PAMER), which focuses on developing and maintaining a sustainable pathway for a highly trained, next-generation additive manufacturing workforce and a corresponding community of subject matter experts for NNSA enterprises. The following report summarizes the status update during this quarter for the ASPIRE program.

42 ENGINEERING↗