Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Time-Based CAN Intrusion Detection Benchmark

Modern vehicles are complex cyber-physical systems made of hundreds of electronic control units (ECUs) that communicate over controller area networks (CANs). This inherited complexity has expanded the CAN attack surface by the injection of malicious messages that vary their time-based characteristics. To detect these malicious messages, time-based intrusion detection systems (IDS) have been proposed. However, time-based IDS are usually trained and tested on low-fidelity datasets with unrealistic labeled attacks. This makes difficult the task of evaluating, comparing, and validating IDS. Here we detail and benchmark four time-based IDS in a dataset with real and advanced attacks. We found that methods with strong assumptions regarding the distribution of inter-arrival times have lower performance than distribution agnostic based methods. In particular, distribution agnostic based methods outperform distribution based methods at least on $55\%$ in area under the precision-recall (AUC-PR) curve. Our results expand the body of knowledge of CAN time-based IDS by providing details of these methods and reporting their results when tested on datasets with real and advanced attacks. We describe limitations, open challenges, and how lessons learnt from this research can inform the design of deployable time-based IDS in modern vehicles.

Blevins, Deborah↗
DOE OSTI2021

A Data-Driven Framework for Automated Detection of Aircraft-Generated Signals in Seismic Array Data Using Machine Learning

Abstract Ground motions associated with aircraft overflights can cover a significant portion of the seismic data collected by shallowly emplaced seismometers, such as new nodal and Distributed Acoustic Sensing systems. This article describes the first published framework for automated detection of aircraft on single channel and multichannel seismic data. The seismic data are converted to spectrograms in a sliding time window and classified as aircraft or nonaircraft in each window using a deep convolutional neural network trained with analyst-labeled data. A majority voting scheme is used to convert the output from the sequence of sliding time windows onto a decision time sequence for each channel and to combine the binary classifications on the decision time sequences across multiple channels. Precision, recall, and F-score are used to quantify the detection performance of the algorithm on nodal data using fourfold time-series cross validation. By applying our framework to data from the Sage Brush Flats nodal array in Southern California, we provide a benchmark performance and demonstrate the advantage of using an array of sensors.

Geochemistry & Geophysics↗
DOE OSTI2023

Battery inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 30 kW off-the-shelf grid following battery inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.9 to 1.1 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59 Hz to 61 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1975

Coastal Zone Classification from Satellite Imagery

The author has identified the following significant results. Studies of cover distribution along Delaware's coast, especially in tidal wetlands, were made utilizing semi-automated analysis of LANDSAT-1 MSS digital data. Cover maps with eleven vegetation and other cover categories were produced with accuracy of identification above 80% in all categories. Recent studies have tested a new technique for training automated analysis which uses ground measured reflectance and atmospheric correction techniques to derive signatures for specific categories in preference to the relative radiance signatures derived from training sets within the LANDSAT data itself. Initial tests using a four category scheme indicate that training data based on absolute measured reflectance and atmospheric correction of LANDSAT data can produce comparable accuracy of categorization to that achieved using more conventional relative radiance training.

Klemas, V.↗
NASA NTRS1976

Coastal zone classification from satellite imagery

The author has identified the following significant results. Studies of cover distribution along Delaware's coast, especially in tidal wetlands, were made, utilizing semi-automated analysis of LANDSAT-1 MSS digital data. Cover maps with eleven vegetation and other cover categories were produced with accuracy of identification above 80% in all categories. Recent studies have tested a new technique for training automated analysis which uses ground measured reflectance and atmospheric correction techniques to derive signatures for specific categories in preference to the relative radiance signatures derived from training sets within LANDSAT data itself. Initial tests using a four category scheme indicate that training data based on absolute measured reflectance and atmospheric correction of LANDSAT data can produce comparable accuracy of categorization to that achieved using more conventional relative radiance training. The analysis of the same four categories produced average categorization accuracies of 82.1% by conventional reflative radiance training and 81.9% by use of absolute reflectance signatures.

Klemas, V.↗
NASA NTRS2010

NATO Human View Architecture and Human Networks

The NATO Human View is a system architectural viewpoint that focuses on the human as part of a system. Its purpose is to capture the human requirements and to inform on how the human impacts the system design. The viewpoint contains seven static models that include different aspects of the human element, such as roles, tasks, constraints, training and metrics. It also includes a Human Dynamics component to perform simulations of the human system under design. One of the static models, termed Human Networks, focuses on the human-to-human communication patterns that occur as a result of ad hoc or deliberate team formation, especially teams distributed across space and time. Parameters of human teams that effect system performance can be captured in this model. Human centered aspects of networks, such as differences in operational tempo (sense of urgency), priorities (common goal), and team history (knowledge of the other team members), can be incorporated. The information captured in the Human Network static model can then be included in the Human Dynamics component so that the impact of distributed teams is represented in the simulation. As the NATO militaries transform to a more networked force, the Human View architecture is an important tool that can be used to make recommendations on the proper mix of technological innovations and human interactions.

Handley, Holly A. H.↗
NASA NTRS2016

Ultraviolet Satellite Measurements of Volcanic Ash

Ultraviolet (UV) remote sensing of volcanic ash and other absorbing aerosols from space began with the launch of the first Total Ozone Mapping Spectrometer (TOMS) instrument in 1978. Subsequent UV satellite missions (TOMS, GOME, SCIAMACHY, OMI, GOME-2, OMPS) have extended UV ash measurements to the present, generating a unique multidecadal record. A UV Aerosol Index (UVAI) based on two near-UV wavelengths, equally applicable to multispectral (TOMS, DSCOVR) or hyperspectral (GOME, SCIAMACHY, OMI, GOME-2, OMPS) instruments, has been used to derive a unique absorbing aerosol climatology across multiple UV satellite missions. Advantages of UV ash measurements relative to infrared (IR) techniques include the ability to detect ash at any altitude (assuming no clouds), above clouds, and over bright surfaces, where visible and IR techniques may fail. Disadvantages include the daytime-only restriction and nonspecificity to silicate ash, since UV measurements are sensitive to any UV-absorbing aerosol, including smoke, desert dust, and pollution. However, simultaneous retrieval of sulfur dioxide (SO2) abundance and UVAI provides robust discrimination of volcanic clouds. Although the UVAI is only semiquantitative, it has proved successful at detecting and tracking volcanic ash clouds from many volcanic eruptions since 1978. NASA A-Train measurements since 2006 (eg, CALIOP) have provided much improved constraints on volcanic ash altitude, and also permit identification of aerosol type through sensor synergy. Quantitative UV retrievals of ash optical depth, effective particle size, and ash column mass are possible and require assumptions of ash refractive index, particle size distribution, and ash layer altitude. The lack of extensive ash refractive index data in the UV-visible and the effects of ash particle shape on retrievals introduce significant uncertainty in the retrieved parameters, although limited validation against IR ash retrievals has been successful. In this contribution, we review UV ash detection and retrieval techniques and provide examples of volcanic eruptions detected in the approx. 37 year data record.

Multidecadal record↗
DOE OSTI2023

Uncertainty Quantified Machine Learning for Street Level Flooding Predictions in Norfolk, Virginia

Everyday citizens, emergency responders, and critical infrastructure can be dramatically affected by street flooding caused by the increasing tidal levels and major storm events magnified by climate change. Low-level flooding, such as nuisance flooding, continues to increase in frequency, especially in cities like Norfolk, Virginia, which can expect nearly 200 flooding events by 2050 [1]. Recently, machine learning (ML) models have been leveraged to produce real-time predictions based on local weather and geographic conditions. However, ML models are known to produce unusual results when presented with data that varies from their training set. For decision-makers to determine the trustworthiness of the model's predictions, ML models need to quantify their prediction uncertainty. This study applies Deep Quantile Regression (DQR) to a previously published, LSTM-based model for hourly water depth predictions [2], and analyzes its out-of-distribution (OOD) performance.

Goldenberg, Steven↗
DOE OSTI2023

MultiLoad-GAN: A GAN-Based Synthetic Load Group Generation Method Considering Spatial-Temporal Correlations

This paper presents a deep-learning framework, Multi-load Generative Adversarial Network (MultiLoad-GAN), for generating a group of synthetic load profiles (SLPs) simultaneously. The main contribution of MultiLoad-GAN is the capture of spatial-temporal correlations among a group of loads that are served by the same distribution transformer. This enables the generation of a large amount of correlated SLPs required for microgrid and distribution system studies. Here, the novelty and uniqueness of the MultiLoad-GAN framework are three-fold. First, to the best of our knowledge, this is the first method for generating a group of load profiles bearing realistic spatial- temporal correlations simultaneously. Second, two complementary realisticness metrics for evaluating generated load profiles are developed: computing statistics based on domain knowledge and comparing high-level features via a deep-learning classifier. Third, to tackle data scarcity, a novel iterative data augmentation mechanism is developed to generate training samples for enhancing the training of both the classifier and the MultiLoad-GAN model. Simulation results show that MultiLoad- GAN can generate more realistic load profiles than existing approaches, especially in group level characteristics. With little finetuning, MultiLoad-GAN can be readily extended to generate a group of load or PV profiles for a feeder or a service area.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Controlling extrapolations of nuclear properties with feature selection

Predictions of nuclear properties far from measured data are inherently inaccurate because of uncertainties in our knowledge of nuclear forces and in our treatment of quantum many-body effects in strongly-interacting systems. While the model bias can be directly calculated when experimental data is available, only an estimate can be made in the absence of such measurements. Current approaches to compute the estimated bias quickly lose predictive power when their input variables are taken far from the training region, resulting in uncontrolled uncertainties in applications such as nucleosynthesis simulations. In this letter, we present a novel technique to identify the input variables of machine learning algorithms that can provide robust estimates of model bias. Our process is based on selecting input variables, or features, based on their probability distribution functions across the entire nuclear chart. We illustrate our approach on the problem of quantifying the model bias in nuclear binding energies calculated with Density Functional Theory (DFT). We prove that building model biases with only Z and N as features leads to highly unreliable extrapolations. Conversely, we show that proper feature selection can systematically improve theoretical predictions without increasing uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Modeling the aqueous interface of amorphous TiO 2 using deep potential molecular dynamics

Amorphous titanium dioxide (a-TiO 2 ) is widely used as a coating material in applications such as electrochemistry and self-cleaning surfaces where its interface with water has a central role. However, little is known about the structures of the a-TiO 2 surface and aqueous interface, particularly at the microscopic level. In this work, we construct a model of the a-TiO 2 surface via a cut-melt-and-quench procedure based on molecular dynamics simulations with deep neural network potentials (DPs) trained on density functional theory data. After interfacing the a-TiO 2 surface with water, we investigate the structure and dynamics of the resulting system using a combination of DP-based molecular dynamics (DPMD) and ab initio molecular dynamics (AIMD) simulations. Both AIMD and DPMD simulations reveal that the distribution of water on the a-TiO 2 surface lacks distinct layers normally found at the aqueous interface of crystalline TiO 2 , leading to an ~10 times faster diffusion of water at the interface. Bridging hydroxyls (Ti 2 –O b H) resulting from water dissociation decay several times more slowly than terminal hydroxyls (Ti–O w H) due to fast Ti–O w H 2 → Ti–O w H proton exchange events. These results provide a basis for a detailed understanding of the properties of a-TiO 2 in electrochemical environments. Moreover, the procedure of generating the a-TiO 2 -interface employed here is generally applicable to studying the aqueous interfaces of amorphous metal oxides.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1961

Applications of Power Spectral Analysis Methods to Maneuver Loads Obtained on Jet Fighter Airplanes During Service Operations

Power spectral densities of normal load factor have been obtained for two service operational training flights of a Republic F-84G airplane and three service operational training flights of a North American F-86A airplane in order to indicate the load-factor frequency content and possible uses of power spectral methods in analyzing maneuver load data. It was determined that the maneuvering load-factor time histories appeared to be described by a truncated normal distribution. The power spectral densities obtained were relatively level at frequencies below 0.03 cycle per second and varied inversely with approximately the cube of the frequency at the higher frequencies. In general, the frequency content was very low above 0.2 cycle per second. The load-factor peak distributions were estimated fairly well from the spectrum analysis. In addition, peak load data obtained during service operations of fighter-type airplanes with flight time totaling about 24,000 hours were examined and appeared to agree reasonably well with the type of equations obtained from spectrum peak-load distributions.

Mayer, John P.↗
NASA NTRSDate not supplied

Eleven Countries, an Integrated Spacecraft: the Story of International Collaboration that Built the Orion Spacecraft and Powered the Success of the Artemis I Mission

The quest to return humans to the Moon in the next step towards humanity's exploration of space is more alive than ever. After a great deal of achievements, failures, and lessons learned, the Artemis I mission set o to the Moon on November 16, 2022, with the goal of testing a new rocket, the Space Launch System, and a new spacecraft, Orion: designed, assembled, and tested across two continents, and 11 countries. Behind this mission, decades of experience with the International Space Station, Autonomous Transfer Vehicle operations, and many other program collaborations built the know-how on how to succeed together in the toughest environment | deep space. The Artemis I mission proved to be an incredible success, meeting 161 total mission objectives, including 21 developed during the flight based on outperforming spacecraft. It was also a case-study in international collaboration, given that ESA, NASA, and industry partners Airbus and Lockheed Martin for the first time had to design, build, test, and fly a fully integrated human-rated spacecraft, with most critical functions dependent and interconnected across U.S. and European systems. The U.S.-built Orion Crew Module and Crew Module Adapter and European-built European Service Module (ESM) shared critical interfaces and commodities, from propulsion, avionics, active/passive thermal, electrical power generation, storage and distribution to the software that managed it all. In this paper, we will describe relevant aspects of the integrated spacecraft design, providing context for the challenges that the team faced in all phases required to get Orion ready to fly, and provide a direct account of how the joint team formed, trained, and supported the operations of the successful Artemis I mission. We will also explore the evolution of the partnerships, given that these allow a multi-national e ort to sustain the program production, share costs, leverage a broader base of engineering expertise, and build more diverse capabilities over the long haul to support the Artemis goals and objectives. Lastly, we will cover critical lessons learned and how the Orion Program has implemented these in preparation of the next Artemis missions to repeat the success of Artemis I. The purpose of this paper is to document knowledge we gained and lessons we learned through the development of an integrated Orion spacecraft, since it is imperative we build on this now, at the dawn of the Artemis Program, an international endeavor to push human space exploration.

Deep Space Exploration↗
DOE OSTI2022

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1973

Estimation of proportions of objects and determination of training sample-size in a remote sensing application

A multichannel scanning device may fail to observe objects because of obstructions blocking the view, or different categories of objects may make up a resolution element giving rise to a single observation. Ground truth will be required on any such categories of objects in order to estimate their expected proportions associated with various classes represented in the remote sensing data. Considering the classes to be distributed as multivariate normal with different mean vectors and common covariance, maximum likelihood estimates are given for the expected proportions of objects associated with different classes, using the Bayes procedure for classification of individuals obtained from these classes. An approximate solution for simultaneous confidence intervals on these proportions is given, and thereby a sample-size needed to achieve a desired amount of accuracy for the estimates is determined.

Chhikara, R. S.↗
DOE OSTI2023

Portable chemical detection platform for on-site monitoring of odorant levels in natural gas

The adequate odorization of natural gas is critical to identify gas leaks and to reduce accidents. To ensure odorization, natural gas utility companies collect samples to be processed at core facilities or a trained human technician smells a diluted natural gas sample. In this work, we report a detection platform that addresses the lack of mobile solutions capable of providing quantitative analysis of mercaptans, a class of compounds used to odorize natural gas. Detailed description of the platform hardware and software components is provided. Designed to be portable, the platform hardware facilitates extraction of mercaptans from natural gas, separation of individual mercaptan species, and quantification of odorant concentration, with results reported at point-of-sampling. The software was developed to accommodate skilled users as well as minimally trained operators. Detection and quantification of six commonly used mercaptan compounds (ethyl mercaptan, dimethyl sulfide, n-propylmercaptan, isopropyl mercaptan, tert–butyl mercaptan, and tetrahydrothiophene) at typical odorizing concentrations of 0.1–5 ppm was performed using the device. We demonstrate the potential of this technology to ensure natural gas odorizing concentrations throughout distribution systems.

03 NATURAL GAS↗
DOE OSTI2024

Convolution Neural Network for Fault Identification in Distribution Feeder with High Penetration Solar PV

Identification and zonal classification of the faults is a decisive factor in the relay’s decision to trip or not. Different types of fault like three-phase, line-to-line-to-ground and single-line-to-ground can occur at various locations in the feeder. These faults are seen as the variation in the instantaneous values of three-phase voltages and currents, i.e., waveforms, that are measured at the relay location. The objective of this work is to develop a machine learning model that can identify a fault and classify it to various protection zones based on measured waveforms. In this work, a data-driven relay based on Convolutional Neural Network (CNN) is proposed for fault identification in distribution feeders with high penetration solar PV. The proposed CNN model takes local current and voltage waveforms as input and classify it into fault, no-fault or a capacitor switching. Further, the CNN also attempts to identify fault zones based on the images of waveforms. The overall testing accuracy of the trained model exceeds 95%.

Ramesh, Meghana↗