SEARCH · Engineering Papers

Results for “generative machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Data Augmentation for Intelligent Contingency Management Using Generative Adversarial Neural Networks

Artificial intelligence (AI)-based techniques for intelligent contingency management (ICM) require that intelligent agents learn various aspects of system dynamics to create and execute contingencies. For high assurance contingency management, agents achieve the most compelling results through supervised or semi-supervised machine learning, for which agents require large datasets to learn the dynamics of the system. Unfortunately, data collection in aerospace applications can be costly, due to both time and resources. Presented work describes a framework for data augmentation of ICM databases containing training data for machine learning models. This framework populates the database with the outputs of generative adversarial network (GAN) models that were trained on flight data. Methods for evaluating the suitability of these models based on the equations of motion, as well as other physical constraints, are discussed. The paper demonstrates the utility of this database for training intelligent agents on the NASA T2 generic transport aircraft model and experimental vertical takeoff and landing (VTOL) simulation model.

Generative Machine Learning↗

NASA NTRSDate not supplied

Data Augmentation for Intelligent Contingency Management Using Generative Adversarial Neural Networks

Generative Machine Learning↗

NASA NTRSDate not supplied

Hierarchical screening for Li-based solid electrolytes using fast, interpretable machine-learned potentials

Li-based solid-state electrolyte materials enable safer, all-solid-state batteries but the computational search for candidates with favorable stability and Li-ion conductivity is challenging due to the size of the search space and the cost of evaluating transport properties with ab initio methods. The prohibitive cost of high-throughput screening with DFT has lead to the development of surrogate models using geometric analysis, empirical potentials, and descriptors for ionic transport. Here, I will discuss a hierarchical screening approach for identifying promising materials using a combination of density functional theory, bond-valence methods, and machine learning potentials generated with the Ultra-Fast Force Fields (UF3) framework. We show how the inexpensive bond-valence method can be used to guide the generation of training samples for machine learning, in addition to filtering candidates. Finally, we apply the hierarchical workflow to screen for ionic conductivity across a database of Li-containing compounds.

Materials discovery↗

NASA NTRSDate not supplied

Hierarchical Screening for Li-Based Solid Electrolytes Using Fast, Interpretable Machine-Learned Potentials

Materials discovery↗

DOE OSTI2020

SODA: a New Synthesis Infrastructure for Agile Hardware Design of Machine Learning Accelerators

Next generation systems, such as edge devices, will have to provide efficient processing of machine learning (ML) algorithms along several metrics, including energy, performance, area, and latency. However, the quickly evolving field of ML makes it extremely difficult to generate accelerators able to support a wide variety of algorithms. At the same time, designing accelerators in hardware description languages (HDLs) by hand is hard and time consuming, and does not allow quick exploration of the design space. This paper discusses the SODA synthesizer, an automated open source high-level ML framework-to-Verilog compiler targeting ML Application-Specific Integrated Circuits (ASICs) chiplets based on the LLVM infrastructure. The SODA synthesizers will allow implementing optimal designs by combining templated and fully tunable IPs and macros, and fully custom components generated through high-level synthesis. All these components will be provided through an extendable resource library, characterized with both commercial and open source logic design flows. Through a closed loop design space exploration engine, developers will be able to quickly explore their hardware designs along different dimension

Minutoli, Marco↗

DOE OSTI2022

Generative memory for lifelong machine learning

Techniques are disclosed for training machine learning systems. An input device receives training data comprising pairs of training inputs and training labels. A generative memory assigns training inputs to each archetype task of a plurality of archetype tasks, each archetype task representative of a cluster of related tasks within a task space and assigns a skill to each archetype task. The generative memory generates, from each archetype task, auxiliary data comprising pairs of auxiliary inputs and auxiliary labels. A machine learning system trains a machine learning model to apply a skill assigned to an archetype task to training and auxiliary inputs assigned to the archetype task to obtain output labels corresponding to the training and auxiliary labels associated with the training and auxiliary inputs assigned to the archetype task to enable scalable learning to obtain labels for new tasks for which the machine learning model has not previously been trained.

Nadamuni Raghavan, Aswin↗

DOE OSTI2020

A Step Towards Machine Learning-based Coherent Generator Grouping for Emergency Control Applications in Modern Power Grid

A dynamic neural network (NN) based multi-class classifier is proposed for improving online prediction of coherent generator groups (CGGs), following the occurrences of various contingencies in the power grid. This is motivated by the increasing availability of the measurements from phasor measurement units (PMUs) and the number of grouping schemes is limited. The proposed method consists of three steps. First, by performing offline simulations, a library of system dynamic responses characterized by post-contingency rotor angles and speeds of individual generators is obtained. To generate sufficient data, up to N-2 contingencies and the uncertain parameters associated with the power grid including type and location of disturbance and fault clearing times are modeled. Secondly, the training data-set is produced by generating labels for individual contingencies using a hierarchical clustering method based on rotor angle and speed data. Lastly, the dynamic NN models are trained for online applications such as emergency controls and controlled islanding. The proposed method is tested on the standard 16-generator 68-bus system to demonstrate its performance. Furthermore, the impact of the sample data lengths on the CGG numbers is evaluated. It is interesting to observe that the time domain stability behaviors can be determined by examining the changes in the CGG numbers.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Machine learning for domain transfer between simulated and experimental 2D X-ray diffraction patterns using generative adversarial networks

X-ray diffraction (XRD) is a well-established technique for analyzing materials at an atomic level. Dynamic compression experiments (DCE), in which materials are subject to extreme pressures, can provide fundamental understanding to pressure-induced phase transitions and compression of the crystal lattice. The analysis of XRD patterns from highly compressed samples is non-trivial given the sparsity of data, high experimental costs, and the fact that the data is often marred with X-ray background and other artifacts. While accurate computational frameworks exist, they solve the forward problem—from structures and orientations to XRD patterns. Solving the inverse problem for 2D experimental diffraction patterns is currently a complex manual process of matching and comparing experimentally observed patterns to computationally generated ones. Machine learning is a promising tool for automating the matching process but often requires data-intensive architectures. Here, in this study, we use a CycleGAN to translate the domain of limited experimental data to a domain in which there is readily available simulated data. This domain shift allows data-intensive machine learning models that have only been trained on simulated XRD patterns to be used in the analysis of experiments.

Brozak, Samantha Jean [Sandia National Laboratorie↗

DOE OSTI2023

MultiLoad-GAN: A GAN-Based Synthetic Load Group Generation Method Considering Spatial-Temporal Correlations

This paper presents a deep-learning framework, Multi-load Generative Adversarial Network (MultiLoad-GAN), for generating a group of synthetic load profiles (SLPs) simultaneously. The main contribution of MultiLoad-GAN is the capture of spatial-temporal correlations among a group of loads that are served by the same distribution transformer. This enables the generation of a large amount of correlated SLPs required for microgrid and distribution system studies. Here, the novelty and uniqueness of the MultiLoad-GAN framework are three-fold. First, to the best of our knowledge, this is the first method for generating a group of load profiles bearing realistic spatial- temporal correlations simultaneously. Second, two complementary realisticness metrics for evaluating generated load profiles are developed: computing statistics based on domain knowledge and comparing high-level features via a deep-learning classifier. Third, to tackle data scarcity, a novel iterative data augmentation mechanism is developed to generate training samples for enhancing the training of both the classifier and the MultiLoad-GAN model. Simulation results show that MultiLoad- GAN can generate more realistic load profiles than existing approaches, especially in group level characteristics. With little finetuning, MultiLoad-GAN can be readily extended to generate a group of load or PV profiles for a feeder or a service area.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Combining Physics and Machine Learning for the Next Generation of Molecular Simulation

Simulating molecules and atomic systems at quantum accuracy is a grand challenge for science in the 21 st century. Quantum-accurate simulations would enable the design of new medicines and the discovery of new materials. The defining problem in this challenge is that quantum calculations on large molecules, like proteins or DNA, are fundamentally impossible with current algorithms. In this work, we explore a range of different methods that aim to make large, quantum-accurate simulations possible. We show that using advanced classical models, we can accurately simulate ion channels, an important biomolecular system. We show how advanced classical models can be implemented in an exascale-ready software package. Lastly, we show how machine learning can learn the laws of quantum mechanics from data and enable quantum electronic structure calculations on thousands of atoms, a feat that is impossible for current algorithms. Altogether, this work shows that combining advances in physics models, computing, and machine learning, we are moving closer to the reality of accurately simulating our molecular world.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2024

IMPACT: Design of Integrated Multiphysics Producible Additive Components for Turbomachinery

The overall objective of the IMPACT program was to enable a dramatic reduction in design maturation time for an additive hot-section turbomachinery component through the following: • A fast crack-risk producibility surrogate model generated from machine learning applied to additive process simulation data generated via exascale computing, • Linking this surrogate model to multi-physics topology optimization (TO) to enable the creation of producible, near-optimal structural/thermal designs for additive hot-section components, • Maturing this toolset to reduce hot-section component design-for-manufacturing iterations by a large fraction, and eventually, • Using these tools to develop more efficient gas turbines in much shorter design cycle times.

42 ENGINEERING↗

DOE OSTI2025

Data-driven design of electrolyte additives supporting high-performance 5 V LiNi 0.5 Mn 1.5 O 4 positive electrodes

LiNi 0.5 Mn 1.5 O 4 (LNMO) is a high-capacity spinel-structured material with an average lithiation/de-lithiation potential at ca. 4.6–4.7 V vs Li + /Li, far exceeding the stability limits of electrolytes. An efficient way to enable LNMO in lithium-ion batteries is to reformulate an electrolyte composition that stabilizes both graphitic (Gr) negative electrode with solid-electrolyte-interphase and LNMO with cathode-electrolyte-interphase. In this study, we select and test a diverse collection of 28 single and dual additives for the Gr||LNMO battery system. Subsequently, we train machine learning models on this dataset and employ the trained models to suggest 6 binary compositions out of 125, based on predicted final area-specific-impedance, impedance rise, and final specific-capacity. Such machine learning-generated new additives outperform the initial dataset. This finding not only underscores the efficacy of machine learning in identifying materials in a highly complicated application space but also showcases an accelerated material discovery workflow that directly integrates data-driven methods with battery testing experiments.

batteries↗

NASA NTRS2020

CyberGAN: Generating High-fidelity Cybersecurity Data With Generative Adversarial Networks

Machine learning for cyber defense offers the promise of detecting adversarial activity against the ground data systems managing critical space assets. A fundamental challenge facing machine learning research in cybersecurity is the lack of high-fidelity, shareable datasets for robust evaluation and testing of machine learning-based solutions. High-fidelity, real-world datasets are necessary for reliable benchmarking of nominal system behavior and malicious activity. Unfortunately, such realistic datasets of both nominal and adversarial activity are rarely shared publicly by data owners due to security and privacy concerns. Besides, the available adversarial data is sparse, which makes training models on malicious activity much harder. This situation has impeded and continues to impede the research and successful adoption of machine learning methods for cyber defense. Researchers have dealt with this problem by generating data within a low-fidelity lab environment, using classified and thus unshareable datasets, or downloading low-fidelity public datasets made available by others. We propose an innovative solution to the problem by employing machine learning methods to generate high-fidelity data. Specifically, we propose the use of Generative Adversarial Networks (GANs) to generate high-fidelity data for cybersecurity purposes. GANs have found successful image processing and natural language applications, but have not yet been investigated for cyber data generation. Our proposed approach first involves training the `discriminator' network of the GAN with a sample of real-world data consisting of malicious and nominal samples. We then use the `generator' network to generate new high-fidelity data samples consisting of an appropriate mix of malicious and nominal activity. We demonstrate applications of our architecture by generating high-fidelity cybersecurity data containing both malicious and nominal samples. We thoroughly evaluate the fidelity of our generated data using heuristics and evaluate its usefulness for machine learning applications using three different datasets. Overall, our approach results in high-fidelity, shareable datasets.

Zhang, Yuening↗

DOE OSTI2022