Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Modeling Imperfect Generator Behavior in Power System Operation Models

A key component in power system operations is the use of computer models to quickly study and analyze different operating conditions and futures in an efficient manner. The output of these models are sensitive to the data used in them as well as the assumptions made during their execution. One typical assumption is that generators and load assets perfectly follow operator control signals. While this is a valid simulation assumption, generators may not always accurately follow control signals. This imperfect response of generators could impact cost and reliability metrics. This paper proposes a generator model that capture this imperfect behavior and examines its impact on production costs and reliability metrics using a steady-state power system operations model. Preliminary analysis shows that while costs remain relatively unchanged, there could be significant impacts on reliability metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Modeling Flexible Generator Operating Regions via Chance- constrained Stochastic Unit Commitment

Here, we introduce a novel chance-constrained stochastic unit commitment model to address uncertainty in renewables' production uncertainty in power systems operation. For most thermal generators,underlying technical constraints that are universally treated as "hard" by deterministic unit commitment models are in fact based on engineering judgments, such that system operators can periodically request operation outside these limits in non-nominal situations, e.g., to ensure reliability. We incorporate this practical consideration into a chance-constrained stochastic unit commitment model, specifically by in-frequently allowing minor deviations from the minimum and maximum thermal generator power output levels. We demonstrate that an extensive form of our model is computationally tractable for medium-sized power systems given modest numbers of scenarios for renewables' production. We show that the model is able to potentially save significant annual production costs by allowing infrequent and controlled violation of the traditionally hard bounds imposed on thermal generator production limits. Finally, we conduct a sensitivity analysis of optimal solutions to our model under two restricted regimes and observe similar qualitative results.

42 ENGINEERING↗
DOE OSTI2013

A Comparison of Forecast Error Generators for Modeling Wind and Load Uncertainty

This paper presents four algorithms to generate random forecast error time series, including a truncated-normal distribution model, a state-space based Markov model, a seasonal autoregressive moving average (ARMA) model, and a stochastic-optimization based model. The error time series are used to create real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast time series that statistically match historically observed forecasting data sets, used for variable generation integration studies. A comparison is made using historical DA load forecast and actual load values to generate new sets of DA forecasts with similar stoical forecast error characteristics. This paper discusses and compares the capabilities of each algorithm to preserve the characteristics of the historical forecast data sets.

Lu, Ning↗
DOE OSTI2024

CaloScore v2: single-shot calorimeter shower simulation with diffusion models

Diffusion generative models are promising alternatives for fast surrogate models, producing high-fidelity physics simulations. However, the generation time often requires an expensive denoising process with hundreds of function evaluations, restricting the current applicability of these models in a realistic setting. In this work, we report updates on the CaloScorearchitecture, detailing the changes in the diffusion process, which produces higher quality samples, and the use of progressive distillation, resulting in a diffusion model capable of generating new samples with a single function evaluation. Here we demonstrate these improvements using the Calorimeter Simulation Challenge 2022 dataset.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

RockFlow: Fast Generation of Synthetic Source Rock Images Using Generative Flow Models

Image-based evaluation methods are a valuable tool for source rock characterization. The time and resources needed to obtain images has spurred development of machine-learning generative models to create synthetic images of pore structure and rock fabric from limited image data. While generative models have shown success, existing methods for generating 3D volumes from 2D training images are restricted to binary images and grayscale volume generation requires 3D training data. Shale characterization relies on 2D imaging techniques such as scanning electron microscopy (SEM), and grayscale values carry important information about porosity, kerogen content, and mineral composition of the shale. Here, we introduce RockFlow, a method based on generative flow models that creates grayscale volumes from 2D training data. We apply RockFlow to baseline binary micro-CT image volumes and compare performance to a previously proposed model. We also show the extension of our model to 2D grayscale data by generating grayscale image volumes from 2D SEM and dual modality nanoscale shale images. The results show that our method underestimates the porosity and surface area on the binary baseline datasets but is able to generate realistic grayscale image volumes for shales. With improved binary data preprocessing, we believe that our model is capable of generating synthetic porous media volumes for a very broad class of rocks from shale to carbonates to sandstone.

58 GEOSCIENCES↗
DOE OSTI2025

Generative AI models for learning flow maps of stochastic dynamical systems in bounded domains

Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary interactions. Despite the success of machine learning-based methods in learning SDEs, existing learning methods are not applicable to SDEs in bounded domains because they cannot accurately capture the particle exit dynamics. We present a unified hybrid data-driven approach that combines a conditional diffusion model with an exit prediction neural network to capture both interior stochastic dynamics and boundary exit phenomena. Our ML model consists of two major components: a neural network that learns exit probabilities using binary cross-entropy loss with rigorous convergence guarantees, and a training-free diffusion model that generates state transitions for non-exiting particles using closed-form score functions. The two components are integrated through a probabilistic sampling algorithm that determines particle exit at each time step and generates appropriate state transitions. Here, the performance of the proposed approach is demonstrated via three test cases: a one-dimensional simplified problem for theoretical verification, a two-dimensional advection-diffusion problem in a bounded domain, and a three-dimensional problem of interest to magnetically confined fusion plasmas.

Bounded domains↗
DOE OSTI2018

A point process model for generating biofilms with realistic microstructure and rheology

Biofilms are communities of bacteria that exhibit a multitude of multiscale biomechanical behaviours. Recent experimental advances have led to characterisations of these behaviours in terms of measurements of the viscoelastic moduli of biofilms grown in bioreactors and the fracture and fragmentation properties of biofilms. These properties are macroscale features of biofilms; however, a previous work by our group has shown that heterogeneous microscale features are critical in predicting biofilm rheology. In this paper, we use tools from statistical physics to develop a generative statistical model of the positions of bacteria in biofilms. Specifically, the model is a type of pairwise interaction model (PIM). We show through simulation that the macroscopic mechanical properties of biofilms depend on the choice of microscale spatial model. A key finding is that uniform and non-uniform sets of points lead to differing mechanical properties. This distinction appears not to have been previously considered in mathematical biofilm literature. We also found that realisations of a biologically informed PIM have realistic in silico mechanical properties, and have statistical properties that closely match experimental data. We also note that a Poisson spatial point process of suitable number density also yields realistic mechanical properties, but that the spatial distribution of points does not reflect those occurring in our experimentally observed biofilm.

Mathematics↗
DOE OSTI2019

A modular biogeochemical modeling suite for next-generation ocean models (Final Report)

The Marine Biogeochemistry Library (MARBL) is a self-contained implementation of ocean biogeochemistry suitable for incorporation in Earth system models. The default configuration of MARBL represents multiple nutrient co-limitation (N, P, Si, and Fe), includes three explicit phytoplankton functional groups (diatoms, diazotrophs, and pico/nano phytoplankton), and one implicit group (calcifiers); there is one zooplankton group. MARBL includes fully prognostic carbonate chemistry and simulates sinking particulate organic matter implicitly, subject to ballasting by mineral dust, biogenic mineral carbonate and opal. MARBL represents subgrid-scale variations in light, variable C:P stoichiometry, semi-labile and refractory dissolved organic material pools, prognostic oceanic emission of ammonia, and an explicit ligand tracer that complexes iron. MARBL is fully runtime-configurable, and is flexible enough to accommodate a variable number of plankton functional types and ecosystem configurations. Critically, MARBL is implemented to be independent of any particular ocean general circulation model (OGCM); it is a standalone library that interfaces with an OGCM's via an explicit "driver" layer. MARBL can thus be coupled to multiple OGCM's, enabling efficient maintenance, development, and cross-model inter-comparison. MARBL is the ocean biogeochemistry component for the Community Earth System Model and the DOE’s Energy Exascale Earth System Model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2011

Updating the neutron electric dipole moment in a fourth generation standard model

A fourth generation of quarks, if it exists, may provide sufficient CP violation for the baryon asymmetry of the Universe. We estimate the neutron electric dipole moment in the presence of a fourth generation and find it would be dominated by the strange quark chromoelectric dipole moment, assuming it does not get wiped out by a Peccei-Quinn symmetry. Both the three electroweak loop and the two-loop electroweak/one-loop gluonic contributions are considered. With m{sub b'}, m{sub t'} at 500 GeV or so that can be covered at the LHC, and with a Jarlskog CP violation factor that is consistent with hints of New Physics in b{yields}s transitions, the neutron electric dipole moment is found around 10{sup -31}e cm, still far below the 10{sup -28}e cm reach of the new experiments being planned or under construction.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Generative diffusion model surrogates for mechanistic agent-based biological models

Mechanistic, multicellular, agent-based models are commonly used to investigate tissue, organ, and organism-scale biology at single-cell resolution. The Cellular-Potts Model (CPM) is a powerful and popular framework for developing and interrogating these models. CPMs become computationally expensive at large space- and time- scales making application and investigation of developed models difficult. Surrogate models may allow for the accelerated evaluation of CPMs of complex biological systems. However, the stochastic nature of these models means each set of parameters may give rise to different model configurations, complicating surrogate model development. In this work, we leverage denoising diffusion probabilistic models (DDPMs) to train a generative AI surrogate of a CPM used to investigate in vitro vasculogenesis. We describe the use of an image classifier to learn the characteristics that define unique areas of a 2-dimensional parameter space. We then apply this classifier to aid in surrogate model selection and verification. Our CPM model surrogate generates model configurations 20,000 timesteps ahead of a reference configuration and demonstrates approximately a 22x reduction in computational time as compared to native code execution. Our work represents a step towards the implementation of DDPMs to develop digital twins of stochastic biological systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Modeling Distributed Generation in California

In support of analysis for the biennial Integrated Energy Policy Report, the California Energy Commission and the National Renewable Energy Laboratory have partnered to study the growth of distributed energy resources in California. This study involves the use of National Renewable Energy Laboratory's Distributed Generation Market Demand model, available at https://www.nrel.gov/analysis/dgen/, to project statewide adoption of distributed photovoltaics and paired storage. Key outcomes of the collaboration include: • Improved representation of California building stock, load profiles, historical adoption, and tariffs, including the net billing tariff, in the dGen model; • Trained CEC staff members to use and adapt the dGen model for their specific needs; • Developed a methodology for representing emerging consumer segments to potentially adopt distributed energy resources, including low-income, multifamily, and renter-occupied buildings; • Forecasted solar photovoltaic and paired storage growth in California using a common set of modeling parameters. This report describes the multiyear effort, which includes a discussion of: • Methodology and data employed in adapting the Distributed Generation Market Demand model for California to forecast solar photovoltaic and storage statewide through 2040; • Steps taken to modify the base model to forecast solar photovoltaic adoption in emerging market segments such as multifamily or renter-occupied homes or both; • Future enhancements of the model.

14 SOLAR ENERGY↗
DOE OSTI2021

D2U: Data Driven User Emulation for the Enhancement of Cyber Testing, Training, and Data Set Generation

Whether testing intrusion detection systems, conducting training exercises, or creating data sets to be used by the broader cybersecurity community, realistic user behavior is a critical component of a cyber range. Existing methods either rely on network level data or replay recorded user actions to approximate real users in a network. Our work is the first to produce generative models trained on actual user data (sequences of application usage) collected on endpoints. Once trained to the user's behavioral data, these models can generate novel sequences of actions %that appear to come from the same distribution as the training data. These sequences of actions are then fed to our custom software via configuration files, which replicate those behaviors on end devices. Notably, our models are platform agnostic and could generate behavior data for any emulation software package. In this paper we present our model generation process, software architecture, and an initial evaluation of the fidelity of our models. Our software is currently deployed in a cyber range to help evaluate the efficacy of defensive cyber technologies. We suggest additional ways that the cyber community as a whole can benefit from more realistic user behavior emulation. The data used to train our model, as well as sample configuration files produced by the model, are available at [redacted].

Oesch, T↗
DOE OSTI2020

Loosely Conditioned Emulation of Global Climate Models With Generative Adversarial Networks

Climate models encapsulate our best understanding of the Earth system, allowing research to be conducted on its future under alternative assumptions of how human-driven climate forces are going to evolve. An important application of climate models is to provide metrics of mean and extreme climate changes, particularly under these alternative future scenarios, as these quantities drive the impacts of climate on society and natural systems. Because of the need to explore a wide range of alternative scenarios and other sources of uncertainties in a computationally efficient manner, climate models can only take us so far, as they require significant computational resources, especially when attempting to characterize extreme events, which are rare and thus demand long and numerous simulations in order to accurately represent their changing statistics. Here we use deep learning in a proof of concept that lays the foundation for emulating global climate model output for different scenarios. We train two "loosely conditioned" Generative Adversarial Networks (GANs) that emulate daily precipitation output from a fully coupled Earth system model: one GAN modeling Fall-Winter behavior and the other Spring-Summer. Our GANs are trained to produce spatiotemporal samples: 32 days of precipitation over a 64x128 regular grid discretizing the globe. We evaluate the generator with a set of related performance metrics based upon KL divergence, and find the generated samples to be nearly as well matched to the test data as the validation data is to test. We also find the generated samples to accurately estimate the mean number of dry days and mean longest dry spell in the 32 day samples. Our trained GANs can rapidly generate numerous realizations at a vastly reduced computational expense, compared to large ensembles of climate models, which greatly aids in estimating the statistics of extreme events.

climate emulation, extreme climate, impacts, machi↗
DOE OSTI2023

Fitting a deep generative hadronization model

Hadronization is a critical step in the simulation of high-energy particle and nuclear physics experiments. As there is no first principles understanding of this process, physically-inspired hadronization models have a large number of parameters that are fit to data. Deep generative models are a natural replacement for classical techniques, since they are more flexible and may be able to improve the overall precision. Proof of principle studies have shown how to use neural networks to emulate specific hadronization when trained using the inputs and outputs of classical methods. However, these approaches will not work with data, where we do not have a matching between observed hadrons and partons. In this paper, we develop a protocol for fitting a deep generative hadronization model in a realistic setting, where we only have access to a set of hadrons in data. Our approach uses a variation of a Generative Adversarial Network with a permutation invariant discriminator. We find that this setup is able to match the hadronization model in Herwig with multiple sets of parameters. This work represents a significant step forward in a longer term program to develop, train, and integrate machine learning-based hadronization models into parton shower Monte Carlo programs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Synthetic Data and Graph Generation for Modeling Adversarial Activity (Final Project Report)

The Data and Graph Generation for Modeling Adversary Activity (MAA) project developed a methodology along with scalable graph modeling and generation tools to produce realistic large-scale background activity graphs with embedded adversarial activity pathways. The technical report presents PNNL methodology, released datasets, lessons learned, and recommendations to develop graph analytic algorithms for structure-only and attributed knowledge graphs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Calomplification — the power of generative calorimeter models

Motivated by the high computational costs of classical simulations, machine-learned generative models can be extremely useful in particle physics and elsewhere. They become especially attractive when surrogate models can efficiently learn the underlying distribution, such that a generated sample outperforms a training sample of limited size. This kind of GANplification has been observed for simple Gaussian models. We show the same effect for a physics simulation, specifically photon showers in an electromagnetic calorimeter.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Comparison of point cloud and image-based models for calorimeter fast simulation

Score based generative models are a new class of generative models that have been shown to accurately generate high dimensional calorimeter datasets. Recent advances in generative models have used images with 3D voxels to represent and model complex calorimeter showers. Point clouds, however, are likely a more natural representation of calorimeter showers, particularly in calorimeters with high granularity. Furthermore, point clouds preserve all of the information of the original simulation, more naturally deal with sparse datasets, and can be implemented with more compact models and data files. In this work, two state-of-the-art score based models are trained on the same set of calorimeter simulation and directly compared.

47 OTHER INSTRUMENTATION↗