Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Data-scarce surrogate modeling of shock-induced pore collapse process

Understanding the mechanisms of shock-induced pore collapse is of great interest in various disciplines in sciences and engineering, including materials science, biological sciences, and geophysics. However, numerical modeling of the complex pore collapse processes can be costly. To this end, a strong need exists to develop surrogate models for generating economic predictions of pore collapse processes. Here, in this work, we study the use of a data-driven reduced-order model, namely dynamic mode decomposition, and a deep generative model, namely conditional generative adversarial networks, to resemble the numerical simulations of the pore collapse process at representative training shock pressures. Since the simulations are expensive, the training data are scarce, which makes training an accurate surrogate model challenging. To overcome the difficulties posed by the complex physics phenomena, we make several crucial treatments to the plain original form of the methods to increase the capability of approximating and predicting the dynamics. In particular, physics information is used as indicators or conditional inputs to guide the prediction. In realizing these methods, the training of each dynamic mode composition model takes only around 30 s on CPU. In contrast, training a generative adversarial network model takes 8 h on GPU. Moreover, using dynamic mode decomposition, the final-time relative error is around 0.3% in the reproductive cases. We also demonstrate the predictive power of the methods at unseen testing shock pressures, where the error ranges from 1.3 to 5% in the interpolatory cases and 8 to 9% in extrapolatory cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Using Machine Learning to Generate a GISS ModelE Calibrated Physics Ensemble (CPE)

A neural network (NN) surrogate of the NASA GISS ModelE atmosphere (version E3) is trained on a perturbed parameter ensemble (PPE) spanning 45 physics parameters and 36 outputs. The NN is leveraged in a Markov Chain Monte Carlo (MCMC) Bayesian parameter inference framework to generate a second posterior constrained ensemble coined a “calibrated physics ensemble,” or CPE. The CPE members are characterized by diverse parameter combinations and are, by definition, close to top-of-atmosphere radiative balance, and must broadly agree with numerous hydrologic, energy cycle and radiative forcing metrics simultaneously. Global observations of numerous cloud, environment, and radiation properties (provided by global satellite products) are crucial for CPE generation. The inference framework explicitly accounts for discrepancies (or biases) in satellite products during CPE generation. We demonstrate that product discrepancies strongly impact calibration of important model parameter settings (e.g., convective plume entrainment rates; fall speed for cloud ice). Structural improvements new to E3 are retained across CPE members (e.g., stratocumulus simulation). Notably, the framework improved the simulation of shallow cumulus and Amazon rainfall while not degrading radiation fields, an upgrade that neither default parameters nor Latin Hypercube parameter searching achieved. Analyses of the initial PPE suggested several parameters were unimportant for output variation. However, many “unimportant” parameters were needed for CPE generation, a result that brings to the forefront how parameter importance should be determined in PPEs. From the CPE, two diverse 45-dimensional parameter configurations are retained to generate radiatively-balanced, auto-tuned atmospheres that were used in two E3 submissions to CMIP6.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Hypothesis testing via AI: Generating physically interpretable models of scientific data with machine learning (Full Technical Report)

Deep learning has demonstrated an exceptional ability to solve complex tasks (an engineering success); however, it has done so at the expense of the ability to generate new knowledge (a scientific failure). We propose an alternative framework—entitled Deep Symbolic Regression (DSR)—in which artificial neural networks (NNs) rapidly generate hypotheses about physical relationships among inputs. This framework bypasses the need to interpret an NN altogether, while still leveraging the representational power of deep learning. The resulting models are tractable mathematical expressions, which are inherently and readily human interpretable and can provide insights into underlying physical phenomena. Further, we fold this methodology into the scientific process by allowing the scientist to directly integrate a priori knowledge and beliefs to accelerate learning. We demonstrate this methodology on symbolic regression—the problem of rediscovering underlying expressions describing a dataset—and achieve state-of-the-art performance across a wide variety of symbolic regression problems. Further, we generalize our DSR framework to apply to the more general class of symbolic optimization problems, in which one seeks to optimize a sequence of symbols or “tokens” under a black-box reward function. Examples of other symbolic optimization problems include neural architecture search and computational antibody design. Our generalized tool, Deep Symbolic Optimization (DSO), has been demonstrated on the task of learning symbolic control policies for reinforcement learning environments, and has been adopted as an enabling capability for computational antibody design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

High harmonic generation in Haldane model quantum dots

We study theoretically the nonlinear electron dynamics of Haldane model quantum dots placed in the field of an ultrashort optical pulse. One of the tuning parameters of the Haldane model is the phase accumulated by an electron during its transfer between the next nearest neighbor sites. We study how this parameter affect the nonlinear electron dynamics and the generation of high optical harmonics. With increasing the phase from its zero value to 90°, the low-energy electron states in the conduction and valence bands become more localized near the edges of the quantum dot resulting in suppression of the band gap, enhancement of the dipole inter-band coupling, and strong suppression of the average low-energy electron density of the states. As a result, the nonlinear response of the electron system of a Haldane model quantum dot is the strongest at intermediate values of the phase, ≈ 30− 40°. At these values of the phase, the electron dynamics is irreversible and a few first high-order harmonics have the largest intensities. Here, when the phase approaches 90° value the generation of high harmonics is strongly suppressed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Adaptive Generation of Training Data for ML Reduced Model Creation

Machine learning proxy models are often used to speed up or completely replace complex computational models. The greatly reduced and deterministic computational costs enable new use cases such as digital twin control systems and global optimization. The challenge of building these proxy models is generating the training data. A naive uniform sampling of the input space can result in a non-uniform sampling of the output space of a model. This can cause gaps in the training data coverage that can miss finer scale details resulting in poor accuracy. While larger and larger data sets could eventually fill in these gaps, the computational burden of full-scale simulation codes can make this prohibitive. In this paper, we present an adaptive data generation method that utilizes uncertainty estimation to identify regions where training data should be augmented. By targeting data generation to areas of need, representative data sets can be generated efficiently. The effectiveness of this method will be demonstrated on a simple one-dimensional function and a complex multidimensional physics model.

Cianciosa, Mark↗
DOE OSTI2021

Bayesian Learning of Adatom Interactions from Atomically Resolved Imaging Data

Atomic structures and adatom geometries of surfaces encode information about the thermodynamics and kinetics of the processes that lead to their formation, and which can be captured by a generative physical model. In this work, we develop a workflow based on a machine-learning-based analysis of scanning tunneling microscopy images to reconstruct the atomic and adatom positions, and a Bayesian optimization procedure to minimize statistical distance between the chosen physical models and experimental observations. We optimize the parameters of a 2- and 3-parameter Ising model describing surface ordering and use the derived generative model to make predictions across the parameter space. For concentration dependence, we compare the predicted morphologies at different adatom concentrations with the dissimilar regions on the sample surfaces that serendipitously had different adatom concentrations. The proposed workflow can be used to reconstruct the thermodynamic models and associated uncertainties from the experimental observations of materials microstructures. The code used in the manuscript is available at https://github.com/saimani5/Adatom_interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A Deep Gravity model for mobility flows generation

The movements of individuals within and among cities influence critical aspects of our society, such as well-being, the spreading of epidemics, and the quality of the environment. When information about mobility flows is not available for a particular region of interest, we must rely on mathematical models to generate them. In this work, we propose Deep Gravity, an effective model to generate flow probabilities that exploits many features (e.g., land use, road network, transport, food, health facilities) extracted from voluntary geographic data, and uses deep neural networks to discover non-linear relationships between those features and mobility flows. Our experiments, conducted on mobility flows in England, Italy, and New York State, show that Deep Gravity achieves a significant increase in performance, especially in densely populated regions of interest, with respect to the classic gravity model and models that do not use deep neural networks or geographic data. Deep Gravity has good generalization capability, generating realistic flows also for geographic areas for which there is no data availability for training. Finally, we show how flows generated by Deep Gravity may be explained in terms of the geographic features and highlight crucial differences among the three considered countries interpreting the model’s prediction with explainable AI techniques.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Methyl propyl ether combustion

Ethers are potential diesel blendstocks that have high cetane numbers and identified cost-effective production pathways. Among ethers, methyl propyl ether (MPE) is a small enough molecule to build a good detailed model for and a large enough molecule for studying key intramolecular hydrogen migrations involved in low-temperature feedback loops for larger ethers. In this study, a model was generated for the combustion of MPE from 600-900 K and 10-20 bar using the Reaction Mechanism Generator (RMG) package. Results from rapid compression machine (RCM) experiments were used to validate the kinetic model. At low temperatures, the generated model successfully captured the dominant low-temperature feedback loops. At higher temperatures, propanal is a major combustion intermediate for PME, suggesting that aldehydes likely play a significant role in larger ethers' combustion.

09 BIOMASS FUELS↗
DOE OSTI2021

The Impala's horn applied to posterior samples of Ti-6Al-4V strength model parameters

We have generated strength model parameters for the Preston-Tonks-Wallace (PTW) model of plastic deformation based on a collection of Ti-6Al-4V alloy data and a Bayesian framework. This data collected from the literature includes different chemistries and processes. The experiments include quasistatic compression, Split Hopkinson Pressure Bar (SHPB) compression, and Taylor cylinders. Here we use posterior parameter distributions applied to a hypothetical impact referred to as the Impala's horn. The Impala's horn is like a Taylor cylinder, but modified to have a conical pro le that is truncated before coming to a point. The smaller diameter at the impact end results in higher calculated strain rates and strains than the same velocity impact with the traditional Taylor profile. The modified geometry exercises the behavior of the strength model outside the range of conditions found in the calibration data. Here we sort posterior strength models based on their flow stress at characteristic values for this hypothetical deformation. Then we compare the performance of these posterior models based on two simple observable final state properties of the Impala's horn.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Development of a metamodelling framework for building energy models with application to fifth-generation district heating and cooling networks

Fully defined physics-based building energy models can accurately represent building systems; however, generating models based on high-level parameters is time consuming and simulation time of complex models can be slow. This article discusses the development of a Metamodelling Framework to create metamodels from a building energy modelling dataset. The framework generates metamodels using either linear regression, random forests, or support vector regressions. A fifth-generation district heating and cooling system analysis use case was used to motivate the development of the framework. The use case required quick and accurate representations of annual building loads reported hourly. Typical annual building modelling approaches can result in a runtime of 10 min. The metamodels runtime was reduced to less than 10 s to load and run an annual simulation with user-defined covariates. The results of the metamodel performance and an abbreviated topology analysis based on the motivating use case will be presented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

The impact of market design and clean energy incentives on strategic generation investments and resource adequacy in low-carbon electricity markets

Well-designed electricity markets play a crucial role in maintaining reliable electric power systems, which are critical in modern society. Here, this study examines the impact of different electricity market designs and clean energy incentive schemes on supporting renewable energy integration and achieving clean energy goals. To this end, we utilize a game-theoretical generation expansion planning model where generation companies make investment and retirement decisions to maximize their expected profit. The model is structured as an equilibrium problem with equilibrium constraints (EPEC) and solved using a diagonalization approach combined with progressive hedging. We analyze three types of electricity market designs: an energy-only market, a capacity market, and a clean energy market, and consider a wide range of market parameters resulting in 14 total scenarios. Wind and solar capacity comprise the majority of new investments in all considered scenarios, but the resultant system planning reserve margin (PRM) can differ significantly depending on market parameters. We also find that profit-driven investments lead to lower PRMs than a traditional system cost minimization approach. These individual scenario results further demonstrate how different market designs and clean energy incentive schemes may influence investor decision-making and impact resource adequacy throughout the clean energy transition.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Reliable Integration of AI Data Centers at Scale – Analysis, Modeling and Synthetic Data Generation

This report analyzes the power consumption of large dynamic digital loads using the open-source MIT supercloud and SURF datasets. With an emphasis on the MIT data, we calculate important power consumption characteristics to help system operators improve generation planning and resource allocation. We also introduce a rudimentary model for generating synthetic load profiles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Modeling 233 Pa Generation in Thorium-fueled Reactors for Safeguards

Thorium has been considered as a possible alternative to uranium for nuclear fuel for many decades. It is three to four times more abundant in the earth than uranium and produces significantly less long-lived transuranic nuclear waste. Some claim thorium poses fewer proliferation concerns than other fuel types largely due to 232 U buildup (and associated high energy gamma-emitting decay products) in the irradiated thorium fuel. However, to fully explore potential proliferation concerns, generation and subsequent decay of 233 Pa produced in the reactor core still must be studied. With its half-life of 27 days, 233 Pa decays to 233 U, which is an International Atomic Energy Agency (IAEA) defined special fissionable material that can be used for nuclear weapons production. With more research being dedicated to thorium-fueled reactors, and several of these reactor designs possessing online fuel processing (allowing for on-site protactinium separation), it is important to understand this potential proliferation pathway. In particular, it is theoretically possible to extract protactinium from the irradiated fuel salt before it decays into 233 U. This hypothetical potential diversion can become an even greater proliferation concern if the extracted protactinium is purified through a second separation of protactinium approximately ten days later to remove the short half-life decay products of 232 Pa and 234 Pa, thus resulting in a higher concentration of the 233 Pa isotope, which decays into weapons usable 233 U with hardly any 232 U or 234 U in it. To estimate the concern of this potential proliferation challenge of thorium, different nuclear material accountancy techniques were reviewed for their viability to quantify 233 Pa if extracted from used thorium fuel. Characteristics of interest included technology maturity, cost, precision, and time taken to acquire results. Some technologies, like hybrid K-edge densitometry and passive gamma spectroscopy, appear to be viable techniques based on current literature. Due to the limited scope of this project, only passive gamma spectroscopy was further investigated. Three different reactor types (PWR, CANDU, MSR) were modeled with mixed thorium-uranium oxide fuels that were burned until the fuel was spent. The protactinium in the used fuel was extracted at the time of shutdown and the change in isotopic content of the protactinium quantified. Gamma spectroscopy simulations were performed for the protactinium isotopes and their decay products at various decay times. Given the simplicity of the models and large assumptions made (e.g. no background, no shielding, no self-attenuation), the initial results indicate that though 233 Pa is detectible for all the reactor types modeled at all decay times (0 to 300 days), more work should be done with higher fidelity models.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2023

Extreme waves in present and future climates using physics-based synthetic tropical cyclones in the Gulf of Mexico.

Historically, extreme waves have been the most destructive force in the Gulf of Mexico, destroying and damaging thousands of offshore structures. The American Petroleum Institute has revised its design criteria for offshore platforms several times over the decades, as new data continues to become available, showing that data for our present climate is insufficient. This problem is exacerbated in a changing climate. By using synthetic physics-based tropical cyclones to force a third-generation wave model, we can generate adequate statistics for present and future climates. These simulations have been completed using Joule Supercomputer.

Climate Change↗
DOE OSTI2023

Digital polycrystalline microstructure generation using diffusion probabilistic models

Accurate micromechanical simulation of polycrystalline materials requires a realistic digital representation of the grain scale microstructure. Here, this work demonstrates the use of a generative diffusion probabilistic model for synthesizing single phase polycrystalline realizations. The model performs well and is capable of producing realistic microstructures consisting of not just simple equiaxed structures but also structures exhibiting more complex spatial arrangements. Masked microstructure generation reveals that the model is context aware of morphological descriptors which may be encoded in the latent space. Training on more diverse data sets, with scaled up architectures, may enable development of future models capable of synthesizing even more complex microstructural features.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗