Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

From disorganized data to emergent dynamic models: Questionnaires to partial differential equations

Starting with sets of disorganized observations of spatially varying and temporally evolving systems, obtained at different (also disorganized) sets of parameters, we demonstrate the data-driven derivation of parameter dependent, evolutionary partial differential equation (PDE) models capable of generating the data. This tensor type of data is reminiscent of shuffled (multidimensional) puzzle tiles. The independent variables for the evolution equations (their “space” and “time”) as well as their effective parameters are all emergent , i.e. determined in a data-driven way from our disorganized observations of behavior in them. We use a diffusion map based questionnaire approach to build a smooth parametrization of our emergent space/time/parameter space for the data. This approach iteratively processes the data by successively observing them on the “space,” the “time” and the “parameter” axes of a tensor. Once the data become organized, we use machine learning (here, neural networks) to approximate the operators governing the evolution equations in this emergent space. Our illustrative examples are based (i) on a simple advection–diffusion model; (ii) on a previously developed vertex-plus-signaling model of Drosophila embryonic development; and (iii) on two complex dynamic network models (one neuronal and one coupled oscillator model) for which no obvious smooth embedding geometry is known a priori. This allows us to discuss features of the process like symmetry breaking, translational invariance, and autonomousness of the emergent PDE model, as well as its interpretability.

generative models↗
DOE OSTI2020

Heat of Mixing During Fast Charge/Discharge of a Li-Ion Cell: A Study on NMC523 Cathode

Predicting temperature rise accurately during fast charge/discharge of a Li-ion cell is essential to avoid thermal runaway and extend battery life. While modeling the temperature rise, it is necessary to model the heat generation correctly. Heat of mixing, one of the four main sources of heat generation in a Li-ion battery, has often been considered insignificant and therefore excluded from modeling. When included, it is modeled using the expression from a Taylor expansion approximation. In this work, we have shown the conditions when including the heat of mixing becomes important and quantified the error associated with using the Taylor expansion, especially under high charge/discharge conditions. Consequently, we carry out the calculation of the rate of enthalpy change and the heat generation rate from the most fundamental equation for the rate of the total enthalpy change without simplifying assumptions or approximations. The heat generation rate calculated doing so naturally includes irreversible, reversible and mixing heat. We then exclusively separate out the heat of mixing by subtracting the rate of enthalpy change by reaction from the rate of the total enthalpy change. Results show that the contribution of heat of mixing in the total heat generated increases with the charge/discharge rate and is as large as 23% for a 6 C discharge. This result suggests that while modeling heat generation for fast charge/discharge, it is necessary to include the heat of mixing and avoid calculating it using the Taylor expansion approximation.

25 ENERGY STORAGE↗
DOE OSTI2022

Particle-based fast jet simulation at the LHC with variational autoencoders

Abstract We study how to use deep variational autoencoders (VAEs) for a fast simulation of jets of particles at the Large Hadron Collider. We represent jets as a list of constituents, characterized by their momenta. Starting from a simulation of the jet before detector effects, we train a deep VAE to return the corresponding list of constituents after detection. Doing so, we bypass both the time-consuming detector simulation and the collision reconstruction steps of a traditional processing chain, speeding up significantly the events generation workflow. Through model optimization and hyperparameter tuning, we achieve state-of-the-art precision on the jet four-momentum, while providing an accurate description of the constituents momenta, and an inference time comparable to that of a rule-based fast simulation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

A general mechanistic framework for cross-scale understanding of hot spots and hot moments in carbon and water fluxes

Semi-arid ecosystems, like those in the American Southwest, exert a massive impact on the interannual variability of carbon and water cycling. Unfortunately, these carbon and water fluxes are notoriously difficult to predict due to their high spatial and temporal variability, which is poorly captured by the current generation of vegetation models. Indeed, this region is exemplified by the ‘hot spots and hot moments’ concept, which states that small areas in space (‘hot spots’) and transient moments in time (‘hot moments’) exert an outsized influence on biogeochemical cycling. However, the factors that regulate these pulses in biogeochemical activity are unknown, as is their variability across space and time. These uncertainties severely limit efforts to better represent hot spots and hot moments in models. Here, we seek to develop a generalized method for detecting and quantifying the importance of hot spots and hot moments from individual plant to regional scales. Underpinning this method is our recently developed statistical approach for identifying hot spots and hot moments. By applying this method to semi-continuous measurements of plant water status, a depth profile of soil water potential, and ecosystem fluxes via eddy covariance, we will track the fate of water through the soil-plant-atmosphere continuum and identify the mechanistic drivers of these transient pulses in biogeochemical activity. Then, we will expand this approach across a broad network of Ameriflux towers, and apply a machine learning approach that will allow us to upscale measurements of hot spots and hot moments across the American Southwest and quantify their impact on carbon and water cycles. These products will allow us to identify hot spots and hot moments across spatio-temporal scales and will serve as crucial data sources for validating a new generation of models that can better capture highly dynamic carbon and water fluxes. The proposed method will be easily transferable across biomes and will serve as a framework for future research on hot spots and hot moments across the plant ecophysiology, biometeorology, and vegetation modeling communities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Reduced-Order Parameterized Short-Circuit Current Model of Inverter-Interfaced Distributed Generators

The short-circuit response of inverter-interfaced distributed generators (IIDGs) is not adequately represented in many conventional protection studies. This paper presents an in-depth analysis of IIDG behavior during grid faults and proposes a more accurate reduced-order parameterized short-circuit current (RPSC) model of inverters. Typical inverter components are thoroughly investigated to identify those that play dominant roles during faults. The paper shows that the current limiter is the dominant factor for the steady-state fault-current of inverter; while the inverter filter along with the severity of the voltage disturbance largely determine the initial transient spike of inverter fault current. The proposed model is low-order and can be used in large scale simulations. The parameters of the proposed RPSC model can be extracted from laboratory experiments without requiring proprietary manufacturer information. The proposed fault-current model is analogous to the well-known synchronous machine model that segregates the inverter fault current into subtransient, transient, and steady-state fault currents. Finally, experimental and simulation tests are presented to validate the model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Full event particle-level unfolding with variable-length latent variational diffusion

The measurements performed by particle physics experiments must account for the imperfect response of the detectors used to observe the interactions. One approach, unfolding, statistically adjusts the experimental data for detector effects. Recently, generative machine learning models have shown promise for performing unbinned unfolding in a high number of dimensions. However, all current generative approaches are limited to unfolding a fixed set of observables, making them unable to perform full-event unfolding in the variable dimensional environment of collider data. A novel modification to the variational latent diffusion model (VLD) approach to generative unfolding is presented, which allows for unfolding of high- and variable-dimensional feature spaces. The performance of this method is evaluated in the context of semi-leptonic t\bar{t} t t ‾ production at the Large Hadron Collider.

Shmakov, Alexander↗
DOE OSTI2025

Effect of self-generated magnetic fields on x-ray emission in Kr-filled targets at the National Ignition Facility

We examine the effects of self-generated magnetic fields in a Kr gas pipe x-ray source platform. X-ray emission from Kr plasma is dependent on the plasma conditions, as the ionization state is largely a function of temperature. Magnetic fields are known to limit heat conduction, which increases temperature. We show that the emission in simulations of the gas pipe x-ray source is dependent on how self-generated magnetic fields are modeled. The inclusion of self-generated magnetic fields in simulations more accurately captures the emission of lower energy x-ray emission (L-shell), bringing results closer to experiments. The modeled x-ray emission and self-generated magnetic fields are shown to be particularly sensitive to the inclusion of the Nernst effect in simulations. Severely limiting the Nernst effect leads to a hotter Kr plasma, which can account for the discrepancy seen in earlier studies. By modifying the Nernst effect multiplier, we can achieve better experimental agreement in x-ray emission from gas pipes; the value of the multiplier that leads to the best agreement is dependent on the laser power of the drive. Currently, the suppression factor of the Nernst effect needed for high power drives (PL>200 TW) is more restrictive than what is currently put forward by non-local models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

The Lack of a QBO-MJO Connection in Climate Models With a Nudged Stratosphere

The observed stratospheric quasi-biennial oscillation (QBO) and the tropospheric Madden-Julian oscillation (MJO) are strongly connected in boreal winter, with stronger MJO activity when lower-stratospheric winds are easterly. However, the current generation of climate models with internally generated representations of the QBO and MJO do not simulate the observed QBO-MJO connection, for reasons that remain unclear. Furthermore, this study builds on prior work exploring the QBO-MJO link in climate models whose stratospheric winds are relaxed toward reanalysis, reducing stratospheric biases in the model and imposing a realistic QBO. A series of ensemble experiments are performed using four state-of-the-art climate models capable of representing the MJO over the period 1980–2015, each with similar nudging in the stratosphere. In these four models, nudging leads to a good representation of QBO wind and temperature signals, however no model simulates the observed QBO-MJO relationship. Biases in MJO vertical structure and cloud-radiative feedbacks are investigated, but no conclusive model bias or mechanism is identified that explains the lack of a QBO-MJO connection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Incorporating point defect generation due to jog formation into the vector density-based continuum dislocation dynamics approach

During plastic deformation of crystalline materials, point defects such as vacancies and interstitials are generated by jogs on moving dislocations. A detailed model for jog formation and transport during plastic deformation was developed within the vector density-based continuum dislocation dynamics framework. Here as a part of this model, point defect generation associated with jog transport was formulated in terms of the volume change due to the non-conservative motion of jogs. Balance equations for the vacancies and interstitials including their rate of generation due to jog transport were also formulated. A two-way coupling between point defects and dislocation dynamics was then completed by including the stress contributed by the eigen-strain of point defects. A jog drag stress was further introduced into the mobility law of dislocations to account for the energy dissipation during point defects generation. A number of test problems and a fully coupled simulation of dislocation dynamics and point defects generation and diffusion were performed. The results show that there is an asymmetry of vacancy and interstitial generation due to the different formation energies of the two types of defects. The results also show that a higher hardening rate and a higher dislocation density are obtained when the point defect generation mechanism is coupled to dislocation dynamics.

36 MATERIALS SCIENCE↗
DOE OSTI2021

The Impact of the Lightning Surge on SiC-based Medium-voltage Three-phase Four-wire Grid-connected Converters

The surge voltage induced by lightning will generate an inrush current in a grid-connected converter. It may not be large in Si-based converters because of the large grid side inductive filter. However, for SiC-based multi-level converters, the inrush current could be very large due to the small filter inductance, which is selected based on the current harmonic consideration. Most previous work focuses on system-level lightning protection while the converter-level impact, especially the internal components of the converter, is rarely discussed. This paper presents the analysis of the impact of the lightning surge on a 10 kV SiC MOSFET-based 13.8 kV three-phase four-wire grid-connected converter. The IEEE arrester model and the combined wave generator model in IEC 61000-4-5 standard are used to evaluate the inrush current, DC-link overvoltage, and component-to-ground potential of the converter. Analysis and simulation results have been provided to demonstrate the impact of lightning on the grid-connected converter. It is found that large inrush current occurs due to the small filter inductance, and the neutral-to-ground impedance impacts both the inrush current and the neutral point-to-ground potential.

Li, Haiguo↗
DOE OSTI2023

Microgrid Modeling for Stability Analysis

Here this document is a summary of a report prepared by the IEEE PES Task Force (TF) on Microgrid (MG) Dynamic Modeling, IEEE Power and Energy Society, Tech. Rep. PES-TR106, 2023. In this paper, the major issues and challenges in microgrid modeling for stability analysis are discussed, and a review of state-of-the-art modeling approaches and trends is presented. In the context of the IEEE 1547 standard, the document covers issues associated with component models for MG dynamic studies and simulations, including generator and grid modeling, full and average converter models, unbalanced and balanced system conditions, dynamic and static loads, protection requirements, and detailed and simplified controls considering communications delays, packet losses, and security issues. Considering the future integration of grids and MGs to form broad integrated networks, a discussion is presented of the use of phasor vis-à-vis electromagnetic transient simulation tools for MG dynamic stability studies, as well as modeling scale-up issues and MG equivalent models. Specifically white-, grey-, and black-box models, are presented. This TF paper and companion report constitute a modeling guide for R&D groups working on developments and standards of MGs with a focus on stability issues.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Hunga Tonga–Hunga Ha′apai Volcano Impact Model Observation Comparison (HTHH-MOC) project: experiment protocol and model descriptions

The 2022 Hunga volcanic eruption injected a significant amount of water vapor and a moderate amount of sulfur dioxide into the stratosphere, causing observable responses in the climate system. We have developed a model–observation comparison project to investigate the evolution of volcanic water and aerosols and their impacts on atmospheric dynamics, chemistry, and climate, using several state-of-the-art chemistry climate models. The project goals are (1) to evaluate the current chemistry–climate models to quantify their performance in comparison to observations and (2) to understand atmospheric responses in the Earth system after this exceptional event and investigate the potential impacts in the projected future. To achieve these goals, we designed specific experiments for direct comparisons to observations, for example from balloons and the Microwave Limb Sounder satellite instrument. Experiment 1 consists of two sets of free-running ensemble experiments from 2022 to 2031: one with fixed sea-surface temperatures and sea ice and one with coupled ocean. These experiments will help to understand the long-term evolution of water vapor and aerosols; quantify HTHH effects on stratospheric and mesospheric temperatures, dynamics, and transport; understand the impact of dynamic changes on ozone chemistry; quantify the net radiative forcings; and evaluate any surface climate impact. Experiment 2 is a nudged-run experiment from 2022 to 2023 using observed meteorology. To allow participation of more climate models with varying complexities of aerosol simulation, we include two sets of simulations in Experiment 2: Experiment 2a is designed for models with internally generated aerosol, while Experiment 2b is designed for models using prescribed aerosol surface area density. This experiment will help to analyze H 2 O and aerosol evolution, quantify the net radiative forcings, understand the impacts on mid-latitude and polar O 3 chemistry, and allow close comparisons with observations.

Zhu, Yunqian [Univ. of Colorado, Boulder, CO (Unit↗
DOE OSTI2024

Exploiting Multi-Domain Features for Detection of Unclassified Electromagnetic Signals

Deep Learning based classification techniques have shown excellent performance in static environments, where the training and testing samples are drawn from the same distribution. However, real world scenarios often present samples that do not belong to the known set of classes chosen during training. This is quite common for electromagnetic signals, where it is impractical to assume that all possible waveforms are known a-priori, specially in scenarios like warfare. To address this problem, we propose a deep learning based adversarial model where the generator learns to generate waveform features that can deceive the discriminator model as true samples. We introduce domain knowledge of wireless signals by decomposing the signal into a lower dimensional unique feature set, which is used for classifying known versus unknown signals. We further introduce multiple domain representations of the signal to extract features and combine them together to accurately classify new waveforms as an unknown class. Our results show that combined features from multiple domains outperform any single domain representation, especially at low SNR regimes with fewer number of samples to classify.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Exploiting Multi-Domain Features for Detection of Unclassified Electromagnetic Signals (Presentation)

Deep Learning based classification techniques have shown excellent performance in static environments, where the training and testing samples are drawn from the same distribution. However, real world scenarios often present samples that do not belong to the known set of classes chosen during training. This is quite common for electromagnetic signals, where it is impractical to assume that all possible waveforms are known a-priori, specially in scenarios like warfare. To address this problem, we propose a deep learning based adversarial model where the generator learns to generate waveform features that can deceive the discriminator model as true samples. We introduce domain knowledge of wireless signals by decomposing the signal into a lower dimensional unique feature set, which is used for classifying known versus unknown signals. We further introduce multiple domain representations of the signal to extract features and combine them together to accurately classify new waveforms as an unknown class. Our results show that combined features from multiple domains outperform any single domain representation, especially at low SNR regimes with fewer number of samples to classify.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Towards an astronomical foundation model for stars with a transformer-based model

ABSTRACT Rapid strides are currently being made in the field of artificial intelligence using transformer-based models like Large Language Models (LLMs). The potential of these methods for creating a single, large, versatile model in astronomy has not yet been explored. In this work, we propose a framework for data-driven astronomy that uses the same core techniques and architecture as used by LLMs. Using a variety of observations and labels of stars as an example, we build a transformer-based model and train it in a self-supervised manner with cross-survey data sets to perform a variety of inference tasks. In particular, we demonstrate that a single model can perform both discriminative and generative tasks even if the model was not trained or fine-tuned to do any specific task. For example, on the discriminative task of deriving stellar parameters from Gaia XP spectra, we achieve an accuracy of 47 K in Teff, 0.11 dex in log g, and 0.07 dex in [M/H], outperforming an expert XGBoost model in the same setting. But the same model can also generate XP spectra from stellar parameters, inpaint unobserved spectral regions, extract empirical stellar loci, and even determine the interstellar extinction curve. Our framework demonstrates that building and training a single foundation model without fine-tuning using data and parameters from multiple surveys to predict unmeasured observations and parameters is well within reach. Such ‘Large Astronomy Models’ trained on large quantities of observational data will play a large role in the analysis of current and future large surveys.

Leung, Henry W. (ORCID:0000000200362752)↗
DOE OSTI2021

Testing to Evaluate Processes Expected to Occur during MSR Salt Spill Accidents

Obtaining a license for a new nuclear reactor requires the identification and assessment of the potential consequences of specified accident scenarios, which are achieved using accident progression models. Those models need to be parameterized and validated using experimental data, but existing experimental data addressing processes relevant to molten salt reactor accidents are sparse. Specifically, experimental data that quantify the sensitives of important processes to the initial conditions of the spill, the ambient environment, and the containment features are needed to parameterize individual process models. Integrated experiments that simulate accident scenarios are also needed to provide data for model validation, but these experiments will require the use of proven methods to quantify the processes under evaluation. The overarching objectives of this work are to develop the methods for simulating the targeted processes, to determine the effectiveness of the methods in producing the data required for model development, to generate data that can be used to parameterize individual process models, and to provide key insights into the behavior of spilled molten salt that should be considered in models. Experimental methods were designed to quantify aspects of individual processes expected to occur during or after a molten salt spill accident that will affect the fate of spilled molten salt and the radionuclides within. These processes include 1) molten salt spreading and heat transfer, 2) molten salt flowing and freezing in tubing, 3) stainless steel corrosion kinetics in molten salt, and 4) molten salt splashing and aerosol generation. The initial tests described in this report were conducted using eutectic FLiNaK to demonstrate the test methods, the data that are generated, and the analyses of the data to derive values needed for modeling. The primary variables that were tested include initial salt temperature and the presence of volatile surrogate fission products (e.g., cesium and iodine). The developed methods are shown to be effective in quantifying the desired processes and can be applied to study more complex salt compositions of interest to molten salt reactor developers, a wide range of environmental conditions of interest to modelers, and additional variables relevant to salt spill accidents. The developed methods and insights gained from laboratory tests can also be incorporated in future large-scale integrated tests used to simulate molten salt spill accidents.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Electrification Futures Study: Methodological Approaches for Assessing Long-Term Power System Impacts of End-Use Electrification

By its nature, electrification enhances the coupling between the electric sector and end-use sectors. Assessing the impacts of electrification requires both an examination of the complex interactions between sectors and a broader assessment of multiple parts of the energy system. The Electrification Futures Study (EFS) uses several complementary modeling and analysis tools to analyze the impacts of electrification on the U.S. energy system. In particular, the EFS relies on an overarching scenario analysis approach, but through the use of separate modeling approaches designed to assess various electricity demand- and supply-side futures. The primary model employed to generate the supply-side scenarios is the Regional Energy Deployment System (ReEDS) model, which is a capacity expansion model for the U.S. electricity system through 2050. Traditionally, the model has been primarily exercised in scenario analysis that implicitly assumed limited electrification. Because of this assumption, resulting future load profiles are approximated by historical ones, load growth is driven primarily by population and economic growth only, and changes in direct end-use natural gas consumption do not effect natural gas costs for electricity generation. In this report, we (1) reflect the potential for resource sharing between regions given these changes in demand, (2) represent how changes in natural gas consumption in end-use sectors could impact the economics of natural gas-fired generation, and (3) document a new model representation of demand-side flexibility used for the EFS. These improvements to ReEDS are employed for the EFS supply-wide analysis, which is summarized in a companion EFS report titled Electrification Futures Study: Scenarios of Power System Evolution and Infrastructure Development for the United States (Murphy et al. 2019). The data and methods documented in this report could also be adapted for other models with similar scope and limitations as ReEDS, and these data and methods could be used to assess future electric system scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Opportunities for Earth Observation to Inform Risk Management for Ocean Tipping Points

Abstract As climate change continues, the likelihood of passing critical thresholds or tipping points increases. Hence, there is a need to advance the science for detecting such thresholds. In this paper, we assess the needs and opportunities for Earth Observation (EO, here understood to refer to satellite observations) to inform society in responding to the risks associated with ten potential large-scale ocean tipping elements: Atlantic Meridional Overturning Circulation; Atlantic Subpolar Gyre; Beaufort Gyre; Arctic halocline; Kuroshio Large Meander; deoxygenation; phytoplankton; zooplankton; higher level ecosystems (including fisheries); and marine biodiversity. We review current scientific understanding and identify specific EO and related modelling needs for each of these tipping elements. We draw out some generic points that apply across several of the elements. These common points include the importance of maintaining long-term, consistent time series; the need to combine EO data consistently with in situ data types (including subsurface), for example through data assimilation; and the need to reduce or work with current mismatches in resolution (in both directions) between climate models and EO datasets. Our analysis shows that developing EO, modelling and prediction systems together, with understanding of the strengths and limitations of each, provides many promising paths towards monitoring and early warning systems for tipping, and towards the development of the next generation of climate models.

Wood, Richard A. (ORCID:0000000239609513)↗