SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Active learning of a crystal plasticity flow rule from discrete dislocation dynamics simulations

Continuum-scale material deformation models, such as crystal plasticity (CP), can significantly enhance their predictive accuracy by incorporating input from lower-scale (i.e. mesoscale) models. The procedure to generate and extract the relevant information is however typically complex and ad hoc, involving decision and intervention by domain experts, leading to long development times. In this study, we develop a principled approach for calibration of continuum-scale models using lower scale information by representing a CP flow rule as a Gaussian process model. This representation allows for efficient parameter space exploration, guided by the uncertainty embedded in the model through a process known as Bayesian optimization (BO). We demonstrate a semi-autonomous BO loop which instantiates discrete dislocation dynamics simulations whose initial conditions are automatically chosen to optimize the uncertainty of a model CP flow rule. Our self-guided computational pipeline efficiently generated a dataset and corresponding model whose error, uncertainty, and physical feature sensitivities were validated with comparison to an independent dataset four times larger, demonstrating a valuable and efficient active learning implementation readily transferable to similar material systems.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Charging infrastructure access and operation to reduce the grid impacts of deep electric vehicle adoption

Electric vehicles will contribute to emissions reductions in the United States, but their charging may challenge electricity grid operations. We present a data-driven, realistic model of charging demand that captures the diverse charging behaviours of future adopters in the US Western Interconnection. We study charging control and infrastructure build-out as critical factors shaping charging load and evaluate grid impact under rapid electric vehicle adoption with a detailed economic dispatch model of 2035 generation. We find that peak net electricity demand increases by up to 25% with forecast adoption and by 50% in a stress test with full electrification. Locally optimized controls and high home charging can strain the grid. Shifting instead to uncontrolled, daytime charging can reduce storage requirements, excess non-fossil fuel generation, ramping and emissions. Our results urge policymakers to reflect generation-level impacts in utility rates and deploy charging infrastructure that promotes a shift from home to daytime charging.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

System Analysis Modeling and Intermodal Transportation for Commercial Spent Nuclear Fuel

The United States Department of Energy (DOE) has long term goals to develop solutions for managing the nation’s spent nuclear fuel (SNF) and high-level waste (HLW) inventory. The Integrated Waste Management (IWM) program under the DOE office of Nuclear Energy (DOE-NE) is employing system-level engineering and analysis principles to inform potential future waste management system architectures. Managing the spent nuclear waste requires the use of system-level analysis software that takes various aspects of the fuel cycle into account like waste generation, on-site/centralized storage, transportation infrastructure, and long-term disposal. The Next Generation System Analysis Model (NGSAM) is an agent-based model that was developed to simulate the transportation and storage of SNF and HLW. As an agent-based model, NGSAM has the capability to detail the interaction and movement of individual components and groups, such as rail cars and casks. The SNF inventory from commercial nuclear reactors is currently in temporary storage at multiple locations spread across the United States. Shipping of SNF from these locations relies on one of three transportation modes: rail, heavy-haul truck, or barge. Out of the three modes identified, rail is generally the most preferred due to the size of the canisters and casks the SNF would be shipped in. However, under some scenarios, a direct rail route might not be readily available to a reactor site or improving the rail infrastructure at shutdown sites might be too cost-prohibitive for utilities to opt for a direct rail transfer. Under such scenarios, using a barge or heavy haul truck to de-inventory the site and transfer the SNF to a nearby intermodal transfer site with adequate rail infrastructure where the payload could be transferred to a rail car might prove to be an attractive option. This work initially presents the various intermodal transportation options that could be used to transfer SNF from reactor sites to rail cars. This is followed by exploring the operational steps in each of these modes to move the SNF from a reactor site and transfer it to a rail car. This work also presents the procedure of implementing the intermodal transfer methodology in NGSAM using various Java methods. Finally, the process times for accomplishing each of the individual steps are furnished. The implementation ideology, assumptions, and future steps are presented in this work.

Gadey, Harish Reddy↗

DOE OSTI2022

System Analysis Modeling and Intermodal Transportation for Commercial Spent Nuclear Fuel

The United States Department of Energy (DOE) Office of Nuclear Energy is applying knowledge and understanding in the areas of systems level engineering, analysis, and decision making to better inform the waste management pathways for U.S. spent nuclear fuel (SNF). Currently there are 93 operating and 23 shutdown commercial nuclear reactors in the United States. SNF at most of these locations is being stored in spent fuel pools, dry storage, or both [1, 2]. This paper initially goes over the basics of the agent-based simulation tool known as the Next Generation System Analysis Model (NGSAM) that has the capability to model interaction and movements of individual components or groups like casks, railcars etc. The next section covers some of the methods implemented in the Java Transportation Operations Model (JTOM) to facilitate the movement of assemblies, casks, railcars etc. and the various intermodal transfer options. This section also covers the current cask loading and intermodal transfer times implemented in NGSAM. The last section goes over the proposed values for intermodal transportation, and cask transfer/loading operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

DOE OSTI2025

Downscaled Earth System Model Data for Resilient Energy System Planning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Enabling scientific machine learning in MOOSE using Libtorch

A neural-network-based machine learning interface has been developed for the Multiphysics Object-Oriented Simulation Environment (MOOSE). The interface relies on Libtorch, the C++ front-end of PyTorch, and enables an online interaction between modern machine learning algorithms and all the existing simulation, modeling, and analysis processes available in MOOSE. New capabilities in MOOSE include the native generation and training of artificial neural networks together with options to load pretrained neural networks in TorchScript format. Furthermore, the MOOSE stochastic tools module (MOOSE-STM) has been enhanced with neural network-based surrogate and reduced-order model generation options for efficient stochastic analyses. Lastly, a reinforcement learning capability has been added to MOOSE-STM for the interactive control and optimization of complex multiphysics problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Data-driven prediction of geometry- and toolpath sequence-dependent intra-layer process conditions variations in laser powder bed fusion

Geometrical features and toolpath sequence are two important factors that cause process condition variations, such as variations in the meltpool temperature or meltpool size, that might lead to undesired material properties in the laser powder bed fusion (LPBF) process. Due to the high dynamics and complex physics of the LPBF process, it is difficult to predict variations in process conditions with simulations alone. Advances in measurement technology and computational technologies open up new possibilities for smart manufacturing. In this paper, a data-driven method to predict intra-layer variations in the processing conditions that source from the toolpath sequence and part geometry is presented. The approach is demonstrated using two-color on-axis pyrometer measurements. Three demonstration cases are presented in which it is demonstrated (1) how the trained predictive model can be used as a filter to ease the interpretation of process variations and discover patterns related to toolpath and part geometry, and (2) how to generate predictions that can be used for feedforward control, i.e., for adjusting laser power or scanning speed along the toolpath using a meltpool temperature prediction model generated based on on-axis measurements. Results show that the developed prediction model is able to meaningfully predict process variations resulted from toolpath sequence and geometry. Predictions are aligned with the results from the related work of others and for the case of 180° laser path turnarounds in our high-speed X-ray imaging experiments. In conclusion, the potential issues related to the current maturity status of the process and measuring equipment that could in practice affect the performance of the proposed solutions are also discussed.

42 ENGINEERING↗

DOE OSTI2021

Machine learning with persistent homology and chemical word embeddings improves prediction accuracy and interpretability in metal-organic frameworks

Machine learning has emerged as a powerful approach in materials discovery. Its major challenge is selecting features that create interpretable representations of materials, useful across multiple prediction tasks. We introduce an end-to-end machine learning model that automatically generates descriptors that capture a complex representation of a material’s structure and chemistry. This approach builds on computational topology techniques (namely, persistent homology) and word embeddings from natural language processing. It automatically encapsulates geometric and chemical information directly from the material system. We demonstrate our approach on multiple nanoporous metal–organic framework datasets by predicting methane and carbon dioxide adsorption across different conditions. Our results show considerable improvement in both accuracy and transferability across targets compared to models constructed from the commonly-used, manually-curated features, consistently achieving an average 25–30% decrease in root-mean-squared-deviation and an average increase of 40–50% in R 2 scores. A key advantage of our approach is interpretability: Our model identifies the pores that correlate best to adsorption at different pressures, which contributes to understanding atomic-level structure–property relationships for materials design.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Using Tau Leptons as a Tool for Studying the Higgs in the SM and Beyond

In the Standard Model, the mass generation of fermions is achieved through the Higgs Yukawa coupling. There exists several more fundamental theories, such as super- symmetry, that could imply deviations of the couplings of the observed Higgs boson to down-type fermions, such as the τ lepton. Therefore, it is necessary to demonstrate the direct coupling of the Higgs boson to the fundamental fermions and to demonstrate the proportionality of the Higgs boson coupling strength to their mass. Furthermore, any deviations from Standard Model expectation could hint at beyond the Standard Model physics. We summarize a measurement of Higgs to Tau leptons at CMS using a simplified template cross section scheme as well as a differential measurement as a function of Higgs transverse momentum, leading jet transverse momentum and the number of jets present in the event. We also summarize recent calorimeter trigger related activities which will help to improve Higgs to fermion measurements in the future runs at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Joint Estimation of Behind-the-Meter Solar Generation in a Community

Distribution grid planning, control, and optimization require accurate estimation of solar photovoltaic (PV) generation and electric load in the system. Most of the small residential solar PV systems are installed behind-the-meter making only the net load readings available to the utilities. This paper presents an unsupervised framework for joint disaggregation of the net load readings of a group of customers into the solar PV generation and electric load. Our algorithm synergistically combines a physical PV system performance model for individual solar PV generation estimation with a statistical model for joint load estimation. The electric loads for a group of customers are estimated jointly by a mixed hidden Markov model (MHMM) which enables modeling the general load consumption behavior present in all customers while acknowledging the individual differences. At the same time, the model can capture the change in load patterns over a time period by the hidden Markov states. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is evaluated using the net load, electric load, and solar PV generation data gathered from residential customers located in Austin, Texas. Testing results show that our proposed method reduces the mean squared error of state-of-the-art net-load disaggregation algorithms by 67%.

behind-the-meter solar generation↗

DOE OSTI2024

CGOLS V: Disk-wide Stellar Feedback and Observational Implications of the Cholla Galactic Wind Model

Abstract We present the fifth simulation in the Cholla Galactic OutfLow Simulation (CGOLS) project—a set of isolated starburst galaxy simulations modeled over large scales (10 kpc) at uniformly high resolution (Δx≈ 5 pc). Supernova feedback in this simulation is implemented as a disk-wide distribution of clusters, and we assess the impact of this geometry on several features of the resulting outflow, including the radial profiles of various phases; mass, momentum, and energy outflow rates; covering fraction of cool gas; mock absorption-line spectra; and X-ray surface brightness. In general, we find that the outflow generated by this model is cooler, slower, and contains more mass in the cool phase than a more centrally concentrated outflow driven by a similar number of supernovae. In addition, the energy loading factors in the hot phase are an order of magnitude lower, indicating much larger losses due to radiative cooling in the outflow. However, coupling between the hot and cool phases is more efficient than in the nuclear burst case, with almost 50% of the total outflowing energy flux carried by the cool phase at a radial distance of 5 kpc. These physical differences have corresponding signatures in observable quantities: the covering fraction of cool gas is much larger, and there is greater evidence of absorption in low and intermediate ionization energy lines. Taken together, our simulations indicate that centrally concentrated starbursts are more effective at driving hot, low-density outflows that will expand far into the halo, while galaxy-wide bursts may be more effective at removing cool gas from the disk.

Astronomy & Astrophysics↗

DOE OSTI2023

Model Data for the Mesh Convergence Study Demonstrating Benefits of Mixed-polyhedral Mesh in Integrated Hydrology Simulations

This archived model data is related to a study introducing a unique method that employs a stream-aligned mixed-polyhedral mesh to effectively and accurately represent river valleys, stream corridors, and narrow engineered channels in integrated hydrology simulations. The study finds that utilizing stream-aligned mixed-polyhedral meshes in integrated hydrology simulations achieves accuracy on par with a finely refined TIN-based mesh while markedly diminishing computational costs. This archive contains scripts and data files needed to generate the ATS model input, including mesh and ATS input files, for all mesh scenarios using the Watershed Workflow package. Additionally, this archive also provides key outputs from the model simulations that are used in the analysis and post-processing scripts to reproduce figures in the manuscript. The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include CSV and HDF5 files, which can be read through Python scripts. The input files for the ATS model, open-source integrated hydrology, and transport model are in XML format and can be edited in any commonly used text editors.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Resource and Load Compatibility Assessment of Wind Energy Offshore of Humboldt County, California

Floating offshore wind is being considered in northern California as indicated by the Bureau of Ocean Energy Management’s issuance of a lease consideration in the Humboldt Call Area. Humboldt County offers access to this enormous resource, but local electric load and transmission are limited. The potential impacts of offshore wind generators at three different scales were studied using a regional grid model of Humboldt County. Offshore wind generation was calculated using modeled wind speed data and 12-MW turbine specifications and integrated with projected load and historical generation. Offshore wind farms deployed in the Humboldt Call Area achieve annual capacity factors between 45% and 54% after losses and maintenance. Power output is variable between and within seasons, with full power output 30% of the time and no output approximately 20% of the time. Electricity from a 48-MW wind farm provides 22% of regional load with limited exports. A 144-MW wind farm serves 38% of local load, exporting 40% of its electricity with the extant 70-MW transmission capacity. A full build-out of 1836 MW would result in 88% curtailment with existing transmission. Across scenarios, offshore wind variability necessitates reliance on existing power plants to meet local demand in periods of low wind.

17 WIND ENERGY↗

DOE OSTI2025

Flexible User-Defined Domain Decomposition in Kilometer-Scale E3SM Land Model Simulation

The Energy Exascale Earth System Model (E3SM) Land Model (ELM) has been extended to kilometer-scale (km-ELM) resolutions, enabling high-fidelity simulations of terrestrial processes at 1 km x 1 km grid spacing. In ELM, domain decomposition partitions the computational domain across processors, ensuring efficient parallel execution. Currently, round-robin decomposition is applied, providing a straightforward way to distribute computational workload. As ELM continues evolving at the kilometer-scale (km-scale), particularly with integrating lateral flow modeling, decomposition strategies must also account for the increased workload and data movement. This paper introduces a flexible user-defined domain decomposition framework, allowing users to customize domain partitioning based on application requirements. The impact of different decomposition strategies is evaluated across various applications concerning computation, communication, and I/O. Results demonstrate that while 1D partitioning yields superior I/O performance, k-nearest neighbors (KNN) clustering effectively reduces inter-process communication overhead. This study lays the groundwork for scalable partitioning in large-scale land surface simulations, enhancing next-generation Earth system modeling.

Wang, Dali [ORNL] (ORCID:0000000168065108)↗

DOE OSTI2022

Dynamic calibration of differential equations using machine learning, with application to turbulence models

We present a methodology for calibration of parametric ordinary and partial differential equation models, using off-the-shelf software for back-propagation in Neural Networks (NN). As a prototypical example, we consider calibration of a Reynolds-averaged Navier-Stokes (RANS) turbulence closure model, against ground truth data from direct numerical simulations (DNS) of two different turbulent flows. Numerical time integration is represented as a custom NN, where only the RANS model parameters are trainable. A loss function is defined to quantify the mismatch between the NN prediction and the ground truth over a predefined, finite time integration window. This loss function is then minimized using a gradient descent method utilizing the back-propagation algorithm. Furthermore, this dynamic approach to training is to be contrasted with a static approach, wherein a least square regression estimate for parameters is obtained in the limit of an infinitesimal time integration window. In a first test of static and dynamic approaches against ground truth data generated by the model, the former proves to be significantly faster and more accurate than the latter at recovering the parameters. When both calibration approaches are tested against DNS data, for which it is known that the model cannot achieve a perfect fit, the static approach yields a good prediction only for short times, while the dynamic approach results in physical and stable predictions over the entire integration window. After optimization of the dynamic approach for time step, spatial resolution, stability, and physics-based constraints, we obtain a 50% improvement of outcomes over those obtained from the existing, manually calibrated set of parameters, demonstrating the merits of this systematic and automated procedure.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Troubleshooting deep-learner training data problems using an evolutionary algorithm on Summit

Architectural and hyper-parameter design choices can influence deep-learner (DL) model fidelity but can also be affected by malformed training and validation data. However, practitioners may spend significant time refining layers and hyper-parameters before discovering that distorted training data was impeding training progress. We found that an evolutionary algorithm (EA) can be used to diagnose this kind of DL problem. An EA evaluated thousands of DL configurations on Summit that yielded no overall improvement in DL performance, which suggested problems with the training and validation data. We suspected that Contrast Limited Adaptive Histogram Equalization (CLAHE) enhancement that was applied to previously generated digital surface models (DSMs), for which we were training DLs to find errors, had damaged the training data. Subsequent runs with an alternative global normalization yielded significantly improved DL performance. However, the DL Intersection Over Union (IOU) still exhibited consistent sub-par performance, which suggested further problems with the training data and DL approach. Nonetheless, we were able to diagnose this problem within a 12-hour span via Summit runs, which prevented several weeks of unproductive trial-and-error DL configuration refinement, and allowed for a more timely convergence on an ultimately viable solution.

97 MATHEMATICS AND COMPUTING↗