Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Baseline for Global Weather and Climate Simulations at 1 km Resolution

In an attempt to advance the understanding of the Earth's weather and climate by representing deep convection explicitly, we present a global, four-month simulation (November 2018 to February 2019) with ECMWF's hydrostatic Integrated Forecasting System (IFS) at an average grid spacing of 1.4 km. The impact of explicitly simulating deep convection on the atmospheric circulation and its variability is assessed by comparing the 1.4 km simulation to the equivalent well-tested and calibrated global simulations at 9 km grid spacing with and without parametrized deep convection. The explicit simulation of deep convection at 1.4 km results in a realistic large-scale circulation, better representation of convective storm activity, and stronger convective gravity wave activity when compared to the 9 km simulation with parametrized deep convection. Comparison of the 1.4 km simulation to the 9 km simulation without parametrized deep convection shows that switching off deep convection parametrization at a too coarse resolution (i.e., 9 km) generates too strong convective gravity waves. Based on the limited statistics available, improvements to the Madden-Julian Oscillation or tropical precipitation are not observed at 1.4 km, suggesting that other Earth system model components and/or their interaction are important for an accurate representation of these processes and may well need adjusting at deep convection resolving resolutions. Overall, the good agreement of the 1.4 km simulation with the 9 km simulation with parametrized deep convection is remarkable, despite one of the most fundamental parametrizations being turned off at 1.4 km resolution and despite no adjustments being made to the remaining parametrizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

INN Airfoil Tools

This software package contains code to perform airfoil inverse shape design using a sparsified invertible neural network model. This is a specialized deep learning architecture that enables both network weights to be shared to evaluate forward or inverse passes through the network. As a design tool, this network allows practitioners to specify desired aerodynamic and structural properties and generate shapes that satisfy those properties. The invertible neural network is accompanied with tuned parameters as well as software tools to train new models as needed.

Glaws, Andrew↗
DOE OSTI2023

NeRVI: Compressive neural representation of visualization images for communicating volume visualization results

We present NeRVI, a new deep-learning approach that compresses a large collection of visualization images generated from time-varying data for communicating volume visualization results. Based on an image-based implicit neural representation, our approach represents tens of thousands of high-resolution rendering images parametrized by different parameters via a hybrid model of multilayer perceptrons and convolutional neural networks. Here, our model predicts images and corresponding masks, and the masks are utilized for loss computation and network training to capture fine structural details and small components. In conjunction with model quantization and weight encoding, NeRVI yields highly compact compressive neural representations while preserving the image fidelity well. We demonstrate the effectiveness of NeRVI with isosurface rendering and direct volume rendering images generated from multiple data sets and compare NeRVI with other state-of-the-art deep learning-based (InSituNet, SIREN, NeRF, and NeRV) methods. Quantitative and qualitative results show that NeRVI provides an alternative solution that augments domain scientists' ability to manage, represent, and communicate scientific visualization output.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Large Ensemble Exploration of Global Energy Transitions Under National Emissions Pledges

Global climate goals require a transition to a deeply decarbonized energy system. Meeting the objectives of the Paris Agreement through countries' nationally determined contributions and long-term strategies represents a complex problem with consequences across multiple systems shrouded by deep uncertainty. Robust, large-ensemble methods and analyses mapping a wide range of possible future states of the world are needed to help policymakers design effective strategies to meet emissions reduction goals. This study contributes a scenario discovery analysis applied to a large ensemble of 5,760 model realizations generated using the Global Change Analysis Model. Eleven energy-related uncertainties are systematically varied, representing national mitigation pledges, institutional factors, and techno-economic parameters, among others. The resulting ensemble maps how uncertainties impact common energy system metrics used to characterize national and global pathways toward deep decarbonization. Results show globally consistent but regionally variable energy transitions as measured by multiple metrics, including electricity costs and stranded assets. Larger economies and developing regions experience more severe economic outcomes across a broad sampling of uncertainty. The scale of CO 2 removal globally determines how much the energy system can continue to emit, but the relative role of different CO 2 removal options in meeting decarbonization goals varies across regions. Previous studies characterizing uncertainty have typically focused on a few scenarios, and other large-ensemble work has not (to our knowledge) combined this framework with national emissions pledges or institutional factors. Our results underscore the value of large-ensemble scenario discovery for decision support as countries begin to design strategies to meet their goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Chromium-doped uranium dioxide fuels: A review

UO 2 doped with parts per million CR 2 O 3 powder is considered a potential near term accident tolerant fuel candidate. Here, the results of decades of industry and academic research into Cr-doped UO 2 are analyzed and their shortcomings are critiqued. Focusing on the incorporation mechanisms of Cr into the fuel matrix, we explore a mechanistic understanding of the characteristic properties of Cr-doped UO 2 , notably, enhanced fission gas retention attributed to enlarged grain sizes following sintering, along with marginal improvements in the thermophysical properties. The findings of recent X-ray Adsorption Near Edge Spectroscopy studies were compared and put into conversation with historic data regarding the incorporation of Cr in UO 2 . On the basis of defect mechanisms, the case is made for the substitutional incorporation of Cr governing the lattice solubility but not the enhanced U diffusivity. Instead, Cr/CR 2 O 3 redox chemistry in a well-defined oxygen potential explains the differences in the U diffusivity and O/M ratio. The primary mechanism of doping enhanced grain growth is found to be liquid assisted sintering due to a CRO (1) eutectic phase at the grain boundaries. The role of inhomogeneities in Cr concentration in UO 2 at various length scales across the materials microstructure is highlighted and connected to promising experimental and modeling work to fill in the gaps in the current understanding of Cr-doped UO 2 . The review considers both the open scientific questions and engineering applications to illustrate the deep connections between the practice and theory in the design of accident tolerant nuclear fuels. In conclusion, the review ends with an outline of future works that combine meticulous irradiation studies and high resolution experiments with next generation modeling and simulations techniques empowered by machine learning advances to accelerate the fabrication and adoption of Cr-doped UO 2 light water reactors.

Cleveland, Mack Wesley [Massachusetts Inst. of Tec↗
DOE OSTI2021

Learning-based framework for sensor fault-tolerant building HVAC control with model-assisted learning

As people spend up to 87% of their time indoors, intelligent Heating, Ventilation, and Air Conditioning (HVAC) systems in buildings are essential for maintaining occupant comfort and reducing energy consumption. These HVAC systems in smart buildings rely 'on real-time sensor readings, which in practice often suffer from various faults and could also be vulnerable to malicious attacks. Such faulty sensor inputs may lead to the violation of indoor environment requirements (e.g., temperature, humidity, etc.) and the increase of energy consumption. While many model-based approaches have been proposed in the literature for building HVAC control, it is costly to develop accurate physical models for ensuring their performance and even more challenging to address the impact of sensor faults. In this work, we present a novel learning-based framework for sensor fault-tolerant HVAC control, which includes three deep learning based components for 1) generating temperature proposals with the consideration of possible sensor faults, 2) selecting one of the proposals based on the assessment of their accuracy, and 3) applying reinforcement learning with the selected temperature proposal. Moreover, to address the challenge of training data insufficiency in building-related tasks, we propose a model-assisted learning method leveraging an abstract model of building physical dynamics. Through extensive experiments, we demonstrate that the proposed fault-tolerant HVAC control framework can significantly reduce building temperature violations under a variety of sensor fault patterns while maintaining energy efficiency.

Xu, Shichao↗
DOE OSTI2026

Localized Interactions in Neutrino Simulations

The Deep Underground Neutrino Experiment (DUNE) requires precise modeling of neutrino--nucleus interactions to achieve its neutrino-oscillation measurement goals. GENIE, the Monte Carlo event generator used by DUNE, exhibits a known discrepancy with MicroBooNE measurements of transverse kinematic imbalance (TKI): the data display a larger high-TKI tail while maintaining a peak similar to that predicted by the baseline GENIE model. Previous variations of final-state interaction (FSI) strength affected both the peak and the tail and therefore did not resolve the discrepancy. This work investigates whether inconsistencies between local and global treatments of intranuclear physics contribute to the observed mismodeling. The GENIE FSI routines were modified to use the particle position when generating nucleons, thereby introducing a local-density treatment in the hA and hN intranuclear models for their 2018 and 2025 implementations. Meson-exchange-current (MEC) localization was also tested for the hN 2018 model. Comparisons of the intranuclear scattering-center momentum and its radial dependence confirm that the localization was implemented as intended. Localization produces modest changes in the proton momentum spectrum, primarily at low momentum, but only a small change in the TKI distribution between approximately \SI{0.25}{\giga\electronvolt} and \SI{0.40}{\giga\electronvolt}. These changes are insufficient to account for the discrepancy with MicroBooNE data. Although a localized treatment improves the internal consistency of the GENIE model, the origin of the TKI discrepancy remains unresolved.

Bulla, Braden [Unlisted, US, IL]↗
DOE OSTI2022

Integrating Deep Learning and Hydrodynamic Modeling to Improve the Great Lakes Forecast

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, trained with the limited data from hypothetical monitoring networks, can provide consistent and robust performance. The LSTM prediction captured the LST spatiotemporal variabilities across the five Great Lakes well, suggesting an effective and efficient way for monitoring network design in assisting the ML-based forecast. Furthermore, we employed an explainable artificial intelligence (XAI) technique named SHapley Additive exPlanations (SHAP) to uncover how the features impact the LSTM prediction. Our XAI analysis shows air temperature is the most influential feature for predicting LST in the trained LSTM. The relatively large bias in the LSTM prediction during the spring and fall was associated with substantial heterogeneity of air temperature during the two seasons. In contrast, the physics-based hydrodynamic model performed better in spring and fall yet exhibited relatively large biases during the summer stratification period. Finally, we developed a statistical integration of the hydrodynamic modeling and deep learning results based on the Best Linear Unbiased Estimator (BLUE). The integration further enhanced prediction accuracy, suggesting its potential for next-generation Great Lakes forecast systems.

Xue, Pengfei (ORCID:000000025702421X)↗
DOE OSTI2023

Future Projections of the El Niño—Southern Oscillation and Tropical Pacific Mean State in CMIP6

Abstract The El Niño—Southern Oscillation (ENSO) is an important mode of tropical Pacific atmosphere‐ocean variability that drives teleconnections with weather and climate globally. However, prior studies using state‐of‐the‐art climate models lack consensus regarding future ENSO projections and are often impacted by tropical Pacific sea‐surface temperature (SST) biases. We used 173 simulations from 29 climate models participating in the Coupled Model Intercomparison Project, version 6 (CMIP6) to analyze model biases and future ENSO projections. We analyzed two ENSO indices, namely the ENSO Longitude Index (ELI), which measures zonal shifts in tropical Pacific deep convection and accounts for changes in background SST, and the Niño 3.4 index, which measures SST anomalies in the central‐eastern equatorial Pacific. We found that the warm eastern tropical‐subtropical Pacific SST bias typical of previous generations of climate models persists into many of the CMIP6 models. Future projections of ENSO shift toward more El Niño‐like conditions based on ELI in 48% of simulations and 55% of models, in association with a future weakening of the zonal equatorial Pacific SST gradient. On the other hand, none of the models project a significant shift toward La Niña‐like conditions. The standard deviation of the Niño 3.4 index indicates a lack of consensus on whether an increase or decrease in ENSO variability is expected in the future. Finally, we found a possible relationship between historical SST and low‐level cloud cover biases in the ENSO region and future changes in ELI; however, this result may be impacted by limitations in data availability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Explainable artificial intelligence relates perovskite luminescence images to current-voltage metrics

As the demand for low-cost, high-efficiency solar energy technologies grows, metal halide perovskite (MHP) solar cells have emerged as a promising candidate for next-generation photovoltaics due to their high power conversion efficiencies. However, their poor durability and issues with manufacturing consistency remain significant barriers to commercialization. In this work, we develop deep learning models to support materials characterization and provide insight into features and processes influencing performance. The models are trained using transfer learning of a pretrained model to predict relevant current-voltage (IV) metrics based on different combinations of input electroluminescence (EL) and photoluminescence (PL) images of MHP devices. We examine which image types are most informative in accurately predicting different IV metrics. Additionally, we use explainable artificial intelligence (XAI) techniques to provide insights into specific spatial features in the devices that drive differences in performance. We find that stabilized luminescence images (e.g. those collected after biasing the devices for at least 1 min) are better for predicting metrics of open-circuit voltage (by PL) and short-circuit current (by PL with EL), but that predicting fill factor and overall power output may use the time-evolution of EL images. Based on attribution masks generated by integrated gradients for each device performance metric, we further suggest different loss mechanisms associated with categories of large and small spatial defects. Overall, this case study highlights the potential applicability of XAI methodology for streamlining MHP device analysis and accelerating detailed understanding of the relationships between spatial defects and impacts on performance.

14 SOLAR ENERGY↗
DOE OSTI2026

Physics model enhancements in MARLEY version 2

Large next-generation neutrino detectors, such as those designed for accelerator-based oscillation experiments, are expected to have impressive sensitivity to MeV astrophysical neutrinos generated by the Sun and by supernovae. There are also numerous related prospects to search for MeV-scale phenomena beyond the Standard Model. In contrast to detectors constructed with water and hydrocarbon targets, which will be primarily sensitive to electron antineutrinos via inverse beta decay, the upcoming Deep Underground Neutrino Experiment (DUNE) will provide unparalleled capabilities to measure low-energy electron neutrinos from cosmic sources. Interpreting such future measurements in DUNE will require a high-quality simulation of MeV interaction physics in the argon nucleus. The MARLEY (Model of Argon Reaction Low Energy Yields) neutrino event generator has been designed with the goal of delivering the needed simulation capabilities for DUNE and other argon-based neutrino detectors. In this poster, I will present recent improvements to MARLEY's suite of interaction models, which will be released for general use by the neutrino community in version 2 of the software.

Gardiner, Steven James [Fermilab] (ORCID:000000028↗
DOE OSTI2026

Physics model enhancements in MARLEY version 2

Large next-generation neutrino detectors, such as those designed for accelerator-based oscillation experiments, are expected to have impressive sensitivity to MeV astrophysical neutrinos generated by the Sun and by supernovae. There are also numerous related prospects to search for MeV-scale phenomena beyond the Standard Model. In contrast to detectors constructed with water and hydrocarbon targets, which will be primarily sensitive to electron antineutrinos via inverse beta decay, the upcoming Deep Underground Neutrino Experiment (DUNE) will provide unparalleled capabilities to measure low-energy electron neutrinos from cosmic sources. Interpreting such future measurements in DUNE will require a high-quality simulation of MeV interaction physics in the argon nucleus. The MARLEY (Model of Argon Reaction Low Energy Yields) neutrino event generator has been designed with the goal of delivering the needed simulation capabilities for DUNE and other argon-based neutrino detectors. In this talk, I will present recent improvements to MARLEY's physics models, which will be released for general use by the neutrino community in version 2 of the software.

Gardiner, Steven James [Fermilab] (ORCID:000000028↗
DOE OSTI2025

Constrained GAN-Generated X-Ray CT Data For Self-Supervised And Foundation-Model Segmentation Of Concrete Microstructures

Three-dimensional characterization of materials using X-ray computed tomography (XCT) is challenging due to the complexity of internal structures, noise, and variations in resolution. Traditional computer vision models often struggle to accurately segment these images, particularly in domain-specific applications like materials science. While supervised deep learning approaches have been developed to address the limitations of conventional algorithms, they typically require large amounts of labeled training data and often fail to generalize across different datasets. Self-supervised, few-and zero-shot learning methods have gained prominence in natural image processing and segmentation tasks, but their application to scientific imaging remains limited due to the unique structural complexity, noise, and textural artifacts present in materials science data. In this work, we investigate how domain adaptation, leveraging physics-based and GAN-generated synthetic data, impacts segmentation performance. We introduce a modified Contrastive Unpaired Translation (CUT) model designed to generate realistic labeled data, which can be used for training, pre-training, and fine-tuning segmentation models for real XCT microstructure data. We evaluate the performance of two segmentation approaches: a self-supervised network (SSL-ALPNet) and a foundation model (Segment Anything Model), assessing their improvements when pre-trained and/or fine-tuned on the synthesized data. Our results demonstrate that leveraging synthetic data significantly enhances segmentation performance, particularly in challenging materials science applications.

Ziabari, Amir [ORNL] (ORCID:000000034776457X)↗
DOE OSTI2022

A Fast and Accurate Transient Stability Assessment Method Based on Deep Learning: WECC Case Study

Transient stability is one of the critical aspects of power system stability assessment. The increasing integration of inverter-based resources and the retirement of conventional synchronous generators result in the decreasing system inertia and growing complexity of system operating conditions. Using a few selected typical operating conditions cannot guarantee system transient stability in all operating conditions, and the time-domain simulation of all operating conditions requires tremendous time and is often infeasible. This paper proposes a more efficient transient stability assessment method based on deep learning. The binary search method is used to determine the critical clearing time (CCT) in creating training databased by time-domain simulation. This method is fast and accurate with 1 ms resolution. The buses whose CCTs are lower than 200 ms are considered critical buses. Buses close to each other are grouped based on their mutual admittance matrix to reduce the search space of the critical buses. This paper also proposes the generator feature normalization based on the physical model. Case study on the reduced 240-bus WECC system model demonstrates that the proposed method can predict CCT accurately and efficiently.

critical clearing time↗
DOE OSTI2026

Synthetic data-driven deep learning for label-free autonomous atomic force microscopy

Atomic force microscopy (AFM) is a widely used tool for nanoscale characterization across materials science, energy research, and biology. However, its adoption in high-throughput materials discovery and statistically driven studies remains limited by a strong dependence on expert operator input and by the scarcity of annotated experimental AFM datasets needed to enable data-driven automation. Here, we introduce SimuScan, a synthetic-data–driven framework that enables reliable AFM feature identification, segmentation, and targeted imaging without requiring large manually labeled experimental datasets. SimuScan generates tunable, high-fidelity synthetic AFM images of defined morphologies while incorporating realistic experimental artifacts, including tip–sample convolution, noise, flattening distortions, and surface debris. These datasets are shown to support scalable, label-free training of modern deep learning models for AFM analysis. When integrated into data-driven AFM workflows, SimuScan-trained models can locate and analyze nanoscale structures across large datasets and guide targeted follow-up imaging. We validate this approach on nanostructured surfaces, DNA assemblies, and bacterial cells, demonstrating robust generalization across diverse sample types with minimal operator intervention. More broadly, this work establishes a general strategy for generating explicitly conditioned, task-relevant synthetic data to improve the reliability of downstream models in autonomous microscopy.

Millan-Solsona, Ruben [Oak Ridge National Laborato↗