Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Discrete fracture network model benchmarks developed and applied in a DECOVALEX-2023 repository performance assessment study

This study presents newly developed benchmarks for modeling flow and transport within discrete fracture networks (DFNs) and useful methods for analyzing the results. The new benchmarks are designed to test modeling approaches for use in probabilistic performance assessment models of deep geologic repositories in fractured rock. The benchmarks simulate flow and transport through a 1 km 3 block of fractured rock. The first simulates migration of a short pulse of tracer through a simple network of four intersecting fractures. The second adds 1089 stochastically generated fractures. The third changes the pulse to a continuous point source. Evaluation of model performance relies on moment analysis and comparison of the results of different models. The expected nondimensional first moment of the conservative tracer for each benchmark is 1. The benchmarks were simulated by teams from Canada, Czechia, Germany, Korea, Sweden, Taiwan, and the United States as part of a DECOVALEX-2023 study (decovalex.org). The teams used various approaches, including explicit DFN modeling, DFN upscaling to an equivalent continuous porous medium (ECPM), and a combination of both methods. Transport mechanisms are modeled using either the advection-dispersion equation or particle tracking. Results demonstrate strong agreement among the models in breakthrough behavior up to the 75th percentile. Significant deviations in first moments and well-clustered outputs led to the identification of inaccuracies in several models. Such findings exemplify the benefit of exercising these benchmarks and using the presented methods to test DFN flow and transport models.

Benchmark↗
NASA NTRSDate not supplied

Probing ExoMiner for Effectiveness against False Alarms in Kepler Data

We present a study on the effectiveness of ExoMiner against False Alarms in Kepler data. ExoMiner is a deep learning model that was used to validate around 370 Kepler Objects of Interest. We follow the analysis conducted in Coughlin et al (2017) “DR25 Robovetter Completeness and Effectiveness” for Robovetter, a rule-based model used to vet TCEs for this data release and automatically generate the Q1-Q17 DR 25 KOI Table. The ExoMiner model is trained on observed transit data from Kepler Q1-Q17 DR25 and evaluated on Kepler inverted and scrambled data. The results provide a more comprehensive insight into the capacities and limitations of ExoMiner, especially the vetting of not-transit-like signals and, more generally, the use of deep learning models to model transit photometry data for vetting and validation purposes.

exoplanet↗
NASA NTRS2012

Irreducible Tests for Space Mission Sequencing Software

As missions extend further into space, the modeling and simulation of their every action and instruction becomes critical. The greater the distance between Earth and the spacecraft, the smaller the window for communication becomes. Therefore, through modeling and simulating the planned operations, the most efficient sequence of commands can be sent to the spacecraft. The Space Mission Sequencing Software is being developed as the next generation of sequencing software to ensure the most efficient communication to interplanetary and deep space mission spacecraft. Aside from efficiency, the software also checks to make sure that communication during a specified time is even possible, meaning that there is not a planet or moon preventing reception of a signal from Earth or that two opposing commands are being given simultaneously. In this way, the software not only models the proposed instructions to the spacecraft, but also validates the commands as well.To ensure that all spacecraft communications are sequenced properly, a timeline is used to structure the data. The created timelines are immutable and once data is as-signed to a timeline, it shall never be deleted nor renamed. This is to prevent the need for storing and filing the timelines for use by other programs. Several types of timelines can be created to accommodate different types of communications (activities, measurements, commands, states, events). Each of these timeline types requires specific parameters and all have options for additional parameters if needed. With so many combinations of parameters available, the robustness and stability of the software is a necessity. Therefore a baseline must be established to ensure the full functionality of the software and it is here where the irreducible tests come into use.

sequencing test↗
DOE OSTI2025

The glass-ceiling convective regime and the origin and diversity of coronae on Venus

Venus and Earth are rocky planets of roughly the same size and bulk density, yet their surface volcanic and tectonic features appear substantially different. On Venus, the coexistence of large volcanic highlands—interpreted as the surface expression of long-lived mantle plumes—alongside coronae, smaller features thought to be caused by transient thermal diapirs, remains enigmatic. Using two-dimensional numerical models of mantle convection with sharp and broad mineral phase transitions for pyrolite, we show that both scales of upwellings can be generated in a stagnant lid planet with an interior temperature 250 to 400 K warmer than Earth’s. The smaller plumes originate from a ~600 km deep internal layer that exists as a consequence of the different sequence of mineral phase transitions that occur in warmer mantles less processed and differentiated by partial melting and volcanism. Future models that include melting will provide further tests of our hypothesis.

Science & Technology - Other Topics↗
DOE OSTI2021

Severity factor kinetic model as a strategic parameter of hydrothermal processing (steam explosion and liquid hot water) for biomass fractionation under biorefinery concept

Hydrothermal processes are an attractive clean technology and cost-effective engineering platform for bio-refineries based in the conversion of biomass to biofuels and high-value bioproducts under the basis of sustainability and circular bioeconomy. The deep and detailed knowledge of the structural changes by the severity of biomasses hydrothermal fractionation is scientifically and technological needed in order to improve processes effectiveness, reactors designs, and industrial application of the multi-scale target compounds obtained by stream explosion and liquid hot water systems. The concept of the severity factor [log 10 (R 0 )] established > 30 years ago, continue to be a useful index that can provide a simple description of the relationship between the operational conditions for biomass fractionation in second generation of biorefineries. Furthermore, this review develops a deep explanation of the hydrothermal severity factor based in lignocellulosic biomass fractionation with emphasis in research advances, pretreatment operations and the applications of severity factor kinetic model.

09 BIOMASS FUELS↗
DOE OSTI2024

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Austenitic 347H stainless steel offers superior mechanical properties and corrosion resistance required for extreme operating conditions such as high temperature. The change in microstructure due to composition and process variations is expected to impact material properties. Identifying microstructural features such as grain boundaries thus becomes an important task in the process-microstructure-properties loop. Applying convolutional neural network (CNN)-based deep learning models is a powerful technique to detect features from material micrographs in an automated manner. In contrast to microstructural classification, supervised CNN models for segmentation tasks require pixel-wise annotation labels. However, manual labeling of the images for the segmentation task poses a major bottleneck for generating training data and labels in a reliable and reproducible way within a reasonable timeframe. Microstructural characterization especially needs to be expedited for faster material discovery by changing alloy compositions. Here, in this study, we attempt to overcome such limitations by utilizing multimodal microscopy to generate labels directly instead of manual labeling. We combine scanning electron microscopy images of 347H stainless steel as training data and electron backscatter diffraction micrographs as pixel-wise labels for grain boundary detection as a semantic segmentation task. The viability of our method is evaluated by considering a set of deep CNN architectures. We demonstrate that despite producing instrumentation drift during data collection between two modes of microscopy, this method performs comparably to similar segmentation tasks that used manual labeling. Additionally, we find that naïve pixel-wise segmentation results in small gaps and missing boundaries in the predicted grain boundary map. By incorporating topological information during model training, the connectivity of the grain boundary network and segmentation performance is improved. Finally, our approach is validated by accurate computation on downstream tasks of predicting the underlying grain morphology distributions which are the ultimate quantities of interest for microstructural characterization.

36 MATERIALS SCIENCE↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
NASA NTRS1998

A Quantitative Investigation of Entrainment and Detrainment in Numerically Simulated Convective Clouds: Simulations of Cumulonimbus Clouds - Pt. 2

Deep cumulonimbus clouds are simulated using a model that makes accurate diagnoses of entrainment and detrainment rates and of the properties of entrained and detrained air. Clouds generated by a variety of initial thermodynamic soundings are compared. In the simulations, updraft entrainment rates are large near and above cloud base, through the entire depth of the conditionally unstable layer. Stronger updrafts in a more unstable environment are better able to entrain relatively undisturbed environmental air, while weaker updrafts can entrain only air that has been modified by the clouds. When the maximum buoyancy is large, the updraft includes parcels with a wide range of buoyancies, while weaker clouds are more horizontally uniform. Strong downdrafts originate from levels at which updrafts detrain, and their mass flux depends on the mass flux of the updraft. The magnitude of mixing between cloud and environment, not the entrainment rate, varies inversely with the cloud radius. How much of the mixed air is entrained depends on the buoyancy.

Cohen, Charles↗
DOE OSTI2024

Understanding the High Energy Higgs Sector with the CMS Experiment and Artificial Intelligence

This dissertation describes efforts towards understanding the Higgs boson at the highest energies humanly accessible, using the CMS experiment at the Large Hadron Collider and advances in artificial intelligence (AI) and machine learning (ML). We present searches for resonant and nonresonant Higgs-boson (H) pair production in the all-hadronic two beauty-quark and two vector boson (V) final state, using a novel strategy to measure the quartic HHVV coupling and search for new Higgs-like bosons. By targeting highly Lorentz-boosted Higgs pairs, we probe effects of potential new physics in the high energy Higgs sector, which could hold answers to fundamental mysteries of nature such as baryon asymmetry. To enable these and future searches, we introduce as well significant developments in AI/ML, including in the identification of boosted H$\rightarrow$VV decays with deep transformer networks and advances in AI-accelerated fast simulations of the CMS detector. The latter notably includes the development of the first, highly performant generative models for point-cloud data in high energy physics, which have the potential to improve CMS' computational efficiency by up to three orders of magnitude. We also highlight novel solutions to the important and challenging problems of calibrating and validating these ML techniques. Finally, we present new approaches to search for new physics in a model-agnostic manner, using physics-informed ML methods equivariant to Lorentz transformations. The quartic HHVV coupling is observed (expected) to be constrained to $[-0.04, 2.05]$ ($[0.05, 1.98]$) at the 95% confidence level relative to the standard model prediction, representing the second-most sensitive measurement of this coupling by CMS to date. Exclusion limits on the production cross section of new heavy resonances decaying to two Higgs-like bosons are expected to be as low as 0.3 fb for high resonance masses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

On CCN Effects upon Convective Cold Pool Timing and Features

Abstract Cold pools produced by deep convection can initiate new convection, and their representation in larger-scale weather and climate models could improve prediction of the extent and timing of upscale growth. Cold pools originate from latent cooling from precipitation changing phase, but little attention has been paid to microphysical influences on cold pool characteristics, particularly CCN effects. Datasets obtained from the CACTI and RELAMPAGO field campaigns, along with idealized numerical modeling, are utilized to investigate the hypothesis that convective storms forming in higher-CCN environments generate their first surface rainfall later, delaying cold pool initiation. Aircraft observations of CCN and shallow convection on 9 days do suggest a CCN effect. Those ingesting more CCN contained fewer drizzle drops, although a decreased cloud depth with increasing CCN was also likely a limiting factor. In three of those cases that later developed into deep convection, the timing of cold pool onset was not ubiquitously delayed in environments with more CCN. Idealized numerical simulations suggest that an ordinary thunderstorm can experience small delays in cold pool onset with increasing CCN due to changes in graupel production, but CCN effects on the cold pool from a supercell thunderstorm can be easily overpowered by its unique dynamics. A strong inverse relationship between cold pool strength, expansion rate, and depth with increasing CCN is suggested by the results of the ordinary thunderstorm simulation. Further consideration of CCN appears warranted for future cold pool parameterization development, but other environmental factors affecting storm morphology and precipitation cannot be ignored.

Meteorology & Atmospheric Sciences↗
DOE OSTI2025

Global tuning of hadronic interaction models with accelerator-based and astroparticle data

In high-energy and astroparticle physics, event generators play an essential role, even in the simplest data analyses. As analysis techniques become more sophisticated, e.g. based on deep neural networks, their correct description of the observed event characteristics becomes even more important. Physical processes occurring in hadronic collisions are simulated within a Monte Carlo framework. A major challenge is the modeling of hadron dynamics at low momentum transfer, which includes the initial and final phases of every hadronic collision. QCD-inspired phenomenological models used for these phases cannot guarantee completeness or correctness over the full phase space. These models usually include parameters which must be tuned to suitable experimental data. Until now, event generators have been developed and tuned mainly on the basis of data from high-energy physics experiments at accelerators. The wealth of data available from the latest generation of astroparticle experiments has not yet been fully exploited, and in many cases is not satisfactorily described. Both kinds of data sets are complementary as astroparticle experiments provide sensitivity especially to hadrons produced nearly parallel to the collision axis and cover center-of-mass energies up to several hundred TeV, well beyond those reached at colliders so far. In this report, we provide an overview of state-of-the-art event generators and their tuning, including the most relevant inputs from high-energy accelerator and astroparticle experiments. We present a road map that shows, for the first time, how the unified tuning of event generators with accelerator-based and astroparticle data can be performed.

Albrecht, J. [Ruhr U., Bochum, RAPP Ctr.; Ruhr U.,↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Transfer Learning using Denoising Auto-Encoders for Cellular-Level Annotation of Tumor in Pathology Slides

Adversarial examples can produce altered classifications using only seemingly innocuous, imperceptible perturbations to the original image. The imperceptibility of adversarial perturbations suggests that the corresponding classifiers use decision criteria different than those of a human. In a medical setting, inexplicable decision criteria confound a pathologist’s willingness to trust machine-generated annotations. Here, we analyze denoising tumor detection models to see if they are robust to imperceptible adversarial perturbations. Moreover, to be more fully trusted by pathologists, we require tumor detectors that generate interpretable annotations which segment pathology slides into tumorous and normal regions at the cellular level. We therefore compare transfer learning based on two different autoencoder architectures, one derived from a deep denoising bottleneck autoencoder and one from an over-complete sparse autoencoder. Both autoencoders were first trained in an unsupervised manner on a set of pathology slides drawn from the Camelyon16 dataset. The latent representations produced by each autoencoder were then passed to separate neural networks that were trained in a supervised manner on binary tumor-normal masks generated by pathologists at cellular resolution. Both tumor detectors supported better than 90% AUC PR as measured by the area under the precision/recall curve on a held-out pathology slide. To assess the underlying decision criteria used by both tumor detectors, we constructed imperceptible adversarial examples which reduced the AUC PR of both models to less than 70%. Random noise of the same amplitude had almost no effect on the AUC PR of either model. Additionally, each tumor detector was resistant to adversarial “transfer” attacks targeting the other. The adversarial perturbations showed strong characteristic differences: the deep denoising models perturbations were a very diffuse, seemingly unrecognizable pattern while the sparse coding models perturbations showed traces of tissue cells.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

A finite-volume scheme for modeling compressible magnetohydrodynamic flows at low Mach numbers in stellar interiors

Fully compressible magnetohydrodynamic (MHD) simulations are a fundamental tool for investigating the role of dynamo amplification in the generation of magnetic fields in deep convective layers of stars. The flows that arise in such environments are characterized by low (sonic) Mach numbers ($\mathscr{M}$ son ≲ 10 –2 ). In these regimes, conventional MHD codes typically show excessive dissipation and tend to be inefficient as the Courant–Friedrichs–Lewy (CFL) constraint on the time step becomes too strict. In this work we present a new method for efficiently simulating MHD flows at low Mach numbers in a space-dependent gravitational potential while still retaining all effects of compressibility. The proposed scheme is implemented in the finite-volume SEVEN-LEAGUE HYDRO (SLH) code, and it makes use of a low-Mach version of the five-wave Harten–Lax–van Leer discontinuities (HLLD) solver to reduce numerical dissipation, an implicit–explicit time discretization technique based on Strang splitting to overcome the overly strict CFL constraint, and a well-balancing method that dramatically reduces the magnitude of spatial discretization errors in strongly stratified setups. The solenoidal constraint on the magnetic field is enforced by using a constrained transport method on a staggered grid. We carry out five verification tests, including the simulation of a small-scale dynamo in a star-like environment at $\mathscr{M}$ son ~ 10 –3 . We demonstrate that the proposed scheme can be used to accurately simulate compressible MHD flows in regimes of low Mach numbers and strongly stratified setups even with moderately coarse grids.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1981

Observations and models of inertial waves in the deep ocean

A study of the structure of the inertial peak in deep ocean kinetic energy is presented, based on records taken from Polymode arrays deployed in the western North Atlantic Ocean. Results are interpreted in terms of both local sources and turning point effects on internal waves generated at lower latitudes, and it is found that three classes of environment and their corresponding spectra emerge from peak height variations: (1) the 1500-m level near the Mid-Atlantic Ridge, with the greatest peak height of 18 dB; (2) the upper and deep ocean over rough topography and the deep ocean underneath the Gulf Stream, with the intermediate peak height of 11.5 dB; and (3) the deep ocean over smooth topography, with the lowest peak height of 7.5 dB. Using the globally valid wave functions obtained by Munk and Phillips (1968), frequency spectra near f are calculated numerically. The model is latitudinally dependent, with the frequency shift and bandwidth of the inertial peak decreasing with latitude.

Fu, L.-L.↗
DOE OSTI2021

An experimental program with high duty-cycle polarized and unpolarized positron beams at Jefferson Lab

Positron beams, both polarized and unpolarized, are identified as important ingredients for the experimental programs at the next generation of lepton accelerators. In the context of the hadronic physics program at Jefferson Lab (JLab), positron beams are complementary, even essential, tools for a precise understanding of the electromagnetic structure of nucleons and nuclei, in both the elastic and deep-inelastic regimes. For instance, elastic scattering of polarized and unpolarized electrons and positrons from the nucleon enables a model independent determination of its electromagnetic form factors. Also, the deeply-virtual scattering of polarized and unpolarized electrons and positrons allows unambiguous separation of the different contributions to the cross section of the lepto-production of photons and of lepton-pairs, enabling an accurate determination of the nucleons and nuclei generalized parton distributions, and providing an access to the gravitational form factors of the energy-momentum tensor. Furthermore, positron beams offer the possibility of alternative tests of the Standard Model of particle physics through the search of a dark photon, the precise measurement of electroweak couplings, and the investigation of charged lepton flavor violation. This document discusses the perspectives of an experimental program with high duty-cycle positron beams at JLab.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Quantitative modeling of carcinogenesis induced by single beams or mixtures of space radiations using targeted and non-targeted effects

Abstract Ionizing radiations encountered by astronauts on deep space missions produce biological damage by two main mechanisms: (1) Targeted effects (TE) due to direct traversals of cells by ionizing tracks. (2) Non-targeted effects (NTE) caused by release of signals from directly hit cells. The combination of these mechanisms generates non-linear dose response shapes, which need to be modeled quantitatively to predict health risks from space exploration. Here we used a TE + NTE model to analyze data on APC (1638N/+) mouse tumorigenesis induced by space-relevant doses of protons, 4 He, 12 C, 16 O, 28 Si or 56 Fe ions, or γ rays. A customized weighted Negative Binomial distribution was used to describe the radiation type- and dose-dependent data variability. This approach allowed detailed quantification of dose–response shapes, NTE- and TE-related model parameters, and radiation quality metrics (relative biological effectiveness, RBE, and radiation effects ratio, RER, relative to γ rays) for each radiation type. Based on the modeled responses for each radiation type, we predicted the tumor yield for a Mars-mission-relevant mixture of these radiations, using the recently-developed incremental effect additivity (IEA) synergy theory. The proposed modeling approach can enhance current knowledge about quantification of space radiation quality effects, dose response shapes, and ultimately the health risks for astronauts.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Neural-based time series forecasting of loss of coolant accidents in nuclear power plants

During the last few years, deep learning in neural networks has demonstrated impressive successes in the areas of computer vision, speech and image recognition, text generation, and many others. However, sensitive engineering areas such as nuclear engineering benefited less from these efficient techniques. In this work, deep learning expert systems are utilized to model and predict time series progression of a design-basis nuclear accident, featuring a loss of coolant accident. Two major findings are accomplished in this work. First, the ability to train expert systems with high accuracy, which could help nuclear power plant operators to figure out plant responses during the accident. Second, building fast, efficient, and accurate deep models to simulate nuclear phenomena, which could be valuable to nuclear computational science. In this work, large amount of time series data is obtained from simulation tools by simulating different conditions of the base-case/nominal accident scenario. Four critical outputs/responses are monitored during the accident (e.g. temperature, pressure, break flow rate, water level). Two approaches are adopted in this work. The first approach is to use feedforward deep neural networks (DNN) to fit all time steps and outputs in a single model. The second approach is to use long short-term memory (LSTM) to fit all time steps together for each reactor response separately. Both DNN and LSTM demonstrate very good performance in predicting the test and base-case scenarios, with accuracy as low as 92% and as high as 99%, where these test scenarios are unknown to the expert systems and are not included in the model training. In addition, both approaches demonstrate a significant reduction in computational costs, as the deep expert system is able to accurately predict the accident 100,000 times faster than the original simulation tool. Given sufficient data, the methodology adopted in this study demonstrates that DNN/LSTM expert systems can be used as a decision support system to model advanced time series phenomena within nuclear power plants with high accuracy and negligible computational costs.

42 ENGINEERING↗