Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Deep Point Cloud Building Envelope Segmentation (DeeP-CuBES) using Deep Learning

Building Information Modeling (BIM) plays an important role in building design and construction, particularly for achieving energy-efficient retrofits. Building envelope retrofits using panelized prefabricated system, such as those popularized by the Energiesprong program, need accurate as-built dimensions of facade features (windows, doors, etc.) to achieve the desired thermal and air tightness. Traditionally, building surveying is done manually, resulting in a time-consuming and labor-intensive process. Recently, 3D point clouds from terrestrial LiDAR have been used to automate the generation of as-built dimensions of existing buildings. However, automated BIM using LiDAR relies on solving the point cloud semantic segmentation (PCSS) problem. In this work, we propose a robust pipeline for solving the PCSS problem using deep neural networks, focusing on overcoming challenges posed by imbalanced datasets and complex architectural features. We introduce the first high-density, labeled, and validated building envelope point cloud dataset derived from multiple building scans, specifically curated to tackle challenges in facade-level segmentation. Results from the trained neural networks show that advanced attention-based architectures and incorporating radiometry (light intensity and RGB) features significantly boost segmentation accuracy for windows and doors.

Selvakumar, Balaji [ORNL]↗
DOE OSTI2026

Integrating very-high-resolution imagery, Sentinel-2 time-series data, and machine learning to map shrub fractional abundance across arid and semi-arid ecosystems in China

Shrub fractional abundance (SFA), the proportion of shrub cover per unit area, serves as a critical indicator of environmental aridity and ecosystem health in arid and semi-arid regions, particularly across the Mongolian steppe. However, large-scale SFA mapping in Mongolian steppe ecosystems remains challenging due to the small crown size of shrubs, their sparse distribution, and spectral overlap with coexisting low vegetation (e.g., grasses and herbs), which hinders accurate detection using coarser-resolution satellite data or traditional field surveys. To address these challenges, we developed a two-step approach that integrates very-high-resolution (VHR) imagery, time-series Sentinel-2 data, and deep learning techniques. First, we generated high-accuracy benchmark maps of individual shrub crowns from 0.5 m VHR imagery by combining manual segmentation with a hybrid deep learning framework (Dino V2 and convolutional neural networks). Second, we used these shrub crown maps as training data to build an XGBoost model for predicting SFA from 20 m Sentinel-2 time-series data, leveraging phenological information to improve estimation. We validated our approach across 70 sites (1km 2 each) in the Inner Mongolia Autonomous Region, which is representative of Mongolian steppe ecosystems. From VHR imagery, we mapped 1.31 million shrub crowns with an accuracy of R 2 = 0.92. Scaling up with Sentinel-2 data yielded regional SFA maps with an R 2 = 0.60. Further SHAP (SHapley Additive exPlanations) analysis on the developed XGBoost model revealed that phenological metrics (particularly observations in early-May, mid-July, and late-September), which distinguish shrub phenology from that of other land cover types (e.g., grasses and bare soil), were the most influential predictors of SFA. Finally, our regional SFA maps uncovered unimodal relationships between shrub distribution and climate variables, peaking at mean annual minimum temperatures near 0 °C and annual precipitation around 200 mm. Collectively, these findings demonstrate how the integration of multi-source remote sensing and machine learning can overcome historical limitations in SFA mapping, enabling accurate, spatially continuous assessments across vast Inner-Mongolian steppe ecosystems. Our framework has the potential to be applied to other steppe ecosystems and dryland ecosystems across the Mongolian steppe and beyond, offering a foundation for improved monitoring and ecological impact assessments in the face of global climate changes.

Arid and semi-arid landscapes↗
DOE OSTI2026

Machine learning surrogates for ion energy–angle distributions in thermal and RF plasma sheaths

Ion energy–angle distributions (IEADs) at material surfaces are a critical input for plasma–material interaction (PMI) studies in fusion devices, yet they are computationally expensive to obtain using particle-in-cell (PIC) simulations. In this work, we develop a machine learning surrogate based on a deep deconvolutional neural network (DDeCNN) trained on large databases generated with the hPIC2 code. The surrogate is capable of reconstructing IEADs from sheath parameters for both thermal and radio-frequency (RF) plasmas, including cases with multiple ion species. Across thousands of test cases, the model achieves high accuracy, with over 97 % of predictions classified as good or average based on standard error metrics (MAE, MSE, L2). Even in the more challenging RF and multi-species regimes, the surrogate reliably captures the multi-peak structure of PIC results. Once trained, the surrogate produces IEADs in milliseconds on a common workstation, yielding speedups of six to seven orders of magnitude compared with running a full PIC simulation. This computational gain enables dense parameter scans and direct coupling of IEAD predictions with PMI and erosion models on whole-device scales in fusion-relevant conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Spatiotemporal predictions of toxic urban plumes using deep learning

Industrial accidents, chemical spills, and structural fires can release large amounts of harmful materials that disperse into urban atmospheres and impact populated areas. Computer models are typically used to predict the transport of toxic plumes by solving fluid dynamical equations. However, these models can be computationally expensive due to the need for many grid cells to simulate turbulent flow and resolve individual buildings and streets. In emergency response situations, alternative methods are needed that can run quickly and adequately capture important spatiotemporal features. Here, we present a novel deep learning model called ST-GasNet inspired by the mathematical equations that govern the behavior of plumes as they disperse through the atmosphere. ST-GasNet learns the spatiotemporal dependencies from a limited set of temporal sequences of ground-level toxic urban plumes generated by a high-resolution large eddy simulation model. On independent sequences, ST-GasNet accurately predicts the late-time spatiotemporal evolution, given the early-time behavior as an input, even when a building splits a large plume into smaller plumes. By incorporating large-scale wind boundary condition information, ST-GasNet achieves a prediction accuracy of at least 90% on test data for the entire prediction period.

Civil and Environmental Engineering↗
DOE OSTI2025

jaxhps: An elliptic PDE solver built with machine learning in mind

Elliptic partial differential equations (PDEs) can model many physical phenomena, such as electrostatics, acoustics, wave propagation, and diffusion. In scientific machine learning settings, a high-throughput PDE solver may be required to generate a training dataset, run in the inner loop of an iterative algorithm, or interface directly with a deep neural network. To provide value to machine learning users, such a PDE solver must be compatible with standard automatic differentiation frameworks, scale efficiently when run on graphics processing units (GPUs), and maintain high accuracy for a large range of input parameters. We have designed the jaxhps package with these use-cases in mind by implementing a highly efficient and accurate solver for elliptic problems with native hardware acceleration and automatic differentiation support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

CrossMP: Enabling Cross-Modality Translation between Single-Cell RNA-Seq and Single-Cell ATAC-Seq through Web-Based Portal

In recent years, there has been a growing interest in profiling multiomic modalities within individual cells simultaneously. One such example is integrating combined single-cell RNA sequencing (scRNA-seq) data and single-cell transposase-accessible chromatin sequencing (scATAC-seq) data. Integrated analysis of diverse modalities has helped researchers make more accurate predictions and gain a more comprehensive understanding than with single-modality analysis. However, generating such multimodal data is technically challenging and expensive, leading to limited availability of single-cell co-assay data. Here, we propose a model for cross-modal prediction between the transcriptome and chromatin profiles in single cells. Our model is based on a deep neural network architecture that learns the latent representations from the source modality and then predicts the target modality. It demonstrates reliable performance in accurately translating between these modalities across multiple paired human scATAC-seq and scRNA-seq datasets. Additionally, we developed CrossMP, a web-based portal allowing researchers to upload their single-cell modality data through an interactive web interface and predict the other type of modality data, using high-performance computing resources plugged at the backend.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Building molecular model series from heterogeneous CryoEM structures using Gaussian mixture models and deep neural networks

Cryogenic electron microscopy (CryoEM) produces structures of macromolecules at near-atomic resolution. However, building molecular models with good stereochemical geometry from those structures can be challenging and time-consuming, especially when many structures are obtained from datasets with conformational heterogeneity. Here we present a model refinement protocol that automatically generates series of molecular models from CryoEM datasets, which describe the dynamics of the macromolecular system and have near-perfect geometry scores. This method makes it easier to interpret the movement of the protein complex from heterogeneity analysis and to compare the structural dynamics observed from CryoEM data with results from other experimental and simulation techniques.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Assessing CLUBB PDF Closure Assumptions for a Continental Shallow-to-Deep Convective Transition Case Over Multiple Spatial Scales

Assumed-PDF (probability density function) higher-order turbulence closures (APHOCs) are now widely used for parameterizing boundary layer turbulence and shallow convection in Earth system models (ESMs). A better understanding of the resolution-dependent behavior of APHOCs is essential for improving the performance of next-generation ESMs with intended horizontal resolutions finer than 10 km. In this study, we evaluate the PDF family of Analytic double-Gaussian 1 implemented in Cloud Layers Unified By Binormals (CLUBB) over a range of spatial scales (Dx) from 2 to 100 km. A 120-km-wide large eddy simulation (LES) for a continental convection case during 2016 Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign serves as benchmark to evaluate the PDF closure using an off-line approach. We find during the shallow convection period, the CLUBB PDF closure tends to produce positive biases of cloud properties and liquid water flux near cloud base for all scales of analysis. It produces negative biases for these variables near cloud top that are more severe for Dx larger than 25 km. Results show that replacing the CLUBB-parameterized moisture and temperature skewnesses with LES-derived ones can fix most of the biases if clipping of input moments is allowed to prevent the occurrence of unrealizable solutions. Overall, the performance of the PDF closure is better for smaller Dx = 2–5 km than for larger Dx = 50–100 km; for a given grid spacing, it is better when the convective clouds become deeper in the late afternoon. Likely causes for the resolution dependence and implications for improving the PDF closure are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

De novo design of protein structure and function with RFdiffusion

Abstract There has been considerable recent progress in designing new proteins using deep-learning methods 1–9 . Despite this progress, a general deep-learning framework for protein design that enables solution of a wide range of design challenges, including de novo binder design and design of higher-order symmetric architectures, has yet to be described. Diffusion models 10,11 have had considerable success in image and language generative modelling but limited success when applied to protein modelling, probably due to the complexity of protein backbone geometry and sequence–structure relationships. Here we show that by fine-tuning the RoseTTAFold structure prediction network on protein structure denoising tasks, we obtain a generative model of protein backbones that achieves outstanding performance on unconditional and topology-constrained protein monomer design, protein binder design, symmetric oligomer design, enzyme active site scaffolding and symmetric motif scaffolding for therapeutic and metal-binding protein design. We demonstrate the power and generality of the method, called RoseTTAFold diffusion (RFdiffusion), by experimentally characterizing the structures and functions of hundreds of designed symmetric assemblies, metal-binding proteins and protein binders. The accuracy of RFdiffusion is confirmed by the cryogenic electron microscopy structure of a designed binder in complex with influenza haemagglutinin that is nearly identical to the design model. In a manner analogous to networks that produce images from user-specified inputs, RFdiffusion enables the design of diverse functional proteins from simple molecular specifications.

Science & Technology - Other Topics↗
DOE OSTI2024

Sequence-structure-function characterization of the emerging tetracycline destructase family of antibiotic resistance enzymes

Tetracycline destructases (TDases) are flavin monooxygenases which can confer resistance to all generations of tetracycline antibiotics. The recent increase in the number and diversity of reported TDase sequences enables a deep investigation of the TDase sequence-structure-function landscape. Here, we evaluate the sequence determinants of TDase function through two complementary approaches: (1) constructing profile hidden Markov models to predict new TDases, and (2) using multiple sequence alignments to identify conserved positions important to protein function. Using the HMM-based approach we screened 50 high-scoring candidate sequences in Escherichia coli, leading to the discovery of 13 new TDases. The X-ray crystal structures of two new enzymes from Legionella species were determined, and the ability of anhydrotetracycline to inhibit their tetracycline-inactivating activity was confirmed. Using the MSA-based approach we identified 31 amino acid positions 100% conserved across all known TDase sequences. The roles of these positions were analyzed by alanine-scanning mutagenesis in two TDases, to study the impact on cell and in vitro activity, structure, and stability. These results expand the diversity of TDase sequences and provide valuable insights into the roles of important residues in TDases, and flavin monooxygenases more broadly.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Oregon Rivers Characterization Tool

DHS’s Regional Resiliency Assessment Program (RRAP) undertook the Oregon State Transportation Systems RRAP project between 2018-2021 to assess the seismic vulnerabilities of the state’s transportation system to a Cascadia Subduction Zone (CSZ) earthquake (CISA 2021). The project primarily focused on the effects of a CSZ earthquake on the mobility of emergency response efforts into the region. In the event that bridges located at crucial river crossings fail during a CSZ earthquake, rivers will become natural barriers affecting the ability to support response and recovery efforts. The characteristics of rivers (e.g., width, depth, and flow) are critical data to inform planning for the recovery of transportation systems across river barriers and determine reopening times following a CSZ earthquake. As part of the transportation system assessment, an Argonne National Laboratory (Argonne) project team developed a River Characterization Tool (RCT) to quantify the physical characteristics of the river system in Oregon, which can be used to inform a system-level analysis of transportation recovery and reopening times. This report mainly discusses approaches, methods, development, and applications of the RCT. The use of the river data generated from this tool for a system-level analysis of transportation recovery is discussed in the Oregon Transportation Systems RRAP Resiliency Assessment report (CISA 2021). The primary goal of the RCT is to generate statewide dataset of widths, depths, and flows for all rivers across Oregon to assess the effects of river barriers on emergency response and recovery efforts following a CSZ earthquake. The RCT leverages remote sensing data that multispectral sensors collect from satellites, employs a deep learning model to characterize river predictions, and computes river channel geometric dimensions with hydraulic relationships and river predictions. The entire process of river characterization is automated and implemented through the RCT.

58 GEOSCIENCES↗
DOE OSTI2024

Measurement of Nuclear Dependence in Inclusive Antineutrino Scattering

One of the fundamental questions in physics is the matter-antimatter asymmetry of the Universe, explored through charge-parity violation searches in neutrino oscillation experiments. Next-generation oscillation experiments like DUNE need to constrain the systematic uncertainties arising from our understanding of (anti)neutrino-nucleus scattering to within a few percent to achieve their physics goals. MINERvA, a dedicated (anti)neutrino-nucleus scattering experiment, plays a crucial role in constraining these uncertainties. This thesis presents MINERvA's first high-statistics direct measurement of nuclear dependence in charged-current inclusive antineutrino scattering on carbon, hydrocarbon, iron, and lead as a function of antimuon transverse momentum, $p_{\text{T}}$, and Bjorken~$x$. The analysis utilises interactions with a mean antineutrino energy of approximately~6~GeV, with reconstructed antimuons having a scattering angle of less than 17$^\circ$ relative to the antin eutrino beam and an antimuon energy of 2--20 GeV. The measured per-nucleon differential cross-sections are reported with a precision of 7--9\%, while the cross-section ratios of carbon, iron, and lead to hydrocarbon have uncertainties of 5\% or less. The cross-sections for iron and lead indicate strong suppression at low $p_{\text{T}}$ and Bjorken~$x$, and an enhancement at high $p_{\text{T}}$. These effects are observed to be more pronounced with the increasing size of the target nucleus and are not reproduced by the underlying simulation prediction. Comparisons to alternative models used in current (anti)neutrino interaction generators show some improvements in modelling over the base prediction model, yet they are still unable to fully reproduce the observed nuclear dependence in this analysis. Importantly, the analysis provides a direct test of nuclear effects in inclusive antineutrino scattering, with major contributions from resonant pion production, deep inelastic scattering, and the transition region between these channels, which will be significant in DUNE. This measurement also represents one of the largest antineutrino datasets in this energy regime analysed to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Deep learning models for interpretation of point of care ultrasound in military working dogs

Introduction: Military working dogs (MWDs) are essential for military operations in a wide range of missions. With this pivotal role, MWDs can become casualties requiring specialized veterinary care that may not always be available far forward on the battlefield. Some injuries such as pneumothorax, hemothorax, or abdominal hemorrhage can be diagnosed using point of care ultrasound (POCUS) such as the Global FAST® exam. This presents a unique opportunity for artificial intelligence (AI) to aid in the interpretation of ultrasound images. In this article, deep learning classification neural networks were developed for POCUS assessment in MWDs. Methods: Images were collected in five MWDs under general anesthesia or deep sedation for all scan points in the Global FAST® exam. For representative injuries, a cadaver model was used from which positive and negative injury images were captured. A total of 327 ultrasound clips were captured and split across scan points for training three different AI network architectures: MobileNetV2, DarkNet-19, and ShrapML. Gradient class activation mapping (GradCAM) overlays were generated for representative images to better explain AI predictions. Results: Performance of AI models reached over 82% accuracy for all scan points. The model with the highest performance was trained with the MobileNetV2 network for the cystocolic scan point achieving 99.8% accuracy. Across all trained networks the diaphragmatic hepatorenal scan point had the best overall performance. However, GradCAM overlays showed that the models with highest accuracy, like MobileNetV2, were not always identifying relevant features. Conversely, the GradCAM heatmaps for ShrapML show general agreement with regions most indicative of fluid accumulation. Discussion: Overall, the AI models developed can automate POCUS predictions in MWDs. Preliminarily, ShrapML had the strongest performance and prediction rate paired with accurately tracking fluid accumulation sites, making it the most suitable option for eventual real-time deployment with ultrasound systems. Further integration of this technology with imaging technologies will expand use of POCUS-based triage of MWDs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Causes of Reduced Climate Sensitivity in E3SM From Version 1 to Version 2

The effective climate sensitivity in the Department of Energy's Energy Exascale Earth System Model (E3SM) has decreased from 5.3 K in version 1 to 4.0 K in version 2. This reduction is mainly due to a weaker positive cloud feedback that leads to a stronger negative radiative feedback. Present-day atmosphere-only experiments with uniform 4 K sea surface temperature warming are used to separate the contributions of individual model modifications to the reduced cloud feedback. We find that the reduced cloud feedback is mostly driven by changes over the tropical marine low cloud regime, mainly related to a new trigger function for the deep convection scheme and modifications in the cloud microphysics scheme. The new trigger function helps weaken the low cloud reduction by increasing the cloud water detrainment at low levels from deep convection under warming. Changes to the formula of autoconversion rate from liquid to rain and an introduced minimum cloud droplet number concentration threshold in cloud microphysical calculations help sustain clouds against dissipation by suppressing precipitation generation with warming. In the midlatitudes, the increased Wegener-Bergeron-Findeisen (WBF) efficiency strongly reduces present-day liquid water and leads to a stronger negative cloud optical depth feedback. The reduced trade cumulus cloud feedback in v2 is closer to estimates from recent observational and large-eddy modeling studies but might not be due to the right physical reasons. The reduced mid-latitude cloud feedback may be more plausible because more realistic present-day mixed-phase clouds are produced through the change in the WBF efficiency.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2021

Light, long-lived B - L gauge and Higgs bosons at the DUNE near detector

The low-energy U(1)B-L gauge symmetry is well-motivated as part of beyond Standard Model physics related to neutrino mass generation. We show that a light B - L gauge boson Z' and the associated U(1) B-L -breaking scalar φ can both be effectively searched for at high-intensity facilities such as the near detector complex of the Deep Underground Neutrino Experiment (DUNE). Without the scalar φ, the Z' can be probed at DUNE up to mass of 1 GeV, with the corresponding gauge coupling g BL as low as 10 -9 . In the presence of the scalar φ with gauge coupling to Z', the DUNE capability of discovering the gauge boson Z' can be significantly improved, even by one order of magnitude in g BL , due to additional production from the decay φ → Z'Z'. The DUNE sensitivity is largely complementary to other long-lived Z' searches at beam-dump facilities such as FASER and SHiP, as well as astrophysical and cosmological probes. On the other hand, the prospects of detecting φ itself at DUNE are to some extent weakened in presence of Z', compared to the case without the gauge interaction.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Tree water uptake patterns across the globe

Plant water uptake from the soil is a crucial element of the global hydrological cycle and essential for vegetation drought resilience. Yet, knowledge of how the distribution of water uptake depth (WUD) varies across species, climates, and seasons is scarce relative to our knowledge of aboveground plant functions. With a global literature review, we found that average WUD varied more among biomes than plant functional types (i.e. deciduous/evergreen broadleaves and conifers), illustrating the importance of the hydroclimate, especially precipitation seasonality, on WUD. By combining records of rooting depth with WUD, we observed a consistently deeper maximum rooting depth than WUD with the largest differences in arid regions – indicating that deep taproots act as lifelines while not contributing to the majority of water uptake. The most ubiquitous observation across the literature was that woody plants switch water sources to soil layers with the highest water availability within short timescales. Hence, seasonal shifts to deep soil layers occur across the globe when shallow soils are drying out, allowing continued transpiration and hydraulic safety. While there are still significant gaps in our understanding of WUD, the consistency across global ecosystems allows integration of existing knowledge into the next generation of vegetation process models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Towards On-Chip Learning for Low Latency Reasoning with End-to-End Synthesis

The Software Defined Architectures (SODA) Synthesizer is an open-source compiler-based tool able to automatically generate domain-specialized systems targeting Application-Specific Integrated Circuits (ASICs) or Field Programmable Gate Arrays (FPGAs) starting from high-level programming. SODA is composed of a frontend, SODA-OPT, which leverages the multilevel intermediate representation (MLIR) framework to interface with productive programming tools (e.g., machine learning frame-works), identify kernels suitable for acceleration, and perform high-level optimizations, and of a state-of-the-art high-level synthesis backend, Bambu from the PandA framework, to generate custom accelerators. One specific application of the SODA Synthesizer is the generation of accelerators to enable ultra-low latency inference and control on autonomous systems for scientific discovery (e.g., electron microscopes, sensors in particle accelerators, etc.). This paper provides an overview of the flow in the context of the generation of accelerators for edge processing to be integrated in transmission electron microscopy (TEM) devices, focusing on use cases from precision material synthesis. We show the tool in action with an example of design space exploration for inference on reconfigurable devices with a conventional deep neural network model (LeNet). Finally, we discuss the research directions and opportunities enabled by SODA in the area of autonomous control for scientific experimental workflows.

Castellana, Vito G.↗