Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Aspen Open Jets: unlocking LHC data for foundation models in particle physics

Foundation models are deep learning models pre-trained on large amounts of data which are capable of generalizing to multiple datasets and/or downstream tasks. This work demonstrates how data collected by the CMS experiment at the Large Hadron Collider can be useful in pre-training foundation models for HEP. Specifically, we introduce the AspenOpenJets (AOJs) dataset, consisting of approximately 178 M high p T jets derived from CMS 2016 Open Data. We show how pre-training the OmniJet-α foundation model on AOJs improves performance on generative tasks with significant domain shift: generating boosted top and QCD jets from the simulated JetClass dataset. In addition to demonstrating the power of pre-training of a jet-based foundation model on actual proton–proton collision data, we provide the ML-ready derived AOJs dataset for further public use.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Reimagine fire science for the anthropocene

Fire is an integral component of ecosystems globally and a tool that humans have harnessed for millennia. Altered fire regimes are a fundamental cause and consequence of global change, impacting people and the biophysical systems on which they depend. As part of the newly emerging Anthropocene, marked by human-caused climate change and radical changes to ecosystems, fire danger is increasing, and fires are having increasingly devastating impacts on human health, infrastructure, and ecosystem services. Increasing fire danger is a vexing problem that requires deep transdisciplinary, trans-sector, and inclusive partnerships to address. Here, we outline barriers and opportunities in the next generation of fire science and provide guidance for investment in future research. We synthesize insights needed to better address the long-standing challenges of innovation across disciplines to (i) promote coordinated research efforts; (ii) embrace different ways of knowing and knowledge generation; (iii) promote exploration of fundamental science; (iv) capitalize on the “firehose” of data for societal benefit; and (v) integrate human and natural systems into models across multiple scales. Fire science is thus at a critical transitional moment. We need to shift from observation and modeled representations of varying components of climate, people, vegetation, and fire to more integrative and predictive approaches that support pathways toward mitigating and adapting to our increasingly flammable world, including the utilization of fire for human safety and benefit. Only through overcoming institutional silos and accessing knowledge across diverse communities can we effectively undertake research that improves outcomes in our more fiery future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Data Analysis of the 2020 Central Idaho Mainshock-Aftershock Sequence

In an effort to inform the Senior Seismic Hazard Analysis Committee for the Idaho National Laboratory, we provide an improved aftershock catalog related to the March 31, 2020, Mw6.5 Stanley, Idaho earthquake from picks related to a temporary network of two real-time and 15 non-telemetered seismometers within the epicentral area. From the permanent and temporary (XP) real-time network, the USGS cataloged 1,946 aftershocks between April 1, 2020 and October 31, 2020. To improve aftershock location and magnitudes, we manually picked arrival times of P and S waves from off-line stations in the XP temporary network, generated a new crustal velocity model, and independently relocated each event using the HypoDD double-difference earthquake algorithm. We created our new velocity model from existing broadband and active source seismic campaign data that were acquired near the epicentral region prior to the 2020 earthquake. We compare arrival time differences, epicentral locations and depths between aftershocks recorded with the two catalogs. We find the addition of local stations provides tighter aftershock clustering that suggests an improved aftershock locations. To detect lower magnitude events, we employed deep learning. Our method solves common problems associated with detecting many events that have a low signal-to-noise ratio. From the machine learning database, we detected more than 74,000 aftershocks. Based on the number of identified earthquakes and Gutenberg-Richter relationships derived from the USGS catalog, we estimate that we have reduced the completion magnitude for the Stanley earthquake sequence to below M1 using this machine learning approach. We located each aftershock with our new velocity model. Our new velocity model and picks suggests aftershocks occurred mostly at shallower depths than assessed in the USGS catalog. These aftershocks align along two linear trends that suggest the activation of two unnamed primary faults.

58 GEOSCIENCES↗
DOE OSTI2020

Robust Assessment of Real-World Adversarial Examples

We explore rigorous, systematic, and controlled experimental evaluation of adversarial examples in the real world and propose a testing regimen for evaluation of real world adversarial objects. We show that for small scene/ environmental perturbations, large adversarial performance differences exist. Current state of adversarial reporting exists largely as a frequency count over a dynamic collections of scenes. Our work underscores the need for either a more complete report or a score that incorporates scene changes and baseline performance for models and environments tested by adversarial developers. We put forth a score that attempts to address the above issues in a straight-forward exemplar application for multiple generated adversary examples. We contribute the following: 1. a testbed for adversarial assessment, 2. a score for adversarial examples, and 3. a collection of additional evaluations on testbed data.

deep learning, adversarial machine learning, machi↗
DOE OSTI2025

A deep learning and finite element approach for exploration of inverse structure–property designs of lightweight hybrid composites

Hybrid composites have important applications, such as high-performance and lightweight materials in aerospace and automotive industries. Hybrid composites utilize the synergy of diverse fillers to achieve desired material properties, but usually have more complicated microstructures. While topology optimization can optimize a particular property, designing hybrid composites for customized mechanical performances, e.g. full-range stress–strain curve, remains challenging. Here, a computational framework that integrated finite element analysis (FEA) and artificial intelligence (AI) methods of Conditional Generative Adversarial Networks (cGAN) deep learning and transfer learning was developed to establish inverse structure–property relationships and design tailor-made hybrid composites. Based on FEA-generated datasets of hybrid fiber-particle–matrix microstructures and their corresponding full-range stress–strain curves, a cGAN architecture was trained to generate tailored microstructures and establish structure–property relationships. Similarity in microstructural features and well-matched stress–strain curves based on the AI-generated composites were achieved. In conclusion, transfer learning was used to expand the pre-trained model for designing different materials systems.

Hybrid composites↗
DOE OSTI2023

Adaptive Deep Reinforcement Learning Algorithm for Distribution System Cyber Attack Defense With High Penetration of DERs

With grid modernization, smart inverters are increasingly used to execute advanced controls for distribution network reliability. However, this also increases the cyber-attack space. Here this paper focuses on the defense approaches to restore the system to normal operation circumstances in the presence of cyber-attacks. A unique deep reinforcement learning (DRL) method is developed to minimize voltage violations and reduce power losses for impacted feeders. The defense problem is reformulated as a Markov decision-making process to dynamically control DERs while minimizing load shedding. This is achieved via an improved soft actor-critic (SAC)-based DRL algorithm, which can govern DER set points and load-shedding scenarios in discrete and continuous modes via the auto-tune entropy and Gaussian policy features. Numerical comparison results on the modified IEEE 123-node system with other control approaches, such as Volt-VAR (VV), Volt-Watt (VW), and model predictive control (MPC) show that the proposed method can eliminate voltage violations and provide feasible control actions that perform complete mitigation of cyber-threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Deep Learning Systems for Increased Safeguards Surveillance Review Productivity

Nuclear safeguards inspectors expend significant time and maintain intense focus in reviewing video surveillance for safeguards relevant events. To increase efficiency and reduce the time burden of safeguards inspectors performing surveillance data review, this paper presents a novel deep learning (DL) systems concept to integrate generalized DL models into the safeguards surveillance review workflow. The Agency is investigating several DL algorithms for object recognition, localization, tracking, and flagging relevant activities. The project team is working closely with nuclear safeguards inspectors to identify review use cases (based on specific safeguards objectives) and collect their associated requirements. We focused on CANDU and LWR Nuclear Power Plants (NPPs) and their associated dry storage areas as these present a particularly heavy burden on the inspector surveillance review process due to the number of these facilities under safeguards worldwide. Initial DL algorithm results on safeguards data are promising. Using a convolutional neural network, the team attained a mean average precision (mAP) of 92.9% identifying and localizing spent fuel (SF) casks from a 475 surveillance image dataset. Further, the team had initial success in training a recurrent neural network to identify reactor area activities in video clips, successfully indicating when SF casks enter or exit a pool. We discuss how such DL algorithms would be integrated into the Next Generation Surveillance Review (NGSR) software application. Another issue impacting review productivity is the long time inspectors may have to wait when running these algorithms in NGSR. We present a concept to pre-process remotely collected surveillance data with DL models as the data arrives to IAEA headquarters so that results are already available when starting a new review in NGSR. The proposed DL system concept shows a pathway and workflow for increasing an inspector’s surveillance review productivity by quickly and accurately identifying declared and undeclared safeguards relevant objects and activities in large quantities of surveillance imagery data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2020

Sequence-to-sequence neural networks for short-term electrical load forecasting in commercial office buildings

The U.S. power grid is transforming to become smarter, cleaner, and more effi- cient. This is leading to the addition of significant distributed variable renew- able generation. Due to the variable nature of renewable generation, the short- and long-term supply-demand imbalances are less predictable, and conventional approaches to mitigating the imbalance will not be efficient or cost-effective. To address this challenge, transactive control technologies have been proposed which balance energy generation and consumption with market activity and in- frastructural limitations. Transactive control requires the ability of individual end-use loads to express flexibility as a function of a transactive signal (e.g., price). Empirical gray- and black-box models have been widely used to express flexibility, and although these approaches are generally easy to construct and simple to use, they do not capture the non-linear behavior that some end-use loads represent . Machine learning approaches have been proposed to address this limitation. Although deep learning approaches for forecasting end-use loads have been explored, certain aspects of the application of deep models to load forecasting are not well understood. These aspects include how much training data is required, and how models should be structured and trained. To that end, this work explores how to approach applying deep recurrent neural networks to short-term electrical load forecasting with a case study of four commercial office buildings. We identify data requirements for training accurate models of whole building electricity use conditioned on outdoor temperature, provide insight into model hyperparameter sensitivity, and demonstrate how readily models can be generalized to unseen buildings.

Skomski, Elliott↗
DOE OSTI2024

Direct Observation of Circularly Polarized Nonlinear Optical Activities in Chiral Hybrid Lead Halides

Circularly polarized light emission is a crucial application in imaging, sensing, and photonics. However, utilizing low-energy photons to excite materials, as opposed to high-energy light excitation, can facilitate deep-tissue imaging and sensing applications. The challenge lies in finding materials capable of directly generating circularly polarized nonlinear optical effects. In this study, we introduce a chiral hybrid lead halide (CHLH) material system, R/S-DPEDPb 3 Br 8 ·H 2 O (DPED = 1,2-diphenylethylenediammonium), which can directly produce circularly polarized second harmonic generation (CP-SHG) through linearly polarized infrared light excitation, exhibiting a polarization efficiency as high as 37% at room temperature. To understand the spin relaxation mechanisms behind the high polarization efficiency, we utilized two models, so-called D’yakonov–Perel’ (DP) and Bir–Aronov–Pikus (BAP) mechanisms. The unique zigzag inorganic frameworks within the hybrid structure are believed to reduce the dielectric confinement and exciton binding energy, thus enhancing spin polarization, especially in regions with a high excitation pump fluence based on the DP mechanism. In the case of low excitation pump fluence, the BAP mechanism dominates, as evidenced by the observed decrease in the polarization ratio from CP-SHG measurement. Using density functional theory analysis, we elucidate how the distinctive 8-coordination environment of lead bromide building blocks effectively suppresses spin–orbit coupling at the conduction band minimum. This suppression significantly diminishes spin-splitting, thereby slowing the spin relaxation rate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Scenario Discovery Analysis of Drivers of Solar and Wind Energy Transitions Through 2050

Deep human-Earth system uncertainties and strong multi-sector dynamics make it difficult to anticipate which conditions are most likely to lead to higher or lower adoption of renewable energy, and models project a broad range of future solar and wind energy shares across future scenarios. To elucidate these dynamics, we explore a large data set of scenarios simulated from the Global Change Analysis Model (GCAM) and use scenario discovery to identify the most significant factors affecting solar and wind adoption by mid-century. We generated a data set of over 4,000 scenarios from GCAM by varying 12 different socioeconomic factors at high and low levels, including assumptions about future energy demand, resource costs, and fossil fuel emissions paths, as well as specific technology assumptions including wind and solar backup requirements and storage costs. Using scenario discovery, we assess the most important factors globally and regionally in creating high fractions of solar and wind energy and explore interconnected effects on other systems including water and non-CO 2 emissions. Globally and regionally, we found that solar and wind-related technology costs were the primary drivers of high wind and solar energy adoption, though a few regions depend heavily on other parameters like carbon capture and storage costs, population and gross domestic product trajectories, and fossil fuel costs. We also identify four key paths to high solar and wind energy by mid-century and discuss their tradeoffs in terms of other outcomes.

14 SOLAR ENERGY↗
DOE OSTI2025

High precision monitoring of outgassing species in model EUV photoresists with a cavity ring-down spectrometer

Extreme ultraviolet (EUV) photoresists play a pivotal role in advancing nanopatterning technologies by balancing image quality and sensitivity. The outgassing behavior of photoresist thin films under EUV and deep ultraviolet (DUV) exposure reveals chemical details relevant to their performance. This study focuses on utilizing an analytical technique not previously used in photolithography, the tabletop cavity ring-down spectrometer, to investigate outgassing dynamics in EUV photoresists, enabling precise chemical identification and deeper insights into resist processing. The spectrometer’s enhanced laser path length (~20 km) and broadband absorption capabilities in the CH overtone region allow for sensitive and temporally resolved detection of outgassed species. Using a model resist comprising a polymer matrix with a photoacid generator and quencher, we analyzed the influence of time delays between exposure and Post-Exposure Bake (PEB) as well as storage under varying environmental conditions. Suppression of isobutylene outgassing and thickness loss was observed with extended delays between exposure and PEB, potentially linked to water absorption and acid deactivation. The technique proved highly effective in distinguishing subtle chemical differences between processing stages. Delay times and their environmental conditions, particularly humidity, reduce outgassing and thickness loss of photoresists during PEB, suggesting decreased acid-driven deprotection. This can potentially impact sensitivity, defectivity, and roughness of resist patterns, necessitating precise monitoring and control.

Lüttgenau, Bernhard↗
DOE OSTI2024

Deep Image Prior Enabled Full Waveform Inversion (Final Technical Report)

MS Student Naveen Gupta worked on the problem of full waveform inversion (FWI) using neural networks as shown in Figure 1. Our goal was to learn a neural network to represent the subsurface velocity model, which when fed into the FWI module (implemented using a numerical forward model of wave equations) produces amplitude estimates that match with ground-truth observations of amplitude. We used neural networks to solve the inverse problem of estimating velocity distributions for a given seismic amplitude data such that, once trained, our neural network model can generate a distribution of velocity profiles for different random vectors fed as inputs to the neural network model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Rats use memory confidence to guide decisions

Memory enables access to past experiences to guide future behavior. Humans can determine which memories to trust (high confidence) and which to doubt (low confidence). How memory retrieval, memory confidence, and memory-guided decisions are related, however, is not understood. In particular, how confidence in memories is used in decision making is unknown. We developed a spatial memory task in which rats were incentivized to gamble their time: betting more following a correct choice yielded greater reward. Rat behavior reflected memory confidence, with higher temporal bets following correct choices. We applied machine learning to identify a memory decision variable and built a generative model of memories evolving over time that accurately predicted both choices and confidence reports. Our results reveal in rats an ability thought to exist exclusively in primates and introduce a unified model of memory dynamics, retrieval, choice, and confidence.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Machine Learning Tools Set for Natural Gas Fuel Cell System Design

This study is focusing on leveraging the system design tools set for the next-generation solid oxide fuel cell (SOFC) based natural gas fuel cell (NGFC) system. Conventionally, system design and optimization of NGFC systems rely heavily on traditional reduced order model (ROM) techniques and designers’ experience level. For overcoming the technical barriers of system design, multiple multi-physics models and machine learning (ML) tools have been utilized to automate the conceptual design process and enhance the reliability of solutions for the NGFC system. The proposed tools set includes a physics-informed ML tool for automated ROM construction that leverages advances in deep neural networks to significantly reduce ROM prediction error for the NGFC power island compared to traditional approaches. The constructed physics-informed ML ROM can be used in system design, and optimization tools set Institute for the Design of Advanced Energy Systems (IDAES) Process Systems Engineering (PSE) framework. The tools set also provides a user-friendly graphic user interface built within Jupyter Notebooks, and the complete tools set is open-source public available.

Wang, Dewei↗
DOE OSTI2021

Learning to Correct Climate Projection Biases

The fidelity of climate projections is often undermined by biases in climate models due to their simplification or misrepresentation of unresolved climate processes. While various bias correction methods have been developed to post-process model outputs to match observations, existing approaches usually focus on limited, low-order statistics, or break either the spatiotemporal consistency of the target variable, or its dependency upon model resolved dynamics. We develop a Regularized Adversarial Domain Adaptation (RADA) methodology to overcome these deficiencies, and enhance efficient identification and correction of climate model biases. Instead of pre-assuming the spatiotemporal characteristics of model biases, we apply discriminative neural networks to distinguish historical climate simulation samples and observation samples. The evidences based on which the discriminative neural networks make distinctions are applied to train the domain adaptation neural networks to bias correct climate simulations. We regularize the domain adaptation neural networks using cycle-consistent statistical and dynamical constraints. An application to daily precipitation projection over the contiguous United States shows that our methodology can correct all the considered moments of daily precipitation at approximately $1^\circ$ resolution, ensures spatiotemporal consistency and inter-field correlations, and can discriminate between different dynamical conditions. Our methodology offers a powerful tool for disentangling model parameterization biases from their interactions with the chaotic evolution of climate dynamics, opening a novel avenue toward big-data enhanced climate predictions.

58 GEOSCIENCES↗
DOE OSTI2025

The role of the droplet interface in controlling the multiphase oxidation of thiosulfate by ozone

Predicting reaction kinetics in aqueous microdroplets, including aerosols and cloud droplets, is challenging due to the probability that the underlying reaction mechanism can occur both at the surface and in the interior of the droplet. Additionally, few studies directly measure the surface activities of doubly charged anions, despite their prevalence in the atmosphere. Here, deep-UV second harmonic generation spectroscopy is used to probe surface affinities of the doubly charged anions thiosulfate, sulfate, and sulfite, key species in the thiosulfate ozonation reaction mechanism. Thiosulfate has an appreciable surface affinity with a measured Gibbs free energy of adsorption of -7.3 ± 2.5 kJ mol -1 in neutral solution, while sulfate and sulfite exhibit negligible surface propensity. The Gibbs free energy is combined with data from liquid flat jet ambient pressure X-ray photoelectron spectroscopy to constrain the concentration of thiosulfate at the surface in our model. Stochastic kinetic simulations leveraging these novel measurements show that the primary reaction between thiosulfate and ozone occurs at the interface and in the bulk, with the contribution of the interface decreasing from ~65% at pH 5 to ~45% at pH 13. Additionally, sulfate, the major product of thiosulfate ozonation and an important species in atmospheric processes, can be produced by two different pathways at pH 5, one with a contribution from the interface of >70% and the other occurring predominantly in the bulk (>98%). The observations in this work have implications for mining wastewater remediation, atmospheric chemistry, and understanding other complex reaction mechanisms in multiphase environments. Future interfacial or microdroplet/aerosol chemistry studies should carefully consider the role of both surface and bulk chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Atomic protein structure refinement using all-atom graph representations and SE(3)-equivariant graph transformer

Abstract Motivation The state-of-art protein structure prediction methods such as AlphaFold are being widely used to predict structures of uncharacterized proteins in biomedical research. There is a significant need to further improve the quality and nativeness of the predicted structures to enhance their usability. In this work, we develop ATOMRefine, a deep learning-based, end-to-end, all-atom protein structural model refinement method. It uses a SE(3)-equivariant graph transformer network to directly refine protein atomic coordinates in a predicted tertiary structure represented as a molecular graph. Results The method is first trained and tested on the structural models in AlphaFoldDB whose experimental structures are known, and then blindly tested on 69 CASP14 regular targets and 7 CASP14 refinement targets. ATOMRefine improves the quality of both backbone atoms and all-atom conformation of the initial structural models generated by AlphaFold. It also performs better than two state-of-the-art refinement methods in multiple evaluation metrics including an all-atom model quality score—the MolProbity score based on the analysis of all-atom contacts, bond length, atom clashes, torsion angles, and side-chain rotamers. As ATOMRefine can refine a protein structure quickly, it provides a viable, fast solution for improving protein geometry and fixing structural errors of predicted structures through direct coordinate refinement. Availability and implementation The source code of ATOMRefine is available in the GitHub repository (https://github.com/BioinfoMachineLearning/ATOMRefine). All the required data for training and testing are available at https://doi.org/10.5281/zenodo.6944368.

59 BASIC BIOLOGICAL SCIENCES↗