SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Solving high-dimensional inverse problems using amortized likelihood-free inference with noisy and incomplete data

Here, we present a likelihood-free probabilistic inversion method based on normalizing flows for high-dimensional inverse problems. The proposed method is composed of two complementary networks: a summary network for data compression and an inference network for parameter estimation. The summary network encodes raw observations into a fixed-size vector of summary features, while the inference network generates samples of the approximate posterior distribution of the model parameters based on these summary features. The posterior samples are produced in a deep generative fashion by sampling from a latent Gaussian distribution and passing these samples through an invertible transformation. We construct this invertible transformation by sequentially alternating conditional invertible neural network and conditional neural spline flow layers. The summary and inference networks are trained simultaneously. We apply the proposed method to an inversion problem in groundwater hydrology to estimate the posterior distribution of the log-conductivity field conditioned on spatially sparse time-series observations of the system’s hydraulic head responses. The conductivity field is represented with 706 degrees of freedom in the considered problem. Comparison with the likelihood-based iterative ensemble smoother PEST-IES method demonstrates that the proposed method accurately estimates the parameter posterior distribution and the observations’ predictive posterior distribution at a fraction of the inference time of PEST-IES.

conditional invertible neural network↗

DOE OSTI2025

Subject-specific modeling framework for particle deposition using computational fluid dynamics

Quantifying particle deposition and dose in the respiratory tract requires a physiologically realistic representation and reproducible computational workflows. However, existing modeling frameworks, such as the International Commission on Radiological Protection (ICRP) compartmental models and the Multiple Path Particle Dosimetry (MPPD) tool, lack detailed deposition profiles and subject-specific capabilities. The combination of advances in computer vision algorithms applied to the respiratory tract and Computational Fluid and Particle Dynamics (CFPD) allows high-fidelity simulations of particle behavior in anatomically accurate geometries derived from individual CT scans. The segmentation, preprocessing, and file preparation task for a CFPD simulation was often time-consuming, and no prior studies to-date have yet presented a fully automated framework. This work presents a fully automated workflow to obtain individualized particle deposition profiles in the human respiratory tract. The pipeline starts with segmenting upper and lower airway geometries using morphological and deep learning-based methods, generating three-dimensional (3D) models from CT imaging data. Next, a series of algorithms are presented to quality check and prepare the 3D geometry for a CFD or CFPD simulation. The preprocessing step includes correcting geometric artifacts, enforcing a physically consistent mesh, and automatically identifying and capping multiple outlets, which is required for CFD/CFPD simulations. These processed models are then input into open-source (OpenFOAM) or commercial (StarCCM+) CFD solvers, where flow and transient particle transport equations — including turbulence and particle–wall interactions are solved under realistic breathing conditions. Finally, the resulting particle deposition profiles can be integrated with Monte Carlo radiation transport codes and state-of-the-art computational phantoms to assess organ-specific absorbed doses in scenarios of radioactive aerosol inhalation. The presented work streamlines respiratory tract segmentation, preprocessing for CFD/CFPD simulations, and integration with dose assessment workflows, reducing manual intervention and improving access to high-fidelity, subject-specific modeling. The high precision in predicted particle deposition and dose distributions can improve personalized treatment strategies in respiratory medicine and refine dose estimates for radiation protection.

AI↗

NASA NTRS2019

Biological CubeSats: What Have We Learned so Far and What Is Next?

Since Apollo 17 in 1972, NASA has sent no humans or other biological organisms outside of Earth's protective magnetosphere. Recently, NASA has set its sights on human exploration in deep space, with an ambitous plan to put astronauts back on the Moon by 2024 and to eventually land human missions on Mars. Such missions will require significant countermeasures, likely both technological and biomedical, to protect biology from chronic radiation exposure. CubeSats can inform these countermeasures by querying relevant space environments with model organisms.NASA has launched five biological CubeSat missions into low-Earth orbit (LEO). GeneSat-1 was launched in 2006 to study gene expression and increase our knowledge of how spaceflight affects microbes. Similar life-support technologies were then used in PharmaSat and O/OREOS, which launched in 2009 and 2010, respectively. PharmaSat contained optical systems to examine how yeast cells responded to an antifungal treatment. One of O/OREOS payloads, SESLO (Space Environment Survivability of Living Organisms), housed dormant microorganisms, which were rehydrated on orbit to track alterations to growth and metabolism induced by microgravity and radiation. In 2014, NASA launched SporeSat to study the mechanisms of plant cell gravity sensing using lab-on-a-chip devices. Most recently, in 2017, NASA launched EcAMSat (E. coli AntiMicrobial Satellite), which investigated the effects of microgravity on antibiotic resistance of a pathogenic bacterium. Each one of these missions increased our understanding of the biological effects of spaceflight in LEO, while refining technologies and imparting valuable lessons to the next generation of CubeSats.CubeSats housing translational biological models are therefore ideal for defining the hazards of deep space travel, as they can provide critical data over relevant durations. BioSentinel, a next-generation deep-space CubeSat, is planned to launch as a secondary payload on Artemis 1 in 2020. BioSentinel will study the DNA damage response to deep space radiation in yeast.

Santa Maria, Sergio R.↗

NASA NTRS2022

Deep Interacting Multiple Model Filtering

In this paper, a deep learning-based multiple model estimation framework is presented for the state estimation of hybrid dynamical systems from high dimensional observations such as camera images. A low dimensional vector which represents the measurement of the latent dynamical system and its corresponding variance are learned using a deep encoder neural network. An Interacting Multiple Model (IMM) filter is used to generate the latent state estimates and covariances using multiple dynamical models, which can be learned using backpropagation through time. The state estimates of the dynamical system and the corresponding covariance matrix are generated from the latent state estimates and covariance using a deep decoder neural network. The whole network is trained in an end-to-end manner using a loss function which minimizes the negative log-likelihood of the neural network parameters. Simulation results are presented using a 2D bouncing ball example and estimation error statistics are computed which demonstrates the accuracy and consistency of the estimation.

Ghananeel Rotithor↗

NASA NTRS1969

Thermal model of a 75 watt

Planar radioisotope thermoelectric generator system for NASA deep space missions and integrated spacecraft power supply

Parker, A. J., Jr.↗

NASA NTRS1988

Underplating, anatexis and assimilation of metacarbonate: A possible source for large CO2 fluxes in the deep crust

Recent models for granulite petrogenesis have involved infiltrative streaming of CO2 derived from deep-seated sources, removal of H2O in locally generated silicate melts, or various combinations of these two processes. All these models require a heat source of some type to generate the high crustal temperatures associated with anatexis and granulite-grade metamorphism, and this most likely takes the form of mantle-derived basaltic magma that is either underplated or intruded into the lower continental crust. Huppert and Sparks have recently shown that such underplating is likely to cause rapid, very large-scale melting of the overlying crust (roof rock) over time scales of only a few hundred years. This model is readily applicable to the granulite terrane of Southern India where metacarbonates occur within the deeper parts of the section including the amphibolite-granulite transition zone. Furthermore, it obviates the need to remove low melt fractions from deep crustal rocks as a principal dehydration mechanism; compaction theory has shown this to be a very sluggish process that is unlikely to be important over typical geological time scales. It also avoids any mechanism involving the subduction of large volumes of sedimentary carbonate into the mantle to provide a CO2 source.

Wickham, S. M.↗

DOE OSTI2026

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗

NASA NTRS2003

GRACE gravity model: assssment in terms of deep ocean currents from hydrography and from the ECCO ocean model

Here we assess the new generation of gravity models, derived from GRACE data. The differences between a global geoid model (one from GRACE data and one the well-known EGM-96), minus a Mean Sea Surface derived from over a decade of altimetric data are compared to hydrographic data from the Levitus compilation and to the ECCO numerical ocean model, which assimilates altimetry and other data.

oceans ocean currents El Nino TOPEX Jason seawinds↗

DOE OSTI2021

Learning Sequential Distribution System Restoration via Graph-Reinforcement Learning

We report a distribution service restoration algorithm as a fundamental resilient paradigm for system operators provides an optimally coordinated, resilient solution to enhance the restoration performance. The restoration problem is formulated to coordinate distribution generators and controllable switches optimally. A model-based control scheme is usually designed to solve this problem, relying on a precise model and resulting in low scalability. To tackle these limitations, this work proposes a graph-reinforcement learning framework for the restoration problem. We link the power system topology with a graph convolutional network, which captures the complex mechanism of network restoration in power networks and understands the mutual interactions among controllable devices. Latent features over graphical power networks produced by graph convolutional layers are exploited to learn the control policy for network restoration using deep reinforcement learning. The solution scalability is guaranteed by modeling distributed generators as agents in a multi-agent environment and a proper pre-training paradigm. Comparative studies on IEEE 123-node and 8500-node test systems demonstrate the performance of the proposed solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Diffusion Model-Guided Inverse Design of Bimetallic Catalysts for Ammonia Decomposition

In the past decade, artificial intelligence and deep learning have played increasingly prominent roles in materials design and discovery. Among these, generative AI models, known for their ability to create unique and complex structures, have emerged as state-of-the-art tools for materials screening due to their high efficiency and low computational cost. In catalysis, one of the major challenges is identifying promising material candidates within an immense chemical space. This challenge can be addressed using generative approaches, such as diffusion-based inverse design models. In this study, we present a machine learning-guided workflow that employed a diffusion model for the inverse design of bimetallic alloy catalysts for low-carbon ammonia decomposition, a key reaction for ammonia emission control and sustainable hydrogen production. Catalyst candidates were evaluated using nitrogen adsorption energy as the key descriptor, inspired by multiscale modeling. The proposed workflow identified low-cost, environmentally friendly catalysts with excellent catalytic performance, which have been validated theoretically and experimentally. Our framework decoupled the generative and property-prediction components, enhancing both flexibility and accuracy in the catalytic material design process.

Adsorption↗

DOE OSTI2024

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗

DOE OSTI2021

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗

DOE OSTI2024

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Electrolytes play a critical role in designing next-generation battery systems, by allowing efficient ion transfer, preventing charge transfer, and stabilizing electrode-electrolyte interfaces. In this work, we develop a differentiable geometric deep learning (GDL) model for chemical mixtures, DiffMix, which is applied in guiding robotic experimentation and optimization towards fast charging battery electrolytes. In particular, we extend mixture thermodynamic and transport laws by creating GDL-learnable physical coefficients. We evaluate our model with mixture thermodynamics and ion transport properties, where we show improved prediction accuracy and model robustness of Diff-Mix than its purely data-driven variants. Furthermore, with a robotic experimentation setup, Clio, we improve ionic conductivity of electrolytes by over 18.8% within 10 experimental steps, via differentiable optimization built on DiffMix gradients. By combining GDL, mixture physics laws, and robotic experimentation, DiffMix expands the predictive modeling methods for chemical mixtures and enables efficient optimization in large chemical spaces.

25 - ENERGY STORAGE↗

DOE OSTI2023

Hybrid Attack Graph Generation with Graph Convolutional Deep-Q Learning

Critical infrastructures such as power grids have become increasingly complex, connected, and vulnerable to adverse scenarios, including cyber and physical attacks and faults. Effective risk mitigation for such cyber-physical energy systems (CPES), requires preemptive knowledge of likely adversarial attack scenarios. Hybrid Attack Graph (HAG) is a structured way to represent an adversarial scenario as an attack sequence using a threat model. However, the scarcity of documented attack sequences hinders analysts and CPES planners’ ability to identify credible attack scenarios for a given CPES. We propose a data-driven Graph Convolutional Deep-Q Network (GCDQ) to address this data challenge through generating HAGs. By leveraging limited real-world observations from the MITRE ATT&CK knowledge base, our GCDQ model synthesizes realistic graphs with the targeted attribute of minimum detectability via reinforcement learning. This generative model is the first step in creating a tool to substantially boost the attack sequence dataset and enhance the performance of CPS defense-related tasks by providing insights into likely attack sequences with given attributes.

deep learning, artificial intelligence↗

DOE OSTI2021

Predictive Data-driven Platform for Subsurface Energy Production

Subsurface energy activities such as unconventional resource recovery, enhanced geothermal energy systems, and geologic carbon storage require fast and reliable methods to account for complex, multiphysical processes in heterogeneous fractured and porous media. Although reservoir simulation is considered the industry standard for simulating these subsurface systems with injection and/or extraction operations, reservoir simulation requires spatio-temporal “Big Data” into the simulation model, which is typically a major challenge during model development and computational phase. In this work, we developed and applied various deep neural network-based approaches to (1) process multiscale image segmentation, (2) generate ensemble members of drainage networks, flow channels, and porous media using deep convolutional generative adversarial network, (3) construct multiple hybrid neural networks such as convolutional LSTM and convolutional neural network-LSTM to develop fast and accurate reduced order models for shale gas extraction, and (4) physics-informed neural network and deep Q-learning for flow and energy production. We hypothesized that physicsbased machine learning/deep learning can overcome the shortcomings of traditional machine learning methods where data-driven models have faltered beyond the data and physical conditions used for training and validation. We improved and developed novel approaches to demonstrate that physics-based ML can allow us to incorporate physical constraints (e.g., scientific domain knowledge) into ML framework. Outcomes of this project will be readily applicable for many energy and national security problems that are particularly defined by multiscale features and network systems.

58 GEOSCIENCES↗

DOE OSTI2023

Deep learning methods for drug response prediction in cancer: Predominant and emerging trends

Cancer claims millions of lives yearly worldwide. While many therapies have been made available in recent years, by in large cancer remains unsolved. Exploiting computational predictive models to study and treat cancer holds great promise in improving drug development and personalized design of treatment plans, ultimately suppressing tumors, alleviating suffering, and prolonging lives of patients. A wave of recent papers demonstrates promising results in predicting cancer response to drug treatments while utilizing deep learning methods. These papers investigate diverse data representations, neural network architectures, learning methodologies, and evaluations schemes. However, deciphering promising predominant and emerging trends is difficult due to the variety of explored methods and lack of standardized framework for comparing drug response prediction models. To obtain a comprehensive landscape of deep learning methods, we conducted an extensive search and analysis of deep learning models that predict the response to single drug treatments. A total of 61 deep learning-based models have been curated, and summary plots were generated. Based on the analysis, observable patterns and prevalence of methods have been revealed. This review allows to better understand the current state of the field and identify major challenges and promising solution paths.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1999

Diurnal Forcing of Planetary Atmospheres

This project investigated and developed models which will assist in developing an understanding of the diurnal forcings in the atmospheres of Mars, Venus, Earth and Jupiter. The differences in the temperatures during the day, and night, generate very deep diurnal boundary layers and strong slope-related winds. A general circulation model (GCM) was adapted for computation of Martian atmospheric dynamics, to simulate the global transport of these atmospheric tracers. The model was applied to the study of the Martian seasonal water cycle. The principles have been applied to venus. The region of study is the upper cloud level, and above rather than the area close to the surface. The model was also applied in efforts to study the evolution of volcanic clouds in the Earth's stratosphere. In particular this was used to model the dispersion of sulfuric acid particles in the atmosphere. A brief study of the application of the tidal theory to the planet Jupiter has been undertaken. The goal of the study is to deduce the source of the tidal dissipation which is thought to have led to the orbital resonances amongst the Galilean satellites and considerable heating of the interiors of Io, Europa, and Ganymede.

Houben, Howard C.↗

NASA NTRS2022

A Dynamo Simulation Generating Saturn-Like Small Magnetic Dipole Tilts

Abstract Among planetary dynamos, the magnetic field of Saturn stands out in its exceptional level of axisymmetry. One of its peculiar features is that the magnetic dipole mode is tilted with respect to the planetary rotation axis by only ≈0.007° or less. Numerical dynamo simulations performed in this context have had great difficulty in producing such small dipole tilt angles without introducing ad hoc ingredients such as a latitudinally varying heat flux pattern in the outer layers or stably stratified layers (SSLs). Here we present a numerical dynamo simulation that generates a highly axisymmetric dynamo with a dipole tilt of about ≈0.0008° on average. The model consists of a deep dynamo layer and an overlying low-conductivity layer but without any SSLs. We highlight a novel mechanism where strong differential rotation generated in the atmospheric layer penetrates into the dynamo region, helping to maintain a very small magnetic dipole tilt. Plain Language Summary Saturn's dipole-dominant magnetic field exhibits a very peculiar feature: the dipole component of the planetary magnetic field is tilted by less than ≈0.007° with respect to the planetary spin axis. Numerical simulations performed in this context suggest that if a spatial heat-flux variation is imposed, along with a stably stratified region, on top of an active dynamo layer, then small dipole tilt values can be realized. Here we present a model where extremely small dipole tilt values can be achieved without these ad hoc ingredients. Our simulations demonstrate that dynamo theory allows extremely small dipole tilt values in a relatively simple model configuration.

Rakesh Kumar Yadav↗