Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗
DOE OSTI2023

Construction of deep-learning based WWBs parameterization for ENSO prediction

Westerly wind bursts (WWBs) significantly impact the occurrence and development of the El Niño-Southern Oscillation (ENSO). Current dynamical models, however, face significant challenges in representing WWBs. In this study, deep learning techniques were used to develop a new parameterization scheme for WWBs and further compared against two widely used schemes. Further, the results show that the scheme developed in this study has greater capability than previous schemes in reproducing WWBs characteristics, particularly in terms of occurrence probability, location, and duration. This improvement was mainly reflected in El Niño years, especially in strong events when the deep-learning-based scheme much realistically captures the location and strength of WWBs. It is expected that the new parameterization scheme will further improve ENSO prediction in dynamical models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

GMT: A deep learning approach to generalized multivariate translation for scientific data analysis and visualization

In scientific visualization, despite the significant advances of deep learning for data generation, researchers have not thoroughly investigated the issue of data translation. We present a new deep learning approach called generalized multivariate translation (GMT) for multivariate time-varying data analysis and visualization. Like V2V, GMT assumes a preprocessing step that selects suitable variables for translation. However, unlike V2V, which only handles one-to-one variable translation during training and inference, GMT enables one-to-many and many-to-many variable translation in the same framework. We leverage the recent StarGAN design from multi-domain image-to-image translation to achieve this generalization capability. We experiment with different loss functions and injection strategies to explore the best choices and leverage pre-training for performance improvement. We compare GMT with other state-of-the-art methods (i.e., Pix2Pix, V2V, StarGAN). Furthermore, the results demonstrate the overall advantage of GMT in translation quality and generalization ability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Deep eutectic solvent approach towards nickel/nickel nitride nanocomposites

Nickel nitride is an attractive material for a broad range of applications including catalysis. However preparations and especially those targeting nanoscale particles remain a major challenge. Herein, we report a wet-chemical approach to produce nickel/nickel nitride nanocomposites using deep eutectic solvents. A choline chloride/urea deep eutectic solvent was used as a reaction medium to form gels containing nickel acetate tetrahydrate. Heat treatment of the gel in inert atmosphere forms nanoparticles embedded within a nitrogen-doped carbon matrix. Thermogravimetric analysis (TGA) and differential thermal analysis (DTA) were used to understand the decomposition profile of the precursors and to select pyrolysis temperatures located in regions of thermal stability. X-ray diffraction (XRD) confirmed the presence of metallic nickel, whereas X-ray photoelectron spectroscopy (XPS) suggested the existence of a nickel nitride surface layer. According to transmission electron microscopy (TEM) analysis these mixed phase, possibly core-shell type nanoparticles, have very defined facets. Furthermore, these materials represent a unique opportunity to tune catalytic properties of nickel-based catalysts through control of their composition, surface structure, and morphology; in addition to employing potential benefits of a nitrogen-doped carbon support.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Synergistic effect of dual Brønsted acidic deep eutectic solvents for oxidative desulfurization of diesel fuel

Deep eutectic solvents (DESs) are generally used as attractive solvents or extractants rather than catalysts in the field of synthesis and separation. Herein, dual Brønsted acidic DESs were prepared by mixing sulfonated quaternary ammonium and oxalic acid as extractants and catalysts for deep oxidative desulfurization. Compared to the DESs with single acidic group, the dual acidic DESs exhibited much higher catalytic activity likely due to the synergistic effect. The 1 H NMR study indicated that the weak interaction between DES and sulfur compounds led to a low extraction capacity. However, the sulfur removal could reach 97.7% under optimized reaction conditions. Density functional theory (DFT) calculations demonstrated that sulfonic group and carboxylic group are of equal importance to desulfurization performance. Further, the desulfurization efficiency was also strongly affected by the viscosity of DESs. Here, we put forward a new strategy that the reaction time could be sharply shortened to 40 min and 100 min by adding low viscous acetonitrile and polyethylene glycol into DES to form mixing reaction system, respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

GRIDS-Net: Inverse shape design and identification of scatterers via geometric regularization and physics-embedded deep learning

This study presents a deep learning based methodology for both remote sensing and design of acoustic scatterers. The ability to determine the shape of a scatterer, either in the context of material design or sensing, plays a critical role in many practical engineering problems. This class of inverse problems is extremely challenging due to their high-dimensional, nonlinear, and ill-posed nature. To overcome these technical hurdles, we introduce a geometric regularization approach for deep neural networks (DNN) based on non-uniform rational B-splines (NURBS) and capable of predicting complex 2D scatterer geometries in a parsimonious dimensional representation. Then, this geometric regularization is combined with physics-embedded learning and integrated within a robust convolutional autoencoder (CAE) architecture to accurately predict the shape of 2D scatterers in the context of identification and inverse design problems. Further, an extensive numerical study is presented in order to showcase the remarkable ability of this approach to handle complex scatterer geometries while generating physically-consistent acoustic fields. The study also assesses and contrasts the role played by the (weakly) embedded physics in the convergence of the DNN predictions to a physically consistent inverse design.

42 ENGINEERING↗
DOE OSTI2025

An end-to-end deep learning method for solving nonlocal Allen–Cahn and Cahn–Hilliard phase-field models

Here, we propose an efficient end-to-end deep learning method for solving nonlocal Allen–Cahn (AC) and Cahn–Hilliard (CH) phase-field models. One motivation for this effort emanates from the fact that discretized partial differential equation-based AC or CH phase-field models result in diffuse interfaces between phases, with the only recourse for remediation is to severely refine the spatial grids in the vicinity of the true moving sharp interface whose width is determined by a grid-independent parameter that is substantially larger than the local grid size. In this work, we introduce non-mass conserving nonlocal AC or CH phase-field models with regular, logarithmic, or obstacle double-well potentials. Because of non-locality, some of these models feature totally sharp interfaces separating phases. The discretization of such models can lead to a transition between phases whose width is only a single grid cell wide. Another motivation is to use deep learning approaches to ameliorate the otherwise high cost of solving discretized nonlocal phase-field models. To this end, loss functions of the customized neural networks are defined using the residual of the fully discrete approximations of the AC or CH models, which results from applying a Fourier collocation method and a temporal semi-implicit approximation. To address the long-range interactions in the models, we tailor the architecture of the neural network by incorporating a nonlocal kernel as an input channel to the neural network model. We then provide the results of extensive computational experiments to illustrate the accuracy, predictive capabilities, and cost reductions of the proposed method.

42 ENGINEERING↗
DOE OSTI2021

Multi defect detection and analysis of electron microscopy images with deep learning

Electron microscopy is widely used to explore defects in crystal structures, but human detecting of defects is often time-consuming, error-prone, and unreliable, and is not scalable to large numbers of images or real-time analysis. In this work, we discuss the application of machine learning approaches to find the location and geometry of different defect clusters in irradiated steels. We show that a deep learning based Faster R-CNN analysis system has a performance comparable to human analysis with relatively small training data sets. Furthermore, this study proves the promising ability to apply deep learning to assist the development of automated microscopy data analysis even when multiple features are present and paves the way for fast, scalable, and reliable analysis systems for massive amounts of modern electron microscopy data.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Geometry-aware framework for deep energy method: An application to structural mechanics with hyperelastic materials

Here, in this work, we introduce a novel physics-informed framework named the Geometry-Aware Deep Energy Method (GADEM) for solving structural mechanics problems on different geometries. As the weak form of the physical system equation (or the energy-based approach) has demonstrated clear advantages compared to the strong form for solving solid mechanics problems, GADEM employs the weak form and aims to infer the solution on multiple shapes of geometries. Integrating a geometry-aware framework into an energy-based method results in an effective physics-informed deep learning model in terms of accuracy and computational cost. Different ways to represent the geometric information and to encode the geometric latent vectors are investigated in this work. We introduce a loss function of GADEM which is minimized based on the potential energy of all considered geometries. An adaptive learning method is also employed for the sampling of collocation points to enhance the performance of GADEM. We present some applications of GADEM to solve solid mechanics problems, including a loading simulation of a toy tire involving contact mechanics and large deformation hyperelasticity. The numerical results of this work demonstrate the remarkable capability of GADEM to infer the solution on various and new shapes of geometries using only one trained model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Patterns in extracellular enzyme activity and microbial diversity in deep-sea Mediterranean sediments

Deep-sea sediments are populated by diverse microbial communities that derive their nutritional requirements from the degradation of organic matter. Extracellular hydrolytic enzymes play a key role in the survival of microbes by enabling them to access and degrade complex organic compounds that are found in seafloor sediments. Despite their importance, extracellular enzymatic activity is poorly characterized at water depths greater than a few hundred meters where physical properties, such as pressure and temperature, create a unique environment for influencing enzyme behavior. In this work, we investigated microbial communities and enzyme activities in surface sediment collected at four sampling stations in the central Mediterranean Sea at water depths ranging from 800 to 2200 m. Fluorometric assays revealed that extracellular hydrolytic activity varied according to substrate type and water depth which suggests that the distributions of these enzymes within this basin are not homogenous. Furthermore, enzyme activities indicated substantial demand for phosphomonoesters and proteins, with measurable but much lower demand for polysaccharides. Barcoded amplicon sequencing of bacterial and archaeal SSU genes revealed that microbial communities varied across sampling stations and some groups displayed water-depth related trends. Our results demonstrate that heterotrophic capabilities of microbes in deep-sea Mediterranean sediments can differ substantially even within the same region.

16S rRNA↗
DOE OSTI2024

Impact of carbon dioxide removal technologies on deep decarbonization: EMF37 MARKAL–NETL modeling results

Here this paper examines the MARKAL-NETL modeling results for the Energy Modeling Forum Study on Deep Decarbonization & High Electrification Scenarios for North America (EMF 37) with specific focus on carbon dioxide removal (CDR) technologies and opportunities under different scenarios guidelines, policies, and technological advancements. The results demonstrate that CDR, such as, bioenergy with carbon capture and storage (BECCS), direct air capture (DAC) and afforestation are key negative emission technologies in deep decarbonization scenarios in the U.S. are accounted for about 70% of annually avoided carbon dioxide emissions (CO 2 ) by 2050, or more than 2 billion tons of CO 2 (GtCO 2 ). The potential scale of CDR and its impact on the energy system depends on energy supply and demand technologies advancement and their costs, the level of end-use sectors electrification, availability and costs of CDR. Results show that the carbon prices are substantially lower if the advanced technologies available, particularly, in carbon management scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Preliminary results in using Deep Learning to emulate BLOB, a nuclear interaction model

Purpose: A reliable model to simulate nuclear interactions is fundamental for Ion-therapy. We already showed how BLOB (“Boltzmann-Langevin One Body”), a model developed to simulate heavy ion interactions up to few hundreds of MeV/u, could simulate also 12 C reactions in the same energy domain. However, its computation time is too long for any medical application. For this reason we present the possibility of emulating it with a Deep Learning algorithm. Methods: The BLOB final state is a Probability Density Function (PDF) of finding a nucleon in a position of the phase space. We discretised this PDF and trained a Variational Auto-Encoder (VAE) to reproduce such a discrete PDF. As a proof of concept, we developed and trained a VAE to emulate BLOB in simulating the interactions of 12 C with 12 C at 62 MeV/u. To have more control on the generation, we forced the VAE latent space to be organised with respect to the impact parameter (b) training a classifier of b jointly with the VAE. Results: In this work, the distributions obtained from the VAE are similar to the input ones and the computation time needed to use the VAE as a generator is negligible. Conclusions: We show that it is possible to use a Deep Learning approach to emulate a model developed to simulate nuclear reactions in the energy range of interest for Ion-therapy. We foresee the implementation of the generation part in C++ and to interface it with the most used Monte Carlo toolkit: Geant4.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2022

Investigating preservation of stable isotope ratios in subfossil deep-sea proteinaceous coral skeletons as paleo-recorders of biogeochemical information over multimillennial timescales

Paleoproxy records in deep-sea proteinaceous coral skeletons can reconstruct past ocean conditions on centennial to millennial time scales. Commonly recovered subfossil specimens could potentially extend these archives through the Holocene. However, protein matrix stability and integrity of stable isotope proxies over multi-millennial timescales in such specimens have never been examined. Here we compare amino acid (AA) composition together with bulk and AA compound-specific carbon (δ 13 C) and nitrogen (δ 15 N) isotopes in live-collected and subfossil (~9.6–11.6 kyrs BP) Kulamanamana haumeaae deep-sea coral specimens from the central Pacific to understand the effects of long-duration benthic oxic exposure on primary coral chemistry. We find large coupled shifts in bulk δ 15 N (~7‰) and δ 13 C (~2‰) in the outermost portion (0–10 mm) of the subfossil coral, coincident with extensive alteration of the protein matrix. Microstructural changes in skeletal texture coincide with higher C/N ratios (+0.8) and isotope-based amino acid degradation parameters (e.g. ΣV ≥ 3), indicating extensive degradation of seawater-exposed gorgonin. However, interior gorgonin (>10 mm) retained amino acid molecular compositions (with exception of major Glycine loss) and bulk and amino acid-specific isotopic values that were similar to live-collected specimens. These results indicate that compound-specific isotope analysis of amino acids can reconstruct paleo-oceanographic biogeochemical and ecosystem information in subfossil corals beyond a clear diagenetic horizon, which is easily identifiable from an evaluation of C/N ratios together with the ΣV degradation proxy.

58 GEOSCIENCES↗
DOE OSTI2025

Experimental investigation of flow distribution in enhanced geothermal systems with deep eutectic solvent

Geothermal energy has been recognized as a valuable alternative to fossil fuels and nuclear power, as it is renewable and reliable. Enhanced Geothermal Systems (EGSs) have the potential to expand geothermal energy production by enabling access to previously untapped geothermal resources. Geothermal short-circuiting poses a significant challenge to EGS development, leading to reduced heat extraction. Deep Eutectic Solvent (DES) exhibits favorable thermal and rheological properties, making it a candidate for geothermal applications. Here, this paper examines Choline Chloride-Based Deep Eutectic Solvent (DES) as a working fluid in geothermal applications and its potential to mitigate geothermal short-circuiting. Hydraulic experiments using a dual fracture flow loop were conducted at high temperatures. The results showed that DES exhibited higher differential pressure behavior compared to water. Flow distribution results revealed that DES enhances flow allocation within the small fracture, particularly when a temperature difference exists between fractures. Specifically, DES increased flow distribution by an average of 11% when the temperature difference was 85°C, and by 13% when the difference was 45°C, relative to water. These findings suggest that DES responds to thermal fracture differences, making it a potential remedy to address geothermal short-circuiting.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗
DOE OSTI2025

Deep-learning-enhanced assessment of wellbore barrier effectiveness in geologic storage systems with intermediate aquifers

For geologic systems where carbon dioxide (CO 2 ) is injected underground, existing wells represent potential pathways for fluid migration. Here, this study introduces a novel deep learning model to quantify the likelihood and potential magnitude of fluid migration through wellbores at sites with intermediate aquifers or thief zones between the injection units and underground drinking water sources. Synthetic datasets, generated using reservoir simulations, captured a wide range of subsurface conditions, well attributes, operational parameters, and fluid migration scenarios. Among the regression models developed to predict brine and CO 2 leakage rates and CO 2 saturations along leaky wellbores, convolutional neural network (CNN) outperformed both Light Gradient Boosting Machine and deep neural network. Additionally, a CNN-based classification model was created to predict whether brine and CO 2 would leak along a wellbore, further improving performance over regression alone. The best models were integrated into the National Risk Assessment Partnership Open-source Integrated Assessment Model for rapid, stochastic assessment of storage system containment and leakage risks. A case study demonstrated the model’s ability to simulate fluid migration through existing wells with multiple intermediate aquifers. This computationally efficient wellbore model offers value in support of site performance evaluation and risk-informed decision making by stakeholders.

CO2 leakage↗
DOE OSTI2020

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗