Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Impurity gas detection for SNF canisters using probabilistic deep learning and acoustic sensing *

Abstract Monitoring impurity gases in spent nuclear fuel (SNF) canisters is a novel structural health monitoring approach for SNF in dry storage. The SNF canisters are sealed containers that do not facilitate visual access to the inside. Acoustic sensing can be deployed by taking advantage of the pathways unobstructed by internal hardware. Although the ultrasonic time-of-flight measurement can provide valuable information, it is limited in its ability to discern the concentration of only one impurity gas. As such, deep learning algorithms, particularly convolutional neural networks (CNNs), offer a promising solution. In this study, CNN-based probabilistic deep learning models were implemented to detect and quantify multiple impurity gases in helium. An experimental platform was established to simulate canister conditions, and ultrasonic test data were collected. The presence of argon and air in helium at concentrations ranging from 0% to 1.2% at increments of 0.05% was considered. The multi-layer perceptron, decision tree, and logistic regression classifiers achieved high accuracies when distinguishing pure helium from helium with impurities. CNN with dropout layers and CNN using maximum likelihood estimation showed a similar performance, indicating their ability to capture uncertainties. The ensemble CNN model exhibited improved predictions and the ability to balance individual gas concentration by integrating 1D- and 2D-CNN models. These findings contribute probabilistic deep learning solutions for impurity gas detection and analysis within SNF canisters, thus ensuring safe storage and management of SNFs.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset

The BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset adds node-level energy consumption data from watt-meters to the primary sweep of the BUTTER - Empirical Deep Learning Dataset. This dataset contains energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network "shapes", and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects. BUTTER-E is intended to be joined with the BUTTER dataset (see "BUTTER - Empirical Deep Learning Dataset on OEDI" resource below) which characterizes the performance of 483k distinct fully connected neural networks but does not include energy measurements.

Array↗
DOE OSTI2015

SPRUCE Deep Peat Heating (DPH) Environmental Data, February 2014 through July 2015

This data set provides a record of the half-hourly automated environmental data collected for 14 SPRUCE plots (4, 5, 6, 7, 8, 10, 11, 13, 14, 16, 17, 19, 20, and 21) during the Deep Peat Heating (DPH) study. In June 2014, deep soil heating was initiated at 5 warming levels (+0, +2.25, +4.5, +6.75 and +9 °C) with 2 replicate plots per level. Measurements were underway before the initiation of heating treatments and continued through July 27 of 2015 at the transition to whole-ecosystem warming manipulations. The DPH study was undertaken to evaluate possible rapid responses of deep peat carbon (C) stocks, microbial communities, and biogeochemical cycling processes to unprecedented temperatures. Warming levels at depth were achieved over a 25 (+ 2.25 °C) to 60-day (+9 °C) period depending on the target treatment temperatures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Physics-guided Deep Learning for Power System State Estimation

In the past decade, dramatic progress has been made in the field of machine learning. This paper explores the possibility of applying deep learning in power system state estimation. Traditionally, physics-based models are used including weighted least square (WLS) or weighted least absolute value (WLAV). These models typically consider a single snapshot of the system without capturing temporal correlations of system states. In this paper, a physics-guided deep learning (PGDL) method is proposed. Specifically, inspired by autoencoders, deep neural networks (DNNs) are used to learn the temporal correlations. The estimated system states from DNNs are then checked against physics laws by running through a set of power flow equations. Hence, the proposed PGDL is both data-driven and physics-guided. The accuracy and robustness of the proposed PGDL method are compared with traditional methods in standard IEEE cases. Simulations show promising results and the applicability is further discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2024

Growth Rate of Deep Convective System Cloud Shields: Satellite Observations and Km-Scale Radiative Convective Equilibrium Simulations

Deep convection gives rise to large upper level clouds that strongly interact with radiation and are important to the climate energy budget. From an object-oriented perspective, these individual deep cloud systems are characterized by a well depicted cloud shield life cycle, starting with small cloud extents that grow at varying rates before decaying and vanishing. A simple formulation of the growth rate of the cloud shield has been proposed that links together the growth rate on the convective part of the cloud, the mass flux of both the convective and stratiform parts of the cluster and a simple removal sink term (Elsaesser et al., 2022). In this presentation we first show using a suite of satellite observations (infrared from geostationary satellites, GPM radar, etc.) that the functional form of the proposed equation is well suited to quantify the shield growth rate. We then focus on RCE simulations, with deep cloud system objects post processed, to explore the relative role of each term of the growth rate budget. Three different models are used in the same RCEMIP-like configurations. The results show that the budget equation works very well for each model, although the time constants require model-dependent adjustments. We will further show in Vienna the commonalities and the specificities of each model.

Deep convection↗
DOE OSTI2017

Van Allen Probes Measurements of Energetic Particle Deep Penetration Into the Low L Region (L < 4) During the Storm on 8 April 2016

In this paper, using measurements from the Van Allen Probes, a penetration event of tens to hundreds of keV electrons and tens of keV protons into the low L shells (L < 4) is studied. Timing and magnetic local time (MLT) differences of energetic particle deep penetration are unveiled and underlying physical processes are examined. During this event, both proton and electron penetrations are MLT asymmetric. The observed MLT difference of proton penetration is consistent with convection of plasma sheet protons, suggesting enhanced convection during geomagnetic active times to be the cause of energetic proton deep penetration during this event. The observed MLT difference of tens to hundreds of keV electron penetration is completely different from tens of keV protons and cannot be well explained by inward radial diffusion, convection of plasma sheet electrons, or transport of trapped electrons by enhanced convection electric field represented by the Volland-Stern model or a uniform dawn-dusk electric field model based on the electric field measurements. Finally, it suggests that the underlying physical mechanism responsible for energetic electron deep penetration, which is very important for fully understanding energetic electron dynamics in the low L shells, should be MLT localized.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Deep neural networks (DNNs) are empirically derived systems that have transformed traditional research methods, and are driving scientific discovery. Here, artificial electromagnetic materials (AEMs)—including electromagnetic metamaterials, photonic crystals, and plasmonics—are research fields where DNN results valorize the data driven approach; especially in cases where conventional methods have failed. In view of the great potential of deep learning for the future of artificial electromagnetic materials research, the status of the field with a focus on recent advances, key limitations, and future directions is reviewed. Strategies, guidance, evaluation, and limits of using deep networks for both forward and inverse AEM problems are presented.

14 SOLAR ENERGY↗
DOE OSTI2023

Stabilizing the Deep Sodiation Process in Layered Sodium Manganese Cathodes by Anchoring Boron Ions

Advanced high-energy-density sodium-ion batteries (SIBs) are inseparable from cathode materials with high specific capacities. Layered manganese-rich oxides (Na x MnO 2 , 0.6 ≤ x ≤1) are promising cathode materials owing to their ease of intercalation and extraction of a considerable amount of sodium ions. However, lattice interactions, especially electrostatic repulsive forces and anisotropic stresses, are usually caused by deep desodiatin/sodiation process, resulting in intragranular cracks and capacity degradation in SIBs. Here, boron ions are introduced into the layered structure to build up B-O-Mn bonds. Further, the regulated electronic structure in Na 0.637 B 0.038 MnO 2 (B-NMO) materials inhibits the deformation of MnO 6 octahedra, which finally achieves a gentle structural transition during the deep sodiation process. B-NMO electrode exhibits a high capacity (141 mAh g –1 ) at 1 C with a capacity retention of 81% after 100 cycles. Therefore, anchoring boron to manganese-rich materials inhibits the detrimental structural evolution of deep sodiation and can be used to obtain excellent cathode materials for SIBs.

25 ENERGY STORAGE↗
DOE OSTI2026

Unlocking plant-microbial interactions in deep Mollisols in the Midwestern US: Linking depth gradients in roots, microbial activity, and soil carbon in agroecosystems

Deep-rooted plants may build soil carbon (C) stocks, but most research has focused on shallow soils, leaving gaps in our understanding of how shifts in the balance between decomposition and C inputs drive soil C accumulation with depth. Thus, our objectives were to: (1) link depth gradients in root biomass with microbial activity and soil C stocks down to 1 m, and (2) examine the potential of simple C inputs to prime soil C across depths. To this end, we dug 5 quantitative soil pits in Argiudolls under mature perennial miscanthus plots in the SoyFACE Farm (Champaign-Urbana, IL). We added 13 C labeled glucose to our soils to determine the fate of simple C inputs with depth. We found that fine root biomass, total soil C, mineral-associated organic C (MAOC), particulate organic C (POC), and microbial activity (as measured by potential enzyme activity) declined with depth. POC declined more rapidly than MAOC, resulting in an increase in the ratio of MAOC-to-POC. Root biomass, enzyme activity (either acid phosphatase or n-acetyl-glucosaminadase) activity, and microbial respiration explained 74% and 38% of the variability in soil total C and MAOC, respectively, while POC was dependent on root biomass and microbial respiration (47%). Although the incorporation of simple 13 C inputs into MAOC was similar across depths, these inputs led to greater net MAOC losses in shallow soils than in deeper soils between 50 and 100 cm. The divergent impact of simple C inputs across depths may suggest that MAOC in shallow soils is more susceptible to priming losses, while C inputs into deep soils may instead be more persistent. Collectively, our results suggest that depth gradients in soil C stocks represents a balance between inputs, decomposition, and microbial necromass production and that increases in root C inputs by deep-rooted plants may have the potential to build stable MAOC.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗
DOE OSTI2026

Deep learning for time series forecasting: a survey of recent advances

Time series forecasting plays a critical role in numerous real-world applications, such as finance, healthcare, transportation, and scientific computing. In recent years, deep learning has become a powerful tool for modeling complex temporal patterns and improving forecasting accuracy. This survey provides an overview of recent deep learning approaches for time series forecasting, involving various architectures including RNNs, CNNs, GNNs, transformers, large language models, MLP-based models, and diffusion models. We first identify key challenges in the field, such as temporal dependency, efficiency, and cross-variable dependency, which drive the development of forecasting techniques. Then, the general advantages and limitations of each architecture are discussed to contextualize their adaptation in time series forecasting. Furthermore, we highlight promising design trends like multi-scale modeling, decomposition, and frequency-domain techniques, which are shaping the future of the field. This paper serves as a compact reference for researchers and practitioners seeking to understand the current landscape and future trajectory of deep learning in time series forecasting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Seismic signal augmentation to improve generalization of deep neural networks

Deep learning has emerged as an effective approach for seismic data processing in general, and for earthquake monitoring in particular. The ability of deep learning models to generalize beyond the training and validation data is important for comprehensive earthquake monitoring; this ability furthermore depends on the availability of a sufficiently large and complete training dataset. However, this requirement can prove challenging to meet due to significant effort and time for data collection and labeling. Data augmentation provides an efficient and effective approach for increasing the dimension of training samples and improving generalization to unseen samples. In this paper, we present augmentation methods appropriate for seismic waveforms and demonstrate their ability to reduce bias and increase performance. Furthermore, these augmentation methods can be applied to a wide range of deep learning applications designed for seismic data.

58 GEOSCIENCES↗
DOE OSTI2023

Harness the power of atomistic modeling and deep learning in biofuel separation

Biofuels offer a remarkable, sustainable energy source for a future of clean energy. The development of efficient biofuel separation plays a crucial role in achieving cost-effective utilization of biofuel. In this chapter, we provide an overview of the recent advancements in atomistic-level modeling and deep learning in the rational design of novel, efficient biofuel separation. The fundamental principles of quantum and statistical mechanics are covered in appropriate detail to highlight their underlying differences in theory. The methodologies of several molecular representations and deep learning algorithms applicable to biofuel separation are briefly demonstrated as well. The applications, successes, and risks of employing density functional theory, ab initio molecular dynamics, classical molecular dynamics, and deep learning are provided to showcase their recent accomplishments in biofuel separation as well as potential improvements in both methodology and application. Lastly, a vision for the future growth of these methods is illustrated.

deep learning, artificial intelligence, biofuels, ↗
DOE OSTI2020

Building thermal load prediction through shallow machine learning and deep learning

Building thermal load prediction informs the optimization of cooling plant and thermal energy storage. Physics-based prediction models of building thermal load are constrained by the model and input complexity. In this study, we developed 12 data-driven models (7 shallow learning, 2 deep learning, and 3 heuristic methods) to predict building thermal load and compared shallow machine learning and deep learning. The 12 prediction models were compared with the measured cooling demand. It was found XGBoost (Extreme Gradient Boost) and LSTM (Long Short Term Memory) provided the most accurate load prediction in the shallow and deep learning category, and both outperformed the best baseline model, which uses the previous day's data for prediction. Then, we discussed how the prediction horizon and input uncertainty would influence the load prediction accuracy. Major conclusions are twofold: first, LSTM performs well in short-term prediction (1 h ahead) but not in long term prediction (24 h ahead), because the sequential information becomes less relevant and accordingly not so useful when the prediction horizon is long. Second, the presence of weather forecast uncertainty deteriorates XGBoost's accuracy and favors LSTM, because the sequential information makes the model more robust to input uncertainty. Training the model with the uncertain rather than accurate weather data could enhance the model's robustness. Finally, our findings have two implications for practice. First, LSTM is recommended for short-term load prediction given that weather forecast uncertainty is unavoidable. Second, XGBoost is recommended for long term prediction, and the model should be trained with the presence of input uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Inverse design of hypoeutectoid pearlite steel microstructures using a deep learning and genetic algorithm optimization framework

Goal-oriented microstructure design in metallic materials is a challenging task due to complex structure-property relationships. Traditional experimental and computational approaches are time-intensive and economically inefficient, limiting their applicability for large-scale design space exploration. Here, in this work, we propose an end-to-end framework that integrates deep learning models with genetic optimization to design microstructures with targeted mechanical properties. Deep learning models enable accurate forward design, while their integration with genetic optimization enables efficient inverse design within a few hours, compared to days or weeks using conventional finite element simulations. The framework combines experimental characterization and finite element modeling to analyze the influence of microstructural features on the mechanical behavior of hypoeutectoid steels. Data from both experiments and simulations are used to train the deep learning models. To demonstrate its effectiveness, we apply the framework to 0.63% carbon steel with proeutectoid ferrite and pearlite phases, commonly used in industrial applications. In this study, 2D microstructures were used for modeling, selected primarily for computational efficiency and to establish proof of concept. The framework successfully optimizes microstructures for targeted yield strength, ultimate strength, and stress concentration factors while significantly reducing computational time. Beyond hypoeutectoid steels, this scalable framework can be extended to other material systems and integrated with additive manufacturing, offering an efficient approach for accelerating microstructure design for specific engineering applications.

ConvLSTM↗
DOE OSTI2021

Deep reinforcement learning control of hydraulic fracturing

Hydraulic fracturing is a technique to extract oil and gas from shale formations, and obtaining a uniform proppant concentration along the fracture is key to its productivity. Recently, various model predictive control schemes have been proposed to achieve this objective. But such controllers require an accurate and computationally efficient model which is difficult to obtain given the complexity of the process and uncertainties in the rock formation properties. In this article, we design a model-free data-based reinforcement learning controller which learns an optimal control policy through interactions with the process. Deep reinforcement learning (DRL) controller is based on the Deep Deterministic Policy Gradient algorithm that combines Deep-Q-network with actor-critic framework. In addition, we utilize dimensionality reduction and transfer learning to quicken the learning process. We show that the controller learns an optimal policy to obtain uniform proppant concentration despite the complex nature of the process while satisfying various input constraints.

42 ENGINEERING↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Deep learning–based digital twins for heat pumps

Heat pumps are effective cooling and heating appliances to save energy in buildings. However, traditional heat pump models are challenging to integrate with building demands in a co-simulation environment because of the nonlinear thermodynamics of refrigerants. Developing digital twin representatives for heat pumps capable of faster calculations with good accuracy is desirable. This study aimed to establish a generic deep learning–based digital twin for heat pumps with a large amount of high-fidelity data. Two refrigerants for two different heat pumps were considered: an air source heat pump with refrigerant R-410A, an air source heat pump with refrigerant CO 2 , a water source heat pump with refrigerant R-410A, and a water source heat pump with refrigerant CO 2 . Furthermore, results showed that the deep learning (long short-term memory) models effectively represented these four heat pumps as a digital twin: (a) accuracy for training and testing showed smaller than 0.02 for heating electricity and heating demands, and (b) the digital twins showed good consistency with original data for heating electricity and heating demands (root mean square errors of less than 0.12 W and 0.19 W, respectively). Therefore, deep learning–based heat pump models can be used in the co-simulation of building mechanical systems.

Air source heat pump↗