Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods

Deep-learning-driven simulations of boundary layer clouds over the Southern Great Plains

Abstract. Based on long-term observations at the Southern Great Plains site by the Atmospheric Radiation Measurement (ARM) program for training and validation, a deep-learning model is developed to simulate the daytime evolution of boundary layer clouds (BLCs) from the perspective of land–atmosphere coupling. The model takes ARM measurements (including early-morning soundings and diurnally varying surface meteorological conditions and heat fluxes) as inputs and predicts hourly estimates (including cloud occurrence, the positions of cloud boundaries, and the vertical profile of the cloud fraction) as outputs. The deep-learning model offers good agreement with the observed cloud fields, especially in the accuracy with which cloud occurrence and base height are reproduced. When the inputs are substituted by reanalysis data from ERA5 and MERRA-2, the outputs of the deep-learning model provide a better agreement with observation than the cloud fields extracted from ERA5 and MERRA-2 themselves. Thus, the deep-learning model shows great potential to serve as a diagnostic tool for the performance of physics-based models in simulating stratiform and cumulus clouds. By quantifying biases in clouds and attributing them to the simulated atmospheric state variables versus the model-parameterized cloud processes, this observation-based deep-learning model may offer insights into the directions needed to improve the simulation of BLCs in physics-based models for weather forecasting and climate prediction.

54 ENVIRONMENTAL SCIENCES

Improved guided-wave acoustic defect detection and localization in pipes under varying temperature conditions using deep learning

Early defect detection in pipelines is critical across industries, particularly in the oil and gas sector, where failures result in significant maintenance costs and operational disruptions. Acoustic guided-wave techniques are widely used for nondestructive evaluation of pipeline defects due to their long-distance propagation capability. However, environmental variations, sensitivity limitations, and complex signal interpretation challenges limit the effectiveness of traditional signal processing approaches with guided-wave signals. Recent advances in deep learning methods have demonstrated remarkable success in solving complex real-world problems in many fields. In particular, deep-learning-based signal processing holds substantial promise to overcome limitations and challenges of conventional signal processing. This study presents a deep learning framework for pipeline inspection using acoustic guided-wave signals under temperature varying environments. The proposed framework employs a dual-path one-dimensional convolutional autoencoder that combines defect detection, localization, and temperature prediction functions. The proposed system utilizes multi-mode and broadband acoustic waves with an optimized number of sensors that provide high accuracy while retaining practical simplicity. Experimental validation is performed on a carbon steel pipe. The results indicate exceptional defect detection accuracy and precise defect localization with a mean absolute error of 66 mm. The proposed technique also predicts the effective average temperature of the pipe with a mean absolute error of 0.2°C. Comparative analysis shows superior performance of the proposed method over a traditional method previously developed by the authors' team. These results highlight the potential of integrating deep learning methods into guided-wave pipeline inspection systems to improve reliability under varying environmental conditions.

42 ENGINEERING

A deep learning approach to fast analysis of collective Thomson scattering spectra

Fast analysis of collective Thomson scattering ion acoustic wave features using a deep convolutional neural network model is presented. The network was trained from spectra to predict the plasma parameters, including ion velocities, population fractions, and ion and electron temperatures. A fully kinetic particle-in-cell simulation was used to model a laboratory astrophysics experiment and simulate a diagnostic image of the ion acoustic wave feature. Network predictions were compared with Bayesian inference of the plasma model parameters for both the simulated and experimentally measured images. Both approaches were fairly accurate predicting the simulated image and the network predictions matched a good portion of the Bayesian results for the experimentally measured image. The Bayesian approach is more robust to noise and motivates future work to train deep learning models with realistic noise. The advantage of the deep learning model is making thousands of predictions in a few hundred milliseconds, compared to a few seconds to minutes per prediction for the optimization and Bayesian approaches presented here. The results demonstrate promising capabilities of deep learning models to analyze Thomson data orders of magnitude faster than conventional methods when using the neural network for standalone analysis. If more rigorous analysis is needed, neural network predictions can be used to quickly initialize other optimization methods and increase chances of success. This is especially useful when the dataset becomes very large or highly dimensional and manually refining initial conditions for the entire dataset are no longer tractable.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

Novel candidate taxa contribute to key metabolic processes in Fennoscandian Shield deep groundwaters

The continental deep biosphere contains a vast reservoir of microorganisms, although a large proportion of its diversity remains both uncultured and undescribed. In this study, the metabolic potential (metagenomes) and activity (metatranscriptomes) of the microbial communities in Fennoscandian Shield deep subsurface groundwaters were characterized with a focus on novel taxa. DNA sequencing generated 1270 de-replicated metagenome-assembled genomes and single-amplified genomes, containing 7 novel classes, 34 orders, and 72 families. The majority of novel taxa were affiliated with Patescibacteria, whereas among novel archaea taxa, Thermoproteota and Nanoarchaeota representatives dominated. Metatranscriptomes revealed that 30 of the 112 novel taxa at the class, order, and family levels were active in at least one investigated groundwater sample, implying that novel taxa represent a partially active but hitherto uncharacterized deep biosphere component. The novel taxa genomes coded for carbon fixation predominantly via the Wood–Ljungdahl pathway, nitrogen fixation, sulfur plus hydrogen oxidation, and fermentative pathways, including acetogenesis. These metabolic processes contributed significantly to the total community’s capacity, with up to 9.9% of fermentation, 6.4% of the Wood–Ljungdahl pathway, 6.8% of sulfur plus 8.6% of hydrogen oxidation, and energy conservation via nitrate (4.4%) and sulfate (6.0%) reduction. Key novel taxa included the UBA9089 phylum, with representatives having a prominent role in carbon fixation, nitrate and sulfate reduction, and organic and inorganic electron donor oxidation. These data provided insights into deep biosphere microbial diversity and their contribution to nutrient and energy cycling in this ecosystem.

Candidatus

Multi‐Scale Model‐Informed Deep Learning for Plasma‐Nanoparticle Interaction

The Overarching Goal of this proposed research is to understand and quantitively determine the interactions between non-thermal plasma (hot electrons, reactive radicals, vibrationally excited species) and surface reactions on influencing the activity and selectivity of the desired reactions via developing multi-scale model informed deep learning algorithm. Investigating non-thermal plasma-surface interaction is feasible due to the low bulk temperature in the discharge region. To investigate the role of plasma-nanoparticle interaction on enhancing the reaction kinetics, we will focus on ammonia cracking to generate clean hydrogen over earth-abundant, non-critical metallic nanoparticles, which is of great significance for decarbonization. We hypothesize that (1) reactive radicals interacting with surface reaction species via Eley–Rideal mechanism will significantly lower the energetics of the potential rate-limiting step of nitrogen formation; (2) the surface will be charged heterogeneously under non-thermal plasma conditions and the charged site will lower the energetics of ammonia cracking through Langmuir– Hinshelwood mechanism; (3) vibrationally excited ammonia will further promote the initial N-H bond cleavage. To access the hypothesis, we will (1) reveal the surface charge effects on tunning the reaction energetics via interpretable, physics-informed deep learning accelerated density functional theory (DFT) calculations; (2) determine the reactive radicals interacting with surface reaction species on tuning the reaction energetics via DFT; (3) reveal the surface charge effects on tunning the reaction energetics via DFT and deep learning models, (4) quantify how vibrationally excited species, reactive radicals, and surface charging effects on enhancing the catalysis via developing DFT-based microkinetic modeling (MKM) and active learning. Deep and active learning of plasma-nanoparticle interactions effects on enhancing ammonia cracking to generate hydrogen represents a new paradigm for designing high performance plasma materials. The fundamental science of how plasma-nanoparticle interactions will change the plasma kinetics and will improve the energy efficiency for decarbonization and sustainability. The interpretable and physics-informed machine learning model will accelerate low temperature plasma chemistry and material discovery with physics rules and model interpretation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Degassing fluxes in a temperate hydropower reservoir predictable by deep‐water dissolved oxygen but highly sensitive to discharge variability

Hydropower reservoirs contribute to methane (CH 4 ) and carbon dioxide (CO 2 ) emissions, like all aquatic ecosystems. Unique to hydropower reservoirs are degassing emissions that occur when deep-water intakes move water with high CH 4 and CO 2 concentrations through turbines, leading to the release of these gases. However, few studies from hydropower reservoirs have measured seasonal variability and drivers of degassing fluxes, especially in temperate systems. We measured monthly degassing emissions in temperate Douglas Reservoir (Tennessee, USA) from 2023 to 2024. We found that degassing fluxes were highest in the summertime, and deep-water CH 4 and CO 2 concentrations were predictable by deep-water dissolved oxygen (DO) concentrations. Degassing emissions accounted for 37–62% of annually estimated CH 4 emissions, outweighing ebullitive emissions during summer months. We highlight the value of using DO data to estimate deep-water CH 4 and CO 2 concentrations and degassing fluxes at higher temporal resolution to improve annualization and extrapolation of reservoir degassing emissions at broader scales.

Pilla, Rachel M. [Oak Ridge National Laboratory (O

Deep desert aquifers as an archive for Mid- to Late Pleistocene hydroclimate: An example from the southeastern Mediterranean

Many efforts have been made to illuminate the nature of past hydroclimates in semi-arid and arid regions, where current and future shifts in water availability have enormous consequences on human subsistence. Deep desert aquifers, where groundwater is stored for prolonged periods, might serve as a direct record of major paleo-recharge events. To date, groundwater-based paleoclimate reconstructions have mainly focused on a relatively narrow timescale (up to ∼40 kyr), limited by the relatively short half-life of the widely used radiocarbon (5.73 kyr). Here we demonstrate the usage of deep regional aquifers in the arid southeastern Mediterranean as a hydroclimate archive for earlier Mid-to-Late Pleistocene epochs. State-of-the-art dating tools, primarily the 81 Kr radioisotope (t 1/2 = 229 kyr), were combined with other atmosphere-derived tracers to illuminate the impact of four distinguishable wetter episodes over the past 400 kyr, with differences in climatic conditions and paleo-recharge locations. Variations in stable water isotope composition suggest moisture transport from more proximal (Mediterranean) and distal (Atlantic) sources to different parts of the region at distinct times. Large variability in the computed noble gas-based recharge temperature (NGT), ranging ~15–30 °C, cannot be explained by climate variations solely, and points to different recharge pathways, including geothermal heating in the deep unsaturated zone and recharge from high-elevation (colder) regions. The obtained groundwater record complements and enhances the interpretation of other terrestrial archives in the arid region, including a contribution of valuable information regarding the moisture source origin as reflected in the deuterium-excess values, which is unattainable from the common practice analysis of calcitic cave deposits. We conclude that similar applications in other deep (hundred-m-order) regional groundwater systems (e.g., the Sahara desert aquifers) can significantly advance our understanding of long-term (up to 1 Myr) paleo-hydroclimate in arid regions, including places where no terrestrial remnants, such as cave, lake, and spring sediments, are available.

Atom Trap Trace Analysis

Dual‐Transformer Deep Learning Framework for Seasonal Forecasting of Great Lakes Water Levels

Abstract The Great Lakes of North America form one of the largest freshwater systems on Earth, and their lake‐wide average water levels (lake levels) can fluctuate by more than 0.5 m on a seasonal scale. These fluctuations pose substantial challenges for coastal resilience, flood risk management, and navigation planning. Accurate seasonal forecasting of lake levels using traditional mechanistic models is challenging due to the complex physical mechanisms and coupled hydroclimatic processes involved. Recently, deep learning has gained prominence in geoscience applications for its ability to recognize intricate patterns within multiphysical data sets. Here, we introduce a novel Dual‐Transformer deep learning framework, tested on the Great Lakes. This architecture integrates two modified Transformer models: the Prophet, which predicts underlying trends, and the Critic, which refines the Prophet's predictions. The final lake level prediction is derived by weighting the outputs of both models through a multi‐layer perceptron, jointly trained with the Prophet and Critic to enhance overall accuracy. Our results demonstrate that the innovative learning framework achieves the highest prediction accuracy compared to established deep learning models when using identical input features. It attains a root mean square error of 4–7 cm in predicting lake levels up to 6 months in advance across the lakes. Additionally, the Dual‐Transformer model runs six orders of magnitude faster than conventional mechanistic models, producing results in less than one second on a typical personal computer. These findings suggest that our deep learning framework has strong potential to advance lake level prediction and carries important implications for water management and disaster mitigation, thereby enhancing the quality of life in coastal regions.

Chen, Yi [Great Lakes Research Center Michigan Tec

Deep Roots Supply Reactivity and Enhance Silicate Weathering in the Bedrock Vadose Zone

In upland environments, roots commonly extend deep below soil into partially saturated bedrock. This Bedrock Vadose Zone (BVZ) has been shown to store and circulate water, host organic carbon respiration and serve as a critical source of rock-derived nutrients. However, the extent to which deep roots influence chemical weathering rates remains poorly understood. Here, we report 4 years of depth-resolved major ion chemistry over a 16-m thick BVZ hosting a deep rhizosphere in a catchment subject to a Mediterranean climate. These data allow development and validation of a reactive transport model (RTM), revealing that the timescales of water storage and drainage in the BVZ are sufficient to facilitate substantial chemical weathering of the shale bedrock. However, observed solute concentrations are only reproduced by the RTM when we explicitly include measured rates of CO 2(g) production meters below soil driven by the deeply rooted forest. By combining direct observations and a process-based RTM we conclude that the carbon respiration promoted by deep roots significantly enhances chemical weathering rates in the BVZ, constituting 43% ± 3% of total solute flux from the base of the BVZ to the water table.

Osorio‐Leon, Ivan D. [University of Illinois Urban

Assessing the Effect of a Deep‐Rooted Grass on Belowground Carbon Storage in Cultivated Land: Insights From a Multi‐Site US Study

Agriculture depletes soil organic carbon (SOC), partly due to the exclusion of deep-rooted perennials. Reintroducing deep-rooted perennials to cultivated land may help to mitigate SOC loss. We quantified the effect of deep roots on SOC by comparing 8 to 30 year-old stands of switchgrass ( Panicum virgatum L .) with paired annual row crop fields at 12 sites across the central and eastern USA. We hypothesized that switchgrass would store more root C and SOC than neighboring shallow-rooted annual crops, and that these effects would extend deeper than 30 cm. We also evaluated whether switchgrass stimulates decomposition of SOC at depth using radiocarbon ( 14 C). Finally, we explored whether the effect of switchgrass on SOC is moderated by soil chemical and physical properties. While the effect of switchgrass on SOC in the surface 100 cm was positive at most sites, the average effect was not statistically significant (difference in SOC = 0.6 kg C m −2 [95% CI −0.8 to +1.9 kg C m −2 ]). By contrast, we found that root C was consistently more abundant under switchgrass, yielding an estimated additional 0.6 kg C m −2 in the surface 100 cm of soil [95% CI +0.5 to +0.7 kg C m −2 ]. 14 C measurements suggested that root C inputs were adding to existing SOC without stimulating decomposition. The effect of switchgrass on belowground C was not strongly related to any of the soil properties that we evaluated. Our observations show that root C can contribute substantially to belowground C stocks when deep-rooted perennials replace shallow-rooted crops.

60 APPLIED LIFE SCIENCES

Impact of Penetrating Kelvin Waves on MJO Rainfall Propagation Through Deep Convection Modulation

The Madden‐Julian Oscillation (MJO) is a dominant intraseasonal oscillation in the tropics. As MJOs propagate over the Indian Ocean, some of them can be penetrated by fast‐moving equatorial Kelvin waves originating to the west of the MJOs. Through a series of sensitivity experiments, we demonstrate that these penetrating Kelvin waves can modulate the eastward propagation speed of MJO rainfall. Deep convection in the western MJO rainfall envelope initiates more frequently and produces greater lifetime rainfall when a convectively active Kelvin phase is present, while the opposite occurs during a convectively suppressed Kelvin phase. This alteration in deep convection activity can lead to notable changes in the propagation of the large‐scale MJO rainfall envelope. The modulation of deep convection lifetime rainfall by penetrating Kelvin waves primarily occurs through their impact on deep convection rainfall area, which is closely related to the variations in lower‐tropospheric moisture induced by the Kelvin waves.

Chen, Xingchao [Pennsylvania State Univ., Universi

Scaling deep learning for material imaging with a pseudo 3D model for domain transfer

The recent introduction of deep learning methods for image processing has greatly advanced the characterization of materials using three-dimensional (3D) X-ray imaging techniques. However, deep learning models often have difficulty performing consistently across images owing to unavoidable variations in imaging conditions, which create inconsistencies even for the same material. As a result, networks must frequently be retrained for new datasets, limiting their applicability and generalization. Thus, it is critical to reduce the variations between images to enable a single model to process multiple datasets. Herein, we introduce P3T-Net, a pseudo-3D domain transfer network that transfers diverse 3D images into a uniform domain before processing using deep learning models. Remarkably, P3T-Net enables the reuse of previously trained networks for processing new images and considerably reduces the computational cost of transferring 3D images across domains. These unique capabilities were demonstrated in the following scenarios: (i) image enhancement of fast scans for geological rock and hydrogen fuel cells, (ii) enhancement of images to match the quality of multi-source imaging for lithium-ion batteries, (iii) accurate segmentation of images captured under different conditions, and (iv) tera-scale 3D transfer (10 11 voxels) on a single GPU. Overall, the proposed approach addresses cross-domain inconsistencies across various materials and conditions, thereby enabling more robust and generalizable deep learning solutions for a wide range of material imaging tasks.

25 ENERGY STORAGE

Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry

Graph deep learning models, which incorporate a natural inductive bias for atomic structures, are of immense interest in materials science and chemistry. Here, we introduce the Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry. Built on top of the popular Deep Graph Library (DGL) and Python Materials Genomics (Pymatgen) packages, MatGL is designed to be an extensible “batteries-included” library for developing advanced model architectures for materials property predictions and interatomic potentials. At present, MatGL has efficient implementations for both invariant and equivariant graph deep learning models, including the Materials 3-body Graph Network (M3GNet), MatErials Graph Network (MEGNet), Crystal Hamiltonian Graph Network (CHGNet), TensorNet and SO3Net architectures. MatGL also provides several pre-trained foundation potentials (FPs) with coverage of the entire periodic table, and property prediction models for out-of-box usage, benchmarking and fine-tuning. Finally, MatGL integrates with PyTorch Lightning to enable efficient model training.

chemistry

Substantial and overlooked greenhouse gas emissions from deep Arctic lake sediment

Thermokarst lakes cause abrupt and sustained permafrost degradation and have the potential to release large quantities of ancient carbon to the atmosphere. Despite concerns about how lakes will affect the permafrost carbon feedback, the magnitude of carbon dioxide and methane emissions from deep permafrost soils remains poorly understood. Here we incubated a very deep sediment core (20 m) to constrain the potential productivity of thawed Yedoma and underlying Quaternary sand and gravel deposits. Through radiocarbon dating, sediment incubations and sediment facies classifications, we show that extensive permafrost thaw can occur beneath lakes on timescales of decades to centuries. Although it has been assumed that shallow, aerobic carbon dioxide production will dominate the climate impact of permafrost thaw, we found that anaerobic carbon dioxide and methane production from deep sediments was commensurate with aerobic production on a per gram carbon basis, and had double the global warming potential at warmer temperatures. Carbon release from deep Arctic sediments may thus have a more substantial impact on a changing climate than currently anticipated. These environments are presently overlooked in estimates of the permafrost carbon feedback.

54 ENVIRONMENTAL SCIENCES

Deep Koopman operators for causal discovery

Causal discovery aims to identify cause-effect mechanisms for better scientific understanding, explainable decision-making, and more accurate modeling. Standard statistical frameworks, such as Granger causality, lack the ability to quantify causal relationships in nonlinear dynamics due to the presence of complex feedback mechanisms, timescale mixing, and nonstationarity. Thus, applying these methods to study causal dynamics in real-world systems, such as the Earth, is a major challenge. Addressing this shortcoming, we leverage deep learning and a Koopman operator-theoretic formalism to present a class of causal discovery algorithms. Kausal uses deep Koopman operator methods to approximate nonlinear dynamics in a linearized vector space in which traditional causal inference methods such as Granger causality can be more easily applied. Our idealized experiments demonstrate Kausal’s superior ability in discovering and characterizing causal signals compared to existing deep learning and non-deep learning state-of-the-art approaches. Finally, the successful identification of major El Niño and La Niña events in observations showcases Kausal’s skill to handle real-world applications.

54 ENVIRONMENTAL SCIENCES

Adding labile carbon to peatland soils triggers deep carbon breakdown

Peatlands store vast amounts of carbon, with deep peat carbon remaining stable due to limited thermodynamic energy and transport. However, climate change-induced increases in labile carbon inputs could destabilize these stores. Here, we combined DNA stable isotope probing with stable isotope-assisted metabolomics employing a multi-platform approach to investigate microbial dynamics driving deep peat carbon degradation upon labile carbon (e.g., glucose) amendment. Our findings highlight the vulnerability of deep peat carbon, as glucose addition triggers the breakdown of older organic matter. By uniquely integrating these techniques, we identified active glucose metabolizers to specific microbial populations and mapped carbon flow through microbial networks, elucidating their role in priming recalcitrant carbon mineralization. This multi-omics approach offers crucial insights into how changing resources reshape the peatland microbiome, enhancing our understanding of deep carbon processing, and refining model parameterization to predict microbial responses and carbon cycle feedbacks under global change pressures.

59 BASIC BIOLOGICAL SCIENCES

Large-scale deep learning for metastasis detection in pathology reports

Objectives No existing algorithm can reliably identify metastasis from pathology reports across multiple cancer types and the entire US population. In this study, we develop a deep learning model that automatically detects patients with metastatic cancer by using pathology reports from many laboratories and of multiple cancer types. Materials and Methods We use 60 471 unstructured pathology reports from 4 Surveillance, Epidemiology, and End Results (SEER) registries. The reports were coded into 1 of 3 labels: metastasis negative, metastases positive, or metastasis undetermined. We utilize a task-specific deep neural network trained from scratch and compare its performance with a widely used large language model (LLM). Results Our deep learning architecture trained on task-specific data outperforms a general-purpose LLM, with a recall of 0.894 compared to 0.824. We quantified model uncertainty and used it to defer reports for human review. We found that retaining 72.9% of reports increased recall from 0.894 to 0.969. Discussion A smaller deep learning architecture trained on task-specific data outperforms a general LLM. Equally critical to model performance is the incorporation of uncertainty quantification, achieved here through an abstention mechanism. Conclusions This study’s finding demonstrate the feasibility of developing algorithms to automatically identify metastatic cancer cases from unstructured pathology reports.

machine learning