Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Deep Learning enabled spectral energy conversion for in situ exposure measurements

A detector-specific deep learning (DL) approach is presented for spectra-to-exposure conversion using large-format sodium iodide (NaI(Tl)) detectors deployed for in situ environmental radiation measurements in emergency response scenarios. Accurate determination of exposure from NaI spectra is challenging due to poor energy resolution, partial energy absorption, and the strong sensitivity of traditionally deployed analytical conversion methods to calibrated source geometry and pre-deployment assumptions. Here, to address these limitations, a multi-layer perceptron model was trained on a hybrid in situ /Monte Carlo dataset constructed to span a broad range of photon energies, spatial extents, and realistic deployment variability, representative of general in situ emergency response conditions. The DL model was evaluated against commonly fielded analytical approaches under matched simulation conditions, including a single-factor method, a G-function method, and a modeled pressurized ion chamber (PIC) baseline. This study was intentionally computational in scope to enable controlled, like-for-like comparisons between conversion techniques while minimizing confounding real-world variability. Comparison to the modeled PIC provides contextual benchmarking and is not intended as a field inter-comparison with deployed instruments. Across the evaluated 20 keV to 3 MeV energy range, the DL approach consistently exhibited higher accuracy and reduced variance relative to the analytical methods against a deterministically calculated exposure. This may indicate improved robustness to spectral complexity without reliance on source-, geometric-, or spectral region-specific optimization. While results do not represent real-world validation, the presented work demonstrates that deep learning may effectively learn the nonlinear detector response-to-exposure relationship for asymmetric NaI(Tl) detectors and offers a promising pathway for improving in situ exposure estimation using spectroscopic systems already integrated into initial real-time emergency response operations.

61 RADIATION PROTECTION AND DOSIMETRY↗

Automating the detection of hydrological barriers and fragmentation in wetlands using deep learning and InSAR

The loss of hydrological connectivity and fragmentation of natural wetlands is a widespread driver of wetland degradation. Understanding where and how natural connectivity is impaired is essential for managing, protecting and remediating these ecosystems. Wetland Interferometric Synthetic Aperture Radar (Wetland InSAR) can provide information on surface flow orientation in wetlands at a high spatial resolution, which can be used for barrier detection. However, the broad application of this approach is constrained by the labour-intensive manual delineation of barriers based on mapped water levels. This study presents the first deep learning-based methodology for the automated detection of hydrological barriers. We trained a deep convolutional network to segment edge features of hydrological barriers in 25 image pairs captured by ALOS PALSAR-1 L-Band InSAR between 2006 and 2011. The training dataset consists of manually labelled and delineated barriers showing abrupt changes in water surface elevation and wrapped interferograms with high coherence. We tested this method across three wetland sites: the Everglades and southern Louisiana wetlands (United States) and the Cienaga de Zapata (Cuba). Across these sites, the convolutional network detected hydrological barriers with up to 84% accuracy. The model performed particularly well for linear hydrological barriers such as roads, dikes, and channels. Notably, some barriers impede flow only seasonally, appearing during low water levels and disappearing when water levels rise. Our automated approach to detecting and assessing wetland hydrologic connectivity can be applied more broadly to support the effective management of fragmented wetland ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Transformational faulting in Mn 2 GeO 4 from olivine to wadsleyite structure: Implications for physical mechanism of deep-focus earthquakes

High-pressure and temperature deformation experiments interfaced with acoustic emission (AE) monitoring have been conducted to study transformational faulting in Mn 2 GeO 4 olivine, which transforms to the β phase, isostructural to wadsleyite. Metastable Mn 2 GeO 4 olivine exhibits a marked embrittlement behavior at temperatures between 800 and 1100 K, emitting numerous AEs. At each temperature, brittle deformation is characterized by a two-stage process: (1) a “preparation” stage with numerous diffusedly located low-magnitude AEs and large b values (>2), and (2) a failure stage where larger-magnitude AEs form a planar distribution with b values about 1. Microstructure analysis reveals extensive kink band development in olivine grains in the recovered samples. Kink band boundaries (KBBs), with a typical thickness of ∼100 nm, are filled with a nanometric β-Mn 2 GeO 4 “gouge”. A dense array of secondary shear localizations is often present within the kink bands, suggesting significant shear deformation therein. The combined observations suggest that faulting in metastable Mn 2 GeO 4 olivine is a self-similar process, from grain-scale to the sample-scale. Both observed embrittlement behavior and the microstructure of metastable Mn 2 GeO 4 olivine are essentially identical to those in Mg 2 GeO 4 olivine we have reported previously, indicating that the physical mechanism of faulting in metastable olivine is insensitive to the specific crystallographic structure of the high-pressure phase. The low b values (about 1) observed in the faulting process in our experiments are similar to those of deep focus earthquakes in cold subduction zones. Our observed mechanism explains deep focus seismicity in cold metastable mantle wedges, provided that the self-similarity assumption holds to geological scales.

58 GEOSCIENCES↗

How Did Westward Volcaniclastic Deposits Accumulate in the Deep Sea Following the January 2022 Eruption of Hunga Volcano?

Most volcanic eruptions on Earth take place below the ocean surface and remain largely unobserved. Reconstruction of past submerged eruptions has thus primarily been based on the study of seafloor deposits. Rarely before the 15 January 2022 eruption of Hunga volcano (Kingdom of Tonga) have we been able to categorically link deep-sea deposits to a specific volcanic source. This eruption was the largest in the modern satellite era, producing a 58-km-tall plume, a 20-m high tsunami, and a pressure wave that propagated around the world. The eruption induced the fastest submarine density currents ever measured, which destroyed submarine telecommunication cables and traveled at least 85 km to the west to the neighboring Lau Basin. Here we report findings from a series of remotely operated vehicle dives conducted 4 months after the eruption along the Eastern Lau Spreading Center-Valu Fa Ridge. Hunga-sourced volcaniclastic deposits 7–150 cm in thickness were found at nine sites, and collected. Study of the internal structure, grain size, componentry, glass chemistry, and microfossil assemblages of the cores show that these deposits are the distal portions of at least two ~100-km-runout submarine density currents. We identify distinct physical characteristics of entrained microfossils that demonstrate the dynamics and pathways of the density currents. Microfossil evidence suggests that even the distal parts of the currents were erosive, remobilizing microfossil-concentrated sediments across the Lau Basin. Remobilization by volcaniclastic submarine density currents may thus play a greater role in carbon transport into deep sea basins than previously thought.

58 GEOSCIENCES↗

Evaluating E3SM Global Storm‐Resolving Model Simulations of Deep Convection: Insights From DP‐SCREAM During TRACER

Global Storm-Resolving Models (GSRMs) are becoming increasingly vital for advancing climate modeling and improving the prediction of extreme weather events. Houston, a coastal region frequently affected by deep convective storms, offers an ideal setting to evaluate the ability of GSRMs to simulate deep convection. This study assesses the performance of the Doubly Periodic Simple Cloud-Resolving E3SM (Energy Exascale Earth System Model) Atmosphere Model (DP-SCREAM) using observations from the TRacking Aerosol Convection interactions ExpeRiment (TRACER) campaign. DP-SCREAM effectively reproduces the diurnal cycles of clouds and precipitation, demonstrating much greater skill than the E3SM single column model. The DP-SCREAM is demonstrated to be applicable to coastal regions, partially due to the forcing data sets already capturing the influence of breezes. DP-SCREAM also replicates biases persistent in the global version of SCREAM: the underrepresentation of boundary layer shallow clouds, a lack of mid-level congestus clouds, and the popcorn convection, characterized by small and disorganized convective cells generating the strongest precipitation. To investigate these issues, two sensitivity experiments were conducted: increasing the mixing length and scaling up the buoyancy flux within the Simplified Higher Order Closure scheme. Increasing the mixing length improved mid-level congestus representation and reduced unrealistic early morning fog occurrence. Enhancing buoyancy flux only marginally improved the bias of underproduced big convective cells. In conclusion, an additional resolution sensitivity test at 0.5 km grid spacing demonstrated that a refined horizontal resolution alone is insufficient to resolve these biases.

54 ENVIRONMENTAL SCIENCES↗

Accurate segmentation of localized corrosion in structural alloys via deep learning

This study presents a deep learning-based approach for the automated segmentation of corrosion damage in scanning electron microscopy (SEM) images. The proposed method enables rapid and accurate segmentation of corrosion features in these SEM images, making it highly suitable for real-time applications such as automated microscopy. Specifically, a dedicated corrosion segmentation database tailored for this task is constructed. The newly constructed dataset, alongside data from two public databases, are employed to jointly train a deep learning-based model modified with a texture refinement module. Compared to the same model without the texture refinement module, the refined model substantially enhances the efficacy and efficiency of corrosion segmentation. Furthermore, the methodology developed here is extendable to segmentation tasks for other materials with similar resolution, texture, and contrast characteristics, thereby paving the way for accelerated and automated analysis in corrosion science and beyond.

Artificial Intelligence↗

Deep learning-based predictive models for laser direct drive at the Omega Laser Facility

The rich and complex physics of inertial confinement fusion provides a unique and challenging space for high-fidelity first-principles modeling. Consequently, simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this article, we present two deep-learning-based predictive models intended to address these difficulties. The first model (TL DNN) acts as a fast emulator of simulations as well as experiments at the Omega Laser Facility. This model is trained on a simulation database and subsequently calibrated on experimental data using transfer learning. To facilitate the development of this model, an autoencoder is developed to reduce the dimensionality of the input space by compressing the laser pulse input. The model predicts key experimental scalar observables of Omega experiments with high accuracy and minimal computational cost. This deep neural net enables rapid exploration of a high-dimensional input parameter space for an optimal implosion design. The second model (DNN SM+) aims to extend the statistical modeling work of Lees et al. [Phys. Rev. Lett. 127, 105001 (2021)], by increasing the complexity of the model space and allowing for coupling between degradation terms. Since the model capacity of DNN SM+ is higher than the model of Lees et al., DNN SM+ can potentially provide an improvement in predictive capability, and we use this model to provide insight into complicated degradation dependencies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A physics-constrained deep learning treatment of runaway electron dynamics

An adjoint formulation leveraging a physics-informed neural network (PINN) is employed to advance the density moment of a runaway electron (RE) distribution forward in time. A distinguishing feature of this approach is that once the adjoint problem is solved, its solution can be used to project the RE density forward in time for an arbitrary initial momentum space distribution of REs. Furthermore, by employing a PINN, a parametric solution to the adjoint problem can be learned. Thus, once trained, this adjoint-deep learning framework is able to efficiently project the RE density forward in time across various plasma conditions while still including a fully kinetic description of RE dynamics. As an example application, the temporal evolution of the density of primary electrons is studied, with particular emphasis on evaluating the decay of a RE population when below threshold. Predictions from the adjoint-deep learning framework are found to be in good agreement with a traditional relativistic electron Fokker–Planck solver, for several distinct initial conditions, and across an array of physics parameters. Once trained, the PINN thus provides a means of generating RE density time histories with exceptionally low online execution time.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Depth of nutrient uptake by deep-rooted plants is regulated by water availability

The capacity of some plants to access water and nutrients at depths greater than one meter is a critical functional trait that confers resistance to drought and impacts both belowground and shallow soil processes. Here, we report water and strontium isotopic data from an alpine meadow transect showing the correlation between water and nutrient acquisition depths. The isotopic compositions of Sr ( 87 Sr/ 86 Sr ratio) and water in rock and soil, and in plant leaf tissues, reveal that deeper-rooted plants acquire a higher proportion of water, Sr, and cation nutrients that are derived from the saprolite, a zone of silicate weathering, than shallow-rooted grass. A three-decade dendrochemical record reveals that reductions of wet precipitation drive deep-rooted plants to acquire cation nutrients from deeper saprolite or bedrock regions. Thus, the depth of cation nutrient acquisition by deep-rooted plant species at this site is tightly coupled with, and likely determined by, water availability in soil, saprolite, and bedrock. The enhanced uptake of cations as well as water from deeper saprolite zones could impact the rate of bedrock weathering and watershed chemistry during drought.

biogeochemistry↗

Popnet : computer vision based deep learning model for forecasting gridded population

Here, this study introduces Popnet, a deep learning model for forecasting 1 km-gridded populations, integrating U-Net, ConvLSTM, a Spatial Autocorrelation module and deep ensemble methods. Using spatial variables and population data from 2000 to 2020, Popnet predicts South Korea’s population trends by age groups (under 14, 15-64 and over 65) up to 2040. In validation, it outperforms traditional machine learning and state-of-the-art computer vision models. The output of this model discovered significant polarisation: population growth in urban areas, especially the capital region, and severe depopulation in rural areas. Popnet is a robust tool for offering significant insights to policymakers and related stakeholders about the detailed future population, which allows them to establish detailed, localised planning and resource allocations.

computer vision↗

Optical characterization of deep-level defects in n-type Al x In y Ga 1- x - y P for the development of solid-state photomultiplier analogs

Characterizing intrinsic defects is an essential step in evaluating materials for novel optoelectronic device applications. For photomultipliers, suppressing dark currents is critical, but a tradeoff is present between maximizing the band gap while remaining sensitive to the wavelength of interest and minimizing the incorporation of fresh defects by growing not-yet-optimized alloys. We present a series of capacitance-based measurements, including deep-level optical spectroscopy, steady-state photocapacitance, and illuminated capacitance-voltage, on photodiodes with lightly n-type Al x In y Ga 1−x−y P absorber regions. Several deep levels are identified, including one near the midgap. Although the inclusion of aluminum increases each trap density by approximately 10×, the hole capture cross-section also appears to decrease, suggesting that Shockley–Read–Hall dark currents may be suppressed. These materials may be good candidates for the development into silicon photomultiplier analogs with a wider bandgap for scintillator applications.

III–V↗

Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble

In this work we explore the capability of physics-informed neural networks (PINNs) to discover multiple solutions. Many real-world phenomena governed by nonlinear differential equations (DEs), such as fluid flow, exhibit multiple solutions under the same conditions, yet capturing this solution multiplicity remains a significant challenge. A key difficulty lies in providing appropriate initial conditions or guesses, as widely used time-marching schemes and Newton’s method are highly sensitive to these choices when solving complex computational problems. While machine learning models, particularly PINNs, have shown promise in solving DEs, their ability to capture multiple solutions remains underexplored. In this work, we propose a simple and practical approach using PINNs to learn and discover multiple solutions. We first demonstrate that PINNs, when combined with random initialization and deep ensemble method—originally developed for uncertainty quantification—can effectively uncover multiple solutions to nonlinear ordinary and partial DEs. Although training large ensembles of PINNs may appear computationally demanding, this can be done efficiently using vectorization techniques supported by modern deep learning frameworks, allowing many networks to be trained simultaneously. Our approach highlights the critical role of initialization in shaping solution diversity, addressing an often-overlooked aspect of machine learning for scientific computing. Furthermore, we propose utilizing PINN-generated solutions as initial conditions or initial guesses for conventional numerical solvers to enhance accuracy and efficiency in capturing multiple solutions. Extensive numerical experiments, including the Allen–Cahn equation and cavity flow, where our approach successfully identifies both stable and unstable solutions, validate the effectiveness of our method. These findings establish a general and efficient framework for addressing solution multiplicity in nonlinear DEs.

97 MATHEMATICS AND COMPUTING↗

Deep exclusive meson production as a probe to the puzzle of Λ hyperon polarization

In the 1970s, an unexpected transverse Λ polarization in unpolarized proton-beryllium collisions was discovered, which initiated extensive studies on spin phenomena in high-energy physics. Over the past five decades, similar transverse Λ polarization has been observed across various collision systems, including lepton-hadron deep-inelastic scattering, hadron-hadron collisions, and electron-positron collisions. Despite numerous promising theoretical models, the fundamental mechanism underlying this polarization phenomenon remains inconclusive to this day. However, in both longitudinally and transversely polarized lepton-hadron and hadron-hadron collisions, it is found that the Λ hyperon is polarized with respect to the initial parton spin direction. How the Λ hyperon acquires its spin has become one of the most crucial questions to address in order to resolve this puzzle. In this paper, I propose to use an exclusive process that can be measured at the Electron-Ion Collider, the deep exclusive meson production, to explicitly test the mechanism of Λ polarization. The outcomes of this experimental measurement are anticipated to unveil the dominant mechanism by which Λ obtains its spin, eliminating many of the ambiguities that have been encountered in previous studies. Finally, experimental challenges and requirements are discussed. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Deep learning-based spatio-temporal fusion for high-fidelity ultra-high-speed X-ray radiography

Full-field ultra-high-speed (UHS) X-ray imaging experiments have been well established to characterize various processes and phenomena. However, the potential of UHS experiments through the joint acquisition of X-ray videos with distinct configurations has not been fully exploited. In this paper, we investigate the use of a deep learning-based spatio-temporal fusion (STF) framework to fuse two complementary sequences of X-ray images and reconstruct the target image sequence with high spatial resolution, high frame rate and high fidelity. We applied a transfer learning strategy to train the model and compared the peak signal-to-noise ratio (PSNR), average absolute difference (AAD) and structural similarity (SSIM) of the proposed framework on two independent X-ray data sets with those obtained from a baseline deep learning model, a Bayesian fusion framework and the bicubic interpolation method. The proposed framework outperformed the other methods with various configurations of the input frame separations and image noise levels. With three subsequent images from the low-resolution (LR) sequence of a four times lower spatial resolution and another two images from the high-resolution (HR) sequence of a 20 times lower frame rate, the proposed approach achieved average PSNRs of 37.57 dB and 35.15 dB, respectively. When coupled with the appropriate combination of high-speed cameras, the proposed approach will enhance the performance and therefore the scientific value of UHS X-ray imaging experiments.

deep learning↗

Deep-learning methods for contrast enhancement and artifact reduction in cryo-electron tomography: a systematic analysis of the state of the art and proposed improvements

Cryo-electron tomography (cryo-ET) has emerged as the preferred technique for visualizing the organization of macromolecular complexes in situ and resolving their structures at subnanometre resolution [Tegunov et al. (2021)View full citation, Nat. Methods, 18, 186–193]. Despite improvements in data quality as a result of advances in detector technology, microscope stability and stage precision, the analysis and interpretation of tomograms remains challenging due to a low signal-to-noise ratio and reconstruction artifacts stemming from experimental constraints in specimen tilt during data collection resulting in a missing wedge in the Fourier space. Recently, self-supervised deep-learning methods have been proposed for contrast enhancement and reduction of resolution anisotropy in reconstructed tomograms. Here, we evaluate several state-of-the-art deep-learning methods which aim to improve the interpretability of cryo-ET reconstructions, with a focus on their performance on downstream tasks of template matching, sub­tomogram averaging and segmentation. We propose new training architectures and a loss function based on Fourier shell correlation that show improved performance over the standard U-Net with L1/L2 losses. We demonstrate our analysis on four diverse experimental datasets: purified 80S ribosomes, in situ Chlamydomonas reinhardtii, immature HIV-1 virus-like particles and INS-1E cells.

contrast enhancement↗

Newton-Raphson AC Power Flow Convergence Based on Deep Learning Initialization and Homotopy Continuation

Power flow forms the basis of many power system studies. With the increased penetration of renewable energy, grid planners tend to perform multiple power flow simulations under various operating conditions and not just selected snapshots at peak or light load conditions. Getting a converged AC power flow (ACPF) case remains a significant challenge for grid planners especially in large power grid networks. This paper proposes a two-stage approach to improve Newton-Raphson ACPF convergence and was applied to a 6102 bus Electric Reliability Council of Texas (ERCOT) system. The first stage utilizes a deep learning-based initializer with data re-training. Here a deep neural network (DNN) initializer is developed to provide better initial voltage magnitude and angle guesses to aid in power flow convergence. This is because Newton-Raphson ACPF is quite sensitive to the initial conditions and bad initialization could lead to divergence. The DNN initializer includes a data re-training framework that improves the initializer's performance when faced with limited training data. The DNN initializer successfully solved 3,285 cases out of 3,899 non-converging dispatch and performed better than random forest and DC power flow initialization methods. ACPF cases not solved in this first stage are then passed through a hot-starting algorithm based on homotopy continuation with switched shunt control. The hot-starting algorithm successfully converged 416 cases out of the remaining 614 non-converging ACPF dispatch. In conclusion, the combined two-stage approach achieved a 94.9% success rate, by converging a total of 3,701 cases out of the initial 3,899 unsolved cases.

Deep learning↗

TorchBraid: High-Performance Layer-Parallel Training of Deep Neural Networks with MPI and GPU Acceleration

TorchBraid is a high-performance implementation of layer-parallel training for deep neural networks (DNNs) supporting MPI-based parallelism and GPU acceleration. Layer-parallel training has been developed to overcome the serialization inherent in forward and backward propagation of DNNs that limits utilization of computational resources in the strong scaling limit. To achieve this, TorchBraid integrates the PyTorch neural network framework with the state-of-the-art XBraid time-parallel library. Furthermore, this article presents the use and performance of TorchBraid, in addition to solutions for overcoming the algorithmic challenges inherent in combining automatic differentiation with layer-parallel. Results are presented with and without GPU acceleration for the Tiny ImageNet and MNIST image classification data sets, as well as recurrent neural networks. Overall, TorchBraid enables fast training of DNNs, both in a strong and weak scaling context. In addition to the TorchBraid software, several new advances in applying layer-parallel algorithms are detailed. Integration of layer-parallel with data-parallel algorithms is presented for the first time, showing the computational advantages of the combination. Standard deep learning techniques, like batch-normalization, are developed for layer-parallel training. Finally, a new approach combining layer-parallel with spatial coarsening in order to accelerate training for 3D image classification shows roughly a 10× speedup over serial execution.

Layer-parallel↗

Griffin Capability Improvements in Support of Ex-core Deep-Penetration Problems

Advanced reactor designs, especially portable reactors that are designed to be located closer to humans and operate autonomously, require the ability to accurately compute the ex-core neutron and gamma flux solutions in terms of shielding design optimization to reduce dose rates at the vessel boundary and detector signal prediction to drive the reactor control system. The Nuclear Energy Advanced Modeling and Simulation program has prioritized improvements to the Griffin discrete ordinates (SN) solver for deep-penetration problems in fiscal year 2025. Significant advancements have been made to the Griffin methodologies for solving ex-core deep-penetration problems for steady-state, fixed-source and transient calculations. This work presents the methodology improvements as well as a comprehensive demonstration with a Transient Test Reactor model and measurements.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗