Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

Coarse-Grained Density Functional Theory Predictions via Deep Kernel Learning

Scalable electronic predictions are critical for soft materials design. Recently, the Electronic Coarse-Graining (ECG) method was introduced to renormalize all-atom quantum chemical (QC) predictions to coarse-grained (CG) resolutions using deep neural networks (DNNs). While DNNs can learn complex representations that prove challenging for kernel-based methods, they are susceptible to overfitting and the overconfidence of uncertainty estimations. Here, we develop ECG within a GPU-accelerated Deep Kernel Learning (DKL) framework to enable CG QC predictions using range-separated hybrid density functional theory (DFT), obtaining a 107 speedup relative to naive all-atom QC. By treating the predicted electronic properties as random Gaussian Processes, DKL incorporates CG mapping degeneracy by learning the distribution of electronic energies as a function of CG configuration. DKL-ECG accurately reproduces molecular orbital energies from range-separated DFT while facilitating efficient training via active learning using the uncertainties provided by DKL. Further, we show that while active learning algorithms enable efficient sampling of a more diverse configurational space relative to random sampling, all explored query methods exhibit comparable performance for the examined system. We attribute this result to the significant overlap of the feature space and output property distributions across multiple temperatures.

97 MATHEMATICS AND COMPUTING↗

Quantum Perturbation Theory Using Tensor Cores and a Deep Neural Network

In this work, time-independent quantum response calculations are performed using Tensor cores. This is achieved by mapping density matrix perturbation theory onto the computational structure of a deep neural network. The main computational cost of each deep layer is dominated by tensor contractions, i.e., dense matrix–matrix multiplications, in mixed-precision arithmetics, which achieves close to peak performance. Quantum response calculations are demonstrated and analyzed using self-consistent charge density-functional tight-binding theory as well as coupled-perturbed Hartree–Fock theory. For linear response calculations, a novel parameter-free convergence criterion is presented that is well-suited for numerically noisy low-precision floating point operations and we demonstrate a peak performance of almost 200 Tflops using the Tensor cores of two Nvidia A100 GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adaptive Data-Driven Deep-Learning Surrogate Model for Frontal Polymerization in Dicyclopentadiene

Frontal polymerization (FP) is a self-sustaining curing process that enables rapid and energy-efficient manufacturing of thermoset polymers and composites. Computational methods conventionally used to simulate the FP process are time-consuming, and repeating simulations are required for sensitivity analysis, uncertainty quantification, or optimization of the manufacturing process. Here, in this work, we develop an adaptive surrogate deep-learning model for FP of dicyclopentadiene (DCPD), which predicts the evolution of temperature and degree of cure orders of magnitude faster than the finite-element method (FEM). The adaptive algorithm provides a strategy to select training samples efficiently and save computational costs by reducing the redundancy of FEM-based training samples. The adaptive algorithm calculates the residual error of the FP governing equations using automatic differentiation of the deep neural network. A probability density function expressed in terms of the residual error is used to select training samples from the Sobol sequence space. The temperature and degree of cure evolution of each training sample are obtained by a 2D FEM simulation. The adaptive method is more efficient and has a better prediction accuracy than the random sampling method. With the well-trained surrogate neural network, the FP characteristics (front speed, shape, and temperature) can be extracted quickly from the predicted temperature and degree-of-cure fields.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep and Shallow Gap States in Reduced and n-Type Doped m -ZrO 2

Monoclinic zirconium dioxide (m-ZrO 2 ) is a wide-band-gap functional oxide with many applications. Understanding the role of intrinsic defects and dopants is important for improving the properties of m-ZrO 2 relevant to its applications. In this work, we characterize the electronic states and energy levels of oxygen vacancies (VO’s) and n-type Nb, Ta, Rb, H, and F dopants in the bulk and at the majority (1̅11) surface of m-ZrO 2 , using accurate dielectric-dependent hybrid functional calculations. Our results show that VO’s generally behave as deep donors with the excess electrons localized at the vacant O sites in the form of F centers, in agreement with previous studies. In contrast, surface VO’s at two-fold coordinated oxygen sites show a rather shallow (1+/0) transition level. Shallow levels are also obtained for adsorbed hydrogen (H ads ) and fluorine substituting an oxygen atom (FO) either in the bulk or at the surface, whereas Nb and Ta form deep levels. Altogether, our results suggest that FO is the best candidate for realizing n-type conductivity in bulk m-ZrO 2 , while surface VO’s and Hads provide an efficient way to control the surface chemistry of m-ZrO 2 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Untapped Potential of Fluoride Ions in Maximizing the Electrochemical Stability of Deep Eutectic Solvents

Advancing the batteries is pivotal to propelling our society toward a sustainable, electrified future. The stability of electrolytes forms the backbone of energy storage systems. This is particularly the case for redox flow batteries (RFBs). Their deployability depends on their longevity and dependability. The presence of unstable electrolytes can trigger undesirable reactions, degrade performance, and lead to battery failure. Aqueous electrolytes, with limited electrochemical stability window (ESW), are prone to hydrogen and oxygen evolution. Conversely, non-aqueous electrolytes offer enhanced stability. In this study, we unveil the ESW of a non-aqueous eutectic solvent, comprising choline fluoride and ethylene glycol—a composition that has eluded experimental investigation until now. Our findings show that the stability window, reduction and oxidation potential limits of deep eutectic solvents, are sensitive to variations in the halide component of the ammonium salt. Furthermore, this work not only highlights the benefits of novel deep eutectic solvents but also sets the stage for their strategic use in future battery electrolytes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Differential Microscopic Mobility of Components within a Deep Eutectic Solvent

From macroscopic measurements of deep eutectic solvents such as glyceline (1:2 molar ratio of choline chloride to glycerol), the long-range translational diffusion of the larger cation (choline) is known to be slower compared to that of the smaller hydrogen bond donor (glycerol). However, when the diffusion dynamics are analyzed on the subnanometer length scale, we discover that the displacements associated with the localized diffusive motions are actually larger for choline. This counterintuitive diffusive behavior can be understood as follows. The localized diffusive motions confined in the transient cage of neighbor particles, which precede the cage-breaking long-range diffusion jumps, are more spatially constrained for glycerol than for choline because of the stronger hydrogen bonds the former makes with chloride anions. The implications of differential localized mobility of the constituents should be especially important for applications where deep eutectic solvents are confined on the nanometer length scale and their long-range translational diffusion is strongly inhibited (e.g., within microporous media).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Comment on “Deep Proteogenomics of a Photosynthetic Cyanobacterium”

Proteomic researchers strive to achieve complete annotation of protein-coding DNA sequences to provide a foundational context for their relevant biological data. A recent deep proteogenomic study using a photosynthetic cyanobacterium Synechocystis sp. PCC 6803 by Spät et al. proposed 64 refined open reading frames (ORFs). By searching LC-MS/MS data from affinity chromatography-isolated protein complexes, our laboratory identified that six of these high-abundance ORFs possess Nterminal initiation start sites that differ than those proposed in the alternative models. Our findings are supported by highly confident MS2 data, phylogenetic analysis, chemical labeling, and established data from two independent research groups. Based on these highquality experimental identifications, we subsequently propose a standardized strategy and set of criteria for future deep proteogenomic efforts to ensure accurate and stringent proteogenomic annotation.

cyanobacteria↗

Ferrous Iron Under Oxygen‐Rich Conditions in the Deep Mantle

Abstract Recent experiments have demonstrated the existence of previously unknown iron oxides at high pressure and temperature including newly discovered pyrite‐type FeO 2 and FeO 2 H x phases stable at deep terrestrial lower mantle pressures and temperatures. In the present study, we probed the iron oxidation state in high‐pressure transformation products of Fe 3+ OOH goethite by in situ X‐ray absorption spectroscopy in laser‐heated diamond‐anvil cell. At pressures and temperatures of ~91 GPa and 1,500–2,350 K, respectively, that is, in the previously reported stability field of FeO 2 H x , a measured shift of −3.3 ± 0.1 eV of the Fe K‐edge demonstrates that iron has turned from Fe 3+ to Fe 2+ . We interpret this reductive valence change of iron by a concomitant oxidation of oxygen atoms from O 2− to O − , in agreement with previous suggestions based on the structures of pyrite‐type FeO 2 and FeO 2 H x phases. Such peculiar chemistry could drastically change our view of crystal chemistry in deep planetary interiors.

58 GEOSCIENCES↗

Observational Evidence of State‐Dependent Positive and Negative Land Surface Feedback on Afternoon Deep Convection Over the Southern Great Plains

Abstract The detection of soil moisture‐precipitation feedback is complicated by the dependence of feedback sign on atmospheric state and cloud types. We evaluated responses of convective clouds to changes in surface evaporative fraction (EF) from satellite and ground‐based measurements over the Southern Great Plains in summer months. Strong responses to EF were inferred only after accounting for tropospheric states supporting systematically positive or negative responses. State dependence (inferred from controlled model experiments) explains the weak response found in previous studies. The probability of transitions from shallow to deep cumulus, and subsequent precipitation onset, increases by 58% over drier surfaces in weakly stratified environments having deeper boundary layers. Boundary layer dynamics play a more important role than low‐level relative humidity in these environments. Wetter surfaces yield increased deep convection in moist and thermally stratified environments. The distinct pathways of convective initiation over dry and wet land surfaces can play important roles in drought onset and termination.

Qiu, Shaoyue↗

Inversion of Time-Lapse Seismic Reservoir Monitoring Data Using CycleGAN: A Deep Learning-Based Approach for Estimating Dynamic Reservoir Property Changes

Carbon capture and storage is being pursued globally as a geoengineering measure for reducing the emission of anthropogenic CO 2 the atmosphere. Comprehensive monitoring, verification, and accounting programs must be established for demonstrating the safe storage of injected CO 2 . One of the most commonly deployed monitoring techniques is time-lapse seismic reservoir monitoring (also known as 4-D seismic), which involves comparing 3-D seismic survey data taken at the same study site but over different times. Analyses of 4-D seismic data volumes can help improve the quality of storage reservoir characterization, track the movement of injected CO 2 plume, and identify potential CO 2 spillover/leakage from the storage reservoirblue. However, the derivation of high-resolution CO 2 saturation maps from 4-D seismic data is a highly nonlinear and ill-posed inverse problem, often requiring significant computational effort. In this research, we apply a physics-based deep learning method to facilitate the solution of both the forward and inverse problems in seismic inversion while honoring physical constraints. A cycle generative adversarial neural network (CycleGAN) model is trained to learn the bidirectional functional mappings between the reservoir dynamic property changes and seismic attribute changes, such that both forward and inverse solutions can be obtained efficiently from the trained model. We show that our CycleGAN-based approach not only improves the reliability of 4-D seismic inversion but also expedites the quantitative interpretation. Our deep learning-based workflow is generic and can be readily used for reservoir characterization and reservoir model updates involving the use of 4-D seismic data.

58 GEOSCIENCES↗

Sensitivity of Simulated Deep Convection to a Stochastic Ice Microphysics Framework

Ice microphysics parameterizations in models must make major simplifications relative to observations, typically employing empirical relationships to represent average functional properties of particles. However, previous studies have established that ice particle properties vary even in similar cloud types and thermodynamic environments, and it remains unclear how this so-called “natural variability” impacts simulated deep convection. This uncertainty is addressed by implementing a stochastic framework into the Predicted Particle Properties microphysics scheme in the Weather Research and Forecasting model. The approach stochastically varies the coefficients of the mass-size (m-D) relationship (m=aD b ) for unrimed and partially rimed ice. Using guidance from aircraft in situ measurements obtained during the Midlatitude Continental Convective Clouds Experiment (MC3E), the scheme samples from distributions of the prefactor (a) and the exponent (b) of the m-D relationship. Simulations of two MC3E deep convective cases indicate that the stochastic m-D scheme produces considerable variability of anvil cirrus cloud optical depth (τ) distributions, even for the same ice water path (IWP). Thus, the stochastic scheme produces variable cloud radiative forcing that is independent of IWP. This τ-IWP relationship variability is nonexistent using the deterministic m-D ensemble. Additional sensitivity tests are performed in which the fallspeed-size relationship (V=cD d ) is stochastically varied, resulting in variable precipitation amounts and rain rate distributions. Results are presented in the context of satellite and precipitation observations and include comparison with other ensemble configurations using perturbed initial and lateral boundary conditions and small-amplitude noise added to the potential temperature field.

54 ENVIRONMENTAL SCIENCES↗

A Benchmark to Test Generalization Capabilities of Deep Learning Methods to Classify Severe Convective Storms in a Changing Climate

Abstract This is a test case study assessing the ability of deep learning methods to generalize to a future climate (end of 21st century) when trained to classify thunderstorms in model output representative of the present‐day climate. A convolutional neural network (CNN) was trained to classify strongly rotating thunderstorms from a current climate created using the Weather Research and Forecasting model at high‐resolution, then evaluated against thunderstorms from a future climate and found to perform with skill and comparatively in both climates. Despite training with labels derived from a threshold value of a severe thunderstorm diagnostic (updraft helicity), which was not used as an input attribute, the CNN learned physical characteristics of organized convection and environments that are not captured by the diagnostic heuristic. Physical features were not prescribed but rather learned from the data, such as the importance of dry air at mid‐levels for intense thunderstorm development when low‐level moisture is present (i.e., convective available potential energy). Explanation techniques also revealed that thunderstorms classified as strongly rotating are associated with learned rotation signatures. Results show that the creation of synthetic data with ground truth is a viable alternative to human‐labeled data and that a CNN is able to generalize a target using learned features that would be difficult to encode due to spatial complexity. Most importantly, results from this study show that deep learning is capable of generalizing to future climate extremes and can exhibit out‐of‐sample robustness with hyperparameter tuning in certain applications.

54 ENVIRONMENTAL SCIENCES↗

Improving the Physical Basis for Updraft Dynamics in Deep Convection Parameterizations

This article presents a new deep convective parameterization that determines cloud characteristics based on a specified cloud size distribution. The vertical profiles of cloud properties are determined by analytic equations, which formulate entrainment with an inverse relationship to cloud width. In line with recent studies of large eddy simulations (LES), cloud widths are assumed to be constant with height and vertical mass flux (M) characteristics of the clouds are therefore regulated by the vertical velocity profile. The parameterization is configured to work with existing cloud base M closure formulations, with the closure predicting the total cloud area rather than the cloud base M directly. Analytic formula are also used to connect the vertical wind shear magnitude to the cloud size distribution, wherein larger shear magnitudes result in more numerous large updrafts than weaker shear magnitudes, which is in line with recent research results. The parameterization is compared against 10 deep convective LES with varying thermodynamic and vertical wind shear profiles. Results show dramatic improvements in the prediction of normalized M, detrainment, and the properties of detrained air over the existing Zhang and McFarlane (1995) scheme. In particular, the new model is able to correctly portray the transition from a bottom-heavy M profile in weakly sheared environments, to a top-heavy M profile in strongly sheared environments.

54 ENVIRONMENTAL SCIENCES↗

How Does LCL Height Influence Deep Convective Updraft Width?

Previous studies have hypothesized that the width of deep convection should positively scale with lifting condensation level (LCL) height. To evaluate this hypothesis, we analyzed idealized large-eddy simulations with varying LCL heights and initial warm bubble widths in unsheared environments with comparable convective available potential energy. For a given initial warm bubble width, simulations with higher LCLs result in wider, deeper, and stronger cloudy updrafts compared to simulations with lower LCLs. Rising dry thermals in higher LCL simulations experience longer residence times within the sub-cloud layer, and consequently entrain more conditionally unstable air and grow wider before reaching the LCL. The resulting cloudy updrafts are wider, deeper, and have faster vertical velocities because of a reduction in entrainment-driven dilution of buoyancy, relative to lower LCL simulations. These results confirm the hypothesized positive relationship between LCL height and deep convective updraft width, and provide a physical explanation for this relationship.

58 GEOSCIENCES↗

High‐Pressure Phase Stability and Thermoelastic Properties of Iron Carbonitrides and Nitrogen in the Deep Earth

Abstract Iron‐dominant metallic phases are likely the primary hosts for nitrogen in the reduced deep Earth, hence the storage of nitrogen in the lower mantle and the core is governed by the behavior of the Fe‐N‐C system at high temperatures and pressures. In this study, phase transitions and thermoelastic properties of iron carbonitrides were investigated at high pressure‐temperature conditions by diamond anvil cell experiments and first‐principles calculations. Experimental data revealed no phase transition in ε ‐type Fe 4 (N 0.6 C 0.4 ) or Fe 7 (N 0.75 C 0.25 ) 3 up to 60 GPa at room temperature. At high temperature, Fe 7 (N 0.75 C 0.25 ) 3 transforms into the Fe 3 C‐type phase at ∼27 GPa, and then into the Fe 7 C 3 ‐type phase at ∼45 GPa, which is also corroborated by our theoretical calculations. We found that the phase stability of iron carbonitrides mainly depends on the N/C ratio, and the elastic properties of iron carbonitrides are dominantly affected by the Fe/(N+C) ratio. Iron carbonitrides with diverse structures may be the main host for nitrogen in the deep mantle. Some iron carbonitride inclusions in lower mantle diamonds could be the residue of the primordial mantle or originate from subducted nitrogen‐bearing materials, rather than iron‐enriched phases of the outer core. In addition, our experiments confirmed the existence of Fe 7 C 3 ‐type Fe 7 C 3 ‐Fe 7 N 3 solid solutions above 40 GPa. Fe 7 C 3 ‐type Fe 7 (C, N) 3 has comparable density and thermoelastic properties to its isostructural endmembers and may be a promising candidate constituent of the Earth's inner core.

Huang, Shengxuan↗

Barometric Pumping Through Fractured Rock: A Mechanism for Venting Deep Methane to Mars' Atmosphere

Abstract Both the source of methane on Mars and the mechanism for transmission from the subsurface to the atmosphere are not fully understood. Previous seepage simulations have invoked relatively shallow subsurface sources to explain observed methane signatures on Mars. We propose that barometric‐pressure pumping through fracture networks could be an effective mechanism for methane transport from the deep subsurface on Mars. Using atmospheric pressure data gathered by Curiosity as input, we simulate methane gas transport from depths of 200 m to the surface. Even with such a deep source, our model reproduces the observed seasonality of methane, and the simulated surface methane fluxes fall within the range of previous estimates derived from atmospheric observations. Because 200 m is the likely minimum hospitable depth for living methanogenic microbes, our fracture network model indirectly reinvigorates the possibility of a microbial source of methane on Mars.

58 GEOSCIENCES↗

A Coupled Deep Learning Model for Estimating Surface NO 2 Levels from Remote Sensing Data: 15-Year Study Over the Contiguous United States

This study proposes a novel two-step deep learning (DL) model for estimating surface NO 2 concentrations using satellite data over the contiguous United States (CONUS) from 2005 to 2019. The first phase of the model uses partial convolutional neural network (PCNN), an advanced DL model that accurately imputes gaps between surface NO 2 stations and creates 5,478 daily-mean NO 2 grids (PCNN-NO 2 ) of the 2005-2019 period over the study area. We then feed the PCNN-NO 2 , along with other predictor variables, into a deep neural network (DNN) to estimate surface NO 2 levels, achieving exceptional performance with a correlation coefficient of 0.975 to 0.978, a mean absolute bias of 0.99 ppb to 1.38 ppb, and a root mean square error of 1.47 ppb to 1.97 ppb. Spatial cross-validation results also indicate strong spatial performance of PCNN-DNN surface NO 2 estimates. In addition to its accurate estimates, the PCNN-DNN model consistently generates estimated NO 2 grids without any missing values, improving the quality of various applications such as emission reduction strategies and public health studies. Between 2005 and 2019, the 5,478 daily estimated NO 2 grids over the CONUS reveal significant reductions in NO 2 levels in fourteen major urban environments: Washington D.C. (-43%), New York (-45%), Los Angeles (-38%), Chicago (-25%), Boston (-43%), Houston (-34%), Dallas (-40%), Philadelphia (-41%), Phoenix (-38%), Detroit (-20%), Denver (-23%), Atlanta (-0.7%), Cincinnati (-38%), and Pittsburgh (-56%). Furthermore, the study shows that the denser urban regions that in-situ stations are installed in, the higher the difference between in-situ observations and regional-mean NO 2 levels.

54 ENVIRONMENTAL SCIENCES↗

Using the Shallow Strain Tensor to Characterize Deep Geologic Reservoirs

Abstract Storing and recovering water, carbon, and heat from geologic reservoirs is central to managing resources in a changing climate. We tested the hypothesis that the strain tensor caused by injecting or producing fluids can be measured at shallow depths and interpreted to advance understanding of underlying deep aquifers or reservoirs. Geodetic‐grade strainmeters were deployed at 30 m depth overlying the Bartlesville Formation, a 500‐m‐deep sandstone near Tulsa, OK. The strainmeters are 220 m east of injection well 9A completed in a permeable lens at the base of the Bartlesville Formation. Water was injected into well 9A at approximately 1.0 L/s during four tests that ranged in duration from a few hours to a few weeks. The horizontal strain increased (tension) and the circumferential strain was a few times larger than the radial strain. The vertical strain decreased (compression) during injection. Strain rates were approximately 100 nε/day during the first few hours, but the rates decreased and were approximately 10 nε/day during most of the tests. Four independent methods of poroelastic simulation and inversion predict reservoir properties and geometries that are similar to each other and consistent with independent information about the reservoir. All strain interpretations predict that a boundary to the permeable lens occurs beneath the vicinity of the strainmeters, which is consistent with core data from the site. The boundary of the permeable lens is located by matching the vertical, radial and circumferential strains, which demonstrates the value of measuring the strain tensor.

Murdoch, Lawrence C.↗