Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality

Abstract Deep neural networks (‘deep learning’) have emerged as a technology of choice to tackle problems in speech recognition, computer vision, finance, etc. However, adoption of deep learning in physical domains brings substantial challenges stemming from the correlative nature of deep learning methods compared to the causal, hypothesis driven nature of modern science. We argue that the broad adoption of Bayesian methods incorporating prior knowledge, development of solutions with incorporated physical constraints and parsimonious structural descriptors and generative models, and ultimately adoption of causal models, offers a path forward for fundamental and applied research.

97 MATHEMATICS AND COMPUTING↗

Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry

Graph deep learning models, which incorporate a natural inductive bias for atomic structures, are of immense interest in materials science and chemistry. Here, we introduce the Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry. Built on top of the popular Deep Graph Library (DGL) and Python Materials Genomics (Pymatgen) packages, MatGL is designed to be an extensible “batteries-included” library for developing advanced model architectures for materials property predictions and interatomic potentials. At present, MatGL has efficient implementations for both invariant and equivariant graph deep learning models, including the Materials 3-body Graph Network (M3GNet), MatErials Graph Network (MEGNet), Crystal Hamiltonian Graph Network (CHGNet), TensorNet and SO3Net architectures. MatGL also provides several pre-trained foundation potentials (FPs) with coverage of the entire periodic table, and property prediction models for out-of-box usage, benchmarking and fine-tuning. Finally, MatGL integrates with PyTorch Lightning to enable efficient model training.

chemistry↗

Substantial and overlooked greenhouse gas emissions from deep Arctic lake sediment

Thermokarst lakes cause abrupt and sustained permafrost degradation and have the potential to release large quantities of ancient carbon to the atmosphere. Despite concerns about how lakes will affect the permafrost carbon feedback, the magnitude of carbon dioxide and methane emissions from deep permafrost soils remains poorly understood. Here we incubated a very deep sediment core (20 m) to constrain the potential productivity of thawed Yedoma and underlying Quaternary sand and gravel deposits. Through radiocarbon dating, sediment incubations and sediment facies classifications, we show that extensive permafrost thaw can occur beneath lakes on timescales of decades to centuries. Although it has been assumed that shallow, aerobic carbon dioxide production will dominate the climate impact of permafrost thaw, we found that anaerobic carbon dioxide and methane production from deep sediments was commensurate with aerobic production on a per gram carbon basis, and had double the global warming potential at warmer temperatures. Carbon release from deep Arctic sediments may thus have a more substantial impact on a changing climate than currently anticipated. These environments are presently overlooked in estimates of the permafrost carbon feedback.

54 ENVIRONMENTAL SCIENCES↗

Viruses control dominant bacteria colonizing the terrestrial deep biosphere after hydraulic fracturing

The deep terrestrial biosphere harbors a significant fraction of earth’s biomass and remains understudied compared to other ecosystems. Deep biosphere life primarily consists of bacteria and archaea, yet knowledge of their co-occurring viruses is poor. Here we temporally catalogued viral diversity from five deep terrestrial subsurface locations (hydraulically fractured wells), examined virus-host interaction dynamics, and experimentally assessed metabolites from cell lysis to better understand viral roles in this ecosystem. We uncovered high viral diversity, rivaling that of peatland soil ecosystems, despite low host diversity. Many viral OTUs were predicted to infect Halanaerobium, the dominant microbe in these ecosystems. Examination of CRISPR-Cas spacers elucidated lineage-specific virus-host dynamics suggesting active in situ viral predation of Halanaerobium. These dynamics indicate an ongoing arms-race with repeated viral encounters and changing viral host range across temporally and geographically distinct shale formations. Laboratory experiments showed that prophage-induced Halanaerobium lysis releases intracellular metabolites that can sustain key fermentative metabolisms, supporting the persistence of microorganisms in this ecosystem. Together these findings suggest that diverse and active viral populations play critical roles in driving strain-level microbial community development and resource turnover within this deep terrestrial subsurface ecosystem.

Daly, Rebecca A.↗

Protein model accuracy estimation empowered by deep learning and inter-residue distance prediction in CASP14

Abstract The inter-residue contact prediction and deep learning showed the promise to improve the estimation of protein model accuracy (EMA) in the 13th Critical Assessment of Protein Structure Prediction (CASP13). To further leverage the improved inter-residue distance predictions to enhance EMA, during the 2020 CASP14 experiment, we integrated several new inter-residue distance features with the existing model quality assessment features in several deep learning methods to predict the quality of protein structural models. According to the evaluation of performance in selecting the best model from the models of CASP14 targets, our three multi-model predictors of estimating model accuracy (MULTICOM-CONSTRUCT, MULTICOM-AI, and MULTICOM-CLUSTER) achieve the averaged loss of 0.073, 0.079, and 0.081, respectively, in terms of the global distance test score (GDT-TS). The three methods are ranked first, second, and third out of all 68 CASP14 predictors. MULTICOM-DEEP, the single-model predictor of estimating model accuracy (EMA), is ranked within top 10 among all the single-model EMA methods according to GDT-TS score loss. The results demonstrate that inter-residue distance features are valuable inputs for deep learning to predict the quality of protein structural models. However, larger training datasets and better ways of leveraging inter-residue distance information are needed to fully explore its potentials.

59 BASIC BIOLOGICAL SCIENCES↗

Survival analysis of localized prostate cancer with deep learning

In recent years, data-driven, deep-learning-based models have shown great promise in medical risk prediction. By utilizing the large-scale Electronic Health Record data found in the U.S. Department of Veterans Affairs, the largest integrated healthcare system in the United States, we have developed an automated, personalized risk prediction model to support the clinical decision-making process for localized prostate cancer patients. This method combines the representative power of deep learning and the analytical interpretability of parametric regression models and can implement both time-dependent and static input data. To collect a comprehensive evaluation of model performances, we calculate time-dependent C-statistics C td over 2-, 5-, and 10-year time horizons using either a composite outcome or prostate cancer mortality as the target event. The composite outcome combines the Prostate-Specific Antigen (PSA) test, metastasis, and prostate cancer mortality. Our longitudinal model Recurrent Deep Survival Machine (RDSM) achieved C td 0.85 (0.83), 0.80 (0.83), and 0.76 (0.81), while the cross-sectional model Deep Survival Machine (DSM) attained C td 0.85 (0.82), 0.80 (0.82), and 0.76 (0.79) for the 2-, 5-, and 10-year composite (mortality) outcomes, respectively. In addition to estimating the survival probability, our method can quantify the uncertainty associated with the prediction. The uncertainty scores show a consistent correlation with the prediction accuracy. We find PSA and prostate cancer stage information are the most important indicators in risk prediction. Our work demonstrates the utility of the data-driven machine learning model in prostate cancer risk prediction, which can play a critical role in the clinical decision system.

60 APPLIED LIFE SCIENCES↗

Deep ocean metagenomes provide insight into the metabolic architecture of bathypelagic microbial communities

The deep sea, the largest ocean’s compartment, drives planetary-scale biogeochemical cycling. Yet, the functional exploration of its microbial communities lags far behind other environments. Here we analyze 58 metagenomes from tropical and subtropical deep oceans to generate the Malaspina Gene Database. Free-living or particle-attached lifestyles drive functional differences in bathypelagic prokaryotic communities, regardless of their biogeography. Ammonia and CO oxidation pathways are enriched in the free-living microbial communities and dissimilatory nitrate reduction to ammonium and H 2 oxidation pathways in the particle-attached, while the Calvin Benson-Bassham cycle is the most prevalent inorganic carbon fixation pathway in both size fractions. Reconstruction of the Malaspina Deep Metagenome-Assembled Genomes reveals unique non-cyanobacterial diazotrophic bacteria and chemolithoautotrophic prokaryotes. The widespread potential to grow both autotrophically and heterotrophically suggests that mixotrophy is an ecologically relevant trait in the deep ocean. These results expand our understanding of the functional microbial structure and metabolic capabilities of the largest Earth aquatic ecosystem.

59 BASIC BIOLOGICAL SCIENCES↗

Deep Koopman operators for causal discovery

Causal discovery aims to identify cause-effect mechanisms for better scientific understanding, explainable decision-making, and more accurate modeling. Standard statistical frameworks, such as Granger causality, lack the ability to quantify causal relationships in nonlinear dynamics due to the presence of complex feedback mechanisms, timescale mixing, and nonstationarity. Thus, applying these methods to study causal dynamics in real-world systems, such as the Earth, is a major challenge. Addressing this shortcoming, we leverage deep learning and a Koopman operator-theoretic formalism to present a class of causal discovery algorithms. Kausal uses deep Koopman operator methods to approximate nonlinear dynamics in a linearized vector space in which traditional causal inference methods such as Granger causality can be more easily applied. Our idealized experiments demonstrate Kausal’s superior ability in discovering and characterizing causal signals compared to existing deep learning and non-deep learning state-of-the-art approaches. Finally, the successful identification of major El Niño and La Niña events in observations showcases Kausal’s skill to handle real-world applications.

54 ENVIRONMENTAL SCIENCES↗

Adding labile carbon to peatland soils triggers deep carbon breakdown

Peatlands store vast amounts of carbon, with deep peat carbon remaining stable due to limited thermodynamic energy and transport. However, climate change-induced increases in labile carbon inputs could destabilize these stores. Here, we combined DNA stable isotope probing with stable isotope-assisted metabolomics employing a multi-platform approach to investigate microbial dynamics driving deep peat carbon degradation upon labile carbon (e.g., glucose) amendment. Our findings highlight the vulnerability of deep peat carbon, as glucose addition triggers the breakdown of older organic matter. By uniquely integrating these techniques, we identified active glucose metabolizers to specific microbial populations and mapped carbon flow through microbial networks, elucidating their role in priming recalcitrant carbon mineralization. This multi-omics approach offers crucial insights into how changing resources reshape the peatland microbiome, enhancing our understanding of deep carbon processing, and refining model parameterization to predict microbial responses and carbon cycle feedbacks under global change pressures.

59 BASIC BIOLOGICAL SCIENCES↗

Accelerating End-to-End Deep Learning for Particle Reconstruction using CMS open data

Machine learning algorithms are gaining ground in high energy physics for applications in particle and event identification, physics analysis, detector reconstruction, simulation and trigger. Currently, most data-analysis tasks at LHC experiments benefit from the use of machine learning. Incorporating these computational tools in the experimental framework presents new challenges. This paper reports on the implementation of the end-to-end deep learning with the CMS software framework and the scaling of the end-to-end deep learning with multiple GPUs. The end-to-end deep learning technique combines deep learning algorithms and low-level detector representation for particle and event identification. We demonstrate the end-to-end implementation on a top quark benchmark and perform studies with various hardware architectures including single and multiple GPUs and Google TPU.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nitrogen is a deep acceptor in ZnO

Zinc oxide is a promising material for blue and UV solid-state lighting devices, among other applications. Nitrogen has been regarded as a potential p-type dopant for ZnO. However, recent calculations indicate that nitrogen is a deep acceptor. This paper presents experimental evidence that nitrogen is, in fact, a deep acceptor and therefore cannot produce p-type ZnO. A broad photoluminescence (PL) emission band near 1.7 eV, with an excitation onset of ~2.2 eV, was observed, in agreement with the deep-acceptor model of the nitrogen defect. Thus the deep-acceptor behavior can be explained by the low energy of the ZnO valence band relative to the vacuum level.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Deep levels generated by thermal oxidation in p-type 4H-SiC

Thermal oxidation is an effective method to reduce deep levels, especially the Z{sub 1/2}-center (E{sub C}-0.67 eV), which strongly suppresses carrier lifetimes in n-type 4H-SiC epilayers. The oxidation, however, simultaneously generates other deep levels, HK0 (E{sub V}+0.79 eV) and HK2 (E{sub V}+0.98 eV) centers, within the lower half of the bandgap of SiC, where the HK0 center is a dominant deep level with a concentration of about 1 Multiplication-Sign 10{sup 13} cm{sup -3} after oxidation. By comparing deep levels observed in three sets of p-type 4H-SiC: oxidized, electron-irradiated, and C{sup +}- or Si{sup +}-implanted samples, we find that the HK0 and HK2 centers are complexes including carbon interstitials such as the di-carbon interstitial or di-carbon antisite. Other defects observed in p-type 4H-SiC after electron irradiation or after C{sup +}/Si{sup +} implantation are also studied.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Tunnel-injection quantum dot deep-ultraviolet light-emitting diodes with polarization-induced doping in III-nitride heterostructures

Efficient semiconductor optical emitters in the deep-ultraviolet spectral window are encountering some of the most deep rooted problems of semiconductor physics. In III-Nitride heterostructures, obtaining short-wavelength photon emission requires the use of wide bandgap high Al composition AlGaN active regions. High conductivity electron (n-) and hole (p-) injection layers of even higher bandgaps are necessary for electrical carrier injection. This approach requires the activation of very deep dopants in very wide bandgap semiconductors, which is a difficult task. In this work, an approach is proposed and experimentally demonstrated to counter the challenges. The active region of the heterostructure light emitting diode uses ultrasmall epitaxially grown GaN quantum dots. Remarkably, the optical emission energy from GaN is pushed from 365 nm (3.4 eV, the bulk bandgap) to below 240 nm (>5.2 eV) because of extreme quantum confinement in the dots. This is possible because of the peculiar bandstructure and band alignments in the GaN/AlN system. This active region design crucially enables two further innovations for efficient carrier injection: Tunnel injection of carriers and polarization-induced p-type doping. The combination of these three advances results in major boosts in electroluminescence in deep-ultraviolet light emitting diodes and lays the groundwork for electrically pumped short-wavelength lasers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The effects of deep level traps on the electrical properties of semi-insulating CdZnTe

Deep level traps have considerable effects on the electrical properties and radiation detection performance of high resistivity CdZnTe. A deep-trap model for high resistivity CdZnTe was proposed in this paper. The high resistivity mechanism and the electrical properties were analyzed based on this model. High resistivity CdZnTe with high trap ionization energy E{sub t} can withstand high bias voltages. The leakage current is dependent on both the deep traps and the shallow impurities. The performance of a CdZnTe radiation detector will deteriorate at low temperatures, and the way in which sub-bandgap light excitation could improve the low temperature performance can be explained using the deep trap model.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Hydride vapor phase GaN films with reduced density of residual electrons and deep traps

Electrical properties and deep electron and hole traps spectra are compared for undoped n-GaN films grown by hydride vapor phase epitaxy (HVPE) in the regular process (standard HVPE samples) and in HVPE process optimized for decreasing the concentration of residual donor impurities (improved HVPE samples). It is shown that the residual donor density can be reduced by optimization from ∼10{sup 17} cm{sup −3} to (2–5) × 10{sup 14} cm{sup −3}. The density of deep hole traps and deep electron traps decreases with decreased donor density, so that the concentration of deep hole traps in the improved samples is reduced to ∼5 × 10{sup 13} cm{sup −3} versus 2.9 × 10{sup 16} cm{sup −3} in the standard samples, with a similar decrease in the electron traps concentration.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A servo controlled gradient loading triaxial model test system for deep-buried cavern

A servo controlled gradient loading model test system is developed to simulate the gradient geostress in deep-buried cavern. This system consists of the gradient loading apparatus, the digital servo control device, and the measurement system. Among them, the gradient loading apparatus is the main component which is used for exerting load onto the model. This loading apparatus is placed inside the counterforce wall/beam and is divided to several different loading zones, with each loading zone independently controlled. This design enables the gradient loading. Hence, the “real” geostress field surrounding the deep-buried cavern can be simulated. The loading or unloading process can be controlled by the human-computer interaction machines, i.e., the digital servo control system. It realizes the automation and visualization of model loading/unloading. In addition, this digital servo could control and regulate hydraulic loading instantaneously, which stabilizes the geostress onto the model over a long term. During the loading procedure, the collision between two adjacent loading platens is also eliminated by developing a guide frame. This collision phenomenon is induced by the volume shrinkage of the model when compressed in true 3D state. In addition, several accurate measurements, including the optical and grating-based method, are adopted to monitor the small deformation of the model. Hence, the distortion of the model could be accurately measured. In order to validate the performance of this innovative model test system, a 3D geomechanical test was conducted on a simulated deep-buried underground reservoir. The result shows that the radial convergence increases rapidly with the release of the stress in the reservoir. Moreover, the deformation increases with the increase of the gas production rate. This observation is consistence with field observation in petroleum engineering. The system is therefore capable of testing deep-buried engineering structures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Iron and intrinsic deep level states in Ga 2 O 3

In this study, using a combination of deep level transient spectroscopy, secondary ion mass spectrometry, proton irradiation, and hybrid functional calculations, we identify two similar deep levels that are associated with Fe impurities and intrinsic defects in bulk crystals and molecular beam epitaxy and hydride vapor phase epitaxi-grown epilayers of β-Ga 2 O 3 . First, our results indicate that Fe Ga , and not an intrinsic defect, acts as the deep acceptor responsible for the often dominating E2 level at ~0.78 eV below the conduction band minimum. Second, by provoking additional intrinsic defect generation via proton irradiation, we identified the emergence of a new level, labeled as E2*, having the ionization energy very close to that of E2, but exhibiting an order of magnitude larger capture cross section. Importantly, the properties of E2* are found to be consistent with its intrinsic origin. As such, contradictory opinions of a long standing literature debate on either extrinsic or intrinsic origin of the deep acceptor in question converge accounting for possible contributions from E2 and E2* in different experimental conditions.

36 MATERIALS SCIENCE↗

Deep acceptors and their diffusion in Ga 2 O 3

β–Ga2O 3 is a wide-bandgap material with promising applications in high-power electronics. While n-type doping is straightforward, p-type doping is elusive, with only deep acceptors available. We explore the properties of these acceptors, from the point of view of achieving stable semi-insulating layers, which are essential in many device structures. Using hybrid density functional theory, we obtain the comprehensive first-principles results for a variety of deep-acceptor impurities in Ga 2 O 3 . Among the impurities examined, nitrogen on an oxygen site and magnesium on a gallium site have particularly low formation energies, making them prime candidates for acceptor doping. Closer inspection of various configurations shows that Mg can incorporate not only on Ga sites (where it acts as a deep acceptor under n-type conditions) but also on O sites, where it acts as a deep donor. Mg interstitials adopt a split-interstitial configuration, sharing a site with a host Ga atom. Similarly, N substituting on an O site acts as a compensating center, but N can also incorporate on the Ga site. We evaluate the diffusivities of these species in the crystal by calculating migration barriers and considering which native defects assist in diffusion. We find that diffusion of N is dominantly assisted by O vacancies, while Mg diffusion is assisted by gallium interstitials. Diffusion of Mg proceeds with significantly lower activation energies than diffusion of N. Our results can be used to assess activation energies and diffusion mechanisms for other impurities in Ga 2 O 3 .

36 MATERIALS SCIENCE↗