Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Adversarial Attacks on Deep Neural Network-based Power System Event Classification Models

Online event classification is essential to strengthening the reliability of the power transmission system. Recently, deep learning based methods have achieved great success in numerous domains such as computer vision and natural language processing. Researchers began to adopt deep learning based methods to solve the power system event identification problem and achieved effective results. However, these previous works do not consider that deep learning models are vulnerable to adversarial attacks, potentially influencing real-world applications' reliability. In this paper, we adopt several adversarial attack mechanisms by adding tailored noise signal to the input Phasor Measurement Units (PMU) time series and make the deep learning model misclassify the power system event. This numerical study discloses that current state-of-the-art deep learning based power system event classifiers are extremely vulnerable to adversarial attacks, which may jeopardize the reliability of the power transmission system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hydraulically‐vulnerable trees survive on deep‐water access during droughts in a tropical forest

Summary Deep‐water access is arguably the most effective, but under‐studied, mechanism that plants employ to survive during drought. Vulnerability to embolism and hydraulic safety margins can predict mortality risk at given levels of dehydration, but deep‐water access may delay plant dehydration. Here, we tested the role of deep‐water access in enabling survival within a diverse tropical forest community in Panama using a novel data‐model approach. We inversely estimated the effective rooting depth (ERD, as the average depth of water extraction), for 29 canopy species by linking diameter growth dynamics (1990–2015) to vapor pressure deficit, water potentials in the whole‐soil column, and leaf hydraulic vulnerability curves. We validated ERD estimates against existing isotopic data of potential water‐access depths. Across species, deeper ERD was associated with higher maximum stem hydraulic conductivity, greater vulnerability to xylem embolism, narrower safety margins, and lower mortality rates during extreme droughts over 35 years (1981–2015) among evergreen species. Species exposure to water stress declined with deeper ERD indicating that trees compensate for water stress‐related mortality risk through deep‐water access. The role of deep‐water access in mitigating mortality of hydraulically‐vulnerable trees has important implications for our predictive understanding of forest dynamics under current and future climates.

54 ENVIRONMENTAL SCIENCES↗

Estimating Watershed Subsurface Permeability From Stream Discharge Data using Deep Neural Networks, Frontiers in Earth Science: Dataset

This data package contains watershed modeling inputs and outputs as well as deep neural networks training and testing results used in "Estimating Watershed Subsurface Permeability From Stream Discharge Data using Deep Neural Networks" (Cromwell et al., 2021). We train various deep neural network models with different architectures to predict subsurface permeability from stream discharge hydrograph at the watershed outlet. The training data are obtained from ensemble simulations of hydrographs corresponding to an permeability ensemble using a fully-distributed, integrated surface-subsurface hydrologic model. The trained model is then applied to estimate the permeability of the real watershed using its observed hydrograph at the outlet. Our study demonstrates that the permeabilities of the soil and geologic facies that make significant contributions to the outlet discharge can be more accurately estimated from the discharge data. Their estimations are also more robust with observation errors. Compared to the traditional ensemble smoother method, DNNs show stronger performance in capturing the nonlinear relationship between permeability and stream hydrograph to accurately estimate permeability. Our study sheds new light on the value of the emerging deep learning methods in assisting integrated watershed modeling by improving parameter estimation, which will eventually reduce the uncertainty in predictive watershed models. For detailed information regarding watershed model description and DNNs setup, please refer to Cromwell et al., 2021. The deep_learning.zip file contains the inputs and outputs for the different deep neural networks. The watershed_model.zip file contains the inputs and outputs for watershed simulation using ATS. The figures.zip file contains raw figures and their corresponding scripts. For a more detailed description, please see the README.md file within each compressed file.

54 ENVIRONMENTAL SCIENCES↗

Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)

This data release provides all data and code used in the paper " "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)" to model stream temperature, evaluate, and assess results. The associated manuscript explores current open questions in prediction in ungauged and unmonitored basins concerning top-down versus bottom-up approaches, tradeoffs between data available and input requirements, and the appropriate representation of catchment attributes as inputs to deep learning models. Modeling was done primarily with long short-term memory (LSTM) models, and stream site coverage spans 1362 locations across the conterminous United States. The data is organized into these items items:Code repository and data for the paper " "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)".Code: stream_temp_ml_regionalization.zip contains the code repositoryData to run the code: - data_dir.zip -- contains all files that should be moved to the "DATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- metadata_dir.zip -- contains all files that should be moved to the "METADATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- error_analysis_attribute_and_groundwater_dir.zip - workflows for the extended error analysis by stream attribute and groundwater influenceData produced by the code and used in the paper:- outputs_dir.zip - contains model output and results (outputs_dir/results), model weights (outputs_dir/models), and all other outputs used for the paper including feature importances.To cite this code, please use the following BibTeX or MLA entries:bibtex:@misc{willard2024streamdata, author = {Jared Willard and Fabio Ciulla and Helen Weierbach and Vipin Kumar and Charuleka Varadharajan}, title = {Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models"}, year = {2024}, doi = {10.15485/2448016}, publisher = {ESS-DIVE Repository}, url = {https://doi.org/10.15485/2448016}}MLA: Willard, Jared, et al. Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models". 2024. ESS-DIVE Repository, doi:10.15485/2448016.

54 ENVIRONMENTAL SCIENCES↗

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep learning has exhibited remarkable results across diverse areas. To understand its success, substantial research has been directed towards its theoretical foundations. Nev- ertheless, the majority of these studies examine how well deep neural networks can model functions with uniform regularities. In this paper, we explore a different angle: how deep neural networks can adapt to varying degrees of smoothness in functions and nonuni- form data distributions across different locations and scales. More precisely, we focus on a broad class of functions defined by nonlinear tree-based approximation methods. This class encompasses a range of function types, such as functions with uniform regularities and discontinuous functions. We develop nonparametric approximation and estimation theories for this class using deep ReLU networks. Our results show that deep neural networks are adaptive to the nonuniform smoothness of functions and nonuniform data distributions at different locations and scales. We apply our results to several function classes, and derive the corresponding approximation and generalization errors. The validity of our results is demonstrated through numerical experiments.

97 MATHEMATICS AND COMPUTING↗

Genomic comparisons of a bacterial lineage that inhabits both marine and terrestrial deep subsurface systems

It is generally accepted that diverse, poorly characterized microorganisms reside deep within Earth’s crust. One such lineage of deep subsurface-dwelling bacteria is an uncultivated member of the Firmicutes phylum that can dominate molecular surveys from both marine and continental rock fracture fluids, sometimes forming the sole member of a single-species microbiome. Here, we reconstructed a genome from basalt-hosted fluids of the deep subseafloor along the eastern Juan de Fuca Ridge flank and used a phylogenomic analysis to show that, despite vast differences in geographic origin and habitat, it forms a monophyletic clade with the terrestrial deep subsurface genome of “ Candidatus Desulforudis audaxviator” MP104C. While a limited number of differences were observed between the marine genome of “ Candidatus Desulfopertinax cowenii” modA32 and its terrestrial relative that may be of potential adaptive importance, here it is revealed that the two are remarkably similar thermophiles possessing the genetic capacity for motility, sporulation, hydrogenotrophy, chemoorganotrophy, dissimilatory sulfate reduction, and the ability to fix inorganic carbon via the Wood-Ljungdahl pathway for chemoautotrophic growth. Finally, our results provide insights into the genetic repertoire within marine and terrestrial members of a bacterial lineage that is widespread in the global deep subsurface biosphere, and provides a natural means to investigate adaptations specific to these two environments.

59 BASIC BIOLOGICAL SCIENCES↗

Transferring Files Between the Deep Impact Spacecrafts and the Ground Data System Using the CCSDS File Delivery Protocol (CFDP): A Case Study

The CCSDS File Delivery Protocol (CFDP) Standard could reshape ground support architectures by enabling applications to communicate over the space link using reliable-symmetric transport services. JPL utilized the CFDP standard to support the Deep Impact Mission. The architecture was based on layering the CFDP applications on top of the CCSDS Space Link Extension Services for data transport from the mission control centers to the ground stations. On July 4, 2005 at 1:52 A.M. EDT, the Deep Impact impactor successfully collided with comet Tempel 1. During the final 48 hours prior to impact, over 300 files were uplinked to the spacecraft, while over 6 thousand files were downlinked from the spacecraft using the CFDP. This paper uses the Deep Impact Mission as a case study in a discussion of the CFDP architecture, Deep Impact Mission requirements, and design for integrating the CFDP into the JPL deep space support services. Issues and recommendations for future missions using CFDP are also provided.

CCSDS File Delivery Protocol (CFDP)↗

Deep Ocean Warming Assessed from Altimeters, GRACE, 3 In-situ Measurements, and a Non-Boussinesq OGCM

Observational surveys have shown significant oceanic bottom water warming, but they are too spatially and temporally sporadic to quantify the deep ocean contribution to the present-day sea level rise (SLR). In this study, altimetry sea surface height (SSH), Gravity Recovery and Climate Experiment (GRACE) ocean mass, and in situ upper ocean (0-700 m) steric height have been assessed for their seasonal variability and trend maps. It is shown that neither the global mean nor the regional trends of altimetry SLR can be explained by the upper ocean steric height plus the GRACE ocean mass. A non-Boussinesq ocean general circulation model (OGCM), allowing the sea level to rise as a direct response to the heat added into the ocean, is then used to diagnose the deep ocean steric height. Constrained by sea surface temperature data and the top of atmosphere (TOA) radiation measurements, the model reproduces the observed upper ocean heat content well. Combining the modeled deep ocean steric height with observational upper ocean data gives the full depth steric height. Adding a GRACE-estimated mass trend, the data-model combination explains not only the altimetry global mean SLR but also its regional trends fairly well. The deep ocean warming is mostly prevalent in the Atlantic and Indian oceans, and along the Antarctic Circumpolar Current, suggesting a strong relation to the oceanic circulation and dynamics. Its comparison with available bottom water measurements shows reasonably good agreement, indicating that deep ocean warming below 700 m might have contributed 1.1 mm/yr to the global mean SLR or one-third of the altimeter-observed rate of 3.11 +/- 0.6 mm/yr over 1993-2008.

sea level↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-of-the-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Deep-learning↗

Deep Learning for Scientific Discovery

Deep learning has positively impacted fields were perceptive tasks are paramount, such as computer vision and natural language processing. Tremendous strides have also been made in deep reinforcement learning towards robotics and gaming. Given the success in these fields, it is apparent that deep learning may also accelerate scientific discovery. Herein, we discuss several topic areas where modern representation learning is driving innovation. This article presents a) learning non-linear models from data, b) learning scientific laws from models, c) deep learning on graphs, and d) approaches to scalable deep learning.

deep learning, scientific computing, koopman, mate↗

CORE ANALYSIS, DESIGN AND OPTIMIZATION OF A DEEP-BURN PEBBLE BED REACTOR

Achieving a high burnup in the Deep-Burn pebble bed reactor design, while remaining within the limits for fuel temperature, power peaking and temperature reactivity feedback, is challenging. The high content of Pu and Minor Actinides in the Deep-Burn fuel significantly impacts the thermal neutron energy spectrum. This can result in power and temperature peaking in the pebble bed core in locally thermalized regions near the graphite reflectors. Furthermore, the interplay of the Pu resonances of the neutron absorption cross sections at low-lying energies can lead to a positive temperature reactivity coefficient for the graphite moderator at certain operating conditions. To investigate the aforementioned effects a code system using existing codes has been developed for neutronic, thermal-hydraulic and fuel depletion analysis of Deep-Burn pebble bed reactors. A core analysis of a Deep-Burn Pebble Bed Modular Reactor (400 MWth) design has been performed for two Deep-Burn fuel types and possible improvements of the design with regard to power peaking and temperature reactivity feedback are identified.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Residential heating, ventilation, and air conditioning (HVAC) has been considered as an important demand response resource. However, the optimization of residential HVAC control is no trivial task due to the complexity of the thermal dynamic models of buildings and uncertainty associated with both occupant-driven heat loads and weather forecasts. In this paper, we apply a novel model-free deep reinforcement learning (RL) method, known as the deep deterministic policy gradient (DDPG), to generate an optimal control strategy for a multi-zone residential HVAC system with the goal of minimizing energy consumption cost while maintaining the users’ comfort. Here, the applied deep RL-based method learns through continuous interaction with a simulated building environment and without referring to any prior model knowledge. Simulation results show that compared with the state-of-art deep Q network (DQN), the DDPG-based HVAC control strategy can reduce the energy consumption cost by 15% and reduce the comfort violation by 79%; and when compared with a rule-based HVAC control strategy, the comfort violation can be reduced by 98%. In addition, experiments with different building models and retail price models demonstrate that the well-trained DDPG-based HVAC control strategy has high generalization and adaptability to unseen environments, which indicates its practicability for real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Trends and Future Challenges in Sampling the Deep Terrestrial Biosphere

Research in the deep terrestrial biosphere is driven by interest in novel biodiversity and metabolisms, biogeochemical cycling, and the impact of human activities on this ecosystem. As this interest continues to grow, it is important to ensure that when subsurface investigations are proposed, materials recovered from the subsurface are sampled and preserved in an appropriate manner to limit contamination and ensure preservation of accurate microbial, geochemical, and mineralogical signatures. On February 20th, 2014, a workshop on “Trends and Future Challenges in Sampling The Deep Subsurface” was coordinated in Columbus, Ohio by The Ohio State University and West Virginia University faculty, and sponsored by The Ohio State University and the Sloan Foundation’s Deep Carbon Observatory. The workshop aims were to identify and develop best practices for the collection, preservation, and analysis of terrestrial deep rock samples. This document summarizes the information shared during this workshop.

contamination↗

Microbial and Mineralogical Characterizations of Soils Collected from the Deep Biosphere of the Former Homestake Gold Mine, South Dakota

A microbial census on the deep biosphere (1.34 km depth) microbial communities was performed in two soil samples collected from the Ross and number 6 Winze sites of the former Homestake gold mine, Lead, South Dakota using high-density 16S microarrays (PhyloChip). Mineralogical characterization of soil samples was carried out using X-ray diffraction, X-ray photoelectron, and Mössbauer spectroscopic techniques which demonstrated the presence of silicates and iron minerals (phyllosilicates and clays) in both samples. Microarray data revealed extensive bacterial diversity in soils and detected the largest number of taxa in Proteobacteria phylum followed by Firmicutes and Actinobacteria. The archael communities in the deep gold mine environments were less diverse and belonged to phyla Euryarchaeota and Crenarchaeota. Both the samples showed remarkable amount of similar microbial communities (1360 common OTUs) despite of distinct geochemical characteristics. A total of 57 phylotypes could not be classified even at phylum level representing a hitherto unidentified diversity in deep biosphere. PhyloChip data also suggested considerable metabolic diversity in deep biosphere by capturing several physiological groups of bacteria such as sulfur-oxidizer, ammonia-oxidizers, iron-oxidizers, methane-oxidizers, and sulfate-reducers in both samples. Application of high-density microarrays revealed the vast prokaryotic diversity ever reported from deep subsurface habitat of gold mines.

54 ENVIRONMENTAL SCIENCES↗

Automatic identification and quantification of dense microcracks in high-performance fiber-reinforced cementitious composites through deep learning-based computer vision

Highlights: • A method is presented to detect, locate, quantify, and visualize dense microcracks in HPFRCC. • Quantification of dense microcracks is realized using deep learning method for the first time. • The presented method uses deep learning models that are trained using a realistic dataset size. • The presented method has a high computation efficiency for identifying and quantifying cracks. • The presented method provides crack width with errors up to 50 μm and a R{sup 2} value of 0.984. High-performance fiber-reinforced cementitious composites (HPFRCCs) feature high mechanical strengths, crack resistance, and durability. Under excessive loading, HPFRCCs demonstrate dense microcracks that are difficult to identify using existing methods. This study presents a computer vision method for identification, quantification, and visualization of microcracks in HPFRCCs based on deep learning. The presented method integrates multiple deep learning models and computer vision techniques in a hierarchical architecture. The crack pattern (e.g., number, width, and spacing of cracks) are automatically determined from pictures without human intervention. This study shows that the presented method achieves an accuracy of 0.992 for crack detection and an accuracy finer than 50 μm (R{sup 2} > 0.984) for quantification of crack width when deep learning models are trained using only 200 pictures of HPFRCCs and 200 pictures of conventional concrete with incorporation of data augmentation. The presented method is expected to be also applicable to other materials featuring complex cracks.

36 MATERIALS SCIENCE↗

Root-driven weathering impacts on mineral-organic associations in deep soils over pedogenic time scales

Plant roots are primary weathering agents in deep soils, yet the impact of resulting mineral transformations on the vast deep soil carbon (C) reservoir are largely unknown. Root-driven weathering of primary minerals causes the formation of reactive secondary minerals, which may protect mineral-organic associations (MOAs) for centuries or millennia. Conversely, root-driven weathering may also transform secondary minerals, potentially enhancing the bioavailability of C previously protected in MOAs. Here we examined the impact of root-driven weathering on MOAs and their capacity to store C over pedogenic time scales. To accomplish this, we compared soil that experienced root-driven weathering, resulting in the formation of discrete rhizosphere zones in deep soil horizons (100-160 cm) of the Santa Cruz Marine Terrace chronosequence (65ka-226ka), with adjacent soil that experienced no root growth. Using a combination of radiocarbon, mass spectrometry, Mössbauer spectroscopy, and X-ray spectromicroscopy approaches, we characterized transformations of mineral-organic associations in relation to changes in C content, turnover and chemistry across four soils ranging in age from 65 to 226 ka. We found that the onset of root-driven weathering (65-90ka) increased the amount of C associated with poorly crystalline iron (Fe) and aluminum (Al) phases, particularly highly-disordered np-goethite. This increase coincided with greater C concentrations, longer C residence times, and a greater abundance of microbially-derived C. Continued root-driven weathering (137-226ka) did not significantly change the amount of C associated with crystalline Fe and Al phases, but resulted in a decline in the amount of C associated with poorly crystalline metal phases. This decline coincided with a decrease in C concentrations and potential turnover rates, and a shift toward plant-derived C. In contrast, soil not affected by root-driven weathering showed comparatively low amounts of C bound in poorly crystalline Fe and Al phases regardless of soil age and, correspondingly, lower C concentrations and estimated residence times. Furthermore, our results demonstrate that root driven-formation and disruption of poorly crystalline Fe and Al phases is a direct control on both C accrual and loss in deep soil. This finding suggests that root impacts on soil C storage are dependent on soil weathering stage, a consideration that is critical for future predictions of the vulnerability of deep soil C to global change.

58 GEOSCIENCES↗

Simulated Precipitation Diurnal Variation With a Deep Convective Closure Subject to Shallow Convection in Community Atmosphere Model Version 5 Coupled With CLUBB

In order to improve the physical consistency between shallow and deep convection, we modify the deep convective closure in the Community Atmosphere Model version 5 (CAM5) coupled with a third-order turbulence closure parameterization (i.e., Cloud Layers Unified by Binormals; CLUBB). The revised closure reserves a portion of the total convective available potential energy for shallow convection via utilizing the heating and moistening profiles from CLUBB to distribute moisture and energy between shallow and deep convection. Simulations at two resolutions (i.e. 2° and 0.5°, respectively) are conducted to investigate the impacts of convective closure on the simulated precipitation diurnal variations. Results from low-resolution simulations show that the revised closure suppresses deep convection until the lower troposphere is sufficiently moistened by shallow convection, which improves the precipitation diurnal variation simulations compared to the default closure, with the precipitation diurnal peak over tropical lands delayed from 12LST to 19LST. The revised closure better simulates the diurnal variations for precipitation over the Asian monsoon region, such as the delayed precipitation onset, but still fails to well capture the nighttime peak for precipitation there. This deficiency is alleviated to some extent when applying the revised closure in highresolution simulations, but nighttime precipitation is still underestimated probably because key processes responsible for nighttime convection are missing. Altogether, our results indicate that establishing the consistency between shallow and deep convection is critical for the precipitation diurnal cycle simulations.

54 ENVIRONMENTAL SCIENCES↗