Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

Deep Green: Structural and Functional Genomic Characterization of Conserved Unannotated Green Lineage Proteins

Our overall objective is to improve and increase functional and structural predictions for a growing number of plant proteins of unknown structure and function (the Deep Green proteins), and to make our predictive data useful and accessible to the larger research community. The project is divided into five major objectives which include 1) Assembly and curation of Deep Green candidate protein sets; 2) in silico structural and functional predictions and network analyses; 3) assembly and validation of reverse genetic resources in Chlamydomonas reinhardtii (Chlamydomonas); 4) high throughput functional genomics characterization and prioritization in Chlamydomonas; and 5) structural validation of selected candidates and functional validation in two important reference plant species, Arabidopsis thaliana (Arabidopsis) and Setaria viridis (Setaria).

59 BASIC BIOLOGICAL SCIENCES↗

Trustworthy Physics-Informed Deep Learning for Predictive Scientific Computing

This project has developed powerful trustworthy physics-informed deep learning (TPiDL) models and methods to fundamentally enhance the scale and power of computational modeling in the scientific and engineering domains. Deep learning (DL) has radically advanced the state-of-the-art in machine learning, computer vision, natural language processing, and also scientific computing. Nevertheless, progress has been driven almost entirely by empirical observations, hacks, and tricks. Under the support of this project, the graph operator learning tools and advanced trustworthy physical informed neural networks have been developed. In addition, stochastic gradient replica-exchange Markov Chain Monte Carlo (MCMC) sampling algorithms have been designed to quantify the uncertainties and speed up the training of large-scale neural networks.

97 MATHEMATICS AND COMPUTING↗

Reconstruction and Selection of Neutrino Interactions in MicroBooNE using Deep Convolutional Neural Networks

In this document, we describe a new reconstruction workflow developed for the MicroBooNE experiment. It features the use of Deep Convolutional Neural Networks trained to recognize key structures within the data sufficient for the 3D reconstruction of neutrino interactions within the detector. As a test of the reconstruction utility, the products of the reconstruction workflow are used to select inclusive charged-current (CC) $\nu_e$ and $\nu_\mu$ interactions in both simulated and real MicroBooNE data. In simulation, our $\nu_e$ and $\nu_\mu$ selections achieve an efficiency of 57% and 68\%, respectively, with a purity of 91% and 96%, respectively. We find that these selections are competitive with the inclusive selections used for the most recent MicroBooNE LEE searches. In particular, the CC-$\nu_e$ inclusive selection efficiency improves by over 20% while also improving sample purity. As a first step in quantifying potential bias, the data and Monte Carlo expectati ons are compared for both selections using the MicroBooNE open data. Within statistical and systematic uncertainties, both the electron and muon CC-inclusive event samples agree. A comparison of the real data events chosen by our work and another reconstruction framework shows that the two analyses each identify a sizeable fraction of events the other does not. This suggests that future analyses integrating the strengths of each could lead to combined gains. This work demonstrates, for the first time on real LArTPC data, state-of-the-art neutrino interaction reconstruction centered around deep learning algorithms.

43 PARTICLE ACCELERATORS↗

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Using Deep Learning to Develop a High Resolution Planetary Boundary Layer Model for Infrasound Propagation

Infrasound, with frequencies less than 20 Hz, is generated by both natural and anthropogenic sources. When one of these sources exerts a force on the atmosphere, infrasonic waves are generated. The propagation of these waves largely depends on temperature, wind speed, and wind direction. Previous work has used deep learning to accurately predict atmospheric specifications to altitudes of ~40 km. However, this model breaks down for local distances because it is too low resolution. Here we use a high-resolution meteorological dataset collected in Las Vegas, Nevada, USA to develop a deep learning model that can predict temperature, wind speed, and wind direction. Predictions are compared to ground truth observations to show that the model performs well at predicting temperature and wind direction but struggles with prediction wind speed. Model limitations and improvements are also discussed.

54 ENVIRONMENTAL SCIENCES↗

A Deep Learning-Based Workflow for Fast Prediction of 3D State Variables in Geological Carbon Storage: A Dimension Reduction Approach

In this study, we used deep learning techniques, which are a form of artificial intelligence, to create fast and effective models for predicting how fluids flow in underground geological formations. This is important for managing geological carbon storage, a method used to fight climate change by storing carbon dioxide underground. The challenge lies in the complex nature of these underground spaces and the large amount of data needed to accurately simulate them. To overcome these issues, we developed a new workflow that reduces the data’s complexity before training the deep learning model and then reconstructs the predicted results in their original form. We also proposed a unique approach to handle the specific complexities found in 3D saturation fields, a crucial aspect of fluid flow prediction. We tested our method using real-world data from the Gulf of Mexico. Our results show that our approach not only accurately predicts fluid behavior but also significantly reduces computation time. This will greatly improve real-time decision-making and risk assessment in large-scale geological carbon storage operations.

Wang, Hongsheng↗

Ash Fouling Free Regenerative Air Preheater for Deep Cyclic Operation

The University of Kentucky (UKy) project titled “Ash Fouling Free Regenerative Air Preheater for Deep Cyclic Operation”, DE-FE0031757, was conducted from 8/15/2019 to 8/14/2024 in two Budget Periods. Other participants included PPL Corporation and Black Dragon Double Boiler. The overall goal was to investigate the proposed self-cleaning technology to achieve ash fouling free air preheater operation in a coal-fired power plant, especially during deep cycling. All project deliverables, milestones, and success criteria were met. UKy obtained the following scientific findings. • Temporary and periodic high temperature of heating elements (450 ~ 500 °F) can prevent ash accumulation and maintain air preheater free of clogging. • The ash samples analysis and unit operation provide solid evidence of ABS formed during low load with SCR ammonia slip being the major cause of ash accumulation, and air preheater clogging can be prevented by raising the heating element temperature up to 450 °F~ 500 °F at which ABS is decomposed. • In-situ self-cleaning can be controlled by monitoring temperature and/or presetting fixed number of cleanings per day. Both approaches in pilot testing show positive results for maintaining an ash free state for the air preheater. • Temperature criteria (cold end or gas outlet temperature) for entering self-cleaning service is critical to balance the number of cleaning cycles with maintaining the ash level. • Temperature criteria (cold end or gas outlet temperature) for exiting self-cleaning service is critical to balance the duration of the cleaning cycles with maintaining the ash level.

01 COAL, LIGNITE, AND PEAT↗

Applying deep learning methods to develop new models of molecular charge transfer, nonadiabatic dynamics, and nonlinear spectroscopy in the condensed phase

Photon- and field-induced charge transfer has central importance in the generation and storage of electricity, the novel properties of materials, photo-induced catalysis, and electro-optic activity (e.g., photovoltaic cells, fuel cells, and organic chromophores for use in optical fibers and light-emission diodes). These non-equilibrium electronic and chemical transformations are probed by ultrafast, nonlinear spectroscopies. Accurate simulations play a crucial role in our ability to understand, optimize, and control these transformations. This project applies modern deep learning and machine learning (ML) methods to dramatically improve models of electronic dynamics, electronic-nuclear dynamics, and spectroscopic measurements for improved simulations of chemistry in complex environments, far from equilibrium phenomena, and processes in extreme environments, such as materials exposed to strong or resonant fields. This project develops accurate neural net models that go beyond predictive capability to also provide new insight into the fundamental physics underlying electron and nuclear dynamics. To achieve its objectives, this project explores and develops customized versions of high-capacity deep learning algorithms/models. These techniques are developed with an emphasis on fundamental chemical insight, not just predictive accuracy, to assist the development of the next generation of quantum simulation methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Challenges in quantifying unparameterized spatial uncertainties in deep geologic repositories for nuclear waste

Spatially heterogeneous uncertainties are prevalent in geophysical modeling applications, such as probabilistic post-closure performance assessment (PA) of deep geologic repositories for nuclear waste. Such uncertainties are often highly influential to model outputs, so it is desirable to identify the most important mechanisms by which they influence model predictions. However, these uncertainties are often unparameterized in the sense that there is no set of parameters that can be specified to yield a particular realization of the uncertainty. Additionally, the uncertainty is not intrinsically endowed with a parameterization that captures a realization’s mechanistic influence on model outputs. Therefore, in this work we present a novel methodology to develop and assess a set of proxy variables that aim to represent this influence. We show how they can be computed, downselected, and incorporated into the construction of statistical surrogate models mapping model inputs to outputs. We present our methodology in the context of a motivating application problem in deep geologic repository PA and discuss the challenges in capturing the effects of these spatial heterogeneities in uncertainty analyses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Toward Complete Merger Identification at Cosmic Noon with Deep Learning

As we enter the era of large imaging surveys such as Roman, Rubin, and Euclid, a deeper understanding of potential biases and selection effects in optical astronomical catalogs created with the use of ML-based methods is paramount. This work focuses on a deeper understanding of the performance and limitations of deep learning-based classifiers as tools for galaxy merger identification. We train a ConvNeXT-Pico model on mock HST CANDELS images from the IllustrisTNG50 simulation. Our focus is on a more challenging classification of galaxy mergers and non-mergers at higher redshifts 1 < z < 1.5, including minor mergers and lower mass galaxies down to the stellar mass of 108M⊙. We demonstrate, for the first time, that a deep learning model, such as the one developed in this work, can successfully identify even minor and low mass mergers even at these redshifts. Our model achieves overall accuracy, purity, and completeness of over 73%. We show that some galaxy mergers can only be identified from certain observation angles, leading to a potential upper limit in overall accuracy. Using Grad-CAMs and UMAPs, we more deeply examine the performance and observe a visible gradient in the latent space with stellar mass and specific star formation rate, but no visible gradient with merger mass ratio or merger stage.

Schechter, Aimee L. [U. Colorado, Boulder]↗

UNCERTAINTY-AWARE DEEP LEARNING FRAMEWORK FOR FORECASTING COASTAL WATER LEVEL IN VIRGINIA BEACH

Coastal areas like Virginia Beach, USA, are increasingly vulnerable to flooding. To mitigate the impact of flooding, it is crucial for the City of Virginia Beach to have reliable 72-hour-ahead (3 days) forecasts of water levels at key gauge locations. To support this effort, several sensors have been installed throughout the city to monitor water levels and other environmental parameters such as wind speed, precipitation, and atmospheric pressure. Leveraging sensor data from one of these locations, we developed an uncertainty-aware deep learning model to forecast water levels. We employed deep quantile regression (DQR) to quantify variability in the predictions and examined the performance of three different model architectures. In addition to exclusively including historical data, we investigated the improvement wind forecasts provide to the accuracy of 72-hour-ahead water level predictions. The results show a twelvefold improvement in the flood forecast for a real flooding event.

Hasan, Mahmud [Thomas Jefferson National Accelerat↗

Research Plan: Foam Delivery of Remedial Amendments to Deep Vadose Zone for Metals and Radionuclides Remediation

Research proposals were submitted to the Scientific and Technical Basis for In Situ Treatment of Metals and Radionuclides Technical Working Group under the US Department of Energy (DOE) Environmental Management Office (specifically, EM-22). After a peer review and selection process, the proposal, “Foam Delivery of Remedial Amendments to Deep Vadose Zone for Metals and Radionuclides Remediation,” submitted by Pacific Northwest National Laboratory (PNNL) was selected for support by the program. A research plan was requested for this EM funded project. The overall objective of this project is to develop foam delivery technology for the distribution of remedial amendments to deep vadose zone sediments for in situ immobilization of metal and radionuclide contaminants. The focus of this research in FY 2009 is on the physical aspects of the foam delivery approach. Specific objectives are to 1) study the foam quality (i.e. the gas volume fraction in foam) influence on injection pressure, 2) study the sediment air permeability influence on injection pressure, 3) investigate liquid uptake in sediment and determine whether a water front will be formed during foam delivery, 4) test amendment distance (and mass) delivery by foam from the injection point, 5) study the enhanced sweeping over heterogeneous systems (i.e., low K zones) by foam delivery relative to water-based delivery under vadose zone conditions, and 6) numerically simulate foam delivery processes in the vadose zone. Laboratory scale experiments will be conducted at PNNL to study a range of basic physical aspects of the foam propagation in sediments, including foam quality and sediment permeability influence on injection pressure, liquid uptake, and foam sweeping across heterogeneous systems. This study will be augmented with separate studies to be conducted at MSE Technology Applications, Inc. (MSE) to evaluate foam transport and amendment delivery at the intermediate-scale. The results of intermediate-scale tests will be used to bridge the gap between the small-scale foam transport studies and the field-scale demonstration. Numerical simulation studies on foam delivery under vadose conditions will be performed to simulate observed foam transport behavior under vadose zone conditions and predict the foam delivery performance at field-scale.

54 ENVIRONMENTAL SCIENCES↗

Combining Multicomponent Seismic Attributes, New Rock Physics Models, and In Situ Data to Estimate Gas-Hydrate Concentrations in Deep-Water, Near-Seafloor Strata of the Gulf of Mexico

The Bureau of Economic Geology was contracted to develop technologies that demonstrate the value of multicomponent seismic technology for evaluating deep-water hydrates across the Green Canyon area of the Gulf of Mexico. This report describes the methodologies that were developed to create compressional (P-P) and converted-shear (P-SV) images of near-seafloor geology from four-component ocean-bottom-cable (4C OBC) seismic data and the procedures used to integrate P-P and P-SV seismic attributes with borehole calibration data to estimate hydrate concentration across two study areas spanning 16 and 25 lease blocks (or 144 and 225 square miles), respectively. Approximately 200 km of two-dimensional 4C OBC profiles were processed and analyzed over the course of the 3-year project. The strategies we developed to image near-seafloor geology with 4C OBC data are unique, and the paper describing our methodology was peer-recognized with a Best Paper Award by the Society of Exploration Geophysicists in the first year of the project (2006). Among the valuable research findings demonstrated in this report, the demonstrated ability to image deep-water near-seafloor geology with sub-meter resolution using a standard-frequency (10-200 Hz) air gun array on the sea surface and 4C sensors on the seafloor has been the accomplishment that has received the most accolades from professional peers. Our study found that hydrate is pervasive across the two study areas that were analyzed but exists at low concentrations. Although our joint inversion technique showed that in some limited areas, and in some geologic units across those small areas, hydrates occupied up to 40-percent of the sediment pore space, we found that when hydrate was present, hydrate concentration tended to occupy only 10-percent to 20-percent of the pore volume. We also found that hydrate concentration tended to be greater near the base of the hydrate stability zone than it was within the central part of the stability zone.

03 NATURAL GAS↗

Deep vadose zone respiration contributions to CO2 fluxes from a semi-arid floodplain, Vadose Zone Journal: Dataset

This data package provides lists of parameter values presented in the paper “Deep vadose zone respiration contributions to CO2 fluxes from a semi-arid floodplain” by Tokunaga et al., Vadose Zone J. 2016. Each table or figure from that paper that contains numerical information is represented as a sheet within the Excel file. Table 1 lists depth profile values for particle-size, bulk density, and parameters for correlating moisture contents with matric potentials. Table 2 lists soil respiration fluxes reported in other studies of semi-arid environments. Figure 3. Presents representative relations between moisture contents with matric potentials. Figure 4 presents depth profiles on different dates at site TT03 for hydraulic head, matric head, pore space volumetric air fraction, temperature, and the effective CO2 diffusion coefficient. Figure 5a presents the time-dependence of relative water table elevation (relative to the deepest measured depth during the study), daily CO2 flux rates at the soil surface, and soil temperature at a depth of 0.20 m. Figure 5b presents continuous measurements of CO2 flux and soil temperature. Figure 6 presents depth profiles on different dates of CO2 concentrations in the gas phase at the 5 monitoring stations. Figure 7 presents CO2 surface fluxes calculated by the gradient method, comparisons between calculated and measured rates at the soil surface, CO2 fluxes at 2m depth, and the ratio of deep (2 m) to surface CO2 fluxes.

54 ENVIRONMENTAL SCIENCES↗

Automatically parallelizing batch inference on deep neural networks using Fiats and Fortran 2023 `do concurrent`

This paper introduces novel programming strategies that leverage features of the Fortran 2023 standard of the International Standards Organization (ISO) to automatically parallelize computations on deep neural networks. The paper focuses on the interplay of object-oriented, parallel, and functional programming paradigms in the Fiats deep learning library. We demonstrate how several infrequently used language features play a role in enabling efficient, parallel execution. Specifically, the ability to explicitly declare that a procedure is pure facilitates inference in the context of the language’s loop-parallelism construct `do concurrent`. Also, explicitly prohibiting the overriding of a parent type’s type-bound procedures eliminates the need for dynamic dispatch in performance-critical code. Finally, this paper uses batch inference calculations on a neural network surrogate for atmospheric aerosol dynamics to demonstrate that LLVM Flang compiler’s automatic parallelization of `do concurrent` achieves roughly the same performance and scalability as achieved by OpenMP compiler directives. We also demonstrate that double-precision inference costs 37–72% longer runtime than default-real precision with most values in the range 57-60%.

Rouson, Damian↗

Deep Water Impact Ensemble Data Set

Asteroids of various sizes, speeds, and compositions are zipping around the solar system with potential future Earth engagements. Most of the earth is covered in ocean and impacts would likely occur in deep ocean water. The IEEE SciVis Contest 2018 is dedicated to the visualization and analysis of simulations designed to study asteroid impacts in deep ocean water.

"asteroid impact" meteor "in situ" visualization↗

Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning

Soil respiration in dryland ecosystems is challenging to model due to its complex interactions with environmental drivers. Knowledge-guided deep learning provides a much more effective means of accurately representing these complex interactions than traditional Q10-based models. Mutual information analysis revealed that future soil temperature shares more information with soil respiration than past soil temperature, consistent with their clockwise diel hysteresis. We explicitly encoded diel hysteresis, soil drying, and soil rewetting effects on soil respiration dynamics in a newly designed Long Short Term Memory (LSTM) model. The model takes both past and future environmental drivers as inputs to predict soil respiration. The new LSTM model substantially outperformed three Q10-based models and the Community Land Model when reproducing the observed soil respiration dynamics in a semi-arid ecosystem. The new LSTM model clearly demonstrated its superiority for temporally extrapolating soil respiration dynamics, such that the resulting correlation with observational data is up to 0.7 while the correlations of the Q10-based models and the Community Land Model (CLM) are less than 0.4. Our results underscore the high potential for knowledge-guided deep learning to replace Q10-based soil respiration modules in Earth system models.

Jiang, Peishi↗