Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep well”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Deep Gravity model for mobility flows generation

The movements of individuals within and among cities influence critical aspects of our society, such as well-being, the spreading of epidemics, and the quality of the environment. When information about mobility flows is not available for a particular region of interest, we must rely on mathematical models to generate them. In this work, we propose Deep Gravity, an effective model to generate flow probabilities that exploits many features (e.g., land use, road network, transport, food, health facilities) extracted from voluntary geographic data, and uses deep neural networks to discover non-linear relationships between those features and mobility flows. Our experiments, conducted on mobility flows in England, Italy, and New York State, show that Deep Gravity achieves a significant increase in performance, especially in densely populated regions of interest, with respect to the classic gravity model and models that do not use deep neural networks or geographic data. Deep Gravity has good generalization capability, generating realistic flows also for geographic areas for which there is no data availability for training. Finally, we show how flows generated by Deep Gravity may be explained in terms of the geographic features and highlight crucial differences among the three considered countries interpreting the model’s prediction with explainable AI techniques.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Microreactor Deep Dive Presentation

This presentation contains information on the performance of the SPHERE gap conductance testing as well as future work involving x-ray imaging work on sodium filled heat pipes.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Suppression of diffraction in deep-inelastic scattering on nuclei and dynamical mechanism of leading twist nuclear shadowing

Abstract Using the leading twist approach (LTA) to nuclear shadowing, we calculate the ratios of diffractive and usual parton distributions for a heavy nucleus (Pb) and the proton,$$ {R}_{A/p}=\left({f}_{i/A}^{D(3)}/{f}_{i/A}\right)/\left({f}_{i/p}^{D(3)}/{f}_{i/p}\right) $$ R A / p = f i / A D 3 / f i / A / f i / p D 3 / f i / p , for coherent and summed (coherent plus quasi-elastic) nuclear deep-inelastic scattering. We find thatR A/p ≈ 0.5 − 1 for quarks as well as for the ratio of the diffractive and total cross sections$$ {\left[\left({d\sigma}_{\textrm{diff}}/{d M}_X^2\right)/{\sigma}_{\textrm{tot}}\right]}_{eA}/{\left[\left({d\sigma}_{\textrm{diff}}/{d M}_X^2\right)/{\sigma}_{\textrm{tot}}\right]}_{ep} $$ dσ diff / dM X 2 / σ tot eA / dσ diff / dM X 2 / σ tot ep andR A/p ≈ 0.5 − 1.3 for gluons in a broad range ofx, including the kinematics of the Electron-Ion Collider, which reaffirms the difference from the nuclear enhancement ofR A/p predicted in the gluon saturation framework. We demonstrate that the magnitude ofR A/p is controlled by the cross section of the interaction of hadronic fluctuations of the virtual photon with target nucleons, which explains an enhancement ofR A/p in the color dipole model and its suppression in LTA. We argue that the black disk limit corresponds toR A/p = 1 and$$ {R}_{A/p}^{\textrm{coh}} $$ R A / p coh = 0.86 for the summed and coherent scattering, respectively. Relying on an intuitive definition of the saturation scale, we show that the ratio of the saturation scales of a heavy nucleus and proton$$ {Q}_{sA}^2(b)/{Q}_{sp}^2(b)\approx 1 $$ Q sA 2 b / Q sp 2 b ≈ 1 at small impact parametersbdue to the strong leading twist nuclear shadowing and diluteness of the nuclear density.

Physics↗
DOE OSTI2021

Lignin-enzyme interaction: A roadblock for efficient enzymatic hydrolysis of lignocellulosics

Efficiently producing second-generation biofuels from biomass is of strategic significance and meets sustainability targets, but it remains a long-term challenge due to the existence of biomass recalcitrance. Lignin contributes significantly to biomass recalcitrance by physically limiting the access of enzymes to carbohydrates, and this could be partially overcome by applying a pretreatment step to directly target lignin. However, lignin typically cannot be completely removed, and its structure is also significantly altered during the pretreatment. As a result, lignin residue in the pretreated materials still significantly hindered a complete conversion of carbohydrate to its monosugars by interacting with cellulase enzymes. The non-productive adsorption driven by hydrophobic, electrostatic, and/or hydrogen bonding interactions is widely considered as the major mechanism of action governing the unfavored lignin-enzyme interaction. One could argue this type of interaction between lignin residue and the activated enzymes is the major roadblock for efficient enzymatic hydrolysis of pretreated lignocellulosics. To alleviate the negative effects of lignin on enzyme performance, a deep understanding of lignin structural transformation upon different types of pretreatments as well as how and where does lignin bind to enzymes are prerequisites. In the last decade, the progress toward a fundamental understanding of lignin-enzyme interaction, structural characterization of lignin during pretreatment and/or conformation change of enzyme during hydrolysis is resulting in advances in the development of methodologies to mitigate the negative effect of lignin. Here in this review, the lignin structural transformation upon different types of pretreatments and the inhibition mechanism of lignin in the bioconversion of lignocellulose to bioethanol are summarized. Some technologies to minimize the adverse impact of lignin on the enzymatic hydrolysis, including chemical modification of lignin, adding blocking additives, and post-treatment to remove lignin were also introduced. The production of liquid biofuels from lignocellulosic biomass has shown great environmental benefits such as reducing greenhouse gas emissions and mitigate climate change. By addressing the root causes of lignin-enzyme interaction and how to retard this interaction, it is our hope that this comprehensive review will pave the way for significantly reducing the high cost associated with the enzymatic hydrolysis process, and ultimately achieving a cost-effective and sustainable biorefinery system.

09 BIOMASS FUELS↗
DOE OSTI2021

Stiff neural ordinary differential equations

Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODEs in the classical stiff ODE systems of Robertson’s problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson’s problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODEs. The success of learning stiff neural ODEs opens up possibilities of using neural ODEs in applications with widely varying time-scales, such as chemical dynamics in energy conversion, environmental engineering, and life sciences.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Long Term Per-Component Power and Thermal Measurements of the OLCF Summit System

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide a dataset that records the long-term power and thermal behavior of the 200PF pre-exascale supercomputer at the Oak Ridge Leadership Computing Facility (OLCF), Summit. This system is an IBM AC922 based system that has 9,252 IBM Power9 CPUs and 27,756 Nvidia V100 GPUs and can consume up to 13MW power at peak. Heat removal is performed using medium temperature direct liquid cooling and rear-door heat exchanger based secondary cooling loop. Originally extracted from a high-resolution (1Hz) per-component (GPUs, CPUs) measurements from the system, we primarily provide a dataset that has 10-second and 1-minute mean power and thermal measurements selected from five month-long segments over the course of 2020 (January and August), 2021 (February and August), and 2022 (January). For convenience, we also provide various sub datasets randomly sampled from the time and space (hosts) of the cluster. Further details and example code for analysis can be found in the following GitHub repository: https://github.com/at-aaims/summit_power_and_thermal_data

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

OLCF Summit Supercomputer GPU Snapshots During Double-Bit Errors and Normal Operations

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide double-bit errors using system telemetry data and logs collected from the Summit supercomputer, equipped with 27,648 Tesla V100 GPUs with 2nd-generation high-bandwidth memory (HBM2). The dataset relies on Nvidia XID records internally collected by GPU firmware at the time of failure occurrence, on the reboot-time logs of each Summit node, on node-level job scheduler records collected after each job termination, and on a 1Hz data rate from the baseboard management controllers (BMCs) of each Summit compute node using the OpenBMC event subscription protocol. Technical details can be found in the paper Oles et. al “Understanding GPU Memory Corruption at Extreme Scale: The Summit Case Study” ICS’24 (https://doi.org/10.1145/3650200.3656615).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Testbeds for test Readiness: Strategic Snapshot

Test bed engineering, monitoring for underground explosive and nuclear testing will be needed if the United States returns to a test posture of nuclear device testing. To maintain and rebuild the capability of test readiness, agile cost-effective test beds are needed and LANL as well as NNSS are the perfect locations to do this. Shallow and deep boreholes should be created to research containment science, diagnostic placement and optimization, coupling and emplacement science, tracer use for fracture and cratering research, and validation of test article performance.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2021

An out-of-distribution-aware autoencoder model for reduced chemical kinetics

While detailed chemical kinetic models have been successful in representing rates of chemical reactions in continuum scale computational fluid dynamics (CFD) simulations, applying the models in simulations for engineering device conditions is computationally prohibitive. To reduce the cost, data-driven methods, e.g., autoencoders, have been used to construct reduced chemical kinetic models for CFD simulations. Despite their success, data-driven methods rely heavily on training data sets and can be unreliable when used in out-of-distribution (OOD) regions (i.e., when extrapolating outside of the training set). In this paper, we present an enhanced autoencoder model for combustion chemical kinetics with uncertainty quantification to enable the detection of model usage in OOD regions, and thereby creating an OOD-aware autoencoder model that contributes to more robust CFD simulations of reacting flows.Here, we first demonstrate the effectiveness of the method in OOD detection in two well-known datasets, MNIST and Fashion-MNIST, in comparison with the deep ensemble method, and then present the OOD-aware autoencoder for reduced chemistry model in syngas combustion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Enforcing constraints for time series prediction in supervised, unsupervised and reinforcement learning

We assume that we are given a time series of data from a dynamical system and our task is to learn the flow map of the dynamical system. We present a collection of results on how to enforce constraints coming from the dynamical system in order to accelerate the training of deep neural networks to represent the flow map of the system as well as increase their predictive ability. In particular, we provide ways to enforce constraints during training for all three major modes of learning, namely supervised, unsupervised and reinforcement learning. In general, the dynamic constraints need to include terms which are analogous to memory terms in model reduction formalisms. Such memory terms act as a restoring force which corrects the errors committed by the learned flow map during prediction. For supervised learning, the constraints are added to the objective function. For the case of unsupervised learning, in particular generative adversarial networks, the constraints are introduced by augmenting the input of the discriminator. Finally, for the case of reinforcement learning and in particular actor-critic methods, the constraints are added to the reward function. In addition, for the reinforcement learning case, we present a novel approach based on homotopy of the action-value function in order to stabilize and accelerate training. We use numerical results for the Lorenz system to illustrate the various constructions.

Stinis, Panagiotis↗
DOE OSTI2021

Assimilating Scanning Radar Data into Cloud-Scale Models

The aim of this project is to improve the initial conditions of large eddy simulations (LES) of deep convective storms by assimilating scanning radar reflectivity and radial velocity data as well as local environmental observations. Accomplishing this goal often results in more accurate numerical forecasts of clouds and precipitation than if the background initial meteorological conditions are solely relied upon for convection initiation and intensification, as is typical of most operational and research models. Conducted in a storm-scale LES framework, these more accurate numerical analyses can serve as tool to better understand and parameterize land-atmosphere coupling, boundary layer turbulence, and cloud processes, each used for model parameterization development of convection. Our work examined the sensitivity of the numerical representation of cloud-scale wind and microphysical structures to: i) the assimilation of radiosonde observations characterizing the near-storm inflow, ii) the assimilation of radar data of varying resolution for model simulations with grid spacings of 1-km and 0.25-km, and iii) to the assimilation of three-dimensional plan-projection-indicator (PPI) and range-height indicator (RHI) radar volumes. Few studies have explored deep convective storm analyses and forecasts produced by assimilation of radar observations to cloud-scale LES. Furthermore, to our knowledge, no storm-scale DA study has explored the value of assimilating high-resolution sector RHI volumes to determine if they can improve the retrieval of the vertical kinematic and microphysical storm structure aloft over the use of traditionally utilized PPI scans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Convective-storm environments in subtropical South America from high-frequency soundings during RELAMPAGO-CACTI

During the RELAMPAGO-CACTI field experiments in 2018-19, an unprecedented number of balloon-borne soundings were collected in Argentina. Radiosondes were launched from both fixed and mobile platforms, yielding 2712 soundings during the period 15 October 2018-30 April 2019. Approximately 20% of these soundings were collected by highly mobile platforms, strategically positioned for each intensive observing period, and launching approximately once per hour. The combination of fixed and mobile soundings capture both the overall conditions characterizing the RELAMPAGO-CACTI campaign, as well as the detailed evolution of environments supporting the initiation and upscale growth of deep convective storms, including some that produced hazardous hail and heavy rainfall. Episodes of frequent convection were characterized by sufficient quantities of moisture and instability for deep convection, along with deep-layer vertical wind shear supportive of organized or rotating storms. Eleven soundings showed most-unstable convective available potential energy (MUCAPE) exceeding 6000 J kg-1, comparable to the extreme instability observed in other parts of the world with intense deep convection. Parameters used to diagnose severe-storm potential showed that conditions were often favorable for supercells and severe hail, but not for tornadoes, primarily owing to insufficient low-level wind shear. High-frequency soundings also revealed the structure and evolution of the boundary layer leading up to convection initiation, convectively generated cold pools, the South American Low-Level Jet (SALLJ), and elevated nocturnal convection. This sounding dataset will enable improved understanding and prediction of convective storms and their surroundings in subtropical South America, as well as comparisons with other heavily studied regions such as the central United States that have not previously been possible.

Schumacher, Russ S.↗
DOE OSTI2024

The deep-acceptor nature of the chalcogen vacancies in 2D transition-metal dichalcogenides

Abstract Chalcogen vacancies in the semiconducting monolayer transition-metal dichalcogenides (TMDs) have frequently been invoked to explain a wide range of phenomena, including both unintentional p-type and n-type conductivity, as well as sub-band gap defect levels measured via tunneling or optical spectroscopy. These conflicting interpretations of the deep versus shallow nature of the chalcogen vacancies are due in part to shortcomings in prior first-principles calculations of defects in the semiconducting two-dimensional TMDs that have been used to explain experimental observations. Here we report results of hybrid density functional calculations for the chalcogen vacancy in a series of monolayer TMDs, correctly referencing the thermodynamic charge transition levels to the fundamental band gap (as opposed to the optical band gap). We find that the chalcogen vacancies are deep acceptors and cannot lead to n-type or p-type conductivity. Both the (0/−1) and (−1/−2) transition levels occur in the gap, leading to paramagnetic charge states S = 1 / 2 and S = 1, respectively, in a collinear-spin representation. We discuss trends in terms of the band alignments between the TMDs, which can serve as a guide to future experimental studies of vacancy behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep learning potential of mean force between polymer grafted nanoparticles

Grafting polymer chains on the surfaces of nanoparticles is a well-known route to control their self-assembly and distribution in a polymer matrix. A wide variety of self-assembled structures are achieved by changing the grafting patterns on the surface of an individual nanoparticle. However, an accurate estimation of the effective potential of mean force between a pair of grafted nanoparticles that determines their assembly and distribution in a polymer matrix is an outstanding challenge in nanoscience. We address this problem via deep learning. As a proof of concept, here we report a deep learning framework that learns the interaction between a pair of single-chain grafted spherical nanoparticles from their molecular dynamics trajectory. Subsequently, we carry out the deep learning potential of mean force-based molecular simulation that predicts the self-assembly of a large number of single-chain grafted nanoparticles into various anisotropic superstructures, including percolating networks and bilayers depending on the nanoparticle concentration in three-dimensions. The deep learning potential of mean force-predicted self-assembled superstructures are consistent with the actual superstructures of single-chain polymer grafted spherical nanoparticles. This deep learning framework is very generic and extensible to more complex systems including multiple-chain grafted nanoparticles. Finally, we expect that this deep learning approach will accelerate the characterization and prediction of the self-assembly and phase behaviour of polymer-grafted and unfunctionalized nanoparticles in free space or a polymer matrix.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Three-dimensional cooperative inversion of airborne magnetic and gravity gradient data using deep-learning techniques

Using multiple geophysical methods has become a prevailing approach in numerous geophysical applications to investigate subsurface structures and parameters. These multimethod-based exploration strategies have the potential to greatly diminish uncertainties and ambiguities encountered during geophysical data analysis and interpretation. One of the applications is the cooperative inversion of airborne magnetic and gravity gradient data for the interpretation of data obtained in mineral, oil and gas, and geothermal explorations. In this paper, a unified cooperative inversion framework is designed by combining the standard separate inversions with a deep neural network (DNN), which serves as the link between different types of data. A well-trained DNN takes the separately inverted susceptibility and density models as the inputs and provides improved models that will be used as the initial models of deterministic inversions. A two-round iteration strategy is adopted to guarantee the reasonability of the recovered models and overall efficiency of the inversion. In addition, this deep-learning (DL)-based framework demonstrates excellent generalization abilities when tested on models that are entirely distinct from the training data sets. The framework can easily incorporate multiphysics without necessitating any structural changes to the network. Synthetic experiments validate that our DL-based method outperforms conventional separate inversions and cross-gradient-based joint inversion in view of the accuracy of the recovered models and inversion efficiency. Successful application to field data further verifies the effectiveness of our DL-based method.

Geochemistry & Geophysics↗
DOE OSTI2025

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗
DOE OSTI2020

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗
DOE OSTI2021

Atomic Layer Deposition with TiO2 for Enhanced Reactivity and Stability of Aromatic Hydrogenation Catalysts

Hydrogenation of aromatic molecules in fossil- and bio-derived fuels is essential for decreasing emissions of harmful combustion products and addressing growing concerns around urban air pollution. In this work, we used atomic layer deposition to significantly enhance the hydrogenation performance of a conventional supported Pd catalyst by applying an ultrathin coating of TiO2 in a scalable powder coating process. The TiO2-coated catalyst showed substantial gains in the conversion of multiple aromatic molecules, including a 5-fold improvement in turnover frequency versus the uncoated catalyst in the hydrogenation of naphthalene. This activity enhancement was maintained upon scaling the coating synthesis process from 3 to 100 g. Based on the results from Xray photoelectron spectroscopy, X-ray absorption spectroscopy, and computational modeling, the activity enhancement was attributed to ensemble effects resulting from partial TiO2 coverage of the Pd surface rather than fundamental changes to the Pd electronic structure. Additional durability testing confirmed that the TiO2 coating improved the thermal and hydrothermal stability of the catalyst as well as tolerance toward sulfur impurities in the reactant stream. Using an economic model of an industrial deep hydrogenation process, we found that an increase in catalyst activity or lifetime of 2× would justify even a relatively high estimate for the cost of TiO2 atomic layer deposition coatings at scale

atomic layer↗