Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep well”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Solving sparse finite element problems on neuromorphic hardware

The finite element method (FEM) is one of the most important and ubiquitous numerical methods for solving partial differential equations (PDEs) on computers for scientific and engineering discovery. Applying the FEM to larger and more detailed scientific models has driven advances in high-performance computing for decades. Here we demonstrate that scalable spiking neuromorphic hardware can directly implement the FEM by constructing a spiking neural network that solves the large, sparse, linear systems of equations at the core of the FEM. We show that for the Poisson equation, a fundamental PDE in science and engineering, our neural circuit achieves meaningful levels of numerical accuracy and close to ideal scaling on modern, inherently parallel and energy-efficient neuromorphic hardware, specifically Intel’s Loihi 2 neuromorphic platform. We illustrate extensions to irregular mesh geometries in both two and three dimensions as well as other PDEs such as linear elasticity. Our spiking neural network is constructed from a recurrent network model of the brain’s motor cortex and, in contrast to black-box deep artificial neural network-based methods for PDEs, directly translates the well-understood and trusted mathematics of the FEM to a natively spiking neuromorphic algorithm.

Applied mathematics↗

Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample

Accurate detection of somatic mutations is challenging but critical in understanding cancer formation, progression, and treatment. We recently proposed NeuSomatic, the first deep convolutional neural network-based somatic mutation detection approach, and demonstrated performance advantages on in silico data. In this study, we use the first comprehensive and well-characterized somatic reference data sets from the SEQC2 consortium to investigate best practices for using a deep learning framework in cancer mutation detection. Using the high-confidence somatic mutations established for a cancer cell line by the consortium, we identify the best strategy for building robust models on multiple data sets derived from samples representing real scenarios, for example, a model trained on a combination of real and spike-in mutations had the highest average performance. The strategy identified in our study achieved high robustness across multiple sequencing technologies for fresh and FFPE DNA input, varying tumor/normal purities, and different coverages, with significant superiority over conventional detection approaches in general, as well as in challenging situations such as low coverage, low variant allele frequency, DNA damage, and difficult genomic regions.

59 BASIC BIOLOGICAL SCIENCES↗

A Physics-Constrained Deep Learning Model for Simulating Multiphase Flow in 3D Heterogeneous Porous Media

Physics-based simulators for multiphase flow in porous media emulate nonlinear processes with coupled physics, and usually require extensive computational resources for software development, maintenance and simulation execution. As a result, a huge demand exists for fast modeling of coupled processes in a wide range of subsurface applications including geological sequestration, hydrocarbon recovery and geothermal energy extraction. In this work, an efficient physics-constrained deep learning model is developed for solving multiphase flow in 3-Dimensional (3D) heterogeneous porous media. The model fully leverages the spatial topology predictive capability of convolutional neural networks, specifically U-Net with successive contracting and expansive steps, and is coupled with an efficient continuity-based smoother to predict flow responses that need spatial continuity. Furthermore, the transient regions are penalized to steer the training process such that the model can accurately capture flow in these regions. The model takes inputs including properties of porous media, fluid properties and well controls, and predicts the temporal-spatial evolution of the state variables (pressure and saturation). While maintaining the continuity of fluid flow, the 3D spatial domain is decomposed into 2D images for reducing training cost, and the decomposition results in an increased number of training data samples and better training efficiency. Additionally, a surrogate model is separately constructed as a postprocessor to calculate well flow rate based on the predictions of state variables from the deep learning model. We use the example of CO 2 injection into saline aquifers, and apply the physics-constrained deep learning model that is trained from physics-based simulation data and emulates the physics process. The model performs prediction with a speedup of ~ 1400 times compared to physics-based simulations, and the average temporal errors of predicted pressure and saturation plumes are 0.27% and 0.099% respectively. Furthermore, water production rate is efficiently predicted by a surrogate model for well flow rate, with a mean error less than 5%. Therefore, with its unique scheme to cope with the fidelity in fluid flow in porous media, the physics-constrained deep learning model can become an efficient predictive model for computationally demanding inverse problems or other coupled processes.

58 GEOSCIENCES↗

Interpretable Data-Driven Probabilistic Power System Load Margin Assessment with Uncertain Renewable Energy and Loads

The increasing uncertainties caused by the high-penetration of stochastic renewable generation resources poses a significant threat to the power system voltage stability. To address this issue, this paper proposes a probabilistic deep kernel learning enabled surrogate model to extract the hidden relationship between uncertain sources, i.e., wind power and loads, and load margin for probabilistic load margin assessment (PLMA). Unlike other deep learning approaches, a kernel SHAP provides the sensitivity analysis as well as interpretability of the inputs to outputs influences. This allows identifying the critical factors that affect load margin so that corrective control can be initiated for stability enhancement. Numerical results carried out on the IEEE 118-bus power system demonstrate the accuracy and efficiency of the proposed data-driven PLMA scheme.

deep kernel learning↗

The JOREK non-linear extended MHD code and applications to large-scale instabilities and their control in magnetically confined fusion plasmas

JOREK is a massively parallel fully implicit non-linear extended magneto-hydrodynamic (MHD) code for realistic tokamak X-point plasmas. It has become a widely used versatile simulation code for studying large-scale plasma instabilities and their control and is continuously developed in an international community with strong involvements in the European fusion research programme and ITER organization. This article gives a comprehensive overview of the physics models implemented, numerical methods applied for solving the equations and physics studies performed with the code. A dedicated section highlights some of the verification work done for the code. A hierarchy of different physics models is available including a free boundary and resistive wall extension and hybrid kinetic-fluid models. The code allows for flux-surface aligned iso-parametric finite element grids in single and double X-point plasmas which can be extended to the true physical walls and uses a robust fully implicit time stepping. Particular focus is laid on plasma edge and scrape-off layer (SOL) physics as well as disruption related phenomena. Among the key results obtained with JOREK regarding plasma edge and SOL, are deep insights into the dynamics of edge localized modes (ELMs), ELM cycles, and ELM control by resonant magnetic perturbations, pellet injection, as well as by vertical magnetic kicks. Also ELM free regimes, detachment physics, the generation and transport of impurities during an ELM, and electrostatic turbulence in the pedestal region are investigated. Regarding disruptions, the focus is on the dynamics of the thermal quench (TQ) and current quench triggered by massive gas injection and shattered pellet injection, runaway electron (RE) dynamics as well as the RE interaction with MHD modes, and vertical displacement events. Also the seeding and suppression of tearing modes (TMs), the dynamics of naturally occurring TQs triggered by locked modes, and radiative collapses are being studied.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Charged Particle Tracking via Edge-Classifying Interaction Networks

Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high-energy particle physics. In particular, particle tracking data are naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges, given a set of hypothesized edges, edge-classifying GNNs identify those corresponding to real particle trajectories. In this work, we adapt the physics-motivated interaction network (IN) GNN toward the problem of particle tracking in pileup conditions similar to those expected at the high-luminosity Large Hadron Collider. Assuming idealized hit filtering at various particle momenta thresholds, we demonstrate the IN’s excellent edge-classification accuracy and tracking efficiency through a suite of measurements at each stage of GNN-based tracking: graph construction, edge classification, and track building. The proposed IN architecture is substantially smaller than previously studied GNN tracking architectures; this is particularly promising as a reduction in size is critical for enabling GNN-based tracking in constrained computing environments. Furthermore, the IN may be represented as either a set of explicit matrix operations or a message passing GNN. Efforts are underway to accelerate each representation via heterogeneous computing resources towards both high-level and low-latency triggering applications.

accelerator physics↗

The role of infrastructure to enable and support electric drive vehicles: A Transportation Research Part D Special Issue

Widespread vehicle electrification appears to be necessary to achieve timely and deep reductions in greenhouse gases (GHG) and pollutant emissions as well as petroleum use in the transportation sector. The lack of a sufficient refuelling infrastructure has defeated many past efforts to promote alternatives to petroleum fuels. The papers in this special issue on the “Role of Infrastructure to Enable and Support Electric Drive Vehicles” address the diverse challenges posed by a transition from fossil-fuelled internal combustion engine vehicles to vehicles powered by electric motors and the special role of refuelling/recharging infrastructure in this transition. Electric drive vehicles are herein considered to be plug-in electric vehicles (PEVs), including plug-in hybrid electric vehicles (PHEVs), battery electric vehicles (BEVs), and hydrogen fuel cell electric vehicles (FCEVs). BEVs and FCEVs are also known as Zero Emission Vehicles (ZEVs) because their propulsion systems produce no tailpipe emissions.

33 ADVANCED PROPULSION SYSTEMS↗

Variability and origins of grain boundary electric potential detected by electron holography and atom-probe tomography

A number of grain boundary phenomena in ionic materials, in particular, anomalous (either depressed or enhanced) charge transport, have been attributed to space charge effects. Developing effective strategies to manipulate transport behaviour requires deep knowledge of the origins of the interfacial charge, as well as its variability within a polycrystalline sample with millions of unique grain boundaries. Electron holography is a powerful technique uniquely suited for studying the electric potential profile at individual grain boundaries, whereas atom-probe tomography provides access to the chemical identify of essentially every atom at individual grain boundaries. Using these two techniques, we show in this paper that the space charge potential at grain boundaries in lightly doped, high-purity ceria can vary by almost an order of magnitude. We further find that trace impurities (<25 ppm), rather than inherent thermodynamic factors, may be the ultimate source of grain boundary charge. These insights suggest chemical tunability of grain boundary transport properties. A number of grain boundary phenomena in ionic materials, such as anomalous charge transport, have been attributed to space charge effects. Space charge potential at grain boundaries in lightly doped, high-purity ceria is now shown to vary by almost an order of magnitude.

36 MATERIALS SCIENCE↗

Optical recognition of constructs using hyperspectral imaging and detection (ORCHID)

Abstract Challenges to deep sample imaging have necessitated the development of special techniques such as spatially offset optical spectroscopy to collect signals that have travelled through several layers of tissue. However, these techniques provide only spectral information in one dimension (i.e., depth). Here, we describe a general and practical method, referred to as Optical Recognition of Constructs Using Hyperspectral Imaging and Detection (ORCHID). The sensing strategy integrates (1) the spatial offset detection concept by computationally binning 2D optical data associated with digital offsets based on selected radial pixel distances from the excitation source; (2) hyperspectral imaging using tunable filter; and (3) digital image binding and collation. ORCHID is a versatile modality that is designed to collect optical signals deep inside samples across three spatial (X, Y, Z) as well as spectral dimensions. The ORCHID method is applicable to various optical techniques that exhibit narrow-band structures, from Raman scattering to quantum dot luminescence. Samples containing surface-enhanced Raman scattering (SERS)-active gold nanostar probes and quantum dots embedded in gel were used to show a proof of principle for the ORCHID concept. The resulting hyperspectral data cube is shown to spatially locate target emitting nanoparticle volumes and provide spectral information for in-depth 3D imaging.

47 OTHER INSTRUMENTATION↗

Analysis of parton distributions in a pion with Bézier parametrizations

We explore the role of parametrizations for nonperturbative QCD functions in global analyses, with a specific application to extending a phenomenological analysis of the parton distribution functions (PDFs) in the charged pion realized in the xFitter fitting framework. The parametrization dependence of PDFs in our pion fits substantially enlarges the uncertainties from the experimental sources estimated in the previous analyses. We systematically explore the parametrization dependence by employing a novel technique to automate generation of polynomial parametrizations for PDFs that makes use of Bézier curves. This technique is implemented in a ++ module that is included in the xFitter program. Our analysis reveals that the sea and gluon distributions in the pion are not well disentangled, even when considering measurements in leading-neutron deep inelastic scattering. For example, the pion PDF solutions with a vanishing gluon and large quark sea are still experimentally allowed, which elevates the importance of ongoing lattice and nonperturbative QCD calculations, together with the planned pion scattering experiments, for conclusive studies of the pion structure. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-pressure electrical conductivity and elasticity of iron-bearing δ-AlOOH

Abstract The electrical conductivity and elasticity of deep hydrous phases are essential to constraining water distribution, as well as deciphering the origins of conductivity anomalies in the lower mantle. To uncover the impact of iron-bearing δ-AlOOH on the geophysical properties of the lower mantle, we carried out synchrotron X-ray diffraction and electrical conductivity measurements on δ-(Al0.52Fe0.48)OOH and (Al0.95Fe0.05)OOH in diamond-anvil cells at pressures up to 75 GPa at room temperature. A sharp volume reduction of ~6.5% was observed in δ-(Al0.52Fe0.48)OOH across the spin transition at 40.8–43.3 GPa, where its electrical conductivity increases steadily without abrupt changes. The electrical conductivity of δ-(Al0.52Fe0.48)OOH is greater than that of pure δ-AlOOH at high pressure, suggesting that both small polaron and proton conduction mechanisms dominate in iron-bearing δ-AlOOH. Furthermore, the high-pressure electrical conductivity profiles are comparable between δ-(Al0.95Fe0.05)OOH and δ-(Al0.52Fe0.48)OOH, indicating that high-iron content only marginally influences the conductivity of iron-bearing δ-AlOOH. Notably, the electrical conductivity of iron-bearing δ-AlOOH along the North Philippine geotherm is greater than the average 1D electrical conductivity profile in the mantle (Ohta et al. 2010a). This result suggests that δ-(Al,Fe)OOH is a promising candidate to account for high conductivity in some subducting slabs.

Geochemistry & Geophysics↗

Estimating irrigation water use from remotely sensed evapotranspiration data: Accuracy and uncertainties at field, water right, and regional scales

Irrigated agriculture is the dominant user of water globally, but most water withdrawals are not monitored or reported. As a result, it is largely unknown when, where, and how much water is used for irrigation. Here, we evaluated the ability of remotely sensed evapotranspiration (ET) data, integrated with other datasets, to calculate irrigation water withdrawals and applications in an intensively irrigated portion of the United States. We compared irrigation calculations based on an ensemble of satellite-driven ET models from OpenET with reported groundwater withdrawals from hundreds of farmer irrigation application records and a statewide flowmeter database at three spatial scales (field, water right group, and management area). At the field scale, we found that ET-based calculations of irrigation agreed best with reported irrigation when the OpenET ensemble mean was aggregated to the growing season timescale (bias = 1.6–4.9%, R 2 = 0.53–0.74), and agreement between calculated and reported irrigation was better for multi-year averages than for individual years. At the water right group scale, linking pumping wells to specific irrigated fields was the primary source of uncertainty. At the management area scale, calculated irrigation exhibited similar temporal patterns as flowmeter data but tended to be positively biased with more interannual variability. Disagreement between calculated and reported irrigation was strongly correlated with annual precipitation, and calculated and reported irrigation agreed more closely after statistically adjusting for annual precipitation. The selection of an ET model was also an important consideration, as variability across ET models was larger than the potential impacts of conservation measures employed in the region. From these results, we suggest key practices for working with ET-based irrigation data that include accurately accounting for changes in soil moisture, deep percolation, and runoff; careful verification of irrigated area and well-field linkages; and conducting application-specific evaluations of uncertainty.

59 BASIC BIOLOGICAL SCIENCES↗

A Public Data Set of Auto-Generated Geotagged PV Site Equipment, Generated via Deep Learning

In this research, we present a data set over 100 photovoltaic (PV) sites in TX, which have been automatically geotagged via a fully autonomous deep learning (DL) pipeline. Specifically, locations of inverters, tracker/fixed tilt rows, batteries, and substations are labeled algorithmically. To ensure high data quality, all systems have been reviewed manually and any deep learning errors have been corrected. This public data set, as well as the open-sourced pipeline used to generate it, is valuable for site planning, modelling, and insurance purposes. Given time and resources, we hope to extend the data set to additional states/regions in the US.

14 SOLAR ENERGY↗

Quantifying the Relevance of Long-Range Forces for Crystal Nucleation in Water

Understanding nucleation from aqueous solutions is of fundamental importance in a multitude of fields, ranging from materials science to biophysics. The complex solvent-mediated interactions in aqueous solutions hamper the development of a simple physical picture, elucidating the roles of different interactions in nucleation processes. In this study, we make use of three complementary techniques to disentangle the role played by short- and long-range interactions in solvent-mediated nucleation. Specifically, the first approach we utilize is the local molecular field (LMF) theory to renormalize long-range Coulomb electrostatics. Second, we use well-tempered metadynamics to speed up rare events governed by short-range interactions. Third, the deep learning-based State Predictive Information Bottleneck approach is employed in analyzing the reaction coordinate of the nucleation processes obtained from the LMF treatment coupled with well-tempered metadynamics. We find that the two-step nucleation mechanism can largely be captured by the short-range interactions, while the long-range interactions further contribute to the stability of the primary crystal state under ambient conditions. Furthermore, by analyzing the reaction coordinate obtained from the combined LMF-metadynamics treatment, we discern the fluctuations on different time scales, highlighting the need for long-range interactions when accounting for metastability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

Grid Energy Storage: Supply Chain Deep Dive Assessment

The report “America’s Strategy to Secure the Supply Chain for a Robust Clean Energy Transition” lays out the challenges and opportunities faced by the United States in the energy supply chain as well as the Federal Government plans to address these challenges and opportunities. It is accompanied by several issue-specific deep dive assessments, including this one, in response to Executive Order 14017 “America’s Supply Chains,” which directs the Secretary of Energy to submit a report on supply chains for the energy sector industrial base. The Executive Order is helping the Federal Government to build more secure and diverse U.S. supply chains, including energy supply chains. To combat the climate crisis and avoid the most severe impacts of climate change, the U.S. is committed to achieving a 50 to 52 percent reduction from 2005 levels in economy-wide net greenhouse gas pollution by 2030, creating a carbon pollution-free power sector by 2035, and achieving net zero emissions economy-wide by no later than 2050. The U.S. Department of Energy (DOE) recognizes that a secure, resilient supply chain will be critical in harnessing emissions outcomes and capturing the economic opportunity inherent in the energy sector transition. Potential vulnerabilities and risks to the energy sector industrial base must be addressed throughout every stage of this transition. The DOE energy supply chain strategy report summarizes the key elements of the energy supply chain as well as the strategies the U.S. Government is starting to employ to address them. Additionally, it describes recommendations for Congressional action. DOE has identified technologies and crosscutting topics for analysis in the one-year time frame set by the Executive Order. Along with the capstone policy report, DOE is releasing 11 deep dive assessment documents, including this one, covering the following technology sectors: carbon capture materials; electric grid including transformers and high voltage direct current (HVDC); energy storage; fuel cells and electrolyzers; hydropower including pumped storage hydropower (PSH); neodymium magnets; nuclear energy; platinum group metals and other catalysts; semiconductors; solar photovoltaics (PV); and wind. DOE is also releasing two deep dive assessments on the following crosscutting topics: Commercialization and competitiveness; and cybersecurity and digital components. More information can be found at www.energy.gov/policy/supplychains.

25 ENERGY STORAGE↗

Improving Deep Neural Networks’ Training for Image Classification With Nonlinear Conjugate Gradient-Style Adaptive Momentum

Momentum is crucial in stochastic gradient-based optimization algorithms for accelerating or improving training deep neural networks (DNNs). In deep learning practice, the momentum is usually weighted by a well-calibrated constant. However, tuning the hyperparameter for momentum can be a significant computational burden. In this article, we propose a novel adaptive momentum for improving DNNs training; this adaptive momentum, with no momentum-related hyperparame- ter required, is motivated by the nonlinear conjugate gradient (NCG) method. Stochastic gradient descent (SGD) with this new adaptive momentum eliminates the need for the momentum hyperparameter calibration, allows using a significantly larger learning rate, accelerates DNN training, and improves the final accuracy and robustness of the trained DNNs. For example, SGD with this adaptive momentum reduces classification errors for training ResNet110 for CIFAR10 and CIFAR100 from 5.25% to 4.64% and 23.75% to 20.03%, respectively. Furthermore, SGD, with the new adaptive momentum, also benefits adversarial training and, hence, improves the adversarial robustness of the trained DNNs.

97 MATHEMATICS AND COMPUTING↗