Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Geothermal Play-Fairway Analysis of Washington State Prospects: Final Report

The Washington State Geothermal Play-Fairway Analysis overcomes the exploration challenges posed by dense vegetation, glacial deposits, and extreme precipitation. The geothermal play-fairways we target are locations where heat, permeability, and saturated porosity are present in sufficient volume to provide adequate heat exchange at depths accessible by modern drilling technology. The three study areas lie along the Cascade Range magmatic arc and are near Mount Baker, Mount St. Helens, and the Wind River Valley. The seven-year project is divided into three phases. In Phase 1 we build on a previous statewide assessment of geothermal resources and develop an initial modeling approach. The results are a series of favorability, uncertainty, and risk maps for three targeted study areas. Based on these initial results, we collect new geologic and geophysical data to further refine our modeling and reduce exploration uncertainty in Phase 2. We improve the modeling method to handle the new data and update the favorability, uncertainty, and risk maps. We also update the conceptual geothermal resource models. In Phase 3 we validate our modeling approach by drilling two temperature-gradient holes and collecting and analyzing core, image logs, and new geochemistry. Our modeling approach improves on an earlier statewide method through a more-rigorous and detailed assessment of heat and permeability. Permeability potential is assessed through geomechanical modeling of the deformation that can generate and maintain reservoir porosity and permeability. Metrics to inform heat potential include temperature-gradient wells, which are sparse in Washington; proximity of Quaternary volcanic vents and young intrusive rock; spring temperature; and reservoir temperature inferred from geothermometry. We weight the individual components using an expert-guided approach known as the Analytical Hierarchy Process. During Phase 2 we also develop a fluid-filled fracture model, and an infrastructure model that helps to delineate areas which are more favorable for geothermal development based on proximity to transmission lines, elevation, land ownership and use restrictions, and availability of process water. New geologic and geophysical data is collected during Phase 2 in each of our three main study areas. At Mount Baker and north of Mount St. Helens we conduct 1:24,000-scale geologic mapping and lidar analysis to better constrain the location and character of surface faults; detailed mapping in the Wind River Valley was completed just prior to the start of this project. Ages of intrusive rocks are determined with 40 Ar/ 39 Ar geochronology, though all of our samples are Miocene or older. We collect ground based gravity observations (a total of 1,580 new stations) in all of our study areas and ground-based magnetic lines (a total of 93 km) at Mount Baker. These data are combined with existing gravity and aeromagnetic data and used to constrain fault locations and geometry. Two to three cross sections are constructed at each study area using the mapped surface geology and forward-modeling of the gravity and magnetic data; these cross sections form the basis for our updated conceptual models. We collect magnetotelluric surveys at Mount Baker and Mount St. Helens and these data are inverted to form a resistivity model from the surface to about 10 km depth; each model shows conductive zones that can be interpreted as upwelling geothermal fluids. At Mount St. Helens we deploy a passive seismic array and use the newly detected events to refine the location of the Saint Helens seismic zone. We also employ ambient-noise tomography to develop a detailed seismic-velocity model for the study area and use this model to help constrain our cross sections and conceptual model. Based on the new data collected during Phase 2—and our updated models—we develop a campaign of temperature-gradient holes and core analysis to validate our modeling in Phase 3. Drill hole MB76-31 is located near Little Park Creek, 11 km west-southwest of the summit of Mount Baker, and is 1,471 ft deep. About 410 ft of core from the lower portion of the hole—and image logs from ~175 ft below ground surface to the bottom—are collected and analyzed. Water samples are collected and processed for geothermometry. Drill hole MSH17-24 is located along upper Schultz Creek, 16 km north-northeast of Mount St. Helens and has core from 470 ft to the bottom at 1,053 ft. We did not collect image logs due to borehole stability concerns, but water samples are collected and analyzed for geothermometry. Repeat temperature-gradient measurements are made at both sites and thermal conductivity is measured from core samples. At MB76-31, the equilibrated temperature gradient of 64°C/km and calculated heat flow of 141–159 mW/m 2 is more than twice the regional average. Detailed mapping and analysis of the core, coupled with correlation to the image logs, indicates a history of permeability generation consistent with our predictions of high permeability. Because the site has high favorability in the Phase 2 model, we consider the results a positive validation of the modeling. At site MSH17-24, the equilibrated temperature gradient of ~15°C/km and calculated heat flow of 41–43 mW/m 2 are similar to regional. Geochemical analysis of the water samples indicates a meteoric source without any geothermal component. Detailed outcrop-based mapping of fault exposures near the drill site and analysis of image logs from nearby boreholes indicates a history of permeability generation consistent with our predictions. Because the site has low favorability in the Phase 2 model, we consider the results a positive validation of the modeling. Together, the two sites provide a reasonably positive validation of the Phase 2 modeling and should encourage future use of this modeling approach.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Toward a First-Principles Framework for Predicting Collective Properties of Electrolytes

Conspectus Given the universal importance of electrolyte solutions, it is natural to expect that we have a nearly complete understanding of the fundamental properties of these solutions (e.g., the chemical potential) and that we can therefore explain, predict, and control the phenomena occurring in them. In fact, reality falls short of these expectations. But, recent advances in the simulation and modeling of electrolyte solutions indicate that it should soon be possible to make progress toward these goals. In this Account, we will discuss the use of first-principles interaction potentials based in quantum mechanics (QM) to enhance our understanding of electrolyte solutions. Specifically, we will focus on the use of quantum density functional theory (DFT) combined with molecular dynamics simulation (DFT-MD) as the foundation for our approach. The overarching concept is to understand and accurately reproduce the balance between local or short-ranged (SR) structural details and long-range (LR) correlations, allowing the prediction of the thermodynamics of both single ions in solution as well as the collective interactions characterized by activity/osmotic coefficients. In doing so, relevant collective motions and driving forces characterized by chemical potentials can be determined. Here, in this Account, we will make the case that understanding electrolyte solutions requires a faithful QM representation of the SR nature of the ion–ion, ion–water, and water–water interactions. However, the number of molecules that is required for collective behavior makes the direct application of high-level QM methods that contain the best SR physics untenable, making methods that balance accuracy and efficiency a practical goal. Alternatives such as continuum solvent models (CSMs) and empirically based classical molecular dynamics have been extensively employed to resolve this problem but without yet overcoming the fundamental issue of SR accuracy. We will demonstrate that accurately describing the SR interaction is imperative for predicting both intrinsic properties, namely, at infinite dilution, and collective properties of electrolyte solutions. DFT has played an important role in our understanding of condensed phase systems, e.g., bulk liquid water, the air–water interface, ions in bulk, and at the air–water interface. This approach holds huge promise to provide benchmark calculations of electrolyte solution properties that will allow for the development and improvement of more efficient methods, as well as an enhanced understanding of fundamental phenomena. However, the standard protocol using the generalized gradient approximation with van der Waals (vdW) correction requires improvement in order to achieve a high level of quantitative accuracy. Simply simulating with higher level DFT functionals may not be the best route considering the significant computational cost. Alternative methods of incorporating information from higher levels of QM should be explored; e.g., using force matching techniques on small clusters, where high level benchmark calculations are possible, to develop ideal correction terms to the DFT functional is a promising possibility. We argue that DFT with statistical mechanics is becoming an increasingly useful framework enabling the prediction of collective electrolyte properties.

Duignan, Timothy T.↗
DOE OSTI2021

A Machine Learning-based Reliability Evaluation Model for Integrated Power-Gas Systems

This article proposes a hybrid machine learning method for the reliability evaluation of integrated power-gas systems (IPGS) under the uncertain component failure probability distributions. The Random Forest (RF) method is designed to select important features to solve the insufficient quantity of data and the curse of dimensionality problems. The Extreme Gradient Boosting (XGBoost) regression algorithm is developed to quantify the relationship between the uncertain parameters and reliability metrics. Moreover, a ten-fold cross-validation method is employed to further improve the accuracy of the regression model. Simulation results on three test systems show that the proposed method can achieve high accuracy for the reliability evaluation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series

Abstract. Improving the quantification of soil thermal and physical properties is key to achieving a better understanding and prediction of soil hydro-biogeochemical processes and their responses to changes in atmospheric forcing. Obtaining such information at numerous locations and/or over time with conventional soil sampling is challenging. The increasing availability of low-cost, vertically resolved temperature sensor arrays offers promise for improving the estimation of soil thermal properties from temperature time series, and the possible indirect estimation of physical properties. Still, the reliability and limitations of such an approach need to be assessed. In the present study, we develop a parameter estimation approach based on a combination of thermal modeling, sliding time windows, Bayesian inference, and Markov chain Monte Carlo simulation to estimate thermal diffusivity and its uncertainty over time, at numerous locations and at an unprecedented vertical spatial resolution (i.e., down to 5 to 10 cm vertical resolution) from soil temperature time series. We provide the necessary framework to assess under which environmental conditions (soil temperature gradient, fluctuations, and trend), temperature sensor characteristics (bias and level of noise), and deployment geometries (sensor number and position) soil thermal diffusivity can be reliably inferred. We validate the method with synthetic experiments and field studies. The synthetic experiments show that in the presence of median diurnal fluctuations ≥ 1.5 ∘C at 5 cm below the ground surface, temperature gradients > 2 ∘C m−1, and a sliding time window of at least 4 d the proposed method provides reliable depth-resolved thermal diffusivity estimates with percentage errors ≤ 10 % and posterior relative standard deviations ≤ 5 % up to 1 m depth. Reliable thermal diffusivity under such environmental conditions also requires temperature sensors to be spaced precisely (with accuracy to a few millimeters), with a level of noise ≤ 0.02 ∘C, and with a bias defined by a standard deviation ≤ 0.01 ∘C. Finally, the application of the developed approach to field data indicates significant repeatability in results and similarity with independent measurements, as well as promise in using a sliding time window to estimate temporal changes in soil thermal diffusivity, as needed to potentially capture changes in bulk density or water content.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

High spatial resolution temperature profile measurements of solid-oxide fuel cells

Temperature gradients resulting from local electrochemical reactions, current distribution and geometry of gas flow channels in solid oxide fuel cells (SOFCs) create thermal stresses, localized thermophysical property gradients and uneven property evolution, contributing to SOFC degradation. This paper presents a new method to perform temperature measurements (up to 800°C) at high spatial resolutions to monitor the operation of SOFCs. Using femtosecond laser irradiation, distributed fiber sensors were hardened for high temperature environment applications. Distributed fiber sensors were embedded in interconnected plates using an additive manufacturing method to perform temperature measurements with 4-mm spatial resolution during the operation of a planar fuel cell. The measurement revealed the impact of various H 2 fuel concentrations and current loads have on temperature profiles of the SOFC tested. Temperature variation on the anode side was found to be less than 5°C, and 3°C on the cathode side. The measurements were compared to results from a multiphysics fuel cell performance model simulating similar conditions. These simulations predicted similar temperature gradients, indicating the experimental data obtained is reasonable. The model also predicts that the effect of the embedded sensor has on the local temperature will be minimal and that the gradient of temperature in the gas channels will be captured despite the separation between the sensor and the gas flow. Finally, the high spatial resolution data harnessed by these distributed fiber sensors provides experimental support for model-based design and optimization to improve the operational efficiency and longevity of solid oxide fuel cells and fuel cell assemblies.

25 ENERGY STORAGE↗
DOE OSTI2024

Performant automatic differentiation of local coupled cluster theories: Response properties and ab initio molecular dynamics

In this work, we introduce a differentiable implementation of the local natural orbital coupled cluster (LNO-CC) method within the automatic differentiation framework of the PySCFAD package. The implementation is comprehensively tuned for enhanced performance, which enables the calculation of first-order static response properties on medium-sized molecular systems using coupled cluster theory with single, double, and perturbative triple excitations [CCSD(T)]. We evaluate the accuracy of our method by benchmarking it against the canonical CCSD(T) reference for nuclear gradients, dipole moments, and geometry optimizations. In addition, we demonstrate the possibility of property calculations for chemically interesting systems through the computation of bond orders and Mössbauer spectroscopy parameters for a [NiFe]-hydrogenase active site model, along with the simulation of infrared spectra via ab initio LNO-CC molecular dynamics for a protonated water hexamer.

Chemistry↗
DOE OSTI2021

Randomized Algorithms for Scientific Computing (RASC)

Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Deep Reinforcement Learning-based Reserve Optimization in Active Distribution Systems for Tertiary Frequency Regulation

Federal Energy Regulatory Commission (FERC)Orders 841 and 2222 have recommended that distributed energy resources (DERs) should participate in energy and reserve markets; therefore, a mechanism needs to be developed to facilitate DERs’ participation at the distribution level. Although the available reserve from a single distribution system may not be sufficient for tertiary frequency regulation, stacked and coordinated contributions from several distribution systems can enable them participate in tertiary frequency regulation at scale. This paper proposes a deep reinforcement learning (DRL)-based approach for optimization of requested aggregated reserves by system operators among the clusters of DERs. The co-optimization of cost of reserve, distribution network loss, and voltage regulation of the feeders are considered while optimizing the reserves among participating DERs. The proposed framework adopts deep deterministic policy gradient (DDPG), which is an algorithm based on an actor-critic method. The effectiveness of the proposed method for allocating reserves among DERs is demonstrated through case studies on a modified IEEE 34-node distribution system.

deep reinforcement learning, distributed energy re↗
DOE OSTI2024

NMPC for Mode-Switching Operation of Reversible Solid Oxide Cell Systems

Solid oxide cells (SOCs) are a promising dual-mode technology that generates hydrogen through high-temperature water electrolysis and generates power through a fuel cell reaction that consumes hydrogen. Reversible operation of SOCs requires a transition between these two modes for hydrogen production setpoints as the demand and price of electricity fluctuate. Moreover, a well-functioning control system is important to avoid cell degradation during mode-switching operation. In this work, we apply nonlinear model predictive control (NMPC) to an SOC module and supporting equipment and compare NMPC performance to classical proportional integral (PI) control strategies, while ramping between the modes of hydrogen and power production. While both control methods provide similar performance in many metrics, NMPC significantly reduces cell thermal gradients and curvatures (mixed spatial-temporal partial derivatives) during mode switching. A dynamic process flowsheet of the reversible SOC system was developed in the open-source, equation-based IDAES modeling framework. Our IDAES dynamic simulation results show that NMPC can ramp the SOC system between hydrogen and power production targets within short mode-switching times. Moreover, NMPC can comply with operating limits in the SOC system more effectively than PI, and only NMPC can directly enforce user-specified limits for mixed spatial-temporal partial derivatives of temperature. This allows for management of the trade-off be-tween operating efficiency and cell degradation, which is dependent on these temperature curvatures.

Li, Mingrui↗
DOE OSTI2022

Modelling and Experimental Validation of Improved Performance of Lithium-Ion Batteries Having Thick Electrodes with Laser-Ablated Micro-Structures

For widespread adoption of electric vehicles, lithium-ion batteries (LiBs) need to achieve energy densities of >275 Wh/kg, cost less than $100/Wh, and charge to more than 80% capacity within 15 minutes. Increasing the battery electrode thicknesses is one way to increase cell energy densities while also saving on cell manufacturing cost by increasing the ratio of electrode active material to inactive material within each cell. However, increased electrode loading is often accompanied by decreased Li+-ion diffusion across the full thick electrodes. This leads to significant cell polarization that prevents full capacity utilization and accelerates cell degradation, especially at fast charging/discharging rates. The introduction of secondary pore networks in thick battery electrodes alleviates some of the trade-offs between energy and power performance. These microstructures provide low tortuosity pathways for facile Li+-ion diffusion deep into the thick electrodes, diminishing detrimental concentration gradients within the cell. Ultrafast-pulsed laser ablation is a promising method to introduce micro pores or channels in thick battery electrodes as it allows for precise control of pattern geometries, results in minimal damage to the electrode and can be introduced into existing roll-to-roll electrode manufacturing lines. Herein, the limitations of thick planer electrodes and the advanced predictive models to identify optimal electrode patterns for improved cycling performance will be presented. The impact of electrode laser patterning to create secondary pore networks also will be discussed. Materials characterization techniques (SEM-EDS, XRD) were used to explore the affect ultrafast laser ablation had on the electrode materials’ morphology and structure. The improvements in the patterned electrodes’ electrochemical cycling performances and degrees of wetting will be compared to a pristine baseline case. Finally, the discrepancies between experimentally obtained data and model predictions will be explained.

DIRECT ENERGY CONVERSION,ENERGY STORAGE↗
DOE OSTI2023

High Throughput Laser Processing for Enhanced Battery Performance and Manufacturing

For widespread adoption of electric vehicles, lithium-ion batteries (LiBs) need to achieve energy densities of >275 Wh/kg, cell costs less than $100/kWh, and charge to more than 80% capacity within 15 minutes. Recently, it has been shown that introducing a secondary pore network in thick battery electrodes enables higher extracted capacity without a severe reduction in charge/discharge rate performance. Secondary pore networks consisting of ordered arrays of microstructures reduce tortuosity of Li+-ion transport deep into the thick electrodes, diminishing detrimental concentration gradients within the cell. Ultrafast (femtosecond)-pulsed laser ablation is a promising method to introduce such micro pores or channels in thick battery electrodes as it allows for precise control of pattern geometries, results in minimal damage to the electrode, and can be introduced into existing roll-to-roll electrode manufacturing lines. We have explored laser patterning to create secondary pore networks in a variety of battery electrode materials for both anode and cathode applications and characterized the laser-material interaction parameters. In addition, advanced materials characterization techniques (SEM-EDS, XRD) were used to explore whether ultrafast laser ablation affects the remaining electrode materials' morphology and structure. Furthermore, we have translated lab-scale laser ablation to high-throughput roll-to-roll processing at industrially relevant scales. Finally, we worked with Argonne National Laboratory, developers of the battery cost-analysis package BatPac, to estimate the additional manufacturing costs (CapEx and OpEx) for incorporation of laser-ablation processing to current battery electrode manufacturing. We estimate that ultrafast laser processing will add only -$1kWh, which for considerable improvements in cell performance, creates a compelling case for industry adoption.

battery↗
DOE OSTI2025

A time-parallel multiple-shooting method for large-scale quantum optimal control

Quantum optimal control plays a crucial role in quantum computing by providing the interface between compiler and hardware. Solving the optimal control problem is particularly challenging for multi-qubit gates, due to the exponential growth in computational complexity with the system's dimensionality and the deterioration of optimization convergence. To ameliorate the computational complexity of time-integration, this paper introduces a multiple-shooting approach in which the time domain is divided into multiple windows and the intermediate states at window boundaries are treated as additional optimization variables. Further, this enables parallel computation of state evolution across time-windows, significantly accelerating objective function and gradient evaluations. Since the initial state matrix in each window is only guaranteed to be unitary upon convergence of the optimization algorithm, the conventional gate trace infidelity is replaced by a generalized infidelity that is convex for non-unitary state matrices. Continuity of the state across window boundaries is enforced by equality constraints. A quadratic penalty optimization method is used to solve the constrained optimal control problem, and an efficient adjoint technique is employed to calculate the gradients in each iteration. We demonstrate the effectiveness of the proposed method through numerical experiments on quantum Fourier transform gates in systems with 2, 3, and 4 qubits, noting a speedup of 80x for evaluating the gradient in the 4-qubit case, highlighting the method's potential for optimizing control pulses in multi-qubit quantum systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Conceptual design for a blanket tritium extraction test stand

Tritium breeding is fundamentally required for a sustainable fusion fuel cycle, yet the technological readiness of blanket technology lags far behind other fusion systems. Breeder concepts are divided into solid and liquid media, where solid breeders typically rely on a sweep gas, such as helium, to carry away tritium from lithium containing ceramic materials, and liquid breeders produce tritium from lithium containing eutectics (e.g., PbLi) or molten salts (FLiBe). In each case, tritium must be harvested from the breeding medium. A promising method for tritium extraction is through a vacuum permeator, in which a concentration gradient from the tritium- containing fluid promotes diffusion through a membrane with high hydrogen permeability to the vacuum. This technology has been demonstrated for hydrogen gas systems using Pd and PdAg permeators, but relatively little work has been done to test tritium extraction from PbLi. A Tritium Extraction eXperimental (TEX) loop is being designed to test tritium extraction in a vacuum permeator configuration. The system design is such that it will allow the testing of tritium extraction from both helium and PbLi. A phased approach is being taken that will allow testing of small specimens for fundamental permeation measurements, to multi-meter component testing at near-prototypic conditions. A molten PbLi loop is challenging due to the toxic and explosive nature of Pb and Li, respectively, radiological concerns by introducing tritium, and high temperatures involved in such a system. In addition, PbLi corrosion is a significant issue at high temperatures (>400C). The TEX system will not employ a neutron source for volumetric production of tritium. Herein we present the design and methods used for 1) pumping PbLi, 2) introducing deuterium or tritium into the PbLi, 3) quantifying the amount of deuterium in the loop, 4) extracting deuterium and tritium, and 5) quantifying the total amount of extracted deuterium or tritium from the permeator. In addition, the safety design for operating such a system will be discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Gradient-Descent-Based Learning Gain for Backstepping Controller and Disturbance Observer of Nonlinear Systems

This paper proposes a gradient-descent-based learning (GL) gain for backstepping controller and disturbance observer (DOB) of nonlinear system. The proposed method consists of the GL gain update law, controller, and DOB. The GL gain update law is proposed to adapt the control gain and DOB gain according to the direction that minimizes the cost function. The mathematical analysis reveals that the GL gain always has a positive sign and upper bound. The controller is designed via a backstepping procedure to track the desired output with GL control gain. The DOB is designed to estimate the unknown external disturbance with the GL DOB gain. Because the control and DOB gains are simultaneously tuned to achieve improved performance, the time consumption for tuning can be reduced. In addition, the peaking phenomenon can be avoided initially by a small initial value of GL gains. The stability of the closed-loop system is guaranteed using the input-to-state stability property. The performance of the proposed method was validated via simulations and experiments using a DC motor.

42 ENGINEERING↗
DOE OSTI2026

Correlating Surface Processing of Nb Superconducting RF Cavities with the Evolution of Surface Electronic States

Superconducting-radio frequency (RF) cavities provide an efficient way to accelerate particle beams with extremely high acceleration gradients while generating very small power dissipation. The few nanometers of the surface play a critical role in defining the RF performance of superconducting Nb based cavities. Over the past two decades, several pioneering surface treatment and processing methods have emerged, enabling remarkable improvements in superconducting cavity performance by simultaneously achieving high quality factors with increasing maximum acceleration gradients. These processing approaches include chemical polishing, distinct multi-step thermal treatments under ultra-high vacuum (UHV) conditions over low to high temperature regimes, as well as high-temperature treatments under controlled nitrogen atmospheres. Beyond their macroscopic impact on RF performance, these methods produce distinct surface oxide configurations characterized by different valence states, oxide thicknesses, chemical uniformity, and oxygen concentration profiles extending into the near-surface bulk of niobium. In this work, we are trying to understand how the surface-processing methods and the resulting oxide/oxygen profiles affect the electronic structure of surface and the mechanism of superconductivity. Using a combination of X-ray photoemission and X-ray absorption spectroscopies, we investigate how the valence-band structure and the electronic density of states (DoS) near the Fermi level evolve under different surface treatments. By employing tunable photon energies across multiple elemental absorption edges, we use resonant photoemission to disentangle and identify the elemental contributions to specific valence-band features. Our observations show that different surface-processing methods lead to distinct temperature evolutions of the DoS and valence-band states near the Fermi level. Our results suggest variations in different Nb-O orbital hybridizations in distinct processes and point towards the possibility of different underlying mechanisms of superconductivity governed by surface chemistry and oxide configuration. We also correlate these distinct superconducting mechanisms with RF cavity performance, specifically focusing on measured surface resistance, the nature of the Q-slope, and quench fields observed in superconducting RF measurements. These results will enable us to identify the potential limiting factors and relevant controllable parameters that can be further optimized to improve the performance of superconducting RF cavities.

Tripathi, Malvika [Fermilab] (ORCID:00000001989251↗
DOE OSTI2020

Layer-Parallel Training of Deep Residual Neural Networks

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be interpreted as forward Euler discretizations of a nonlinear initial value problem whose time-dependent control variables represent the weights of the neural network. Hence, training a ResNet can be cast as an optimal control problem of the associated dynamical system. For similar time-dependent optimal control problems arising in engineering applications, parallel-in-time methods have shown notable improvements in scalability. This paper demonstrates the use of those techniques for efficient and effective training of ResNets. The proposed algorithms replace the classical (sequential) forward and backward propagation through the network layers with a parallel nonlinear multigrid iteration applied to the layer domain. This adds a new dimension of parallelism across layers that is attractive when training very deep networks. From this basic idea, we derive multiple layer-parallel methods. The most efficient version employs a simultaneous optimization approach where updates to the network parameters are based on inexact gradient information in order to speed up the training process. Finally, using numerical examples from supervised classification, we demonstrate that the new approach achieves a training performance similar to that of traditional methods, but enables layer-parallelism and thus provides speedup over layer-serial methods through greater concurrency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Stochastic gradient descent algorithm for stochastic optimization in solving analytic continuation problems

We propose a stochastic gradient descent based optimization algorithm to solve the analytic continuation problem in which we extract real frequency spectra from imaginary time Quantum Monte Carlo data. The procedure of analytic continuation is an ill-posed inverse problem which is usually solved by regularized optimization methods, such like the Maximum Entropy method, or stochastic optimization methods. The main contribution of this work is to improve the performance of stochastic optimization approaches by introducing a supervised stochastic gradient descent algorithm to solve a flipped inverse system which processes the random solutions obtained by a type of Fast and Efficient Stochastic Optimization Method.

97 MATHEMATICS AND COMPUTING↗