Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Toward continuum gyrokinetic study of high-field mirrors

High-temperature superconducting (HTS) magnetic mirrors under development exploit strong fields with high mirror ratio to compress loss cones and enhance confinement and may offer cheaper, more compact fusion power plant candidates. This new class of devices could exhibit largely unexplored interchange and gradient-driven modes. Such instabilities, and methods to stabilize them, can be studied with gyrokinetics, given the strong magnetization and prevalence of kinetic effects. Our focus here is to (a) determine if oft-used gyrokinetic models for open field lines produce the electron-confining (Pastukhov) electrostatic potential and (b) examine and address challenges faced by gyrokinetic codes in studying HTS mirrors. Here, we show that a one-dimensional limit of said models self-consistently develops a potential qualitatively approaching the analytical Pastukhov level. Additionally, we describe the computational challenges of studying high mirror ratios with open field line gyrokinetic solvers and offer a force softening method to mitigate small time steps needed for time integration in colossal magnetic field gradients produced by HTS coils, providing a 19X speedup.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

PyTREES

PyTREES (Python tool for Training/Testing Robust Explainable Ensembles on Spectra) is software that implements a data-driven approach to predicting the amount of specific oxides present in materials samples of laser-induced breakdown spectroscopy (LIBS); such as from the ChemCam instrument suite onboard the NASA Curiosity rover. PyTREES is designed to input LIBS data in the format provided by the ChemCam team [1]. PyTREES then applies appropriate pre-processing to this data [2], and implements several regression methods for predicting oxides from spectra. The regression methods include: ensemble methods (random forest, extra trees, and gradient boosting regression) and blended submodels using the “double blending” technique. PyTREES additionally implements methods for quantifying the importance of features in regression model: (1) mean decrease in impurity (MDI) and (2) permutation importance to investigate the wavelengths used by the regression methods. [1] Gasda et al. (2021). Spectrochim Acta B, 181, 106223. [2] Clegg et al. (2017). Spectrochim Acta B , 129, 64–85.

Oyen, Diane↗
DOE OSTI2020

Multireference Electron Correlation Methods: Journeys along Potential Energy Surfaces

Multireference electron correlation methods describe static and dynamical electron correlation in a balanced way and, therefore, can yield accurate and predictive results even when single-reference methods or multiconfigurational self-consistent field theory fails. One of their most prominent applications in quantum chemistry is the exploration of potential energy surfaces. This includes the optimization of molecular geometries, such as equilibrium geometries and conical intersections and on-the-fly photodynamics simulations, both of which depend heavily on the ability of the method to properly explore the potential energy surface. Because such applications require nuclear gradients and derivative couplings, the availability of analytical nuclear gradients greatly enhances the scope of quantum chemical methods. This review focuses on the developments and advances made in the past two decades. A detailed account of the analytical nuclear gradient and derivative coupling theories is presented. Emphasis is given to the software infrastructure that allows one to make use of these methods. Notable applications of multireference electron correlation methods to chemistry, including geometry optimizations and on-the-fly dynamics, are summarized at the end followed by a discussion of future prospects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Ab initio molecular dynamics on quantum computers

Ab initio molecular dynamics (AIMD) is a valuable technique for studying molecules and materials at finite temperatures where the nuclei evolve on potential energy surfaces obtained from accurate electronic structure calculations. In this work, we present an approach to running AIMD simulations on noisy intermediate-scale quantum (NISQ)-era quantum computers. The electronic energies are calculated on a quantum computer using the variational quantum eigensolver (VQE) method. Algorithms for computation of analytical gradients entirely on a quantum computer require quantum fault-tolerant hardware, which is beyond NISQ-era. Therefore, we compute the energy gradients numerically using finite differences, the Hellmann-Feynman theorem, and a correlated sampling technique. This method only requires additional classical calculations of electron integrals for each degree of freedom without any additional computations on a quantum computer beyond the initial VQE run. As a proof of concept, AIMD simulations are demonstrated for the H-2 molecule on IBM quantum devices. In addition, we demonstrate the validity of the method for larger molecules using full configuration interaction wave functions. As quantum hardware and noise mitigation techniques continue to improve, the method can be utilized for studying larger molecular systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

An autoencoder compression approach for accelerating large-scale inverse problems

Abstract Partial differential equation (PDE)-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes required to accurately compute the PDE solution introduce an enormous number of parameters and require large-scale computing resources such as more processors and more memory to solve such systems in a reasonable time. For inverse problems constrained by time-dependent PDEs, the adjoint method often employed to compute gradients and higher order derivatives efficiently requires solving a time-reversed, so-called adjoint PDE that depends on the forward PDE solution at each timestep. This necessitates the storage of a high-dimensional forward solution vector at every timestep. Such a procedure quickly exhausts the available memory resources. Several approaches that trade additional computation for reduced memory footprint have been proposed to mitigate the memory bottleneck, including checkpointing and compression strategies. In this work, we propose a close-to-ideal scalable compression approach using autoencoders to eliminate the need for checkpointing and substantial memory storage, thereby reducing the time-to-solution and memory requirements. We compare our approach with checkpointing and an off-the-shelf compression approach on an earth-scale ill-posed seismic inverse problem. The results verify the expected close-to-ideal speedup for the gradient and Hessian-vector product using the proposed autoencoder compression approach. To highlight the usefulness of the proposed approach, we combine the autoencoder compression with the data-informed active subspace (DIAS) prior showing how the DIAS method can be affordably extended to large-scale problems without the need for checkpointing and large memory.

Mathematics↗
DOE OSTI2020

Locally adaptive artificial viscosity strategies for Lagrangian hydrodynamics

To accurately model inviscid flow with shock waves using staggered-grid Lagrangian hydrodynamics, artificial viscosity is introduced to convert kinetic energy into internal energy, thereby providing a mechanism to generate the required entropy increase across shocks. In this paper, we propose a new method for constructing an adaptive, artificial viscosity in the context of one-dimensional, staggered-grid Lagrangian hydrodynamics. Our adaptive, artificial viscosity is defined in terms of two parameters that depend on density locally in a neighborhood around a shock, and hence, vary cell-by-cell. Our methodology is based on building a reference set of pre-computed optimal, globally constant artificial viscosity coefficients for a family of isolated shock test problems. For arbitrary flows, the evaluation of the unknown coefficients is automated by first estimating shock intensity locally, and second computing the corresponding adaptive parameter value via interpolation over the data from the pre-computed reference set of optimal, globally constant coefficient values. To illustrate the performance of our new approach, we compare our results against two existing methods. The first method is a limiter-based approach, which relies on estimating velocity gradients of the flow, and the second method is utilized in several commercial codes. Finally, we demonstrate that our new adaptive methodology produces more accurate results for a variety of tests with propagating shock waves, as well as for the aforementioned family of isolated shock problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Gradient-based optimization of 3D MHD equilibria

Using recently developed adjoint methods for computing the shape derivatives of functions that depend on magnetohydrodynamic (MHD) equilibria (Antonsen et al. , J. Plasma Phys. , vol. 85, issue 2, 2019; Paul et al. , J. Plasma Phys. , vol. 86, issue 1, 2020), we present the first example of analytic gradient-based optimization of fixed-boundary stellarator equilibria. We take advantage of gradient information to optimize figures of merit of relevance for stellarator design, including the rotational transform, magnetic well and quasi-symmetry near the axis. With the application of the adjoint method, we reduce the number of equilibrium evaluations by the dimension of the optimization space ( ${\sim }50\text {--}500$ ) in comparison with a finite-difference gradient-based method. We discuss regularization objectives of relevance for fixed-boundary optimization, including a novel method that prevents self-intersection of the plasma boundary. We present several optimized equilibria, including a vacuum field with very low magnetic shear throughout the volume.

Physics↗
DOE OSTI2025

Mapping structures and dynamics with frequency-correlated diffusion exchange

Understanding molecular motion in diffusion-driven complex environments is critical for designing sustainable materials and improving chemical processes. Here, we introduce a multidimensional nuclear magnetic resonance (NMR) method that captures how molecular populations exchange across different dynamic regimes. By extending the modulated gradient spin-echo technique to include frequency-frequency correlations, our approach reveals diffusion pathways that are otherwise obscured in heterogeneous systems. Implemented on a unilateral NMR magnet, the method eliminates gradient pulsing constraints and accesses dynamics in the kilohertz regime. We apply this technique to swelling and acid-catalyzed deconstruction of cross-linked and linear polymers to observe how structural heterogeneity evolves over time. By linking molecular motion to topology and chemical state, we extract physical metrics such as fractal surface dimensionality and reaction wavefront velocity, properties inaccessible with standard diffusion measurements. This work expands the capabilities of NMR for probing soft matter, with implications for polymer recycling and materials design.

Fricke, Sophia N. [University of California, Berke↗
DOE OSTI2024

Imaging extended single crystal lattice distortion fields with multi-peak Bragg ptychography

Recent advances in phase-retrieval-based x-ray imaging methods have demonstrated the ability to reconstruct 3D distortion vector fields within a nanocrystal by using coherent diffraction information from multiple crystal Bragg reflections. However, these works do not provide a solution to the challenges encountered in imaging lattice distortions in crystals with significant defect content that result in phase wrapping. Moreover, these methods only apply to isolated crystals smaller than the x-ray illumination, and therefore cannot be used for imaging of distortions in extended crystals. We introduce multi-peak Bragg ptychography which addresses both challenges via an optimization framework that combines stochastic gradient descent and phase unwrapping methods for robust image reconstruction of lattice distortions and defects in extended crystals. Our work uses modern automatic differentiation toolsets so that the method is easy to extend to other settings and easy to implement in high-performance computers. This work is particularly timely given the broad interest in using the increased coherent flux in fourth-generation synchrotrons for innovative material research.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Adjoint DSMC for nonlinear Boltzmann equation constrained optimization

Applications for kinetic equations such as optimal design and inverse problems often involve finding unknown parameters through gradient-based optimization algorithms. Based on the adjoint-state method, we derive two different frameworks for approximating the gradient of an objective functional constrained by the nonlinear Boltzmann equation. While the forward problem can be solved by the DSMC method, it is difficult to efficiently solve the high-dimensional continuous adjoint equation obtained by the “optimize-then-discretize” approach. This challenge motivates us to propose an adjoint DSMC method following the “discretize-then-optimize” approach for Boltzmann-constrained optimization. We also analyze the properties of the two frameworks and their connections. Here, several numerical examples are presented to demonstrate their accuracy and efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Dataset from: "Adjoint methods for quasisymmetry of vacuum fields on a surface"

Adjoint methods can speed up stellarator optimisation by providing gradient information more efficiently compared to finite-difference evaluations. Adjoint methods are herein applied to vacuum magnetic fields, with objective functions targeting quasisymmetry and a rotational transform value on a surface. To measure quasisymmetry, a novel way of evaluating approximate flux coordinates on a single flux surface without the assumption of a neighbourhood of flux surfaces is proposed. The shape gradients obtained from the adjoint formalism are evaluated numerically and verified against finite-difference evaluations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗
DOE OSTI2022

Adjoint methods for quasi-symmetry of vacuum fields on a surface

Adjoint methods can speed up stellarator optimisation by providing gradient information more efficiently compared with finite-difference evaluations. Adjoint methods are herein applied to vacuum magnetic fields, with objective functions targeting quasi-symmetry and a rotational transform value on a surface. Here to measure quasi-symmetry, a novel way of evaluating approximate flux coordinates on a single flux surface without the assumption of a neighbourhood of flux surfaces is proposed. The shape gradients obtained from the adjoint formalism are evaluated numerically and verified against finite-difference evaluations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Novel Relativistic Electronic Structure Theories for Actinide-Containing Compounds

Actinides of importance to basic energy sciences contain electrons moving at speed comparable to the speed of light. Reliable computational simulation of these electrons and hence actinide chemistry requires accurate description of relativistic effects. The present project advances computational actinide chemistry with development of new methodologies, algorithms, and computer programs in relativistic quantum chemistry, as well as applications to actinide chemistry and spectroscopy. A new “electrons-only” exact two-component approach has been developed to provide efficient treatments of relativistic effects, while maintaining chemical accuracy. New computational algorithms developed here extend the applicability of relativistic electron-correlation methods to larger molecules. The method-development work in this project also features the first implementation of analytic gradient technique for relativistic electron-correlation methods, which provides significantly enhanced ability to compute properties for molecules containing actinides. The applicability and usefulness of these new methods and computer programs have been demonstrated in calculations of actinide-containing molecules to facilitate understanding of actinide chemistry and spectroscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Static Subspace Approximation for Random Phase Approximation Correlation Energies: Applications to Materials for Catalysis and Electrochemistry

Modeling complex materials using high-fidelity, ab initio methods at low cost is a fundamental goal for quantum chemical software packages. The GW approximation and random phase approximation (RPA) provide a unified description of both electronic structure and total energies using the same physics in a many-body perturbative approach that can be more accurate than generalized-gradient density functional theory (DFT) methods. However, GW/RPA implementations have historically been limited to either specific materials classes or application toward small chemical systems. Here, the static subspace approximation allows for reduced cost full-frequency GW/RPA calculations and has previously been benchmarked thoroughly for GW calculations. Here, we describe our approach to including partial occupations of electronic orbitals in full-frequency GW and RPA calculations for the study of electrocatalysts. We benchmarked RPA total energy calculations using the subspace approximation across a diverse test suite of materials for a variety of computational parameters. The benchmarking quantifies the impact of different extrapolation procedures for representing the static polarizability at infinite screened cutoff, and shows that using screened cutoffs above 20-25 Ryd result in diminishing accuracy returns for predicting RPA total energies. Additionally, for moderately sized electrocatalytic models, 2-3 times fewer computational resources are used to compute RPA total energies by representing the static polarizability with 20-30% of the static subspace basis, with an error of approximately 0.01 eV or better in RPA adsorption energy calculations. Finally, we show that for these electrochemical models RPA can shift DFT adsorption energy shifts by up to 0.5 eV and that GW can frequently shift DFT eigenvalues of surface and adsorbate states by approximately 0.5-1 eV.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

A comparative study of calibration techniques for finite strain elastoplasticity: Numerically-exact sensitivities for FEMU and VFM

Accurate identification of material parameters is crucial for predictive modeling in computational mechanics. Here, the two primary approaches in the experimental mechanics community for calibration from full-field digital image correlation data are known as finite element model updating (FEMU) and the virtual fields method (VFM). In VFM, the objective function is a squared mismatch between internal and external virtual work or power. In FEMU, the objective function quantifies the weighted mismatch between model predictions and corresponding experimentally measured quantities of interest. It is minimized by iteratively updating the parameters of an FE model. While FEMU is seen as more flexible, VFM is commonly used instead of FEMU due to its considerably greater computational expense. However, comparisons between the two methods usually involve approximations of gradients or sensitivities with finite difference schemes, thereby making direct assessments difficult. Hence, in this study, we compare VFM and FEMU in the context of numerically-exact sensitivities obtained through local sensitivity analyses and the application of automatic differentiation software. To this end, we conduct a series of test cases to assess both methods under practical challenges using a finite strain elastoplasticity model.

Automatic differentiation↗
DOE OSTI2023

Design Criteria for High-Gradient Radio-Frequency Linacs

This article will review methods used at the SLAC National Accelerator Laboratory and other world accelerator laboratories to design high-gradient normal conducting accelerating structures. A quest for compact radio-frequency linacs fueled decades of studies toward a higher accelerating gradient. A major phenomena limiting the increase of the gradient is vacuum radio-frequency breakdown; therefore, this paper will address the breakdown physics and discuss approaches that reduce the breakdown probability. This discussion will cover both the electrical design and fabrication technology of the accelerating structures to achieve practical operating accelerating gradients in excess of 100 MV/m. Most of the data described here were obtained during the development of 11 GHz linacs for electron–positron linear colliders, so extrapolation of the results to other frequencies should be performed cautiously.

Dolgashev, Valery A. (ORCID:0000000166715402)↗
DOE OSTI2024

A robust spectral element implementation of the $k - τ$ RANS model in Nek5000/NekRS

The $k - ω$ Reynolds Averaged Navier Stokes (RANS) model is one of the industry standard approaches for modeling of turbulent flows. It performs better than the $k - ϵ$ model for low Reynolds number flows and is also more suitable for boundary layers with adverse pressure gradients. Major drawback of the model, however, is that the asymptotic value of $ω$ at the walls is singular, necessitating the use of a contrived “sufficiently” large value for $ω$ as the boundary condition for its transport equation. Here, this invariably leads to the solution being sensitive to near wall grid spacing. While an acceptable solution for low order (finite volume) methods, the excessive near wall gradients lead to persistent numerical stability issues in high order codes. To alleviate the problem, specifically in the context of the high order spectral element code Nek5000, a regularized $k - ω$ approach was formulated in our prior work (Tomboulides et al., 2018). The formulation, however, relies on the use of wall distance and its gradients for modeling the closure terms and can pose problems for simulations in complex geometries. This work presents a novel implementation of the $k - τ$ RANS model in Nek5000, where $τ = 1/ω$, eliminating the need for regularization, owing to the asymptotically bounded behavior of the source terms in the $τ$ transport equation, and also eliminating dependence on wall distance. Robustness and stability of the $k - τ$ model is ensured through implicit treatment of the source terms and their careful numerical implementation and demonstrated through several cases aimed at verification and validation. Studies include both canonical and engineering relevant problems, viz., turbulent channel flow, pipe flow, backward facing step, flow over NACA 0012 airfoil and flow in a T-junction. Results from the $k - τ$ model are shown to be consistent with regularized $k - ω$ model and also with the $k - ω$ SST model in OpenFOAM (for select studies). Comparison with experimental data is also shown, where available, to bolster validation efforts for the $k - τ$ model implementation through prediction of key turbulent quantities of interest.

Nek5000↗