Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Adjoint”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Optimal checkpointing for adjoint multistage time-stepping schemes

Here, we consider checkpointing strategies that minimize the number of recomputations needed when performing discrete adjoint computations using multistage time-stepping schemes that require computing several substeps within one complete time step. Specifically, we propose two algorithms that can generate optimal checkpoint-ing schedules under weak assumptions. The first is an extension of the seminal Revolve algorithm adapted to multistage schemes. The second algorithm, named CAMS, is developed based on dynamic programming, and it requires the least number of recomputations when compared with other algorithms. The CAMS algorithm is made publicly available in a library with bindings to C and Python. Numerical results show that the proposed algorithms can deliver up to two times the speedup compared with that of classical Revolve. Moreover, we discuss the utilization of the CAMS library in mature scientific computing libraries and demonstrate the ease of using it in an adjoint workflow. The proposed algorithms have been adopted by the PETSc TSAdjoint library. Their performance has been demonstrated with a large-scale PDE-constrained optimization problem on a leadership-class supercomputer. This work is a significant extension of the authors' conference paper.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

AdjointBackMapV2: Precise reconstruction of arbitrary CNN unit’s activation via adjoint operators

Adjoint operators have been found to be effective in the exploration of CNN’s inner workings (Wan and Choe, 2022). However, the previous no-bias assumption restricted its generalization. We overcome the restriction via embedding input images into an extended normed space that includes bias in all CNN layers as part of the extended space and propose an adjoint-operator-based algorithm that maps high-level weights back to the extended input space for reconstructing an effective hypersurface. Such hypersurface can be computed for an arbitrary unit in the CNN, and here we prove that this reconstructed hypersurface, when multiplied by the original input (through an inner product), will precisely replicate the output value of each unit. We show experimental results based on the CIFAR-10 and CIFAR-100 data sets where the proposed approach achieves near 0 activation value reconstruction error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Adjoint Klein-Nishina Sampling Methods: Efficiency, Speed and Applications

Three new rejection sampling methods for generating samples from the adjoint Klein-Nishina cross section are discussed: the two-branch rejection sampling procedure, the three-branch linear rejection sampling procedure and the three-branch inverse rejection sampling procedure. These methods have all been implemented in the Framework for REsearch in Nuclear ScIence and Engineering (FRENSIE). The efficiency and sample generation rate of each of these methods are evaluated to characterize the methods and to make recommendations regarding their use. The use of these methods in realistic transport simulations is also evaluated by incorporating a scattering function into the sampling process. Furthermore, the results of an infinite medium problem are presented to verify that the sampling procedure can be used in an adjoint Monte Carlo simulation to generate results that are in agreement with an equivalent forward simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Progress on Optimizing Wind Farms and Rotor Designs Using Adjoints

Modern wind plants are increasingly tasked with multiple performance objectives. In addition to designing plants that maximize power output and minimize the levelized cost of energy (LCOE), the design and operation of wind plants is increasingly influenced by challenges regarding grid integration of variable generation renewables. This places a growing emphasis on making wind plants more controllable and predictable. WindSE is a Reynolds-averaged Navier-Stokes (RANS) model designed around analytical gradient and adjoint methods, with the ability to capture terrain-induced effects, as shown in Figure 1. The recent addition of an unsteady solver with an actuator line method (ALM) and ongoing work to enable massively parallel optimizations gives it a unique niche to explore coupled plant-level controls and design problems. This code is an open source python package built on the FEniCS framework that utilizes fast, parallel PETSc solvers to model fluid flow throughout wind-farm scale domains. Two recent studies performed using WindSE demonstrate the capability to optimize under a wide variety of flow conditions and objective functions. In the first, we present an optimization focused on modifying the layout of a wind farm with a fixed number of turbines for maximum total power output [1]. This study highlights the ability to quickly perform simulations using the steady Navier-Stokes solver combined with rotors represented as actuator disks while also stressing the importance of capturing terrain-induced effects. Gradient-based optimization using the RANS equations is viable due to the inclusion of efficiently computed adjoint derivatives. We interpret the physical results of the optimal layout and also discuss the computational cost of scaling to larger problems. In the second study, we present the capabilities of the unsteady Navier-Stokes solver, where rotor-blade profiles represented by actuator lines are optimized to enhance wake steering effects and overall power production [2]. We quantify the wind plant performance gains obtained from this type of simultaneous control co-design optimization as compared to optimizing the blade design and yaw independently. Figure 2 shows the differences between a baseline two-turbine system and an optimized system where we fine-tune the blade chord profile. Results and challenges from each study are quickly summarized and used to motivate the current development efforts within WindSE. Current and future work is focused on enabling higher-resolution studies with more degrees of freedom through parallelization of both the simulation and optimization algorithms. We present benchmarking results to show that WindSE performs well in both weak- and strong-scaling tests and further demonstrate that the optimizer obtains the same convergence rates in both shared- and distributed-memory environments. Using larger wind farms, we can study deep-array effects within an optimization context, allowing the use of objective functions that have been previously unstudied. As an example, we present ongoing work on a blockage metric which characterizes the loss of available kinetic energy due to wake effects from multiple upstream turbines.

adjoint optimization↗
DOE OSTI2025

More about the lattice Hamiltonian for Adjoint QCD 2

In our earlier work [1], we introduced a lattice Hamiltonian for Adjoint QCD 2 using staggered Majorana fermions. We found the gauge invariant space of states explicitly for the gauge group SU(2) and used them for numerical calculations of observables, such as the spectrum and the expectation value of the fermion bilinear. In this paper, we carry out a more in-depth study of our lattice model, extending it to any compact and simply-connected gauge group G. We show how to find the gauge invariant space of states and use it to study various observables. We also use the lattice model to calculate the mixed ’t Hooft anomalies of Adjoint QCD 2 for arbitrary G. We show that the matrix elements of the lattice Hamiltonian can be expressed in terms of the Wigner 6j-symbols of G. For G = SU(3), we perform exact diagonalization for lattices of up to six sites and study the low-lying spectrum, the fermion bilinear condensate, and the string tension. We also show how to write the lattice strong coupling expansion for ground state energies and operator expectation values in terms of the Wigner 6j-symbols. For SU(3) we carry this out explicitly and find good agreement with the exact diagonalizations, and for SU(4) we give expansions that can be compared with future numerical studies.

confinement↗
DOE OSTI2025

A Type II Hamiltonian Variational Principle and Adjoint Systems for Lie Groups

We present a novel Type II variational principle on the cotangent bundle of a Lie group which enforces Type II boundary conditions, i.e., fixed initial position and final momentum. In general, such Type II variational principles are only globally defined on vector spaces or locally defined on general manifolds; however, by left translation, we are able to define this variational principle globally on cotangent bundles of Lie groups. Type II boundary conditions are particularly important for adjoint sensitivity analysis, which is our motivating application. As such, we additionally discuss adjoint systems on Lie groups, their properties, and how they can be used to solve optimization problems subject to dynamics on Lie groups.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An adjoint method for determining the sensitivity of island size to magnetic field variations

An adjoint method to calculate the gradient of island width in stellarators is presented and applied to a set of magnetic field configurations. The underlying method for calculation of the island width is that of Cary & Hanson ( Phys. Fluids B, vol. 3, issue 4, 1991, pp. 1006–1014) (with a minor modification), and requires that the residue of the island centre be small. Therefore, the gradient of the residue is calculated in addition. Both the island width and the gradient calculations are verified using an analytical magnetic field configuration introduced by Reiman & Greenside ( Comput. Phys. Commun. , vol. 43, issue 1, 1986, pp. 157–167). The method is also applied to the calculation of the shape gradient of the width of a magnetic island in a National Compact Stellarator Experiment (NCSX) vacuum configuration with respect to positions on a coil. A gradient-based optimization is applied to a magnetic field configuration studied by Hanson & Cary ( Phys. Fluids , vol. 27, issue 4, 1984, pp. 767–769) to minimize stochasticity by adding perturbations to a pair of helical coils. Although only vacuum magnetic fields and an analytical magnetic field model are considered in this work, the adjoint calculation of the island width gradient could also be applied to a magnetohydrodynamic (MHD) equilibrium if the derivative of the magnetic field, with respect to the equilibrium parameters, is known. Using the island width gradient calculation presented here, more general gradient-based optimization methods can be applied to design stellarators with small magnetic islands. Moreover, the sensitivity of the island size may itself be optimized to ensure that coil tolerances, with respect to island size, are kept as high as possible.

Physics↗
DOE OSTI2022

Strong Upper-Plate Heterogeneity at the Hikurangi Subduction Margin (North Island, New Zealand) Imaged by Adjoint Tomography

We use earthquake-based adjoint tomography to invert for three-dimensional structure of the North Island, New Zealand, and the adjacent Hikurangi subduction zone. The study area, having a shallow depth to the plate interface below the North Island, offers a rare opportunity for imaging material properties at an active subduction zone using land-based measurements. Starting from an initial model derived using ray tomography, we perform iterative model updates using spectral element and adjoint simulations to fit waveforms with periods ranging from 4–30 s. We perform 28 model updates using an L-BFGS optimization algorithm, improving data fit and introducing P- and S-wave velocity changes of up to ±30%. Resolution analysis using point spread functions show that our measurements are most sensitive to heterogeneities in the upper 30 km. The most striking velocity changes coincide with areas related to the active Hikurangi subduction zone. Lateral velocity structures in the upper 5 km correlate well with New Zealand geology. Here, the inversion reveals increased along-strike heterogeneity on the margin. In Cook Strait we observe a low-velocity zone interpreted as deep sedimentary basins. In the central North Island, low-velocity anomalies are linked to surface geology, and we relate velocity structures at depth to crustal magmatic activity below the Taupō Volcanic Zone.

58 GEOSCIENCES↗
DOE OSTI2023

CANVAS: An Adjoint Waveform Tomography Model of California and Nevada

Abstract We present the California‐Nevada Adjoint Simulations (CANVAS) model, an adjoint waveform tomography model of the crust and uppermost mantle of the states of California and Nevada. We used WUS256 (Rodgers et al., 2022, https://doi.org/10.1029/2022jb024549 ) as the starting model and iteratively decreased the minimum period of CANVAS from 30 to 12 s. CANVAS was iterated in two distinct stages: the first stage with source mechanisms from the Global Centroid Moment Tensor (GCMT) catalog and the second stage with inverted moment tensors (MT) using the CANV_WUS model (Doody et al., 2023, https://doi.org/10.1029/2023jb026463 ). We show that updating the MTs with 3D Green's functions improved waveform fits and azimuthal coverage of windowed data used to calculate the gradients. As for the model itself, we improved waveform fits over WUS256, particularly in the dispersed surface waves. CANVAS resolved tectonic features seen in other models and accurately defined the depth to basement of major basins, including the Central Valley and the Ventura Basin. We propose CANVAS as a starting model for crustal tomography models on smaller scales.

58 GEOSCIENCES↗
DOE OSTI2022

Adjoint sensitivity analysis and data assimilation for verification of dry storage cask contents

Dry cask storage is a method for interim storage of spent fuel assemblies which contain fissile isotopes of uranium and plutonium. These can present a proliferation concern and consequently there is a need for non-destructive testing methods to verify a dry cask's contents for proliferation protection. We present an application of adjoint sensitivity analysis and data assimilation to a multigroup diffusion model of dry cask storage. Adjoint sensitivity analysis allows the efficient calculation of sensitivities for use in data assimilation to calibrate imprecisely known parameter values and data consistency tests to detect diversion scenarios. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Adjoint Waveform Tomography for Next Generation Seismic Analyses and Monitoring

The development of methods and capabilities to compute complete waveform simulations in three-dimensional (3D) Earth models along with adjoint methods for computing the fully 3D sensitivity kernels in the 2000's set the stage for new advances in seismic imaging. I believe that the full benefits of adjoint waveform tomography (AWT) are not yet fully realized and this will be an important direction for the future of seismic tomography.

58 GEOSCIENCES↗
DOE OSTI2025

A direct-adjoint approach for material point model calibration with application to plasticity

Here, this paper proposes a new approach for the calibration of material parameters in local elastoplastic constitutive models. The calibration is posed as a constrained optimization problem, where the constitutive model evolution equations for a single material point serve as constraints. The objective function quantifies the mismatch between the stress predicted by the model and corresponding experimental measurements. To improve calibration efficiency, a novel direct-adjoint approach is presented to compute the Hessian of the objective function, which enables the use of second-order optimization algorithms. Automatic differentiation is used for gradient and Hessian computations. Two numerical examples are employed to validate the Hessian matrices and to demonstrate that the Newton–Raphson algorithm consistently outperforms gradient-based algorithms such as L-BFGS-B.

36 MATERIALS SCIENCE↗
DOE OSTI2024

MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade

The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model’s main branch and is now freely available.

Adjoints↗
DOE OSTI2022

Exploring the phenomenology of weak adjoint scalars in minimal R -symmetric models

We examine the phenomenology of the scalar fields in weak and Higgs sectors of minimal R-symmetric models, in particular the ‘swino’ and ‘sbino’, the scalar partners to the chiral fields that marry the electroweak gauge bosons in Dirac gaugino models. These fields are in adjoint representations of SU(2) and U(1) and have both CP-even and CP-odd components. The interactions of these new states are summarized, and decay widths are computed analytically to one loop order. We discuss the tree level contributions of these new states to the mass spectrum of MSSM sfermions. We also explore production cross sections and decay signatures at colliders for several chosen benchmarks. We find that large regions of parameter space are unconstrained by present collider data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Investigating two-dimensional adjoint QCD on the lattice

We present our investigations of SU(N) adjoint QCD in two dimensions with one Majorana fermion on the lattice. We determine the relevant parameter range for the simulations with Wilson fermions and present results for Polyakov loop, chiral condensate, and string tension. In the theory with massive fermions, all observables we checked show qualitative agreement between numerical lattice data and theory, while the massless limit is more subtle since chiral and non-invertible symmetry of the continuum theory are explicitly broken by lattice regularization. In thermal compactification, we observe N perturbative vacua for the holonomy potential at high-T with instanton events connecting them, and a unique vacuum at low-T. At finite-N, this is a cross-over and it turns to a phase transition at large-N thermodynamic limit. In circle compactification with periodic boundary conditions, we observe a unique center-symmetric minimum at any radius. In continuum, the instantons in the thermal case carry zero modes (for even N) and indeed, in the lattice simulations, we observe that chiral condensate is dominated by instanton centers, where zero modes are localized. We present lattice results on the issue of confinement vs. screening in the theory and comment on the roles of chiral symmetry and non-invertible symmetry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Exploration of the parameter space of quasisymmetric stellarator vacuum fields through adjoint optimisation

Optimising stellarators for quasisymmetry leads to strongly reduced collisional transport and energetic particle losses compared with unoptimised configurations. Although stellarators with precise quasisymmetry have been obtained in the past, it remains unclear how broad the parameter space is where good quasisymmetry may be achieved. We study the range of aspect ratios and rotational transform values for which stellarators with excellent quasisymmetry on the boundary can be obtained. A large number of Fourier harmonics is included in the boundary representation, which is made computationally tractable by the use of adjoint methods to enable fast gradient-based optimisation and by the direct optimisation of vacuum magnetic fields, which converge more robustly compared with solutions from magnetohydrostatics. Several novel configurations are presented, including stellarators with record levels of quasisymmetry on a surface, three field period quasiaxisymmetric stellarators with substantial magnetic shear, and compact quasisymmetric stellarators at low aspect ratios similar to tokamaks.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

WUS256: An Adjoint Waveform Tomography Model of the Crust and Upper Mantle of the Western United States for Improved Waveform Simulations

Abstract We report a new model (WUS256) of radially anisotropic seismic wavespeeds of the crust and upper mantle of the western United States (WUS) obtained from adjoint waveform tomography for the purpose of improving synthetic waveform fits to observed data. WUS256 is based on inversion of over 94,000 waveforms from 72 earthquakes recorded by nearly 3,400 stations. We started with the SPiRaL global model (Simmons et al., 2021, https://doi.org/10.1093/gji/ggab277 ) and waveforms in the period band of 50–120 s. We followed a conservative multiscale inversion approach with eight stages and 256 total inversion iterations which enabled monotonic misfit reduction to 20‐s minimum‐period waves. WUS256 relied on time‐frequency (TF) phase misfits and a trust region limited memory Broyden–Fletcher–Goldfarb–Shanno (L‐BFGS) optimization. Hessian‐vector products were used to qualitatively assess model resolution. Results indicate that WUS256 has good coverage of the continental regions to depths of about 150 km and is able to resolve features on lateral scales of about 200 km. We quantify waveform fits by the reduction in TF and normalized amplitude difference misfits between WUS256 and the SPiRaL starting model. WUS256 significantly improves waveform fits with misfit reduction 64% for both inversion and validation data sets compared to the SPiRaL starting model and shows even better fits compared to other models. Waveform fits illustrate that WUS256 reproduces body‐waves, fundamental mode surface waves as well as late arriving dispersed and/or scattered short period surface waves. The improvement in waveform fit indicates that WUS256 can be used to reproduce path effects on regional complete waveforms and moment tensor inversions.

58 GEOSCIENCES↗