Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adjoint equation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

LATTE: open-source, high-performance traveltime computation, tomography and source location in acoustic and elastic media

Traveltime-based tomography and source location are fundamental approaches for imaging subsurface structures and understanding the spatiotemporal distribution of seismicity from local to global scales. We present an open-source, high-performance framework integrating eikonal equation solvers and adjoint-state theory for traveltime computation, velocity tomography, source location and joint tomography-location in 2-D/3-D acoustic and elastic media. We introduce novel regularization schemes based on total generalized p-variation, structural similarity and multitask machine learning to enhance the fidelity and interpretability of inverted models and source locations. Key features of our implementation also include the ability to leverage both absolute-difference and double-difference traveltime misfits for high-fidelity velocity tomography and source parameter estimation; support for traveltime computation and inversion in diverse 2-D/3-D scenarios with arbitrary source and receiver distributions; and a perturbation-based optimal step-size estimation method to reduce computational costs. In addition, our implementation employs shared-memory and distributed-memory parallelization to provide an efficient solution for traveltime computation, tomography, and source location. In conclusion, we validate the efficacy and accuracy of our approach through multiple synthetic data examples.

58 GEOSCIENCES↗

Structural Aspects of Neutron Survival Probabilities

The neutron survival probability (and related quantities including probabilities of extinction and initiation) is a central element of the broader stochastic theory of neutron populations and finds application in fields including reactor start-up, analysis of reactor power bursts and criticality accidents, and safeguards. In a full neutron transport formulation, the equation governing the single-neutron survival probability is a backward or adjoint-like integro-partial differential equation with the added complexity of being highly nonlinear. Analogous formulations of this equation exist in the context of many approximate theories of neutron transport, with the point kinetics formulation having received significant theoretical attention since the 1940s. This work continues this tradition by providing a novel analysis of the single-neutron survival probability equation using the tools of boundary layer theory. The analysis reveals that the “fully dynamic” solution of the single-neutron survival probability equation—and some key probability distributions derived from it—may be cast as a singular perturbation around the underlying quasi-static single-neutron probability of initiation. In this perturbation solution, the expansion parameter is the ratio of the neutron generation time to a macroscopic time scale characterizing the overall system evolution; this interpretation illuminates some of the fundamental structural aspects of neutron survival phenomena.

97 MATHEMATICS AND COMPUTING↗

A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO

In this work, we provide a new approach for the efficient matrix-free application of the transpose of the Jacobian for the spectral element method for the adjoint-based solution of partial differential equation (PDE) constrained optimization. This results in optimizations of nonlinear PDEs using explicit integrators where the integration of the adjoint problem is not more expensive than the forward simulation. Solving PDE constrained optimization problems entails combining expertise from multiple areas, including simulation, computation of derivatives, and optimization. The Portable, Extensible Toolkit for Scientific computation (PETSc) together with its companion package, the Toolkit for Advanced Optimization (TAO), is an integrated numerical software library that contains an algorithmic/software stack for solving linear systems, nonlinear systems, ordinary differential equations, differential algebraic equations, and large-scale optimization problems and, as such, is an ideal tool for performing PDE-constrained optimization. This paper describes an efficient approach in which the software stack provided by PETSc/TAO can be used for large-scale nonlinear time-dependent problems. Time integration can involve a range of high-order methods, both implicit and explicit. The PDE-constrained optimization algorithm used is gradient-based and seamlessly integrated with the simulation of the physical problem.

97 MATHEMATICS AND COMPUTING↗

On Properties of Adjoint Systems for Evolutionary PDEs

We investigate the geometric structure of adjoint systems associated with evolutionary partial differential equations at the fully continuous, semi-discrete, and fully discrete levels and the relations between these levels. We show that the adjoint system associated with an evolutionary partial differential equation has an infinite-dimensional Hamiltonian structure, which is useful for connecting the fully continuous, semi-discrete, and fully discrete levels. We subsequently address the question of discretize-then-optimize versus optimize-then-discrete for both semi-discretization and time integration, by characterizing the commutativity of discretize-then-optimize methods versus optimize-then-discretize methods uniquely in terms of an adjoint-variational quadratic conservation law. For Galerkin semi-discretizations and one-step time integration methods in particular, we explicitly construct these commuting methods by using structure-preserving discretization techniques.

97 MATHEMATICS AND COMPUTING↗

(U) SENSMG: First-Order Sensitivities of Neutron Reaction Rates, Reaction-Rate Ratios, Leakage, k eff , α , and Subcritical Multiplication Using PARTISN

SENSMG is a tool for computing first-order sensitivities of neutron reaction rates, reaction-rate ratios, leakage, k eff , α, and subcritical multiplication using the PARTISN multigroup discrete-ordinates code. SENSMG computes sensitivities to all of the transport cross sections and data (total, fission, a nu, chi, and all scattering moments), two edit cross sections (absorption and capture), and the density for every nuclide and energy group. It also computes sensitivities to the mass density for every material and derivatives with respect to all interface locations and outer boundaries. It computes sensitivities to user specified reactions whose cross sections are available in a user-supplied NJOY output file. The tool can be used for one-dimensional spherical and slab (r) and two-dimensional cylindrical (r-z) geometries. The tool can be used for fixed-source and eigenvalue problems. For most responses, the tool implements Generalized Perturbation Theory (GPT) as discussed by Williams and Stacey. The tool is thus limited to computing sensitivities only for GPT-allowable responses. For subcritical multiplication, the tool implements sensitivities derived by O’Brien and Clark. SENSMG has a similar role as the old SWANLAKE (Ref. 8), FORSS (Ref. 9), and SENSIT (Ref. 10) codes. It has capabilities similar to those of SUSD3D (Refs. 11 and 12), which also uses PARTISN. Section II of this report describes the theory behind adjoint-based sensitivities, gives the equations that SENSMG solves, and defines the sensitivities that are output. Section III describes the user interface, including the input file and command line options. Section IV describes the output. Section V gives some notes about the coding that may be of interest. Section VI presents some sample problems and discusses verification, which is ongoing. Section VII lists needs and ideas for future work. Appendix A lists most of the input files whose results are presented in Sec. VI. Appendix B provides some useful details on one of the cross-section libraries that SENSMG supports.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PETSc TSAdjoint: A Discrete Adjoint ODE Solver for First-Order and Second-Order Sensitivity Analysis

Here, we present a new software system PETSc TSAdjoint for first-order and second order adjoint sensitivity analysis of time-dependent nonlinear differential equations. The derivative calculation in PETSc TSAdjoint is essentially a high-level algorithmic differentiation process. The adjoint models are derived by differentiating the timestepping algorithms and implementing them based on the parallel infrastructure in PETSc. Full differentiation of the library code, including MPI routines, is avoided, and users do not need to derive their own adjoint models for their specific applications. PETSc TSAdjoint can compute the first-order derivative, that is, the gradient of a scalar functional, and the Hessian-vector product, which carries second-order derivative information, while requiring minimal input (a few callbacks) from the users. The adjoint model employs optimal checkpointing schemes in a manner that is transparent to users. Finally, usability, efficiency, and scalability are demonstrated through examples from a variety of applications.

79 ASTRONOMY AND ASTROPHYSICS↗

Differentiable programming for online training of a neural artificial viscosity function within a staggered grid Lagrangian hydrodynamics scheme

Lagrangian methods to solve the inviscid Euler equations produce numerical oscillations near shock waves. A common approach to reducing these oscillations is to add artificial viscosity (AV) to the discrete equations. The AV term acts as a dissipative mechanism that attenuates oscillations by smearing the shock across a finite number of computational cells. However, AV introduces several control parameters that are not determined by the underlying physical model, and hence, in practice are tuned to the characteristics of a given problem. We seek to improve the standard quadratic-linear AV form by replacing it with a learned neural function that reduces oscillations relative to exact solutions of the Euler equations, resulting in a hybrid numerical-neural hydrodynamic solver. Because AV is an artificial construct that exists solely to improve the numerical properties of a hydrodynamic code, there is no offline ‘viscosity data’ against which a neural network can be trained before inserting into a numerical simulation, thus requiring online training. We achieve this via differentiable programming, i.e. end-to-end backpropagation or adjoint solution through both the neural and differential equation code, using automatic differentiation of the hybrid code in the Julia programming language to calculate the necessary loss function gradients. A novel offline pre-training step accelerates training by initializing the neural network to the default numerical AV scheme, which can be learned rapidly by space-filling sampling over the AV input space. We find that online training over early time steps of simulation is sufficient to learn a neural AV function that reduces numerical oscillations in long-term hydrodynamic shock simulations. These results offer an early proof-of-principle that online differentiable training of hybrid numerical schemes with novel neural network components can improve certain performance aspects existing in purely numerical schemes.

97 MATHEMATICS AND COMPUTING↗

Higher-derivative relations between scalars and gluons

We extend the covariant color-kinematics duality introduced by Cheung and Mangan to effective field theories. We focus in particular on relations between the effective field theories of gluons only and of gluons coupled to bi-adjoint scalars. Maps are established between their respective equations of motion and between their tree-level scattering amplitudes. An additional rule for the replacement of flavor structures by kinematic factors realizes the map between higher-derivative amplitudes. As an example of new relations, the pure-gluon amplitudes of mass dimension up to eight, featuring insertions of the F 3 and F 4 operators which satisfy the traditional color-kinematics duality, can be generated at all multiplicities from just renormalizable amplitudes of gluons and bi-adjoint scalars. We also obtain closed-form expressions for the kinematic numerators of the dimension-six gluon effective field theory, which are valid in D space-time dimensions. Finally, we find strong evidence that this extended covariant color-kinematics duality relates the (DF) 2 +YM(+Φ 3 ) theories which, at low energies, generate infinite towers of operators satisfying the traditional color-kinematics duality, beyond aforementioned F 3 and F 4 ones.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predicting mesoscale spectral thermal conductivity using advanced deterministic phonon transport techniques

We present a review, demonstration and simulation of phonon transport for the purposes of predicting materials performance at the mesoscale. We focus primarily on the development and implementation of a unified methodology to enable predictive heat transport. We report on the current state of the art as it pertains to deterministic phonon transport methodologies, discussing various topics concerning phonons. In application, we focus on the Self-Adjoint Angular Flux (SAAF) formulation of the Boltzmann transport equation for phonons, and develop the spatial, angular, and material property discretization required to accurately simulate the predictive physics of heat transport in dielectrics. We discuss thermal interfacial resistance and present our formulation of the diffuse mismatch model for simulating phonon interactions at internal boundaries. We have recently developed a deterministic, spectral phonon transport method for predicting effective thermal conductivity ($\kappa_{\textrm{eff}}$), using Bose-Einstein source terms coupled through an average material temperature. In this method, we introduce a closure term to the phonon transport system which acts as a redistribution function for the total energy of the system, and serves as a guide for the amount of non-equilibrium behavior occurring in the system. This method predicts thermal conductivity and equilibrium temperature distributions in homogeneous and heterogeneous materials using data generated by ab initio density functional theory methods. We employ polarization, density of states and full dispersion spectra to resolve thermal conductivity with numerous angular and spatial discretizations. Our implementation utilizes a Richardson iteration on a modified version of the phonon scattering source. The equations associated with this method are solved via a modification of traditional source iteration. We compare the performance of source iteration applied to an existing uncoupled, traditional SAAF method to our new method and comment on the iterative performance of each. We observe ballistic and diffusive phonon scattering as acoustic thickness of the domain changes, and are able to make comparisons between the accuracy and efficiency of both methods.

36 MATERIALS SCIENCE↗

Differentiable lagrangian shock hydrodynamics with application to stable shock acceleration of density interfaces

We develop a gradient based optimization approach for the equations of compressible, Lagrangian hydrodynamics and demonstrate how it can be employed to automatically uncover strategies to control hydrodynamic instabilities arising from shock acceleration of density interfaces. Strategies for controlling the Richtmyer-Meshkov instability (RMI) are of great benefit for inertial confinement fusion (ICF) where shock interactions with many small imperfections in the density interface lead to instabilities which rapidly grow over time. These instabilities lead to mixing which, in the case of laser driven ICF, quenches the runaway fusion process ruining the potential for positive energy return. Here, we demonstrate that control of these instabilities can be achieved by optimization of initial conditions with ( > 100) parameters. Optimizing over a large parameter space like this is not possible with gradient-free optimization strategies. This requires computation of the gradient of the outputs of a numerical solution to the equations of Lagrangian hydrodynamics with respect to the inputs. We show that the efficient computation of these gradients is made possible via a judicious application of (i) adjoint methods, the exact formal representation of sensitivities involving partial differential equations, and (ii) automatic differentiation (AD), the algorithmic calculation of derivatives of functions. Careful regularization of multiple operators including artificial viscosity and timestep control is required. We perform design optimization of > 100 parameter energy field driving the Richtmyer Meshkov instability showing significant suppression while simultaneously enhancing the acceleration of the interface relative to a nominal baseline case.

Hydrophysics↗

Topology optimization of additively manufactured fluidic components free of internal support structures

This report integrates projection-based approaches for implementing overhang constraints with fluid topology optimization to design additively manufactured fluidic components that do not require internal support structures. Internal support structures are challenging, potentially impossible to remove in complex fluid networks, yet would degrade fluidic performance if left within the part. This presents a major challenge in coupling topology optimization with additive manufacturing in the design of fluid components. The proposed approach leverages past work in overhang constraints for solid mechanics, including projection formulations and adjoint sensitivity analysis, and considers incompressible Navier–Stokes equations for laminar fluid flow. The approach is demonstrated on 2D and 3D fluid topology optimization problems to minimize pressure drop and constrain mass flow rates in pipes and manifolds. Resulting designs are crisp, logical, satisfy performance constraints, and satisfy overhang constraints, eliminating the need for internal support structures.

42 ENGINEERING↗

Bootstrapping conformal QED 3 and deconfined quantum critical point

We bootstrap the deconfined quantum critical point (DQCP) and 3D Quantum Electrodynamics (QED 3 ) coupled to N f flavors of two-component Dirac fermions. We show the lattice and perturbative results on the SO(5) symmetric DQCP are excluded by the bootstrap bounds with an assumption that the lowest singlet scalar is irrelevant. Remarkably, we discover a new family of kinks in the 3D SO(N) vector bootstrap bounds with N ⩾ 6. We demonstrate coincidences between SU(N f ) adjoint and $SO (N^2_f-1$) vector bootstrap bounds due to a novel algebraic relation between the crossing equations. By introducing gap assumptions breaking the $SO (N^2_f-1$) symmetry, the SU(N f ) adjoint bootstrap bounds with large N f converge to the 1/N f perturbative results of QED 3 . Our results provide strong evidence that the SO(5) DQCP is not continuous and the critical flavor number of QED 3 is slightly above 2: $N^*_f\in$ (2,4). Bootstrap results near $N^*_f$ are well consistent with the merger and annihilation mechanism for the loss of conformality in QED 3 .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Gas-Cooled High-Temperature Pebble-Bed Reactor Reference Plant Model

This report details a fully coupled neutronics thermal hydraulics reference plant model for a gas-cooled high-temperature pebble-bed reactor. The multiphysics model is developed on the Nuclear Regulatory Commission's Comprehensive Reactor Analysis Bundle (BlueCRAB) available on the Idaho National Laboratory high performance computer, which natively and seamlessly couples Griffin, Pronghorn, and the BISON MOOSE-based applications. Griffin provides the reactor physics capabilities including depletion to the equilibrium core, k-eigenvalue, adjoint, and transient solutions. Pronghorn solves the porous medium equations for the fluid regions and conduction in the solid regions. BISON solves thermal conduction problems for the average pebble and TRISO in the pebble-bed core thus providing the fuel and moderator spatial fields for each pebble burnup group. The neutronics feedback relies primarily on fuel and moderator temperatures. We present results for the coupled steady state equilibrium core and a protected loss of flow event. Although this model is to be considered prototypical with regard to the capabilities in BlueCRAB, its results are consistent with published work by the Institute of Nuclear and New Energy Technology (INET) in China and other research entities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Progress on Optimizing Wind Farms and Rotor Designs Using Adjoints

Modern wind plants are increasingly tasked with multiple performance objectives. In addition to designing plants that maximize power output and minimize the levelized cost of energy (LCOE), the design and operation of wind plants is increasingly influenced by challenges regarding grid integration of variable generation renewables. This places a growing emphasis on making wind plants more controllable and predictable. WindSE is a Reynolds-averaged Navier-Stokes (RANS) model designed around analytical gradient and adjoint methods, with the ability to capture terrain-induced effects, as shown in Figure 1. The recent addition of an unsteady solver with an actuator line method (ALM) and ongoing work to enable massively parallel optimizations gives it a unique niche to explore coupled plant-level controls and design problems. This code is an open source python package built on the FEniCS framework that utilizes fast, parallel PETSc solvers to model fluid flow throughout wind-farm scale domains. Two recent studies performed using WindSE demonstrate the capability to optimize under a wide variety of flow conditions and objective functions. In the first, we present an optimization focused on modifying the layout of a wind farm with a fixed number of turbines for maximum total power output [1]. This study highlights the ability to quickly perform simulations using the steady Navier-Stokes solver combined with rotors represented as actuator disks while also stressing the importance of capturing terrain-induced effects. Gradient-based optimization using the RANS equations is viable due to the inclusion of efficiently computed adjoint derivatives. We interpret the physical results of the optimal layout and also discuss the computational cost of scaling to larger problems. In the second study, we present the capabilities of the unsteady Navier-Stokes solver, where rotor-blade profiles represented by actuator lines are optimized to enhance wake steering effects and overall power production [2]. We quantify the wind plant performance gains obtained from this type of simultaneous control co-design optimization as compared to optimizing the blade design and yaw independently. Figure 2 shows the differences between a baseline two-turbine system and an optimized system where we fine-tune the blade chord profile. Results and challenges from each study are quickly summarized and used to motivate the current development efforts within WindSE. Current and future work is focused on enabling higher-resolution studies with more degrees of freedom through parallelization of both the simulation and optimization algorithms. We present benchmarking results to show that WindSE performs well in both weak- and strong-scaling tests and further demonstrate that the optimizer obtains the same convergence rates in both shared- and distributed-memory environments. Using larger wind farms, we can study deep-array effects within an optimization context, allowing the use of objective functions that have been previously unstudied. As an example, we present ongoing work on a blockage metric which characterizes the loss of available kinetic energy due to wake effects from multiple upstream turbines.

adjoint optimization↗

Compensating attenuation effects in full-waveform inversion with dissipation-dispersion decoupling

Seismic attenuation poses challenges to velocity model building from acoustic/elastic full-waveform inversion (FWI). In particular, when constructing the FWI gradient for velocity inversion, recent studies have indicated that the high-attenuation structure could distort the gradient by damping the amplitudes and shifting the kinematic phases, resulting in an imbalanced update and thus unreliable velocity model. These Q effects are particularly significant in the reflection acquisition geometry due to the “double-damping” issue. Here, we develop a Q-compensated FWI algorithm for constructing a Q-free FWI gradient. By using a recently developed viscoacoustic wave propagator, this compensation can be done conveniently by keeping the dispersion term and flipping the dissipation term in the wave equation when we simulate the forward and time-reversed adjoint wavefields. The resultant gradient obtained by interacting these two wavefields has correct kinematics and Q-free amplitudes. This Q-compensated FWI can balance the update between Q- and no- Q-areas, which we determine using synthetic examples. In addition, we illustrate how to take advantage of the dissipation-dispersion decoupling to determine the anomalous Q value in the Q model building workflow via Q-compensated reverse time migration.

Geochemistry & Geophysics↗

Accelerated Deterministic Phonon Transport With Consistent Material Temperature and Intensities

Abstract We present a method for deterministically solving the frequency and temperature dependent phonon radiative transport (PRT) equation in the single-mode relaxation time (SMRT) approximation in the self-adjoint angular flux (SAAF) form. To handle the nonlinear coupling between the phonon intensities and the material temperature, we apply a linearization approach that is similar to one in thermal radiative transport. This procedure leads to the PRT equation with pseudo-scattering. The method presented includes acceleration of both the inner pseudo-scattering source iterations and outer temperature iteration with a gray diffusion synthetic acceleration (DSA) and Anderson acceleration, respectively. We use the finite-element method to discretize the PRT equation in space and the method of discrete ordinates (SN) for angular discretization. The proposed method is verified by a gray method of manufactured solutions problem and demonstrated on a problem using temperature and direction dependent multigroup data from lithium aluminate (LiAlO2). The iterative performance of the acceleration method in each test is then compared to the unaccelerated method.

Engineering↗

Dynamic Parameter Estimation with Physics-based Neural Ordinary Differential Equations

Accurate estimation of dynamic parameters of gen-erators is crucial to building a reliable model for dynamical studies and reliable operation of the power system. This paper develops a physics-based neural ordinary differential equations (ODE) approach to learn the parameters of generator dynamic model using phasor measurement units (PMU) data. We design a physics-based neural network to represent the swing equations of the power system dynamics. A loss function is defined as the difference between dynamic simulation results from the physics-based neural networks and pseudo PMU measurements. The parameters of generator dynamic model are iteratively updated using the neural ODEs and the adjoint method. By exploiting the mini-batch scheme in neural ODE training, the parameter estimation performance is significantly improved. Numerical study results on a 3-machine 9-bus system show that the proposed algorithm outperforms state-of-the-art baseline method in both computation time and dynamic parameter estimation accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A direct-adjoint approach for material point model calibration with application to plasticity

Here, this paper proposes a new approach for the calibration of material parameters in local elastoplastic constitutive models. The calibration is posed as a constrained optimization problem, where the constitutive model evolution equations for a single material point serve as constraints. The objective function quantifies the mismatch between the stress predicted by the model and corresponding experimental measurements. To improve calibration efficiency, a novel direct-adjoint approach is presented to compute the Hessian of the objective function, which enables the use of second-order optimization algorithms. Automatic differentiation is used for gradient and Hessian computations. Two numerical examples are employed to validate the Hessian matrices and to demonstrate that the Newton–Raphson algorithm consistently outperforms gradient-based algorithms such as L-BFGS-B.

36 MATERIALS SCIENCE↗