Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automatic adjoint”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Aerodynamic Shape Optimization of the STARC-ABL Concept for Minimal Inlet Distortion

The NASA single-aisle turboelectric aircraft with an aft boundary layer propulsor (STARC-ABL) concept utilizes a novel electrically driven aft fan that ingests the fuselage boundary-layer for increased propulsive efficiency. In this paper we examine how aerodynamic shaping of the fuselage diffuser and nacelle inlet can reduce the flow distortion at the aft fan. Adjoint-based aerodynamic shape optimization with the ARP1420 distortion metric objective is used to automatically determine the optimal shapes for minimal fan-face distortion. Single and multipoint optimizations are carried out for simplified body-duct and wing-body-duct configurations. These two configurations highlight the importance of including the wing downwash effects when designing the propulsor. The optimizations showed the body-duct configuration can obtain cruise distortion values of approximately 1% while the wing-body-duct configuration can obtain distortion values of just over 2%.

Kenway, Gaetan K. W.↗
DOE OSTI2022

Image-domain DAS 3D VSP elastic transmission tomography

SUMMARY Full-wavefield elastic imaging of active-source seismic data acquired by downhole receivers commonly offers higher-resolution subsurface images in the vicinity of a borehole compared to conventional surface seismic data sets, which can lack higher-frequency wavefield components due to longer travel paths and increased attenuation. An increasingly used approach for downhole acquisition is vertical seismic profiling (VSP), which has become more attractive when coupled with distributed acoustic sensing (DAS) using optical fibres installed in wells. The main difficulty for generating high-quality images with full-wavefield imaging tools for DAS VSP data, though, is the need for an accurate velocity model. To build plausible velocity models using active-source DAS VSP data, we adopt a 3-D image-domain elastic transmission tomography technique, originally developed for surface-recorded passive (microseismic) data, by exchanging the source and receiver positions (i.e. reciprocity) to mimic a passive-seismic surface monitoring scenario. The inversion approach exploits various images for each source constructed through time-reverse imaging (TRI) of downgoing P- and S-wave first-arrival waveforms. The TRI process uses the kinetic term of the (extended) PS energy imaging condition that exhibits sufficient sensitivity to velocity model errors. The method automatically updates the P- and S-wave velocity models to optimize image focusing via adjoint-state inversion. We illustrate the efficacy of the adopted elastic inversion technique using an active-source DAS 3-D VSP field data set acquired in the North Slope of Alaska. The numerical experiments demonstrate that the inverted elastic velocity models can be further used in full-wavefield acoustic/elastic imaging algorithms to obtain accurate subsurface images.

Oren, Can (ORCID:000000019534265X)↗
NASA NTRS1975

A steepest descents method for reentry optimization

A steepest descents optimization program is applied to the problem of a lifting vehicle entering the earth's atmosphere. The program employs penalty functions representing terminal conditions and inflight inequality constraints. During each iteration, it reduces a single performance measure which is the sum of the performance index and the penalty functions. Therefore, only one set of adjoint equations must be integrated per iteration. Values of weight factors, multiplying the penalty functions, are automatically adjusted before each iteration in order that the penalty functions will approach acceptable values. This method is shown to be a form of the classical Lagrange multiplier methods.

Andrus, J. F.↗
DOE OSTI2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗
NASA NTRS1997

Constrained Multipoint Aerodynamic Shape Optimization Using an Adjoint Formulation and Parallel Computers

An aerodynamic shape optimization method that treats the design of complex aircraft configurations subject to high fidelity computational fluid dynamics (CFD), geometric constraints and multiple design points is described. The design process will be greatly accelerated through the use of both control theory and distributed memory computer architectures. Control theory is employed to derive the adjoint differential equations whose solution allows for the evaluation of design gradient information at a fraction of the computational cost required by previous design methods. The resulting problem is implemented on parallel distributed memory architectures using a domain decomposition approach, an optimized communication schedule, and the MPI (Message Passing Interface) standard for portability and efficiency. The final result achieves very rapid aerodynamic design based on a higher order CFD method. In order to facilitate the integration of these high fidelity CFD approaches into future multi-disciplinary optimization (NW) applications, new methods must be developed which are capable of simultaneously addressing complex geometries, multiple objective functions, and geometric design constraints. In our earlier studies, we coupled the adjoint based design formulations with unconstrained optimization algorithms and showed that the approach was effective for the aerodynamic design of airfoils, wings, wing-bodies, and complex aircraft configurations. In many of the results presented in these earlier works, geometric constraints were satisfied either by a projection into feasible space or by posing the design space parameterization such that it automatically satisfied constraints. Furthermore, with the exception of reference 9 where the second author initially explored the use of multipoint design in conjunction with adjoint formulations, our earlier works have focused on single point design efforts. Here we demonstrate that the same methodology may be extended to treat complete configuration designs subject to multiple design points and geometric constraints. Examples are presented for both transonic and supersonic configurations ranging from wing alone designs to complex configuration designs involving wing, fuselage, nacelles and pylons.

Reuther, James↗
DOE OSTI2016

Land-surface parameter optimisation using data assimilation techniques: the adJULES system V1.0

Land-surface models (LSMs) are crucial components of the Earth system models (ESMs) that are used to make coupled climate–carbon cycle projections for the 21st century. The Joint UK Land Environment Simulator (JULES) is the land-surface model used in the climate and weather forecast models of the UK Met Office. JULES is also extensively used offline as a land-surface impacts tool, forced with climatologies into the future. In this study, JULES is automatically differentiated with respect to JULES parameters using commercial software from FastOpt, resulting in an analytical gradient, or adjoint, of the model. Using this adjoint, the adJULES parameter estimation system has been developed to search for locally optimum parameters by calibrating against observations. This paper describes adJULES in a data assimilation framework and demonstrates its ability to improve the model–data fit using eddy-covariance measurements of gross primary production (GPP) and latent heat (LE) fluxes. adJULES also has the ability to calibrate over multiple sites simultaneously. This feature is used to define new optimised parameter values for the five plant functional types (PFTs) in JULES. The optimised PFT-specific parameters improve the performance of JULES at over 85 % of the sites used in the study, at both the calibration and evaluation stages. Furthermore, the new improved parameters for JULES are presented along with the associated uncertainties for each parameter.

58 GEOSCIENCES↗
NASA NTRS2015

Adaptive Shape Control for Aerodynamic Design

We present an approach to aerodynamic optimization in which the shape control is adaptively parameterized. Starting from a coarse set of design variables, a sequence of higher-dimensional nested search spaces is automatically generated. Refinement can be either uniform or adaptive, in which case only the most important shape control is added. The relative importance of candidate design variables is determined by comparing objective and constraint gradients, computed at low cost via adjoint solutions. A search procedure for finding an effective ensemble of shape parameters is also given. We first demonstrate this system on a multipoint drag miminization problem in 2D with many constraints, showing that an adaptive parameterization approach consistently achieves smoother, more robust, and faster design improvement than fixed parameterizations. We also establish a 3D shape- matching benchmark, where we demonstrate that our approach automatically discovers the necessary parameters to match a target shape. By largely automating shape parameterization, this work also aims to remove a time-consuming aspect of shape optimization.

Aerodynamic Design↗
DOE OSTI2019

Sicopolis-AD: Quick-Start Manual

SICOPOLIS-AD is a version of the ice sheet model SICOPOLIS (originally: www.sicopolis.net) used to produce adjoint sensitivities of chosen control variables. It can be used to assess the sensitivity of some quantity of interest to perturbations in variables that may affect that quantity of interest. For example, it can be used to comprehensively and quantitatively assess exactly how the volume of the Greenland Ice Sheet is sensitive to changes in surface temperature at each point on the ice sheet. This document provides basic startup and troubleshooting methods, as well as some best practices for making changes in the code for the purposes of adjoint production.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2002

Adjoint-Based, Three-Dimensional Error Prediction and Grid Adaptation

Engineering computational fluid dynamics (CFD) analysis and design applications focus on output functions (e.g., lift, drag). Errors in these output functions are generally unknown and conservatively accurate solutions may be computed. Computable error estimates can offer the possibility to minimize computational work for a prescribed error tolerance. Such an estimate can be computed by solving the flow equations and the linear adjoint problem for the functional of interest. The computational mesh can be modified to minimize the uncertainty of a computed error estimate. This robust mesh-adaptation procedure automatically terminates when the simulation is within a user specified error tolerance. This procedure for estimating and adapting to error in a functional is demonstrated for three-dimensional Euler problems. An adaptive mesh procedure that links to a Computer Aided Design (CAD) surface representation is demonstrated for wing, wing-body, and extruded high lift airfoil configurations. The error estimation and adaptation procedure yielded corrected functions that are as accurate as functions calculated on uniformly refined grids with ten times as many grid points.

Park, Michael A.↗
NASA NTRS1994

Methodology for sensitivity analysis, approximate analysis, and design optimization in CFD for multidisciplinary applications

The straightforward automatic-differentiation and the hand-differentiated incremental iterative methods are interwoven to produce a hybrid scheme that captures some of the strengths of each strategy. With this compromise, discrete aerodynamic sensitivity derivatives are calculated with the efficient incremental iterative solution algorithm of the original flow code. Moreover, the principal advantage of automatic differentiation is retained (i.e., all complicated source code for the derivative calculations is constructed quickly with accuracy). The basic equations for second-order sensitivity derivatives are presented; four methods are compared. Each scheme requires that large systems are solved first for the first-order derivatives and, in all but one method, for the first-order adjoint variables. Of these latter three schemes, two require no solutions of large systems thereafter. For the other two for which additional systems are solved, the equations and solution procedures are analogous to those for the first order derivatives. From a practical viewpoint, implementation of the second-order methods is feasible only with software tools such as automatic differentiation, because of the extreme complexity and large number of terms. First- and second-order sensitivities are calculated accurately for two airfoil problems, including a turbulent flow example; both geometric-shape and flow-condition design variables are considered. Several methods are tested; results are compared on the basis of accuracy, computational time, and computer memory. For first-order derivatives, the hybrid incremental iterative scheme obtained with automatic differentiation is competitive with the best hand-differentiated method; for six independent variables, it is at least two to four times faster than central finite differences and requires only 60 percent more memory than the original code; the performance is expected to improve further in the future.

Taylor, Arthur C., III↗
DOE OSTI2022

Automatic Calibration of a Geomechanical Model from Sparse Data for Estimating Stress in Deep Geological Formations

Summary In this study, we demonstrate geomechanical modeling with fully automatic parameter calibration to estimate the full geomechanical stress fields of a prospective US carbon dioxide (CO2) storage site, based on sparse measurement data. The goal is to compute full stress tensor field estimates (principal stresses and orientations) that are maximally compatible with observations within the constraints of the model assumptions, thereby extending pointwise, incomplete partial stress measurement to a simulated full formation stress field, as well as a rough assessment of the associated error. We use the Perch site, located in Otsego County, Michigan, USA, as our case study. The input data consist of partial stress tensor information inferred from in-situ borehole tests, geophysical well logs, and processing of seismic data. A static earth model (SEM) of the site was developed, and geomechanical simulation functionality of the open-source MATLAB Reservoir Simulation Toolbox (MRST) was used to model the stress field. Adjoint-based nonlinear optimization was used to adjust boundary conditions and material properties to calibrate simulated results of observations. Results were interpreted through a Bayesian framework. The focus of this paper is to demonstrate how the fully automatic calibration procedure works and discuss the results obtained; it does not attempt a detailed analysis of the stress field in the context of the proposed CO2 storage initiatives. Our work is part of a larger effort to noninvasively determine in-situ stresses in deep formations considered for CO2 storage. Guided by previously published research on geomechanical model calibration, our work presents a novel calibration approach supporting a potentially large number of linear or nonlinear calibration parameters to produce results optimally agreeing with available measurements and thus extend partial pointwise estimates to full tensor fields compatible with the physics of the site.

Engineering↗
DOE OSTI2020

SICOPOLIS-AD: Quick-Start Manual (Revision 0.11)

SICOPOLIS-AD is a version of the ice sheet model SICOPOLIS used to produce adjoint sensitivities of chosen control variables. It can be used to assess the sensitivity of some quantity of interest to perturbations in variables that may affect that quantity of interest. For example, it can be used to comprehensively and quantitatively assess exactly how the volume of the Greenland Ice Sheet is sensitive to changes in surface temperature at each point on the ice sheet. This document provides basic startup and troubleshooting methods, as well as some best practices for making changes in the code for the purposes of adjoint production.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Graph-based Reversible Evaluation and Tangents Library

GRETL is a C++ library for evaluation, re-evaluation and algorithmic differentiation of functional operations on an arbitrary computational graph with limited memory usage. Similar to popular machine learning frameworks in Python, like PyTorch and JAX, it tracks and stores both operations and output data as functions are evaluated. Once this composition of functions is built up, the entire chain of operations can be back propagated to compute sensitivities of the final result with respect to any number of inputs. In contrast to most machine learning applications, memory usage becomes the bottleneck for back propagation in many physics applications, especially for time-dependent PDEs. Dynamic check pointing becomes essential. An important distinguishing feature of GRETL is its ability to limit the maximum memory usage by automatically dynamic checkpointing the data output for each graph operation (see Wang, Moin, Iaccarino, 2009). During backpropagation, parts of the graph that are no longer in memory are automatically re-evaluated from upstream checkpointed states as needed for derivative sensitivity calculations (or more precisely, for vector-Jacobian products). GRETL is particularly beneficial for applications, such as coupled multi-physics, where deriving adjoint-based sensitivities and managing checkpoint memory across modules becomes onerous. Cases which can be readily handled by the GRETL library include: different time-integration algorithms per physics (e.g., coupled predictor-corrector algorithms, IMEX, etc.), sub-cycling, asynchronous integrators, state dependent timestep sizes, iterative solvers and coupling algorithms, controller algorithms, and more.

Tupek, MichaelR [Lawrence Livermore National Labor↗
DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Longitudinal sound waves in a collisionless, quasineutral plasma

The time evolution of slow sound waves in a homogeneous, collisionless and quasineutral plasma, in particular their Landau damping, is investigated using the kinetic-magnetohydrodynamics formulation of Ramos ( J. Plasma Phys. vol. 81, 2015 p. 905810325; vol. 82, 2016 p. 905820607). In this approach, the electric field is eliminated from a closed, hybrid fluid-kinetic system that ensures automatically the fulfilment of the charge neutrality condition. Considering the time dependence of a spatial-Fourier-mode linear perturbation with wavevector parallel to the equilibrium magnetic field, this can be cast as a second-order self-adjoint problem with a continuum spectrum of real and positive squared frequencies. Therefore, a conventional resolution of the identity with a continuum basis of singular normal modes is guaranteed, which simplifies significantly a Van Kampen-like treatment of the Landau damping. The explicit form of such singular normal modes is obtained, along with their orthogonality relations. These are used to derive the damped time evolution of the fluid moments of solutions of initial-value problems, for the most general kinds of initial conditions. The non-zero parallel electric field is not used explicitly in this analysis, but it is calculated from any given solution after the later has been obtained.

Physics↗
DOE OSTI2018

Kinetic-magnetohydrodynamic description of longitudinal sound waves in a collisionless, quasineutral plasma

The time evolution of slow sound waves in a homogeneous, collisionless and quasineutral plasma, in particular their Landau damping, is investigated using the kinetic magnetohydrodynamics formulation of J.J. Ramos (J . Plasma Phys. vol. 81, 2015 p. 905810325; vol. 82, 2016 p. 905820607). In this approach, the electric field is eliminated from a closed, hybrid fluid-kinetic system that ensures automatically the fulfillment of the charge neutrality condition. Considering the time dependence of a spatial-Fourier-mode linear perturbation with wavevector parallel to the equilibrium magnetic field, this can be cast as a second-order self-adjoint problem with a continuum spectrum of real and positive squared frequencies. Therefore, a conventional resolution of the identity with a continuum basis of singular normal modes is guaranteed, which simplifies significantly a Van Kampen-like treatment of the Landau damping. The explicit form of such singular normal modes is obtained, along with their orthogonality relations. These are used to derive the damped time evolution of the fluid moments of solutions of initial-value problems, for the most general kinds of initial conditions. The non-zero parallel electric field is not used explicitly in this analysis, but it is calculated from any given solution after the later has been obtained.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1997

CFD Analysis and Design Optimization Using Parallel Computers

A versatile and efficient multi-block method is presented for the simulation of both steady and unsteady flow, as well as aerodynamic design optimization of complete aircraft configurations. The compressible Euler and Reynolds Averaged Navier-Stokes (RANS) equations are discretized using a high resolution scheme on body-fitted structured meshes. An efficient multigrid implicit scheme is implemented for time-accurate flow calculations. Optimum aerodynamic shape design is achieved at very low cost using an adjoint formulation. The method is implemented on parallel computing systems using the MPI message passing interface standard to ensure portability. The results demonstrate that, by combining highly efficient algorithms with parallel computing, it is possible to perform detailed steady and unsteady analysis as well as automatic design for complex configurations using the present generation of parallel computers.

Martinelli, Luigi↗
DOE OSTI2015

ACCELERATING FUSION REACTOR NEUTRONICS MODELING BY AUTOMATIC COUPLING OF HYBRID MONTE CARLO/DETERMINISTIC TRANSPORT ON CAD GEOMETRY

Detailed radiation transport calculations are necessary for many aspects of the design of fusion energy systems (FES) such as ensuring occupational safety, assessing the activation of system components for waste disposal, and maintaining cryogenic temperatures within superconducting magnets. Hybrid Monte Carlo (MC)/deterministic techniques are necessary for this analysis because FES are large, heavily shielded, and contain streaming paths that can only be resolved with MC. The tremendous complexity of FES necessitates the use of CAD geometry for design and analysis. Previous ITER analysis has required the translation of CAD geometry to MCNP5 form in order to use the AutomateD VAriaNce reducTion Generator (ADVANTG) for hybrid MC/deterministic transport. In this work, ADVANTG was modified to support CAD geometry, allowing hybrid (MC)/deterministic transport to be done automatically and eliminating the need for this translation step. This was done by adding a new ray tracing routine to ADVANTG for CAD geometries using the Direct Accelerated Geometry Monte Carlo (DAGMC) software library. This new capability is demonstrated with a prompt dose rate calculation for an ITER computational benchmark problem using both the Consistent Adjoint Driven Importance Sampling (CADIS) method an the Forward Weighted (FW)-CADIS method. The variance reduction parameters produced by ADVANTG are shown to be the same using CAD geometry and standard MCNP5 geometry. Significant speedups were observed for both neutrons (as high as a factor of 7.1) and photons (as high as a factor of 59.6).

Biondo, Elliott D↗