Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradients”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Formulation and solution approach for calibrating activity-based travel demand model-system via microsimulation

This study addresses the problem of calibrating utility-maximizing nested logit activity-based travel demand model-systems. After estimation, it is common practice to use aggregate measurements to calibrate the estimated model-system’s parameters prior to their application in transportation planning, policy making, and operations. However, calibration of activity-based model-systems has received much less attention. Existing calibration approaches are myopic heuristics in the sense that they do not consider the fundamental inter-dependencies among choice-models and do not have a systematic way to adjust model parameters. Also, other purely simulation-based approaches do not perform well in large-scale applications. In this study, we focus on utility-maximizing nested logit activity-based model-systems and calibrating aggregate statistics such as activity shares, mode shares, time-dependent & mode-specific OD flows, and time-dependent & mode-specific sensor counts. We formulate the calibration problem as a simulation-based optimization problem and propose a stochastic gradient-based solution procedure to solve it. The solution procedure relies on microsimulation to calculate expectations of the aggregate statistics of interest to the calibration problem. Additionally, we derive approximate analytical expressions for the gradient of the objective function —that are evaluated through microsimulation on mini-batches of the population. The proposed solution procedure is sensitive to the fundamental structure of the activity-based model-system and is non-myopic in considering the dependencies across its model components. The formulated optimization problem is non-convex, highly nonlinear, and potentially has multiple-minima. Lastly, we show —through a real-world application— that the proposed solution procedure outperforms other state-of-the-art purely simulation-based optimization approaches in terms of computational efficiency, stability, and convergence. We also compare various gradient-based solution algorithms to determine the best algorithm to update the parameters. This work has the potential to facilitate wider and easier application of activity-based model-systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Multireference Electron Correlation Methods: Journeys along Potential Energy Surfaces

Multireference electron correlation methods describe static and dynamical electron correlation in a balanced way and, therefore, can yield accurate and predictive results even when single-reference methods or multiconfigurational self-consistent field theory fails. One of their most prominent applications in quantum chemistry is the exploration of potential energy surfaces. This includes the optimization of molecular geometries, such as equilibrium geometries and conical intersections and on-the-fly photodynamics simulations, both of which depend heavily on the ability of the method to properly explore the potential energy surface. Because such applications require nuclear gradients and derivative couplings, the availability of analytical nuclear gradients greatly enhances the scope of quantum chemical methods. This review focuses on the developments and advances made in the past two decades. A detailed account of the analytical nuclear gradient and derivative coupling theories is presented. Emphasis is given to the software infrastructure that allows one to make use of these methods. Notable applications of multireference electron correlation methods to chemistry, including geometry optimizations and on-the-fly dynamics, are summarized at the end followed by a discussion of future prospects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Implementation and Exploration of Parameterizations of Large-Scale Dynamics in NCAR's Single Column Atmosphere Model SCAM6

A single column model with parameterized large-scale (LS) dynamics is used to better understand the response of steady-state tropical precipitation to relative sea surface temperature under various representations of radiation, convection, and circulation. The large-scale dynamics are parametrized via the weak temperature gradient (WTG), damped gravity wave (DGW), and spectral weak temperature gradient (Spectral WTG) method in NCAR's Single Column Atmosphere Model (SCAM6). Radiative cooling is either specified or interactive, and the convective parameterization is run using two different values of a parameter that controls the degree of convective inhibition. Results are interpreted in the context of the Global Atmospheric System Studies -Weak Temperature Gradient (GASS-WTG) Intercomparison project. Using the same parameter settings and simulation configuration as in the GASS-WTG Intercomparison project, SCAM6 under the WTG and DGW methods produces erratic results, suggestive of numerical instability. However, when key parameters are changed to weaken the large-scale circulation's damping of tropospheric temperature variations, SCAM6 performs comparably to single column models in the GASS-WTG Intercomparison project. The Spectral WTG method is less sensitive to changes in convection and radiation than are the other two methods, performing qualitatively similarly across all configurations considered. Under all three methods, circulation strength, represented in 1D by grid-scale vertical velocity, is decreased when barriers to convection are reduced. This effect is most extreme under specified radiative cooling, and is shown to come from increased static stability in the column's reference radiative-convective equilibrium profile. This argument can be extended to interactive radiation cases as well, though perhaps less conclusively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Cr-Be Pushered Single Shell (PSS) Capsule Development

Pushered single shell (PSS) has emerged as an alternative platform of implosion to ease the stability issue at the ablation front. The design consists of a thin inner Be layer, a 50% Cr:Be plateau region, an S-curve gradient, a low Cr (1.5%) tamper layer, and followed by a pure Be outer layer. General Atomics has developed a way to fabricate the higher-Z Cr to lower-Z Be gradients on glow discharge polymer mandrels with a designed S-shape profile for optimal implosion stability using magnetron sputtering. Microstructure analysis of the gradient coating indicated that at lower Cr concentration a short order or amorphous structure was formed. Here, these fabricated PSS capsules were subsequently built into capsule fill tube assemblies, verified to be leak tight at both ambient and cryogenic conditions, and delivered to Lawrence Livermore National Laboratory for the shots. The capsule thermal stability was demonstrated by invariable Cr profiles before and after pyrolysis. However, cracking at inner Cr layers was observed, which has been attributed to thermal stress.

Capsule↗
DOE OSTI2024

Modeling electron temperature profiles in the pedestal with simple formulas for ETG transport

Abstract This paper reports on the refinement (building on (Hatch D.R. et al 2022 Phys. Plasmas 29 062501)) and application of simple formulas for electron heat transport from electron temperature gradient (ETG) driven turbulence in the pedestal. The formulas are improved by (1) improving the parameterization for certain key parameters and (2) carefully accounting for the impact of geometry and shaping in the underlying gyrokinetic simulation database. Comparisons with nonlinear gyrokinetic simulations of ETG transport in the MAST pedestal demonstrate the model’s applicability to spherical tokamaks in addition to standard aspect ratio tokamaks. We identify bounds for model applicability: the model is accurate in the steep gradient region, where the ETG turbulence is largely slab-like, but accuracy decreases as the temperature gradient becomes weaker in the pedestal top. We use the formula to model the electron temperature profile in the pedestal for four experimental scenarios while extensively varying input parameters to represent uncertainties. In all cases, the predicted electron temperature profile exhibits extreme sensitivity to separatrix temperature and density, which has implications for core-edge integration. The model reproduces the electron temperature profile for high η e = L n e / L T e scenarios but not for low η e scenarios in which microtearing modes (MTMs) have been identified. We develop a proof-of-concept model for MTM transport and explore the relative roles of ETG and MTM in setting the electron temperature profile.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Optimal control of large quantum systems: assessing memory and runtime performance of GRAPE

Abstract Gradient Ascent Pulse Engineering (GRAPE) is a popular technique in quantum optimal control, and can be combined with automatic differentiation (AD) to facilitate on-the-fly evaluation of cost-function gradients. We illustrate that the convenience of AD comes at a significant memory cost due to the cumulative storage of a large number of states and propagators. For quantum systems of increasing Hilbert space size, this imposes a significant bottleneck. We revisit the strategy of hard-coding gradients in a scheme that fully avoids propagator storage and significantly reduces memory requirements. Separately, we present improvements to numerical state propagation to enhance runtime performance. We benchmark runtime and memory usage and compare this approach to AD-based implementations, with a focus on pushing towards larger Hilbert space sizes. The results confirm that the AD-free approach facilitates the application of optimal control for large quantum systems which would otherwise be difficult to tackle.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Accelerating iterative ptychography with an integrated neural network

Electron ptychography is a powerful and versatile tool for high-resolution and dose-efficient imaging. Iterative reconstruction algorithms are powerful but also computationally expensive due to their relative complexity and the many hyperparameters that must be optimised. Gradient descent-based iterative ptychography is a popular method, but it may converge slowly when reconstructing low spatial frequencies. Here, in this work, we present a method for accelerating a gradient descent-based iterative reconstruction algorithm by training a neural network (NN) that is applied in the reconstruction loop. The NN works in Fourier space and selectively boosts low spatial frequencies, thus enabling faster convergence in a manner similar to accelerated gradient descent algorithms. We discuss the difficulties that arise when incorporating a NN into an iterative reconstruction algorithm and show how they can be overcome with iterative training. We apply our method to simulated and experimental data of gold nanoparticles on amorphous carbon and show that we can significantly speed up ptychographic reconstruction of the nanoparticles.

4DSTEM↗
DOE OSTI2024

Sphingomonas clade and functional distribution with simulated climate change

Microbes are essential for the functioning of all ecosystems, and as global warming and anthropogenic pollution threaten ecosystems, it is critical to understand how microbes respond to these changes. We investigated the climate response of Sphingomonas, a widespread gram-negative bacterial genus, during an 18-month microbial community reciprocal transplant experiment across a Southern California climate gradient. We hypothesized that after 18 months, the transplanted Sphingomonas clade and functional composition would correspond with site conditions and reflect the Sphingomonas composition of native communities. We extracted Sphingomonas sequences from metagenomic data across the gradient and assessed their clade and functional composition. Representatives of at least 12 major Sphingomonas clades were found at varying relative abundances along the climate gradient, and transplanted Sphingomonas clade composition shifted after 18 months. Site had a significant effect (PERMANOVA; P < 0.001) on the distribution of both Sphingomonas functional (R 2 = 0.465) and clade composition (R 2 = 0.400), suggesting that Sphingomonas composition depends on climate parameters. Additionally, for both Sphingomonas clade and functional composition, ordinations revealed that the transplanted communities shifted closer to the native Sphingomonas composition of the grassland site compared with the site they were transplanted into. Overall, our results indicate that climate and substrate collectively determine Sphingomonas clade and functional composition.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A backward SDE method for uncertainty quantification in deep learning

Here, we develop a backward stochastic differential equation based probabilistic machine learning method, which formulates a class of stochastic neural networks as a stochastic optimal control problem. An efficient stochastic gradient descent algorithm is introduced with the gradient computed through a backward stochastic differential equation. Convergence analysis for stochastic gradient descent optimization and numerical experiments for applications of stochastic neural networks are carried out to validate our methodology in both theory and performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Efficient derivative computation for unsteady fatigue-constrained nonlinear aero-structural wind turbine blade optimization

Gradient-based optimization offers significant efficiency advantages for wind turbine blade design, but its application has often been limited by the cost and accuracy of finite-difference derivative calculations, especially when fatigue constraints are considered. In this work, we systematically compare and evaluate four differentiation techniques, namely algorithmic differentiation, implicit differentiation, sparsity exploitation, and parallelization, to determine their effectiveness in computing accurate gradients through time-domain aero-structural simulations. By integrating these techniques with unsteady nonlinear aerodynamic and structural models, we develop software designed for accurate gradient computation. We show that combining these techniques addresses memory and runtime challenges associated with long simulations required by design load cases. Specifically, the most effective combination reduces derivative computation wall time by over an order of magnitude compared to finite differencing while maintaining superior accuracy. We demonstrate this approach in a proof-of-concept aero-structural optimization of a wind turbine blade that improves the cost of energy by 12.78 %. This comparative study establishes a viable approach for fatigue-aware blade design that balances computational efficiency with modeling accuracy.

17 WIND ENERGY↗
DOE OSTI2023

Large-Eddy Simulation of Flow Over Boeing Gaussian Bump Using Multiagent Reinforcement Learning Wall Model: Preprint

We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning. The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall at various computational grid points. It utilizes a wall eddy-viscosity formulation as the boundary condition to apply the modeled wall shear stress. Each agent receives states based on local instantaneous flow quantities at an off-wall location, computes a reward based on the estimated wall-shear stress, and provides an action to update the wall eddy viscosity at each time step. The trained wall model is validated in wall-modeled LES of flow over periodic hills at higher Reynolds numbers, and the results show the effectiveness of the model on flow with pressure gradients. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow. To further assess the robustness of the developed wall model, simulations of flow over the Boeing Gaussian bump are conducted at a Reynolds number of 2 x 10^6, based on the free-stream velocity and the bump width. The results of mean skin friction and pressure on the bump surface, as well as the velocity statistics of the flow field, are compared to those obtained from equilibrium wall model (EQWM) simulations and published experimental data sets. The developed wall model is found to successfully capture the acceleration and deceleration of the turbulent boundary layer on the bump surface, providing better predictions of skin friction near the bump peak and exhibiting comparable performance to the EQWM with respect to the wall pressure and velocity field. We also conclude that the subgrid-scale model is crucial to the accurate prediction of the flow field, in particular the prediction of separation.

boundary layer↗
DOE OSTI2023

Toward High Conversion Efficiency of Thermoelectric Modules through Synergistical Optimization of Layered Materials

Abstract Waste‐heat electricity generation using high‐efficiency solid‐state conversion technology can significantly decrease dependence on fossil fuels. Here, a synergistical optimization of layered half‐Heusler (hH) materials and module to improve thermoelectric conversion efficiency is reported. This is realized by manufacturing multiple thermoelectric materials with major compositional variations and temperature‐gradient‐coupled carrier distribution by one‐step spark plasma sintering. This strategy provides a solution to overcome the intrinsic concomitants of the conventional segmented architecture that only considers the matching of the figure of merit ( zT ) with the temperature gradient. The current design is dedicated to temperature‐gradient‐coupled resistivity and compatibility matching, optimum zT matching, and reducing contact resistance sources. By enhancing the quality factor of the materials by Sb‐vapor‐pressure‐induced annealing, a superior zT of 1.47 at 973 K is achieved for (Nb, Hf)FeSb hH alloys. Along with the low‐temperature high‐ zT hH alloys of (Nb, Ta, Ti, V)FeSb, the single stage layered hH modules are developed with efficiencies of ≈15.2% and ≈13.5% for the single‐leg and unicouple thermoelectric modules, respectively, under Δ T of 670 K. Therefore, this work has a transformative impact on the design and development of next‐generation thermoelectric generators for any thermoelectric material families.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Calibration of elastoplastic constitutive model parameters from full-field data with automatic differentiation-based sensitivities

Here, we present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.

42 ENGINEERING↗
DOE OSTI2024

Metabolomics of related C3 and C4 Flaveria species indicate differences in the operation of photorespiration under fluctuating light

C 3 photosynthesis can be complemented with a C 4 carbon concentrating mechanism (CCM) to minimize photorespiratory losses. C 4 photosynthesis is often more efficient than C 3 under steady-state conditions. However, the C 4 CCM depends on inter-cellular metabolite concentration gradients, which must increase following increases in light intensity and could decrease rates of C 4 photosynthesis under fluctuating light. Additionally, incomplete flux through photorespiration could prove beneficial to C 4 assimilation during light induction of the CCM. Here, we compare metabolic profiles in the closely related C 3 Flaveria robusta and C 4 Flaveria bidentis during a light transient from low to high light to determine if these non-steady state accumulation patterns provide insight to the induction of the metabolite gradients needed to drive C 4 intermediate transport and if there is incomplete cycling of photorespiratory intermediates. In these C 3 and C 4 species, metabolite steady-state pool sizes suggest that C 4 transport acids maintain concentration gradients across the bundle sheath and mesophyll cell types under these light fluctuations. However, there was incomplete flux through photorespiration in the C 4 F. bidentis, which could reduce photorespiratory CO 2 loss via glycine decarboxylation and help maintain higher rates of assimilation during following induction periods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Finding wombling boundaries in LHC data with Voronoi and Delaunay tessellations

We address the problem of finding a wombling boundary in point data generated by a general Poisson point process, a specific example of which is an LHC event sample distributed in the phase space of a final state signature, with the wombling boundary created by some new physics. We discuss the use of Voronoi and Delaunay tessellations of the point data for estimating the local gradients and investigate methods for sharpening the boundaries by reducing the statistical noise. The outcome from traditional wombling algorithms is a set of boundary cell candidates with relatively large gradients, whose spatial properties must then be scrutinized in order to construct the boundary and evaluate its significance. Here we propose an alternative approach where we simultaneously form and evaluate the significance of all possible boundaries in terms of the total gradient flux. We illustrate our method with several toy examples of both straight and curved boundaries with varying amounts of signal present in the data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Understanding Irrigation Impacts on Low-Level Jets over the Great Plains

Low-level jets (LLJs) over the Great Plains are well-known for their importance in transporting moisture from the Gulf of Mexico and forming precipitation in the Central US. However, the impact of irrigation practice on LLJs is rarely studied. To understand the irrigation impact on the Great Plains LLJs, the Weather Research and Forecasting (WRF) model is employed with and without an irrigation scheme. The simulated wind field is evaluated against the observed wind from Midlatitude Continental Convective Clouds Experiment (MC3E). The results show that adding irrigation improves the simulated wind, especially at lower altitudes below 800 hPa. Irrigation reduces the LLJ frequency over the Great Plains, mainly by reducing the intense LLJ frequency. The reduced LLJ frequency is caused by the irrigation-induced weakening of meridional wind. The favorable conditions for LLJs have been identified by examining the mechanism associated with LLJs: a ridge-like pattern with weak and calm synoptic-scale conditions in the mid-levels and a strong west-east temperature gradient at lower levels that promote meridional winds. Irrigation-induced cooling leads to a baroclinic pattern with high pressure at lower altitudes over the irrigation region and low pressure in the mid- and upper levels in the downstream region, resulting in a northerly component that hinders the formation of LLJs. Low-level surface cooling also decreases the west-east temperature gradient and hence weakens the thermal wind forcing. The irrigation-induced mid-level low and weaker west-east temperature gradient are responsible for the reduced meridional winds and the reduced LLJ frequencies.

Yang, Zhao↗
DOE OSTI2022

Improved Architectures and Training Algorithms for Deep Operator Networks

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of partial differential equations (PDEs) in an entirely self-supervised manner. In this work we analyze the training dynamics of deep operator networks (DeepONets) through the lens of Neural Tangent Kernel theory, and reveal a bias that favors the approximation of functions with larger magnitudes. To correct this bias we propose to adaptively re-weight the importance of each training example, and demonstrate how this procedure can effectively balance the magnitude of back-propagated gradients during training via gradient descent. We also propose a novel network architecture that is more resilient to vanishing gradient pathologies. Taken together, our developments provide new insights into the training of DeepONets and consistently improve their predictive accuracy by a factor of 10-50x, demonstrated in the challenging setting of learning PDE solution operators in the absence of paired input-output observations.

97 MATHEMATICS AND COMPUTING↗