Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Magnetocaloric refrigerator

The invention is for an apparatus and method for a refrigerator and a heat pump based on the magnetocaloric effect (MCE) offering a simpler, lighter, robust, more compact, environmentally compatible, and energy efficient alternative to traditional vapor-compression devices. The subject magnetocaloric apparatus alternately exposes portions of an MCE material to strong and weak magnetic field while coordinating the heat flow between the exposed portions by heat bridges to move the heat up the thermal gradient. The invention may be practiced with multiple MCE material portions or segments to attain large differences in temperature. Key applications include thermal management of electronics, as well as industrial and home refrigeration, heating, and air conditioning. The invention offers a simpler, lighter, compact, and robust apparatus compared to magnetocaloric devices of prior art. Furthermore, the invention may be run in reverse as a thermodynamic engine, receiving low-level heat and producing mechanical energy.

Vetrovec, Jan↗
DOE OSTI2024

Challenges in Training PINNs: A Loss Landscape Perspective

This paper explores challenges in training Physics Informed Neural Networks (PINNs), emphasizing the role of the loss landscape in the training process. We examine difficulties in minimizing the PINN loss function, particularly due to ill conditioning caused by differential operators in the residual term. We compare gradient-based optimizers Adam, L-BFGS, and their combination Adam+L-FGS, showing the superiority of Adam+L-BFGS, and introduce a novel secondorder optimizer, NysNewton-CG (NNCG), which significantly improves PINN performance. Theoretically, our work elucidates the connection between ill-conditioned differential operators and ill-conditioning in the PINN loss and shows the benefits of combining first- and second-order optimization methods. Our work presents valuable insights and more powerful optimization strategies for training PINNs, which could improve the utility of PINNs for solving difficult partial differential equations.

Rathore, Pratik↗
DOE OSTI2026

ZEUS: An Efficient GPU Optimization Method Integrating PSO, BFGS, and Automatic Differentiation

We introduce a novel, efficient computational method, ZEUS, for numerical optimization, and provide an open-source implementation. It has four key ingredients: (1) particle swarm optimization (PSO), (2) the use of the Broyden-Fletcher-Goldfarb-Shanno (BFGS) method, (3) automatic differentiation (AD), and (4) GPUs. Our approach addresses the computational challenges inherent in high-dimensional, non-convex optimization problems. In the first phase of the algorithm, we get a potentially good set of starting points using PSO. Thereafter, we run BFGS independently in parallel from these starting points. BFGS is one of the best-performing algorithms for numerical optimization. However, it requires the gradient of the function being optimized. ZEUS integrates automatic differentiation into BFGS thus avoiding the need for the user to calculate derivatives explicitly. The use of GPUs allows ZEUS to speed up the calculations substantially. We carry out systematic studies to explore the trade-offs between the number of PSO iterations taken, starting points, and BFGS iteration depth. We show that a handful of iterations of PSO can improve global convergence when combined with BFGS. We also present performance studies using common test functions. The source code can be found at https://github.com/fnal-numerics/global-optimizer-gpu.

Soos, Dominik [Old Dominion U.]↗
DOE OSTI2021

Trace impurity transport in multi-species plasmas with large particle fluxes

A burning fusion plasma has a large inwards flux of fuel and outwards flux of ash. Existing impurity transport theories do not account for a steady-state environment of such large fluxes. In this paper, we extend classical transport theory to account for a background of such fluxes. In a mainly two-ion species magnetized plasma, with oppositely directed density gradients maintained by oppositely directed sources of the two species, trace impurity ions are shown to align with the larger mass ions. This unexpected behavior is derived analytically and simulated numerically using the MITNS (Multiple-Ion Transport Numerical Solver) code. Overall, the result suggests a potential advantage of edge-fueled p-B11 fusion in extracting high-Z impurities, and possible applications in plasma-based separation methods.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Autocalibration of the E3SM Version 2 Atmosphere Model Using a PCA-Based Surrogate for Spatial Fields

Global Climate Model tuning (calibration) is a tedious and time-consuming process, with high-dimensional input and output fields. Experts typically tune by iteratively running climate simulations with hand-picked values of tuning parameters. Many, in both the statistical and climate literature, have proposed alternative calibration methods, but most are impractical or difficult to implement. We present a practical, robust, and rigorous calibration approach on the atmosphere-only model of the Department of Energy's Energy Exascale Earth System Model (E3SM) version 2. Our approach can be summarized into two main parts: (a) the training of a surrogate that predicts E3SM output in a fraction of the time compared to running E3SM, and (b) gradient-based parameter optimization. To train the surrogate, we generate a set of designed ensemble runs that span our input parameter space and use polynomial chaos expansions on a reduced output space to fit the E3SM output. We use this surrogate in an optimization scheme to identify values of the input parameters for which our model best matches gridded spatial fields of climate observations. To validate our choice of parameters, we run E3SMv2 with the optimal parameter values and compare prediction results to expertly-tuned simulations across 45 different output fields. This flexible, robust, and automated approach is straightforward to implement, and we demonstrate that the resulting model output matches present day climate observations as well or better than the corresponding output from expert tuned parameter values, while considering high-dimensional output and operating in a fraction of the time.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

MrHyDE v.1.0

SAND2024-01324O MrHyDE, which stands for Multi-resolution Hybridized Differential Equations, is a general-purpose C++ package for the solution of coupled multiphysics and multiscale systems on massively parallel computing systems. MrHyDE is designed to enable moving beyond forward simulation for multiscale applications which includes optimization, control, uncertainty quantification, and stochastic inversion. The framework provides interfaces to several packages within the Trilinos framework and leverages automatic differentiation to enable adjoint capabilities for large-scale, gradient-based optimization. MrHyDE provides automated multiscale capabilities through a subgrid model interface and multiscale Dirichlet-to-Neumann maps. For extreme-scale applications, MrHyDE provides in situ data-compression algorithms to reduce memory requirements while maintaining performance. MrHyDE is a general-purpose, computational framework for the solution of multiscale and multiphysics applications. It uses a combination of structure-preserving, physics-compatible discretizations, fully implicit methods, multi-resolution schemes, or fully explicit methods. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗
DOE OSTI2023

Temperature uncertainty modelling with proxy structural data as geostatistical constraints for well siting: an example applied to Granite Springs Valley, NV, USA

Utilizing existing temperature and structural geology information around Granite Springs Valley, Nevada, we build 3D stochastic temperature models with the aims of evaluating the 3D uncertainty of temperature and choosing between candidate exploration well locations. The data used to support the modelling are measured temperatures and structural proxies from 3D geologic modelling (distance to fault, distance to fault intersections and terminations, Coulomb stress change and dilation tendency), the latter considered ‘secondary’ data. Two stochastic geostatistical techniques are explored for incorporating the structural proxies: cosimulation and local varying mean. With both the cosimulation and local varying mean methods, many equally-likely temperature models (i.e. realizations) are produced, from which temperature probability profiles are calculated at candidate well locations. To aid in choosing between the candidate locations, two quantities summarize the temperature probabilities: V prior and entropy. V prior quantifies the likelihood for economic temperatures at each candidate location, whereas entropy identifies where new information has the most potential to reduce uncertainty. In general, the cosimulation realizations have smoother spatial structure, and extrapolate high temperatures at candidate locations that are located along the direction of the longest spatial correlation, which are down dip from existing temperature logs. The smooth realizations result in tight temperature probability profiles that are easier to interpret, but they have unrealistic temperature reversals in some locations because of the dipping ellipsoid shape created and that the cosimulation technique does not enforce a conductive geothermal gradient as a baseline (i.e. linearly increasing temperature with depth). The local varying mean results produce realizations with more realistic geothermal gradients, with temperatures increasing downward since a depth-temperature relationship is included. However, because they have much noisier spatial nature compared to cosimulation, it is harder to interpret the temperature probability profiles. The different local varying mean results allow the geologist to determine which proxy (e.g. dilation v. distance to fault termination) should be used given the specific geothermal system. In general, V prior from local varying mean results identify locations that are close to high values for the structural proxies: areas with higher probabilities for higher temperatures. The entropy results identify where uncertainty is greatest and therefore new drilling information could be most useful. Though these techniques provide useful information, even when applied to areas of sparse data, our comparison of these two techniques demonstrates the need for new geothermal geostatistics techniques that combine the advantages of these two methods and that are tailored to the spatial uncertainty issues inherent in geothermal exploration.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Density Matrix Implementation of the Fermi–Löwdin Orbital Self-Interaction Correction Method

The Fermi–Löwdin orbital self-interaction correction (FLOSIC) method effectively provides a transformation from canonical orbitals to localized Fermi–Löwdin orbitals which are used to remove the self-interaction error in the Perdew–Zunger (PZ) framework. This transformation is solely determined by a set of points in space, called Fermi–Löwdin descriptors (FODs), and the occupied canonical orbitals or the density matrix. In this work, we provide a detailed workflow for the implementation of the FLOSIC method for removal of self-interaction error in DFT calculations in an orbital-by-orbital basis that takes advantage of the unitary invariant nature of the FLOSIC method. In this way, it is possible to cast the self-consistent energy minimization at fixed FODs in the same manner than standard Kohn–Sham with one additional term in the Kohn–Sham Hamiltonian that introduces the PZ self-interaction correction. Each energy minimization iteration is divided in two substeps, one for the density matrix and one for the FODs. Expressions for the effective Kohn–Sham matrix and FOD gradients are provided such that its implementation is suitable for most electronic structure codes. Here, we analyze the convergence characteristics of the algorithm and present applications for the evaluation of NMR shielding constants and real-time time-dependent DFT simulations based on the Liouville–von Neumann equation to calculate excitation energies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Conditional Generative Adversarial Networks for Solving Heat Transfer Problems

Generative Adversarial Networks (GANs) have been used as a deep learning approach to solving physics and engineering problems. Using deep learning for these problems is attractive in that reasonably accurate models can be inferred from only raw data, eliminating the need to define the exact physical equations governing a problem. We expand on previous work using GANs to generate steady-state solutions to the two-dimensional heat equation. Using a basic conditional GAN (cGAN), we generate accurate solutions for rectangular domains conditioned on four edge boundary conditions (MAE < 0.5%). For finding steady-state solutions over arbitrary two-dimensional domains (not constrained to rectangles), we use a cGAN designed for image-to-image translation. We train this GAN on various types of geometric domains (circles, squares, triangles, shapes with one circular or rectangular hole), achieving accurate results on test data made up of geometries similar to those in training (MAE < 1%). For both of these GANs, we experiment with different loss function terms, showing that a term using the gradients of solution images significantly improves the basic cGAN but not the image-to-image GAN. Lastly, we show that the image-to-image GAN performs poorly when applied to two-dimensional geometries that vary in structure from training data (MAE < 8% for shapes with multiple holes or different shaped holes). This demonstrates the cGAN's lack of generalizability. While the cGAN is an accurate and computationally efficient method when trained and tested on similarly structured data, it is a much less reliable method when applied to data that is slightly different in structure from the training data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Mortality correlates with tree functional traits across a wood density gradient in the Central Amazon

Introduction: Understanding the mechanisms of tree mortality in tropical ecosystems remains challenging, in part due to the high diversity of tree species and the inherently stochastic nature of mortality. Plant functional traits offer a mechanistic link between plant physiology and performance, yet their ability to predict growth and mortality remains poorly understood. Given recent increases in tree mortality rates in the Amazon forest following extreme drought and wind events, we tested if lower wood density and acquisitive plant functional traits were associated with increased growth and mortality for common co-occurring trees in the Central Amazon. Methods: Seventeen trees of different species with similar sizes but a range in wood density (WD) and wood traits were felled, then assessed for 27 different individual functional parameters, including whole tree architecture, stem xylem anatomical and hydraulic traits and leaf traits. Traits of the individual trees were related to stand-level growth and mortality rates collected periodically over 30 years from nearby permanent inventory plots. Results: Higher wood density was associated with smaller leaf size, lower foliar base cations, lower stem water content and sapwood fraction, in agreement with the fast-slow plant economics spectrum. Lower wood density was associated with more acquisitive characteristics with greater hydraulic capacity and foliar nutrient concentrations, correlating with greater growth and mortality rates. Discussion: Our results show that lower wood density is part of a coordinated suite of traits linked to high resource acquisition, fast growth, and increased mortality risk, providing a functional framework for predicting species performance and forest vulnerability under future climate stress.

demographics↗
DOE OSTI2026

Measuring pH Changes Inside a Bipolar Membrane Junction

Here, the local pH environment within bipolar membrane (BPM) junctions is complex and not well understood, yet it is important to control for advancing the performance of BPM-based electrochemical systems. We report a voltammetric strategy using an ultrathin Ni mesh pH probe to spatially resolve pH changes in the BPM junction during model BPM electrolyzer operation. Under reverse bias, we observe depletion of OH – at the anion-exchange layer (AEL) interface, with a degree diminishing with increasing distance from the AEL. These gradients correlate with current-dependent water dissociation (WD) and are modulated by the electric field and the surface charge state of the catalyst. By correlating spatial pH profiles with the surface-charging behavior of WD catalysts, we explore a mechanism of catalyst-mediated H + and OH – transfer facilitated by hydrogen-bonding networks. These findings highlight the role of local chemistry and electrostatics in BPM performance and offer new methods to probe and engineer catalytic junctions in electrochemical energy devices.

Hou, Shujin [University of California, Berkeley, C↗
DOE OSTI2020

Nonlinear δf particle in cell gyrokinetic simulations of the microtearing mode

Nonlinear simulations are carried out for the microtearing mode using particle-based δf gyrokinetic simulations for parameters relevant to spherical tokamaks. The present study finds that the microtearing mode can generate significant electron heat flux, which is predominantly carried out by the electromagnetic component of the heat flux with a negligible contribution from the electrostatic component. The mode sustains without the electrostatic component. We observe that the electron heat flux increases with the electron temperature gradient. The heat flux exhibits a very weak dependence on the collisions. It increases with electron β initially; however, at very high β, the electron heat flux is reduced.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Operation of normal-conducting rf cavities in multi-Tesla magnetic fields for muon ionization cooling: A feasibility demonstration

Ionization cooling is the preferred method for producing bright muon beams. This cooling technique requires the operation of normal conducting, radio-frequency (rf) accelerating cavities within the multi-tesla fields of dc solenoid magnets. Under these conditions, cavities exhibit increased susceptibility to rf breakdown, which can damage cooling channel components and imposes limits on channel length and transmission efficiency. We report, for the first time, stable high-vacuum, normal-conducting cavity operation at gradients of 50 MV / m in an external magnetic field of three tesla, through the use of beryllium cavity elements. This eliminates a significant technical risk that has previously been inherent in ionization cooling channel designs.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Vorticity-induced flow-focusing leads to bubble entrainment in an inkjet printhead: Synchrotron x-ray and volume-of-fluid visualizations

The oscillatory flows present in an inkjet printhead can lead to strong deformations of the air-liquid interface at the nozzle exit. Such deformations may lead to an inward directed air jet with bubble pinch-off and the subsequent entrainment of an air bubble, which is highly detrimental to the stability of inkjet printing. Understanding the mechanisms of bubble entrainment is therefore crucial to improving print stability. Here, in the present work, we use ultrafast x-ray phase-contrast imaging and direct numerical simulations based on the volume-of-fluid method to study the mechanisms underlying the bubble entrainment in a piezoacoustic printhead. We first demonstrate good agreement between experiments and numerics. We then show the different classes of bubble pinch-off obtained in experiments, and that those were also captured numerically. The numerical results are then used to show that the baroclinic torque, which is generated at the gas-liquid interface due to the misalignment of density and pressure gradients, results in a flow-focusing effect that drives the formation of the air jet from which a bubble can pinch off.

42 ENGINEERING↗
DOE OSTI2026

Reverse segregation and self-organization in inclined chute flows of bidisperse granular mixtures

In the usual segregation scenario for stable inclined chute flows of bidisperse mixtures of fine and coarse spherical particles, coarse particles rise toward the free surface, forming a coarse-rich region atop the flowing pile. Beyond a threshold coarse-to-fine diameter ratio of approximately 4, conversely, the weight of the coarse particles exceeds the segregation driving forces, causing individual coarse particles to sink within the pile and producing a reversed segregation state. However, an understanding of the collective evolution of the pile structure is still lacking when the particle diameter ratio exceeds 4 and the coarse-particle mass fraction is appreciable. To explore this broadly bidisperse limit, we perform discrete element method simulations considering mean particle diameter ratios of up to 8 and coarse-particle mass fractions spanning 0.1 to 0.9. The steady-state flow profiles reveal several intriguing behaviors that depend on the diameter ratio and mass fraction. These include a previously identified transition from usual to reverse segregation and a newfound tendency to self-organize into alternating coarse- and fine-rich particle layers stacked along the shear gradient direction, with layer thickness dictated by the coarse-particle diameter. A fuller understanding of segregation at this scale could pave the way for enhanced mixing or demixing techniques at the commercial scale.

granular flow↗
DOE OSTI2023

Efficient QAOA Optimization using Directed Restarts and Graph Lookup

Variational Quantum Algorithms (VQA) aim to enhance the capabilities of Noisy Intermediate-Scale Quantum (NISQ) devices. These algorithms utilize parameterized circuits and classical optimizers to iteratively execute circuits with varying parameters. However, VQA faces computational overheads due to repeated iterations and random restarts. Prior work suggests using basic sub-graphs to transfer parameters for the input graph, reducing optimizer overheads but limiting applicability to structured regular graphs. In real-world applications, random irregular graphs are common, and existing methods are not scalable or practical for such graphs. This paper presents a framework that aims to improve random irregular graphs in VQA. The framework uses graph similarity and important features like total edge counts, average edge counts, and variance. It follows an iterative process to choose basis sub-graphs from a small database and adjust parameters accordingly. Classical optimizers then utilize these parameters to determine when to restart and perform gradient descent. This approach increases the chances of reaching global maximum points.

Wang, Meng↗
DOE OSTI2021

Development and Implementation of Digital Image Correlation for Out-of-Cell Burst Testing

This report details the progress made towards utilizing in-situ methods to observe and quantify unirradiated Zircaloy-4 (Zr4) fuel cladding deformation during out-of-cell design basis accident conditions, specifically during loss-of-coolant accident (LOCA) burst testing in the Severe Accident Test Station at Oak Ridge National Laboratory. Digital image correlation (DIC) was implemented to calculate cladding strain during burst and infrared (IR) thermography was used to attempt a correlation of strain with temperature and to investigate thermal gradients. For both techniques, early experimentation revealed experimental modifications were necessary for implementation. For DIC, this manifested as shortened cladding lengths which could be centered in front of the viewing chamber bored through the IR furnace side, and for IR thermography this meant conducting burst tests in air without a reaction tube and the incorporation of a SiC shell to eliminate direct IR reflections from the tungsten lamps. In the following, the technical issues and subsequent origin of these modifications are discussed, laying the framework for a proof-of-concept DIC/IR characterization of a burst test in the final section.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Lion Cub: Minimizing Communication Overhead in Distributed Lion

Communication overhead is a key challenge in distributed deep learning, especially on slower Ethernet intercon nects, and given current hardware trends, communication is likely to become a major bottleneck. While gradient compression techniques have been explored for SGD and Adam, the Lion optimizer has the distinct advantage that its update vectors are the output of a sign operation, enabling straightforward quantization. However, simply compressing updates for communication and using techniques like majority voting fails to lead to end-to-end speedups due to inefficient communication algorithms and reduced convergence. We analyze three factors critical to distributed learning with Lion: optimizing communication methods, identifying effective quantization methods, and assessing the necessity of momentum synchronization. Our findings show that quantization techniques adapted to Lion and selective momentum synchronization can significantly reduce communication costs while maintaining convergence. We combine these into Lion Cub, which enables up to 5x speedups in end-to-end training compared to Lion. This highlights Lion’s potential as a communication-efficient solution for distributed training.

97 MATHEMATICS AND COMPUTING↗