Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gradient estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Quantifying the Role of Ocean Dynamics in SST Variability across GCMs and Observations

Abstract Midlatitude SSTs forced by mesoscale oceanic processes can affect the large-scale atmosphere, pointing to the ocean’s crucial role outside the tropics. Previous studies have shown oceanic mesoscale processes’ effect on global and regional climate variability. This study quantifies the local contribution of ocean dynamics to mixed-layer temperature across the globe by directly estimating the ocean heat flux divergence resolved by state-of-the-art ocean reanalysis, eddy-resolving, and eddy-parameterized versions of two U.S. national climate models and indirectly from air–sea flux satellite-based estimates. Our results show that the eddy-resolving climate simulations resolve mixed-layer temperature variances that are larger and closer to those inferred from observations than both their eddy-parameterized counterparts and ECCO over much of the extratropics. The observations and the eddy-resolving models indicate a more significant role of ocean dynamics in the mixed-layer temperature variability than the surface fluxes over most extratropics compared to their eddy-parameterized versions. A frequency domain analysis shows that the better-resolved ocean mesoscale and thermal gradients enhance the variance over a time scale from 2 months to 30 years. Results show agreement in the ocean’s contribution among satellite-based estimates, ocean reanalysis products, and ocean eddy-resolving simulations. At the same time, differences emerge for ECCO and the eddy-parameterized models, suggesting that surface fluxes account for a larger fraction of the mixed-layer temperature variability in most of the extratropics.

Siqueira, L.↗
DOE OSTI2025

Robustness of Deep Learning Classification to Adversarial Input on GPUs: Asynchronous Parallel Accumulation Is a Source of Vulnerability

The ability of machine learning (ML) classification models to resist small, targeted input perturbations—known as adversarial attacks—is a key measure of their safety and reliability. We show that floating-point non associativity (FPNA) coupled with asynchronous parallel programming on GPUs is sufficient to result in misclassification, without any perturbation to the input. Additionally, we show that this misclassification is particularly significant for inputs close to the decision boundary and that standard adversarial robustness results may be overestimated up to 4.6 when not considering machine-level details. We first study a linear classifier, before focusing on standard Graph Neural Network (GNN) architectures and datasets used in robustness assessments. We develop a novel black-box attack using Bayesian optimization to discover external workloads that can change the instruction scheduling which bias the output of reductions on GPUs and reliably lead to misclassification. Motivated by these results, we present a new learnable permutation (LP) gradient-based approach to learning floating-point operation orderings that lead to misclassifications. The LP approach provides a worst-case estimate in a computationally efficient manner, avoiding the need to run identical experiments tens of thousands of times over a potentially large set of possible GPU states or architectures. Finally, using instrumentation-based testing, we investigate parallel reduction ordering across different GPU architectures under external background workloads, when utilizing multi-GPU virtualization, and when applying power capping. Our results demonstrate that parallel reduction ordering varies significantly across architectures under the first two conditions, substantially increasing the search space required to fully test the effects of this parallel scheduler-based vulnerability. These results and the methods developed here can help to include machine-level considerations into adversarial robustness assessments, which can make a difference in safety and mission critical applications.

Shanmugavelu, Sanjif [Maxeler Technologies, a Groq↗
DOE OSTI2024

Concurrent Measurement of O 2 Production and Isoprene Emission During Photosynthesis: Pros, Cons and Metabolic Implications of Responses to Light, CO 2 and Temperature

Traditional leaf gas exchange experiments have focused on net CO 2 exchange (A net ). Here, using California poplar (Populus trichocarpa), we coupled measurements of net oxygen production (NOP), isoprene emissions and δ 18 O in O 2 to traditional CO 2 /H 2 O gas exchange with chlorophyll fluorescence, and measured light, CO 2 and temperature response curves. This allowed us to obtain a comprehensive picture of the photosynthetic redox budget including electron transport rate (ETR) and estimates of the mean assimilatory quotient (AQ = A net /NOP). We found that A net and NOP were linearly correlated across environmental gradients with similar observed AQ values during light (1.25 ± 0.05) and CO 2 responses (1.23 ± 0.07). In contrast, AQ was suppressed during leaf temperature responses in the light (0.87 ± 0.28), potentially due to the acceleration of alternative ETR sinks like lipid synthesis. A net and NOP had an optimum temperature (Topt) of 31°C, while ETR and δ 18 O in O2 (35°C) and isoprene emissions (39°C) had distinctly higher T opt . The results confirm a tight connection between water oxidation and ETR and support a view of light-dependent lipid synthesis primarily driven by photosynthetic ATP/NADPH not consumed by the Calvin–Benson cycle, as an important thermotolerance mechanism linked with high rates of (photo)respiration and CO 2 /O 2 recycling.

H218O labelling↗
DOE OSTI2024

Measure this, not that: Optimizing the cost and model-based information content of measurements

Model-based design of experiments (MBDoE) is a powerful framework for selecting and calibrating science-based mathematical models from data. Here, this work extends popular MBDoE workflows by proposing a convex mixed integer (non)linear programming (MINLP) to optimize the selection of measurements. The solver MindtPy is modified to support calculating the D-optimality objective and its gradient via an external package, scipy, using the grey-box module in Pyomo. The new approach is demonstrated in two case studies: estimating highly correlated kinetics from a batch reactor and estimating transport parameters in a large-scale rotary packed bed for CO 2 capture. Both case studies show how examining the Pareto optimal trade-offs between information content measured by A- and D-optimality versus measurement budget offers practical guidance for selecting measurements for scientific experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Mapping strain and structural heterogeneities around bubbles in amorphous ionically conductive Bi 2 O 3

While amorphous materials are often approximated to have a statistically homogeneous atomic structure, they frequently exhibit localized structural heterogeneity that challenges simplified models. This study uses 4D scanning transmission electron microscopy to investigate the strain and structural modifications around gas bubbles in amorphous Bi 2 O 3 induced by argon irradiation. We present a method for determining strain fields surrounding bubbles that can be used to measure the internal pressure of the gas. Compressive strain is observed around the cavities, with higher-order crystalline symmetries emerging near the cavity interfaces, suggesting paracrystalline ordering as a result of bubble coarsening. This ordering, along with a compressive strain gradient, indicates that gas bubbles induce significant localized changes in atomic packing. By analyzing strain fields with maximum compressive strains of 3%, we estimate a lower bound on the internal pressure of the bubbles at 2.5 GPa. These findings provide insight into the complex structural behavior of amorphous materials under stress, particularly in systems with gas inclusions, and offer new methods for probing the local atomic structure in disordered materials. Although considering structural heterogeneity in amorphous systems is non-trivial, these features have crucial impacts on material functionalities, such as mechanical strength, ionic conductivity, and electronic mobility.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Interpretation of high-harmonic fast-wave propagation in the scrape-off layer of NSTX-U as a geometrically bounded-waveguide mode

This paper revisits the onset of high-harmonic fast-wave (HHFW) propagation in the scrape-off layer (SOL) plasma of the NSTX/NSTX-U spherical tokamak, motivated by past HHFW heating and current drive experiments and modelling. Previously, the fast-wave propagation in the SOL was correlated with the opening (suppression) of the fast-wave right-hand cutoff layer in front of the antenna. In this work, the SOL propagation is interpreted as a geometric waveguide mode guided by the SOL geometry, whose radial width can be comparable to the wave’s perpendicular wavelength in the HHFW regime. A two-dimensional circular model is first employed using full-wave solvers to characterise the poloidal eigenmode structures and to clarify their relationship to annulus resonance. By progressively adding a tokamak-like magnetic-field configuration, starting from a uniform axial field, the effects of magnetic-field gradients and pitch on the SOL waveguide mode are characterised. The poloidal mode numbers supported by the SOL plasma agree well with analytic estimates, indicating that an anisotropic plasma in a bounded geometry selectively supports and amplifies the resonant poloidal mode number. Additionally, two-dimensional axisymmetric NSTX-U simulations demonstrate that the SOL eigenmode features identified in the circular model persist in the experimentally relevant configurations. A control approach based on lengthening the wave perpendicular wavelength relative to the SOL width, including a higher magnetic (B)-field operation, is discussed. The analysis here shows the key role of a bounded geometry in interpreting HHFW eigenmode coupling and propagation in the NSTX-U SOL plasma.

plasma heating↗
DOE OSTI2025

Influence of Soil Moisture on the Development of Organized Convective Systems in South America

Abstract This study investigates the role of soil moisture (SM) on the initiation and organization of convective systems using the convection‐permitting ICOsahedral Non‐hydrostatic (ICON) model. We conduct two sets of experiments: a Control experiment with interactive SM and a fixed SM experiment (FixedSM) with invariable SM conditions. We focus on two regions in South America: the Amazon and southeastern South America (SESA). Larger organized convective systems are associated with greater SM heterogeneity in both regions, though other large‐scale synoptic influences affect the robustness of this relationship in SESA. These results remain largely unaffected by disabling the effects of precipitation on SM in the FixedSM experiment, and complementary analyses using satellite‐based estimates of SM and precipitation support these findings. Spatial compositing of mesoscale environments in the Amazon shows the presence of well‐defined SM gradients, at a length scale of a few hundred kilometers, many hours before convective system detection. Larger SM gradients correspond to larger gradients in thermodynamic variables, particularly surface temperature and sensible heat flux, and are associated with larger convective systems. Overall, our findings suggest that surface heterogeneities such as SM gradients not only affect deep convection initiation, as previously suggested, but they can also encourage the growth and organization of convective systems into larger clusters, particularly in the absence of significant synoptic influences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Lattice B -field correlators for heavy quarks

We analyze the color-magnetic (or “ B ”) field two-point function that encodes the finite-mass correction to the heavy-quark momentum-diffusion coefficient. The simulations are done on fine isotropic lattices in the quenched approximation at 1.5 T c , using a range of gradient flow times for noise suppression and operator renormalization. The continuum extrapolation is performed at fixed flow time followed by a second extrapolation to zero flow time. Perturbative calculations to next-to-leading order of this correlation function, matching gradient-flowed correlators to MS ¯ , are used to resolve nontrivial renormalization issues. We perform a spectral reconstruction based on perturbative model fits to estimate the coefficient κ B of the finite-mass correction to the heavy-quark momentum-diffusion coefficient. The approach we present here yields high-precision data for the correlator with all renormalization issues incorporated at next-to-leading order and is also applicable for actions with dynamical fermions. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Ensemble methods for quantification of potassium oxide in ChemCam Mars and laboratory spectra

In this paper we test new approaches for predicting the amount of element oxides in rock samples from the ChemCam instrument suite onboard the NASA Curiosity rover by focusing on K 2 O. Using the expanded dataset compiled by Gasda et al. (2021) with and without the Earth to Mars (E2M and NoE2M) transformation discussed in Clegg et al. (2017) we trained blended submodels using the “double blending” technique and compared these to ensemble methods (Random Forest, ExtraTrees, and Gradient Boosting Regression). We found that ensemble methods performed similar to blended submodels when looking at RMSE-P on the laboratory spectra and provided significant advantages when looking at spectra coming from Mars. For the full model, blended submodels achieved an RMSE-P of 0.62 and 0.60 (E2M and NoE2M respectively) while Gradient Boosting Regression resulted in a slightly improved RMSE-P of 0.59 and 0.60. More importantly, by employing a local RMSE-P estimation technique where model performance is evaluated based on nearby test samples we found that using ensemble methods can lower the quantification limit for K 2 O from the current value of ≈0.6 wt% to ≈0.08 wt% using Extra Trees and Random Forest. This would allow for a much larger range of K 2 O values to be quantified on Mars with greater certainty given that most targets seen on Mars tend to have <1 wt% K2O. Finally, we used both Mean Decrease in Impurity (MDI) and permutation importance techniques to investigate the wavelengths used by the ensemble methods and found that they correspond to known potassium emission lines. This suggests that ensemble methods can provide an easier to train and improved alternative to blended submodels for predicting potassium compositions from Laser Induced Breakdown Spectroscopy (LIBS) data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Randomized Preconditioned Solvers for Strong Constraint 4D-Var Data Assimilation

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle using the Gauss-Newton method. The computation of the descent direction is expensive since it involves the solution of a large-scale and potentially ill-conditioned linear system, solved using the preconditioned conjugate gradient (PCG) method. Here, to address this cost, we efficiently construct scalable preconditioners using three different randomization techniques, which all rely on a certain low-rank structure involving the Gauss-Newton Hessian. The proposed techniques come with theoretical guarantees on the condition number, and at the same time, are amenable to parallelization. We also develop an adaptive approach to estimate the sketch size and choose between the reuse or recomputation of the preconditioner. We demonstrate the performance and effectiveness of our methodology on two representative model problems—the Burgers and barotropic vorticity equation—showing a drastic reduction in both the number of PCG iterations and the number of Gauss-Newton Hessian products after including the preconditioner construction cost.

Gauss-Newton↗
DOE OSTI2025

Machine learning for fundamental spectroscopic and thermodynamic data of actinides and lanthanides

Accurately modeling optical spectra with absolute radiometric intensities is vital for nuclear forensics applications that depend on characterizing optical emissions from energetic nuclear phenomena. This requires precise knowledge of the individual atomic transition probabilities, known as Einstein A-coefficients, for each emission line. Obtaining these values theoretically or experimentally is often impractical due to the complex electronic structures and the number of transitions involved in atoms relevant to nuclear applications. In this study, we explore the use of machine learning to predict the Einstein A coefficients for atomic transitions. Seven models were evaluated that ranged from deep learning to decision tree algorithms, and found that gradient boosting performed best, specifically the Extreme Gradient Boosting (XGB) architecture, achieving a precision of 86% across transitions of 36 elements. Furthermore, the model was cross-validated using published transition probabilities reported in the literature and applied to estimate Pu plasma temperatures from a previous experiment conducted at Savannah River National Laboratory.

Atomic spectroscopy↗
DOE OSTI2023

Thermal Disorder‐Induced Strain and Carrier Localization Activate Reverse Halide Segregation

The reversal of halide ions is studied under various conditions. However, the underlying mechanism of heat-induced reversal remains unclear. This work finds that dynamic disorder-induced localization of self-trapped polarons and thermal disorder-induced strain (TDIS) can be co-acting drivers of reverse segregation. Localization of polarons results in an order of magnitude decrease in excess carrier density (polaron population), causing a reduced impact of the light-induced strain (LIS – responsible for segregation) on the perovskite framework. Meanwhile, exposing the lattice to TDIS exceeding the LIS can eliminate the photoexcitation-induced strain gradient, as thermal fluctuations of the lattice can mask the LIS strain. Under continuous 0.1 W cm -2 illumination (upon segregation), the strain disorder is estimated to be 0.14%, while at 80 °C under dark conditions, the strain is 0.23%. However, in situ heating of the segregated film to 80 °C under continuous illumination (upon reversal) increases the total strain disorder to 0.25%, where TDIS is likely to have a dominant contribution. Therefore, the contribution of entropy to the system's free energy is likely to dominate, respectively. Various temperature-dependent in situ measurements and simulations further support the results. These findings highlight the importance of strain homogenization for designing stable perovskites under real-world operating conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Training quantum neural networks using the quantum information bottleneck method

Abstract We provide in this paper a concrete method for training a quantum neural network to maximize the relevant information about a property that is transmitted through the network. This is significant because it gives an operationally well founded quantity to optimize when training autoencoders for problems where the inputs and outputs are fully quantum. We provide a rigorous algorithm for computing the value of the quantum information bottleneck quantity within error ε that requires O ( log 2 ⁡ ( 1 / ϵ ) + 1 / δ 2 ) queries to a purification of the input density operator if its spectrum is supported on { 0 } ⋃ [ δ , 1 − δ ] for δ > 0 and the kernels of the relevant density matrices are disjoint. We further provide algorithms for estimating the derivatives of the QIB function, showing that quantum neural networks can be trained efficiently using the QIB quantity given that the number of gradient steps required is polynomial.

Çatlı, Ahmet Burak (ORCID:0000000152294141)↗
DOE OSTI2025

Renewable Energy Potential Model: Hawaii Geothermal Supply Curves

This dataset extends the development of the Renewable Energy Potential (reV) model to include geothermal energy, with a specific focus on Hawaii. Provided here are the results of two scenarios that were modeled for geothermal energy in Hawaii: binary enhanced geothermal systems (EGS) at a depth of 2.5 km and hydrothermal binary systems at a depth of 1.5 km. The resource data for both scenarios were derived from Lautze and Haskins (2024) using an exponential method. The PFA probability of heat map was used as a look up table for which temperature gradient to use (Lautze and Haskins, 2024). The dataset provides geospatial and techno-economic details for evaluating geothermal energy potential. It includes spatial coordinates, estimated capacity factors, developable area, resource potential, and annual energy production metrics. Economic details such as levelized cost of electricity (LCOE), site development costs, transmission costs, and fixed-charge rates are also included. The reV model, originally developed for wind and solar energy, incorporates these variables to evaluate deployment constraints related to land use, environmental and cultural factors, and grid integration.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Reconstructing the Stripping History of the Sagittarius Stream with Neural Networks

The Sagittarius (Sgr) Stream is produced by the ongoing disruption of the Sgr dwarf spheroidal (dSph) galaxy and is thought to contain multiple wraps that were stripped during different pericentric passages. In this study, we introduce a neural-network–based method trained on N-body simulations to infer the stripping time of Sgr Stream stars directly from their phase-space coordinates. We combine spectroscopic data from SEGUE, APOGEE DR17, and LAMOST DR7 low-resolution spectroscopic (LRS) survey with Gaia EDR3 astrometry and distance estimates from the latest StarHorse catalog to identify high-quality Sgr Stream members. Applying our method to these stars, we measure a clear metallicity gradient with stripping time, well described by a linear relation with slope ∼0.3 dex Gyr −1 . We further predict the stripping times of globular clusters previously suggested to originate from the Sgr dSph. M 54, Terzan 7, Terzan 8, and Arp 2 exhibit stripping times consistent with being currently bound to the Sgr remnant. Pal 12, Whiting 1, and NGC 2419 are inferred to have been stripped 0.9 ± 0.1, 1.1 ± 0.2, and 2.1 ± 0.2 Gyr ago, respectively. For NGC 4147 and NGC 5634, whose membership in the Sgr system remains uncertain, our analysis suggests stripping times of 1.1 ± 0.4 and 1.1 ± 0.1 Gyr, respectively, if they are ultimately confirmed as genuine Sgr members. These results demonstrate that data-driven models of dynamical stripping histories offer a promising approach for reconstructing the formation and chemical evolution of the Sgr Stream.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2025

Meta-Learning Enhanced Physics-Informed Graph Attention Convolutional Network for Distribution Power System State Estimation

Promptly perceiving distribution system states is challenged by frequent topology changes and uncertain power injections. To address these issues, a Meta-learning enhanced physics-informed graph attention convolutional network (Meta-PIGACN) model is proposed to handle topological variability in distribution system state estimation (DSSE). Specifically, physics information is integrated into the graph convolutional network, enabling a physics-informed edge-weighting process that incorporates physical information to control the aggregation of neighboring nodes. Besides, the graph attention mechanism automatically adjusts the importance of different neighboring nodes, allowing the capture and preservation of inherent system features across varying topologies, thereby improving state estimation accuracy. Furthermore, meta-learning is proposed to acquire empirical knowledge across multiple topologies so that the model can rapidly adapt to new configurations through iterative gradient descent updates even in large-scale systems. In conclusion, the simulation results based on the 33/118/1746-node distribution systems show the high accuracy and efficiency of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

The structure of the stellar halo of the Andromeda galaxy explored with the NB515 for Subaru/HSC – I. New insights on the stellar halo up to 120 kpc

ABSTRACT We analyse the M31 halo and its substructure within a projected radius of 120 kpc using a combination of Subaru/HSC NB515 and Canada France Hawaii Telescope/MegaCam g and i bands. We succeed in separating M31’s halo stars from foreground contamination with $\sim$90 per cent accuracy by using the surface gravity sensitive NB515 filter. Based on the selected M31 halo stars, we discover three new substructures, which associate with the Giant Southern Stream (GSS) based on their photometric metallicity estimates. We also produce the distance and photometric metallicity estimates for the known substructures. While these quantities for the GSS are reproduced in our study, we find that the north-western stream shows a steeper distance gradient than found in an earlier study, suggesting that it is likely to have formed in an orbit closer to the Milky Way. For two streams in the eastern halo (Stream C and D), we identify distance gradients that had not been resolved. Finally, we investigate the global halo photometric metallicity distribution and surface brightness profile using the NB515-selected halo stars. We find that the surface brightness of the metal-poor and metal-rich halo populations, and the all population can be fitted to a power-law profile with an index of $\alpha =-1.65\pm 0.02$, $-2.82\pm 0.01$, and $-2.44\pm 0.01$, respectively. In contrast to the relative smoothness of the halo profile, its photometric metallicity distribution appears to be spatially non-uniform with non-monotonic trends with radius, suggesting that the halo population had insufficient time to dynamically homogenize the accreted populations.

Ogami, Itsuki (ORCID:0000000182394549)↗