Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variance reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Improved multifidelity Monte Carlo estimators based on normalizing flows and dimensionality reduction techniques

Here, we study the problem of multifidelity uncertainty propagation for computationally expensive models. In particular, we consider the general setting where the high-fidelity and low-fidelity models have a dissimilar parameterization both in terms of number of random inputs and their probability distributions, which can be either known in closed form or provided through samples. We derive novel multifidelity Monte Carlo estimators which rely on a shared subspace between the high-fidelity and low-fidelity models where the parameters follow the same probability distribution, i.e., a standard Gaussian. We build the shared space employing normalizing flows to map different probability distributions into a common one, together with linear and nonlinear dimensionality reduction techniques, active subspaces and autoencoders, respectively, which capture the subspaces where the models vary the most. We then compose the existing low-fidelity model with these transformations and construct modified models with an increased correlation with the high-fidelity model, which therefore yield multifidelity estimators with reduced variance. A series of numerical experiments illustrate the properties and advantages of our approaches.

97 MATHEMATICS AND COMPUTING↗

Parametric model-order-reduction development for unsteady convection

A time-averaged error indicator with POD- h Greedy is developed to drive parametric model order reduction (pMOR) for 2D unsteady natural convection in a high-aspect ratio slot parameterized with the Prandtl number, Rayleigh number, and slot angle with respect to the gravity. The error indicator is extended to accommodate the energy equation and Leray regularization. Despite being two-dimensional and laminar, the target flow regime presents several challenges: 1) there is a bifurcation in the angle parameter space; 2) the solution can be multivalued, even at steady state; and 3) the solution exhibits spatio-temporal chaos at several points in the parameter space. The authors explore several reduced-order models (ROMs) and demonstrate that Leray-regularized Galerkin ROMs provide a robust solution approach for this class of flows. They further demonstrate that error-indicated pMOR can efficiently predict several QOIs, such as mean flow, mean Nusselt number and mean turbulent kinetic energy, even in the presence of a bifurcation. Finally, they show that spatio-temporal chaos can lead to lack of reproducibility in both the full-order model and the reduced-order model and that the variance in the full-order model provides a lower bound on the pMOR error in these cases.

leray regularization↗

Reducing Ground-based Astrometric Errors with Gaia and Gaussian Processes

Stochastic field distortions caused by atmospheric turbulence are a fundamental limitation to the astrometric accuracy of ground-based imaging. This distortion field is measurable at the locations of stars with accurate positions provided by the Gaia DR2 catalog; we develop the use of Gaussian process regression (GPR) to interpolate the distortion field to arbitrary locations in each exposure. We introduce an extension to standard GPR techniques that exploits the knowledge that the 2D distortion field is curl-free. Applied to several hundred 90 s exposures from the Dark Energy Survey as a test bed, we find that the GPR correction reduces the variance of the turbulent astrometric distortions ≈12× , on average, with better performance in denser regions of the Gaia catalog. The rms per-coordinate distortion in the riz bands is typically ≈7 mas before any correction and ≈2 mas after application of the GPR model. The GPR astrometric corrections are validated by the observation that their use reduces, from 10 to 5 mas rms, the residuals to an orbit fit to riz-band observations over 5 yr of the r = 18.5 trans-Neptunian object Eris. We also propose a GPR method, not yet implemented, for simultaneously estimating the turbulence fields and the 5D stellar solutions in a stack of overlapping exposures, which should yield further turbulence reductions in future deep surveys.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗

Bayesian calibration of irradiated graphite property models under high temperatures

Graphite under high temperatures and irradiation is central to advanced reactors. We develop a Bayesian calibration framework for graphite property models that explicitly represents model-data mismatch via a Gaussian-process discrepancy. The approach propagates uncertainty from parameters, experimental noise, and model form, with a hierarchical variance structure to capture group and cross-group noise. Using two predictive models across five grades (IG-110, NBG-18, PCEA, NBG-17, 2114) and four properties-irradiation-induced dimension change, creep, Young’s modulus change ratio, and coefficient of thermal expansion change ratio-we obtain average predictive-error reductions of 54%, 65%, 17%, and 17% when discrepancy is included. We illustrate engineering impact with a multiphysics model of a very-high-temperature reactor prismatic reflector brick, analyzing stresses under high fluence and temperature. Accounting for model discrepancy markedly improves predictive accuracy and provides a robust basis for reliable graphite component design in advanced reactors.

36 - MATERIALS SCIENCE↗

The Sixth Data Release of the Radial Velocity Experiment (RAVE). I. Survey Description, Spectra, and Radial Velocities

The Radial Velocity Experiment (Rave) is a magnitude-limited (9 < I < 12) spectroscopic survey of Galactic stars randomly selected in Earth’s southern hemisphere. The Rave medium-resolution spectra (R ~ 7500) cover the Ca-triplet region (8410–8795 Å). The sixth and final data release (DR6) is based on 518,387 observations of 451,783 unique stars. Rave observations were taken between 2003 April 12 and 2013 April 4. Here we present the genesis, setup, and data reduction of Rave as well as wavelength-calibrated and flux-normalized spectra and error spectra for all observations in Rave DR6. Furthermore, we present derived spectral classification and radial velocities for the Rave targets, complemented by cross-matches with Gaia DR2 and other relevant catalogs. A comparison between internal error estimates, variances derived from stars with more than one observing epoch, and a comparison with radial velocities of Gaia DR2 reveals consistently that 68% of the objects have a velocity accuracy better than 1.4 km s{sup –1}, while 95% of the objects have radial velocities better than 4.0 km s{sup –1}. Stellar atmospheric parameters, abundances and distances are presented in a subsequent publication. The data can be accessed via the Rave website (http://rave-survey.org) or the Vizier database.

79 ASTRONOMY AND ASTROPHYSICS↗

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas↗

Solving the structure of “single-atom” catalysts using machine learning – assisted XANES analysis

We show that "single-atom” catalysts (SACs) have demonstrated excellent activity and selectivity in challenging chemical transformations such as photocatalytic CO 2 reduction. For heterogeneous photocatalytic SAC systems, it is essential to obtain sufficient information of their structure at the atomic level in order to understand reaction mechanisms. In this work, a SAC was prepared by grafting a molecular cobalt catalyst on a light-absorbing carbon nitride surface. Due to the sensitivity of the X-ray absorption near edge structure (XANES) spectra to subtle variances in the Co SAC structure in reaction conditions, different machine learning (ML) methods, including principal component analysis, K-means clustering, and neural network (NN), were utilized for in situ Co XANES data analysis. As a result, we obtained quantitative structural information of the SAC nearest atomic environment thereby extending the NN-XANES approach previously demonstrated for nanoparticles and size-selective clusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Characterization of zirconium carbide microspheres synthesized via internal gelation

Microspheres of zirconium carbide with grain size 40-320 nm were synthesized using internal gelation techniques and characterized by scanning electron microscopy, synchrotron X-ray diffraction, and neutron total scattering. Compared with a polycrystalline benchmark ZrC sample prepared by plasma vapor phase deposition, the microspheres display lower variance in grain size and considerably lower microstrain representative of a more homogenous internal microstructure. However, excess carbon was present in the microspheres, evident in both the X-ray and neutron diffraction data as well as a corresponding hypostoichiometric ZrC phase. Furthermore, the excess carbon phase is assumed to be pockets of carbon that remained unreacted through the combined internal gelation and subsequent carbothermic reduction synthesis process. Atomic-scale structural characterization with neutron PDF analysis confirmed the presence of localized nano-sized domains of graphite-like carbon material.

36 MATERIALS SCIENCE↗

Understanding Diverse Model Projections of Future Extreme El Niño

The majority of future projections in the Coupled Model Intercomparison Project (CMIP5) show more frequent exceedances of the 5 mm day -1 rainfall threshold in the eastern equatorial Pacific rainfall during El Niño, previously described in the literature as an increase in “extreme El Niño events”; however, these exceedance frequencies vary widely across models, and in some projections actually decrease. Here we combine single-model large ensemble simulations with phase 5 of the Coupled Model Intercomparison Project (CMIP5) to diagnose the mechanisms for these differences. The sensitivity of precipitation to local SST anomalies increases consistently across CMIP-class models, tending to amplify extreme El Niño occurrence; however, changes to the magnitude of ENSO-related SST variability can drastically influence the results, indicating that understanding changes to SST variability remains imperative. Future El Niño rainfall intensifies most in models with 1) larger historical cold SST biases in the central equatorial Pacific, which inhibit future increases in local convective cloud shading, enabling more local warming; and 2) smaller historical warm SST biases in the far eastern equatorial Pacific, which enhance future reductions in stratus cloud, enabling more local warming. Additionally, these competing mechanisms complicate efforts to determine whether CMIP5 models under- or overestimate the future impacts of climate change on El Niño rainfall and its global impacts. However, the relation between future projections and historical biases suggests the possibility of using observable metrics as “emergent constraints” on future extreme El Niño, and a proof of concept using SSTA variance, precipitation sensitivity to SST, and regional SST trends is presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mapping the Binary Covalent Alloy Space to Pursue Superior Nitrogen Reduction Reaction Catalysts

The electrochemical nitrogen reduction reaction (NRR) has the potential to decarbonize industrial ammonia production. However, NRR has poor activity and selectivity versus the competing hydrogen evolution reaction for catalysts that adhere to scaling relations. Overcoming the limitations imposed by scaling relations requires more complex catalyst materials, however, evaluating materials beyond simple metal systems is a large combinatorial problem that requires an improved understanding of the electrocatalyst surface to rationally guide the discovery of superior catalysts. The study uses grand canonical density functional theory to uncover NRR trends on a large and disparate set of binary covalent alloys (BCA) with variable compositions and active-site geometries. The studied BCAs generally follow scaling relations, albeit with larger variance and several systems that significantly break scaling. BCAs with early- to mid-transition metals tend to lie near the volcano peak and activate the N 2 triple bond via a side-on binding configuration. Trends in the BCA space cannot be readily predicted using simple electronic descriptors, which is ascribed to the large geometric variability of the BCA surfaces. Furthermore, it is anticipated that these findings will provide a foundation for the rational design of superior NRR electrocatalysts with increasing material complexity.

36 MATERIALS SCIENCE↗

Stability-Constrained Learning for Frequency Regulation in Power Grids With Variable Inertia

The increasing penetration of converter-based renewable generation has resulted in faster frequency dynamics, and low and variable inertia. As a result, there is a need for frequency control methods that are able to stabilize a disturbance in the power system at timescales comparable to the fast converter dynamics. This paper proposes a combined linear and neural network controller for inverter-based primary frequency control that is stable at time-varying levels of inertia. We model the time-variance in inertia via a switched affine hybrid system model. We derive stability certificates for the proposed controller via a quadratic candidate Lyapunov function. We test the proposed control on a 12-bus 3-area test network, and compare its performance with a base case linear controller, optimized linear controller, and finite-horizon Linear Quadratic Regulator (LQR). Our proposed controller achieves faster mean settling time and over 50% reduction in average control cost across 100 inertia scenarios compared to the optimized linear controller. Unlike LQR which requires complete knowledge of the inertia trajectories and system dynamics over the entire control time horizon, our proposed controller is real-time tractable, and achieves comparable performance to LQR.

data-driven control↗

Challenges in practical button cell testing for hydrogen production from high temperature electrolysis of water

High temperature electrolysis of water using solid oxide electrochemical cells (SOEC) is a promising technology for hydrogen production with high energy efficiency and may promote decarbonization when coupled with renewable energy sources and excess heat from nuclear reactors. Over the past several decades there have been extensive scientific and engineering studies on cell materials and degradation behaviors that have greatly improved current density, decreased total resistance, and lowered degradation rates. Although the technology is now at a near-commercial level, maintaining consistency in cell testing and minimizing variance in practical testing environments is an often overlooked but crucial topic. To promote high quality data collection, testing procedures and balance of plant component details are extremely important to consider. This work discusses some key factors affecting the reproducibility of practical SOEC testing on the button cell level, namely, current collection layers, cell sealing procedures, the reliability of steam and hydrogen delivery systems, cell testing fixture design, and reduction procedures. To provide a baseline and a level of standardization for the SOEC community, this work also discloses details of the standard operating procedure and techniques adopted for o-SOEC testing at Idaho National Laboratory (INL).

08 HYDROGEN↗

BEACON—automated aberration correction for scanning transmission electron microscopy using Bayesian optimization

Aberration correction is an important aspect of modern high-resolution scanning transmission electron microscopy. Most methods of aligning aberration correctors require specialized sample regions and are unsuitable for fine-tuning aberrations without interrupting on-going experiments. Here, we present an automated method of correcting first- and second-order aberrations called BEACON, which uses Bayesian optimization of the normalized image variance to efficiently determine the optimal corrector settings. We demonstrate its use on gold nanoparticles and a hafnium dioxide thin film showing its versatility in nano- and atomic-scale experiments. BEACON can correct all first- and second-order aberrations simultaneously to achieve an initial alignment and first- and second-order aberrations independently for fine alignment. Ptychographic reconstructions are used to demonstrate an improvement in probe shape and a reduction in the target aberration.

techniques and instrumentation↗

Monitoring the propagation of mechanical discontinuity using data-driven causal discovery and supervised learning

Mechanical wave transmission through a material is influenced by the mechanical discontinuity in the material. The propagation of embedded discontinuities can be monitored by analyzing the wave-transmission measurements recorded by a multipoint sensor system placed on the surface of the material. The proposed workflow monitors the propagation of mechanical discontinuity through three stages, namely initial, intermediate, and final stages, by using supervised learning followed by data-driven causal discovery. To the end, the workflow processes the multipoint waveform measurements resulting from a single impulse source, while considering the effects of wave attenuation, dispersion and multiple wave-propagation modes due to the discontinuity and material boundaries. Among various feature reduction techniques ranging from decomposition methods to manifold approximation methods, the features derived based on statistical parameterizations of the measured waveforms lead to reliable monitoring that is robust to changes in precision, resolution, and signal-to-noise ratio of the multipoint sensor measurements. The numbers of zero-crossing, negative-turning, and positive turning in the waveforms are the strongest causal signatures of the propagation of mechanical discontinuity. Higher order moments of the waveforms, such as variance, skewness and kurtosis, are also strong causal signatures of the propagation. Finally, the newly discovered causal signatures confirm that the statistical correlations and conventional feature rankings are not always statistically significant indicators of causality.

42 ENGINEERING↗

Roles of mineral matter in biomass processing to biofuels

Abstract Minerals in biomass have a significant impact on both biofuel quality and yield. This is especially true for current thermochemical biomass conversion processes. However, the roles of plant minerals in biochemical conversion have not been studied extensively, even though they are generally considered to lower the sugar yield because they reduce the feedstock proportion of carbohydrates. A successful strategic solution is thus necessary to overcome the challenges caused by the minerals in biomass, which include (1) decreased quality of biomass feedstocks; (2) reduction of process efficiency; and (3) reduction of the product quality and quantity from biomass conversion. This review summarizes the roles of plant minerals in a biorefinery, focusing on these key challenges. The discussion covers many issues related to plant minerals in biofuel production, including their sources, functions, and distribution in plant biomass, methods of characterizing them, their influence in a biorefinery, and the strategic handling required to manage their occurrence in biomass, based on reported studies. It could inspire better strategies to deal with the variance of mineral content in biomass feedstocks to increase process efficiency and reduce costs while supporting the concept of a circular bioeconomy. © 2023 The Authors. Biofuels, Bioproducts and Biorefining published by Society of Industrial Chemistry and John Wiley & Sons Ltd.

09 BIOMASS FUELS↗

Visual Instance-aware Prompt Tuning

Visual Prompt Tuning (VPT) has emerged as a parameter-efficient fine-tuning paradigm for vision transformers, with conventional approaches utilizing dataset-level prompts that remain the same across all input instances. We observe that this strategy results in sub-optimal performance due to high variance in downstream datasets. To address this challenge, we propose Visual Instance-aware Prompt Tuning (ViaPT), which generates instance-aware prompts based on each individual input and fuses them with dataset-level prompts, leveraging Principal Component Analysis (PCA) to retain important prompting information. Moreover, we reveal that VPT-Deep and VPT-Shallow represent two corner cases based on a conceptual understanding, in which they fail to effectively capture instance-specific information, while random dimension reduction on prompts only yields performance between the two extremes. Instead, ViaPT overcomes these limitations by balancing dataset-level and instance-level knowledge, while reducing the amount of learnable parameters compared to VPT-Deep. Extensive experiments across 34 diverse datasets demonstrate that our method consistently outperforms state-of-the-art baselines, establishing a new paradigm for analyzing and optimizing visual prompts for vision transformers.

Xiao, Xi [ORNL] (ORCID:0009000009316982)↗

Detailed modeling of the video signal and optimal readout of charge-coupled devices

This paper provides a practical design methodology to calculate an optimal filter for noise reduction in the readout of charge-coupled devices (CCDs) taking into account the charge transfer and feedthroughs due to capacitive coupling in the CCD. A detailed analysis of the dynamics of the video signal and charge transfer is presented, including the circuital modeling of the output stage of the CCD and the dynamics of the electronics in the video chain before the analog-to-digital (AD) converter. This model is used to compute an optimal filter that minimizes the variance of the pixel noise and uses the samples of the charge transfer, before the charge is fully settled. This is necessary to enhance the performance of previous results that also use optimal filters but do not use the transition samples, while also reducing the pixel readout time, resulting in faster readouts. As a proof of concept for the optimal filter, we present in this paper novel experimental results using a Skipper CCD, which has a floating sense node that allows to measure the charge packet an arbitrary number of times. However, this technique can be applied to any CCD that has a readout system that digitally samples the video signal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗