Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Binning is Sinning: Redemption for Hubble Diagram Using Photometrically Classified Type Ia Supernovae

Bayesian Estimation Applied to Multiple Species (BEAMS) is implemented in the BEAMS with Bias Corrections (BBC) framework to produce a redshift-binned Hubble diagram (HD) for Type Ia supernovae (SNe Ia). BBC corrects for selection effects and non–SN Ia contamination, and systematic uncertainties are described by a covariance matrix with dimension matching the number of BBC redshift bins. For spectroscopically confirmed SN Ia samples, a recent "Binning is Sinning" article showed that an unbinned HD and covariance matrix reduces the systematic uncertainty by a factor of ~1.5 compared to the binned approach. Here we extend their analysis to obtain an unbinned HD for a photometrically identified sample processed with BBC. To test this new method, we simulate and analyze 50 samples corresponding to the Dark Energy Survey (DES) with a low-redshift anchor; the simulation includes SNe Ia, and contaminants from core-collapse SNe and peculiar SNe Ia. The analysis includes systematic uncertainties for calibration and measures the dark energy equation of state parameter (w). Compared to a redshift-binned HD, the unbinned HD with nearly 2000 events results in a smaller systematic uncertainty, in qualitative agreement with BHS21, and averaging results among the 50 samples we find no evidence for a w-bias. To reduce computation time for fitting an unbinned HD with large samples, we propose an HD-rebinning method that defines the HD in bins of redshift, color, and stretch; the rebinned HD results in similar uncertainty as the unbinned case, and shows no evidence for a w-bias.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

ROSE: A reduced-order scattering emulator for optical models

A new generation of phenomenological optical potentials requires robust calibration and uncertainty quantification, motivating the use of Bayesian statistical methods. These Bayesian methods usually require calculating observables for thousands or even millions of parameter sets, making fast and accurate emulators highly desirable or even essential. Emulating scattering across different energies or with interactions such as optical potentials is challenging because of the nonaffine parameter dependence, meaning the parameters do not all factorize from individual operators. Here we introduce and demonstrate the reduced-order scattering emulator ( ROSE ) framework, a reduced basis emulator that can handle nonaffine problems. ROSE is fully extensible and works within the publicly available band framework software suite for calibration, model mixing, and experimental design. As a demonstration problem, we use ROSE to calibrate a realistic nucleon-target scattering model through the calculation of elastic cross sections. This problem shows the practical value of the ROSE framework for Bayesian uncertainty quantification with controlled trade-offs between emulator speed and accuracy as compared to high-fidelity solvers. Finally, planned extensions of ROSE are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A rigorous physics-based enhanced parameter estimation (EPE) methodology for calibration of building energy simulations

Buildings rarely perform as designed/simulated and there are numerous tangible benefits if this gap is reconciled. A new scientifically rigorous yet pragmatic methodology for calibrating building energy simulations - called Enhanced Parameter Estimation (EPE) - is proposed that allows physically relevant parameter estimation rather than a blind force-fit to energy use data. Starting with a rapidly created simulation model, calibration is performed in two stages: (a) building shell calibration with the HVAC system replaced by an ideal system that meets the loads (b) HVAC system calibration with the building shell and all internal loads replaced by a box with only process loads. In the first stage, EPE identifies a small number of high-level heat flows in the energy balance, calculates them with specifically tailored individual driving functions, introduces physically significant parameters to best accomplish energy balance, and, estimates the parameters and their uncertainty bounds. Calibration is thus done with corrective heat flows without any arbitrary tuning of input parameters. Calibration accuracy is enhanced by machine learning of the residual errors. The EPE methodology is demonstrated by means of: a synthetic building and an actual 75,000 sq. ft. building in Pennsylvania. Future work needed for widespread application is discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Water vapor isotopic composition during TRACER IOP

The TRACER-Iso project took place from June 1 to September 30, 2022 as part of the intensive observation period (IOP) of the Tracking Aerosol Convection Interactions (TRACER) project at the main project site at the La Porte, Texas, municipal airport. The project sought to use measurements of the stable isotopic composition of water vapor to better understand cloud-aerosol interactions in deep convection in a polluted urban setting. Water vapor isotopologue and humidity measurements were determined using a Picarro L2130 Water Vapor Isotope Analyzer. The instrument was deployed in the guest van and consists of three main components: a water vapor isotope analyzer, and a Los Gatos Research Water Vapor Isotope Standard Source (WVISS), and a Los Gatos Research Dry Air Source. Ambient air samples were collected through an inlet located about one meter above roof of the shipping container. Samples were then delivered to the analyzer through teflon tubing by use of an external pump to minimize the transport time between the inlet and analyzer. The inlet tubing was surrounded by a Briskheat heat trace and insulating material to ensure ambient air samples did not fall below the dew point and result in condensation. The analyzer uses cavity ringdown spectroscopy to report isotopic ratios of ambient air samples at a frequency of 1 Hz. The calibration unit of the instrument was used in conjunction with the dry air source to periodically measure the δ values of standard waters. It uses a nebulizer to push small water droplets into a hot chamber that vaporizes the water without fractionation. This vapor was then transported to the analyzer using a built-in compressor and the dry air source, which allows each standard with known δ values to be measured at a wide range of humidity values for post-measurement calibration of ambient air samples. There are multiple sources of uncertainty introduced at different stages during the data collection and processing. These include (1) instrument precision, (2) uncertainty in the secondary standards, (3) humidity-correction uncertainty, and (4) VSMOW-SLAP calibration uncertainty. Uncertainty from each step is propagated in quadrature to calculate a total uncertainty of each isotopologue. Uncertainty was determined to be 2.3‰ for δD and 0.4‰ for δ18O.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

MULTI-FIDELITY MODELING AND UNCERTAINTY QUANTIFICATION OF INVERTER BASED RESOURCES IN INTEGRATED T&D SYSTEMS

Uncertainty quantification plays a pivotal role in improving the accuracy and reliability of inverter operation within modern power systems that are increasingly dominated by inverter-based resources (IBRs). IBRs, especially those operating under grid forming (GFM) control, rely heavily on a complex set of control parameters and system measurements to maintain voltage, frequency, and power balance. Traditional deterministic modeling approaches often fail to capture these parameter deviations, potentially resulting in suboptimal control actions, reduced system stability, or even instability under high penetration of IBRs. In this paper, we demonstrate the application of model calibration and uncertainty quantification (UQ) principles to an integrated transmission and distribution (T&D) model involving a GFM converter and provide a framework for prioritizing control improvements, guiding robust design, and informing adaptive strategies that can accommodate real-time variability in system conditions. The proposed approach could be valuable in enhancing the robustness of current and future power systems under increased IBR penetrations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Neural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Finding Real Uncertainties From Physical Simulations

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Surrogate models for linear response

Linear response theory is a well-established method in physics and chemistry for exploring excitations of many-body systems. In particular, the quasiparticle random-phase approximation (QRPA) provides a powerful microscopic framework by building excitations on top of the mean-field vacuum; however, its high computational cost limits model calibration and uncertainty quantification studies. Here, we present two complementary QRPA surrogate models and apply them to study response functions of finite nuclei. One is a reduced-order model that exploits the underlying QRPA structure, while the other utilizes the recently developed parametric matrix model algorithm to construct a map between the system’s Hamiltonian and observables. Our benchmark applications, the calculation of the electric dipole polarizability of 180 Yb and the 𝛽-decay half-life of 80 Ni, show that both emulators can achieve 0.1%–1% accuracy while offering a 6–7 orders of magnitude speedup compared to state-of-the-art QRPA solvers. These results demonstrate that the developed QRPA emulators are well positioned to enable Bayesian calibration and large-scale studies of computationally expensive physics models describing the properties of many-body systems.

Beta decay↗
DOE OSTI2025

Characterization of uncertainties in electron-argon collision cross sections

Abstract The predictive capability of a plasma discharge model depends on accurate representations of electron-impact collision cross sections, which determine the corresponding reaction rates and electron transport properties. The values of cross sections can be known only approximately either through experiments or simulations and are thus subject to uncertainties. Quantifying the uncertainties in plasma simulations allows us to assess the reliability of simulations and to provide a basis for interpreting discrepancies between simulations and experiments. For such uncertainty quantification of plasma simulations, it is essential to quantify the uncertainties of the underlying cross sections. Although much effort has been committed to calibrate the cross section values, their uncertainties are not well investigated. We characterize uncertainties in electron-argon atom collision cross sections using a Bayesian framework. Six collision processes—elastic momentum transfer, ionization, and four excitations—are characterized with semi-empirical models, which effectively capture the features important to the macroscopic properties of the plasma. A probability model for the uncertain parameters of these semi-empirical models is developed. Specifically, a Gaussian-process likelihood model is proposed to capture discrepancies among data sets, as well as the model-form inadequacies of the semi-empirical models. Two other likelihood models are compared with the proposed Gaussian-process model, to illustrate the importance of the choice of the likelihood model. The cross section models are calibrated using the electron-beam experiments and ab-inito quantum simulations. The resulting calibrated uncertainties capture well the scattering among the data sets. The calibrated cross section models are further validated against swarm-parameter experiments and zero-dimensional Boltzmann equation simulations of widely used cross section datasets.

Chung, Seung Whan (ORCID:0000000302501549)↗
DOE OSTI2024

Computationally efficient and error aware surrogate construction for numerical solutions of subsurface flow through porous media

Limiting the injection rate to restrict the pressure below a threshold at a critical location can be an important goal of simulations that model the subsurface pressure between injection and extraction wells. The pressure is approximated by the solution of Darcy’s partial differential equation for a given permeability field. The subsurface permeability is modeled as a random field since it is known only up to statistical properties. This induces uncertainty in the computed pressure. Solving the partial differential equation for an ensemble of random permeability simulations enables estimating a probability distribution for the pressure at the critical location. These simulations are computationally expensive, and practitioners often need rapid online guidance for real-time pressure management. An ensemble of numerical partial differential equation solutions is used to construct a Gaussian process regression model that can quickly predict the pressure at the critical location as a function of the extraction rate and permeability realization. The Gaussian process surrogate analyzes the ensemble of numerical pressure solutions at the critical location as noisy observations of the true pressure solution, enabling robust inference using the conditional Gaussian process distribution. Our first novel contribution is to identify a sampling methodology for the random environment and matching kernel technology for which fitting the Gaussian process regression model scales as O ( n log n ) instead of the typical O ( n 3 ) rate in the number of samples n used to fit the surrogate. The surrogate model allows almost instantaneous predictions for the pressure at the critical location as a function of the extraction rate and permeability realization. Our second contribution is a novel algorithm to calibrate the uncertainty in the surrogate model to the discrepancy between the true pressure solution of Darcy’s equation and the numerical solution. Finally, although our method is derived for building a surrogate for the solution of Darcy’s equation with a random permeability field, the framework broadly applies to solutions of other partial differential equations with random coefficients.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Comparison of atomized mass and crater volume in laser ablation

The extent and dynamics of laser ablation are typically studied using crater imaging or by invoking the relationship between atomic emission and the mass removed. The former is a static view of a dynamic process and requires the accumulation of multiple shots in one location. The latter is complex and not absolute without calibration of the optical system with a standard of spectral radiance. We measure the mass of the atomized plume by laser atomic-absorption spectroscopy at 2 µs without external mass calibration; mass uncertainty in laser-ablation atomic absorption spectroscopy (LA-AAS) results from uncertainties in line area fitting, tabulated oscillator strengths, and partition functions as well as a <10% underrepresentation of the mass due to treating the plasma as a single thermodynamic equilibrium. The LA-AAS-measured mass pertains to the atoms in the probed charge states and does not include condensed or molecular species. The ablation efficiency at 300 mbar of helium varies significantly between the two focusing conditions used. A comparison of crater-derived masses and LA-AAS masses suggests that more defocused ablation may result in significant redeposition of material in the crater, distorting the conclusions from drilling studies and crater imaging. More focused ablation conditions result in crater-derived masses that exceed those measured with LA-AAS and suggest melt expulsion or phase explosion.

Merten, Jonathan [Arkansas State University, Jones↗
DOE OSTI2021

A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics

We study the utility and performance of a Bayesian model error embedding construction in the context of molecular dynamics modeling of metallic alloys, where we embed model error terms in existing interatomic potential model parameters. To alleviate the computational burden of this approach, we propose a framework combining likelihood approximation and Gaussian process surrogates. Here we leverage sparse Gaussian process techniques to construct a hierarchy of increasingly accurate but more expensive surrogate models. This hierarchy is then exploited by multilevel Markov chain Monte Carlo methods to efficiently sample from the target posterior distribution. We illustrate the utility of this approach by calibrating an interatomic potential model for a family of gold-copper alloys. In particular, this case study highlights effective means for dealing with computational challenges with Bayesian model error embedding in large-scale physical models, and the utility of embedded model error for model diagnostics.

Bayesian inference↗
DOE OSTI2025

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2020

Model Package Report: Plateau to River Groundwater Model Version 8.3

This model package report documents the groundwater flow component of the Plateau to River Groundwater Model (P2R Model), which is a groundwater flow and contaminant fate and transport (F&T) simulation model used to support remedial activities conducted by CH2M HILL Plateau Remediation Company at the Hanford Site in Washington State. The objective of this report is to describe the modeling objectives, conceptualization, model implementation, calibration, sensitivity, uncertainty, configuration control, limitations, and future model enhancements of the groundwater flow component of the P2R Model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Approach to Precision and Bias Analysis of Interlaboratory Salt Study Results

An interlaboratory study of salt properties measurements was initiated in 2020 by Raluca Scarlatt of UC Berkley and Jake McMurray of Oak Ridge National Laboratory as a DOE-funded NEUP project. The objective of what is referred to as the interlaboratory salt study (ISS) was to assess the quality of molten salt property data and develop consensus standard methods for measuring key property values. Unlike many interlaboratory studies in which the precision of applying a well-defined and well-constrained method is measured, the methods used to measure property values were not specified nor were the measurement conditions controlled. Instead, the approach was to engage participants in measuring the property values of two commonly-used salt mixtures by using any desired measurement techniques. By including measurements made using the same and different methods across institutions, the precisions achieved using specific techniques can be assessed as well as the confidence in the values measured using different techniques. Details of the calibrations and uncertainty provided by the participants will be useful in establishing a best practice for the application of each technique to molten salts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Regression Convolutional Neural Network for Energy Estimation in NOvA

Regression Convolutional Neural Network for Energy Estimation in NOvA" Abstract: "NOvA (NuMI Off-Axis $\nu_e$ Appearance) is a long baseline neutrino experiment designed to measure neutrino oscillations over a distance of 810 km. NOvA employs a near and far detector to observe $\nu_\mu$ disappearance and $\nu_e$ appearance of neutrinos produced by the NuMI beam at Fermilab. Energy reconstruction is critical for precise measurements of neutrino oscillation parameters and cross sections, which are functions of neutrino energy. Energy estimation remains difficult due to the complexity of detector response and final state particle kinematics. We present a regression-based convolutional neural network (CNN) method that reconstructs neutrino and lepton energies based on raw pixel inputs for NOvA. The trained model is able to reconstruct event energy for different interaction modes and complex final states containing leptons and hadrons. Studies of regression CNN networks show improved energy resolution and reduced sensitivity to calibration scale uncertainties relative to traditional kinematics-based energy reconstruction techniques. The results demonstrate the potential of the regression CNN method for neutrino physics analyses by improving on standard kinematics-based reconstruction.

Zhao, Larry [UC, Irvine (main)]↗
DOE OSTI2025

End-to-end differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using controllable-fidelity simulations that have fast execution time or can yield additional insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate an end-to-end digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes for linac and ring simulation, the development of generic interfaces between surrogate and physics-based sections, and presenting the control interface as either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to implement larger proton accelerators like PIPII and Booster.

Kuklev, N. [Fermilab]↗