Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

The Simons Observatory: impact of bandpass, polarization angle and calibration uncertainties on small-scale power spectrum analysis

We study the effects due to mismatches in passbands, polarization angles, and temperature and polarization calibrations in the context of the upcoming cosmic microwave background experiment Simons Observatory (SO). Using the SO multi-frequency likelihood, we estimate the bias and the degradation of constraining power in cosmological and astrophysical foreground parameters assuming different levels of knowledge of the instrumental effects. We find that incorrect but reasonable assumptions about the values ofall the systematics examined here can have significant effects on cosmologicalanalyses, hence requiring marginalization approaches at the likelihood level.When doing so, we find that the most relevant effect is due to bandpass shifts. When marginalizing over them, the posteriors of parameters describing astrophysical microwave foregrounds (such as radio point sources or dust) get degraded, while cosmological parameters constraints are not significantly affected.Marginalization over polarization angles with up to 0.25$^{°}$ uncertainty causes an irrelevant bias ≲ 0.05 σ in all parameters.Marginalization over calibration factors in polarization broadens the constraints on the effective number of relativistic degrees of freedom N$_{eff}$ by a factor 1.2, interpreted here as a proxy parameter for non standard model physics targeted by high-resolution CMB measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Post-Calibration Uncertainty Analysis for Travel Times at a Naval Weapons Industrial Reserve Plant

The Naval Weapons Industrial Reserve Plant (NWIRP) in McGregor, Texas began manufacturing explosives in 1980 and several hazardous chemicals were discovered in lakes and streams surrounding the site in 1998. Contaminants traveled to local lakes and streams much faster than initially predicted. This research estimated contaminant travel times and identified locations where monitoring wells should be installed to yield the greatest reductions in uncertainties in travel-time predictions. To this end, groundwater and particle-tracking models for NWIRP site were built to predict hydraulic heads and contaminant travel times. Next, parameter (hydraulic conductivities) uncertainties, parameter identifiabilities, observation (hydraulic heads) worth, and predictive (contaminant travel times) uncertainties were quantified. Parameter uncertainties were reduced by up to 92%; a total of 19 of 158 parameters were at least moderately identifiable; travel-time uncertainties were reduced up to 92%. Additionally, travel-time predictions and post-calibration parameter distributions were generated using the null-space Monte Carlo (NSMC) technique. NSMC predicted that conservative tracers exited the flow system within a year, which matches with field data. Finally, an observations-worth analysis found that additional 11 more measurements would reduce travel-time uncertainties by factors from 1.04 to 4.3 over existing data if monitoring wells were installed at the suggested locations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

Beyond pinball loss: Quantile methods for calibrated uncertainty quantification

Amongthemanywaysofquantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles for each input, at all quantile levels, presents a correct and efficient representation of the underlying uncertainty. To achieve this, many current quantile-based methods focus on optimizing the pinball loss. However, this loss restricts the scope of applicable regression models, limits the ability to target many desirable properties (e.g. calibration, sharpness, centered intervals), and may produce poor conditional quantiles. In this work, we develop new quantile methods that address these shortcomings. In particular, we propose methods that can apply to any class of regression model, select an explicit balance between calibration and sharpness, optimize for calibration of centered intervals, and produce more accurate conditional quantiles. We provide a thorough experimental evaluation of our methods, which includes a high dimensional uncertainty quantification task in nuclear fusion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Discrete-Direct Model Calibration and Uncertainty Propagation Method Confirmed on Multi-Parameter Plasticity Model Calibrated to Sparse Random Field Data

A discrete direct (DD) model calibration and uncertainty propagation approach is explained and demonstrated on a 4-parameter Johnson-Cook (J-C) strain-rate dependent material strength model for an aluminum alloy. The methodology's performance is characterized in many trials involving four random realizations of strain-rate dependent material-test data curves per trial, drawn from a large synthetic population. The J-C model is calibrated to particular combinations of the data curves to obtain calibration parameter sets which are then propagated to “Can Crush” structural model predictions to produce samples of predicted response variability. These are processed with appropriate sparse-sample uncertainty quantification (UQ) methods to estimate various statistics of response with an appropriate level of conservatism. This is tested on 16 output quantities (von Mises stresses and equivalent plastic strains) and it is shown that important statistics of the true variabilities of the 16 quantities are bounded with a high success rate that is reasonably predictable and controllable. The DD approach has several advantages over other calibration-UQ approaches like Bayesian inference for capturing and utilizing the information obtained from typically small numbers of replicate experiments in model calibration situations—especially when sparse replicate functional data are involved like force–displacement curves from material tests. The DD methodology is straightforward and efficient for calibration and propagation problems involving aleatory and epistemic uncertainties in calibration experiments, models, and procedures.

42 ENGINEERING↗
DOE OSTI2022

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Improved Primary Reference Cell Calibrations for Higher Accuracy Photovoltaic Cell and Module Performance Measurements

The adoption of photovoltaic (PV) modules for clean electricity relies on accurate measurements of their performance, which are essential for estimating their energy production potential. Herein, the calibration chain of PV cells and modules, with particular emphasis on primary reference cell calibrations, is discussed. Also, herein, the direct sunlight method the group has developed for these calibrations is presented and critical improvements and upgrades that lead to calibration uncertainty as low as 0.45% are discussed. The ultimate motivation behind this work is to provide low‐uncertainty performance measurements of PV modules, and lowering the calibration uncertainty of primary reference cells is a key first step toward achieving this goal. As the use of solar electricity continues to grow, the demand for primary reference cell calibrations inevitably increases beyond what the small handful of primary calibration laboratories can provide today. Therefore, this work can serve as a useful guide for implementing primary PV reference cell calibrations using the outdoor method, as well as outlining the critical elements required to make these calibrations highly accurate.

Osterwald, Carl R.↗
DOE OSTI2024

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗
DOE OSTI2024

Calibration and uncertainty quantification for Davis Equation of State models for the High Explosive PBX 9501 products

Abstract This paper investigates the uncertainty in the parameters used in the calibration of an Davis Equation Of State (EOS) for the detonation products of the High Explosive PBX 9501. The procedure sought to make use of all available information about this HE to inform the best set of calibration parameters as well as the uncertainty in these parameters. The procedure made use of historical experimental data, the results from thermo‐chemical modeling as well as data on the best isentrope function fit to cylinder test experimental data. Combining all these heterogeneous data sources together in a Bayesian calibration, yielded a posterior mean and covariance. Sampling from the posterior distribution and evaluating an important Quantity Of Interest (QOI) in the EOS model, the detonation speed of a one‐inch rate stick, produced a distribution which showed variations which were in agreement with experiments. The uncertainty in the EOS was reported as eleven sets of model calibrations which spanned the range of this QOI.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

Requirements on the gain calibration for LiteBIRD polarisation data with blind component separation

The detection of primordial B modes of the cosmic microwave background (CMB) could provide information about the early stages of the Universe's evolution. The faintness of this signal requires exquisite calibration accuracy and control of instrumental systematic effects which otherwise could bias the measurements. In this work, we study the impact of an imperfect relative polarisation gain calibration on the recovered value of the tensor-to-scalar ratio r for the LiteBIRD experiment, through the application of the blind Needlet Internal Linear Combination (NILC) foreground-cleaning method. We derive requirements on the relative calibration accuracy of the overall polarisation gain (Δg ν ) for each LiteBIRD frequency channel. Our results show that minimum variance techniques, as NILC, are less sensitive to systematic gain calibration uncertainties compared to a parametric approach, if the latter is not equipped with a proper modelling of these instrumental effects. In this study, the most stringent requirements are found in the channels where the CMB signal is relatively brighter, with the tightest constraints at 166 GHz (Δg ν ≈ 0.16%). This differs from the outcome of an analogous analysis performed with a parametric method, where the tightest requirements are obtained for the foreground-dominated channels. Gain calibration uncertainties, corresponding to the derived requirements, are then simultaneously propagated into all frequency channels. By doing so, we find that the overall impact on estimated r is lower than the total gain systematic budget for LiteBIRD approximately by a factor 5, due to the correlations of the impacts of gain calibration uncertainties in different frequency channels. In order to decouple the systematic effect from the specific choice of the model, we derive the requirements assuming constant spectral parameters for the foreground emission. To assess the robustness of the obtained results against more realistic scenarios, we repeat the analysis assuming sky models of intermediate and high complexity. In these further cases, we adopt an optimised NILC pipeline, called the Multi-Clustering NILC (MC-NILC). We find that the impact of gain calibration uncertainties on r is lower than the LiteBIRD gain systematics budget for the intermediate-complexity sky model. For the high-complexity case, instead, it would be necessary to tighten the requirements by a factor 1.8.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Scintillation light calibrations, systematic uncertainties, and triggering efficiency in the MicroBooNE detector

Scintillation light, produced alongside ionisation charge from particle interactions, plays a critical role in liquid argon time projection chamber (LArTPC) detectors. A detailed understanding of its production and detection mechanisms is essential for robust calibration, systematic uncertainty evaluation, and physics analysis. This article describes the MicroBooNE light simulation, light-based triggering schemes, photomultiplier tube gain calibration, light response stability, and light-based systematic uncertainties over the course of five years of data collection. In addition, we present a measurement of scintillation light triggering efficiency, focusing on the lowest-light regime relevant to rare-event searches and low-energy neutrino interactions. Finally, we discuss two notable observations in MicroBooNE's data, both reported here for the first time: an approximately 50% decline in MicroBooNE's light yield over time, concentrated in the first two years of running; and a higher than expected O(200 kHz) rate of single photoelectron noise. The results presented provide an important benchmark of long-term light detection performance in LArTPC neutrino detectors.

Abratenko, P. [Tufts U.]↗
DOE OSTI2020

Nondestructive measurements of residual 235 U mass of Israeli Research Reactor-1 fuel using the Advanced Experimental Fuel Counter

In 2018, a measurement campaign took place with participants from Los Alamos National Laboratory (LANL), the Nuclear Research Centre-Negev (NRCN) and Soreq Nuclear Research Center (SNRC) at the Israeli Research Reactor-1 (IRR-1) in which 14 of the reactor’s used fuel assemblies (FAs) with varied amount of depletion were measured with the nondestructive assay instrument Advanced Experimental Fuel Counter (AEFC). Designed for safeguards purposes, the AEFC measures both neutrons emitted from the FA (passive neutrons) and fission neutrons induced by an external neutron source (in this experiment, 252 Cf). Signals recorded with the AEFC include total neutron count rates (Singles), time-correlated neutron count rates (Doubles), and total gamma-ray count rates. The 235 U content of the FAs was previously assessed by two independent methods: (1) measurement of the transparency of the FA to low-energy gamma rays from an activated rhenium source (rhenium gamma transmission, or the RGT method) and (2) calculation of the 30-year burnup history of the core using detailed three-dimensional Monte-Carlo core depletion calculations. The results from the FAs that had been measured via the RGT method were used to construct the calibration curves, which translate the AEFC count rates to 235 U mass. Then, the calibration was evaluated using AEFC measurements of six additional FAs that were not measured via the RGT method. From the results, it was determined the Doubles calibration curve was more reliable than that of the Singles and follows a simple second-order polynomial fit for the whole range of residual 235 U mass content, albeit with larger statistical uncertainty. Detailed uncertainties quantification was conducted for both the AEFC Singles and Doubles. This includes the analysis of statistical uncertainties, calibration uncertainty, and random uncertainties due to the sensitivity of the AEFC to several sources of uncertainty, namely the FA position, FA orientation, interrogation source position, and ambient pool temperature. Finally, an overall total uncertainty of 6 g of 235 U is estimated for the Singles and Doubles, which is mainly due to calibration uncertainty (for the Singles) and statistical uncertainty (for the Doubles), and which constitutes 3%–6% of the 235 U total mass in the FAs, depending on their level of depletion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Calculating Interval Uncertainties for Calibration Standards That Drift with Time

Calibrated values of many devices exhibit predictable drift over time. To provide an uncertainty statement valid over the entire calibration interval, one must account for drift. In this article, a method of accounting for drift is proposed based on guidance in the Guide to Expression of Uncertainty in Measurement. An additional uncertainty term is computed using a linear regression of historical measurement data, which is included along with the time-of-test uncertainty. This method is evaluated by analyzing its average out-of-tolerance (OOT) rate using a Monte Carlo simulation, which results in the desired 5% average OOT rate when the total uncertainty is expanded to a 95% confidence interval.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Calibration and Uncertainty Estimation Using the Ensemble Kalman Filter with a Large Subsurface Flow and Transport Model - 20321

At routinely monitored groundwater contamination sites, periodically measured environmental conditions such as groundwater levels and contaminant concentrations are used to inform and confirm a conceptual site model (CSM) and guide the development and calibration of a numerical groundwater flow and transport model. The calibration of groundwater flow and transport models after each measurement (sampling) event can illuminate deficiencies in a CSM, identify areas where additional monitoring is warranted, and predict the behavior of the system to guide decision making. However, manual and automated (e.g. PEST) model calibration tools can be time-consuming and computationally expensive to implement after each sampling event. Perhaps as a result, such calibration tools generally utilize all available monitoring data simultaneously rather than sequentially assimilating monitoring data one sampling event at a time as the results from sampling become available. A more real-time data assimilation approach may reduce parameter uncertainty, quantify the value of additional monitoring data, and produce a usable model more quickly and with less effort. To mitigate the potential time-consuming aspects of manual and widely applied automated calibration techniques, a data assimilation algorithm called the ensemble Kalman filter (EnKF) was evaluated as a relatively efficient method of model calibration and uncertainty assessment via the sequential integration of monitoring data into a model. The EnKF was able to successfully and efficiently assimilate monitoring and modeling data to calibrate a complex flow and transport model at a real-world site with significant subsurface heterogeneity, uncertainty, and 12 years of monitoring data (over 4,000 individual measurements of groundwater levels and over 2,500 measurements of contaminant concentrations). Starting with an uncalibrated model data from annual sampling events were sequentially assimilated, and the resultant predication errors and estimated parameter uncertainties were tracked. After all monitoring data were assimilated, both flow and transport residuals at the end of the EnKF process were comparable to those produced via a concurrent PEST calibration effort but required fewer model simulations. Both uncertainty and prediction errors decreased over time. In a real-time application, the adequacy of the model could be assessed after each sampling event. The benefits of such a real-time approach to utilizing monitoring data include reduced costs (in the form of model updates or site characterization efforts), early flagging of possible errors in the CSM, and a reduced risk of overfitting and corresponding increased confidence in model predictions. This tool may be particularly useful compared to other calibration techniques (e.g. manual, PEST) when model runtimes are long, calibration parameters are many, or parameter uncertainty is large. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗