Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Assessment of MODIS Reflected Solar Calibration Uncertainty

Determination of the calibration accuracy and traceability of a remote sensing instrument is a driving issue in the use of satellite data for calibration inter-comparisons and studying climate change. The Terra and Aqua MODerate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 11 and 9 years, respectively. Twenty of the thirty six MODIS spectral bands are in the reflected solar region with center wavelengths ranging from 0.41 to 2.2 microns. MODIS reflective solar band (RSB) on-orbit calibration is reflectance based through the use of an on-board solar diffuser (SO). The calibration uncertainty requirements are +/-2.0% for the RSB reflectance factors at sensor specified typical scene reflectances or radiances. The SO bi-directional reflectance factor (BRF) was characterized pre-launch and its on-orbit changes are tracked by an on-board solar diffuser stability monitor (SDSM). This paper provides an assessment of MODIS RSB on-orbit calibration traceability and uncertainty for its Level 1B (L1B) reflectance factors. It examines in details each of the uncertainty contributors, including those from pre-launch measurements as well as on-orbit observations. Common challenging issues and differences due to individual sensors' specific characteristics and on-orbit performance are also discussed in this paper. Guidance and recommendations are presented, based on lessons from MODIS RSB calibration uncertainty assessment, for the development of future instrument calibration and validation plans.

Xiong, Xiaoxiong↗
NASA NTRS2011

MODIS On-orbit Calibration Uncertainty Assessment

MODIS has 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB). Compared to its heritage sensors, MODIS was developed with very stringent calibration uncertainty requirements. As a result, MODIS was designed and built with a set of on-board calibrators (OBC), which allow key sensor performance parameters and on-orbit calibration coefficients to be monitored and updated. In terms of its calibration traceability, MODIS RSB calibration is reflectance based using an on-board solar diffuser (SD) and the TEB calibration is radiance based using an on-board blackbody (BB). In addition to on-orbit calibration coefficients derived from its OBC, calibration parameters determined from sensor pre-launch calibration and characterization are used in both the RSB and TEB calibration and retrieval algorithms. This paper provides a brief description of MODIS calibration methodologies and an in-depth analysis of its on-orbit calibration uncertainties. Also discussed in this paper are uncertainty contributions from individual components and differences due to Terra and Aqua MODIS instrument characteristics and on-orbit performance.

Chiang, Vincent↗
NASA NTRS2018

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗
NASA NTRS2017

VIIRS Thermal Emissive Bands L1B Calibration Uncertainty

The Visible Infrared Imaging Radiometer Suite (VIIRS) is a key instrument on-board the Suomi National Polar-orbiting Partnership (S-NPP) spacecraft. The S-NPP launched in October 2011 and it has been collecting valuable Earth science data with VIIRS and four other instruments for more than five years. The VIIRS Characterization Support Team (VCST) of the National Aeronautics and Space Administration (NASA) Science Investigator-led Processing Systems (SIPS) is designed to support the VIIRS sensor pre-launch geometric and radiometric characterization and to access on-orbit long-term Level-1B (L1B) calibration and performance. This paper reviews the VIIRS thermal emissive bands (TEB), covering wavelengths from 3.7 to 12.0 μm, L1B radiometric calibration algorithms and presents the calibration uncertainty methodology which will be implanted in the L1B processing software. Discussions will be focused on the key uncertainty parameters and the application in L1B.

S-NPP VIIRS TEB Uncertainty↗
DOE OSTI2024

The Simons Observatory: impact of bandpass, polarization angle and calibration uncertainties on small-scale power spectrum analysis

We study the effects due to mismatches in passbands, polarization angles, and temperature and polarization calibrations in the context of the upcoming cosmic microwave background experiment Simons Observatory (SO). Using the SO multi-frequency likelihood, we estimate the bias and the degradation of constraining power in cosmological and astrophysical foreground parameters assuming different levels of knowledge of the instrumental effects. We find that incorrect but reasonable assumptions about the values ofall the systematics examined here can have significant effects on cosmologicalanalyses, hence requiring marginalization approaches at the likelihood level.When doing so, we find that the most relevant effect is due to bandpass shifts. When marginalizing over them, the posteriors of parameters describing astrophysical microwave foregrounds (such as radio point sources or dust) get degraded, while cosmological parameters constraints are not significantly affected.Marginalization over polarization angles with up to 0.25$^{°}$ uncertainty causes an irrelevant bias ≲ 0.05 σ in all parameters.Marginalization over calibration factors in polarization broadens the constraints on the effective number of relativistic degrees of freedom N$_{eff}$ by a factor 1.2, interpreted here as a proxy parameter for non standard model physics targeted by high-resolution CMB measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Post-Calibration Uncertainty Analysis for Travel Times at a Naval Weapons Industrial Reserve Plant

The Naval Weapons Industrial Reserve Plant (NWIRP) in McGregor, Texas began manufacturing explosives in 1980 and several hazardous chemicals were discovered in lakes and streams surrounding the site in 1998. Contaminants traveled to local lakes and streams much faster than initially predicted. This research estimated contaminant travel times and identified locations where monitoring wells should be installed to yield the greatest reductions in uncertainties in travel-time predictions. To this end, groundwater and particle-tracking models for NWIRP site were built to predict hydraulic heads and contaminant travel times. Next, parameter (hydraulic conductivities) uncertainties, parameter identifiabilities, observation (hydraulic heads) worth, and predictive (contaminant travel times) uncertainties were quantified. Parameter uncertainties were reduced by up to 92%; a total of 19 of 158 parameters were at least moderately identifiable; travel-time uncertainties were reduced up to 92%. Additionally, travel-time predictions and post-calibration parameter distributions were generated using the null-space Monte Carlo (NSMC) technique. NSMC predicted that conservative tracers exited the flow system within a year, which matches with field data. Finally, an observations-worth analysis found that additional 11 more measurements would reduce travel-time uncertainties by factors from 1.04 to 4.3 over existing data if monitoring wells were installed at the suggested locations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
NASA NTRS2014

Calibration Uncertainty in Ocean Color Satellite Sensors and Trends in Long-term Environmental Records

Launched in late 2011, the Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the Suomi National Polar-orbiting Partnership (NPP) spacecraft is being evaluated by NASA to determine whether this sensor can continue the ocean color data record established through the Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) and the MODerate resolution Imaging Spectroradiometer (MODIS). To this end, Goddard Space Flight Center generated evaluation ocean color data products using calibration techniques and algorithms established by NASA during the SeaWiFS and MODIS missions. The calibration trending was subjected to some initial sensitivity and uncertainty analyses. Here we present an introductory assessment of how the NASA-produced time series of ocean color is influenced by uncertainty in trending instrument response over time. The results help quantify the uncertainty in measuring regional and global biospheric trends in the ocean using satellite remote sensing, which better define the roles of such records in climate research.

environment↗
DOE OSTI2025

Beyond pinball loss: Quantile methods for calibrated uncertainty quantification

Amongthemanywaysofquantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles for each input, at all quantile levels, presents a correct and efficient representation of the underlying uncertainty. To achieve this, many current quantile-based methods focus on optimizing the pinball loss. However, this loss restricts the scope of applicable regression models, limits the ability to target many desirable properties (e.g. calibration, sharpness, centered intervals), and may produce poor conditional quantiles. In this work, we develop new quantile methods that address these shortcomings. In particular, we propose methods that can apply to any class of regression model, select an explicit balance between calibration and sharpness, optimize for calibration of centered intervals, and produce more accurate conditional quantiles. We provide a thorough experimental evaluation of our methods, which includes a high dimensional uncertainty quantification task in nuclear fusion.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2019

Bayesian Inference and the Effects of Varying Uncertainty Models in Charring Ablator Calibration and Uncertainty Quantification Problems

The Mars Science Laboratory (MSL) vehicle utilized a heat shield constructed from NASA’s Phenolic-Impregnated Carbon Ablator (PICA) material to protect the main structure from the high enthalpy environment encountered during hypersonic atmospheric entry. During the vehicle’s descent through Martian atmosphere, multiple thermocouples embedded within the heat shield captured in-depth material temperature data that allow for studies to be conducted on current material response reconstruction tools. In the present work, material temperature data obtained from thermocouples within the MISP-4 plug (MEDLI (Mars Science Laboratory Entry, Descent, and Landing Instrument) Integrated Sensor Plug) are utilized in the calibration of Theoretical Ablative Composite for Open Testing (TACOT) model parameters in conjunction with NASA’s Porous material Analysis Toolbox (PATO) through Bayesian inference where uncertainty due to parametric, modeling, and experimental sources is simultaneously quantified. Prior to the study, a sensitivity analysis is performed through computation of the robust Sobol indices in an effort to study the relationship between input space and model response and to reduce the dimensionality of the statistical inverse problem. The Bayesian inference methodology necessitates an a-priori choice to be made for the uncertainty model for which numerous possibilities are available. Across most works, however, only basic additive or multiplicative models are utilized with pre-defined magnitudes of uncertainty based on a-priori knowledge or to-be-calibrated multipliers of static covariance matrix structures. The present effort explores the effects of informed uncertainty models, ones with temporal dependence that are simultaneously calibrated through Bayesian inference, on calibrated results for parameters that make up the uncertain input space.

Sensitivity Analysis↗
DOE OSTI2025

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Discrete-Direct Model Calibration and Uncertainty Propagation Method Confirmed on Multi-Parameter Plasticity Model Calibrated to Sparse Random Field Data

A discrete direct (DD) model calibration and uncertainty propagation approach is explained and demonstrated on a 4-parameter Johnson-Cook (J-C) strain-rate dependent material strength model for an aluminum alloy. The methodology's performance is characterized in many trials involving four random realizations of strain-rate dependent material-test data curves per trial, drawn from a large synthetic population. The J-C model is calibrated to particular combinations of the data curves to obtain calibration parameter sets which are then propagated to “Can Crush” structural model predictions to produce samples of predicted response variability. These are processed with appropriate sparse-sample uncertainty quantification (UQ) methods to estimate various statistics of response with an appropriate level of conservatism. This is tested on 16 output quantities (von Mises stresses and equivalent plastic strains) and it is shown that important statistics of the true variabilities of the 16 quantities are bounded with a high success rate that is reasonably predictable and controllable. The DD approach has several advantages over other calibration-UQ approaches like Bayesian inference for capturing and utilizing the information obtained from typically small numbers of replicate experiments in model calibration situations—especially when sparse replicate functional data are involved like force–displacement curves from material tests. The DD methodology is straightforward and efficient for calibration and propagation problems involving aleatory and epistemic uncertainties in calibration experiments, models, and procedures.

42 ENGINEERING↗
DOE OSTI2022

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Improved Primary Reference Cell Calibrations for Higher Accuracy Photovoltaic Cell and Module Performance Measurements

The adoption of photovoltaic (PV) modules for clean electricity relies on accurate measurements of their performance, which are essential for estimating their energy production potential. Herein, the calibration chain of PV cells and modules, with particular emphasis on primary reference cell calibrations, is discussed. Also, herein, the direct sunlight method the group has developed for these calibrations is presented and critical improvements and upgrades that lead to calibration uncertainty as low as 0.45% are discussed. The ultimate motivation behind this work is to provide low‐uncertainty performance measurements of PV modules, and lowering the calibration uncertainty of primary reference cells is a key first step toward achieving this goal. As the use of solar electricity continues to grow, the demand for primary reference cell calibrations inevitably increases beyond what the small handful of primary calibration laboratories can provide today. Therefore, this work can serve as a useful guide for implementing primary PV reference cell calibrations using the outdoor method, as well as outlining the critical elements required to make these calibrations highly accurate.

Osterwald, Carl R.↗