Uncertainty estimation and propagation in SIRTF pipelines
Explore the source record for details and available documents.
calibrated science products estimating uncertainti↗
SEARCH · Engineering Papers
Results for “uncertainty estimation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Methods for Validation of Random Uncertainty Estimates and Their Applications to Ozone Profiles From Limb-Viewing Satellite Instruments
For satellite measurements of atmospheric composition, the random uncertainty estimates provided by retrieval algorithms might be imperfect due to various approximations used in the retrievals or the presence of unknown error sources. This paper presents an overview of the methods used for the validation of random uncertainty estimates. All methods discussed in this study are categorized, and assumptions and limitations of each method are discussed. This overview evaluates these methods in application to ozone profile measurements from limb and occultation satellite instruments and provides practical illustrations of random uncertainty validation.
Viktoria F Sofieva↗
Space Radiation Cancer, Circulatory Disease and CNS Risks for Near Earth Asteroid and Mars Missions: Uncertainty Estimates for Never-Smokers
The uncertainties in estimating the health risks from galactic cosmic rays (GCR) and solar particle events (SPE) are a major limitation to the length of space missions and the evaluation of potential risk mitigation approaches. NASA limits astronaut exposures to a 3% risk of exposure induced cancer death (REID), and protects against uncertainties in risks projections using an assessment of 95% confidence intervals after propagating the error from all model factors (environment and organ exposure, risk coefficients, dose-rate modifiers, and quality factors). Because there are potentially significant late mortality risks from diseases of the circulatory system and central nervous system (CNS) which are less well defined than cancer risks, the cancer REID limit is not necessarily conservative. In this report, we discuss estimates of lifetime risks from space radiation and new estimates of model uncertainties are described. The key updates to the NASA risk projection model are: 1) Revised values for low LET risk coefficients for tissue specific cancer incidence, with incidence rates transported to an average U.S. population to estimate the probability of Risk of Exposure Induced Cancer (REIC) and REID. 2) An analysis of smoking attributable cancer risks for never-smokers that shows significantly reduced lung cancer risk as well as overall cancer risks from radiation compared to risk estimated for the average U.S. population. 3) Derivation of track structure based quality functions depends on particle fluence, charge number, Z and kinetic energy, E. 4) The assignment of a smaller maximum in quality function for leukemia than for solid cancers. 5) The use of the ICRP tissue weights is shown to over-estimate cancer risks from SPEs by a factor of 2 or more. Summing cancer risks for each tissue is recommended as a more accurate approach to estimate SPE cancer risks. 6) Additional considerations on circulatory and CNS disease risks. Our analysis shows that an individual s history of smoking exposure has a larger impact on GCR risk estimates than amounts of radiation shielding or age at exposure (amongst adults). Risks for never-smokers compared to the average U.S. population are estimated to be reduced between 30% and 60% dependent on model assumptions. Lung cancer is the major contributor to the reduction for never-smokers, with additional contributions from circulatory diseases and cancers of the stomach, liver, bladder, oral cavity and esophagus, and leukemia. The relative contribution of CNS risks to the overall space radiation detriment is potentially increased for never-smokers such as most astronauts. Problems in estimating risks for former smokers and the influence of second-hand smoke are discussed. Compared to the LET approximation, the new track structure derived radiation quality functions lead to a reduced risk for relativistic energy particles and increased risks for intermediate energy particles. Revised estimates for the number of safe days in space at solar minimum for heavy shielding conditions are described for never-smokers and the average U.S. population. Results show that missions to near Earth asteroids (NEA) or Mars violate NASA's radiation safety standards with the current levels of uncertainties. Greater improvements in risk estimates for never-smokers are possible, and would be dependent on improved understanding of risk transfer models, and elucidating the role of space radiation on the various stages of disease formation (e.g. initiation, promotion, and progression).
Cucinotta, Francis A.↗
Understanding Volume Estimation Uncertainty of Lakes and Wetlands Using Satellites and Citizen Science
We studied variations in the volume of water stored in small lakes and wetlands using satellite remote sensing and lake water height data contributed by citizen scientists. A total of 94 water bodies across the globe were studied using satellite data in the optical and microwave wavelengths from Landsat 8, Sentinel-1, and Sentinel-2. The uncertainty in volume estimation as a function of geography and geophysical factors, such as cloud cover, precipitation, and water surface temperature, was studied. The key finding that emerged from this global study is that uncertainty is highest in regions with a distinct precipitation season, such as in the monsoon dominated South Asia or the Pacific Northwestern region of the USA. This uncertainty is further compounded when small lakes and wetlands are seasonal with alternating land use as a water body and agricultural land, such as the wetlands of Northeastern Bangladesh. On an average, 45% of studied lakes could be estimated of their volume change with a statistical significant uncertainty that is less than the expected volume in South Asia. In North America, this statistically significant uncertainty in volume estimation was found to be around 50% in lakes eastward of the 108th meridian with lowest uncertainty found in lakes along the East coast of the USA. The article provides a baseline for understanding the current state of the art in estimating volumetric change of lakes and wetlands using citizen science in anticipation of the recently launched Surface Water and Ocean Topography Mission.
Shahzaib Khan↗
Subpixel Localization and Uncertainty Estimation Using Occupancy Grids
We describe techniques for performing mobile robot localization using occupancy grids that enable both subpixel localization to be performed and uncertainty estimates to be computed.
Mobile↗
Lognormal Uncertainty Estimation for Failure Rates
"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.
Britton, Paul T.↗
Estimating Uncertainties in the SBUV Version 8.6 Merged Profile Ozone Data Set
The combined record of total and profile ozone measurements from the solar backscatter ultraviolet (SBUV) and SBUV/2 series of instruments, known as the SBUV Merged Ozone Data (MOD) product, constitutes the longest satellite-based ozone time series from a single instrument type and as such plays a key role in ozone trend analyses. Following the approach documented in Frith et al. (2014) to analyze the merging uncertainties in the MOD total ozone record, we use Monte Carlo simulations to estimate the potential for uncertainties in the calibration and drift of individual instruments in the profile ozone merged data set. We focus our discussion on the trends and associated merging uncertainty since 2001 in an effort to verify the start of ozone recovery as predicted by chemistry climate models. We find that merging uncertainty dominates the overall estimated uncertainty when considering only the 15 years of data since 2001. We derive trends versus pressure level for the MOD data set that are positive in the upper stratosphere as expected for ozone recovery. These trends appear to be significant when only statistical uncertainties are included but become not significant at the 2o level when instrument uncertainties are accounted for. However, when we use the entire data set from 1979 through 2015 and fit to the EESC (equivalent effective stratospheric chlorine) we find statistically significant fits throughout the upper stratosphere at all latitudes. This implies that the ozone profile data remain consistent with our expectation that chlorine is the dominant ozone forcing term.
Ozone profile↗
Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales
Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.
Hydrology↗
Estimating Uncertainty in GPCP and TRMM Multi-Satellite Precipitation Estimates
One of the high-priority problems in satellite precipitation estimation is developing algorithms for estimating the errors in precipitation retrievals by individual sensors and subsequent multi-satellite combinations. Classically, we distinguish between "random" and "bias" errors, which do and do not, respectively average to zero over a "big enough" time/space sample. The current operational GPCP and TRMM multi-satellite algorithms are nearly unique in estimating random error for the monthly precipitation estimates from individual sensor systems (including gauge), following Huffman, and then making multi-sensor combinations. No routinely operational global precipitation produces estimates of bias error. Subsequently, a similar scheme has been followed to provide random error estimates for the Multi-satellite Precipitation Analysis (MPA) being computed in real time and after real time for TRMM. The Huffman algorithm for random error is briefly reviewed, including a discussion of the limitations imposed on the algorithm by standard monthly precipitation data sets. Starting from a very simple theoretical treatment of the histogram of precipitation samples in a month, an equation is developed that depends on the estimated average precipitation rate for the month, the number of samples in the month, and two constants. The constants are set separately for each source of precipitation estimate (such as "raingauge") by calibration at selected ground sites. We discuss recent work validating the random error estimates to highlight the successes and limitations of this first-generation approach. We then consider what information is needed from the individual sensor algorithms to facilitate additional accuracy in the estimation of random errors across the time/space span of climate regimes which a global estimation system must handle. In addition, the thorny issue of estimating bias is raised. Finally, the role of error estimates (and the qualitative errors!) in creating combinations of precipitation estimates from different individual sensors is discussed. This issue is particularly important when fine scales in space and time are being considered, say the 0.25 x 0.25-deg 3-hourly estimates in the MPA.
Huffman, G. J.↗
Lidar Simulations of Backscatter and Extinction Uncertainty Estimates for ACCP Assessments
As part of the NASA Aerosols and Clouds, Convection, and Precipitation (ACCP) pre-formulation study, several lidar instruments are being assessed for their capabilities in advancing the science objectives enumerated in the most recent Earth Sciences Decadal Survey. These assessments are conducted using the NASA Langley Research Center(LaRC) lidar simulator, which produces profiles of backscatter and extinction uncertainty estimates for a given set of input parameters. Specifically, attention is focused onevaluating the science benefits and improvements of a candidate two-wavelength space-based High Spectral Resolution Lidar (HSRL) compared to an elastic backscatter lidar with similar capabilities to the Cloud-Aerosol Lidar with Orthogonal Polarization(CALIOP), flying aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite. In this talk, simulations of satellite-based HSRL and those of a CALIOP-like system are compared for different atmospheric scenes that capture varying total aerosol loadings, aerosol vertical distributions, and aerosol types.The results of these analyses are presented as functions of averaging resolution(horizontal/vertical), lighting conditions (daytime/nighttime), surface type (land/ocean),and wavelength (532 nm/1064 nm). Also, simulations of multiple aerosol layers and of aerosols beneath transparent cirrus clouds are shown to demonstrate the consequent impacts on underlying backscatter and extinction uncertainties, and to better differentiate the performance of HSRL compared to that of CALIOP for real-world atmospheric scenarios.
Travis D. Toth↗
Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales
In this study, we assimilate Soil Moisture Active Passive (SMAP) mission brightness temperature (Tb) observations into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update surface and root-zone soil moisture simulations. Different time series components of the Tb observations are assimilated including anomalies, inter-annual variations, and high-frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the un-certainties of modeled and observed Tb is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. Results are compared to a benchmark experiment that mimics the operational SMAP Level-4 algorithm, which assimilates Tb observations using a spatially-constant 4 Kelvin (K) observation uncertainty. All DA experiments exhibit notable skill improvements in most regions. Improvements are greatest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for sur-face soil moisture simulations (0.06). Strikingly, however, no notable difference in skill—neither improvement nor deterioration—is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. We show, analytically, that this may be explained by the presence of large observation operator errors, which have the potential to render post-update uncertainty insensitive to inaccuracies in the Kalman gain.
Alexander Gruber↗
Estimating Uncertainty in Long Term Total Ozone Records from Multiple Sources
Total ozone measurements derived from the TOMS and SBUV backscattered solar UV instrument series cover the period from late 1978 to the present. As the SBUV series of instruments comes to an end, we look to the 10 years of data from the AURA Ozone Monitoring Instrument (OMI) and two years of data from the Ozone Mapping Profiler Suite (OMPS) on board the Suomi National Polar-orbiting Partnership satellite to continue the record. When combining these records to construct a single long-term data set for analysis we must estimate the uncertainty in the record resulting from potential biases and drifts in the individual measurement records. In this study we present a Monte Carlo analysis used to estimate uncertainties in the Merged Ozone Dataset (MOD), constructed from the Version 8.6 SBUV2 series of instruments. We extend this analysis to incorporate OMI and OMPS total ozone data into the record and investigate the impact of multiple overlapping measurements on the estimated error. We also present an updated column ozone trend analysis and compare the size of statistical error (error from variability not explained by our linear regression model) to that from instrument uncertainty.
TOMS and SBUV↗
Validation and Uncertainty Estimates for MODIS Collection 6 "Deep Blue" Aerosol Data
The "Deep Blue" aerosol optical depth (AOD) retrieval algorithm was introduced in Collection 5 of the Moderate Resolution Imaging Spectroradiometer (MODIS) product suite, and complemented the existing "Dark Target" land and ocean algorithms by retrieving AOD over bright arid land surfaces, such as deserts. The forthcoming Collection 6 of MODIS products will include a "second generation" Deep Blue algorithm, expanding coverage to all cloud-free and snow-free land surfaces. The Deep Blue dataset will also provide an estimate of the absolute uncertainty on AOD at 550 nm for each retrieval. This study describes the validation of Deep Blue Collection 6 AOD at 550 nm (Tau(sub M)) from MODIS Aqua against Aerosol Robotic Network (AERONET) data from 60 sites to quantify these uncertainties. The highest quality (denoted quality assurance flag value 3) data are shown to have an absolute uncertainty of approximately (0.086+0.56Tau(sub M))/AMF, where AMF is the geometric air mass factor. For a typical AMF of 2.8, this is approximately 0.03+0.20Tau(sub M), comparable in quality to other satellite AOD datasets. Regional variability of retrieval performance and comparisons against Collection 5 results are also discussed.
MODIS collection 6↗
Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment
"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.
Britton, Paul T.↗
The Relationship Between Two Methods for Estimating Uncertainties in Data Assimilation
This note examines the relationship between two apparently unrelated methods for estimating error statistics or uncertainties of relevance to data assimilation. The first method is due to (Desroziers et al., 2005, Q. J. R. Meteorol. Soc., 131, 3385–3396; referred to as DBCP hereafter) and relies on residual statistics readily available from data assimilation applications. The second method, the three- cornered hat (3CH) developed by Gray and Allan (1974, IEEE 28th Annual Symp. Freq. Control, 243–246), only recently applied to atmospheric sciences, uses three data sets and can derive estimates of relevant error uncertainties as well. The usefulness of both methods lies in them not requiring knowledge of the true value of the quantities at play. DBCP derives its results by relying explicitly on the constraints as- sociated with the data assimilation minimization problem; 3CH is general and its estimates hold as long as errors in the three data sets of choice are uncorrelated. Establishing the relationship between the methods requires applying the 3CH approach to the same observation, background, and analysis data sets used by DBCP. In this case, the same assumptions of DBCP on residual errors allow for cancellation of error cross–covariance terms in 3CH such that two of its corners derive identical estimates for observation and background error covariances as those of DBCP. The error cross–covariance terms associated with the third corner are shown to add up to twice the analysis error covariance so that the 3CH estimate for the third corner recovers the negative of the analysis error covariance. Illustrations of these findings are provided by deriving uncertainties for radio occultation bending angles.
Ricardo Todling↗
Combined Error and Uncertainty Estimates for CFD Problems
Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?
Posteriori↗
Exploiting Measurement Uncertainty Estimation in Evaluation of GOES-R ABI Image Navigation Accuracy Using Image Registration Techniques
In evaluating GOES-R Advanced Baseline Imager (ABI) image navigation quality, upsampled sub-images of ABI images are translated against downsampled Landsat 8 images of localized, high contrast earth scenes to determine the translations in the East-West and North-South directions that provide maximum correlation. The native Landsat resolution is much finer than that of ABI, and Landsat navigation accuracy is much better than ABI required navigation accuracy and expected performance. Therefore, Landsat images are considered to provide ground truth for comparison with ABI images, and the translations of ABI sub-images that produce maximum correlation with Landsat localized images are interpreted as ABI navigation errors. The measured local navigation errors from registration of numerous sub-images with the Landsat images are averaged to provide a statistically reliable measurement of the overall navigation error of the ABI image. The dispersion of the local navigation errors is also of great interest, since ABI navigation requirements are specified as bounds on the 99.73rd percentile of the magnitudes of per pixel navigation errors. However, the measurement uncertainty inherent in the use of image registration techniques tends to broaden the dispersion in measured local navigation errors, masking the true navigation performance of the ABI system. We have devised a novel and simple method for estimating the magnitude of the measurement uncertainty in registration error for any pair of images of the same earth scene. We use these measurement uncertainty estimates to filter out the higher quality measurements of local navigation error for inclusion in statistics. In so doing, we substantially reduce the dispersion in measured local navigation errors, thereby better approximating the true navigation performance of the ABI system.
navigation performance↗
Estimating Uncertainties in the Multi-Instrument SBUV Profile Ozone Merged Data Set
The MOD data set is uniquely qualified for use in long-term ozone analysis because of its long record, high spatial coverage, and consistent instrument design and algorithm. The estimated MOD uncertainty term significantly increases the uncertainty over the statistical error alone. Trends in the post-2000 period are generally positive in the upper stratosphere, but only significant at 1-1.6 hPa. Remaining uncertainties not yet included in the Monte Carlo model are Smoothing Error ( 1 from 10 to 1 hPa) Relative calibration uncertainty between N11 and N17Seasonal cycle differences between SBUV records.
Uncertainties↗