Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗
DOE OSTI2025

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Quantifying Effects of Departure and Flight Time Uncertainty on Urban Air Mobility Operations

Demand capacity balancing is a key mechanism for maintaining safe and efficient Urban Air Mobility (UAM) operations. However, uncertainties such as departure delays and flight time variation may reduce the effectiveness of algorithms used for balancing and detrimentally impact the safety and efficiency of UAM operations. In this paper, the effects of these uncertainties on UAM operations are quantified by modeling a distribution of departure and flight time errors. A route network in the Dallas/Fort Worth metropolitan area was used to simulate traffic demand with and without uncertainty. Simulations were conducted with three main models of uncertainty – first uncertainty in departure time delay resulting in late takeoffs, second with uncertainty in flight times in addition to departure delays, and finally, uncertainty in departure times that cause either late or early takeoffs. Each of these simulations were performed using varied standard deviations to fully understand the effects of uncertainties. Results from these simulations were compared to a baseline simulation using the same parameters, but without any uncertainty. The results suggest that both safety and efficiency are significantly impacted by uncertainty even with relatively low uncertainty introduced. These results work towards quantifying the effects of uncertainty in flight scheduling for UAM. They will also aid in the further development of the demand capacity balancing algorithms for UAM operations and associated air traffic management.

Urban Air Mobility↗
NASA NTRSDate not supplied

Quantifying the Effects of Departure and Flight Time Uncertainty on Urban Air Mobility Operations

Demand capacity balancing is a key mechanism for maintaining safe and efficient Urban Air Mobility (UAM) operations. However, uncertainties such as departure delays and flight time variation may reduce the effectiveness of algorithms used for balancing and detrimentally impact the safety and efficiency of UAM operations. In this paper, the effects of these uncertainties on UAM operations are quantified by modeling a distribution of departure and flight time errors. A route network in the Dallas/Fort Worth metropolitan area was used to simulate traffic demand with and without uncertainty. Simulations were conducted with three main models of uncertainty – first uncertainty in departure time delay resulting in late takeoffs, second with uncertainty in flight times in addition to departure delays, and finally, uncertainty in departure times that cause either late or early takeoffs. Each of these simulations were performed using varied standard deviations to fully understand the effects of uncertainties. Results from these simulations were compared to a baseline simulation using the same parameters, but without any uncertainty. The results suggest that both safety and efficiency are significantly impacted by uncertainty even with relatively low uncertainty introduced. These results work towards quantifying the effects of uncertainty in flight scheduling for UAM. They will also aid in the further development of the demand capacity balancing algorithms for UAM operations and associated air traffic management.

Urban Air Mobility↗
NASA NTRS1995

Calculation of surface and top of atmosphere radiative fluxes from physical quantities based on ISCCP data sets. 1: Method and sensitivity to input data uncertainties

The largest uncertainty in upwelling shortwave (SW) fluxes (approximately equal 10-15 W/m(exp 2), regional daily mean) is caused by uncertainties in land surface albedo, whereas the largest uncertainty in downwelling SW at the surface (approximately equal 5-10 W/m(exp 2), regional daily mean) is related to cloud detection errors. The uncertainty of upwelling longwave (LW) fluxes (approximately 10-20 W/m(exp 2), regional daily mean) depends on the accuracy of the surface temperature for the surface LW fluxes and the atmospheric temperature for the top of atmosphere LW fluxes. The dominant source of uncertainty is downwelling LW fluxes at the surface (approximately equal 10-15 W/m(exp 2)) is uncertainty in atmospheric temperature and, secondarily, atmospheric humidity; clouds play little role except in the polar regions. The uncertainties of the individual flux components and the total net fluxes are largest over land (15-20 W/m(exp 2)) because of uncertainties in surface albedo (especially its spectral dependence) and surface temperature and emissivity (including its spectral dependence). Clouds are the most important modulator of the SW fluxes, but over land areas, uncertainties in net SW at the surface depend almost as much on uncertainties in surface albedo. Although atmospheric and surface temperature variations cause larger LW flux variations, the most notable feature of the net LW fluxes is the changing relative importance of clouds and water vapor with latitude. Uncertainty in individual flux values is dominated by sampling effects because of large natrual variations, but uncertainty in monthly mean fluxes is dominated by bias errors in the input quantities.

Zhang, Y.-C.↗
NASA NTRS2019

Assessing Uncertainties of a Geophysical Approach to Estimate Surface Fine Particulate Matter Distributions from Satellite-Observed Aerosol Optical Depth

Health impact analyses are increasingly tapping the broad spatial coverage of satellite aerosol optical depth (AOD) products to estimate human exposure to fine particulate matter (PM2.5). We use a forward geophysical approach to derive ground-level PM2.5 distributions from satellite AOD at 1 km2(exp) resolution for 2011 over the northeastern US by applying relationships between surface PM2.5 and column AOD (calculated offline from speciated mass distributions) from a regional air quality model (CMAQ; 12×12 km2(exp) horizontal resolution). Seasonal average satellite-derived PM2.5 reveals more spatial detail and best captures observed surface PM2.5 levels during summer. At the daily scale, however, satellite-derived PM2.5 is not only subject to measurement uncertainties from satellite instruments, but more importantly to uncertainties in the relationship between surface PM2.5 and column AOD. Using 11 ground-based AOD measurements within 10 km of surface PM2.5 monitors, we show that uncertainties in modeled PM2.5∕AOD can explain more than 70 % of the spatial and temporal variance in the total uncertainty in daily satellite-derived PM2.5 evaluated at PM2.5 monitors. This finding implies that a successful geophysical approach to deriving daily PM2.5 from satellite AOD requires model skill at capturing day-to-day variations in PM2.5∕AOD relationships. Overall, we estimate that uncertainties in the modeled PM2.5∕AOD lead to an error of 11 µg m−3(exp) in daily satellite-derived PM2.5, and uncertainties in satellite AOD lead to an error of 8 µg m−3(exp). Using multi-platform ground, airborne, and radiosonde measurements, we show that uncertainties of modeled PM2.5∕AOD are mainly driven by model uncertainties in aerosol column mass and speciation, while model representation of relative humidity and aerosol vertical profile shape contributes some systematic biases. The parameterization of aerosol optical properties, which determines the mass extinction efficiency, also contributes to random uncertainty, with the size distribution being the largest source of uncertainty and hygroscopicity of inorganic salt the second largest. Future efforts to reduce uncertainty in geophysical approaches to derive surface PM2.5 from satellite AOD would thus benefit from improving model representation of aerosol vertical distribution and aerosol optical properties, to narrow uncertainty in satellite-derived PM2.5.

aerosol optical depth↗
NASA NTRS2009

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗
NASA NTRS2012

Shock Layer Radiation Modeling and Uncertainty for Mars Entry

A model for simulating nonequilibrium radiation from Mars entry shock layers is presented. A new chemical kinetic rate model is developed that provides good agreement with recent EAST and X2 shock tube radiation measurements. This model includes a CO dissociation rate that is a factor of 13 larger than the rate used widely in previous models. Uncertainties in the proposed rates are assessed along with uncertainties in translational-vibrational relaxation modeling parameters. The stagnation point radiative flux uncertainty due to these flowfield modeling parameter uncertainties is computed to vary from 50 to 200% for a range of free-stream conditions, with densities ranging from 5e-5 to 5e-4 kg/m3 and velocities ranging from of 6.3 to 7.7 km/s. These conditions cover the range of anticipated peak radiative heating conditions for proposed hypersonic inflatable aerodynamic decelerators (HIADs). Modeling parameters for the radiative spectrum are compiled along with a non-Boltzmann rate model for the dominant radiating molecules, CO, CN, and C2. A method for treating non-local absorption in the non-Boltzmann model is developed, which is shown to result in up to a 50% increase in the radiative flux through absorption by the CO 4th Positive band. The sensitivity of the radiative flux to the radiation modeling parameters is presented and the uncertainty for each parameter is assessed. The stagnation point radiative flux uncertainty due to these radiation modeling parameter uncertainties is computed to vary from 18 to 167% for the considered range of free-stream conditions. The total radiative flux uncertainty is computed as the root sum square of the flowfield and radiation parametric uncertainties, which results in total uncertainties ranging from 50 to 260%. The main contributors to these significant uncertainties are the CO dissociation rate and the CO heavy-particle excitation rates. Applying the baseline flowfield and radiation models developed in this work, the radiative heating for the Mars Pathfinder probe is predicted to be nearly 20 W/cm2. In contrast to previous studies, this value is shown to be significant relative to the convective heating.

Johnston, Christopher O.↗
NASA NTRS2015

Sonic Boom Pressure Signature Uncertainty Calculation and Propagation to Ground Noise

The objective of this study was to outline an approach for the quantification of uncertainty in sonic boom measurements and to investigate the effect of various near-field uncertainty representation approaches on ground noise predictions. These approaches included a symmetric versus asymmetric uncertainty band representation and a dispersion technique based on a partial sum Fourier series that allows for the inclusion of random error sources in the uncertainty. The near-field uncertainty was propagated to the ground level, along with additional uncertainty in the propagation modeling. Estimates of perceived loudness were obtained for the various types of uncertainty representation in the near-field. Analyses were performed on three configurations of interest to the sonic boom community: the SEEB-ALR, the 69o DeltaWing, and the LM 1021-01. Results showed that representation of the near-field uncertainty plays a key role in ground noise predictions. Using a Fourier series based dispersion approach can double the amount of uncertainty in the ground noise compared to a pure bias representation. Compared to previous computational fluid dynamics results, uncertainty in ground noise predictions were greater when considering the near-field experimental uncertainty.

West, Thomas K., IV↗
NASA NTRS2016

Identifying and Analyzing Uncertainty Structures in the TRMM Microwave Imager Precipitation Product over Tropical Ocean Basins

Despite continuous improvements in microwave sensors and retrieval algorithms, our understanding of precipitation uncertainty is quite limited, due primarily to inconsistent findings in studies that compare satellite estimates to in situ observations over different parts of the world. This study seeks to characterize the temporal and spatial properties of uncertainty in the Tropical Rainfall Measuring Mission Microwave Imager surface rainfall product over tropical ocean basins. Two uncertainty analysis frameworks are introduced to qualitatively evaluate the properties of uncertainty under a hierarchy of spatiotemporal data resolutions. The first framework (i.e. 'climate method') demonstrates that, apart from random errors and regionally dependent biases, a large component of the overall precipitation uncertainty is manifested in cyclical patterns that are closely related to large-scale atmospheric modes of variability. By estimating the magnitudes of major uncertainty sources independently, the climate method is able to explain 45-88% of the monthly uncertainty variability. The percentage is largely resolution dependent (with the lowest percentage explained associated with a 1 deg x 1 deg spatial/1 month temporal resolution, and highest associated with a 3 deg x 3 deg spatial/3 month temporal resolution). The second framework (i.e. 'weather method') explains regional mean precipitation uncertainty as a summation of uncertainties associated with individual precipitation systems. By further assuming that self-similar recurring precipitation systems yield qualitatively comparable precipitation uncertainties, the weather method can consistently resolve about 50 % of the daily uncertainty variability, with only limited dependence on the regions of interest.

Climate↗
NASA NTRS2017

Accounting for Epistemic Uncertainty in Mission Supportability Assessment: A Necessary Step in Understanding Risk and Logistics Requirements

Future crewed missions to Mars present a maintenance logistics challenge that is unprecedented in human spaceflight. Mission endurance – defined as the time between resupply opportunities – will be significantly longer than previous missions, and therefore logistics planning horizons are longer and the impact of uncertainty is magnified. Maintenance logistics forecasting typically assumes that component failure rates are deterministically known and uses them to represent aleatory uncertainty, or uncertainty that is inherent to the process being examined. However, failure rates cannot be directly measured; rather, they are estimated based on similarity to other components or statistical analysis of observed failures. As a result, epistemic uncertainty – that is, uncertainty in knowledge of the process – exists in failure rate estimates that must be accounted for. Analyses that neglect epistemic uncertainty tend to significantly underestimate risk. Epistemic uncertainty can be reduced via operational experience; for example, the International Space Station (ISS) failure rate estimates are refined using a Bayesian update process. However, design changes may re-introduce epistemic uncertainty. Thus, there is a tradeoff between changing a design to reduce failure rates and operating a fixed design to reduce uncertainty. This paper examines the impact of epistemic uncertainty on maintenance logistics requirements for future Mars missions, using data from the ISS Environmental Control and Life Support System (ECLS) as a baseline for a case study. Sensitivity analyses are performed to investigate the impact of variations in failure rate estimates and epistemic uncertainty on spares mass. The results of these analyses and their implications for future system design and mission planning are discussed.

Owens, Andrew↗
NASA NTRS2024

Spectral Correlation in MODIS Water-Leaving Reflectance Retrieval Uncertainty

Spectral remote sensing reflectance, Rrs(λ) (sr−1), is the fundamental quantity used to derive a host of bio-optical and biogeochemical properties of the water column from satellite ocean color measurements. Estimation of uncertainty in those derived geophysical products is therefore dependent on knowledge of the uncertainty in satellite-retrieved R rs . Furthermore, since the associated algorithms require R rs at multiple spectral bands, the spectral (i.e., band-to-band)error covariance in R rs is needed to accurately estimate the uncertainty in those derived properties. This study establishes a derivative-based approach for propagating instrument random noise, instrument systematic uncertainty, and forward model uncertainty into R rs as retrieved using NASA’s multiple-scattering epsilon (MSEPS) atmospheric correction algorithm, to generate pixel-level error covariance in R rs . The approach is applied to measurements from Moderate Resolution Imaging Spectroradiometer (MODIS) on the Aqua satellite and verified using Monte Carlo (MC) analysis. We also make use of this full spectral error covariance in R rs to calculate uncertainty in phytoplankton pigment chlorophyll-a concentration (chl a , mg/m 3 ) and diffuse attenuation coefficient of downwelling irradiance at 490 nm (K d (490), m -1 ). Accounting for the error covariance in R rs generally reduces the estimated relative uncertainty in chl a by ∼1-2% (absolute value) in waters with chl a < 0.25 mg/m 3 where the color index (CI) algorithm is used. The reduction is ∼5-10% in waters with chl a > 0.35 mg/m 3 where the blue-green ratio (OCX) algorithm is used. Such reduction can be higher than 30% in some regions. For K d (490), the reduction by error covariance is generally ∼2%, but can be higher than 20% in some regions. The error covariance in R rs is further verified through forward-calculating chl a from MODIS-retrieved and in situ R rs and comparing estimated uncertainty with observed differences. An 8-day global composite of propagated uncertainty shows that the goal of 35% uncertainty in chl a can be achieved over deep ocean waters (chl a ≤ 0.1 mg/m3). While the derivative-based approach generates reasonable error covariance in R rs some assumptions should be updated as our knowledge improves. These include the inter-band error correlation in top-of-atmosphere reflectance, and uncertainties in the calibration of MODIS 869 nm band, in ancillary data, and in the in situ data used for system vicarious calibration.

Ocean color↗
NASA NTRS2022

Determining the Primary Sources of Uncertainty in Retrieval of Marine Remote Sensing Reflectance From Satellite Ocean Color Sensors

Uncertainties in the retrieval of the remote sensing reflectance, R_rs, from Ocean Color (OC) satellite sensors have a strong impact on the performance of algorithms for the estimation of chlorophyll-a, mineral concentrations, and inherent optical properties (IOPs). The uncertainties are highest in the blue bands. The total radiance measured at the top of the atmosphere captures the instantaneous state of the atmosphere-ocean system: the in-water conditions, sky and Sun glint reflected from the wind-roughened ocean surface, as well as light scattered from molecules and aerosols in the atmosphere. Each of these components has associated uncertainties, and when combined with the additional uncertainties from the instrument noise and the atmospheric correction process, they contribute to the total uncertainty budget for the retrieved R_rs. We analyzed the contribution of each component uncertainties to the total R_rs uncertainties in SNPP-VIIRS level 2 products, taking advantage of the spectral differences between the components. We examined multiple scenes in the open ocean and coastal waters at spatial resolutions ranging from 2250 to 5250 m by comparing the retrieved R_rs to in situ measurements made at several AERONET-OC sites and at the MOBY site. It was shown that uncertainties associated with the molecular (Rayleigh) scattering play the most significant role, while the contributions of other components are usually smaller. Uncertainties in Rayleigh scattering are primarily attributed to the variability of Rayleigh optical thickness (ROT) with a standard deviation of approximately 1.5% of ROT, which can largely explain the frequency of negative R_rs retrievals as observed using the current standard atmospheric correction process employed by NASA. Variability of the sky light reflected from the ocean surface in some conditions also contributed to uncertainties in the blue; water variability proportional to R_rs had a very pronounced peak in the green at coastal sites.

remote sensing reflectance↗
NASA NTRSDate not supplied

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗
NASA NTRS1999

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗
NASA NTRS2008

Tolerance and UQ4SIM: Nimble Uncertainty Documentation and Analysis Software

Ultimately, scientific numerical models need quantified output uncertainties so that modeling can evolve to better match reality. Documenting model input uncertainties and variabilities is a necessary first step toward that goal. Without known input parameter uncertainties, model sensitivities are all one can determine, and without code verification, output uncertainties are simply not reliable. The basic premise of uncertainty markup is to craft a tolerance and tagging mini-language that offers a natural, unobtrusive presentation and does not depend on parsing each type of input file format. Each file is marked up with tolerances and optionally, associated tags that serve to label the parameters and their uncertainties. The evolution of such a language, often called a Domain Specific Language or DSL, is given in [1], but in final form it parallels tolerances specified on an engineering drawing, e.g., 1 +/- 0.5, 5 +/- 10%, 2 +/- 10 where % signifies percent and o signifies order of magnitude. Tags, necessary for error propagation, can be added by placing a quotation-mark-delimited tag after the tolerance, e.g., 0.7 +/- 20% 'T_effective'. In addition, tolerances might have different underlying distributions, e.g., Uniform, Normal, or Triangular, or the tolerances may merely be intervals due to lack of knowledge (uncertainty). Finally, to address pragmatic considerations such as older models that require specific number-field formats, C-style format specifiers can be appended to the tolerance like so, 1.35 +/- 10U_3.2f. As an example of use, consider figure 1, where a chemical reaction input file is has been marked up to include tolerances and tags per table 1. Not only does the technique provide a natural method of specifying tolerances, but it also servers as in situ documentation of model uncertainties. This tolerance language comes with a utility to strip the tolerances (and tags), to provide a path to the nominal model parameter file. And, as shown in [1], having the ability to quickly mark and identify model parameter uncertainties facilitates error propagation, which in turn yield output uncertainties.

Kleb, Bil↗
NASA NTRS2008

Uncertainty Analysis of Air Radiation for Lunar Return Shock Layers

By leveraging a new uncertainty markup technique, two risk analysis methods are used to compute the uncertainty of lunar-return shock layer radiation predicted by the High temperature Aerothermodynamic Radiation Algorithm (HARA). The effects of epistemic uncertainty, or uncertainty due to a lack of knowledge, is considered for the following modeling parameters: atomic line oscillator strengths, atomic line Stark broadening widths, atomic photoionization cross sections, negative ion photodetachment cross sections, molecular bands oscillator strengths, and electron impact excitation rates. First, a simplified shock layer problem consisting of two constant-property equilibrium layers is considered. The results of this simplified problem show that the atomic nitrogen oscillator strengths and Stark broadening widths in both the vacuum ultraviolet and infrared spectral regions, along with the negative ion continuum, are the dominant uncertainty contributors. Next, three variable property stagnation-line shock layer cases are analyzed: a typical lunar return case and two Fire II cases. For the near-equilibrium lunar return and Fire 1643-second cases, the resulting uncertainties are very similar to the simplified case. Conversely, the relatively nonequilibrium 1636-second case shows significantly larger influence from electron impact excitation rates of both atoms and molecules. For all cases, the total uncertainty in radiative heat flux to the wall due to epistemic uncertainty in modeling parameters is 30% as opposed to the erroneously-small uncertainty levels (plus or minus 6%) found when treating model parameter uncertainties as aleatory (due to chance) instead of epistemic (due to lack of knowledge).

Kleb, Bil↗
NASA NTRS2010

Transfer of Satellite Rainfall Uncertainty from Gauged to Ungauged Regions at Regional and Seasonal Timescales

Hydrologists and other users need to know the uncertainty of the satellite rainfall data sets across the range of time/space scales over the whole domain of the data set. Here, uncertainty' refers to the general concept of the deviation' of an estimate from the reference (or ground truth) where the deviation may be defined in multiple ways. This uncertainty information can provide insight to the user on the realistic limits of utility, such as hydrologic predictability, that can be achieved with these satellite rainfall data sets. However, satellite rainfall uncertainty estimation requires ground validation (GV) precipitation data. On the other hand, satellite data will be most useful over regions that lack GV data, for example developing countries. This paper addresses the open issues for developing an appropriate uncertainty transfer scheme that can routinely estimate various uncertainty metrics across the globe by leveraging a combination of spatially-dense GV data and temporally sparse surrogate (or proxy) GV data, such as the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar and the Global Precipitation Measurement (GPM) mission Dual-Frequency Precipitation Radar. The TRMM Multi-satellite Precipitation Analysis (TMPA) products over the US spanning a record of 6 years are used as a representative example of satellite rainfall. It is shown that there exists a quantifiable spatial structure in the uncertainty of satellite data for spatial interpolation. Probabilistic analysis of sampling offered by the existing constellation of passive microwave sensors indicate that transfer of uncertainty for hydrologic applications may be effective at daily time scales or higher during the GPM era. Finally, a commonly used spatial interpolation technique (kriging), that leverages the spatial correlation of estimation uncertainty, is assessed at climatologic, seasonal, monthly and weekly timescales. It is found that the effectiveness of kriging is sensitive to the type of uncertainty metric, time scale of transfer and the density of GV data within the transfer domain. Transfer accuracy is lowest at weekly timescales with the error doubling from monthly to weekly.However, at very low GV data density (<20% of the domain), the transfer accuracy is too low to show any distinction as a function of the timescale of transfer.

Tang, Ling↗