Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

GCR Environmental Models III: GCR Model Validation and Propagated Uncertainties in Effective Dose

This is the last of three papers focused on quantifying the uncertainty associated with galactic cosmic rays (GCR) models used for space radiation shielding applications. In the first paper, it was found that GCR ions with Z>2 and boundary energy below 500 MeV/nucleon induce less than 5% of the total effective dose behind shielding. This is an important finding since GCR model development and validation have been heavily biased toward Advanced Composition Explorer/Cosmic Ray Isotope Spectrometer measurements below 500 MeV/nucleon. Weights were also developed that quantify the relative contribution of defined GCR energy and charge groups to effective dose behind shielding. In the second paper, it was shown that these weights could be used to efficiently propagate GCR model uncertainties into effective dose behind shielding. In this work, uncertainties are quantified for a few commonly used GCR models. A validation metric is developed that accounts for measurements uncertainty, and the metric is coupled to the fast uncertainty propagation method. For this work, the Badhwar-O'Neill (BON) 2010 and 2011 and the Matthia GCR models are compared to an extensive measurement database. It is shown that BON2011 systematically overestimates heavy ion fluxes in the range 0.5-4 GeV/nucleon. The BON2010 and BON2011 also show moderate and large errors in reproducing past solar activity near the 2000 solar maximum and 2010 solar minimum. It is found that all three models induce relative errors in effective dose in the interval [-20%, 20%] at a 68% confidence level. The BON2010 and Matthia models are found to have similar overall uncertainty estimates and are preferred for space radiation shielding applications.

Slaba, Tony C.↗
NASA NTRS2014

Combined Uncertainty and A-Posteriori Error Bound Estimates for General CFD Calculations: Theory and Software Implementation

This workshop presentation discusses the design and implementation of numerical methods for the quantification of statistical uncertainty, including a-posteriori error bounds, for output quantities computed using CFD methods. Hydrodynamic realizations often contain numerical error arising from finite-dimensional approximation (e.g. numerical methods using grids, basis functions, particles) and statistical uncertainty arising from incomplete information and/or statistical characterization of model parameters and random fields. The first task at hand is to derive formal error bounds for statistics given realizations containing finite-dimensional numerical error [1]. The error in computed output statistics contains contributions from both realization error and the error resulting from the calculation of statistics integrals using a numerical method. A second task is to devise computable a-posteriori error bounds by numerically approximating all terms arising in the error bound estimates. For the same reason that CFD calculations including error bounds but omitting uncertainty modeling are only of limited value, CFD calculations including uncertainty modeling but omitting error bounds are only of limited value. To gain maximum value from CFD calculations, a general software package for uncertainty quantification with quantified error bounds has been developed at NASA. The package provides implementations for a suite of numerical methods used in uncertainty quantification: Dense tensorization basis methods [3] and a subscale recovery variant [1] for non-smooth data, Sparse tensorization methods[2] utilizing node-nested hierarchies, Sampling methods[4] for high-dimensional random variable spaces.

CFD↗
NASA NTRS2013

Uncertainty in Simulating Wheat Yields Under Climate Change

Projections of climate change impacts on crop yields are inherently uncertain1. Uncertainty is often quantified when projecting future greenhouse gas emissions and their influence on climate2. However, multi-model uncertainty analysis of crop responses to climate change is rare because systematic and objective comparisons among process-based crop simulation models1,3 are difficult4. Here we present the largest standardized model intercomparison for climate change impacts so far. We found that individual crop models are able to simulate measured wheat grain yields accurately under a range of environments, particularly if the input information is sufficient. However, simulated climate change impacts vary across models owing to differences in model structures and parameter values. A greater proportion of the uncertainty in climate change impact projections was due to variations among crop models than to variations among downscaled general circulation models. Uncertainties in simulated impacts increased with CO2 concentrations and associated warming. These impact uncertainties can be reduced by improving temperature and CO2 relationships in models and better quantified through use of multi-model ensembles. Less uncertainty in describing how climate change may affect agricultural productivity will aid adaptation strategy development and policymaking.

exhaust gases↗
NASA NTRS2014

Surface Nitrification: A Major Uncertainty in Marine N2O Emissions

The ocean is responsible for up to a third of total global nitrous oxide (N2O) emissions, but uncertainties in emission rates of this potent greenhouse gas are high (approaching 100%). Here we use a marine biogeochemical model to assess six major uncertainties in estimates of N2O production, thereby providing guidance in how future studies may most effectively reduce uncertainties in current and future marine N2O emissions. Potential surface N2O production from nitrification causes the largest uncertainty in N2O emissions (estimated up to approximately 1.6 Tg N/yr (sup -1) or 48% of modeled values), followed by the unknown oxygen concentration at which N2O production switches to N2O consumption (0.8 Tg N/yr (sup -1)or 24% of modeled values). Other uncertainties are minor, cumulatively changing regional emissions by less than 15%. If production of N2O by surface nitrification could be ruled out in future studies, uncertainties in marine N2O emissions would be halved.

N2O↗
NASA NTRS2015

Uncertainty in Twenty-First-Century CMIP5 Sea Level Projections

The representative concentration pathway (RCP) simulations included in phase 5 of the Coupled Model Intercomparison Project (CMIP5) quantify the response of the climate system to different natural and anthropogenic forcing scenarios. These simulations differ because of 1) forcing, 2) the representation of the climate system in atmosphere-ocean general circulation models (AOGCMs), and 3) the presence of unforced (internal) variability. Global and local sea level rise projections derived from these simulations, and the emergence of distinct responses to the four RCPs depend on the relative magnitude of these sources of uncertainty at different lead times. Here, the uncertainty in CMIP5 projections of sea level is partitioned at global and local scales, using a 164-member ensemble of twenty-first-century simulations. Local projections at New York City (NYSL) are highlighted. The partition between model uncertainty, scenario uncertainty, and internal variability in global mean sea level (GMSL) is qualitatively consistent with that of surface air temperature, with model uncertainty dominant for most of the twenty-first century. Locally, model uncertainty is dominant through 2100, with maxima in the North Atlantic and the Arctic Ocean. The model spread is driven largely by 4 of the 16 AOGCMs in the ensemble; these models exhibit outlying behavior in all RCPs and in both GMSL and NYSL. The magnitude of internal variability varies widely by location and across models, leading to differences of several decades in the local emergence of RCPs. The AOGCM spread, and its sensitivity to model exclusion and/or weighting, has important implications for sea level assessments, especially if a local risk management approach is utilized.

Variability↗
NASA NTRS2017

What is the Uncertainty in MODIS Aerosol Optical Depth in the Vicinity of Clouds?

MODIS dark-target (DT) algorithm retrieves aerosol optical depth (AOD) using a Look Up Table (LUT) approach. Global comparison of AOD (Collection 6 ) with ground-based sun photometer gives an Estimated Error (EE) of +/-(0.04 + 10%) over ocean. However, EE does not represent per-retrieval uncertainty. For retrievals that are biased high compared to AERONET, here we aim to closely examine the contribution of biases due to presence of clouds and per-pixel retrieval uncertainty. We have characterized AOD uncertainty at 550 nm, due to standard deviation of reflectance in 10 km retrieval region, uncertainty related to gas (H2O, O3) absorption, surface albedo, and aerosol models. The uncertainty in retrieved AOD seems to lie within the estimated over ocean error envelope of +/-(0.03+10%). Regions between broken clouds tend to have higher uncertainty. Compared to C6 AOD, a retrieval omitting observations in the vicinity of clouds (< or = 1 km) is biased by about +/- 0.05. For homogeneous aerosol distribution, clear sky retrievals show near zero bias. Close look at per-pixel reflectance histograms suggests retrieval possibility using median reflectance values.

Patadia, Falguni↗
NASA NTRS2017

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗
NASA NTRS2017

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗
NASA NTRS2020

Calibration Probe Uncertainty and Validation for the Hypersonic Material Environmental Test System

This paper presents an uncertainty analysis of the stagnation-point calibration probe surface predictions for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System facility located at NASA Langley Research Center. A second-order stochastic expansion was constructed over 47 uncertain parameters to evaluate the sensitivities, identify the most significant uncertain variables, and quantify the uncertainty in the stagnation-point heat flux and pressure predictions of the calibration probe for a low- and high-enthalpy test condition. A sensitivity analysis showed that measurement bias uncertainty is the most significant contributor to the stagnation-point pressure and heat flux variance for the low-enthalpy condition. For the high-enthalpy condition, a paradigm shift in sensitivities revealed the computational fluid dynamics model input uncertainty as the main contributor. A comparison between the prediction and measurement of the stagnation-point conditions under uncertainty showed that there was evidence of statistical disagreement. A validation metric was proposed and applied to the prediction uncertainty to account for the statistical disagreement when compared to the possible stagnation-point heat flux and pressure measurements.

Brune, Andrew J.↗
NASA NTRS2022

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.

Hydrology↗
NASA NTRS2022

Ames-2021 CO 2 Dipole Moment Surface and IR Line Lists: Toward 0.1% Uncertainty for CO 2 IR Intensities

A highly accurate CO 2 ab initio dipole moment surface (DMS), Ames-2021, is reported along with 12 C 16 O 2 infrared (IR) intensity comparisons approaching a 1–4‰ level of agreement and uncertainty. The Ames-2021 DMS was accurately fitted from CCSD(T) finite-field dipoles computed with the aug-cc-pVXZ (X = T, Q, 5) basis for C atom and the d-aug-cc-pVXZ (X = T, Q, 5) basis for O atoms, and extrapolated to the one particle basis set limit. Fitting σ(rms) is 3.8 × 10^(–7) au for 4443 geometries below 15 000 per cm . The corresponding IR intensity, S Ames-2021 , are computed using the Ames-2 potential energy surface (PES), which is the best PES available for CO 2 . Compared to high accuracy IR studies for 2001i–00001 and 3001i–00001 bands, S Ames-2021 matches NIST experiment-based intensities [S NIST-HIT16 or S HIT20 ] to −1.0 ± 1.3‰, or matches DLR experiment-based intensities [S DLR-HIT16/UCL/Ames ] to 1.9 ± 3.7‰. This indicates the systematic deviations and uncertainties have been significantly reduced in S Ames-2021 . The S UCL2015 (or S HITRAN2016 ) have larger deviations (vs S DLR ) and uncertainties (vs S DLR , S NIST ) which are attributed to the less accurate Ames-1 PES adopted in UCL-296 line list calculation. The S Ames-2021 intensity of 12 C 16 O 2 and 13 C 16 O 2 is utilized to derive new absolute 13 C/ 12 C ratios for Vienna PeeDee Belemnite (VPDB) with uncertainty reduced by 1/3 or 2/3. Further evaluation of S Ames-2021 are carried out on those CO 2 bands discussed in the HITRAN2020 update paper. Consistent improvements and better accuracies are found in band-by-band analysis, except for those bands strongly affected by Coriolis couplings, or very weak bands measured with relatively larger experimental uncertainties. The Ames-2021 296 K IR line lists are generated for 13 CO 2 isotopologues, with 18,000 per and S 296K > 1E–31) cm/molecule cutoff and then combined with CDSD line positions (except 14 C 16 O 2 ). The Ames-2021 DMS and 296 K IR line lists represent a major improvement over previous CO 2 theoretical IR intensity studies, including Ames-2016, UCL-296, and recent UCL DMS 2021 update. A real 1 permille level of agreement and uncertainty will definitely require both more accurate PES and more accurate DMS.

Chemical calculations↗
NASA NTRS2021

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗
NASA NTRS2023

Reducing Aerosol Forcing Uncertainty by Combining Models With Satellite and Within-The-Atmosphere Observations: A Three-Way Street

Aerosol forcing uncertainty represents the largest climate forcing uncertainty overall. Its magnitude has remained virtually undiminished over the past 20 years despite considerable advances in understanding most of the key contributing elements. Recent work has produced modest increases only in the confidence of the uncertainty estimate itself. This review summarizes the contributions toward reducing the uncertainty in the aerosol forcing of climate made by satellite observations, measurements taken within the atmosphere, as well as modeling and data assimilation. We adopt a more measurement-oriented perspective than most reviews of the subject in assessing the strengths and limitations of each; gaps and possible ways to fill them are considered. Currently planned programs supporting advanced, global-scale satellite and surface-based aerosol, cloud, and precursor gas observations, climate modeling, and intensive field campaigns aimed at characterizing the underlying physical and chemical processes involved, are all essential. But in addition, new efforts are needed: (a) to obtain systematic aircraft in situ measurements capturing the multi-variate probability distribution functions of particle optical, microphysical, and chemical properties (and associated uncertainty estimates), as well as co-variability with meteorology, for the major aerosol airmass types; (b) to conceive, develop, and implement a suborbital (aircraft plus surface-based) program aimed at systematically quantifying the cloud-scale microphysics, cloud optical properties, and cloud-related vertical velocities associated with aerosol-cloud interactions; and (c) to focus much more research on integrating the unique contributions of satellite observations, suborbital measurements, and modeling, to reduce the persistent uncertainty in aerosol climate forcing.

aerosol climate forcing↗
NASA NTRS2023

Understanding Volume Estimation Uncertainty of Lakes and Wetlands Using Satellites and Citizen Science

We studied variations in the volume of water stored in small lakes and wetlands using satellite remote sensing and lake water height data contributed by citizen scientists. A total of 94 water bodies across the globe were studied using satellite data in the optical and microwave wavelengths from Landsat 8, Sentinel-1, and Sentinel-2. The uncertainty in volume estimation as a function of geography and geophysical factors, such as cloud cover, precipitation, and water surface temperature, was studied. The key finding that emerged from this global study is that uncertainty is highest in regions with a distinct precipitation season, such as in the monsoon dominated South Asia or the Pacific Northwestern region of the USA. This uncertainty is further compounded when small lakes and wetlands are seasonal with alternating land use as a water body and agricultural land, such as the wetlands of Northeastern Bangladesh. On an average, 45% of studied lakes could be estimated of their volume change with a statistical significant uncertainty that is less than the expected volume in South Asia. In North America, this statistically significant uncertainty in volume estimation was found to be around 50% in lakes eastward of the 108th meridian with lowest uncertainty found in lakes along the East coast of the USA. The article provides a baseline for understanding the current state of the art in estimating volumetric change of lakes and wetlands using citizen science in anticipation of the recently launched Surface Water and Ocean Topography Mission.

Shahzaib Khan↗
NASA NTRS2024

Uncertainty Budget for Detector-Based Absolute Radiometric Calibration With GLAMR

The accuracy of the absolute radiometric calibration (RadCal) for remote sensing instruments is essential to their wide range of applications. The uncertainty associated to the traditional source-based RadCal method is assessed at a 2% (k=1) or higher level for radiance measurement. To further improve the accuracy to meet the demands of climate studies, a detector-based approach using tunable lasers as a light source has been devised. The Goddard Laser for Absolute Measurement of Radiance, known as the GLAMR system, is a notable example of the incorporation of such technology. Using transfer radiometers calibrated at NIST as calibration standards, the absolute spectral response (ASR) function of a remote sensing instrument is measured with its uncertainty traceable to the International System of Units. This paper presents a comprehensive uncertainty analysis of the detector-based absolute RadCal using the GLAMR system. It identifies and examines uncertainty sources during the GLAMR RadCal test, including those from the GLAMR system, the testing configuration, and data processing methodologies. Analysis is carried out to quantify the contribution of each source and emphasize the most influential factors. It is shown that the calibration uncertainty of GLAMR RadCal can be better than 0.3% (k=1) in the wavelength range of 350-950 nm and 0.6% (k=1) between 950-2300 nm, with the exception of regions with strong water absorption. In addition, recommendations are made to refine the calibration process to further reduce the uncertainty.

Zhipeng Wang↗
NASA NTRSDate not supplied

Uncertainty Quantification Methodology for Sonic Boom Loudness of a Low-Boom Supersonic Concept

This paper presents a comprehensive analysis of uncertainty quantification for sonic boom loudness metrics associated with the X-59 aircraft during its acoustic validation phase. The study focuses on employing advanced methodologies to characterize uncertainties in key sonic boom parameters predicted from a database derived from a computational fluid dynamics (CFD) solver. These methodologies include creating a polynomial chaos expansion (PCE) surrogate model, which is then used to run a Monte Carlo analysis to obtain 95% uncertainty intervals for sonic boom loudness parameters across the full carpet. Atmospheric uncertainties are rigorously considered, leveraging weather models based on historical data near Edwards Air Force Base to simulate potential flight conditions. The findings include preliminary uncertainty results for the full carpet during the validation phase of the Quesst mission. Additionally, a sensitivity study reveals that the primary sources of uncertainty are humidity and cruise weight.

Laura M. White↗
NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design

UQ↗
NASA NTRSDate not supplied

Copula-based Method to Generate Consistent Surface Pressures Under Uncertainty

This paper establishes a method to create surface pressure databases that allow for uncertainty quantification. Aerodynamic databases are critical products for launch vehicles and other aeronautical systems, and surface pressure databases are one such database that constains large quantities of data. The focus of this work is the relationship between the integrated force and moment data base and the surface pressure database. In particular, the work attempts to provide a method that maintains consistency between these two databases when accounting for uncertainty. The integrated force and moment database and surface pressure databases are constructed from CFD data which is high-density but low-trust. However, the force and moment database will often also include data from high-trust but low-density sources such as from wind tunnel experiments. This means that the quantified uncertainty of the force and moment database is higher quality as it includes this high fidelity wind tunnel data. This motivates the idea to use the force and moment database uncertainty when constructing the surface pressure database uncertainty. The method utilizes the statistical idea of a copula in order to generate surface pressures that match with uncertain integrated force and moment distributions as well as being consistent with known CFD data. This statistical consistency is quantified by using the Maximum Mean Discrepancy two-sample test. The predictive error of the method is also approximated using leave-one-out error estimation and the good overall performance of the method is presented using probability boxes in a simulated uncertainty scenario.

SLS↗