Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty Propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Propagation of experimental uncertainties from the tunnel to the body coordinate system in 3-D LDV flow field studies

An analysis of experimental laser Doppler velocimetry (LDV) data uncertainties that propagate from measurements in the tunnel coordinate system to results in the model system are provided. Calculations of uncertainties as functions of the variables that comprise the final result requires assessment of the contribution each variable makes. Such an analysis enables and necessitates the experimentalists to identify and address the contributing error sources in the experimental measurement system. This provides an opportunity to improve the quality of data derived from experimental systems. This is especially important in experiments where small changes in test conditions are expected to produce small, detectable changes in results. In addition, the need for high-quality experimental data for CFD method validation demands a thorough assessment of experimental uncertainty. Transforming from one Cartesian coordinate system to another by three sequential rotations, equations were developed to transform the variables initially obtained in the original coordinates into variables in the final coordinate system. Based on the transformation equations, propagation equations for errors in the experimentally-derived flow quantities were derived for a model at angle of attack. Experimental uncertainties were then propagated from the tunnel coordinate system into the model system.

Neuhart, Dan H.↗
NASA NTRSDate not supplied

Fast and Precise Trajectory Simulation for Entry, Descent, and Landing Using A Multi-Model Monte Carlo Approach

Predicting landing radius and other quantities of interest (QoI) for entry, descent, and landing (EDL) applications requires a viable uncertainty propagation method for quantifying the impact of uncertainties in wind pattern variations, atmospheric uncertainties, etc. While standard MC simulation is the defacto standard for providing robust and unbiased predictions,it is often infeasible for expensive, high-fidelity EDL models. Low-fidelity models are commonly constructed to replace the high-fidelity model in MC simulation for computational speedup,but at the expense of accuracy and unbiasedness. Emerging multi-model MC methods are bridging this gap by combining predictions from two or more models of varying fidelity and computational cost for efficient and unbiased uncertainty propagation. This work explores the use of multi-model MC for increasing the speed and precision of trajectory simulation for EDL. It is shown that combining a high-fidelity EDL model with low-fidelity models (e.g,data-driven, reduced physics) yields substantial computational speedup versus standard MCwith only the high-fidelity model. Moreover, the unbiasedness of multi-model MC predictions is highlighted by showing increased accuracy versus an approach that leverages a low-fidelity surrogate model alone.

James E. Warner↗
NASA NTRS2018

Realistic Covariance Generation for the GPM Spacecraft

We present several different methods for generating realistic predictive covariance, including Monte-Carlo simulations and more direct linear methods which require the addition of process noise. The Monte-Carlo simulation starts with an epoch uncertainty sample basis and propagates each trial to a time of interest in the future. The variance-covariance of the state elements as well as other higher order sample statistics can be readily computed from the propagated sample. While this method preserves the nonlinear effects on the propagated uncertainty, it is computationally intensive as a statistically significant sample size must be considered in the propagation process. Moreover, if the epoch covariance is optimistic, this can result in an underestimation of the prediction error. Another method is to propagate a state sensitivity matrix simultaneously with the satellite state, which allows the epoch covariances to be propagated forward in a linear fashion. This method does not preserve the non-linearity of the satellite state uncertainty but is much less computationally intensive. The propagated state covariance is the scaled to represent the realistic level of GPM state uncertainty via a "e-tuning process." The tuning process generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Difference tuning strategies are considered and compared via Goodness-of-Fit method testing for the Gaussian properties of the scaled covariance.

prediction error↗
NASA NTRS2012

A Statistics-Based Material Property Analysis to Support TPS Characterization

Accurate characterization of entry capsule heat shield material properties is a critical component in modeling and simulating Thermal Protection System (TPS) response in a prescribed aerothermal environment. The thermal decomposition of the TPS material during the pyrolysis and charring processes is poorly characterized and typically results in large uncertainties in material properties as inputs for ablation models. These material property uncertainties contribute to large design margins on flight systems and cloud re- construction efforts for data collected during flight and ground testing, making revision to existing models for entry systems more challenging. The analysis presented in this work quantifies how material property uncertainties propagate through an ablation model and guides an experimental test regimen aimed at reducing these uncertainties and characterizing the dependencies between properties in the virgin and charred states for a Phenolic Impregnated Carbon Ablator (PICA) based TPS. A sensitivity analysis identifies how the high-fidelity model behaves in the expected flight environment, while a Monte Carlo based uncertainty propagation strategy is used to quantify the expected spread in the in-depth temperature response of the TPS. An examination of how perturbations to the input probability density functions affect output temperature statistics is accomplished using a Kriging response surface of the high-fidelity model. Simulations are based on capsule configuration and aerothermal environments expected during the Mars Science Laboratory (MSL) entry sequence. We identify and rank primary sources of uncertainty from material properties in a flight-relevant environment, show the dependence on spatial orientation and in-depth location on those uncertainty contributors, and quantify how sensitive the expected results are.

Copeland, Sean R.↗
NASA NTRS2016

Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A detailed description of the Monte Carlo method as applied for this analysis is provided. Detailed uncertainty results for the uncertainty in average free stream Mach number as well as other variables of interest are provided. All results are presented as random (variation in observed values about a true value), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty. The largest sources contributing to uncertainty are determined and potential improvement opportunities for the facility are investigated.

Error↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
NASA NTRSDate not supplied

Uncertainty Quantification of Expected Time-of-Arrival in UAV Flight Trajectory

One of the foremost requirements for accurate in-flight safety monitoring of autonomous unmanned aerial vehicles (UAVs) is tracking of their flight trajectory. Existing UAVs leverage autonomous flight functionalities based on trajectory generation algorithms developed in robotic applications such as polynomial or spline curves in order to facilitate kinematic smoothness, minimum vibrations and fuel efficiency. However in practice, the actual path may be subjected to unexpected local weather conditions, unexpected obstacles along the path or abrupt traffic changes in the low-altitude airspace resulting in large errors of the predicted time-of-arrival at way-points. In this study, an approach to quantify and propagate uncertainty in 4D trajectories is proposed. The paper presents a simple error interval propagation method based on the expected cruise speed of the UAV and its associated uncertainty. The uncertainty is then propagated in time to estimate reasonable confidence intervals on the times-of-arrival of the vehicle at each way-point as well as along the entire flight-path. The uncertainty propagation is demonstrated on a state-of-the-art trajectory generation algorithm based on non-uniform rational B-spline (NURBS) curves. Further, the effect of a stationary wind field is incorporated in the uncertainty propagation approach. The proposed method is implemented on synthetic and real data obtained from flight experiments with a small UAV.

Uncertainty Quantification↗
NASA NTRS2005

Instrument Drift Uncertainties and the Long-Term TOMS/SBUV Total Ozone Record

Long-term climate records from satellites are often constructed from the measurements of a sequence of instruments launched at different times. Each of these instruments is calibrated prior to launch. After launch they are subjected to potential offsets and slow drifts in calibration. We illustrate these issues in the construction of a merged total ozone record from two TOMS and three SBUV instruments. This record extends from late 1978 through the present. The question is "How good are these records?". We have examined the uncertainty in determining the relative calibration of two instruments during an overlap period in their measurements. When comparing a TOMS instrument, such as that on Nimbus 7, with an SBUV instrument, also on Nimbus 7, we find systematic differences and random differences. We have combined these findings with estimates of individual instrument drift into a monte- carlo uncertainty propagation model. We estimate an instrument drift uncertainty of a little larger than 1 percent per decade over the 25-year history of the TOMS/SBUV measurements. We make an independent estimate of the drift uncertainty in the ground-based network of total ozone measurements and find it to be of similar, but slightly smaller magnitude. The implications of these uncertainties for trend and recovery determination will be discussed.

Solarski, Richard S.↗
NASA NTRSDate not supplied

Multi-Model Monte Carlo Estimators for Trajectory Simulation

Predicting landing radius and other quantities of interest (QoI) for entry, descent, andlanding (EDL) applications requires a viable uncertainty propagation method for quantifying the impact of uncertainties in aerodynamics, atmosphere, mass properties, etc. While standard Monte Carlo (MC) simulation is the de facto standard for producing robust and unbiasedstatistical estimators, it is often infeasible for expensive, high-fidelity models. Low-fidelity models are commonly constructed to replace the high-fidelity model in MC simulation for computational speedup, but at the expense of accuracy and unbiasedness. Emerging multi-model MC methods are bridging this gap by combining predictions from two or more modelsof varying fidelity and computational cost for efficient and unbiased uncertainty propagation.This works establishes a proof of concept for using multi-model MC to increase the speed and precision of trajectory simulation for EDL. It is shown that combining a high-fidelity EDL model with low-fidelity models (e.g., data-driven, reduced physics) in this manner has the potential to yield significant efficiency and accuracy gains for certain EDL QoIs versusa standard MC approach. Moreover, the unbiasedness of multi-model MC predictions ishighlighted by showing increased accuracy versus an approach that leverages a low-fidelity model alone.

James E Warner↗
NASA NTRS2015

Sonic Boom Pressure Signature Uncertainty Calculation and Propagation to Ground Noise

The objective of this study was to outline an approach for the quantification of uncertainty in sonic boom measurements and to investigate the effect of various near-field uncertainty representation approaches on ground noise predictions. These approaches included a symmetric versus asymmetric uncertainty band representation and a dispersion technique based on a partial sum Fourier series that allows for the inclusion of random error sources in the uncertainty. The near-field uncertainty was propagated to the ground level, along with additional uncertainty in the propagation modeling. Estimates of perceived loudness were obtained for the various types of uncertainty representation in the near-field. Analyses were performed on three configurations of interest to the sonic boom community: the SEEB-ALR, the 69o DeltaWing, and the LM 1021-01. Results showed that representation of the near-field uncertainty plays a key role in ground noise predictions. Using a Fourier series based dispersion approach can double the amount of uncertainty in the ground noise compared to a pure bias representation. Compared to previous computational fluid dynamics results, uncertainty in ground noise predictions were greater when considering the near-field experimental uncertainty.

West, Thomas K., IV↗
NASA NTRS2019

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗
NASA NTRS2017

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗
NASA NTRS2023

Uncertainty Analysis of the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel 2019 Characterization Test 14-Foot, 5.8 Percent Test Section Porosity

This paper presents methods and results of a measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The uncertainty analysis is based on data collected during a characterization test following major structural modifications to the facility and upgrades to the facility’s data and control systems. The statistical methods and engineering judgments used to estimate elemental uncertainties are described in this report. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A description of the Monte Carlo method as applied for this analysis is provided. The primary variable of interest (VOI) for this facility is free stream Mach number. In addition to determining the uncertainty in Mach number, the uncertainty in free stream values of static pressure, total pressure, dynamic pressure, total temperature, static temperature, Reynolds number, and air speed were also calculated. Uncertainty results are presented as random (unpredictable variation in repeated measurements), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty for Mach number. Systematic uncertainty results are presented for the other VOIs. Individual uncertainty sources are presented both dimensionally and as percent contributions to uncertainty in all VOIs, to aid in the identification of primary uncertainty sources.

Uncertainty Analysis↗
NASA NTRSDate not supplied

A NASA GISTEMP Observational Uncertainty Ensemble: Regional and Monthly Uncertainty

The historical global temperature record is an essential data product for quantifying the variability and change of the Earth system. In recent years, better characterization of observational uncertainty in global and hemispheric trends has become available, but the methodologies are not necessarily applicable to analyses at smaller regional areas, or monthly means, where station sparsity and other systematic issues contribute to greater uncertainty. This work details a gridded uncertainty ensemble of historical temperature anomalies from the Goddard Institute for Space Studies (GISS) Surface Temperature product (GISTEMP) product. This ensemble characterizes the complex spatial and temporal correlation structure of uncertainty in gridded historical temperature, enabling proper uncertainty propagation for climate and social science at regional and monthly scales. This work details the methodology for generating the uncertainty ensemble, key statistics of the uncertainty evolution over space and time, and provides best practices for using the uncertainty ensemble in future studies. Summary statistics from the uncertainty ensemble are in good agreement with production GISTEMP. Two applications of the uncertainty ensemble are also presented. First, the warmest year on record is shown to most likely be 2016 with a 53.2% chance and 2020 as the second most likely with a 44.4% chance. Second, it is shown that the arctic is warming 2.5 - 5 times faster than the globe, significantly faster than the regularly quoted twice as fast.

GISTEMP↗
NASA NTRS2019

Validation and Uncertainty Analysis of Stereo Time-Resolved PIV Measurements for Boundary-Layer Transition Research

An uncertainty analysis was performed on the stereo time-resolved particle image velocimetry measurements that were obtained in the boundary-layer of a swept wing model. Several different approaches were undertaken to estimate the uncertainty of the PIV measurements and to understand how that uncertainty propagates through to the results of interest. It was found that the stereo registration error, which is often neglected in stereo- PIV uncertainty analysis, can cause significant errors in the measured amplitude of the stationary cross ow instability due to the large spanwise velocity gradients that occur in the ow. The self-calibrations do not always adequately correct for the stereo-registration error. A simple approach is demonstrated for estimating the error due to a misalignment of the calibration target and laser plane. This approach was found to be very successful at predicting the error in stationary cross ow amplitude caused by the misalignment. The time-resolved PIV results are also compared to previously-acquired hotwire data. The TRPIV technique is successful at measuring the same types of unsteady instabilities as the hotwire, and thus does not appear to have any adverse e ect on the transition process due to the introduction of particles into the ow. It was also found that a larger interrogation window size is beneficial for reducing the noise of the TRPIV results.

Eppink, Jenna L.↗