Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

TPSAS-NF1676L-17243-DND

This presentation captures ERA Project's effort in using integrated cost-schedule-risk analysis tool, identifying and capturing explicit relationships between program funds, schedule, and discrete risks. The project team merged a myriad of cost and schedule data for timely, objective, uncertainty analysis of the ITD's budget and schedule. The project team conducted detailed schedule uncertainty analysis showing schedule activities and how their interrelationships were impacted, representing an impressive advance beyond routine Gantt charts. Furthermore, the ERA Project collected discrete risk events including their impacts to costs and/or schedule and interwove these risks into cost and schedule logic networks, providing the foundation to conduct cost and schedule analyses. The team integrated this data into the analysis model, providing probabilistic results that were then used by the ERA Project's senior management for decision-making purposes. The ERA Project management team, through technical and pathfinder expertise in integrating cost, schedule, risk, and technical content, consistently provided risk-informed recommendations to Implementing Centers and ISRP senior management which ultimately ensured the successful ARMD Key Decision Point (KDP) review of the ERA Phase 2 ITD Portfolio and increased the likelihood of achieving technical objectives within cost and schedule constraints.

Gaudy M Bezos-O'Connor↗

Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept

The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.

Noyes, Connor↗

Substructure Versus Property-Level Dispersed Modes Calculation

This paper calculates the effect of perturbed finite element mass and stiffness values on the eigenvectors and eigenvalues of the finite element model. The structure is perturbed in two ways: at the "subelement" level and at the material property level. In the subelement eigenvalue uncertainty analysis the mass and stiffness of each subelement is perturbed by a factor before being assembled into the global matrices. In the property-level eigenvalue uncertainty analysis all material density and stiffness parameters of the structure are perturbed modified prior to the eigenvalue analysis. The eigenvalue and eigenvector dispersions of each analysis (subelement and property-level) are also calculated using an analytical sensitivity approximation. Two structural models are used to compare these methods: a cantilevered beam model, and a model of the Space Launch System. For each structural model it is shown how well the analytical sensitivity modes approximate the exact modes when the uncertainties are applied at the subelement level and at the property level.

Stewart, Eric C.↗

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗

Monte Carlo analysis of uncertainty propagation in a stratospheric model. 1: Development of a concise stratospheric model

A concise model has been developed to analyze uncertainties in stratospheric perturbations, yet uses a minimum of computer time and is complete enough to represent the results of more complex models. The steady state model applies iteration to achieve coupling between interacting species. The species are determined from diffusion equations with appropriate sources and sinks. Diurnal effects due to chlorine nitrate formation are accounted for by analytic approximation. The model has been used to evaluate steady state perturbations due to injections of chlorine and NO(X).

Rundel, R. D.↗

Analysis of uncertainty in force balance calibration

In order to reduce errors encountered in the measurement and identification of loads using force balances, a third-order forward polynomial relation between loads and output voltages is proposed. This full third-order model represents an alternative to the second-order model currently in use at NASA Langley Research Center (LaRC) and many other installations worldwide. The new model requires the identification of 84 coefficients (including the 28 used presently) for each of the six outputs. The existing LaRC calibration loading sequence is insufficient for identification of many of these 504 coefficients because critical three-load combinations are absent. Accordingly, a new loading sequence that permits the identification of all 504 coefficients has been developed and is described fully. It is apparent from numerical tests that the new third-order model is clearly superior to second-order models in the presence of small amounts of random measurement noise, assuming that there are indeed higher-order interactions between loads. As the amount of noise increases, however, a third-order model becomes less attractive due to its ability to match the noise itself more faithfully than a second-order model. Numerical results suggest that the transition occurs when the magnitude of random noise becomes of the same order as that of the physical higher-order interactions.

Bursal, Faruk H.↗

Validation of Linear Covariance Techniques for Mars Entry, Descent, and Landing Guidance and Navigation Performance Analysis

Current Monte Carlo-based uncertainty analysis methods may require significant computational resources to evaluate the performance of a closed-loop guidance, navigation, and control system. An attractive alternative, particularly during the preliminary and conceptual design phase, is to use linear covariance analysis, which can provide the same statistical information as Monte Carlo methods at a fraction of the computational load. Linear covariance has already been demonstrated in various spaceflight regimes, but only recently has it been applied to atmospheric flight. In this study, a 6-degree-of-freedom formulation of both a linear covariance and Monte Carlo analysis tools are utilized for a Mars entry, descent, and landing scenario which capture both atmospheric and powered flight phases to support precision landing. Comparison of the performance results shows close agreement between the linear covariance and traditional Monte Carlo methods when incorporating an assortment of guidance algorithms and processing a variety of inertial and relative sensor measurements onboard the lander's navigation filter.

James W. Williams↗

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗

Uncertainty of Five-Hole Probe Measurements

A new algorithm for five-hole probe calibration and data reduction using a non-nulling technique was developed, verified, and reported earlier (Wendt and Reichert, 1993). The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify the uncertainty of five-hole probe results (e.g., total pressure, static pressure, and flow direction) and to determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance for improving the measurement technique.

Reichert, Bruce A.↗

Uncertainty estimates in geomagnetic field modeling

This paper presents an extension of the conventional uncertainty analysis which characterizes the sources of uncertainty in the coefficients of the geomagnetic field models. The new formalism accounts for the systematic errors introduced by the omission of such sources as the presence of crustal fields, the external fields, and the field from the truncated terms. The usefulness of this formalism depends on two critical conditions. The first of these is the knowledge of the statistical properties of the fields whose parameters are not solved in the analysis, i.e., the crustal field and the external field. The second critical point in the practical use of the method is the approximation used for the weight matrix.

Langel, R. A.↗

Verification and Validation in NASA-CUIP LOX/methane Injector Research Efforts

The NASA-CUIP program is supporting experimental and modeling/computational research efforts investigating wall heat flux characteristics of LOX/methane single-element injectors. A Verification and Validation (V&V) task has begun with the objective of quantifying the degree of accuracy of the models for wall heat flux distributions at specific sets of conditions. The V&V approach used is that being drafted as a standard by the ASME Performance Test Codes Committee, PTC 61: Verification and Validation in Computational Fluid Dynamics and Heat Transfer. The approach is based on well-established concepts from experimental uncertainty analysis. Initially the V&V and uncertainty estimation efforts will use data obtained previously in the same facility using oxygen/hydrogen in single-element injector testing. In this paper the V&V process, experimental facility, and computer code are described, and approaches to estimating the associated uncertainties are discussed.

Coleman, Hugh W.↗

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit(CPU)on the order of ~30 s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit (CPU) on the order of ~30s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗

Aerothermal Analysis of the Rocket Lab Venus Probe Heatshield

This document provides an overview of the aerothermodynamic analyses performed by the Aerothermodynamics Branch at NASA Langley Research Center for the Rocket Lab Venus Probe (RLVP). In addition to defining the baseline heating environment to the heatshield, this document pursues the experimental validation of key physical models at RLVP-relevant conditions. This experimental validation analysis, which captures the model form uncertainty, is used as one of two primary components of the margin assessment, where the other component is the parametric uncertainty. These model form (experimental) and parametric uncertainty components are used to construct a spatial and time varying margin for the heating to the RLVP heatshield. The margin is evaluated as the sum of the parametric and model form uncertainty components. The model form uncertainty is defined as the difference between the RLVP-relevant measurements and their simulations, using the upper limit uncertainty bounds for both the measurements and simulations in the comparisons. The differences in the dominant physics in the stagnation region and flank lead to the separate RLVP-relevant measurements for assessing the model form uncertainty in these two regions. These regions are addressed as follows: Stagnation Region Heating Environment: For the high-temperature stagnation-region, both the radiative heating and impact of blowing on convective heating are significant, while the impacts of turbulence and roughness are negligible. Coupled radiation and ablation LAURA/HARA solutions with ray-tracing provide the radiative heating over the entire vehicle, including the contributions from the Venus atmosphere and ablation species. Non-ablating LAURA simulations provide the convective heating. During the material-response computation typically used for TPS sizing, this non-ablating convective heating is corrected for the impact of ablation using the blowing correction. Coupled ablation LAURA simulations that capture finite-rate sur-face processes show that this blowing correction may be non-conservative over most of the heatshield. This non-conservatism is due to hydrogen recombination in the finite-rate surface model, which tends to increase the coupled ablation convective heating to near the non-ablating values, therefore making any reduction in the non-ablating value through the blowing correction non-conservative. This non-conservatism due to H catalysis is captured in the parametric component of the margin. The best available ground-test measurements that capture the impact of blowing on stagnation region convective heating, at RLVP-relevant conditions, indicate that the current blowing reduction model is non-conservative by up to 20% at RLVP-relevant blowing rates (the coupled blowing simulations were also non-conservative). Because of the relatively low velocity of the ground tests and the non-Venus atmospheric chemistry, these measurements do not capture the chemistry and therefore do not inform the uncertainty due to H catalysis. However, they do capture the fluid mechanics of blowing. The non-conservatism of the blowing correction implied by these measurements is covered by the model form component of the margin, which leads to total margin values over 50%. For the radiative heating, the shock-tube informed bias approach suggests a model form uncertainty of roughly 20%, while the parametric uncertainty analysis suggests values over 100%. The combined stagnation-point radiation margin of over 100% leads to peak margined radiative heating values of over300 W/cm2, which remains small relative to the peak margined convective heating of nearly 2000 W/cm2. Based on this analysis, at the stagnation point, the peak margined heat rate is 2203 W/cm2 and the margined total heat load is 31.5 kJ/cm2 for the current nominal trajectory. Flank Heating Environment: The forebody flank (and near-shoulder) heating environment is dominated by the impact of turbulence, roughness augmentation, and ablation on the convective heating. An extensive collection of ground test measurements with RLVP-relevant turbulence and roughness is studied to show that the maximum difference between the simulated and measured convective heating is 5%. However, with the exception of the Holden measurements from the 1980s, these measurements do not include roughness elements extending into the supersonic region of the boundary layer, which is likely to occur for RLVP (due to the 45 degree sphere-cone geometry). The interaction between the supersonic flow and roughness could cause convective heating augmentation fundamentally different than for locally subsonic flow. Although these Holden measurements are consistent with the other measurements considered, another path was pursued to assure that the rough-ness height extending into supersonic flow does not fundamentally change the roughness augmentation. This additional path was a computational effort to resolve the roughness elements in the CFD grid, so that the interaction be-tween the roughness elements and locally supersonic flow may be simulated in detail. This roughness-resolved CFD simulation is feasible because of the RLVP forebody TPS’s patterned roughness, which may be approximated analytically, and because of the axisymmetric nominal flow field, which allows a narrow surface region to be simulated and therefore make the computational expense feasible. These grid-resolved roughness simulations, which are performed at actual RLVP flight conditions, result in heating augmentation values that are below the design approach for roughness augmentation. This provides evidence that the design approach for RLVP roughness augmentation is sufficient. Based on this analysis, at this flank or near-shoulder location, the peak margined total heat rate is 2088 W/cm2and the margined total heat load is 26.0 kJ/cm2for the current nominal trajectory. Heat flux, shear, pressure and heat transfer coefficient at the RLVP stagnation point and near shoulder location are evaluated for the entire trajectory, and curved fit to a functional form of F=AρB∞UC∞. These simplified relationships for the nominal and margined aerothermal environments are referred to as aerothermal indicators, and presented at the end of this document.

Christopher O Johnston↗

Conducting the NASP ground test program

The National Aero-Space Plane (NASP) program has recently entered a new phase of the program known as Phase 2D. During this period, five aerospace companies and the Government have formed a National Team. This team has focused on developing a single experimental (X-30) vehicle design and are pursuing a technology validation and demonstration program to prove out the design concepts and design tools. This paper presents an overview of the Phase 2D round testing being conducted to validate the X-30 design and to demonstrate the critical technologies needed to build and fly a research vehicle during Phase 3 of the program. The Phase 2D exit criteria are discussed to identify how they provide top-level guidance for developing the ground test program. An overview of major test facility modifications being performed in support of the test program is also presented. Emphasis is placed on propulsion and structures testing since these are felt to be the primary areas requiring technologies beyond the current state-of-the-art. Also discussed is the use of uncertainty analysis as a method to account for uncertainties in test data. In addition, this paper addresses the use of these uncertainties to develop qualitative indicators of how well the design and technology developed during Phase 2 have matured.

Airframes↗