Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty Propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

MultiLayer Clustered Sampling (MLCS) technique for near-earth asteroid impact hazard assessment

Because of planetary encounters, the motion of near-Earth asteroids is chaotic and small differences in the initial conditions tend to diverge exponentially. Linear approximations for propagating orbital uncertainties can lead to inaccurate estimates of the probability of an Earth collision. We present a novel fully nonlinear strategy for estimating the probability of an asteroid impact using sequential Monte Carlo layers. The method first explores a low-resolution layer to locate potentially relevant regions. Then, we conduct localized searches on deeper layers with higher resolution. The method retains the accuracy of brute-force Monte Carlo sampling while reducing the computational cost by only sampling relevant regions.

Farnocchia, Davide↗

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation amongst the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation among the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗

Atmospheric moisture measurements - A microwave radiometer-radiosonde comparison

Measurements of the thermal emission of the sky at three frequencies (20.7, 22.2, and 31.4 GHz) with the NASA/Goddard Space Flight Center Crustal Dynamics Project MW Water Vapor Radiometer are reported. These measurements are compared with brightness temperatures inferred from measurements from VAISALA radiosonde packages launched every 3 hr during the experiment period. An error analysis for the radiosonde-inferred brightness temperatures is performed under the assumption of reasonable random uncertainties for the pressure, temperature, and humidity measurements and propagation of these uncertainties through the analysis algorithm. For the assumed uncertainties, the dominant contribution to the total uncertainty comes from the temperature measurement (66-88 percent), whereas the relative humidity measurement contributes only 2-8 percent, except in the vicinity of the water vapor line, where the contribution is 10-20 percent.

England, Martin N.↗

Aeroelastic Uncertainty Quantification Studies Using the S4T Wind Tunnel Model

This paper originates from the joint efforts of an aeroelastic study team in the Applied Vehicle Technology Panel from NATO Science and Technology Organization, with the Task Group number AVT-191, titled "Application of Sensitivity Analysis and Uncertainty Quantification to Military Vehicle Design." We present aeroelastic uncertainty quantification studies using the SemiSpan Supersonic Transport wind tunnel model at the NASA Langley Research Center. The aeroelastic study team decided treat both structural and aerodynamic input parameters as uncertain and represent them as samples drawn from statistical distributions, propagating them through aeroelastic analysis frameworks. Uncertainty quantification processes require many function evaluations to asses the impact of variations in numerous parameters on the vehicle characteristics, rapidly increasing the computational time requirement relative to that required to assess a system deterministically. The increased computational time is particularly prohibitive if high-fidelity analyses are employed. As a remedy, the Istanbul Technical University team employed an Euler solver in an aeroelastic analysis framework, and implemented reduced order modeling with Polynomial Chaos Expansion and Proper Orthogonal Decomposition to perform the uncertainty propagation. The NASA team chose to reduce the prohibitive computational time by employing linear solution processes. The NASA team also focused on determining input sample distributions.

Nikbay, Melike↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

Uncertainty in Inverted Pendulum Thrust Measurements

An uncertainty analysis of a common configuration of electric propulsion thrust stand is presented. The analysis applies to inverted pendulum thrust stands operating in a null-coil configuration with in-situ calibration. Several sources of bias and precision uncertainty are discussed, propagated, and combined to form conservative estimates of the relative and absolute thrust uncertainties. A case study of the NASA Glenn Research Center Vacuum Facility 6 thrust stand is presented. For the thruster investigated, the uncertainty was estimated to be +/-6.9 mN over the entire span of thrust. This uncertainty represents a maximum instrument bias introduced by the thrust stand. The paper does not address repeatability of actual thrust measurements, as this is generally beyond the influence of the thrust stand and can be dependent on a large number of factors.

Mackey, J.↗

Uncertainty in Inverted Pendulum Thrust Measurements

An uncertainty analysis of a common configuration of electric propulsion thrust stand is presented. The analysis applies to inverted pendulum thrust stands operating in a null-coil configuration with in-situ calibration. Several sources of bias and precision uncertainty are discussed, propagated, and combined to form conservative estimates of the relative and absolute thrust uncertainties. A case study of the NASA Glenn Research Center Vacuum Facility 6 thrust stand is presented. For the thruster investigated, the uncertainty was estimated to be ±6.9 mN over the entire span of thrust. This uncertainty represents a maximum instrument bias introduced by the thrust stand. The paper does not address repeatability of actual thrust measurements, as this is generally beyond the influence of the thrust stand and can be dependent on a large number of factors.

Mackey, Jonathan A.↗

Uncertainty in Inverted Pendulum Thrust Measurements

An uncertainty analysis of a common configuration of electric propulsion thrust stand is presented. The analysis applies to inverted pendulum thrust stands operating in a null-coil configuration with in-situ calibration. Several sources of bias and precision uncertainty are discussed, propagated, and combined to form conservative estimates of the relative and absolute thrust uncertainties. A case study of the NASA Glenn Research Center Vacuum Facility 6 thrust stand is presented. For the thruster investigated, the uncertainty was estimated to be ±6.9mN over the entire span of thrust. This uncertainty represents a maximum instrument bias introduced by the thrust stand. The paper does not address repeatability of actual thrust measurements, as this is generally beyond the influence of the thrust stand and can be dependent on a large number of factors.

Mackey, Jonathan A.↗

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗

The New Sun-Sky-Lunar Cimel CE318-T Multiband Photometer - A Comprehensive Performance Evaluation

This paper presents the new photometer CE318-T, able to perform daytime and night-time photometric measurements using the sun and the moon as light source. Therefore,this new device permits a complete cycle of diurnal aerosol and water vapour measurements valuable to enhance atmospheric monitoring to be extracted. In this study wehave found significantly higher precision of triplets when comparing the CE318-T master instrument and the Cimel AErosol RObotic NET work (AERONET) master (CE318-AERONET) triplets as a result of the new CE318-T tracking system. Regarding the instrument calibration, two new methodologies to transfer the calibration from a reference instrument using only daytime measurements (Sun Ratio and Sun-Moon gain factor techniques) are presented and discussed. These methods allow the reduction of the previous complexities inherent to nocturnal calibration. A quantitative estimation of CE318-T AOD uncertainty by means of error propagation theory during daytime revealed AOD uncertainties (u(sup D)(sub AOD)) for Langley-calibrated instruments similar to the expected values for other reference instruments (0.002-0.009). We have also found u(sup D)(sub AOD) values similar to the values reported in sun photometry for field instruments (approximately 0.015). In the case of the night-time period, the CE318-T-estimated standard combined uncertainty (u(sup N)(sub AOD)) is dependent not only on the calibration technique but also on illumination conditions and the instrumental noise. These values range from 0.011-0.018 for Lunar Langley-calibrated instruments to 0.012-0.021 for instruments calibrated using the Sun Ratio technique. In the case of moon-calibrated instruments using the Sun-Moon gain factor method and sun calibrated using the Langley technique, we found u(sup N)(sub AOD) ranging from 0.016 to 0.017 (up to 0.019 in 440 nm channel), not dependent on any lunar irradiance model. A subsequent performance evaluation including CE318-T and collocated measurements from independent reference instruments has served to assess the CE318-T performance as well as to confirm its estimated uncertainty. Daytime AOD evaluation, performed at Izana station from March to June 2014, encompassed measurements from a reference CE318-T, a CE318-AERONET master instrument, a Precision Filter Radiometer (PFR) and a Precision Spectroradiometer (PSR) prototype, reporting low AOD discrepancies between the four instruments (up to 0.006). The nocturnal AOD evaluation was performed using CE318-T- and starphotometer-collocated measurements and also by means of a day/night coherence transition test using the CE318-T master instrument and the CE318 daytime data from the CE318-AERONET master instrument. Results showed low discrepancies with the star photometer at 870 and 500 nm channels(less tna or equal to 0.013) and differences with AERONET daytime data (1 h after and before sunset and sunrise) in agreement with the estimated u(sup N)(sub AOD) values at all illumination conditions in the case of channels within the visible spectral range, and only for high moon's illumination conditions in the case of near infrared channels. Perceptible water vapour (PWV) validation showed a good agreement between CE318-T and Global Navigation Satellite System (GNSS) PWV values for all illumination conditions, within the expected precision for sun photometry. Finally, two case studies have been included to highlight the ability of the new CE318-T to capture the diurnal cycle of aerosols and water vapour as well as short-term atmospheric variations, critical for climate studies.

Barreto, Africa↗

Long-range vertical propagation

Development of the advanced turboprop has led to concerns about en route noise. Advanced turboprops generate low-frequency, periodic noise signatures at relatively high levels. As demonstrated in a flight test of NASA Lewis Research Center's Propfan Test Assessment (PTA) airplane in Alabama in October 1987, the noise of an advanced turboprop operating at cruise altitudes can be audible on the ground. The assessment of the en route noise issue is difficult due to the variability in received noise levels caused by atmospheric propagation and the uncertainty in predicting community response to the relatively low-level en route noise, as compared to noise associated with airport operations. The En Route Noise Test was designed to address the atmospheric propagation of advanced turboprop noise from cruise altitudes and consisted of measuring the noise of an advance turboprop at cruise in close proximity to the turboprop and on the ground. Measured and predicted ground noise levels are presented.

Willshire, William L., Jr.↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

Potentially Underestimated Gas Flaring Activities—A New Approach to Detect Combustion Using Machine Learning and NASA’s Black Marble Product Suite

Monitoring changes in greenhouse gas (GHG) emission is critical for assessing climate mitigation efforts towards the Paris Agreement goal. A crucial aspect of science-based GHG monitoring is to provide objective information for quality assurance and uncertainty assessment of the reported emissions. Emission estimates from combustion events (gas flaring and biomass burning) are often calculated based on activity data (AD) from satellite observations, such as those detected from the visible infrared imaging radiometer suite (VIIRS) onboard the Suomi-NPP and NOAA-20 satellites. These estimates are often incorporated into carbon models for calculating emissions and removals. Consequently, errors and uncertainties associated with AD propagate into these models and impact emission estimates. Deriving uncertainty of AD is therefore crucial for transparency of emission estimates but remains a challenge due to the lack of evaluation data or alternate estimates. This work proposes a new approach using machine learning (ML) for combustion detection from NASA's Black Marble product suite and explores the assessment of potential uncertainties through comparison with existing detections. We jointly characterize combustion using thermal and light emission signals, with the latter improving detection of probable weaker combustion with less distinct thermal signatures. Being methodologically independent, the differences in ML-derived estimates with existing approaches can indicate the potential uncertainties in detection. The approach was applied to detect gas flares over the Eagle Ford Shale, Texas. We analyzed the spatio-temporal variations in detections and found that approximately 79.04% and 72.14% of the light emission-based detections are missed by ML-derived detections from VIIRS thermal bands and existing datasets, respectively. This improvement in combustion detection and scope for uncertainty assessment is essential for comprehensive monitoring of resulting emissions and we discuss the steps for extending this globally.

gas flaring↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.

Stephanie Y Zhu↗