Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Prelaunch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 (TIRS-2) that will be onboard Landsat 9 has undergone a prelaunch testing campaign to characterize its radiometric, spectral, and spatial performances and demonstrate compliance to its requirements. This work reviews the key elements of the instrument-level radiometric testing using an SI-traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 onboard blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a nonlinear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument's potential for enhancing our understanding of the Earth's environment.

Aaron Pearlman↗
NASA NTRSDate not supplied

Probabilistic Blast Damage Modeling Uncertainties and Sensitivities

Blast overpressure is the predominant source of ground damage posed by potentially hazardous asteroid strikes. Estimates of the extent, severity, and likelihoods of potential blast damage regions will be one of the key metrics needed to mount civil defense or disaster response plans in the face of an impending impact. However, there are many inherent sources of uncertainty in evaluating the damage, both in characterizing the properties of the incoming object and in the approaches used to model the entry/impact and resulting damage, which make it difficult to produce a single ‘accurate’ or ‘best guess’ prediction of ground damage. The current 2021 PDC hypothetical impact scenario poses a particular challenge due to its short warning time. The need for rapid disaster response to prepare for an immanent impact, combined with lack of observational opportunities to refine basic knowledge about the object’s basic size and properties, make understanding the range and relative likelihood of consequences particularly critical. The potential damage caused by these blasts can be evaluated using a range of modeling and simulation approaches and levels of fidelity. Fast-running engineering-level models can be used to run large numbers of probabilistically sampled cases covering wide variations of uncertain properties or parameters. High-fidelity simulations, on the other hand, can capture more detailed/accurate blast physics, but can only be performed for a small selection of specific cases, requiring many assumptions to be made about the initial object and its unpredictable entry/breakup characteristics. In order to provide a more complete picture of the potential threat for effective disaster response, both types of analysis need to be employed together. In this approach, high-fidelity simulations are used to refine and anchor engineering models, and the probabilistic engineering models are used to evaluate broad parameters spaces and guide selection of the most pertinent simulation cases for a given scenario. This presentation expands upon the probabilistic asteroid impact risk assessments being performed as part of the 2021 PDC hypothetical impact exercise, focusing on key aspects of blast damage modeling uncertainties and sensitivities. We review the current modeling and simulation approaches employed in the current assessment, compare the relative levels of uncertainty stemming from each main element of the problem (i.e., knowledge of the asteroid properties, modeling of the atmospheric entry/breakup and airburst, and estimates of the ground damage from the resulting blasts waves), and highlight any notable trends and sensitivities for the current scenario case.

SMD↗
NASA NTRS2019

Tropospheric Ozone Assessment Report: Tropospheric Ozone From 1877 to 2016, Observed Levels, Trends and Uncertainties

From the earliest observations of ozone in the lower atmosphere in the 19th century, both measurement methods and the portion of the globe observed have evolved and changed. These methods have different uncertainties and biases, and the data records differ with respect to coverage (space and time), information content, and representativeness. In this study, various ozone measurement methods and ozone datasets are reviewed and selected for inclusion in the historical record of background ozone levels, based on relationship of the measurement technique to the modern UV absorption standard, absence of interfering pollutants, representativeness of the well-mixed boundary layer and expert judgement of their credibility. There are significant uncertainties with the 19th and early 20th-century measurements related to interference of other gases. Spectroscopic methods applied before 1960 have likely underestimated ozone by as much as 11% at the surface and by about 24% in the free troposphere, due to the use of differing ozone absorption coefficients. There is no unambiguous evidence in the measurement record back to 1896 that typical mid-latitude background surface ozone values were below about 20 nmol mol–1, but there is robust evidence for increases in the temperate and polar regions of the northern hemisphere of 30–70%, with large uncertainty, between the period of historic observations, 1896–1975, and the modern period (1990–2014). Independent historical observations from balloons and aircraft indicate similar changes in the free troposphere. Changes in the southern hemisphere are much less. Regional representativeness of the available observations remains a potential source of large errors, which are difficult to quantify. The great majority of validation and intercomparison studies of free tropospheric ozone measurement methods use ECC ozonesondes as reference. Compared to UV-absorption measurements they show a modest (~1–5% ±5%) high bias in the troposphere, but no evidence of a change with time. Umkehr, lidar, and FTIR methods all show modest low biases relative to ECCs, and so, using ECC sondes as a transfer standard, all appear to agree to within one standard deviation with the modern UV-absorption standard. Other sonde types show an increase of 5–20% in sensitivity to tropospheric ozone from 1970–1995. Biases and standard deviations of satellite retrieval comparisons are often 2–3 times larger than those of other free tropospheric measurements. The lack of information on temporal changes of bias for satellite measurements of tropospheric ozone is an area of concern for long-term trend studies.

UV absorption standard↗
NASA NTRSDate not supplied

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗
NASA NTRSDate not supplied

Aerothermal Uncertainty Quantification of Deployable Entry Technologies Using Multi-Fidelity Modeling

The objective of this work was to investigate the use of a co-Kriging based multi-fidelity modeling approach with a Monte Carlo uncertainty quantification analyses of surface heating on hypersonic inflatable aerodynamic decelerator vehicles and adaptable, deployable entry placement technology vehicles in Mars entry. A previously developed co-Kriging based multi-fidelity modeling approach was used to model the laminar and turbulent convective and radiative heat fluxes along the vehicle. Monte Carlo analyses of surface heat load for nine different vehicle nose radii was performed for both vehicles, assuming the same thermal protection system is used for both vehicles. The maximum heat loads and heat load uncertainties were found to occur at either the stagnation point or the vehicle shoulder. The maximum 95% confidence intervals for the total heat load for the hypersonic inflatable aerodynamic decelerator vehicle were found to be [-9.27, 7.81] % of the nominal value and [-6.09, 13.1] % of the nominal value for laminar and turbulent flow, respectively. The maximum 95% confidence intervals for the total heat load for the adaptable, deployable entry placement technology vehicle were found to be [-8.85, 7.22] % of the nominal value and [-9.33, 9.35] % of the nominal value for laminar and turbulent flow, respectively. The difference in heating uncertainties based on vehicle geometry between the two vehicle technologies was found to be minimal.

Mario Santos↗
NASA NTRS2022

A Multi-sensor Evaluation of Precipitation Uncertainty for Landslide-triggering Storm Events

Extreme precipitation can have profound consequences for communities, resulting in natural hazards such as rainfall-triggered landslides that cause casualties and extensive property damage. A key challenge to understanding and predicting rainfall triggered landslides comes from observational uncertainties in the depth and intensity of precipitation preceding the event. Practitioners and researchers must select among a wide range of precipitation products, often with little guidance. Here we evaluate the degree of precipitation uncertainty across multiple precipitation products for a large set of landslide triggering storm events and investigate the impact of these uncertainties on predicted landslide probability using published intensity-duration thresholds. The average intensity, peak intensity, duration, and NOAA-Atlas return periods are compared ahead of reported landslides across the continental US and Canada. Precipitation data are taken from four products that cover disparate measurement methods: near real-time and post-processed satellite (IMERG), radar (MRMS), and gauge-based (NLDAS-2). Landslide-triggering precipitation was found to vary widely across precipitation products with the depth of individual storm events diverging by as much as 296mm with an average range of 51mm. Peak intensity measurements, which are typically influential in triggering landslides, were also highly variable with an average range of 7.8262745mm/hr and as much as 57mm/hr. The two products more reliant upon ground-based observations (MRMS and NLDAS-2) performed better at identifying landslides according to published intensity duration storm thresholds, but all products exhibited hit-ratios of greater than 0.56. A greater proportion of landslides were predicted when including only manually-verified landslide locations. We recommend practitioners consider low-latency products like MRMS for investigating landslides, given their near-real time data availability and good performance in detecting landslides. Practitioners would be well-served considering more than one product as a way to confirm intense storm signals and minimize the influence of noise and false alarms.

Precipitation inter-comparison↗
NASA NTRS2020

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗
NASA NTRSDate not supplied

Update on Prediction Uncertainty Reduction (PUR) Tech Challenge

NASA has taken on a Technical Challenge to reduce the uncertainty in prediction of noise from near-term commercial supersonic aircraft. To date, an assessment has been done to baseline this effort, quantifying how much more uncertainty exists when the system-level prediction methods are applied to supersonic aircraft as compared to conventional aircraft. And an assessment has been made for the uncertainty in the physics-based simulations for jets. These will be briefly demonstrated.

supersonic↗
NASA NTRSDate not supplied

ASCoT 3: Nonlinear Principal Components Analysis and Uncertainty Quantification in Early Concept Spacecraft Flight Software Cost Estimation

For mission planners and evaluators alike, value in cost models comes from a mean or median prediction, an understanding of the uncertainty on that prediction, and an understanding of model performance. Here we apply advanced statistical and machine learning methods to spacecraft flight software cost, effort, and SLOC estimation, and present the results in the latest version of the Analogy Software Cost Tool (ASCoT). We present in- and out-of-sample performance metrics for our models, each of which incorporate some amount of epistemic uncertainty. ASCoT, hosted on the One NASA Cost Engineering (ONCE) database via the Online NASA Space Estimation Tool (ONSET), was first showcased in 2016 as a number of analogy-based models and methods (kNN and Clustering) to support early project formulation. This ASCoT update improves upon the previous analogic methods by incorporating uncertainty in the data transformations. In particular, we use a Nonlinear Principal Components Analysis (NLPCA) to deal with ordinal data.

Robotic Spacecraft↗
NASA NTRSDate not supplied

The Relationship Between Two Methods for Estimating Uncertainties in Data Assimilation

This note examines the relationship between two apparently unrelated methods for estimating error statistics or uncertainties of relevance to data assimilation. The first method is due to (Desroziers et al., 2005, Q. J. R. Meteorol. Soc., 131, 3385–3396; referred to as DBCP hereafter) and relies on residual statistics readily available from data assimilation applications. The second method, the three- cornered hat (3CH) developed by Gray and Allan (1974, IEEE 28th Annual Symp. Freq. Control, 243–246), only recently applied to atmospheric sciences, uses three data sets and can derive estimates of relevant error uncertainties as well. The usefulness of both methods lies in them not requiring knowledge of the true value of the quantities at play. DBCP derives its results by relying explicitly on the constraints as- sociated with the data assimilation minimization problem; 3CH is general and its estimates hold as long as errors in the three data sets of choice are uncorrelated. Establishing the relationship between the methods requires applying the 3CH approach to the same observation, background, and analysis data sets used by DBCP. In this case, the same assumptions of DBCP on residual errors allow for cancellation of error cross–covariance terms in 3CH such that two of its corners derive identical estimates for observation and background error covariances as those of DBCP. The error cross–covariance terms associated with the third corner are shown to add up to twice the analysis error covariance so that the 3CH estimate for the third corner recovers the negative of the analysis error covariance. Illustrations of these findings are provided by deriving uncertainties for radio occultation bending angles.

Ricardo Todling↗
NASA NTRS2022

Bayesian Rules of Thumb: Robust Uncertainty Quantification in Early Project Cost Estimation

Systems engineers often make use of cost Rules ofThumb in order to estimate cost during early phases of projectformulation. These Rules of Thumb typically take the form ofa sequence of percentages over which a total cost is allocatedacross NASA WBS elements. Rules of Thumb can then be usedto extrapolate cost from one or more known WBS elements tothe remaining unknown WBS elements, assisting early projectformulation architecture studies (such as those in JPL’s Team Xand A Team).A number of issues can arise when generating and using costRules of Thumb. For example, many records of project costsconsist of incomplete data. Typical methods of dealing withincomplete cost allocation data include (a) ignoring missionswith incomplete data, or (b) taking averages of the non-zero percentagesacross missions, but both of these methods can result inbiased estimates if the existence of incomplete data correlateswith total mission cost or any particular WBS element. Anothercommon example is cost reported in one or more incorrect WBSelements. This is especially prevalent in smaller missions whereit is more common for engineers to perform tasks that fall underthe purview of multiple WBS elements.Furthermore, a Rule of Thumb estimate is typically reported asa point estimate; there is no reported uncertainty around thepercentages used to generate an allocation. Even in the rarecase in which confidence intervals around mean percentages areprovided, there may be positive or negative correlations betweenWBS elements which can skew estimates.Here we attempt to address these problems by formulatingprobabilistic Rules of Thumb in which a distribution of allocationschemes, rather than a single allocation scheme, is generated.We use a bootstrap imputation method to simultaneouslyaccount for uncertainty in the missing data while using allavailable information contained in the dataset. The imputeddatasets are then input into a multivariate Bayesian modelwhich accounts for correlations between WBS elements andproperly accounts for uncertainty in the final Rule of Thumbpercentages and predictions. We describe the mathematicalmodel and provides snippets of R code utilizing the brms(Bayesian Regression Models using Stan) package. To illustratethis model, we generate a Bayesian Level 2 WBS Cost Rule ofThumb for MIDEX (Medium-Class Explorers) missions withdata extracted from NASA’s CADRe. We then compare thismethod’s performance with the classical Rule of Thumb method.

Hooke, Melissa A↗
NASA NTRSDate not supplied

LOFTID Aeroshell Thermal Response Uncertainty Analysis Utilizing the End-to-End Monte Carlo Approach

A probabilistic thermal margin process has been performed to design the flexible thermal protection system (FTPS) and select entry trajectory constraints given an acceptable risk level for the Low-Earth Orbit Flight Test of and Inflatable Decelerator (LOFTID) project. Uncertainties exist in atmospheric entry aeroheating environments and the predicted thermal response of thermal protection system (TPS) material. Entry vehicle TPS is often over-sized to mitigate uncertainty by combining conservative bounding scenarios together. The probabilistic thermal margin process allows engineers to make informed aeroshell design, flight design, and FTPS performance risk trades while preventing excessive FTPS margin from being applied. This paper describes the uncertainty analysis methodology used to carry out a probabilistic thermal margin process used for LOFTID’s aeroshell and explains how the calculated probability of exceeding flight allowable temperatures is used to design the FTPS and establish nominal flight design constraints. This probabilistic thermal margin process had never been applied to entry, decent, and landing design for a flown entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven Andrew Tobin↗
NASA NTRS2024

Uncertainty Quantification of Artemis I Space Launch System Integrated Aerodynamics Databases

Accurate prediction of integrated aerodynamic forces and moments is a necessary part of aerospace vehicle development. This accuracy can be quantified in the form of an uncertainty model, which makes the prediction more useful within an integrated vehicle design effort. Aerodynamic force and moment databases were constructed for the Artemis~I mission of the Space Launch System vehicle. These databases reconcile data from multiple sources to yield unified predictions of how NASA's most advanced launch vehicle interacts with Earth's atmosphere as it ascends into orbit. This paper outlines how the uncertainty quantification was performed for these databases to ensure comprehensive and tractable uncertainty source coverage.

Michael W Lee↗
NASA NTRSDate not supplied

A Comparison of Control Allocation Methods in the Presence of Parametric Model Uncertainty

When allocating redundant effectors to virtual control commands, linear (generalized inverse) allocators have historically been used on aircraft and spacecraft. While simple to implement, generalized inverses are unable to realize a significant portion of the attainable moments. To address this drawback, the control allocation problem can also be formulated as a linear programming or quadratic programming problem and solved using convex optimization based solvers. These approaches have been shown to access a larger set of attainable moments, however, little work has been done to understand the performance of convex optimization-based control allocation in the presence of parametric model uncertainty. This paper seeks to compare the performance of several control allocation approaches, including two forms of generalized inverse allocators, the pseudo inverse and minimum-variance, and the linear programming and quadratic programming approach in the presence of parametric model uncertainty. The performance of these four allocators were tested on an aircraft model in the presence of realistic parametric model uncertainty and the convex optimization approaches were shown to outperform the generalized inverses.

Luke J Miller↗
NASA NTRS2026

Methods for Validation of Random Uncertainty Estimates and Their Applications to Ozone Profiles From Limb-Viewing Satellite Instruments

For satellite measurements of atmospheric composition, the random uncertainty estimates provided by retrieval algorithms might be imperfect due to various approximations used in the retrievals or the presence of unknown error sources. This paper presents an overview of the methods used for the validation of random uncertainty estimates. All methods discussed in this study are categorized, and assumptions and limitations of each method are discussed. This overview evaluates these methods in application to ozone profile measurements from limb and occultation satellite instruments and provides practical illustrations of random uncertainty validation.

Viktoria F Sofieva↗
NASA NTRS2012

Standardization of the Definitions of Vertical Resolution and Uncertainty in the NDACC-archived Ozone and Temperature Lidar Measurements

The international Network for the Detection of Atmospheric Composition Change (NDACC) is a global network of high-quality, remote-sensing research stations for observing and understanding the physical and chemical state of the Earth atmosphere. As part of NDACC, over 20 ground-based lidar instruments are dedicated to the long-term monitoring of atmospheric composition and to the validation of space-borne measurements of the atmosphere from environmental satellites such as Aura and ENVISAT. One caveat of large networks such as NDACC is the difficulty to archive measurement and analysis information consistently from one research group (or instrument) to another [1][2][3]. Yet the need for consistent definitions has strengthened as datasets of various origin (e.g., satellite and ground-based) are increasingly used for intercomparisons, validation, and ingested together in global assimilation systems.In the framework of the 2010 Call for Proposals by the International Space Science Institute (ISSI) located in Bern, Switzerland, a Team of lidar experts was created to address existing issues in three critical aspects of the NDACC lidar ozone and temperature data retrievals: signal filtering and the vertical filtering of the retrieved profiles, the quantification and propagation of the uncertainties, and the consistent definition and reporting of filtering and uncertainties in the NDACC- archived products. Additional experts from the satellite and global data standards communities complement the team to help address issues specific to the latter aspect.

Detection of Atmospheric Composition Change (NDACC↗
NASA NTRS2013

Advanced Methods for Determining Prediction Uncertainty in Model-Based Prognostics with Application to Planetary Rovers

Prognostics is centered on predicting the time of and time until adverse events in components, subsystems, and systems. It typically involves both a state estimation phase, in which the current health state of a system is identified, and a prediction phase, in which the state is projected forward in time. Since prognostics is mainly a prediction problem, prognostic approaches cannot avoid uncertainty, which arises due to several sources. Prognostics algorithms must both characterize this uncertainty and incorporate it into the predictions so that informed decisions can be made about the system. In this paper, we describe three methods to solve these problems, including Monte Carlo-, unscented transform-, and first-order reliability-based methods. Using a planetary rover as a case study, we demonstrate and compare the different methods in simulation for battery end-of-discharge prediction.

prognosis↗