Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Aerothermal Uncertainty Quantification of Deployable Entry Technologies Using Multi-Fidelity Modeling

The objective of this work was to investigate the use of a co-Kriging based multi-fidelity modeling approach with a Monte Carlo uncertainty quantification analyses of surface heating on hypersonic inflatable aerodynamic decelerator vehicles and adaptable, deployable entry placement technology vehicles in Mars entry. A previously developed co-Kriging based multi-fidelity modeling approach was used to model the laminar and turbulent convective and radiative heat fluxes along the vehicle. Monte Carlo analyses of surface heat load for nine different vehicle nose radii was performed for both vehicles, assuming the same thermal protection system is used for both vehicles. The maximum heat loads and heat load uncertainties were found to occur at either the stagnation point or the vehicle shoulder. The maximum 95% confidence intervals for the total heat load for the hypersonic inflatable aerodynamic decelerator vehicle were found to be [-9.27, 7.81] % of the nominal value and [-6.09, 13.1] % of the nominal value for laminar and turbulent flow, respectively. The maximum 95% confidence intervals for the total heat load for the adaptable, deployable entry placement technology vehicle were found to be [-8.85, 7.22] % of the nominal value and [-9.33, 9.35] % of the nominal value for laminar and turbulent flow, respectively. The difference in heating uncertainties based on vehicle geometry between the two vehicle technologies was found to be minimal.

Mario Santos↗
NASA NTRS2022

A Multi-sensor Evaluation of Precipitation Uncertainty for Landslide-triggering Storm Events

Extreme precipitation can have profound consequences for communities, resulting in natural hazards such as rainfall-triggered landslides that cause casualties and extensive property damage. A key challenge to understanding and predicting rainfall triggered landslides comes from observational uncertainties in the depth and intensity of precipitation preceding the event. Practitioners and researchers must select among a wide range of precipitation products, often with little guidance. Here we evaluate the degree of precipitation uncertainty across multiple precipitation products for a large set of landslide triggering storm events and investigate the impact of these uncertainties on predicted landslide probability using published intensity-duration thresholds. The average intensity, peak intensity, duration, and NOAA-Atlas return periods are compared ahead of reported landslides across the continental US and Canada. Precipitation data are taken from four products that cover disparate measurement methods: near real-time and post-processed satellite (IMERG), radar (MRMS), and gauge-based (NLDAS-2). Landslide-triggering precipitation was found to vary widely across precipitation products with the depth of individual storm events diverging by as much as 296mm with an average range of 51mm. Peak intensity measurements, which are typically influential in triggering landslides, were also highly variable with an average range of 7.8262745mm/hr and as much as 57mm/hr. The two products more reliant upon ground-based observations (MRMS and NLDAS-2) performed better at identifying landslides according to published intensity duration storm thresholds, but all products exhibited hit-ratios of greater than 0.56. A greater proportion of landslides were predicted when including only manually-verified landslide locations. We recommend practitioners consider low-latency products like MRMS for investigating landslides, given their near-real time data availability and good performance in detecting landslides. Practitioners would be well-served considering more than one product as a way to confirm intense storm signals and minimize the influence of noise and false alarms.

Precipitation inter-comparison↗
NASA NTRS2020

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗
NASA NTRSDate not supplied

Update on Prediction Uncertainty Reduction (PUR) Tech Challenge

NASA has taken on a Technical Challenge to reduce the uncertainty in prediction of noise from near-term commercial supersonic aircraft. To date, an assessment has been done to baseline this effort, quantifying how much more uncertainty exists when the system-level prediction methods are applied to supersonic aircraft as compared to conventional aircraft. And an assessment has been made for the uncertainty in the physics-based simulations for jets. These will be briefly demonstrated.

supersonic↗
NASA NTRSDate not supplied

ASCoT 3: Nonlinear Principal Components Analysis and Uncertainty Quantification in Early Concept Spacecraft Flight Software Cost Estimation

For mission planners and evaluators alike, value in cost models comes from a mean or median prediction, an understanding of the uncertainty on that prediction, and an understanding of model performance. Here we apply advanced statistical and machine learning methods to spacecraft flight software cost, effort, and SLOC estimation, and present the results in the latest version of the Analogy Software Cost Tool (ASCoT). We present in- and out-of-sample performance metrics for our models, each of which incorporate some amount of epistemic uncertainty. ASCoT, hosted on the One NASA Cost Engineering (ONCE) database via the Online NASA Space Estimation Tool (ONSET), was first showcased in 2016 as a number of analogy-based models and methods (kNN and Clustering) to support early project formulation. This ASCoT update improves upon the previous analogic methods by incorporating uncertainty in the data transformations. In particular, we use a Nonlinear Principal Components Analysis (NLPCA) to deal with ordinal data.

Robotic Spacecraft↗
NASA NTRSDate not supplied

The Relationship Between Two Methods for Estimating Uncertainties in Data Assimilation

This note examines the relationship between two apparently unrelated methods for estimating error statistics or uncertainties of relevance to data assimilation. The first method is due to (Desroziers et al., 2005, Q. J. R. Meteorol. Soc., 131, 3385–3396; referred to as DBCP hereafter) and relies on residual statistics readily available from data assimilation applications. The second method, the three- cornered hat (3CH) developed by Gray and Allan (1974, IEEE 28th Annual Symp. Freq. Control, 243–246), only recently applied to atmospheric sciences, uses three data sets and can derive estimates of relevant error uncertainties as well. The usefulness of both methods lies in them not requiring knowledge of the true value of the quantities at play. DBCP derives its results by relying explicitly on the constraints as- sociated with the data assimilation minimization problem; 3CH is general and its estimates hold as long as errors in the three data sets of choice are uncorrelated. Establishing the relationship between the methods requires applying the 3CH approach to the same observation, background, and analysis data sets used by DBCP. In this case, the same assumptions of DBCP on residual errors allow for cancellation of error cross–covariance terms in 3CH such that two of its corners derive identical estimates for observation and background error covariances as those of DBCP. The error cross–covariance terms associated with the third corner are shown to add up to twice the analysis error covariance so that the 3CH estimate for the third corner recovers the negative of the analysis error covariance. Illustrations of these findings are provided by deriving uncertainties for radio occultation bending angles.

Ricardo Todling↗
NASA NTRS2022

Bayesian Rules of Thumb: Robust Uncertainty Quantification in Early Project Cost Estimation

Systems engineers often make use of cost Rules ofThumb in order to estimate cost during early phases of projectformulation. These Rules of Thumb typically take the form ofa sequence of percentages over which a total cost is allocatedacross NASA WBS elements. Rules of Thumb can then be usedto extrapolate cost from one or more known WBS elements tothe remaining unknown WBS elements, assisting early projectformulation architecture studies (such as those in JPL’s Team Xand A Team).A number of issues can arise when generating and using costRules of Thumb. For example, many records of project costsconsist of incomplete data. Typical methods of dealing withincomplete cost allocation data include (a) ignoring missionswith incomplete data, or (b) taking averages of the non-zero percentagesacross missions, but both of these methods can result inbiased estimates if the existence of incomplete data correlateswith total mission cost or any particular WBS element. Anothercommon example is cost reported in one or more incorrect WBSelements. This is especially prevalent in smaller missions whereit is more common for engineers to perform tasks that fall underthe purview of multiple WBS elements.Furthermore, a Rule of Thumb estimate is typically reported asa point estimate; there is no reported uncertainty around thepercentages used to generate an allocation. Even in the rarecase in which confidence intervals around mean percentages areprovided, there may be positive or negative correlations betweenWBS elements which can skew estimates.Here we attempt to address these problems by formulatingprobabilistic Rules of Thumb in which a distribution of allocationschemes, rather than a single allocation scheme, is generated.We use a bootstrap imputation method to simultaneouslyaccount for uncertainty in the missing data while using allavailable information contained in the dataset. The imputeddatasets are then input into a multivariate Bayesian modelwhich accounts for correlations between WBS elements andproperly accounts for uncertainty in the final Rule of Thumbpercentages and predictions. We describe the mathematicalmodel and provides snippets of R code utilizing the brms(Bayesian Regression Models using Stan) package. To illustratethis model, we generate a Bayesian Level 2 WBS Cost Rule ofThumb for MIDEX (Medium-Class Explorers) missions withdata extracted from NASA’s CADRe. We then compare thismethod’s performance with the classical Rule of Thumb method.

Hooke, Melissa A↗
NASA NTRSDate not supplied

LOFTID Aeroshell Thermal Response Uncertainty Analysis Utilizing the End-to-End Monte Carlo Approach

A probabilistic thermal margin process has been performed to design the flexible thermal protection system (FTPS) and select entry trajectory constraints given an acceptable risk level for the Low-Earth Orbit Flight Test of and Inflatable Decelerator (LOFTID) project. Uncertainties exist in atmospheric entry aeroheating environments and the predicted thermal response of thermal protection system (TPS) material. Entry vehicle TPS is often over-sized to mitigate uncertainty by combining conservative bounding scenarios together. The probabilistic thermal margin process allows engineers to make informed aeroshell design, flight design, and FTPS performance risk trades while preventing excessive FTPS margin from being applied. This paper describes the uncertainty analysis methodology used to carry out a probabilistic thermal margin process used for LOFTID’s aeroshell and explains how the calculated probability of exceeding flight allowable temperatures is used to design the FTPS and establish nominal flight design constraints. This probabilistic thermal margin process had never been applied to entry, decent, and landing design for a flown entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven Andrew Tobin↗
NASA NTRS2024

Uncertainty Quantification of Artemis I Space Launch System Integrated Aerodynamics Databases

Accurate prediction of integrated aerodynamic forces and moments is a necessary part of aerospace vehicle development. This accuracy can be quantified in the form of an uncertainty model, which makes the prediction more useful within an integrated vehicle design effort. Aerodynamic force and moment databases were constructed for the Artemis~I mission of the Space Launch System vehicle. These databases reconcile data from multiple sources to yield unified predictions of how NASA's most advanced launch vehicle interacts with Earth's atmosphere as it ascends into orbit. This paper outlines how the uncertainty quantification was performed for these databases to ensure comprehensive and tractable uncertainty source coverage.

Michael W Lee↗
NASA NTRSDate not supplied

A Comparison of Control Allocation Methods in the Presence of Parametric Model Uncertainty

When allocating redundant effectors to virtual control commands, linear (generalized inverse) allocators have historically been used on aircraft and spacecraft. While simple to implement, generalized inverses are unable to realize a significant portion of the attainable moments. To address this drawback, the control allocation problem can also be formulated as a linear programming or quadratic programming problem and solved using convex optimization based solvers. These approaches have been shown to access a larger set of attainable moments, however, little work has been done to understand the performance of convex optimization-based control allocation in the presence of parametric model uncertainty. This paper seeks to compare the performance of several control allocation approaches, including two forms of generalized inverse allocators, the pseudo inverse and minimum-variance, and the linear programming and quadratic programming approach in the presence of parametric model uncertainty. The performance of these four allocators were tested on an aircraft model in the presence of realistic parametric model uncertainty and the convex optimization approaches were shown to outperform the generalized inverses.

Luke J Miller↗
NASA NTRS2026

Methods for Validation of Random Uncertainty Estimates and Their Applications to Ozone Profiles From Limb-Viewing Satellite Instruments

For satellite measurements of atmospheric composition, the random uncertainty estimates provided by retrieval algorithms might be imperfect due to various approximations used in the retrievals or the presence of unknown error sources. This paper presents an overview of the methods used for the validation of random uncertainty estimates. All methods discussed in this study are categorized, and assumptions and limitations of each method are discussed. This overview evaluates these methods in application to ozone profile measurements from limb and occultation satellite instruments and provides practical illustrations of random uncertainty validation.

Viktoria F Sofieva↗
DOE OSTI2021

State of Stress Uncertainty Quantification and Geomechanical Risk Analysis for Subsurface Engineering

All subsurface stress measurement methods available for deep subsurface applications are indirect and involve a significant amount of uncertainty. Quantifying these uncertainties is critical for applications where the state of stress is a component of a risk analysis with significant safety, environmental, and economic considerations. A publicly available and open source tool called the State of Stress Analysis Tool (SOSAT) has been developed to aid in performing a Bayesian uncertainty quantification and geomechanical risk analysis using many types of commonly available data. A new feature of this tool is using data from the FutureGen 2.0 site. The new feature of the tool was uses information about the absence or presence of borehole breakouts to constrain the state of stress. This new feature allows the user to specify probability distributions for the relevant parameters such as the drilling mud pressure, temperature, and the formation strength properties. The tool computes the posterior joint probability distribution of the horizontal principal stresses. Using random samples from this posterior distribution the tool then computes the probability of activating a critically oriented fault at a range of pore pressures. This latter feature can be used to aid in the assessment of the risk of induced seismicity and leakage in geologic carbon sequestration and enhanced geothermal systems.

Burghardt, Jeffrey A.↗
DOE OSTI2023

Preliminary Results for Uncertainty Quantification on Asymptotic Hydrogen Redistribution in a Prototypical Yttrium-Hydride Moderated Heat-Pipe-Cooled Microreactor

Yttrium hydride is one of the most promising materials for moderating nuclear microreactors. This is due to its high hydrogen concentration at high operating conditions, high value of thermal conductivity, and chemical stability. However, when subject to thermal and concentration spatial gradients, the hydrogen tends to migrate within the yttrium matrix, potentially leading to power swings and reactivity changes. This paper aims to present selected results concerning the sensitivity of the thermal and hydrogen redistribution response for a prototypical heat-pipe-cooled yttrium-hydride moderated microreactor to thermal properties uncertainty and selected design characteristics. To the best knowledge of the authors, this is the first study examining the impact of uncertainties on microreactor hydrogen redistribution response. To achieve this goal, Bison was used in conjunction with Dakota to create a framework able to perform Uncertainty Quantification (UQ) for the Simplified Microreactor Benchmark Assessment (SiMBA) problem.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Investigation of Benchmark $k$ eff Sensitivity and Uncertainty for 239 Pu fission in Specific Energy Ranges

Nuclear data at intermediate energies (from 1 to 100s of keV) are evaluated based on scarce differential data and theory unable to capture physics’ expected structure. There is also a lack of integral data. This is a known deficiency and is challenging to address. Calculated effective multiplication factor, k eff , values for intermediate energy experiments are ~25× further from experiment than for fast energies and are often well outside the experimental uncertainties. The goal of the PARADIGM (PARallel Approach of Differential and InteGral Measurements) project is to significantly re duce the uncertainties of intermediate energy nuclear data for 239 Pu. To this end, PARADIGM simultaneously optimizes experiments at both the Los Alamos Neutron Science Center (LANSCE) and National Criticality Experiments Research Center (NCERC). The combined set of data will inform new intermediate-energy nuclear data. By execution of differential and integral experiments, establishment of new theory, and undertaking nuclear data evaluation in parallel, the timeline to deliver improved nuclear data to users will be reduced significantly that is to three years. For the PARADIGM project, it was decided to optimize an integral experiment for two neutron energy ranges, within the full intermediate energy range. The low energy range goes from 1 to 30 keV, while the higher energy range goes from 30 to 600 keV. This work focuses on nuclear data sensitivities and uncertainties for 239 Pu fission for existing experiments in the International Criticality Safety Benchmark Evaluation Project (ICSBEP). When designing new experiments, it is important to understand what benchmarks currently exist. For a more traditional experiment design (in which a specific application model(s) exists), comparisons would be made between the application model(s) and existing benchmarks. For PARADIGM, there is no specific application model, but instead the specific nuclear data reaction and energy ranges of interest can be explored for existing benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

From Resilient and Ready to Used and Useful: Managing Temporal and Locational Uncertainty in Electrification, DER Adoption, and Climate Adaptation

Grid planning decisions involve weighing risks against benefits. The best decisions will facilitate development of electrical infrastructure that minimizes risk and maximizes benefits. With the rapidly evolving energy landscape, today's planner must discern new loads and demand cycles; embrace the operational complexity of climate risk; revise settled standards; and anticipate and manage the system impacts of distributed energy resource (DER) adoption. Only by managing the combined uncertainty of these dynamic processes can a planner hope to make effective decisions. Our analysis focuses on the management of temporal and locational uncertainty, and particularly on the risks presented to customers by the mismanagement of the factors that are the sources of these uncertainties.

climate↗
DOE OSTI2024

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne↗
DOE OSTI2023

The Reduction of Random Uncertainty in Differential Temperature Measurements Using Common Leg Thermocouples

The uncertainty quantification of random error is considered for common leg thermocouples (i.e., where one thermoelement is shared along the length of the TC for all other TC junctions present). The uncertainty is presented for both a common leg and individual, separate leg thermocouples. For Type K thermocouples a reduction in uncertainty by up to 3x is capable when differential temperatures, ?T, are within 150°C, and diminishes to little to no improvement above 150°C.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2024

ECAR-7932 Rev 0 Large Eddy Simulation of MARVEL Reactor Core Subchannel to Evaluate Model Uncertainty of Reynolds-Averaged Navier-Stokes Equation Based Computational Fluid Dynamics Analysis

In the previous work (ECAR-7210), the peak cladding temperature of the MARVEL microreactor has been evaluated by steady-state Reynolds-Averaged Navier-Stokes (RANS) based computational fluid dynamics (CFD) simulations. Although numerical uncertainties of RANS-based CFD simulations has been assessed in ECAR-7210, the model uncertainty of RANS turbulence models must be investigated to resolve the issues related to inaccurate prediction of turbulent heat flux and flow pulsation in a tight lattice rod bundle using the steady-state RANS simulations. Consequently, this ECAR conducted a high-fidelity CFD analysis utilizing Large Eddy Simulation (LES) to generate reference data and investigated the model uncertainty of RANS-based CFD simulations.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗