End-to-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty
Explore the source record for details and available documents.
Ben D. Phillips↗
SEARCH · Engineering Papers
Results for “uncertainty Quantification”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems
In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.
CPH systems↗
Combining Data with Physical Knowledge for Uncertainty Quantification in Certification and Reliability Analysis
Unifying empirical data with predictive models can enable engineering cost-savings through certification by analysis and reliability-based design. Both concepts require rigorous uncertainty quantification (UQ) and robust understanding and treatment of relevant physics. Combining sampling-based UQ algorithms with high-fidelity simulations creates a computational bottleneck that is often alleviated through the use of machine learning (ML). ML can be used to create computationally efficient surrogates for simulations of complex or high-dimensional physical interactions (e.g., multi-phase interactions associated with melt pools in laser powder bed fusion or spatially-dependent material properties in functionally graded materials). However, negative side effects of ML may include a lack of interpretability and negative correlation between event rarity and simulation accuracy due to a lack of training data. As such, it is important to infuse ML algorithms with physics-based guardrails to provide confidence in their predictions. This talk will provide a brief review of recent NASA research at this intersection of physics-based simulation, ML, and UQ with a focus on certification and reliability analysis.
uncertainty quantification↗
Multifidelity Uncertainty Quantification of a Commercial Supersonic Transport
The objective of this work was to develop a multifidelity uncertainty quantification approach for efficient analysis of a commercial supersonic transport. An approach based on non-intrusive polynomial chaos was formulated in which a low-fidelity model could be corrected by any number of high-fidelity models. The formulation and methodology also allows for the addition of uncertainty sources not present in the lower fidelity models. To demonstrate the applicability of the multifidelity polynomial chaos approach, two model problems were explored. The first was supersonic airfoil with three levels of modeling fidelity, each capturing an additional level of physics. The second problem was a commercial supersonic transport. This model had three levels of fidelity that included two different modeling approaches and the addition of physics between the fidelity levels. Both problems illustrate the applicability and significant computational savings of the multifidelity polynomial chaos method.
West, Thomas K., IV↗
Advanced Modeling and Uncertainty Quantification for Flight Dynamics; Interim Results and Challenges
As part of the NASA Vehicle Systems Safety Technologies (VSST), Assuring Safe and Effective Aircraft Control Under Hazardous Conditions (Technical Challenge #3), an effort is underway within Boeing Research and Technology (BR&T) to address Advanced Modeling and Uncertainty Quantification for Flight Dynamics (VSST1-7). The scope of the effort is to develop and evaluate advanced multidisciplinary flight dynamics modeling techniques, including integrated uncertainties, to facilitate higher fidelity response characterization of current and future aircraft configurations approaching and during loss-of-control conditions. This approach is to incorporate multiple flight dynamics modeling methods for aerodynamics, structures, and propulsion, including experimental, computational, and analytical. Also to be included are techniques for data integration and uncertainty characterization and quantification. This research shall introduce new and updated multidisciplinary modeling and simulation technologies designed to improve the ability to characterize airplane response in off-nominal flight conditions. The research shall also introduce new techniques for uncertainty modeling that will provide a unified database model comprised of multiple sources, as well as an uncertainty bounds database for each data source such that a full vehicle uncertainty analysis is possible even when approaching or beyond Loss of Control boundaries. Methodologies developed as part of this research shall be instrumental in predicting and mitigating loss of control precursors and events directly linked to causal and contributing factors, such as stall, failures, damage, or icing. The tasks will include utilizing the BR&T Water Tunnel to collect static and dynamic data to be compared to the GTM extended WT database, characterizing flight dynamics in off-nominal conditions, developing tools for structural load estimation under dynamic conditions, devising methods for integrating various modeling elements into a real-time simulation capability, generating techniques for uncertainty modeling that draw data from multiple modeling sources, and providing a unified database model that includes nominal plus increments for each flight condition. This paper presents status of testing in the BR&T water tunnel and analysis of the resulting data and efforts to characterize these data using alternative modeling methods. Program challenges and issues are also presented.
Hyde, David C.↗
Uncertainty Quantification Methodology for Sonic Boom Loudness of a Low-Boom Supersonic Concept
This paper presents a comprehensive analysis of uncertainty quantification for sonic boom loudness metrics associated with the X-59 aircraft during its acoustic validation phase. The study focuses on employing advanced methodologies to characterize uncertainties in key sonic boom parameters predicted from a database derived from a computational fluid dynamics (CFD) solver. These methodologies include creating a polynomial chaos expansion (PCE) surrogate model, which is then used to run a Monte Carlo analysis to obtain 95% uncertainty intervals for sonic boom loudness parameters across the full carpet. Atmospheric uncertainties are rigorously considered, leveraging weather models based on historical data near Edwards Air Force Base to simulate potential flight conditions. The findings include preliminary uncertainty results for the full carpet during the validation phase of the Quesst mission. Additionally, a sensitivity study reveals that the primary sources of uncertainty are humidity and cruise weight.
Laura M. White↗
Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems
The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.
Uncertainty Quantification↗
Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems
The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.
Uncertainty Quantification↗
Uncertainty Quantification of Artemis I Space Launch System Integrated Aerodynamics Databases
Accurate prediction of integrated aerodynamic forces and moments is a necessary part of aerospace vehicle development. This accuracy can be quantified in the form of an uncertainty model, which makes the prediction more useful within an integrated vehicle design effort. Aerodynamic force and moment databases were constructed for the Artemis~I mission of the Space Launch System vehicle. These databases reconcile data from multiple sources to yield unified predictions of how NASA's most advanced launch vehicle interacts with Earth's atmosphere as it ascends into orbit. This paper outlines how the uncertainty quantification was performed for these databases to ensure comprehensive and tractable uncertainty source coverage.
Michael W Lee↗
Numerical Uncertainty Quantification for Radiation Analysis Tools
Recently a new emphasis has been placed on engineering applications of space radiation analyses and thus a systematic effort of Verification, Validation and Uncertainty Quantification (VV&UQ) of the tools commonly used for radiation analysis for vehicle design and mission planning has begun. There are two sources of uncertainty in geometric discretization addressed in this paper that need to be quantified in order to understand the total uncertainty in estimating space radiation exposures. One source of uncertainty is in ray tracing, as the number of rays increase the associated uncertainty decreases, but the computational expense increases. Thus, a cost benefit analysis optimizing computational time versus uncertainty is needed and is addressed in this paper. The second source of uncertainty results from the interpolation over the dose vs. depth curves that is needed to determine the radiation exposure. The question, then, is what is the number of thicknesses that is needed to get an accurate result. So convergence testing is performed to quantify the uncertainty associated with interpolating over different shield thickness spatial grids.
Anderson, Brooke↗
Aerothermal Uncertainty Quantification of Deployable Entry Technologies Using Multi-Fidelity Modeling
The objective of this work was to investigate the use of a co-Kriging based multi-fidelity modeling approach with a Monte Carlo uncertainty quantification analyses of surface heating on hypersonic inflatable aerodynamic decelerator vehicles and adaptable, deployable entry placement technology vehicles in Mars entry. A previously developed co-Kriging based multi-fidelity modeling approach was used to model the laminar and turbulent convective and radiative heat fluxes along the vehicle. Monte Carlo analyses of surface heat load for nine different vehicle nose radii was performed for both vehicles, assuming the same thermal protection system is used for both vehicles. The maximum heat loads and heat load uncertainties were found to occur at either the stagnation point or the vehicle shoulder. The maximum 95% confidence intervals for the total heat load for the hypersonic inflatable aerodynamic decelerator vehicle were found to be [-9.27, 7.81] % of the nominal value and [-6.09, 13.1] % of the nominal value for laminar and turbulent flow, respectively. The maximum 95% confidence intervals for the total heat load for the adaptable, deployable entry placement technology vehicle were found to be [-8.85, 7.22] % of the nominal value and [-9.33, 9.35] % of the nominal value for laminar and turbulent flow, respectively. The difference in heating uncertainties based on vehicle geometry between the two vehicle technologies was found to be minimal.
Mario Santos↗
Model Update of a Micro Air Vehicle (MAV) Flexible Wing Frame with Uncertainty Quantification
This paper describes a procedure to update parameters in the finite element model of a Micro Air Vehicle (MAV) to improve displacement predictions under aerodynamics loads. Because of fabrication, materials, and geometric uncertainties, a statistical approach combined with Multidisciplinary Design Optimization (MDO) is used to modify key model parameters. Static test data collected using photogrammetry are used to correlate with model predictions. Results show significant improvements in model predictions after parameters are updated; however, computed probabilities values indicate low confidence in updated values and/or model structure errors. Lessons learned in the areas of wing design, test procedures, modeling approaches with geometric nonlinearities, and uncertainties quantification are all documented.
Reaves, Mercedes C.↗
Uncertainty Quantification and Statistical Engineering for Hypersonic Entry Applications
NASA has invested significant resources in developing and validating a mathematical construct for TPS margin management: a) Tailorable for low/high reliability missions; b) Tailorable for ablative/reusable TPS; c) Uncertainty Quantification and Statistical Engineering are valuable tools not exploited enough; and d) Need to define strategies combining both Theoretical Tools and Experimental Methods. The main reason for this lecture is to give a flavor of where UQ and SE could contribute and hope that the broader community will work with us to improve in these areas.
Cozmuta, Ioana↗
Simulation Credibility: Advances in Verification, Validation, and Uncertainty Quantification
Decision makers and other users of simulations need to know quantified simulation credibility to make simulation-based critical decisions and effectively use simulations, respectively. The credibility of a simulation is quantified by its accuracy in terms of uncertainty, and the responsibility of establishing credibility lies with the creator of the simulation. In this volume, we present some state-of-the-art philosophies, principles, and frameworks. The contributing authors involved in this publication have been dedicated to advancing simulation credibility. They detail and provide examples of key advances over the last 10 years in the processes used to quantify simulation credibility: verification, validation, and uncertainty quantification. The philosophies and assessment methods presented here are anticipated to be useful to other technical communities conducting continuum physics-based simulations; for example, issues related to the establishment of simulation credibility in the discipline of propulsion are discussed. We envision that simulation creators will find this volume very useful to guide and assist them in quantitatively conveying the credibility of their simulations.
Simulation Credibility↗
AeroFusion: Data Fusion and Uncertainty Quantification for Entry Vehicles
AeroFusion is a NASA Langley initiative to incorporate advances in data science into the aerodynamic modeling process to improve efficiency. The effort can largely be categorized in three components: reduced-order modeling techniques, surrogate modeling techniques, and uncertainty quantification. By combining various methods from these categories, AeroFusion aims to reduce the development cost of aerodynamic models, both in terms of time and money.
Steven Snyder↗
AeroFusion: Data Fusion and Uncertainty Quantification for Entry Vehicles
AeroFusion is a NASA Langley initiative to incorporate advances in data science into the aerodynamic modeling process to improve efficiency. The effort can largely be categorized in three components: reduced-order modeling techniques, surrogate modeling techniques, and uncertainty quantification. By combining various methods from these categories, AeroFusion aims to reduce the development cost of aerodynamic models, both in terms of time and money.
Steven Snyder↗
Uncertainty Quantification of Modeled Electron Backstreaming Failure for the NEXT Ion Thruster
Excessive electron back streaming is one of the primary life-limiting failure modes for gridded ion thrusters. Physics-based modeling of the optics grid erosion and electron back streaming margins is augmented with statistical uncertainty quantification techniques to generate a life expectancy distribution of this particular failure mechanism for the NEXT ion thruster. Generation of distributions instead of a single point estimate provide a more comprehensive picture of thruster failure probabilities and life expectation for various mission applications.
Yim, John T.↗
Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design
A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.
Benek, John A.↗