Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity and Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1995

Credible Computations: Standard and Uncertainty

The discipline of computational fluid dynamics (CFD) is at a crossroad. Most of the significant advances related to computational methods have taken place. The emphasis is now shifting from methods to results. Significant efforts are made in applying CFD to solve design problems. The value of CFD results in design depends on the credibility of computed results for the intended use. The process of establishing credibility requires a standard so that there is a consistency and uniformity in this process and in the interpretation of its outcome. The key element for establishing the credibility is the quantification of uncertainty. This paper presents salient features of a proposed standard and a procedure for determining the uncertainty. A customer of CFD products - computer codes and computed results - expects the following: A computer code in terms of its logic, numerics, and fluid dynamics and the results generated by this code are in compliance with specified requirements. This expectation is fulfilling by verification and validation of these requirements. The verification process assesses whether the problem is solved correctly and the validation process determines whether the right problem is solved. Standards for these processes are recommended. There is always some uncertainty, even if one uses validated models and verified computed results. The value of this uncertainty is important in the design process. This value is obtained by conducting a sensitivity-uncertainty analysis. Sensitivity analysis is generally defined as the procedure for determining the sensitivities of output parameters to input parameters. This analysis is a necessary step in the uncertainty analysis, and the results of this analysis highlight which computed quantities and integrated quantities in computations need to be determined accurately and which quantities do not require such attention. Uncertainty analysis is generally defined as the analysis of the effect of the uncertainties involved in all stages of a process on the final responses. There are two approaches for conducting the uncertainty analysis: experimental and computational. These analyses and approaches are briefly described.

Mehta, Unmeel B.↗
NASA NTRS2016

Uncertainty and Sensitivity Analysis of Afterbody Radiative Heating Predictions for Earth Entry

The objective of this work was to perform sensitivity analysis and uncertainty quantification for afterbody radiative heating predictions of Stardust capsule during Earth entry at peak afterbody radiation conditions. The radiation environment in the afterbody region poses significant challenges for accurate uncertainty quantification and sensitivity analysis due to the complexity of the flow physics, computational cost, and large number of un-certain variables. In this study, first a sparse collocation non-intrusive polynomial chaos approach along with global non-linear sensitivity analysis was used to identify the most significant uncertain variables and reduce the dimensions of the stochastic problem. Then, a total order stochastic expansion was constructed over only the important parameters for an efficient and accurate estimate of the uncertainty in radiation. Based on previous work, 388 uncertain parameters were considered in the radiation model, which came from the thermodynamics, flow field chemistry, and radiation modeling. The sensitivity analysis showed that only four of these variables contributed significantly to afterbody radiation uncertainty, accounting for almost 95% of the uncertainty. These included the electronic- impact excitation rate for N between level 2 and level 5 and rates of three chemical reactions in uencing N, N(+), O, and O(+) number densities in the flow field.

West, Thomas K., IV↗
NASA NTRS2017

Summary Findings from the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in Greece in 2008 identified many promising sensitivity analysis and uncertainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not clear. The NATO Science and Technology Organization, Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic vehicle development problems. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper summarizes findings and lessons learned from the task group.

Benek, John A.↗
NASA NTRS2017

Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.

Benek, John A.↗
NASA NTRS2014

The NASA Langley Multidisciplinary Uncertainty Quantification Challenge

This paper presents the formulation of an uncertainty quantification challenge problem consisting of five subproblems. These problems focus on key aspects of uncertainty characterization, sensitivity analysis, uncertainty propagation, extreme-case analysis, and robust design.

Crespo, Luis G.↗
NASA NTRS1991

Some Aspects of uncertainty in computational fluid dynamics results

Uncertainties are inherent in computational fluid dynamics (CFD). These uncertainties need to be systematically addressed and managed. Sources of these uncertainty analysis are discussed. Some recommendations are made for quantification of CFD uncertainties. A practical method of uncertainty analysis is based on sensitivity analysis. When CFD is used to design fluid dynamic systems, sensitivity-uncertainty analysis is essential.

Mehta, U. B.↗
NASA NTRS2017

Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept

The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.

Noyes, Connor↗
NASA NTRS1992

Sensitivity of wildlife habitat models to uncertainties in GIS data

Decision makers need to know the reliability of output products from GIS analysis. For many GIS applications, it is not possible to compare these products to an independent measure of 'truth'. Sensitivity analysis offers an alternative means of estimating reliability. In this paper, we present a CIS-based statistical procedure for estimating the sensitivity of wildlife habitat models to uncertainties in input data and model assumptions. The approach is demonstrated in an analysis of habitat associations derived from a GIS database for the endangered California condor. Alternative data sets were generated to compare results over a reasonable range of assumptions about several sources of uncertainty. Sensitivity analysis indicated that condor habitat associations are relatively robust, and the results have increased our confidence in our initial findings. Uncertainties and methods described in the paper have general relevance for many GIS applications.

Stoms, David M.↗
NASA NTRSDate not supplied

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit (CPU) on the order of ~30s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗
NASA NTRSDate not supplied

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit(CPU)on the order of ~30 s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗
NASA NTRS1995

Verification and Validation of Simulation Models for High-Speed Flow Fields

This paper is largely based on the paper titled "Guide to Credible Computational Fluid Dynamics Simulations (Invited)" (AIAA Paper 95-2225). The significance of computational fluid dynamics (CFD) simulations depends solely on their credibility. A customer of CFD products -- simulations and software -- expects that these products are credible for the intended use. Simulation model verification and validation are critical in establishing the credibility of simulations and in certifying simulation software. The only thing that matters in establishing the credibility is uncertainty, not veracity or validity. The sensitivity-uncertainty analysis is the key to the establishment of this credibility. Assessing the credibility of complex simulation results poses a significant challenge. Terminology, concepts, framework, and guidelines are presented for addressing this challenge. Verification assesses whether the problem is solved correctly and estimates the level of computational accuracy of simulations; validation determines whether the right problem is solved and assesses the level of validity of the simulation model by estimating the degree to which simulations accurately represent reality. These concepts and the related guidelines are discussed with examples from high-speed flow fields.

Mehta, Unmeel B.↗
NASA NTRSDate not supplied

The Nasa Multiscale Analysis Tool: an Enabling Platform for Achieving Vision 2040

Vision 2040 is a community-driven consensus document, written in 2018, aimed at defining the potential 25-year future state required for performing integrated multiscale modeling of materials and systems for future aerospace and aeronautical applications. Nine Vision Key Elements (KEs) were defined along with associated technical gaps. This paper will address current NASA GRC research efforts utilizing the NASA Multiscale Analysis Tool (NASMAT). This paper will specifically focus on NASMAT’s ability to address gaps in three of the nine Vision 2040 KEs: 1) Models and Methods, 2) Multiscale Measurements and Characterization Tools and Methods, and 6) Data, Informatics, and Visualization. NASMAT is a versatile platform for performing computationally efficient multiscale analyses of heterogeneous materials. NASMAT offers the user flexibility to define an arbitrary number of length scales (levels) where a variety of micromechanics theories can be implemented at each level. Micromechanics theories can be selected to balance accuracy and computational efficiency and range from analytical (Mori-Tanaka) to several semi-analytical (method of cells) formulations. NASMAT can also be coupled with external software and used to perform multiscale analyses of more complex structures. The paper will include a recent application of NASMAT to model a complex, three-dimensional woven composite, with a particular emphasis placed on multiscale measurements utilized to enhance the quality of the multiscale analysis. Since typical NASMAT analyses can be completed in on the order of seconds to minutes, a second example will demonstrate NASMAT’s ability to generate large quantities of data useful for sensitivity analysis, uncertainty quantification, or machine learning applications. Current progress on developing multiscale data visualization tools will also be addressed along with the challenges associated with and proposed solutions for sifting through large amounts of data. These examples will demonstrate that NASMAT is an enabling platform for achieving the goals in Vision 2040.

Vision 2040↗
NASA NTRS2023

An Enabling Platform for Achieving Multiscale Multiphysics Analysis of Multiphase Materials

This paper will address current NASA GRC research efforts utilizing the NASA Multiscale Analysis Tool (NASMAT) which address technical gaps in three of the Vision 2040 key discipline areas. NASMAT is a versatile platform for performing computationally efficient multiscale analyses of heterogeneous materials and is available free through the NASA software catalog. It offers the user flexibility to define an arbitrary number of length scales (levels) where a variety of micromechanics theories can be implemented at each level. Micromechanics theories can be selected to balance accuracy and computational efficiency and range from analytical (Mori-Tanaka) to several semi-analytical (method of cells) formulations. The resulting anisotropic, evolving nonlinear, thermomechanical constitutive model can also be coupled with external software and used to perform multiscale analyses of more complex structures. A recent application to model a complex, three-dimensional woven composite, with a particular emphasis placed on multiscale measurements utilized to enhance the quality of the multiscale analysis will be discussed. Since typical NASMAT analyses can be completed on the order of seconds to minutes, a second example will demonstrate the ability to generate large quantities of data useful for sensitivity analysis, uncertainty quantification, or machine learning applications. Current progress on implementing NASMAT within a multiscale digital thread/digital twin framework will also be addressed. These examples will demonstrate that NASMAT is an enabling platform for achieving the goals in Vision 2040.

Multiscale↗
NASA NTRSDate not supplied

Uncertainty Quantification and Sensitivity Analysis in Process-Structure-Property Simulations for Laser Powder Bed Fusion Additive Manufacturing

Process variations and process-induced defects like porosity cause significant uncertainty in the microstructure and mechanical behavior of additively manufactured metals. Establishing process-structure-property (PSP) relationships and quantifying uncertainty using experiments alone is costly, especially for structural applications where mechanical allowables must be established for qualification and certification. This work presents a PSP simulation framework for laser powder bed fusion with a focus on uncertainty quantification through probabilistic calibration and multi-fidelity uncertainty propagation. Motivated by phenomenological input parameters related to grain nucleation and growth that are difficult to characterize, a global sensitivity analysis (GSA) is completed. Through GSA, the most important input parameters are identified based on their influence on the statistical distributions of microstructural metrics that influence mechanical behavior, including grain size, morphology, and crystallographic texture. The results provide insight on what experiments are necessary to quantify and control PSP uncertainties, particularly those associated with the more challenging input parameters.

additive manufacturing↗
NASA NTRS2016

Uncertainty Reduction using Bayesian Inference and Sensitivity Analysis: A Sequential Approach to the NASA Langley Uncertainty Quantification Challenge

This paper presents a computational framework for uncertainty characterization and propagation, and sensitivity analysis under the presence of aleatory and epistemic un- certainty, and develops a rigorous methodology for efficient refinement of epistemic un- certainty by identifying important epistemic variables that significantly affect the overall performance of an engineering system. The proposed methodology is illustrated using the NASA Langley Uncertainty Quantification Challenge (NASA-LUQC) problem that deals with uncertainty analysis of a generic transport model (GTM). First, Bayesian inference is used to infer subsystem-level epistemic quantities using the subsystem-level model and corresponding data. Second, tools of variance-based global sensitivity analysis are used to identify four important epistemic variables (this limitation specified in the NASA-LUQC is reflective of practical engineering situations where not all epistemic variables can be refined due to time/budget constraints) that significantly affect system-level performance. The most significant contribution of this paper is the development of the sequential refine- ment methodology, where epistemic variables for refinement are not identified all-at-once. Instead, only one variable is first identified, and then, Bayesian inference and global sensi- tivity calculations are repeated to identify the next important variable. This procedure is continued until all 4 variables are identified and the refinement in the system-level perfor- mance is computed. The advantages of the proposed sequential refinement methodology over the all-at-once uncertainty refinement approach are explained, and then applied to the NASA Langley Uncertainty Quantification Challenge problem.

Uncertainty↗
NASA NTRS2007

Computational Support for Technology- Investment Decisions

Strategic Assessment of Risk and Technology (START) is a user-friendly computer program that assists human managers in making decisions regarding research-and-development investment portfolios in the presence of uncertainties and of non-technological constraints that include budgetary and time limits, restrictions related to infrastructure, and programmatic and institutional priorities. START facilitates quantitative analysis of technologies, capabilities, missions, scenarios and programs, and thereby enables the selection and scheduling of value-optimal development efforts. START incorporates features that, variously, perform or support a unique combination of functions, most of which are not systematically performed or supported by prior decision- support software. These functions include the following: Optimal portfolio selection using an expected-utility-based assessment of capabilities and technologies; Temporal investment recommendations; Distinctions between enhancing and enabling capabilities; Analysis of partial funding for enhancing capabilities; and Sensitivity and uncertainty analysis. START can run on almost any computing hardware, within Linux and related operating systems that include Mac OS X versions 10.3 and later, and can run in Windows under the Cygwin environment. START can be distributed in binary code form. START calls, as external libraries, several open-source software packages. Output is in Excel (.xls) file format.

Adumitroaie, Virgil↗
NASA NTRS2016

Microgravity-Induced Physiological Fluid Redistribution: Computational Analysis to Assess Influence of Physiological Parameters

Space flight impacts human physiology in many ways, the most immediate being the marked cephalad (headward) shift of fluid upon introduction into the microgravity environment. This physiological response to microgravity points to the redistribution of blood and interstitial fluid as a major factor in the loss of venous tone and reduction in heart muscle efficiency which impact astronaut performance. In addition, researchers have hypothesized that a reduction in astronaut visual acuity, part of the Visual Impairment and Intracranial Pressure (VIIP) syndrome, is associated with this redistribution of fluid. VIIP arises within several months of beginning space flight and includes a variety of ophthalmic changes including posterior globe flattening, distension of the optic nerve sheath, and kinking of the optic nerve. We utilize a suite of lumped parameter models to simulate microgravity-induced fluid redistribution in the cardiovascular, central nervous and ocular systems to provide initial and boundary data to a 3D finite element simulation of ocular biomechanics in VIIP. Specifically, the lumped parameter cardiovascular model acts as the primary means of establishing how microgravity, and the associated lack of hydrostatic gradient, impacts fluid redistribution. The cardiovascular model consists of 16 compartments, including three cerebrospinal fluid (CSF) compartments, three cranial blood compartments, and 10 thoracic and lower limb blood compartments. To assess the models capability to address variations in physiological parameters, we completed a formal uncertainty and sensitivity analysis that evaluated the relative importance of 42 input parameters required in the model on relative compartment flows and compartment pressures. Utilizing the model in a pulsatile flow configuration, the sensitivity analysis identified the ten parameters that most influenced each compartment pressure. Generally, each compartment responded appropriately to parameter variations associated with itself and adjacent compartments. However, several unexpected interactions between components, such as between the choroid plexus and the lower capillaries, were found, and are due to simplifications in the formulation of the model. The analysis illustrates that highly influential parameters and those that have unique influences within the model formulation must be tightly controlled for successful model application.

gravitational physiology↗
NASA NTRS1998

Space Shuttle Main Engine Quantitative Risk Assessment: Illustrating Modeling of a Complex System with a New QRA Software Package

During 1997, a team from Hernandez Engineering, MSFC, Rocketdyne, Thiokol, Pratt & Whitney, and USBI completed the first phase of a two year Quantitative Risk Assessment (QRA) of the Space Shuttle. The models for the Shuttle systems were entered and analyzed by a new QRA software package. This system, termed the Quantitative Risk Assessment System(QRAS), was designed by NASA and programmed by the University of Maryland. The software is a groundbreaking PC-based risk assessment package that allows the user to model complex systems in a hierarchical fashion. Features of the software include the ability to easily select quantifications of failure modes, draw Event Sequence Diagrams(ESDs) interactively, perform uncertainty and sensitivity analysis, and document the modeling. This paper illustrates both the approach used in modeling and the particular features of the software package. The software is general and can be used in a QRA of any complex engineered system. The author is the project lead for the modeling of the Space Shuttle Main Engines (SSMEs), and this paper focuses on the modeling completed for the SSMEs during 1997. In particular, the groundrules for the study, the databases used, the way in which ESDs were used to model catastrophic failure of the SSMES, the methods used to quantify the failure rates, and how QRAS was used in the modeling effort are discussed. Groundrules were necessary to limit the scope of such a complex study, especially with regard to a liquid rocket engine such as the SSME, which can be shut down after ignition either on the pad or in flight. The SSME was divided into its constituent components and subsystems. These were ranked on the basis of the possibility of being upgraded and risk of catastrophic failure. Once this was done the Shuttle program Hazard Analysis and Failure Modes and Effects Analysis (FMEA) were used to create a list of potential failure modes to be modeled. The groundrules and other criteria were used to screen out the many failure modes that did not contribute significantly to the catastrophic risk. The Hazard Analysis and FMEA for the SSME were also used to build ESDs that show the chain of events leading from the failure mode occurence to one of the following end states: catastrophic failure, engine shutdown, or siccessful operation( successful with respect to the failure mode under consideration).

Smart, Christian↗