Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Rocket engine system reliability analyses using probabilistic and fuzzy logic techniques

The reliability of rocket engine systems was analyzed by using probabilistic and fuzzy logic techniques. Fault trees were developed for integrated modular engine (IME) and discrete engine systems, and then were used with the two techniques to quantify reliability. The IRRAS (Integrated Reliability and Risk Analysis System) computer code, developed for the U.S. Nuclear Regulatory Commission, was used for the probabilistic analyses, and FUZZYFTA (Fuzzy Fault Tree Analysis), a code developed at NASA Lewis Research Center, was used for the fuzzy logic analyses. Although both techniques provided estimates of the reliability of the IME and discrete systems, probabilistic techniques emphasized uncertainty resulting from randomness in the system whereas fuzzy logic techniques emphasized uncertainty resulting from vagueness in the system. Because uncertainty can have both random and vague components, both techniques were found to be useful tools in the analysis of rocket engine system reliability.

Hardy, Terry L.↗

Probabilistic simulation of long term behavior in polymer matrix composites

A methodology to compute cumulative probability distribution functions (CDF) of fatigue life for different ratios, r of applied stress to the laminate strength based on first ply failure criteria has been developed and demonstrated. Degradation effects due to long term environmental exposure and mechanical cyclic loads are considered in the simulation process. A unified time-stress dependent multi-factor interaction equation model developed at NASA Lewis Research Center has been used to account for the degradation/aging of material properties due to cyclic loads. Fast probability integration method is used to perform probabilistic simulation of uncertainties. Sensitivity of fatigue life reliability to uncertainties in the primitive random variables are computed and their significance in the reliability based design for maximum life is discussed. The results show that the graphite/epoxy (0/+45/90) deg laminate with ply thickness 0.125 in. has 500,000 cycles life for applied stress to laminate strength ratio of 0.6 and a reliability of 0.999. Also, the fatigue life reliability has been found to be most sensitive to the ply thickness and matrix tensile strength. Tighter quality controls must therefore be enforced on ply thickness and matrix strength in order to achieve high reliability of the structure.

Shah, A. R.↗

The Challenges of Credible Thermal Protection System Reliability Quantification

The paper discusses several of the challenges associated with developing a credible reliability estimate for a human-rated crew capsule thermal protection system. The process of developing such a credible estimate is subject to the quantification, modeling and propagation of numerous uncertainties within a probabilistic analysis. The development of specific investment recommendations, to improve the reliability prediction, among various potential testing and programmatic options is then accomplished through Bayesian analysis.

Green, Lawrence L.↗

Overview of Probabilistic Methods for SAE G-11 Meeting for Reliability and Uncertainty Quantification for DoD TACOM Initiative with SAE G-11 Division

The SAE G-11 RMSL Division and Probabilistic Methods Committee meeting during October 6-8 at the Best Western Sterling Inn, Sterling Heights (Detroit), Michigan is co-sponsored by US Army Tank-automotive & Armaments Command (TACOM). The meeting will provide an industry/government/academia forum to review RMSL technology; reliability and probabilistic technology; reliability-based design methods; software reliability; and maintainability standards. With over 100 members including members with national/international standing, the mission of the G-11's Probabilistic Methods Committee is to "enable/facilitate rapid deployment of probabilistic technology to enhance the competitiveness of our industries by better, faster, greener, smarter, affordable and reliable product development."

Singhal, Surendra N.↗

Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensembles

Visualizing the uncertainty of ensemble simulations is challenging due to the large size and multivariate and temporal features of en-semble data sets. One popular approach to studying the uncertainty of ensembles is analyzing the positional uncertainty of the level sets. Probabilistic marching cubes is a technique that performs Monte Carlo sampling of multivariate Gaussian noise distributions for positional uncertainty visualization of level sets. However, the technique suffers from high computational time, making interactive visualization and analysis impossible to achieve. This paper introduces a deep-learning-based approach to learning the level-set uncertainty for two-dimensional ensemble data with a multivariate Gaussian noise assumption. We train the model using the first few time steps from time-varying ensemble data in our workflow. We demonstrate that our trained model accurately infers uncertainty in level sets for new time steps and is up to 170X faster than that of the original probabilistic model with serial computation and 10X faster than that of the original parallel computation.

Han, Mengjiao↗

Assessing Uncertainty in Modeling Stress Corrosion Cracking

This report summarizes the collaboration between Sandia National Laboratories (SNL) and the Nuclear Regulatory Commission (NRC) to improve the state of knowledge on chloride induced stress corrosion cracking (CISCC). The foundation of this work relied on using SNL’s CISCC computer code to assess the current state of knowledge for probabilistically modeling CISCC on stainless steel canisters. This work is presented as three tasks. The first task is exploring and independently comparing crack growth rate (CGR) models typically used in CISCC modeling by the research community. The second task is implementing two of the more conservative CGR models from the first task into SNL’s full CISCC code to understand the impact of the different CGR models on a full probabilistic analysis while studying uncertainty from three key input parameters. The combined work of the first two tasks showed that properly measuring salt deposition rates is impactful to reducing uncertainty when modeling CISCC. The work in Task 2 also showed how probabilistic CGR models can be more appropriate at capturing aleatory uncertainty when modeling SCC. Lastly, appropriate and realistic input parameters relevant for CISCC modeling were documented in the last task as a product of the simulations considered in the first two tasks.

36 MATERIALS SCIENCE↗

Data-Driven Computation of Probabilistic Marching Cubes for Efficient Visualization of Level-Set Uncertainty

Uncertainty visualization is an important emerging research area. Being able to visualize data uncertainty can help scientists improve trust in analysis and decision-making. However, visualizing uncertainty can add computational overhead, which can hinder the efficiency of analysis. In this paper, we propose novel data-driven techniques to reduce the computational requirements of the probabilistic marching cubes (PMC) algorithm. PMC is an uncertainty visualization technique that studies how uncertainty in data affects level-set positions. However, the algorithm relies on expensive Monte Carlo (MC) sampling for the multivariate Gaussian uncertainty model because no closed-form solution exists for the integration of multivariate Gaussian. In this work, we propose the eigenvalue decomposition and adaptive probability model techniques that reduce the amount of MC sampling in the original PMC algorithm and hence speed up the computations. Our proposed methods produce results that show negligible differences compared with the original PMC algorithm demonstrated through metrics, including root mean squared error, maximum error, and difference images. We demonstrate the performance and accuracy evaluations of our data-driven methods through experiments on synthetic and real datasets.

Athawale, Tushar↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Unmitigated uncertainties are known to have previously led to failed development programs; in order to combat these uncertainties, risks and their impacts must be understood and handled to ensure program success. In this paper, a probabilistic methodology to handle uncertainties is demonstrated on a three-element Human Landing System (HLS) concept, which allows tracking of current best estimates of the vehicle’s performance and assessment of its robustness against uncertainties. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as to model the HLS architecture. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. Range estimating — a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities — is then adapted with operational parameters as well as vehicle parameters in the DYREQT model to capture mission uncertainty alongside vehicle uncertainty. To perform the range estimation portion of this methodology, the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the set of uncertainty parameters. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo on the surrogate models. This probabilistic methodology was proved to provide insight into the underlying uncertainties of the three-element HLS architecture.

Stephanie Y Zhu↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Unmitigated uncertainties are known to have previously led to failed development programs; in order to combat these uncertainties, risks and their impacts must be understood and handled to ensure program success. In this paper, a probabilistic methodology to handle uncertainties is demonstrated on a three-element Human Landing System (HLS) concept, which allows tracking of current best estimates of the vehicle’s performance and assessment of its robustness against uncertainties. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as to model the HLS architecture. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. Range estimating — a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities — is then adapted with operational parameters as well as vehicle parameters in the DYREQT model to capture mission uncertainty alongside vehicle uncertainty. To perform the range estimation portion of this methodology, the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the set of uncertainty parameters. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo on the surrogate models. This probabilistic methodology was proved to provide insight into the underlying uncertainties of the three-element HLS architecture.

Stephanie Y. Zhu↗

Optimization of Systems with Uncertainty: Initial Developments for Performance, Robustness and Reliability Based Designs

This paper presents a study on the optimization of systems with structured uncertainties, whose inputs and outputs can be exhaustively described in the probabilistic sense. By propagating the uncertainty from the input to the output in the space of the probability density functions and the moments, optimization problems that pursue performance, robustness and reliability based designs are studied. Be specifying the desired outputs in terms of desired probability density functions and then in terms of meaningful probabilistic indices, we settle a computationally viable framework for solving practical optimization problems. Applications to static optimization and stability control are used to illustrate the relevance of incorporating uncertainty in the early stages of the design. Several examples that admit a full probabilistic description of the output in terms of the design variables and the uncertain inputs are used to elucidate the main features of the generic problem and its solution. Extensions to problems that do not admit closed form solutions are also evaluated. Concrete evidence of the importance of using a consistent probabilistic formulation of the optimization problem and a meaningful probabilistic description of its solution is provided in the examples. In the stability control problem the analysis shows that standard deterministic approaches lead to designs with high probability of running into instability. The implementation of such designs can indeed have catastrophic consequences.

Crespo, Luis G.↗

Probabilistic Structural Health Monitoring of the Orbiter Wing Leading Edge

A structural health monitoring (SHM) system can contribute to the risk management of a structure operating under hazardous conditions. An example is the Wing Leading Edge Impact Detection System (WLEIDS) that monitors the debris hazards to the Space Shuttle Orbiter s Reinforced Carbon-Carbon (RCC) panels. Since Return-to-Flight (RTF) after the Columbia accident, WLEIDS was developed and subsequently deployed on board the Orbiter to detect ascent and on-orbit debris impacts, so as to support the assessment of wing leading edge structural integrity prior to Orbiter re-entry. As SHM is inherently an inverse problem, the analyses involved, including those performed for WLEIDS, tend to be associated with significant uncertainty. The use of probabilistic approaches to handle the uncertainty has resulted in the successful implementation of many development and application milestones.

Yap, Keng C.↗

Slip Tendency Analysis of Fracture Networks to Determine Suitability of Candidate Testbeds for the EGS Collab Hydroshear Experiment

Experiment 2 of the EGS Collab project is aimed at testing stimulation by hydro-shearing of existing natural fractures, versus Experiment 1, which is focused on hydraulic fracturing a rock mass to enhance permeability. The main criterion for the testbed selection in Experiment 2 is the presence of an interconnected network of fractures, at least 10 meters in extent, and with orientations such that shear slip can be induced at injection pressures less than the minimum horizontal stress (Shmin). The feasibility analysis for this experiment requires a well-constrained stress state along with well-characterized fracture networks. The fracture systems at two candidate locations in the Sanford Underground Research Facility (SURF), the 4850 Level (number refers to depth below ground surface in feet) and the 4100 Level, have been characterized to different extents. The 4850 Level has a well-characterized Discrete Fracture Network (DFN) from borehole (drilled for an experimental test bed) and drift observations. In contrast, the 4100 level has a fracture network characterized only by observations from the drift wall, which provides little constraint on fracture extents. This paper will present assessments for the interpreted slip potential for the natural fractures at the two locations. Data uncertainties are addressed by performing a probabilistic analysis that takes into account the uncertainty in the stress state, uncertainty in the fracture properties, and preliminary borehole locations. There is strong evidence of shear stimulation of some natural fractures in Experiment 1 on the 4850 level. We use examples of natural fractures strongly linked to shear stimulation in Experiment 1 from multiple monitoring indicators to test the consistency of the stress model and guide the uncertainty interpretation. This analysis is intended to guide the site selection process for Experiment 2 by highlighting the fracture orientations that are likely to be shear-stimulated in a majority of modeled realizations.

40 EE - Geothermal Technologies Office (EE-4G)↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

A functional global sensitivity measure and efficient reliability sensitivity analysis with respect to statistical parameters

Sensitivity analysis and reliability assessment are two important aspects of structural and system safety. Epistemic uncertainty with respect to probabilistic model of input parameters due to lack of knowledge is present in many scarce-data applications and complicates the characterization of uncertainty in model response. In this article, we present two importance measures to evaluate the impact of distribution parameters on the probability distribution function (PDF) of the output and the failure probability. The epistemic uncertainty associated with the distribution parameters is modeled as random variables. Additionally, a modified extended polynomial chaos expansion (MEPCE) approach is introduced in which aleatory and epistemic random variables are modeled and propagated simultaneously while allowing the separate assessment for any single epistemic variable. A MEPCE-based kernel density estimation (KDE) construction provides a composite map from each epistemic variable to the response PDF. The functional global sensitivity index of the PDF with respect to the distribution parameters is thus derived, as a function of output, which is both more informative and more efficient than standard scalar sensitivity measures. Reliability sensitivity indices can be readily evaluated by integrating the global sensitivity index function over the failure zone. Three illustrative examples are used to demonstrate the proposed methodology.

42 ENGINEERING↗

Deep probabilistic direction prediction in 3D with applications to directional dark matter detectors

Abstract We present the first method to probabilistically predict 3D direction in a deep neural network model. The probabilistic predictions are modeled as a heteroscedastic von Mises-Fisher distribution on the sphere S 2 , giving a simple way to quantify aleatoric uncertainty. This approach generalizes the cosine distance loss which is a special case of our loss function when the uncertainty is assumed to be uniform across samples. We develop approximations required to make the likelihood function and gradient calculations stable. The method is applied to the task of predicting the 3D directions of electrons, the most complex signal in a class of experimental particle physics detectors designed to demonstrate the particle nature of dark matter and study solar neutrinos. Using simulated Monte Carlo data, the initial direction of recoiling electrons is inferred from their tortuous trajectories, as captured by the 3D detectors. For 40 keV electrons in a 70% He 30% CO 2 gas mixture at STP, the new approach achieves a mean cosine distance of 0.104 (26 ∘ ) compared to 0.556 (64 ∘ ) achieved by a non-machine learning algorithm. We show that the model is well-calibrated and accuracy can be increased further by removing samples with high predicted uncertainty. This advancement in probabilistic 3D directional learning could increase the sensitivity of directional dark matter detectors.

Computer Science↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗