Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Uncertainty Reduction using Bayesian Inference and Sensitivity Analysis: A Sequential Approach to the NASA Langley Uncertainty Quantification Challenge

This paper presents a computational framework for uncertainty characterization and propagation, and sensitivity analysis under the presence of aleatory and epistemic un- certainty, and develops a rigorous methodology for efficient refinement of epistemic un- certainty by identifying important epistemic variables that significantly affect the overall performance of an engineering system. The proposed methodology is illustrated using the NASA Langley Uncertainty Quantification Challenge (NASA-LUQC) problem that deals with uncertainty analysis of a generic transport model (GTM). First, Bayesian inference is used to infer subsystem-level epistemic quantities using the subsystem-level model and corresponding data. Second, tools of variance-based global sensitivity analysis are used to identify four important epistemic variables (this limitation specified in the NASA-LUQC is reflective of practical engineering situations where not all epistemic variables can be refined due to time/budget constraints) that significantly affect system-level performance. The most significant contribution of this paper is the development of the sequential refine- ment methodology, where epistemic variables for refinement are not identified all-at-once. Instead, only one variable is first identified, and then, Bayesian inference and global sensi- tivity calculations are repeated to identify the next important variable. This procedure is continued until all 4 variables are identified and the refinement in the system-level perfor- mance is computed. The advantages of the proposed sequential refinement methodology over the all-at-once uncertainty refinement approach are explained, and then applied to the NASA Langley Uncertainty Quantification Challenge problem.

Uncertainty↗
DOE OSTI2023

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2019

Bayesian Inference and the Effects of Varying Uncertainty Models in Charring Ablator Calibration and Uncertainty Quantification Problems

The Mars Science Laboratory (MSL) vehicle utilized a heat shield constructed from NASA’s Phenolic-Impregnated Carbon Ablator (PICA) material to protect the main structure from the high enthalpy environment encountered during hypersonic atmospheric entry. During the vehicle’s descent through Martian atmosphere, multiple thermocouples embedded within the heat shield captured in-depth material temperature data that allow for studies to be conducted on current material response reconstruction tools. In the present work, material temperature data obtained from thermocouples within the MISP-4 plug (MEDLI (Mars Science Laboratory Entry, Descent, and Landing Instrument) Integrated Sensor Plug) are utilized in the calibration of Theoretical Ablative Composite for Open Testing (TACOT) model parameters in conjunction with NASA’s Porous material Analysis Toolbox (PATO) through Bayesian inference where uncertainty due to parametric, modeling, and experimental sources is simultaneously quantified. Prior to the study, a sensitivity analysis is performed through computation of the robust Sobol indices in an effort to study the relationship between input space and model response and to reduce the dimensionality of the statistical inverse problem. The Bayesian inference methodology necessitates an a-priori choice to be made for the uncertainty model for which numerous possibilities are available. Across most works, however, only basic additive or multiplicative models are utilized with pre-defined magnitudes of uncertainty based on a-priori knowledge or to-be-calibrated multipliers of static covariance matrix structures. The present effort explores the effects of informed uncertainty models, ones with temporal dependence that are simultaneously calibrated through Bayesian inference, on calibrated results for parameters that make up the uncertain input space.

Sensitivity Analysis↗
DOE OSTI2023

A proposed method for addressing large unphysical uncertainties in mubar

Mubar uncertainties in Section MF 34 MT 2 of ENDF/B-VIII.0 data are sometimes too large. Physical limitations of the bounds of mubar limit the maximum uncertainty to be < 1.0 and usually $\ll$ 1.0. Two ad hoc methods are proposed to artificially constrain the randomly sampled values of mubar to allowable values. The application of NJOY’s mubar covariance matrix to the “sandwich rule” is also discussed and a consistent way to apply sensitivity coefficients is described. Mubar uncertainties for the Jezebel k eff were found to be 156 pcm – a value comparable to other evaluated cross section uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1977

Monte Carlo analysis of uncertainty propagation in a stratospheric model. 2: Uncertainties due to reaction rates

A concise stratospheric model was used in a Monte-Carlo analysis of the propagation of reaction rate uncertainties through the calculation of an ozone perturbation due to the addition of chlorine. Two thousand Monte-Carlo cases were run with 55 reaction rates being varied. Excellent convergence was obtained in the output distributions because the model is sensitive to the uncertainties in only about 10 reactions. For a 1 ppby chlorine perturbation added to a 1.5 ppby chlorine background, the resultant 1 sigma uncertainty on the ozone perturbation is a factor of 1.69 on the high side and 1.80 on the low side. The corresponding 2 sigma factors are 2.86 and 3.23. Results are also given for the uncertainties, due to reaction rates, in the ambient concentrations of stratospheric species.

Stolarski, R. S.↗
DOE OSTI2026

Statistical Uncertainty of Inhalation Dose Coefficients in Consequence Management: Propagated Dose Uncertainty in ICRP 66 Human Respiratory Tract Model

Reference inhalation dose models rely on deterministic biokinetics and reference computational phantoms, limiting their applicability to the variability present in population-specific exposures encountered in emergency response scenarios. Here, this study introduces REDCAL, a Python-based computational framework developed to propagate uncertainty in inhalation dose coefficients using the International Commission on Radiological Protection (ICRP) Publication 66 Human Respiratory Tract Model. REDCAL integrates ICRP deposition and clearance models, systemic biokinetics, and governing physics principles, and leverages Sandia National Laboratories’ Dakota toolkit for uncertainty quantification via Latin Hypercube Sampling. REDCAL was validated against DCAL, with biokinetic retention results differing by less than 1% and effective dose coefficients by less than 2% across all tested radionuclides. Stochastic sampling introduced variability in dose coefficients, with geometric standard deviations (GSD) in committed effective dose coefficients (CEDC) ranging from 1.0 to 1.5, based on lognormal distribution fits. Analysis demonstrated that variations in the activity median aerodynamic diameter (AMAD) notably influenced the computed CEDC values. Smaller particles (<1 µm) increased doses by 20–30% due to deeper lung deposition and prolonged retention for alpha emitting radionuclides, such as 241 Am and 239 Pu. Radionuclides with fast clearance, such as 133 I, demonstrated a dose reduction exceeding 50%, as AMAD increased beyond 5 µm due to upper airway deposition and rapid mucociliary clearance. The greatest GSD among the radionuclides reported in this study was for 241 Am. In most cases, the largest GSDs in the CEDC were associated with larger particle sizes, an expected outcome, as ICRP Publication 66 defines GSD in particle size as a function of AMAD, resulting in an extended tail of the lognormal distribution. The findings support improved inhalation dose assessments and enhance consequence management strategies for the U.S. Federal Radiological Monitoring and Assessment Center by quantifying uncertainty in dose coefficients and strengthening decision-making for emergency response scenarios.

Biokinetic Modeling↗
DOE OSTI2026

Experimental uncertainty quantification using templates of expected measurement uncertainties for fast neutron-induced total, capture, and scattering cross sections

Careful experimental uncertainty quantification (UQ) is key for developing trustworthy evaluated nuclear data. Templates to account for missing or under-reported experimental uncertainties were recently developed by the covariance committee of Cross Section Evaluation Working Group (CSEWG). In this work, we illustrate the practical application and limitations of these templates for selected neutron-induced reactions, including (n, tot), (n, γ), and (n, xn) in the fast energy range, to illustrate their use in data analyses for nuclear data evaluations. We show that while the templates provide consistent framework, proper implementation still requires detailed knowledge of experimental conditions and careful treatment of nonlinear effects in cross section derivation. Case studies highlight how template-assisted UQ improves consistency with previous evaluations such as ENDF/B and reveals open challenges in propagating uncertainties across different energy regimes. The main contribution of this paper is to connect formal template recommendations with their use in practical evaluation workflows, clarifying both their benefits and current limitations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗
DOE OSTI2022

Assessment of Crustal Leg Uncertainties for RSTT Path-dependent Uncertainty

The Regional Seismic Travel Time (RSTT) model and software were recently updated to allow for path-dependent uncertainty (PDU) estimates for travel-time (Begnaud et al. 2021; Begnaud et al. 2020). Begnaud et al. (2021) describes the process of improving the current distance-dependent uncertainty parameterization for RSTT using a random effects model (REM) to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The REM separates the error between observed slowness and model predicted slowness into bias and random components. The PDU is calculated by integrating these mean squared errors along a seismic-phase ray path.

58 GEOSCIENCES↗
NASA NTRS1988

Development of a special-purpose test surface guided by uncertainty analysis - Introduction of a new uncertainty analysis step

Development of a recent experimental program to investigate the effects of streamwise curvature on boundary layer transition required making a bendable, heated and instrumented test wall, a rather nonconventional surface. The present paper describes this surface, the design choices made in its development and how uncertainty analysis was used, beginning early in the test program, to make such design choices. Published uncertainty analysis techniques were found to be of great value; but, it became clear that another step, one herein called the pre-test analysis, would aid the program development. Finally, it is shown how the uncertainty analysis was used to determine whether the test surface was qualified for service.

Wang, T.↗
NASA NTRS2014

Numerical Uncertainty Analysis for Computational Fluid Dynamics using Student T Distribution -- Application of CFD Uncertainty Analysis Compared to Exact Analytical Solution

Computational Fluid Dynamics (CFD) is the standard numerical tool used by Fluid Dynamists to estimate solutions to many problems in academia, government, and industry. CFD is known to have errors and uncertainties and there is no universally adopted method to estimate such quantities. This paper describes an approach to estimate CFD uncertainties strictly numerically using inputs and the Student-T distribution. The approach is compared to an exact analytical solution of fully developed, laminar flow between infinite, stationary plates. It is shown that treating all CFD input parameters as oscillatory uncertainty terms coupled with the Student-T distribution can encompass the exact solution.

Groves, Curtis E.↗
DOE OSTI2023

Uncertainty Quantification of Metal Additive Manufacturing Processing Conditions Through the use of Exascale Computing

Metal additive manufacturing (AM) is a disruptive manufacturing technology that opens the design space for parts outside those possible from traditional manufacturing methods. In order to accelerate industry and R&D needs to certify AM parts, the Exascale Additive Manufacturing project (ExaAM) has developed a suite of exascale-ready computational tools to model the process-to-structure-to-properties (PSP) relationship for additively manufactured metal components. One such tool is an uncertainty quantification (UQ) pipeline to quantify the effect that uncertainty in processing conditions has on local mechanical responses. We present an overview of this pipeline and its required simulation and workflow codes. Using the Oak Ridge National Laboratory’s (ORNL) exascale computer, Frontier, we utilize this pipeline to cross multiple length and time scales to predict the local mechanical response of a location within a complex AM bridge part, AMB2018-01 produced by the National Institute of Standards and Technology (NIST) as part of their 2018 AM-Bench test series. Our results are then compared to experimental mechanical tests of parts from the NIST build to quantify the error in the ExaAM UQ workflow.

Carson, Robert↗
DOE OSTI2022

Uncertainty quantification in elastic constants of SiC f /SiC m tubular composites using global sensitivity analysis

Silicon carbide fiber and silicon carbide matrix (SiC f /SiC m ) tubes produced through the chemical vapor infiltration process have become a candidate cladding material in nuclear applications. The performance of this composite is influenced by many variables such as braiding angle, porosity, material properties, etc., which vary over a range of values due to the inherent fluctuations in the manufacturing process. In this study, the variability in elastic constants of SiC f /SiC m composite has been quantified through multiscale finite element (FE) simulations, variable screening, and high-fidelity surrogate modeling. The key variables dominantly affecting the elastic constants of SiC f /SiC m tubes were identified using global sensitivity analysis. A surrogate to the high-fidelity FE-based model was used in Monte Carlo simulations to generate a hundred thousand samples from which the uncertainty in elastic constants was assessed. It turned out that the coefficient of variation was less than 10%.

Materials Science↗
NASA NTRS1976

The uncertainty threshold principle - Fundamental limitations of optimal decision making under dynamic uncertainty

The fundamental limitations of the optimal control of dynamic systems with random parameters are analyzed by studying a scalar linear-quadratic optimal control example. It is demonstrated that optimum long-range decision making is possible only if the dynamic uncertainty (quantified by the means and covariances of the random parameters) is below a certain threshold. If this threshold is exceeded, there do not exist optimum decision rules. This phenomenon is called the 'uncertainty threshold principle'. The implications of this phenomenon to the field of modelling, identification, and adaptive control are discussed.

Athans, M.↗
NASA NTRS1977

The uncertainty threshold principle - Some fundamental limitations of optimal decision making under dynamic uncertainty

This note shows that the optimal control of dynamic systems with uncertain parameters has certain limitations. In particular, by means of a simple scalar linear-quadratic optimal control example, it is shown that the infinite horizon solution does not exist if the parameter uncertainty exceeds a certain quantifiable threshold; we call this the uncertainty threshold principle. The philosophical and design implications of this result are discussed.

Athans, M.↗
NASA NTRS1991

Measuring uncertainty by extracting fuzzy rules using rough sets and extracting fuzzy rules under uncertainty and measuring definability using rough sets

Computers are not designed to handle terms where uncertainty is present. To deal with uncertainty, techniques other than classical logic must be developed. This paper examines the concepts of statistical analysis, the Dempster-Shafer theory, rough set theory, and fuzzy set theory to solve this problem. The fundamentals of these theories are combined to provide the possible optimal solution. By incorporating principles from these theories, a decision-making process may be simulated by extracting two sets of fuzzy rules: certain rules and possible rules. From these rules a corresponding measure of how much we believe these rules is constructed. From this, the idea of how much a fuzzy diagnosis is definable in terms of its fuzzy attributes is studied.

Worm, Jeffrey A.↗