Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Uncertainty Analysis via Failure Domain Characterization: Polynomial Requirement Functions

This paper proposes an uncertainty analysis framework based on the characterization of the uncertain parameter space. This characterization enables the identification of worst-case uncertainty combinations and the approximation of the failure and safe domains with a high level of accuracy. Because these approximations are comprised of subsets of readily computable probability, they enable the calculation of arbitrarily tight upper and lower bounds to the failure probability. A Bernstein expansion approach is used to size hyper-rectangular subsets while a sum of squares programming approach is used to size quasi-ellipsoidal subsets. These methods are applicable to requirement functions whose functional dependency on the uncertainty is a known polynomial. Some of the most prominent features of the methodology are the substantial desensitization of the calculations from the uncertainty model assumed (i.e., the probability distribution describing the uncertainty) as well as the accommodation for changes in such a model with a practically insignificant amount of computational effort.

Crespo, Luis G.↗
DOE OSTI2020

Validation and Independent Uncertainty Analysis of the MIX-SOL-THERM-003 ICSBEP Benchmark

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) was started in 1992 by the United States Department of Energy and later in 1995 became an international project with contributions from 22 countries. The project is now organized by the OECD (Organisation for Economic Co-operation and Development) Nuclear Energy Agency (NEA). In its most recent iteration, the ICSBEP handbook contains over five thousand evaluations of critical, near-critical, and subcritical experiments conducted in facilities all around the world. These benchmarks serve as valuable information for criticality safety engineers who can use them to validate calculation techniques and establish minimum subcritical margins for operations with fissionable materials. The benchmarks in the handbook are categorized by their fissile material composition, material form (oxide, solution, or metal), and fission energy spectra. This is especially useful for those looking for benchmarks similar to a system they are working on to compare methods and identify trends. The ICSBEP Handbook Uncertainty Guide is document outlining recommended practices and methods for determining uncertainties in these benchmarks. Quantifying these uncertainties thoroughly is crucial as it allows a higher degree of confidence that data used from them is valid and relevant. The guide stresses the importance of a thorough and well documented uncertainty analysis when evaluating an experiment. All measured values of a system, whether they be dimensions or material compositions, have a certain amount of uncertainty associated with them and can be analyzed one by one to determine their effects on the system. Many evaluated benchmarks in the handbook present this in detail, however some do not, mostly earlier evaluations performed in the 1990’s and early 2000’s. Recently at Los Alamos National Laboratory (LANL), the Nuclear Criticality Safety Division (NCSD) of LANL has been validating MCNP6.2 ® input files of criticality benchmarks for use by Whisper, a criticality safety code developed at LANL. This effort is also part of the OECD NEA Working Party on International Nuclear Data Evaluation Co-operation (WPEC) Subgroup 45, also known as Validation of Nuclear Data Libraries (VaNDaL). The goal of VaNDaL is to compile a set of validated simulation inputs for use in validating nuclear data and simulation codes. As part of these efforts, one of the benchmarks reviewed was the MIX SOL-THERM-003 ICSBEP benchmark. This paper provides an independent uncertainty analysis of this benchmark experiment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2016

Facility Measurement Uncertainty Analysis at NASA GRC

This presentation provides and overview of the measurement uncertainty analysis currently being implemented in various facilities at NASA GRC. This presentation includes examples pertinent to the turbine engine community (mass flow and fan efficiency calculation uncertainties.

measurement↗
DOE OSTI2021

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2016

Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A detailed description of the Monte Carlo method as applied for this analysis is provided. Detailed uncertainty results for the uncertainty in average free stream Mach number as well as other variables of interest are provided. All results are presented as random (variation in observed values about a true value), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty. The largest sources contributing to uncertainty are determined and potential improvement opportunities for the facility are investigated.

Error↗
DOE OSTI2020

XRD-PUAT (X-Ray Diffraction - Parameter Uncertainty Analysis Toolkit)

This XRD uncertainty toolkit was built to investigate uncertainty and local least squares topology over a specified parameter space on a single histogram in a gpx GSAS-II file. The parameter uncertainty can be investigated using either a frequentist F-test approach or a Bayesian Inference statistical inversion method on a weighted least squares or peak fit refinements.SAND Number: SAND2020-12227 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Moore, Alexander↗
DOE OSTI2021

Uncertainty Analysis and Software Verification

Uncertainty analyses are an important part of calibrations and testing. They allow researchers insight on how to reduce and mitigate errors in testing. Each device used in testing introduces error in a system, as well as other sources such as environmental conditions, electronics, analog to digital, and random errors. Each source is carefully examined to identify how much error it introduces to a system. These sources are then combined using various methods of uncertainty calculations. To verify and validate software, a manual calculation is required to ensure the software is performing as intended. Using Excel to verify the calculations, we can identify discrepancies within the software. The root of the sum of the squares uncertainty (RSS) is used to find the combined uncertainty of a device at one and two standard deviations of the mean. Calibrations on accelerometers are performed using a vibration system along with a back-toback reference accelerometer. The vibration system takes a reference point at 100Hz frequency at 10g amplitude. The sensitivities are collected at each dialed in frequency. The sensitivity of the device represents the electrical output of the UUT (mV, pC, etc.) per unit of acceleration (g). The full history of sensitivities of selected accelerometers are used to find the averaged, standard deviation, and uncertainty of the device at each frequency tested. The uncertainty calculations from excel and the software are then compared.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

MELCOR 2.2 Benchmarks of Peach Bottom NUREG/CR 7155 Uncertainty Analysis

The U.S. Nuclear Regulatory Commission (NRC) performed a first-of-a-kind uncertainty analysis (UA) of the accident progression, radiological releases, and offsite consequences for the State-of- the-Art Reactor Consequence Analyses (SOARCA) of an unmitigated long-term station blackout (LTSBO) severe accident scenario at the Peach Bottom Atomic Power Station. The objective of the UA was to evaluate the robustness of the SOARCA deterministic "best estimate results and conclusions documented in NUREG-1935, and to develop insight into the overall sensitivity of the SOARCA results to uncertainty in key modeling inputs. The study was completed in 2015 and documented in NUREG/CR-7155. Since 2015, two other SOARCA UAs were completed for two pressurized water reactor (PWR) plants. The PWR UAs incrementally updated the approach and methodology, including using the latest release of the MELCOR 2.2 computer code. There were also advances made in the state-of-the-art modeling related to NRC efforts using the Peach Bottom model in NUREG-2206, which provided the technical basis for the containment protection and release reduction rulemaking for boiling water reactors with Mark I and Mark II containments. This report documents the input model changes from the NUREG/CR-7155 study and performs a small number of reference calculations to assess the changes of the new computer code and the model input updates. The objective of the work is to verify whether the updated Peach Bottom MELCOR model and updated version of MELCOR support the conclusions formed in the Peach Bottom SOARCA UA by performing these representative calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2006

Uncertainty Analysis for a Jet Flap Airfoil

An analysis of variance (ANOVA) study was performed to quantify the potential uncertainties of lift and pitching moment coefficient calculations from a computational fluid dynamics code, relative to an experiment, for a jet flap airfoil configuration. Uncertainties due to a number of factors including grid density, angle of attack and jet flap blowing coefficient were examined. The ANOVA software produced a numerical model of the input coefficient data, as functions of the selected factors, to a user-specified order (linear, 2-factor interference, quadratic, or cubic). Residuals between the model and actual data were also produced at each of the input conditions, and uncertainty confidence intervals (in the form of Least Significant Differences or LSD) for experimental, computational, and combined experimental / computational data sets were computed. The LSD bars indicate the smallest resolvable differences in the functional values (lift or pitching moment coefficient) attributable solely to changes in independent variable, given just the input data points from selected data sets. The software also provided a collection of diagnostics which evaluate the suitability of the input data set for use within the ANOVA process, and which examine the behavior of the resultant data, possibly suggesting transformations which should be applied to the data to reduce the LSD. The results illustrate some of the key features of, and results from, the uncertainty analysis studies, including the use of both numerical (continuous) and categorical (discrete) factors, the effects of the number and range of the input data points, and the effects of the number of factors considered simultaneously.

Green, Lawrence L.↗
DOE OSTI2020

Uncertainty analysis of steady-state measurements with a hot-filament type calorimetric emissometer

Calorimetric emissometers measure total hemispherical emissivity by measuring the heat transferred from a heated sample to its surroundings under a vacuum. The accuracy of emissometers standardized by the ASTM C835-06 are well understood. This work uses the Guide to the Evaluation of Uncertainty in Measurement (GUM) for the propagation uncertainties for an ASTM compliant emissometer. The GUM method was able to develop a measurement model and expressions to determine the uncertainty for other emissometers of this type. Data on ‘as-received’ Hastelloy X was used to develop a detailed uncertainty analysis of the emissivity measurement. Data on ‘as-received’ SS 347 and sandblasted A387 Gr. 91 and previous data by the group on A508/A533B were used to determine uncertainty over the ranges 0.16 to 0.81. For all samples, relative uncertainties in emissivities varied from 0.77% to 2.5% when using a fluxgate magnetometer sensor (FMS) to measure the DC heating current. Data on Hastelloy X using a Hall-effect sensor for DC current and low alloy steel showed the DC current and voltage across the test section to be dominate sources of uncertainty. When these sources were reduced, the specimen temperature and the surface area of the test sections were main sources of uncertainty in the emissivity, especially at higher temperatures. As thermal expansion of the surface was considered in the calculations, correlation between specimen temperature and surface area was examined. It was found to be a small contribution to emissivity's uncertainty despite the differences in linear CTE and its uncertainty for the materials analyzed in this study. For low temperatures, the chamber temperature can be a significant source of uncertainty if not sufficiently cooled. The GUM was also briefly compared to uncertainty from the 2nd and 3rd expansions of the Taylor series. We found that the results were the same when rounding to two significant figures.

42 ENGINEERING↗
NASA NTRS2023

Uncertainty Analysis of Slug Calorimeters in the HyMETS Arc-Jet Facility

The objective of this work is to perform an uncertainty analysis of the deduced stagnation heat flux environment on a slug calorimeter for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System arc-jet facility located at NASA Langley Research Center. Analytical solutions are developed for boundary-value problems on the slug element accounting for non-ideal effects, including spatial variation in the slug heat flux, multi-dimensional thermal conduction, and back-face losses, which departs from the state-of-the-art method derived from the American Society of Testing and Materials. Boundary-value problem definitions are informed by preliminary finite element thermal analysis of the slug calorimeter assembly (including both slug and housing) and just the slug element. The analytical solutions are presented in a general sense and in a truncated form from error analysis. Results are shown in optimizing and validating the analytical models against available slug back-face thermal data. The optimization results indicate that the appropriate epistemic uncertainty of the deduced stagnation heat flux on the slug calorimeter is at most±2.5% for both a high-and low-enthalpy test condition. In addition, a numerical approach is used to determine the aleatory (probabilistic) uncertainty component in the slug stagnation heat flux by applying a marching least-squares slope routine through the steady-state portion of the slug back-face thermal response. Results indicate a compromise between the number of samples and the filter frequency of slug back-face thermal data points when evaluating the standard deviation of the deduced stagnation heat flux statistics. When combining the mixed uncertainty, both aleatory and epistemic, the interval of uncertainty in the deduced stagnation heat flux is determined to be up to ±4%, which is at least a 60% reduction from the standard uncertainty used in the state-of-the-art method.

uncertainty↗
NASA NTRS1994

A new algorithm for five-hole probe calibration, data reduction, and uncertainty analysis

A new algorithm for five-hole probe calibration and data reduction using a non-nulling method is developed. The significant features of the algorithm are: (1) two components of the unit vector in the flow direction replace pitch and yaw angles as flow direction variables; and (2) symmetry rules are developed that greatly simplify Taylor's series representations of the calibration data. In data reduction, four pressure coefficients allow total pressure, static pressure, and flow direction to be calculated directly. The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify uncertainty of five-hole results (e.g., total pressure, static pressure, and flow direction) and determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance to improve measurement technique. The new algorithm is applied to calibrate and reduce data from a rake of five-hole probes. Here, ten individual probes are mounted on a single probe shaft and used simultaneously. Use of this probe is made practical by the simplicity afforded by this algorithm.

Reichert, Bruce A.↗
NASA NTRS2012

Uncertainty Analysis of Sonic Boom Levels Measured in a Simulator at NASA Langley

A sonic boom simulator has been constructed at NASA Langley Research Center for testing the human response to sonic booms heard indoors. Like all measured quantities, sonic boom levels in the simulator are subject to systematic and random errors. To quantify these errors, and their net influence on the measurement result, a formal uncertainty analysis is conducted. Knowledge of the measurement uncertainty, or range of values attributable to the quantity being measured, enables reliable comparisons among measurements at different locations in the simulator as well as comparisons with field data or laboratory data from other simulators. The analysis reported here accounts for acoustic excitation from two sets of loudspeakers: one loudspeaker set at the facility exterior that reproduces the exterior sonic boom waveform and a second set of interior loudspeakers for reproducing indoor rattle sounds. The analysis also addresses the effect of pressure fluctuations generated when exterior doors of the building housing the simulator are opened. An uncertainty budget is assembled to document each uncertainty component, its sensitivity coefficient, and the combined standard uncertainty. The latter quantity will be reported alongside measurement results in future research reports to indicate data reliability.

Rathsam, Jonathan↗
DOE OSTI2022

Uncertainty analysis for VERA problem 2 using the cell-code Condor v2.8.05

Condor is a cell-level neutronic calculation code that applies multi-group collision probabilities with heterogeneous response coupling method within generic geometry configurations. Under the Condor's code continuous development, the incorporation of up-to-date methodologies and state-of-the-art practices in reactor analysis represents a driving force. In this work, the capabilities of Condor v2.8.05 to develop an uncertainty analysis for realistic PWR-kind fuel assemblies are studied. The Total Monte Carlo approach is applied to quantify the impact of fabrication tolerances in the code's results for reactivity and power distributions, by means of randomly sampled input values using the VERA problem 2 as basis. The VERA problem 2 proposes a series of Westinghouse 2D 17 x 17-type fuel lattices, to be calculated reflected at beginning-of-life without Xe. The configurations correspond to a modern PWR. Selected neutronic parameters from Condor runs are thus analyzed in terms of the observed spread as well as the obtained distributions for the randomly perturbed cases, showing the capability of the code to handle the required input data, as well as its ability to provide valuable insights regarding uncertainty quantification.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Influence of Local Water Vapor Analysis Uncertainty on Ensemble Forecasts of Tropical Cyclogenesis Using Hurricane Irma (2017) as a Testbed

Abstract Tropical cyclone formation is known to require abundant water vapor in the lower to middle troposphere within the incipient disturbance. In this study, we assess the impacts of local water vapor analysis uncertainty on the predictability of the formation of Hurricane Irma (2017). To this end, we reduce the magnitude of the incipient disturbance’s water vapor perturbations obtained from an ensemble-based data assimilation system that constrained moisture by assimilating all-sky infrared and microwave radiances. Five-day ensemble forecasts are initialized two days before genesis using each set of modified analysis perturbations. Growth of convective differences and intensity uncertainty are evaluated for each ensemble forecast. We observe that when initializing an ensemble forecast with only moisture uncertainty within the incipient disturbance, the resulting intensity uncertainty at every lead time exceeds half that of an ensemble containing initial perturbations to all variables throughout the domain. Although ensembles with different initial moisture uncertainty amplitudes reveal a similar pathway to genesis, uncertainty in genesis timing varies substantially across ensembles since moister members exhibit earlier spinup of the low-level vortex. These differences in genesis timing are traced back to the first 6–12 h of integration, when differences in the position and intensity of mesoscale convective systems across ensemble members develop more quickly with greater initial moisture uncertainty. In addition, the rapid growth of intensity uncertainty may be greatly modulated by the diurnal cycle. Ultimately, this study underscores the importance of targeting the incipient disturbance with high spatiotemporal water vapor observations for ingestion into data assimilation systems. Significance Statement Hurricanes form from clusters of thunderstorms that organize into a coherent system. One of the key ingredients for the formation process is an abundance of moisture. In this study, we test the sensitivity of hurricane formation to the initial moisture content in the vicinity of the cluster of thunderstorms that would become Hurricane Irma (2017). To do so, we initialize sets of forecasts each having a different variability of initial moisture content within the embryonic disturbance. Our results show that the predictability of hurricane formation is highly dependent on the uncertainty of the moisture content within the initial disturbance. Consequently, more high-quality observations of the moisture within the precursor disturbances to hurricanes are expected to improve forecasts of their formation.

Hartman, Christopher M.↗