Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Risk Assessment Metrics for NASA Fission Reactor Applications

Risk assessment is an important part of many NASA activities. In August 2019, the White House issued NSPM-20, which defines acceptable levels of risk for nuclear launches, but does not prescribe the particular methodologies or metrics that are to be used for comparison to the defined acceptance criteria. There are a variety of metrics that are possible and can be readily generated by a probabilistic risk assessment (PRA). This paper will explore alternative metrics that can be provided, along with some discussion of their characteristics and important factors to consider during a space fission reactor risk analysis.

Probabilistic Risk Assessment↗

Surrogate-driven Variance-based Sensitivity Analysis of Thermal Storage Tanks in Integrated Energy Systems

Sensitivity analysis and uncertainty quantification are essential steps for enhancing the accuracy of computational models by identifying and mitigating uncertainties. This study focuses on these steps for the Thermal Energy Delivery System at Idaho National Laboratory, specifically targeting the thermocline tank. Using a Modelica/Dymola simulation model, the study perturbed various design parameters and boundary conditions, including shape factor, porosity, outlet temperature, inlet mass flow rate, and system pressure, to predict and quantify uncertainty in the tank’s ax- ial temperature. A dataset of over 1,000 simulations was generated, and surrogate models were developed using the pyMAISE (Michigan Artificial Intelligence Standard Environment) library, which is an Automatic Machine Learning library for nuclear engineering applications. The optimal model, a feedforward neural network with two hidden layers, achieved an R2 score above 0.99 and a mean absolute error below 1 Kelvin. Sensitivity analyses using Sobol indices and Fourier amplitude sensitivity testing methods on this surrogate model revealed that the inlet mass flow rate at initial timestamps and porosity significantly impacts predicted temperatures across all sensors and time steps.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Preliminary investigation of an uncertainty budget for uranium isotope ratio analysis using a liquid sampling—atmospheric pressure glow discharge—orbitrap mass spectrometer system

The liquid sampling-atmospheric pressure glow discharge (LS-APGD) ionization source has proven to be an effective analysis tool for making uranium isotope ratio measurements when coupled to high-resolution mass spectrometers, such as the Orbitrap. While previous studies have shown the capabilities of the LS-APGD for isotope ratio determination, a systematic evaluation of the measurement uncertainty of the technique has not been conducted. To this end, the International Standards Organizations (ISO) guidelines to the expression of uncertainty in measurement (GUM analysis) have been applied to generate an uncertainty budget. For this work, a preliminary assessment derived from the GUM analysis was performed. The uncertainty in the instrument blank determination has been identified as a primary factor contributing to measurement uncertainty for the LS-APGD-Orbitrap method. These findings for the specific test case of uranium isotopic analysis will be invaluable in applications across the breadth of isotope ratio mass spectrometry performed on this unique instrumental platform.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

On robustness analysis with non-diagonally structured uncertainty

The authors study the structured singular value for a class of robustness analysis problems in which the uncertainty is allowed to be nondiagonally structured, and the norm of each block is individually considered. The results extend the previous work conducted for problems where each uncertainty block is assumed to be a scalar. Computations of this generalized notion via both the similarity and nonsimilarity scaling methods are investigated. It is shown in particular that under certain circumstances the structured singular value defined here coincides with a vector-induced norm.

Chen, Jie↗

Study of a Proposed fissionTPC Measurement of 233 U(n,f)/ 235 U(n,f) Cross Section Ratio

A review of the available 233 U( n, f )/ 235 U( n, f ) cross section ratio data compared to the ENDF evaluation in the fast neutron energy range, 0.1–20 MeV, shows that discrepancies exist between some of the various measurements and the evaluation. The discrepancies vary and a function of incident neutron energy and range between 1–5%. In this document we review two potential options for performing new measurements of the cross section ratio to potentially resolve these discrepancies. The two options are compared and contrasted in terms of measurement accuracy and cost. The first option would utilize the fissionTPC, which was designed specifically to achieve measurement uncertainties of better than 1% to resolve a similar data–evaluation discrepancy in the 239 Pu( n, f ) cross section. While this would seem to be an ideal option in this case also, there are challenges. The fissionTPC is a complex instrument and the cost of maintenance and operations are significant. Furthermore, some of the fissionTPC equipment is nearing the end of its useful life which presents a risk to completion of a measurement campaign. The second option is to use a dual-fission chamber, which is the more traditional approach to these types of measurements. The cost is estimated to be about half that of a fissionTPC measurement, while the much simpler design of the detector reduces overall risk. The trade-off is the measurement uncertainty, which would be on order of 1–3% with a careful measurement and analysis. This uncertainty however may not be good enough to fully resolve the discrepancies. The objective of a new measurement would be the improvement in the ENDF evaluation with the end goal of improving the accuracy of models and simulations at the end of the nuclear data pipeline. An understanding of the sensitivity of these models to the data uncertainties would help guide the choice of measurement techniques.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Integrated Approach to Life Cycle Analysis

Life Cycle Analysis (LCA) is the evaluation of the impacts that design decisions have on a system and provides a framework for identifying and evaluating design benefits and burdens associated with the life cycles of space transportation systems from a "cradle-to-grave" approach. Sometimes called life cycle assessment, life cycle approach, or "cradle to grave analysis", it represents a rapidly emerging family of tools and techniques designed to be a decision support methodology and aid in the development of sustainable systems. The implementation of a Life Cycle Analysis can vary and may take many forms; from global system-level uncertainty-centered analysis to the assessment of individualized discriminatory metrics. This paper will focus on a proven LCA methodology developed by the Systems Analysis and Concepts Directorate (SACD) at NASA Langley Research Center to quantify and assess key LCA discriminatory metrics, in particular affordability, reliability, maintainability, and operability. This paper will address issues inherent in Life Cycle Analysis including direct impacts, such as system development cost and crew safety, as well as indirect impacts, which often take the form of coupled metrics (i.e., the cost of system unreliability). Since LCA deals with the analysis of space vehicle system conceptual designs, it is imperative to stress that the goal of LCA is not to arrive at the answer but, rather, to provide important inputs to a broader strategic planning process, allowing the managers to make risk-informed decisions, and increase the likelihood of meeting mission success criteria.

Chytka, T. M.↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

Analysis of Polarimetry Data with Angular Uncertainties

For a track based polarimeter, such as the Imaging X-ray Polarimetry Explorer (IXPE), the sensitivity to polarization depends on the modulation factor, which is a strong function of energy. In previous work, a likelihood method was developed that would account for this variation in order to estimate the minimum detectable polarization (MDP). That method essentially required that the position angles of individual events should be known precisely. In a separate work, however, it was shown that using a machine-learning method for measuring event tracks can generate track angle uncertainties, which can be used in the analysis. Here, the maximum likelihood method is used as a basis for revising the estimate of the MDP in a general way that can include uncertainties in event track position angles. The resultant MDP depends solely upon the distribution of track angle uncertainties present in the input data. Due to the physics of the IXPE detectors, it is possible to derive a simple relationship between these angular uncertainties and the energy-dependent modulation function as a step in the process.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Dispersion analysis for baseline reference mission 2

A dispersion analysis considering uncertainties (or perturbations) in platform, vehicle, and environmental parameters was performed for baseline reference mission (BRM) 2. The dispersion analysis is based on the nominal trajectory for BRM 2. The analysis was performed to determine state vector and performance dispersions (or variations) which result from the indicated uncertainties. The dispersions are determined at major mission events and fixed times from liftoff (time slices). The dispersion results will be used to evaluate the capability of the vehicle to perform the mission within a specified level of confidence and to determine flight performance reserves.

Snow, L. S.↗

Uncertainty Quantification of Turbulence Model Closure Coefficients for Transonic Wall-Bounded Flows

The goal of this work was to quantify the uncertainty and sensitivity of commonly used turbulence models in Reynolds-Averaged Navier-Stokes codes due to uncertainty in the values of closure coefficients for transonic, wall-bounded flows and to rank the contribution of each coefficient to uncertainty in various output flow quantities of interest. Specifically, uncertainty quantification of turbulence model closure coefficients was performed for transonic flow over an axisymmetric bump at zero degrees angle of attack and the RAE 2822 transonic airfoil at a lift coefficient of 0.744. Three turbulence models were considered: the Spalart-Allmaras Model, Wilcox (2006) k-w Model, and the Menter Shear-Stress Trans- port Model. The FUN3D code developed by NASA Langley Research Center was used as the flow solver. The uncertainty quantification analysis employed stochastic expansions based on non-intrusive polynomial chaos as an efficient means of uncertainty propagation. Several integrated and point-quantities are considered as uncertain outputs for both CFD problems. All closure coefficients were treated as epistemic uncertain variables represented with intervals. Sobol indices were used to rank the relative contributions of each closure coefficient to the total uncertainty in the output quantities of interest. This study identified a number of closure coefficients for each turbulence model for which more information will reduce the amount of uncertainty in the output significantly for transonic, wall-bounded flows.

Schaefer, John↗

Evaluation of CFD as a Surrogate for Wind Tunnel Testing - Experimental Uncertainty Quantification

A series of wind tunnel tests is being performed at the Unitary Plan Wind Tunnel at Langley Research Center to assess the validity of using computational fluid dynamics (CFD) as a surrogate for wind tunnel testing. In order to make proper comparisons, uncertainties in CFD results and experimental data must be well understood. The material presented will highlight the methods, assumptions, and elemental inputs used to achieve experimental uncertainty estimates for several variables of interest.The work performed to date has focused on gaining insight into random uncertainty via statistical analysis of repeat data and systematic uncertainty via Monte Carlo propagation analysis. These methods were combined using a second-order Monte Carlo propagation, resulting in a probability box (P-box) for each variable and at all conditions of interest. Figure 1 provides an example of one such P-box, showing the experimental uncertainty in a locally determined dynamic pressure (QC10) for one of many tunnel conditions evaluated during the Flow Survey experiment. This particular condition (Condition 27) has nominal set points of Mach number = 3.85, Reynolds number = 3x10(exp 6) ft(exp -1), total pressure = 5160 psfa, and total temperature = 150°F. The uncertainty in dynamic pressure at this condition is now well defined by this plot. Armed with this experimental data uncertainty, meaningful comparisons can be made with computational results, when their associated uncertainties are also considered.

Heather P Houlden↗

Probabilistic sizing of laminates with uncertainties

A reliability based design methodology for laminate sizing and configuration for a special case of composite structures is described. The methodology combines probabilistic composite mechanics with probabilistic structural analysis. The uncertainties of constituent materials (fiber and matrix) to predict macroscopic behavior are simulated using probabilistic theory. Uncertainties in the degradation of composite material properties are included in this design methodology. A multi-factor interaction equation is used to evaluate load and environment dependent degradation of the composite material properties at the micromechanics level. The methodology is integrated into a computer code IPACS (Integrated Probabilistic Assessment of Composite Structures). Versatility of this design approach is demonstrated by performing a multi-level probabilistic analysis to size the laminates for design structural reliability of random type structures. The results show that laminate configurations can be selected to improve the structural reliability from three failures in 1000, to no failures in one million. Results also show that the laminates with the highest reliability are the least sensitive to the loading conditions.

Shah, A. R.↗

DANTE as a primary temperature diagnostic for the NIF iron opacity campaign

The Opacity Platform on the National Ignition Facility (NIF) has been developed to measure iron opacities at varying densities and temperatures relevant to the solar interior and to verify recent experimental results obtained at the Sandia Z-machine, that diverge from theory. The first set of NIF experiments collected iron opacity data at ∼150 eV to 160 eV and an electron density of ∼7 × 1021 cm−3, with a goal to study temperatures up to ∼210 eV, with electron densities of up to ∼3 × 1022 cm−3. Among several techniques used to infer the temperature of the heated Fe sample, the absolutely calibrated DANTE-2 filtered diode array routinely provides measurements of the hohlraum conditions near the sample. However, the DANTE-2 temperatures are consistently low compared to pre-shot LASNEX simulations for a range of laser drive energies. We have re-evaluated the estimated uncertainty in the reported DANTE-2 temperatures and also the error generated by varying channel participation in the data analysis. An uncertainty of ±5% or better can be achieved with appropriate spectral coverage, channel participation, and metrology of the viewing slot.

Opachich, Y. P. (ORCID:0000000314323989)↗

Regression Bias in using Solar Wind Measurements

Simultaneous solar wind measurements from the solar wind monitors, WIND and ACE, differ due to the spatial and temporal structure of the solar wind. Correlation studies that use these measurements as input may infer an incorrect correlation due to uncertainties arising from this spatial and temporal structure, especially at extreme and rare solar wind values. In particular, regression analysis will lead to a regression function whose slope is biased towards the mean value of the measurement parameter. This article demonstrates this regression bias by comparing simultaneous ACE and WIND solar wind measurements. A non-linear regression analysis between them leads to a perception of underestimation of extreme values of one measurement on average over the other. Using numerical experiments, we show that popular regression analysis techniques such as linear least-squares, orthogonal least-squares, and non-linear regression are not immune to this bias. Hence while using solar wind parameters as an independent variable in a correlation or regression analysis, random uncertainty in the independent variable can create unintended biases in the response of the dependent variable. More generally, the regression to the mean effect can impact both event-based, statistical studies of magnetospheric response to solar wind forcing.

magnetosphere↗

Improvement of Drop‐Hammer Impact Testing for Safety Assessment of High Explosives Using 10‐mg Samples

Here, in this study, we established an improved method for drop-hammer impact testing of small quantities of high explosives (10 mg). We performed about seven hundred impact tests under various experimental conditions (e.g., sandpaper vs bare anvil, different sample masses, drop-weights, and striker diameters) to determine an optimal set of conditions and reaction detection methods (e.g., gas analysis, video, and sound recordings) that give the most statistically reliable results with 10 mg samples. We used both Frequentist and Bayesian statistical approaches to compare estimates of the drop height (DH50) that initiates a reaction 50% of the time, and to quantify the associated uncertainty. Gas analysis proved to be the most reliable reaction detection method, showing unambiguous rises in HE decomposition products (e.g., CO 2 ) even when the other indicators (e.g., sound, video) were inconclusive. The impact tests performed with a bare anvil showed much better reproducibility than those conducted with sandpaper, reducing the largest uncertainty observed in the data sets by a factor of 1.7. The DH 50 values obtained from three different sample masses (10, 20, and 35 mg) fell within the uncertainties of the measurements. We demonstrated the improved procedure (i.e., 10-mg samples, gas analysis, bare anvil, and Bayesian approach) on a variety of PETN samples having different surface areas and thermal histories.

PETN↗

Coal-Based Fuel-Cell Powerplants

Report assesses advanced technologyy design alternatives for integrated coal-gasifier/fuel-cell powerplants. Various gasifier, cleanup, and fuelcell options evaluated. Evaluation includes adjustments to assumed performances and costs of proposed technologies where required. Analysis identifies uncertainties remaining in designs and most promising alternatives and research and development required to develop these technologies. Bulk of report summary and detailed analysis of six major conceptual designs and variations of each. All designs for plant that uses Illinois No. 6 coal and produces 675 MW of net power.

Ferral, J. F.↗