Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Attitude determination error analysis - General model and specific application

This paper presents a comprehensive approach to filter and dynamics modeling for attitude determination error analysis. The discussion includes models for both batch least-squares and sequential estimators, a specific dynamic model for attitude determination error analysis of a three-axis stabilized spacecraft equipped with strapdown gyros, and the incorporation of general attitude sensor observations. An analyst using this approach to perform an error analysis chooses a subset of the spacecraft parameters to be 'solve-for' parameters, which are to be estimated, and another subset to be 'consider' parameters, which are assumed to have errors but not to be estimated. The result of the error analysis is an indication of overall uncertainties in the 'solve-for' parameters, as well as the contributions of the various error sources to these uncertainties, including those of errors in the a priori 'solve-for' estimates, of measurement noise, of dynamic noise (also known as process noise or plant noise), and of 'consider' parameter uncertainties. The analysis of attitude, star tracker alignment, and gyro bias uncertainties for the Gamma Ray Observatory spacecraft provide a specific example of the use of a general-purpose software package incorporating these models.

Markley, F. Landis↗
NASA NTRS2019

A Double Bootstrap Approach to Superposed Epoch Analysis to Evaluate Response Uncertainty

The association between climate variability and episodic events, such as the antecedent moisture conditions prior to wildfire or the cooling following volcanic eruptions, is commonly assessed using Superposed Epoch Analysis (SEA). In SEA the epochal response is typically calculated as the average climate conditions prior to and following all event years or their deviation from climatology. However, the magnitude and significance of the inferred climate association may be sensitive to the selection or omission of individual key years, potentially resulting in a biased assessment of the relationship between these events and climate. Here we describe and test a modified double-bootstrap SEA that generates multiple unique draws of the key years and evaluates the sign, magnitude, and significance of event-climate relationships within a probabilistic framework. This multiple resampling helps quantify multiple uncertainties inherent in conventional applications of SEA within dendrochronology and paleoclimatology. We demonstrate our modified SEA by evaluating the volcanic cooling signal in a Northern Hemisphere tree-ring temperature reconstruction and the link between drought and wildfire events in the western United States. Finally, we make our Matlab and R code available to be adapted for future SEA applications.

Dendroclimatology↗
DOE OSTI2021

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗
DOE OSTI2023

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗
NASA NTRS2017

Aeroelastic Uncertainty Quantification Studies Using the S4T Wind Tunnel Model

This paper originates from the joint efforts of an aeroelastic study team in the Applied Vehicle Technology Panel from NATO Science and Technology Organization, with the Task Group number AVT-191, titled "Application of Sensitivity Analysis and Uncertainty Quantification to Military Vehicle Design." We present aeroelastic uncertainty quantification studies using the SemiSpan Supersonic Transport wind tunnel model at the NASA Langley Research Center. The aeroelastic study team decided treat both structural and aerodynamic input parameters as uncertain and represent them as samples drawn from statistical distributions, propagating them through aeroelastic analysis frameworks. Uncertainty quantification processes require many function evaluations to asses the impact of variations in numerous parameters on the vehicle characteristics, rapidly increasing the computational time requirement relative to that required to assess a system deterministically. The increased computational time is particularly prohibitive if high-fidelity analyses are employed. As a remedy, the Istanbul Technical University team employed an Euler solver in an aeroelastic analysis framework, and implemented reduced order modeling with Polynomial Chaos Expansion and Proper Orthogonal Decomposition to perform the uncertainty propagation. The NASA team chose to reduce the prohibitive computational time by employing linear solution processes. The NASA team also focused on determining input sample distributions.

Nikbay, Melike↗
NASA NTRS2019

Improvements in the Uncertainty Model in the Goddard Institute for Space Studies Surface Temperature (GISTEMP) Analysis

We outline a new and improved uncertainty analysis for the Goddard Institute of Space Studies (GISS) Surface Temperature product version 4 (GISTEMP v4). Historical spatial variations in surface temperature anomalies are derived from historical weather station data and ocean data from ships, buoys and other sensors. Uncertainties arise from measurement uncertainty, changes in spatial coverage of the station record, and systematic biases due to technology shifts and land cover changes. Previously published uncertainty estimates for GISTEMP included only the effect of incomplete station coverage. Here, we update this term using currently available spatial distributions of source data, state‐of‐the‐art reanalyses and incorporate independently derived estimates for ocean data processing, station homogenization and other structural biases. The resulting 95% uncertainties are near 0.05° C in the global annual mean for the last 50 years, and increase going back further in time reaching 0.15° C in 1880. In addition, we quantify the benefits and inherent uncertainty due to the GISTEMP interpolation and averaging method. We use the total uncertainties to estimate the probability for each record year in the GISTEMP to actually be the true record year (to that date), and conclude with 86% likelihood that 2016 was indeed the hottest year of the instrumental period (so far).

Nathan J L Lenssen↗
DOE OSTI2023

Simulation of a TRISO MiniFuel irradiation experiment with data-informed uncertainty quantification

An irradiation experiment using tristructural isotropic (TRISO) fuel particles and the miniature fuel (MiniFuel) irradiation vehicle was performed in Oak Ridge National Laboratory’s High Flux Isotope Reactor (HFIR) to support development of the Kairos Power fluoride salt–cooled, high-temperature reactor (KP-FHR). Here, this paper describes modeling predictions of temperatures and fuel burnup for the as-built experiment. An uncertainty quantification (UQ) analysis was performed to determine the effect of TRISO particle volume and position on the temperature predictions at various fuel heat generation rates (HGRs). This UQ study utilized fuel kernel position and volume measurements previously collected using X-ray computed tomography (XCT) techniques and Monte Carlo sampling methods to generate fuel compact cases that were then analyzed using a finite element thermal model. The UQ analysis indicated that uncertainty in calculated temperatures caused by varying TRISO particle arrangement is relatively small, even at high fuel HGR. Final predictions of particle temperatures throughout the irradiation are shown to be relevant to KP-FHR normal and off-normal operating conditions and to previous TRISO irradiation experiments. The combination of XCT with UQ analyses will inform post-irradiation examination (PIE) of the irradiated fuel compacts, and these analyses can be used to develop fuel performance models for coated particle fuel forms. Both PIE of separate-effects irradiation data and enhanced fuel performance modeling support accelerated qualification of TRISO fuels for a broad range of advanced reactor applications. The novel approach demonstrated here of measuring TRISO particle configurations with XCT methods and generating representative fuel compacts for finite element modeling and UQ analysis could be leveraged by the broader particle fuel community in the development of other TRISO fuel experiments in which these variables may have a significant impact on key outcomes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Uncertainty propagation and sensitivity analysis for constrained optimization of nuclear waste vitrification

Abstract The vitrification of high‐level waste (HLW) by heating a mixture of glass‐forming chemicals (GFCs) with the waste can be improved using a constrained optimization problem. This study explores how different uncertainty propagation (UP) methods implemented with the optimization process can affect the glass formulation of nuclear waste glasses. UP is the effort of propagating uncertain inputs through a system to understand and quantify output distributions. Uncertainty intervals are crafted from output distributions to inform the optimization algorithm. UP is often implemented with Monte Carlo (MC) sampling for large nonlinear systems, which can be difficult to implement within a constrained optimization algorithm that requires derivative information. Other UP methods often used for optimization under uncertainty (OUU) can be designed to work within an established constrained optimization framework. Methods of UP are evaluated in this study including iterative sampling approaches, first‐order approximations, and surrogate modeling with machine learning (ML). A method of dimensional reduction based on global sensitivity analysis is introduced to support the UP methods for the large dimensionality of the problem. Analytical UP methods able to achieve similar optimums 10 times faster than the baseline MC approach, and produce 93.9% similar output distributions are reported.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2011

Assessment of MODIS Thermal Emissive Band On-Orbit Calibration

Sixteen Moderate Resolution Imaging Spectroradiometer thermal emissive bands (TEBs) cover the wavelength from 3.75 to 14.24 m. TEB calibration uses data collected from the detector responses to the onboard blackbody (BB) and space view. The BB was designed to operate either at a constant temperature for detector linear gain calibration or at temperatures varying from ambient ( 270 K) to 315 K for on-orbit characterization of nonlinear coefficients. In this paper, we assess TEB on-orbit calibration performance in two aspects: One is to review the calibration trending on the orbital, daily, and multiyear timescales, and the other is to analyze the on-orbit calibration radiance uncertainty and its impact on the calibration. The calibration trending confirms the detector response dependence on the instrument temperature. The temperature trending and prelaunch characterization provide the basis for determining the calibration radiance source temperature range and uncertainties. An analytical approach was used to assess the impacts of onboard radiance uncertainties. The BB emission uncertainty, resulting from the temperature measurement error and emissivity uncertainty, causes a calibration uncertainty up to 0.3%, a value decreasing with the band wavelength. The BB nonblackness effect is analyzed and found to be insignificant. For the band with the lowest BB emissivity, the nonblackness affects the calibration radiance by less than 0.08%. The cavity emission uncertainty and the scan-mirror emission uncertainty both cause a less than 0.1% calibration uncertainty. The analysis of the nonlinear calibration coefficient uncertainty shows that its effect on the low Earth-view brightness-temperature range varies by band and is generally insignificant.

Chang, Tiejun↗
DOE OSTI2022

Quantifying the impact of temporal analysis of products reactor initial state uncertainties on kinetic parameters

The temporal analysis of products (TAP) reactor, a transient kinetic tool, provides users with information as the catalyst state evolves. However, the state of the art for TAP uncertainty quantification only considers the experimental noise present in the outlet flow signal. Additional sources of uncertainty, including, but not limited to, initial surface coverages, the catalyst zone location, the inert void fraction, and the gas pulse intensity and pulse delay, are not included. For this reason, a framework for quantifying all uncertainty sources present in TAP experiments is presented and applied to a carbon monoxide oxidation case study. Herein, two methods for quantifying these sources of uncertainty are introduced. The first utilizes initial state sensitivities to approximate the parameter variances, as well as to provide insights into the structural certainty of the model. The second generates parameter confidence distributions through an ensemble-based sampling algorithm. This initial state covariance matrix can ultimately be merged with the experimental noise covariance matrix, providing a unified description of the parameter uncertainties for a single TAP experiment.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Data-driven surrogate modeling of hPIC ion energy-angle distributions for high-dimensional sensitivity analysis of plasma parameters' uncertainty

In this work, we present a data-driven strategy for effective construction of a surrogate model in high-dimensional parameter space for the ion energy-angle distribution (IEAD) output of hPIC simulations of plasma-surface interactions. The methodology is based on a bin-by-bin least-squares fitting of the IEAD in the parameter space. The fitting is performed in a transformed coordinate system to normalize the IEAD, and it employs sparse grids for sampling the parameter space to overcome sampling challenges in high dimensions. The surrogate model is significantly cheaper computationally than direct hPIC simulations yet maintains high fidelity to them, providing a fast emulator for hPIC simulations. Sensitivity analysis based on the surrogate model is utilized to characterize the dependence of the ion impact angle and energy moments on the physical parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Uncertainty in Experimental Data Analysis [Slides]

The talk was presented virtually to the Institute of Fundamental Technological Research, Polish Academy of Sciences in Warsaw, Poland, December 21, 2020. Astronomical observations, unusual medical cases, physics experiments too costly to repeat, natural events like earthquakes, hurricanes – all of them are impossible to repeat yet produce important scientific information not achievable in other way. This data should not be treated as qualitative, anecdotal evidence only. It should be analyzed in a mathematically rigorous way to produce quantitative experimental data. Analysis method for one-of-a-kind event data differs from analysis of a repeated experiment data. For a repeated experiments the experimental error includes a range of true values generated by repetitions of the experiment, and measurement uncertainty caused by detectors. They are independent. Repetitions of any experiment, as similar as achievable, always have built-in differences resulting in a range of the true values rather than in a single true experimental value. Measurement uncertainty depends on the measurement system only. Modern digital measurements have very small uncertainty, frequently smaller than the range of true experimental values resulting from built-in differences in the experiment repetitions. When data from one-of-a-kind experiment are analyzed, only the measurement uncertainty can be reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

My Virtual Cancer

Since each cancer has its own unique characteristics, each one can respond differently to the same treatments. Therefore, the creation of a digital twin (DT) of cancer can assist us in predicting the evolution of an individual's cancer through modeling each tumor's characteristics and response to treatment. Hence, we propose to take advantage of new advances in computational approaches and combine mechanistic, machine learning, and stochastic modeling approaches to create “My Virtual Cancer", a DT platform. To establish a personalized DT, we use patient-specific data for parameter estimations, sensitivity analysis, and uncertainty quantification. For each patient, we will estimate the values of parameters of their QSP model using the patient's data. We perform a multi-dimensional sensitivity analysis and uncertainty quantification on the mechanistic model to find a set of critical interactions and predict the intervals of confidence. Since this QSP model includes the data-driven mechanistic model of cells and molecules' interaction networks, one of the ultimate results of this DT would be the prediction of evolution of tumors.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Nuclear Data Sensitivity Study for the EBR-II Fast Reactor Benchmark Using SCALE with ENDF/B-VII.1 and ENDF/B-VIII.0

The EBR-II benchmark, which was recently included in the International Handbook of Evaluated Reactor Physics Benchmark Experiments, served as a basis for assessing the performance of the SCALE code system for fast reactor analyses. A reference SCALE model was developed based on the benchmark specifications. Great agreement was observed between the eigenvalue calculated with this SCALE model and the benchmark eigenvalue. To identify potential gaps and uncertainties of nuclear data for the simulation of various quantities of interest in fast spectrum systems, sensitivity and uncertainty analyses were performed for the eigenvalue, reactivity effects, and the radial power profile of EBR-II using the two most recent ENDF/B nuclear data library releases. While the nominal results are consistent between the calculations with the different libraries, the uncertainties due to nuclear data vary significantly. The major driver of observed uncertainties is the uncertainty of the 235 U ( n,γ ) reaction. Since the uncertainty of this reaction is significantly reduced in the ENDF/B-VIII.0 library compared to ENDF/B-VII.1, the obtained output uncertainties tend to be smaller in ENDF/B-VIII.0 calculations, although the decrease is partially compensated by increased uncertainties in 235 U fission and ν ¯ .

42 ENGINEERING↗
DOE OSTI2020

Total Measurement Uncertainty in Neutron Coincidence Multiplicity Analysis

Neutron multiplicity counting is the most commonly used nondestructive assay technique for determining the plutonium mass within containers of scrap PuO 2 or mixed oxide (MOX). In multiplicity analysis, the 240 Pu eff mass, leakage multiplication, and alpha ratio (the ratio of [α, n]-to-spontaneous fission neutron production) are the three primary unknown sample properties. They must be determined simultaneously. To solve for these three unknowns in a multiplicity assay, three measured values are needed: the singles, doubles, and triples neutron count rates. While the analysis is limited to solving for three unknowns, there are many additional factors that impact the observed count rates and contribute to the measurement uncertainty. In this study we investigate the various uncertainty contributors for the multiplicity analysis through a combination of traditional uncertainty propagation techniques supplemented by Monte Carlo simulations to address the dependences not explicitly expressed by the point source model. Uncertainties arising from counting statistics, calibration parameters, calibration method, nuclear data, and various material characteristics (isotopic abundances, chemical form, density, and impurities) are considered. A Total Measurement Uncertainty (TMU) estimate is then developed from these uncertainty contributors. This study is confined to multiplicity analysis of items commonly encountered in international safeguards applications. That is, the study focused on Pu oxides and MOX materials for the masses ranging up to 4000 grams total Pu. Multiplicity measurements were simulated using MCNP V6 based on the Plutonium Scrap Multiplicity Counter (PSMC), Epithermal Multiplicity Counter (ENMC), Pyrochemical Multiplicity Counter, and Large Epithermal Multiplicity Counter (LEMC) for this study; however, this report focuses on the parameterization of the uncertainties for the PSMC. The performance differences between the PSMC and the other multiplicity counting systems are relatively small, primarily manifesting in the impact on measurement precision so that the evaluation developed for the PSMC can be applied to the other multiplicity counting systems. Finally an analysis tool, the Multiplicity TMU Estimator, was developed from this study to serve as an aid for evaluation of the total measurement uncertainty of multiplicity assay results obtained from the commonly used INCC acquisition and analysis software.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Harnessing Uncertainty through Functional Data Analysis in Gas Breakthrough Data

Detecting subsurface explosions from radionuclide gas migration through rock fractures is an effective way to identify nuclear activity. Los Alamos National Laboratory (LANL) has developed simulation methods, based on data from the 1962 Hardhat underground nuclear test, to predict gas breakthrough times at the surface. However, these methods rely on an imperfect understanding of the relationship between rock damage and fracture permeability. Our clinic project studies methods for predicting breakthrough curves that characterize total mass produced as a function of time, as well as quantifying the uncertainty associated with these predictions. The model that is currently employed to relate damage to permeability uses an empirically motivated power-law expression, with a range of parameter values that are compatible with the experimental Hardhat data. We develop emulators, built from functional data analysis techniques and trained on simulation data, that rapidly predict the gas breakthrough curve given a damage field and given the parameter values of the power-law equation. Using Bayesian regression, we address the problem of uncertainty quantification in our emulators. Finally, in order to test the robustness of the model, we further validate it on a damage field representing different physical conditions.

58 GEOSCIENCES↗
DOE OSTI2025

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗
DOE OSTI2021

Quantifying the propagation of parametric uncertainty on flux balance analysis

Flux balance analysis (FBA) and associated techniques operating on stoichiometric genome-scale metabolic models play a central role in quantifying metabolic flows and constraining feasible phenotypes. At the heart of these methods lie two important assumptions: (i) the biomass precursors and energy requirements neither change in response to growth conditions nor environmental/genetic perturbations, and (ii) metabolite production and consumption rates are equal at all times (i.e., steady-state). Despite the stringency of these two assumptions, FBA has been shown to be surprisingly robust at predicting cellular phenotypes. In this paper, we formally assess the impact of these two assumptions on FBA results by quantifying how uncertainty in biomass reaction coefficients, and departures from steady-state due to temporal fluctuations could propagate to FBA results. In the first case, conditional sampling of parameter space is required to re-weigh the biomass reaction so as the molecular weight remains equal to 1 g mmol –1 , and in the second case, metabolite (and elemental) pool conservation must be imposed under temporally varying conditions. Results confirm the importance of enforcing the aforementioned constraints and explain the robustness of FBA biomass yield predictions.

59 BASIC BIOLOGICAL SCIENCES↗