Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

DECOVALEX-2023: Task F Specification (Revision 10)

This report is the revised (Revision 10) Task F specification for DECOVALEX-2023. Task F is a comparison of the models and methods used in deep geologic repository performance assessment. The task proposes to develop a reference case for a mined repository in a fractured crystalline host rock (Task F1) and a reference case for a mined repository in a salt formation (Task F2). Teams may choose to participate in the comparison for either or both reference cases. For each reference case, a common set of conceptual models and parameters describing features, events, and processes that impact performance will be given, and teams will be responsible for determining how best to implement and couple the models. The comparison will be conducted in stages, beginning with a comparison of key outputs of individual process models, followed by a comparison of a single deterministic simulation of the full reference case, and moving on to uncertainty propagation and uncertainty and sensitivity analysis. This report provides background information, a summary of the proposed reference cases, and a staged plan for the analysis.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Impact of uncertainty on modeling and testing

A thorough understanding of the uncertainties associated with the modeling and testing of the Space Shuttle Main Engine (SSME) Engine will greatly aid decisions concerning hardware performance and future development efforts. This report will describe the determination of the uncertainties in the modeling and testing of the Space Shuttle Main Engine test program at the Technology Test Bed facility at Marshall Space Flight Center. Section 2 will present a summary of the uncertainty analysis methodology used and discuss the specific applications to the TTB SSME test program. Section 3 will discuss the application of the uncertainty analysis to the test program and the results obtained. Section 4 presents the results of the analysis of the SSME modeling effort from an uncertainty analysis point of view. The appendices at the end of the report contain a significant amount of information relative to the analysis, including discussions of venturi flowmeter data reduction and uncertainty propagation, bias uncertainty documentations, technical papers published, the computer code generated to determine the venturi uncertainties, and the venturi data and results used in the analysis.

Coleman, Hugh W.↗

Realistic Covariance Generation for the GPM Spacecraft

A covariance realism process for NASA's Global Precipitation Measurement (GPM) spacecraft is detailed. The GPM spacecraft is in a low earth orbit, and performs collision avoidance maneuvers few times a year. Currently GPM is below the International Space Station (ISS). So, in addition to cataloged debris objects, GPM must contend with smallsat/cubesat objects that are deployed from the ISS. Both operational scenarios require complete knowledge of the expected GPM prediction errors as a function of time. In this study, we present a method for generating realistic predicted covariance that uses linear propagation of the covariance with the addition of process noise. Further analyses are presented for the process noise ''tuning'' that generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Different tuning strategies are considered and compared via a Goodness-of-Fit testing for the Gaussian properties of the scaled covariance. SpaceNav's realistic covariance generation approach takes into account the contribution of predicted maneuver errors in the increased propagation uncertainty. Corresponding maneuver uncertainty is injected into the state uncertainty, and is used within the collision avoidance process to determine the collision risk for close approach events that follow a maneuver. This is a critical step in the maneuver planning process that provides the satellite operator with an accurate quantification of the collision probability for planned maneuvers. Using this information, an informed decision can be made to proceed with a maneuver if the collision risk is acceptable. This approach is validated by Monte-Carlo simulations and results are presented.

spacecraft uncertainty propagation↗

Data for "Quantifying the Propagation of Parametric Uncertainty on Flux Balance Analysis"

In the repository are example scripts that perform uncertainty injection and propagation to flux balance analysis with outputs for a small sample size (for demonstration purpose only). For proper analysis, user should download the scripts and run for a large sample size (e.g., 10,000 samples). If you use the scripts, please cite the following Metabolic Engineering article: “Quantifying the propagation of parametric uncertainty on flux balance analysis” (https://doi.org/10.1016/j.ymben.2021.10.012) There are two subdirectories: /uncFBA/uncBiom: injection of normally distributed noise to biomass precursor coeffcients and ATP maintenance (growth-associated ATP maintenance (GAM) and non-growth associated ATP maintenance (NGAM)) /uncFBA/uncRHS: departure from steady-state by adding noise drawn from normal distribution to the RHS terms of mass balance constraints

Metabolomics↗

Derivation of mission fluences from flux models: Propagation of uncertainties

The calculation of fluences from the flux models for spacecraft designers, and the propagation of uncertainties in the flux models to larger uncertainties in the final answer are discussed. Ionization and displacement damage in silicon, fluence, and a fluence of an equivalent energy are considered. Data in graph form are presented on stopping power and range curves for electrons and protons in silicon, relative electron and proton damage in silicon, and electron fluences expressed as 3 MeV equivalent and proton fluences expressed as 20 MeV equivalent for flybys in Jupiter's magnetic equatorial plane. It is concluded that the problem includes the uncertainty in peak flux, which has an immediate linear effect; uncertainty in the spatial distribution of the flux which gives great divergency between the upper-limit model and the nominal model and in the case of protons, may preclude any mission planning in order to make the situation better; and the uncertainty in the energy spectrum both in shape and energy location of the peak, if any, and which has little importance for mission planning if the spectrum is fairly constant.

Barengoltz, J.↗

Doppler Global Velocimeter Development for the Large Wind Tunnels at Ames Research Center

Development of an optical, laser-based flow-field measurement technique for large wind tunnels is described. The technique uses laser sheet illumination and charged coupled device detectors to rapidly measure flow-field velocity distributions over large planar regions of the flow. Sample measurements are presented that illustrate the capability of the technique. An analysis of measurement uncertainty, which focuses on the random component of uncertainty, shows that precision uncertainty is not dependent on the measured velocity magnitude. For a single-image measurement, the analysis predicts a precision uncertainty of +/-5 m/s. When multiple images are averaged, this uncertainty is shown to decrease. For an average of 100 images, for example, the analysis shows that a precision uncertainty of +/-0.5 m/s can be expected. Sample applications show that vectors aligned with an orthogonal coordinate system are difficult to measure directly. An algebraic transformation is presented which converts measured vectors to the desired orthogonal components. Uncertainty propagation is then used to show how the uncertainty propagates from the direct measurements to the orthogonal components. For a typical forward-scatter viewing geometry, the propagation analysis predicts precision uncertainties of +/-4, +/-7, and +/-6 m/s, respectively, for the U, V, and W components at 68% confidence.

Reinath, Michael S.↗

MODIS TEB Electronic Crosstalk Correction Update and Impact on L1B Product Uncertainty

The MODIS instruments onboard the Terra and Aqua satellites have been in operation for over22 and 20 years, respectively. The instruments’ calibration accuracy has been maintained, even with instrument degradation. Electronic crosstalk in the thermal emissive bands (TEB) is a known issue with an increasing impact on the calibration and product. The Terra MODIS photovoltaic (PV) longwave infrared (LWIR) bands crosstalk corrections have been applied in Collection 6.1 (C6.1). However, the electronic crosstalk contamination for some detectors in the mid-wave infrared (MWIR) bands and the Aqua PVLWIR bands affect the Level-1B (L1B) product’s measurement accuracy and image quality. In Collection 7 (C7), crosstalk corrections for select detectors in the Terra and Aqua MWIR and Aqua PV LWIR bands are applied. The entire mission crosstalk coefficients for the select detectors and bands are derived from scheduled lunar observations and populated in the form of look-up tables (LUTs). The Aqua PV-LWIR bands exhibit similar downward crosstalk trends as the Terra PV-LWIR bands, especially in recent years. The crosstalk coefficients and their trends provide a guideline for the correction application. Earth measurement analyses before and after the correction provide contamination and correction assessments. It has been shown that the product quality is enhanced with the crosstalk correction applied in C7. For C7, the crosstalk coefficient uncertainty is derived from the fit residuals between the measured values and a linear fit over a three-year sliding window. The uncertainty propagation is modeled and applied in the total uncertainty calculation intheL1B product. The TEB electronic crosstalk LUTs have been processed over the entire Terra and Aqua MODIS missions. This paper presents the C7 crosstalk correction, as well as its assessment and uncertainty propagation algorithm to the TEB uncertainty.

Tiejun Chang↗

Modis TEB Electronic Crosstalk Correction Update and Impact on L1B Product Uncertainty

The MODIS instruments on board the Terra and Aqua satellites have been in operation for over 22 and 20 years, respectively. The instruments’ calibration accuracy has been maintained, even with instrument degradation. Electronic crosstalk in the thermal emissive bands (TEB) is a known issue with an increasing impact on the calibration and product. The Terra MODIS photovoltaic (PV) longwave infrared (LWIR) bands crosstalk corrections have been applied in Collection 6.1 (C6.1). However, the electronic crosstalk contamination for some detectors in the mid-wave infrared(MWIR) bands and the Aqua PVLWIR bands affect the Level-1B(L1B) product’s measurement accuracy and image quality. In Collection 7 (C7), crosstalk corrections for select detectors in the Terra and Aqua MWIR and Aqua PV LWIR bands are applied. The entire mission crosstalk coefficients for the select detectors and bands are derived from scheduled lunar observations and populated in the form of look-up tables (LUTs). The Aqua PV-LWIR bands exhibit similar downward crosstalk trends as the Terra PV-LWIR bands, especially in recent years. The crosstalk coefficients and their trends provide a guideline for the correction application. Earth measurement analyses before and after the correction provide contamination and correction assessments. It has been shown that the product quality is enhanced with the crosstalk correction applied in C7. For C7, the crosstalk coefficient uncertainty is derived from the fit residuals between the measured values and a linear fit over a three-year sliding window. The uncertainty propagation is modeled and applied in the total uncertainty calculation intheL1B product. The TEB electronic cross talk LUT shave been processed over the entire Terra and Aqua MODIS missions. This paper presents the C7 crosstalk correction, as well as its assessment and uncertainty propagation algorithm to the TEB uncertainty.

Tiejun Chang↗

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗

STAT7 v1.2 User Guide: The STAT7 Code for Statistical Propagation of Uncertainties in Steady-State Thermal Hydraulics Analysis of Plate-Fueled Reactors

The STAT7 software was developed to perform steady-state, single-phase thermal hydraulics analysis of plate-fueled reactors based on statistical propagation of uncertainties. Application of the software is for non-power research and test reactors, including conversion to low-enriched uranium fuel of U.S. High-Performance Research Reactors such as Massachusetts Institute of Technology Research Reactor. Since it can be necessary to repeat analysis during fuel reloading, STAT7 accommodates flexibility in analyzing many realistic aspects of reactor fuel management. STAT7 uses a Monte Carlo approach to model uncertainty in common fuel fabrication parameters and other key reactor operating parameters required for thermal hydraulics analyses of research and test reactors. These safety calculations are ultimately intended to protect against high fuel plate temperatures due to critical heat flux, or onset of flow instability. STAT7 supports water properties based on the IAPWS-IF97 functions (The International Association for the Properties of Water and Steam Industrial Formulation 1997 for the Thermodynamic Properties of Water and Steam) in addition to the fit functions. STAT7 predicts axial profiles of fuel, cladding, and coolant temperature along a lateral stripe that runs the full length of the fuel plate from the bottom to the top. STAT7 can simultaneously analyze all of the axial nodes of all of the fuel plates and all of the coolant channels for one latera stripe of a fuel element. Power splits are calculated for each axial node of each plate to determine how much of the power goes out each face of the plate. By running STAT7 multiple times, full core analysis can be performed by analyzing the margin to onset of nucleate boiling and onset of flow instability for each axial node of each stripe of each plate of each fuel element in the core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Framework for Propagation of Uncertainties in the Kepler Data Analysis Pipeline

The Kepler space telescope is designed to detect Earth-like planets around Sun-like stars using transit photometry by simultaneously observing 100,000 stellar targets nearly continuously over a three and a half year period. The 96-megapixel focal plane consists of 42 charge-coupled devices (CCD) each containing two 1024 x 1100 pixel arrays. Cross-correlations between calibrated pixels are introduced by common calibrations performed on each CCD requiring downstream data products access to the calibrated pixel covariance matrix in order to properly estimate uncertainties. The prohibitively large covariance matrices corresponding to the ~75,000 calibrated pixels per CCD preclude calculating and storing the covariance in standard lock-step fashion. We present a novel framework used to implement standard propagation of uncertainties (POU) in the Kepler Science Operations Center (SOC) data processing pipeline. The POU framework captures the variance of the raw pixel data and the kernel of each subsequent calibration transformation allowing the full covariance matrix of any subset of calibrated pixels to be recalled on-the-fly at any step in the calibration process. Singular value decomposition (SVD) is used to compress and low-pass filter the raw uncertainty data as well as any data dependent kernels. The combination of POU framework and SVD compression provide downstream consumers of the calibrated pixel data access to the full covariance matrix of any subset of the calibrated pixels traceable to pixel level measurement uncertainties without having to store, retrieve and operate on prohibitively large covariance matrices. We describe the POU Framework and SVD compression scheme and its implementation in the Kepler SOC pipeline.

Clarke, Bruce D.↗

Network Uncertainty Quantification for Analysis of Multi-Component Systems

To impact physical mechanical system design decisions and realize the full promise of high-fidelity computational tools, simulation results must be integrated at the earliest stages of the design process. This is particularly challenging when dealing with uncertainty and optimizing for system-level performance metrics, as full-system models (often notoriously expensive and time-consuming to develop) are generally required to propagate uncertainties to system-level quantities of interest. Methods for propagating parameter and boundary condition uncertainty in networks of interconnected components hold promise for enabling design under uncertainty in real-world applications. These methods avoid the need for time consuming mesh generation of full-system geometries when changes are made to components or subassemblies. Additionally, they explicitly tie full-system model predictions to component/subassembly validation data which is valuable for qualification. These methods work by leveraging the fact that many engineered systems are inherently modular, being comprised of a hierarchy of components and subassemblies that are individually modified or replaced to define new system designs. By doing so, these methods enable rapid model development and the incorporation of uncertainty quantification earlier in the design process. The resulting formulation of the uncertainty propagation problem is iterative. We express the system model as a network of interconnected component models, which exchange solution information at component boundaries. We present a pair of approaches for propagating uncertainty in this type of decomposed system and provide implementations in the form of an open-source software library. We demonstrate these tools on a variety of applications and demonstrate the impact of problem-specific details on the performance and accuracy of the resulting UQ analysis. This work represents the most comprehensive investigation of these network uncertainty propagation methods to date.

42 ENGINEERING↗

Propagation of experimental uncertainties from the tunnel to the body coordinate system in 3-D LDV flow field studies

An analysis of experimental laser Doppler velocimetry (LDV) data uncertainties that propagate from measurements in the tunnel coordinate system to results in the model system are provided. Calculations of uncertainties as functions of the variables that comprise the final result requires assessment of the contribution each variable makes. Such an analysis enables and necessitates the experimentalists to identify and address the contributing error sources in the experimental measurement system. This provides an opportunity to improve the quality of data derived from experimental systems. This is especially important in experiments where small changes in test conditions are expected to produce small, detectable changes in results. In addition, the need for high-quality experimental data for CFD method validation demands a thorough assessment of experimental uncertainty. Transforming from one Cartesian coordinate system to another by three sequential rotations, equations were developed to transform the variables initially obtained in the original coordinates into variables in the final coordinate system. Based on the transformation equations, propagation equations for errors in the experimentally-derived flow quantities were derived for a model at angle of attack. Experimental uncertainties were then propagated from the tunnel coordinate system into the model system.

Neuhart, Dan H.↗

Advanced Graphite Creep Uncertainty Analysis

Radiation damage estimation is an important component of the post irradiation analysis of the Advanced Graphite Creep (AGC) experiment. It depends primarily on the fast fluence, which is determined using well established methods of spectral adjustment. These are based on best estimates from models such as Monte Carlo N-Particle (MCNP), input cross-sections, and measured activities from flux wires in the experiment. Each of these parameters can propagate uncertainties which will affect the uncertainty in the calculated dose levels for AGC, or any experiment irradiated within a reactor. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to outline some deficiencies in the ways these input uncertainties are presently estimated, and to outline a methodology by which they can be improved. The fast fluence and radiation damage received by graphite specimens irradiated in the Advanced Graphite Creep (AGC) experiments is presently estimated using spectral adjustment methods that are based on both flux wire activity measurements, and MCNP model predictions. This work describes an ongoing effort to quantify and propagate uncertainties in inputs to the spectral adjustment process, and thereby quantify the resultant error in radiation damage (dpa) estimates. The effort is multi-faceted, and we consider the impacts of both the set of flux wires selected, and the counting process. An expanded set of flux wires is identified that provides a more comprehensive data set on the fast spectrum. To address the counting process itself, a series of round-robin measurements in several reactor metrology laboratories across the Department of Energy (DOE) complex and nuclear industry are being undertaken to refine the American Society for Testing and Materials (ASTM) standards for flux wire measurements. To address the contribution of uncertainty in the MCNP model predictions, an uncertainty quantification (UQ) tool has been developed that statistically samples the model input parameters, runs a series of cases, and assimilates the results to provide an overall uncertainty. The impact of the MCNP UQ tool results is demonstrated by re-analyzing previous AGC flux wire and irradiation data. While the expanded flux wire set obviously cannot be added to these experiments retroactively, plans for future graphite irradiations are outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Fast and Precise Trajectory Simulation for Entry, Descent, and Landing Using A Multi-Model Monte Carlo Approach

Predicting landing radius and other quantities of interest (QoI) for entry, descent, and landing (EDL) applications requires a viable uncertainty propagation method for quantifying the impact of uncertainties in wind pattern variations, atmospheric uncertainties, etc. While standard MC simulation is the defacto standard for providing robust and unbiased predictions,it is often infeasible for expensive, high-fidelity EDL models. Low-fidelity models are commonly constructed to replace the high-fidelity model in MC simulation for computational speedup,but at the expense of accuracy and unbiasedness. Emerging multi-model MC methods are bridging this gap by combining predictions from two or more models of varying fidelity and computational cost for efficient and unbiased uncertainty propagation. This work explores the use of multi-model MC for increasing the speed and precision of trajectory simulation for EDL. It is shown that combining a high-fidelity EDL model with low-fidelity models (e.g,data-driven, reduced physics) yields substantial computational speedup versus standard MCwith only the high-fidelity model. Moreover, the unbiasedness of multi-model MC predictions is highlighted by showing increased accuracy versus an approach that leverages a low-fidelity surrogate model alone.

James E. Warner↗

Unbalanced Nested Random Effects Estimation of Variance Components

To investigate the contributing factors of variance in the measurement of an iodine 127 (127I) sample, we implement a nested random effects analysis of variance (ANOVA). Historically, the reported uncertainty on a measurement of 127I has been obtained by methods of forward uncertainty propagation because there is typically only one replicate of a given sample for which to estimate the uncertainty. When samples are processed there are several types of quality control (QC) standards analyzed along-side the unknown samples with two to five replicates for each. Assuming the variance observed in these replicate QC standards is representative of that of the unknown samples, we use these data in a nested random effects ANOVA to estimate the total uncertainty of a measurement. We demonstrate this approach with two sets of measurements from Idaho National Laboratory and compare the results with the forward uncertainty propagation approach. Variance component estimates for the coarsest level of the nesting structure were most imprecise because replicates were most limited at these levels. We find that the results largely agree between forward propagation and ANOVA, and the greatest contributors of variance are due to instrument variation and chemical processing, with human processing being among the smallest contributors. This analysis provides reassurance that the reported uncertainties using forward propagation are reasonable and the process is well controlled. We propose a future designed experiment to increase replicates at the coarsest level of the hierarchy to improve estimates of these variance components.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

On the Feynman-alpha method for reflected fissile assemblies

The Feynman-alpha method is a neutron noise technique that is used to estimate the prompt neutron period of fissile assemblies. The method and quantity are of widespread interest including in applications such as nuclear criticality safety, safeguards and nonproliferation, and stockpile stewardship; the prompt neutron period may also be used to infer the k eff multiplication factor. The Feynman-alpha method is predicated on time-correlated neutron detections that deviate from a Poisson random variable due to multiplication. Traditionally, such measurements are diagnosed with one-region point kinetics, but two-region models are required when the fissile assembly is reflected. This paper presents a derivation of the two-region point kinetics Feynman-alpha equations based on a double integration of the Rossi-alpha equations, develops novel propagation of measurement uncertainty, and validates the theory. Validation is achieved with organic scintillator measurements of weapons-grade plutonium reflected by various amounts of copper to achieve k eff values of 0.83–0.94 and prompt periods of 5–75 ns. The results demonstrate that Feynman-alpha measurements should use the two-region model instead of the one-region model. The simplified one-region model deviates from the validated two-region models by as much as 10% in the estimate of the prompt neutron period, and the two-region model reduces to the one-region model for small amounts of reflector. The Feynman-alpha estimates of the prompt neutron period are compared to those of the Rossi-alpha approach. The comparative results demonstrate that the Feynman-alpha method is more precise than the Rossi-alpha method and more accurate for k eff < 0.92, whereas the Rossi-alpha method is generally more accurate for higher multiplications. Here, the uncertainty propagation developed in this work should be used for all Feynman-alpha measurements and will therein improve fitting accuracy and appropriate precision estimates.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗