Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Measurement uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Uncertainty and Sensitivity Analyses of a Two-Parameter Impedance Prediction Model

This paper presents comparisons of predicted impedance uncertainty limits derived from Monte-Carlo-type simulations with a Two-Parameter (TP) impedance prediction model and measured impedance uncertainty limits based on multiple tests acquired in NASA Langley test rigs. These predicted and measured impedance uncertainty limits are used to evaluate the effects of simultaneous randomization of each input parameter for the impedance prediction and measurement processes. A sensitivity analysis is then used to further evaluate the TP prediction model by varying its input parameters on an individual basis. The variation imposed on the input parameters is based on measurements conducted with multiple tests in the NASA Langley normal incidence and grazing incidence impedance tubes; thus, the input parameters are assigned uncertainties commensurate with those of the measured data. These same measured data are used with the NASA Langley impedance measurement (eduction) processes to determine the corresponding measured impedance uncertainty limits, such that the predicted and measured impedance uncertainty limits (95% confidence intervals) can be compared. The measured reactance 95% confidence intervals encompass the corresponding predicted reactance confidence intervals over the frequency range of interest. The same is true for the confidence intervals of the measured and predicted resistance at near-resonance frequencies, but the predicted resistance confidence intervals are lower than the measured resistance confidence intervals (no overlap) at frequencies away from resonance. A sensitivity analysis indicates the discharge coefficient uncertainty is the major contributor to uncertainty in the predicted impedances for the perforate-over-honeycomb liner used in this study. This insight regarding the relative importance of each input parameter will be used to guide the design of experiments with test rigs currently being brought on-line at NASA Langley.

Jones, M. G.↗

A general model for attitude determination error analysis

An overview is given of a comprehensive approach to filter and dynamics modeling for attitude determination error analysis. The models presented include both batch least-squares and sequential attitude estimation processes for both spin-stabilized and three-axis stabilized spacecraft. The discussion includes a brief description of a dynamics model of strapdown gyros, but it does not cover other sensor models. Model parameters can be chosen to be solve-for parameters, which are assumed to be estimated as part of the determination process, or consider parameters, which are assumed to have errors but not to be estimated. The only restriction on this choice is that the time evolution of the consider parameters must not depend on any of the solve-for parameters. The result of an error analysis is an indication of the contributions of the various error sources to the uncertainties in the determination of the spacecraft solve-for parameters. The model presented gives the uncertainty due to errors in the a priori estimates of the solve-for parameters, the uncertainty due to measurement noise, the uncertainty due to dynamic noise (also known as process noise or measurement noise), the uncertainty due to the consider parameters, and the overall uncertainty due to all these sources of error.

Markley, F. Landis↗

Quantifying uncertainty in uranium concentration measurements via K-edge densitometry

This study quantifies the uncertainty in uranium concentration predictions of fluoride and chloride-based salts within a steel pipe using K-edge densitometry. Modeling and simulation was conducted with the Monte Carlo N-Particle Transport (MCNP) code. The quality of of this technique’s prediction in a pipe requires proper characterization of the pipe’s thickness, which is dependent on the source size and axial offset from the pipe centerline. The thickness was determined as either the center-line thickness seen by the X-ray source or an average value determined through random sampling. Generally, the predicted concentrations were slightly better at lower offset with the random sampling thickness and using the center-line thickness for the highest offsets. For a line-beam source and varying axial offsets, the relative error of concentration was within 1% of the true value but uncertainty increased by 2 orders of magnitude. Similarly, for no axial offset, the relative error was significantly less than 1% while no trend for uncertainty was found. However, at the largest possible offset for a given source size, the concentrations become erroneous and greater than the allowable 1% relative error. Furthermore, high offsets tended to increase the variance of the transmission spectra by 3 orders of magnitude.

Characterization and Analytical Technique↗

A Reconfigurable Planar Capacitor Sensor for Thru the Jacket Dielectric Constant Measurement of Cable Insulation

Planar capacitor sensors have been proposed to measure the aging-related dielectric constant variation of the jacket or insulation materials of cables. Although capacitor sensors have been used to monitor the aging of cable insulation by removing the jacket, through the jacket measurement of cable insulation dielectric constant variation is difficult because once the sensor is placed on the jacket it would either measure the aging of the jacket or that of the jacket and insulation together. A reconfigurable sensor along with innovative cable-specific models could be used to determine the jacket and insulation aging using the same sensor. For the proposed novel reconfigurable sensor, the electric field penetration depth is changed by activating and deactivating PIN diode switches. In one instance, the sensor measures the dielectric constant variation of the jacket, while in the next, it measures the dielectric constant variation of both the jacket and the insulation. Here, by leveraging previously developed capacitance estimation models from large-scale finite element simulations for a specific cable, these two sets of measurement data are used to evaluate the aging-related dielectric constant variation of the insulation. Experimental data from aged cable specimens are presented to demonstrate the operation of the sensor.

47 OTHER INSTRUMENTATION↗

Sampling on NISQ Devices: "Who’s the Fairest One of All?"

Modern NISQ devices are subject to a variety of biases and sources of noise that degrade the solution quality of computations carried out on these devices. A natural question that arises in the NISQ era, is how fairly do these devices sample ground state solutions. To this end, we run five fair sampling problems (each with at least three ground state solutions) that are based both on quantum annealing and, on the Grover Mixer, -QAOA algorithm for gate-based NISQ hardware. In particular, we use seven IBM Q devices, the Aspen-9 Rigetti device, the IonQ device, and three D-Wave quantum annealers. For each of the fair sampling problems, we measure the ground state probability, the relative fairness of the frequency of each ground state solution with respect to the other ground state solutions, and the aggregate error as given by each hardware provider. Overall, our results show that NISQ devices do not achieve fair sampling yet. Furthermore, we also observe differences in the software stack with a particular focus on compilation techniques that illustrate what work will still need to be done to achieve a seamless integration of frontend (i.e., quantum circuit description) and backend compilation.

Computer Science↗

Carbon monoxide measurement in the global atmospheric sampling program

The carbon monoxide measurement system used in the NASA Global Atmospheric Sampling Program (GASP) is described. The system used a modified version of a commercially available infrared absorption analyzer. The modifications increased the sensitivity of the analyzer to 1 ppmv full scale, with a limit of detectability of 0.02 ppmv. Packaging was modified for automatic, unattended operation in an aircraft environment. The GASP system is described along with analyzer operation, calibration procedures, and measurement errors. Uncertainty of the CO measurement over a 2-year period ranged from + or - 3 to + or - 13 percent of reading, plus an error due to random fluctuation of the output signal + or - 3 to + or - 15 ppbv.

Dudzinski, T. J.↗

Application of Neutron Multiplicity Counting Experiments to Optimal Cross-Section Adjustments

This paper presents the first application of model calibration to neutron multiplicity counting (NMC) experiments for cross-section optimization that is informed by adjoint-based sensitivity analysis (SA) and first-order uncertainty quantification (UQ). We summarize previous work on SA applied to NMC and describe notable modifications and additions. We give the procedure for first-order UQ and Bayesian-inference-based parameter estimation (PE). We then discuss model calibration applied to NMC of a 4.5-kg sphere of weapons-grade, alpha-phase plutonium metal (the BeRP ball) with the nPod neutron multiplicity counter. For the BeRP ball in bare and polyethylene-reflected configurations, we discuss the sensitivity of the first- and second-moment detector responses (i.e., first and second moments of the NMC distribution, respectively) to the cross sections. We describe the sources of uncertainty in the measured and simulated responses. Specifically, uncertainty in the measured responses is due to both random and systematic sources. Uncertainty in the simulated responses is due to the cross-section covariances. We describe in detail the adjustment to the cross sections and cross-section covariances due to the optimization. Due to the contribution of systematic uncertainties to the measured response uncertainties, the adjustment to the cross sections is similar in trend but larger in magnitude compared to that recommended by previous work. We compare the measured responses to responses simulated with nominal and optimized cross sections, demonstrating that the best-estimate cross sections produce simulations of NMC experiments that are more accurate with reduced uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty of in-flight thrust determination

Methods for estimating the measurement error or uncertainty of in-flight thrust determination in aircraft employing conventional turbofan/turbojet engines are reviewed. While the term 'in-flight thrust determination' is used synonymously with 'in-flight thrust measurement', in-flight thrust is not directly measured but is determined or calculated using mathematical modeling relationships between in-flight thrust and various direct measurements of physical quantities. The in-flight thrust determination process incorporates both ground testing and flight testing. The present text is divided into the following categories: measurement uncertainty methodoogy and in-flight thrust measurent processes.

Abernethy, Robert B.↗

Uncertainty in Annual Energy Resulting from Uncertain Irradiance Measurements

We report an analysis quantifying the contribution to uncertainty in annual energy projections from uncertainty in ground-measured irradiance. Uncertainty in measured irradiance is quantified for eight instruments by the difference from a well maintained, secondary standard pyranometer which is regarded as truthful. We construct a statistical model of irradiance uncertainty and apply the model to generate a sample of 100 annual time series of irradiance for each instrument. The sample is propagated through a common performance model for a reference photovoltaic system to quantify variation in annual energy. Although the measured irradiance varies from the reference by a few percent (standard deviation of 1-2%) the uncertainty in annual energy is on the order of a fraction of one percent. We propose a model for a factor that represents uncertainty in modeled annual energy that arises from uncertainty in ground-measured irradiance.

14 SOLAR ENERGY↗

ZPPR-15 Criticality Measurements

A reference critical configuration was established for each phase of the ZPPR-15 experimental program. The reference critical configuration for each phase corresponds to a configuration in which the measured excess reactivity was adjusted to a standard set of reporting conditions with an average reactor temperature of 293 K, a zero interface gap and all operational control rods parked 30 inches from the axial centerline of the core. The ZPPR staff published the measured excess reactivity and the statistical uncertainty in the measurement. In reality, the published uncertainty for each reference critical configuration is only a small component of the total uncertainty for that configuration. Additional uncertainties related measurement technique, configuration geometry and material compositions exist. The geometry and material composition uncertainties are the dominant uncertainties for ZPPR-15. A full uncertainty analysis was performed for each ZPPR-15 reference critical configuration. The significant uncertainties related to measurement technique, configuration geometry and material compositions were quantified, and a total uncertainty was derived for each reference critical configuration. The ZPPR-15 experimental records were used to create detailed as-built Monte Carlo models for the reference critical configurations established in ZPPR-15A loading 15, ZPPR-15B loading 88, ZPPR-15C loading 166 and ZPPR-15D loading 185. The as-built models neglect the small, non-uniform gap between matrix halves at full closure, any structures outside the matrix tubes and minor components, e.g., impurities, in some materials. The biases associated with the neglected items were quantified. The experimental value of keff and its associated uncertainty for each reference critical configuration were adjusted to account for biases introduced by items that are neglected in the as-built model for that configuration.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗

Sister Rod Destructive Examinations (FY23): Appendix H: Instron Uncertainty Calculations

This document discusses the uncertainty of measurements associated with the Instron system and the resulting uncertainty in the acquired measurements and calculated information. The primary parameters measured during the Instron test include the applied load and specimen deflection. The associated primary calculated parameters are the maximum beam deflection at the rod’s axial center and modulus of elasticity. Secondary calculated parameters include specimen stress and strain amplitudes, as well as flexural rigidity. The uncertainty associated with the primary and secondary calculated parameters was investigated based on the known uncertainty in the measured parameters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sister Rod Destructive Examinations (FY2021) Appendix G: CRIFT Uncertainty Calculations

This document discusses the uncertainty of measurements associated with the CIRFT system and the resulting uncertainty in the acquired measurements and calculated information. The primary parameters measured during the CIRFT test include the deflection magnitude of the specimen, the load applied in bending, and the number of cycles to specimen gross failure. The associated primary calculated parameters are the bending radius/curvature and bending moment. Secondary calculated parameters include specimen stress and strain amplitudes and flexural rigidity. The uncertainty associated with the primary and secondary calculated parameters are investigated based on the known uncertainty in the measured parameters.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

OVOC (Oxygenated Volatile Organic Chemicals) in the Global Atmosphere: Atmospheric Budgets, Oceanic Concentrations, and Uncertainties

Airborne measurements of oxygenated volatile organic chemicals (OVOC), OH free radicals, and tracers of pollution were performed over the Pacific during Winter/Spring of 2001. Large concentrations of OVOC are present in the global troposphere and are expected to play an important role in atmospheric chemistry. Their total abundance (SIGMAOVOC) was nearly twice that of non-methane hydrocarbons (SIGMAC2-C8 NMHC). Throughout the troposphere, the OH reactivity of OVOC is comparable to that of methane and far exceeds that of NHMC. A comparison of these data with western Pacific observations collected some seven years earlier (Feb.-March, 1994) did not reveal significant differences. Analysis of the relative enhancement of selected OVOC with respect to CH3Cl and CO in twelve plumes originating from fires and sampled in the free troposphere (3-11 km) is used to assess their primary and secondary emissions from biomass combustion. The composition of these plumes also indicates a large shift of reactive nitrogen into the PAN reservoir thereby limiting ozone formation. These data are combined with other observations and interpreted with the help of a global 3-D model to assess OVOC global sources and sinks. We further interpret atmospheric observations with the help of an air-sea exchange model io show that oceans can be both net so~rces and sinks. An extremely large oceanic reservoir of OVOC, that exceeds the atmospheric reservoir by more than an order of magnitude, can be inferred to be present. We conclude that OVOC sources are extremely large (150-500 TgC y-1) but remain poorly quantified. In many cases, measured concentrations are uncertain and incompatible with our present knowledge of atmospheric chemistry. Results based on observations from several field studies and critical gaps will be discussed.

Singh, Hanwant B.↗

Estimating Residual Uncertainties for Lunar Irradiance Measurements Due to Imaging Acquisition Parameters

Lunar calibration is a commonly used method to track a climate satellite sensor's long-term radiometric stability. We present a modeling approach to examine the satellite sensor lunar observation uncertainties due to several important aspects related to the lunar image acquisition by the satellite sensor: lunar pixel shift, point spread function (PSF), lunar orientation, pitch, and oversampling rates. Our analyses can be summarized as follows: (1) The sensor observed lunar irradiance can vary due to small lunar pixel shift if the PSF is less than ideal; (2) During lunar calibration, an unstable oversampling rate due to spacecraft control will result in errors in observed lunar irradiance. A drift in oversampling rate would result in a bias in observed lunar irradiance and a random variation in oversampling rate would cause random error in lunar irradiance. Increasing the overall oversampling rates can reduce random error in observed lunar irradiance but would not change the biases in the observation; (3) Furthermore, the biases can vary when the Moon is observed at different orientations. Our results show impacts on observed lunar irradiance are on the order of 0.1 percent, which is a significant part of the overall uncertainty for a lunar irradiance measurement of a climate satellite sensor.

Oversampling↗

An entropy-based debiasing approach to quantifying experimental coverage for novel applications of interest in the nuclear community

This manuscript proposes a novel information-theoretic approach to the quantification of experimental relevance, i.e., coverage, to achieve optimal data assimilation results for nuclear engineering applications. Specifically, this work posits the need for a new metric, called coverage (q C ) of an application’s quantity of interest, i.e., eigenvalue or power peaking for an advanced reactor concept, defined herein as the theoretically maximum achievable reduction in the quantity’s uncertainty given measurements from a pool of experiments in a manner that is independent of the data assimilation procedure employed. Currently, reduction in a quantity’s uncertainty is strongly biased by the underlying assumptions of the assimilation procedure to account for the under-determined nature of such problems and the similarity criterion employed to identify relevant experiments. To address this challenge, this work has developed a coverage metric, q C , based on mutual information, which establishes a new conceptual framework for assessing coverage, one that is independent of the model parameters and responses degree of variations in both the experimental and application domains, i.e., linear vs non-linear, and their prior uncertainty distributions, i.e., Gaussian vs. non-Gaussian. The q C is an entropic measure capable of addressing coverage for general nonlinear problems with non-Gaussian uncertainties and inclusive of the measurement uncertainties from multiple experiments. Numerical experiments from manufactured analytical problems as well as a set of benchmarks from the ICSBEP handbook are employed to demonstrate its theoretical and practical performance as compared to the c k -based experiment selection methodology, commonly employed in the neutronic community. The manuscript then employs other well-known adaptations to existing data assimilation methodologies for nonlinear and non-Gaussian problems capable of achieving the coverage posited by q C .

Bayesian data assimilation↗

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗