Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “propagation of uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Instrument Drift Uncertainties and the Long-Term TOMS/SBUV Total Ozone Record

Long-term climate records from satellites are often constructed from the measurements of a sequence of instruments launched at different times. Each of these instruments is calibrated prior to launch. After launch they are subjected to potential offsets and slow drifts in calibration. We illustrate these issues in the construction of a merged total ozone record from two TOMS and three SBUV instruments. This record extends from late 1978 through the present. The question is "How good are these records?". We have examined the uncertainty in determining the relative calibration of two instruments during an overlap period in their measurements. When comparing a TOMS instrument, such as that on Nimbus 7, with an SBUV instrument, also on Nimbus 7, we find systematic differences and random differences. We have combined these findings with estimates of individual instrument drift into a monte- carlo uncertainty propagation model. We estimate an instrument drift uncertainty of a little larger than 1 percent per decade over the 25-year history of the TOMS/SBUV measurements. We make an independent estimate of the drift uncertainty in the ground-based network of total ozone measurements and find it to be of similar, but slightly smaller magnitude. The implications of these uncertainties for trend and recovery determination will be discussed.

Solarski, Richard S.↗

Multi-Model Monte Carlo Estimators for Trajectory Simulation

Predicting landing radius and other quantities of interest (QoI) for entry, descent, andlanding (EDL) applications requires a viable uncertainty propagation method for quantifying the impact of uncertainties in aerodynamics, atmosphere, mass properties, etc. While standard Monte Carlo (MC) simulation is the de facto standard for producing robust and unbiasedstatistical estimators, it is often infeasible for expensive, high-fidelity models. Low-fidelity models are commonly constructed to replace the high-fidelity model in MC simulation for computational speedup, but at the expense of accuracy and unbiasedness. Emerging multi-model MC methods are bridging this gap by combining predictions from two or more modelsof varying fidelity and computational cost for efficient and unbiased uncertainty propagation.This works establishes a proof of concept for using multi-model MC to increase the speed and precision of trajectory simulation for EDL. It is shown that combining a high-fidelity EDL model with low-fidelity models (e.g., data-driven, reduced physics) in this manner has the potential to yield significant efficiency and accuracy gains for certain EDL QoIs versusa standard MC approach. Moreover, the unbiasedness of multi-model MC predictions ishighlighted by showing increased accuracy versus an approach that leverages a low-fidelity model alone.

James E Warner↗

Propagation of statistical uncertainties of Skyrme mass models to simulations of r -process nucleosynthesis

Uncertainties in nuclear models have a major impact on simulations that aim at understanding the origin of heavy elements in the universe through the rapid neutron capture process ( r process) of nucleosynthesis. Within the framework of the nuclear density functional theory, we use results of Bayesian statistical analysis to propagate uncertainties in the parameters of energy density functionals to the predicted r -process abundance pattern, by way not only of the nuclear masses but also through the influence of the masses on β -decay and neutron capture rates. We point out the importance of the nonequilibrium end stage of the r process in determining the width of the resulting abundance pattern uncertainty bands. We additionally make the first identifications of specific parameters of Skyrme-like energy density functionals which show tentative correlations with particular aspects of the r -process abundance pattern. While previous studies have explored the reduction in the abundance pattern uncertainties due to anticipated new measurements of neutron-rich nuclei, here we point out that an even larger reduction will occur when these new measurements are used to reduce the uncertainty of model predictions of masses, which are then propagated through to the abundance pattern. We make a quantitative prediction for how large this reduction will be.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Investigating the Role of Accident Tolerant Cladding on Source Term Reduction for High-Burnup PWRs Using MELCOR

The use of accident tolerant fuel (ATF) cladding can increase coping times during and beyond design basis accidents. While such gains may be incremental, they provide a margin that can potentially be recovered to enable high-burnup (HBU) operation. Realizing such a margin requires demonstrating that the combination of HBU and ATF has not led to an overall increase in source term. This study investigates the influence of cladding technology (Zr-based, Cr-coated Zr, and FeCrAl) and fuel cycle length (18 and 24 months) on radiological dose at the boundary of the exclusion zone for a four-loop pressurized water reactor to investigate whether ATF claddings can provide such benefits. We analyze a recovered large break loss-of-coolant accident scenario to investigate the impact of transient timescale on the benefits of such coping time increases. The simulations have been performed using the MELCOR and MELCOR Accident Consequence Code System codes. For the cases analyzed, increased fuel cycle length did not necessarily increase radionuclide release and hydrogen generation, as these were found to be sensitive to the core power distribution. Similarly, off-site dose consequence is dominated by short-lived radionuclides that tend to saturate earlier in the burnup, so higher burnup operation did not necessarily increase the source term for the phenomena and transients analyzed here. Delays in recovery of the lowpressure safety injection system increase hydrogen production and radionuclide release, especially between 780 s and 1620 s, due to the nonlinear oxidation and core degradation behavior. Results show that Cr-coated Zr enhances safety by delaying heatup and gap release. Here, when uncertainty propagation on oxidation properties is considered, FeCrAl exhibits the lowest overall radionuclide release and off-site dose throughout the spectrum. However, while the considered “base model” performance is superior under delayed injection scenarios, upper-bound cases display hydrogen generation risk comparable to the Zr-based cladding.

Accident Tolerant Fuel↗

Uncertainty quantification and propagation in lithium-ion battery electrodes using bayesian convolutional neural networks

The complex nature of manufacturing processes stipulates electrodes to possess high variability with increased heterogeneity during production. X-ray computed tomography imaging has proved to be critical in visualizing the complicated stochastic particle distribution of as-manufactured electrodes in lithium-ion batteries. However, accurate prediction of their electrochemical performance necessitates precise evaluation of kinetic and transport properties from real electrodes. Image segmentation that characterizes voxels to particle/pore phase is often meticulous and fraught with subjectivity owing to a myriad of unconstrained choices and filter algorithms. Here we utilize a Bayesian convolutional neural network to tackle segmentation subjectivity and quantify its pertinent uncertainties. Otsu inter-variance and Blind/Referenceless Imaging Spatial Quality Evaluator are used to assess the relative image quality of grayscale tomograms, thus evaluating the uncertainty in the derived microstructural attributes. We analyze how image uncertainty is correlated with the uncertainties and magnitude of kinetic and transport properties of an electrode, further identifying pathways of uncertainty propagation within microstructural attributes. The coupled effect of spatial heterogeneity and microstructural anisotropy on the uncertainty quantification of transport parameters is also understood. This work demonstrates a novel methodology to extract microstructural descriptors from real electrode images through quantification of associated uncertainties and discerning the relative strength of their propagation, thus facilitating feedback to manufacturing processes from accurate image based electrochemical simulations.

25 ENERGY STORAGE↗

Sonic Boom Pressure Signature Uncertainty Calculation and Propagation to Ground Noise

The objective of this study was to outline an approach for the quantification of uncertainty in sonic boom measurements and to investigate the effect of various near-field uncertainty representation approaches on ground noise predictions. These approaches included a symmetric versus asymmetric uncertainty band representation and a dispersion technique based on a partial sum Fourier series that allows for the inclusion of random error sources in the uncertainty. The near-field uncertainty was propagated to the ground level, along with additional uncertainty in the propagation modeling. Estimates of perceived loudness were obtained for the various types of uncertainty representation in the near-field. Analyses were performed on three configurations of interest to the sonic boom community: the SEEB-ALR, the 69o DeltaWing, and the LM 1021-01. Results showed that representation of the near-field uncertainty plays a key role in ground noise predictions. Using a Fourier series based dispersion approach can double the amount of uncertainty in the ground noise compared to a pure bias representation. Compared to previous computational fluid dynamics results, uncertainty in ground noise predictions were greater when considering the near-field experimental uncertainty.

West, Thomas K., IV↗

Evaluation of Apex Alpha with LabWare-LIMS Data Reduction for Alpha Analyses

Savannah River Site's Environmental Bioassay Laboratory is migrating its laboratory information management system (LIMS) from SQL-LIMS to Oracle Labware-LIMS (LW-LIMS) systems to align with the Department of Energy's cyber security policies. Concurrently with the LIMS upgrade, the current VMS based Alpha Measurement System (AMS) software is being replaced with Apex Alpha software to reduce other cyber vulnerabilities, streamline procedural production aspects of data handling, and improve outdated reduction processes to align the program with requirements outlined in ANSI N13.30. The primary technical changes which are being implemented are: - Reagent contributions are added in data reduction, - Moving average background equivalent activity are used for gross signal corrections, - Measured uncertainty of both are included in the decision level and propagated uncertainty, - Tracer levels are increased for precision and accuracy improvements, and - Reports are modified for compliance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗

A Conterminous USA-Scale Map of Relative Tidal Marsh Elevation

Abstract Tidal wetlands provide myriad ecosystem services across local to global scales. With their uncertain vulnerability or resilience to rising sea levels, there is a need for mapping flooding drivers and vulnerability proxies for these ecosystems at a national scale. However, tidal wetlands in the conterminous USA are diverse with differing elevation gradients, and tidal amplitudes, making broad geographic comparisons difficult. To address this, a national-scale map of relative tidal elevation ( Z * MHW ), a physical metric that normalizes elevation to tidal amplitude at mean high water (MHW), was constructed for the first time at 30 × 30-m resolution spanning the conterminous USA. Contrary to two study hypotheses, watershed-level median Z * MHW and its variability generally increased from north to south as a function of tidal amplitude and relative sea-level rise. These trends were also observed in a reanalysis of ground elevation data from the Pacific Coast by Janousek et al. (Estuaries and Coasts 42 (1): 85–98, 2019). Supporting a third hypothesis, propagated uncertainty in Z * MHW increased from north to south as light detection and ranging (LiDAR) errors had an outsized effect under narrowing tidal amplitudes. The drivers of Z * MHW and its variability are difficult to determine because several potential causal variables are correlated with latitude, but future studies could investigate highest astronomical tide and diurnal high tide inequality as drivers of median Z * MHW and Z * MHW variability, respectively. Watersheds of the Gulf Coast often had propagated Z * MHW uncertainty greater than the tidal amplitude itself emphasizing the diminished practicality of applying Z * MHW as a flooding proxy to microtidal wetlands. Future studies could focus on validating and improving these physical map products and using them for synoptic modeling of tidal wetland carbon dynamics and sea-level rise vulnerability analyses.

Holmquist, James R. (ORCID:0000000325466766)↗

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗

Uncertainty Analysis of the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel 2019 Characterization Test 14-Foot, 5.8 Percent Test Section Porosity

This paper presents methods and results of a measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The uncertainty analysis is based on data collected during a characterization test following major structural modifications to the facility and upgrades to the facility’s data and control systems. The statistical methods and engineering judgments used to estimate elemental uncertainties are described in this report. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A description of the Monte Carlo method as applied for this analysis is provided. The primary variable of interest (VOI) for this facility is free stream Mach number. In addition to determining the uncertainty in Mach number, the uncertainty in free stream values of static pressure, total pressure, dynamic pressure, total temperature, static temperature, Reynolds number, and air speed were also calculated. Uncertainty results are presented as random (unpredictable variation in repeated measurements), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty for Mach number. Systematic uncertainty results are presented for the other VOIs. Individual uncertainty sources are presented both dimensionally and as percent contributions to uncertainty in all VOIs, to aid in the identification of primary uncertainty sources.

Uncertainty Analysis↗

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗

A Bayesian Approach to the Eagar–Tsai Model for Melt Pool Geometry Prediction with Implications in Additive Manufacturing of Metals

Here, this paper focuses on improving the melt pool geometry predictions and quantifying uncertainties using an adapted version of the Eagar–Tsai (E–T) model that incorporates temperature-dependent properties of the material as well as powder conditions. Additionally, Bayesian inference is employed to predict distributions for the E–T model input parameters of laser absorptivity and powder bed porosity by incorporating experimental results into the analysis. Monte Carlo uncertainty propagation is then used with these parameter distributions to estimate the melt pool depth and associated uncertainty. Our results for the 316L stainless steel suggest that both the absorptivity and powder bed porosity are strongly influenced by the laser power. In contrast, the scanning speed has only a marginal effect on both the absorptivity and powder bed porosity. We constructed a printability map using the Bayesian E–T model based on power-dependent input parameter values to demonstrate the merit of the approach. The Bayesian approach improved the accuracy in predicting the keyhole regions in the laser power-scan speed parameter space for the 316L stainless steel. Although applied to a specific adaptation of the E–T model, the method put forth can be extended to quantify uncertainties in other numerical models as well as in the estimation of unknown parameters.

316L Stainless Steel (SS).↗

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗

Total Measurement Uncertainty in Neutron Coincidence Multiplicity Analysis

Neutron multiplicity counting is the most commonly used nondestructive assay technique for determining the plutonium mass within containers of scrap PuO 2 or mixed oxide (MOX). In multiplicity analysis, the 240 Pu eff mass, leakage multiplication, and alpha ratio (the ratio of [α, n]-to-spontaneous fission neutron production) are the three primary unknown sample properties. They must be determined simultaneously. To solve for these three unknowns in a multiplicity assay, three measured values are needed: the singles, doubles, and triples neutron count rates. While the analysis is limited to solving for three unknowns, there are many additional factors that impact the observed count rates and contribute to the measurement uncertainty. In this study we investigate the various uncertainty contributors for the multiplicity analysis through a combination of traditional uncertainty propagation techniques supplemented by Monte Carlo simulations to address the dependences not explicitly expressed by the point source model. Uncertainties arising from counting statistics, calibration parameters, calibration method, nuclear data, and various material characteristics (isotopic abundances, chemical form, density, and impurities) are considered. A Total Measurement Uncertainty (TMU) estimate is then developed from these uncertainty contributors. This study is confined to multiplicity analysis of items commonly encountered in international safeguards applications. That is, the study focused on Pu oxides and MOX materials for the masses ranging up to 4000 grams total Pu. Multiplicity measurements were simulated using MCNP V6 based on the Plutonium Scrap Multiplicity Counter (PSMC), Epithermal Multiplicity Counter (ENMC), Pyrochemical Multiplicity Counter, and Large Epithermal Multiplicity Counter (LEMC) for this study; however, this report focuses on the parameterization of the uncertainties for the PSMC. The performance differences between the PSMC and the other multiplicity counting systems are relatively small, primarily manifesting in the impact on measurement precision so that the evaluation developed for the PSMC can be applied to the other multiplicity counting systems. Finally an analysis tool, the Multiplicity TMU Estimator, was developed from this study to serve as an aid for evaluation of the total measurement uncertainty of multiplicity assay results obtained from the commonly used INCC acquisition and analysis software.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A NASA GISTEMP Observational Uncertainty Ensemble: Regional and Monthly Uncertainty

The historical global temperature record is an essential data product for quantifying the variability and change of the Earth system. In recent years, better characterization of observational uncertainty in global and hemispheric trends has become available, but the methodologies are not necessarily applicable to analyses at smaller regional areas, or monthly means, where station sparsity and other systematic issues contribute to greater uncertainty. This work details a gridded uncertainty ensemble of historical temperature anomalies from the Goddard Institute for Space Studies (GISS) Surface Temperature product (GISTEMP) product. This ensemble characterizes the complex spatial and temporal correlation structure of uncertainty in gridded historical temperature, enabling proper uncertainty propagation for climate and social science at regional and monthly scales. This work details the methodology for generating the uncertainty ensemble, key statistics of the uncertainty evolution over space and time, and provides best practices for using the uncertainty ensemble in future studies. Summary statistics from the uncertainty ensemble are in good agreement with production GISTEMP. Two applications of the uncertainty ensemble are also presented. First, the warmest year on record is shown to most likely be 2016 with a 53.2% chance and 2020 as the second most likely with a 44.4% chance. Second, it is shown that the arctic is warming 2.5 - 5 times faster than the globe, significantly faster than the regularly quoted twice as fast.

GISTEMP↗

Propagation of Noise Uncertainty Through Virtual Strain Gauge Formulations for 2D Digital Image Correlation

The effect of displacement uncertainty is examined on 2-dimensional strain, calculated using linear surfaces fitted to the displacement field. A classical engineering error propagation method is used to calculate uncertainty in Green-Lagrangian strain calculations. The derived uncertainty is compared to a Monte Carlo simulation and discrepancies under 2% are seen between these two methods. The effect of virtual strain gauge size, displacement uncertainty, and boundaries on the region of interest on the strain uncertainty are considered. Here, an exponential decay relationship is observed between strain uncertainty and virtual strain gauge size, while a linear relationship is seen between strain and displacement uncertainty. For boundaries in the region of interest, strain uncertainty is affected by the reduced number of points available to perform the regression.

42 ENGINEERING↗