Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Casper-1, Part 6: Uncertainty Quantification, Factor Effects, and Outlier Analysis for an On-Board Airplane Trajectory Prediction Function

This report presents data analysis results for a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of onboard energy state and automation mode prediction functions for terminal area arrival and approach phases of flight over a wide range of conditions. In particular, the results include quantification of energy state (i.e., altitude and airspeed) prediction performance, models for prediction performance as a function of initial energy state (i.e., initial altitude, airspeed, and weight) and weather factors, and analysis of outlier prediction performance. Wind speed, wind direction, and wind gradient were found to be major factors in energy state prediction performance. Initial energy and gust intensity were also significant factors in airspeed prediction performance. Furthermore, the results suggest that errors in automation mode prediction may be a major contributor to outlier prediction performance.

Torres-Pomales, Wilfredo↗

Systematic Uncertainties in the NOvA \nu_\mu-Disappearance Analysis

As the NOvA long-baseline neutrino oscillation experiment takes more data, systematic uncertainty begins to more heavily impact the oscillation analyses. The largest effects are calibration on calorimetric energy, detector modeling on muon energy scale, and near-detector pileup on normalization of the far-detector expectation. Cross-section systematics will be discussed in another poster. Detailed studies have justified previous systematics as too conservative and suggested smaller values. Focused study of detector modeling using dE/dx and external measurements constrain the calibration and energy scale uncertainties. A novel technique is used to assess the impact of activity from neutrino activity piling up over signal, where a simulated neutrino is overlaid into both data and simulation. The difference in efficiency of selecting that single neutrino among data and simulated spills then dominates the normalization systematic.

Alion, Tyler [Sussex U.]↗

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗

A non-intrusive optical (NIO) approach to characterize heliostats in utility-scale power tower plants: Sensitivity study

Power towers, a type of concentrating power tower technology, use a large number of heliostats to concentrate sunlight and produce renewable energy. Optical errors of heliostats can cause drastic losses in the efficiency of power-tower plants. Accurately measuring optical errors is crucial to assessing and improving plant performance. This analysis discusses an innovate non-intrusive optical (NIO) approach to measure slope, canting, and tracking errors by detecting distortions in the reflected tower structure in heliostat images. Further in this work a sensitivity study is carefully conducted to determine the uncertainty requirements to allow the method to calculate slope errors with an accuracy of 0.25 mrad. Measurement uncertainty sources include camera resolution and position uncertainty, tower position uncertainty, and number of collected images. Each uncertainty source is investigated to determine its impact on the accuracy of the slope-error calculation. A combination of theoretical results and experimental results obtained from data collected on a heliostat at Sandia National Laboratories is used to determine and validate uncertainty requirements. The analysis shows that a measurement uncertainty of 0.25 mrad can be realized by realistically controlling uncertainty sources when implementing the NIO method. It demonstrates the superior performance of NIO in performing in-situ optical characterization.

14 SOLAR ENERGY↗

PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

54 ENVIRONMENTAL SCIENCES↗

Kepler Uniform Modeling of KOIs: MCMC Notes for Data Release 25

This document describes data products related to the reported planetary parameters and uncertainties for the Kepler Objects of Interest (KOIs) based on a Markov-Chain-Monte-Carlo (MCMC) analysis. Reported parameters, uncertainties and data products can be found at the NASA Exoplanet Archive . The codes used for this data analysis are available on the Github website (Rowe 2016). The relevant paper for details of the calculations is Rowe et al. (2015). The main differences between the model fits discussed here and those in the DR24 catalogue are that the DR25 light curves were used in the analysis, our processing of the MAST light curves took into account different data flags, the number of chains calculated was doubled to 200 000, and the parameters which are reported are based on a damped least-squares fit, instead of the median value from the Markov chain or the chain with the lowest 2 as reported in the past.

DR25↗

Validation of SAS4A/SASSYS-1 for Steady-State Single-Phase Natural Circulation

The development of numerical software for engineering applications requires the validation of the code against experimental benchmark datasets. To support the validation of SAS4A/SASSYS-1 in simulating the single-phase natural circulation within nuclear reactor systems, high-precision steady-state experiments are performed to capture single-phase natural circulation phenomena on an existing scaled facility with comprehensive instrumentation. Forced convection tests are designed precisely capturing the facility’s critical thermal-hydraulic parameters required for one-dimensional modeling, and a comprehensive single-phase natural circulation dataset is obtained with well-documented experimental uncertainty and facility description. Analysis and discussion based on the finalized dataset confirm the dataset’s ability in capturing dominant phenomena and address important physical interpretation of parameters. The dataset reported in this project provides a valuable benchmark resource for the validation of system analysis codes under single-phase natural circulation inside nuclear reactors. Validation of SAS4A/SASSYS-1 is then performed against the obtained benchmark dataset to confirm the capability of its physics model in simulating the steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators to quantify and restrict numerical errors from discretization. Numerical uncertainty originating from finite maximum pseudo-transient time is also quantified and restricted. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, directly quantifying the simulation output in a Monte Carlo approach. The composition of the output uncertainty is further determined by the estimators of Sobol’ indices through a variance-based sensitivity analysis. With uncertainty quantified for each individual condition, detailed comparison between the simulation results and experimental data is performed covering the whole dataset, which shows consistent agreement for all important quantities. The validation activity reported in this project demonstrates that SAS4A/SASSYS-1 can predict the primary parameters with satisfactorily accuracy under steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nondestructive measurements of residual 235 U mass of Israeli Research Reactor-1 fuel using the Advanced Experimental Fuel Counter

In 2018, a measurement campaign took place with participants from Los Alamos National Laboratory (LANL), the Nuclear Research Centre-Negev (NRCN) and Soreq Nuclear Research Center (SNRC) at the Israeli Research Reactor-1 (IRR-1) in which 14 of the reactor’s used fuel assemblies (FAs) with varied amount of depletion were measured with the nondestructive assay instrument Advanced Experimental Fuel Counter (AEFC). Designed for safeguards purposes, the AEFC measures both neutrons emitted from the FA (passive neutrons) and fission neutrons induced by an external neutron source (in this experiment, 252 Cf). Signals recorded with the AEFC include total neutron count rates (Singles), time-correlated neutron count rates (Doubles), and total gamma-ray count rates. The 235 U content of the FAs was previously assessed by two independent methods: (1) measurement of the transparency of the FA to low-energy gamma rays from an activated rhenium source (rhenium gamma transmission, or the RGT method) and (2) calculation of the 30-year burnup history of the core using detailed three-dimensional Monte-Carlo core depletion calculations. The results from the FAs that had been measured via the RGT method were used to construct the calibration curves, which translate the AEFC count rates to 235 U mass. Then, the calibration was evaluated using AEFC measurements of six additional FAs that were not measured via the RGT method. From the results, it was determined the Doubles calibration curve was more reliable than that of the Singles and follows a simple second-order polynomial fit for the whole range of residual 235 U mass content, albeit with larger statistical uncertainty. Detailed uncertainties quantification was conducted for both the AEFC Singles and Doubles. This includes the analysis of statistical uncertainties, calibration uncertainty, and random uncertainties due to the sensitivity of the AEFC to several sources of uncertainty, namely the FA position, FA orientation, interrogation source position, and ambient pool temperature. Finally, an overall total uncertainty of 6 g of 235 U is estimated for the Singles and Doubles, which is mainly due to calibration uncertainty (for the Singles) and statistical uncertainty (for the Doubles), and which constitutes 3%–6% of the 235 U total mass in the FAs, depending on their level of depletion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Analysis of FRAM Measurements to Establish Methodology Uncertainty

Qualification measurements were performed at Oak Ridge National Laboratory (ORNL) on a variety of measurement standards. These measurements will be used to qualify the Fixed-Energy, Response Function Analysis with Multiple Efficiency (FRAM) code with a high purity germanium (HPGe) detector for use at ORNL. Measured items include uranium isotopic standards, U 3 O 8 line sources, and a uranium tetrafluoride source. The 235 U enrichment was estimated using the FRAM isotopic analysis software for each source and compared with the declared isotopic values.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sensitive parameter identification and uncertainty quantification for the stability of pipeline conveying fluid

In this study, several uncertainty quantification and sensitivity analysis methods are used to determine the most sensitive geometric and material input parameters of a cantilevered pipeline conveying fluid when uncertainty is introduced to the system at the onset of instability. The full nonlinear equations of motion are modeled using the extended Hamilton’s principle and then discretized using Galerkin’s method. A parametric study is first performed, and the Morris elementary effects are calculated to obtain a preliminary understanding of how the onset speed changes when each parameter is introduced to a ± 5% uncertainty. Then, four different input uncertainty distributions, mainly, uniform and Gaussian distribution, are chosen to investigate how input distributions affect uncertainty in the output. A convergence analysis is used to determine the number of samples needed to maintain simulation accuracy while saving the most computational time. Then, Monte Carlo simulations are run, and the output distributions for each input distribution at ± 1%, ± 3% and ± 5% input uncertainty range are found and discussed. Additionally, the Pearson correlation coefficients are evaluated for different uncertainty ranges. A final Monte Carlo study is performed in which single parameters are held constant while all others still have uncertainty. Overall, the flow speed at the onset of instability is the most sensitive to changes in the outer diameter of the pipe.

36 MATERIALS SCIENCE↗

Binning is Sinning: Redemption for Hubble Diagram Using Photometrically Classified Type Ia Supernovae

Bayesian Estimation Applied to Multiple Species (BEAMS) is implemented in the BEAMS with Bias Corrections (BBC) framework to produce a redshift-binned Hubble diagram (HD) for Type Ia supernovae (SNe Ia). BBC corrects for selection effects and non–SN Ia contamination, and systematic uncertainties are described by a covariance matrix with dimension matching the number of BBC redshift bins. For spectroscopically confirmed SN Ia samples, a recent "Binning is Sinning" article showed that an unbinned HD and covariance matrix reduces the systematic uncertainty by a factor of ~1.5 compared to the binned approach. Here we extend their analysis to obtain an unbinned HD for a photometrically identified sample processed with BBC. To test this new method, we simulate and analyze 50 samples corresponding to the Dark Energy Survey (DES) with a low-redshift anchor; the simulation includes SNe Ia, and contaminants from core-collapse SNe and peculiar SNe Ia. The analysis includes systematic uncertainties for calibration and measures the dark energy equation of state parameter (w). Compared to a redshift-binned HD, the unbinned HD with nearly 2000 events results in a smaller systematic uncertainty, in qualitative agreement with BHS21, and averaging results among the 50 samples we find no evidence for a w-bias. To reduce computation time for fitting an unbinned HD with large samples, we propose an HD-rebinning method that defines the HD in bins of redshift, color, and stretch; the rebinned HD results in similar uncertainty as the unbinned case, and shows no evidence for a w-bias.

79 ASTRONOMY AND ASTROPHYSICS↗

Assessment of Uncertainty in the Determination of Activation Energy for Polymeric Materials

An assessment of the experimental uncertainty in obtaining the kinetic activation energy from thermogravimetric analysis (TGA) data is presented. A neat phenolic resin, Borden SC1O08, was heated at three heating rates to obtain weight loss vs temperature data. Activation energy was calculated by two methods: the traditional Flynn and Wall method based on the slope of log(q) versus 1/T, and a modification of this method where the ordinate and abscissa are reversed in the linear regression. The modified method produced a more accurate curve fit of the data, was more sensitive to data nonlinearity, and gave a value of activation energy 75 percent greater than the original method. An uncertainty analysis using the modified method yielded a 60 percent uncertainty in the average activation energy. Based on this result, the activation energy for a carbon-phenolic material was doubled and used to calculate the ablation rate In a typical solid rocket environment. Doubling the activation energy increased surface recession by 3 percent. Current TGA data reduction techniques that use the traditional Flynn and Wall approach to calculate activation energy should be changed to the modified method.

Darby, Stephania P.↗

Nuclear Data Impact Assessment for the HTR-10 Pebble-Bed Reactor Using SCALE

The HTR-10 was used as a representative pebble-bed high-temperature gas-cooled reactor in this assessment of nuclear data’s impact on important reactor and spent fuel metrics, including safety-related quantities such as the effective multiplication factor (k eff ), temperature reactivity feedback, spent fuel inventory, and decay heat. Using the SCALE code system tools and ENDF/B-VII.1 nuclear data libraries, we quantify the effect of nuclear data uncertainties on these key performance metrics for both fresh fuel and equilibrium core configurations. For reactor core key parameters, important contributors to uncertainty include reactions of 235 U [$\bar{v}$, fission, (n, γ)], 238 U [elastic, (n, γ)], and graphite [elastic, (n, γ)]. Additional important contributors for the equilibrium core include reactions of higher actinides ( 239 Pu, 240 Pu) and fission products ( 135 Xe, 149 Sm). For spent fuel analysis, most nuclide inventory uncertainties remain below 5%. Higher uncertainties up to 11% are being observed for minor actinides like 243 Am and 244 Cm. Additionally, fission product uncertainties in 155 Eu and 155 Gd, of 25% and 23% respectively, are also significant and have implications for burnup credit applications. 110m Ag also shows high uncertainty of up to 11%, mainly due to fission product yield uncertainties. Decay heat relative uncertainties remain below 0.6% up to 10 years’ cooling time after fuel discharge. The highest relative uncertainty of 1.5% occurs at 500 years of cooling; however, because the decay heat value is very low at that time, the absolute uncertainty is not significant. This work demonstrates that extending assessments beyond fresh fuel k eff to include irradiated cores, nuclide inventories, and decay heat is essential in understanding the behavior of uncertainties as a function of fuel burnup and can support improvements of safety margins and spent fuel management.

Nuclear data impact↗

Neural Active Manifolds: Nonlinear Dimensionality Reduction for Uncertainty Quantification

We present a new approach for nonlinear dimensionality reduction, specifically designed for computationally expensive mathematical models. We leverage autoencoders to discover a one-dimensional neural active manifold (NeurAM) capturing the model output variability, through the aid of a simultaneously learnt surrogate model with inputs on this manifold. Our method only relies on model evaluations and does not require the knowledge of gradients. The proposed dimensionality reduction framework can then be applied to assist outer loop many-query tasks in scientific computing, like sensitivity analysis and multifidelity uncertainty propagation. In particular, we prove, both theoretically under idealized conditions, and numerically in challenging test cases, how NeurAM can be used to obtain multifidelity sampling estimators with reduced variance by sampling the models on the discovered low-dimensional and shared manifold among models. Several numerical examples illustrate the main features of the proposed dimensionality reduction strategy and highlight its advantages with respect to existing approaches in the literature.

Autoencoders↗