Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ZPPR-15 Criticality Measurements

A reference critical configuration was established for each phase of the ZPPR-15 experimental program. The reference critical configuration for each phase corresponds to a configuration in which the measured excess reactivity was adjusted to a standard set of reporting conditions with an average reactor temperature of 293 K, a zero interface gap and all operational control rods parked 30 inches from the axial centerline of the core. The ZPPR staff published the measured excess reactivity and the statistical uncertainty in the measurement. In reality, the published uncertainty for each reference critical configuration is only a small component of the total uncertainty for that configuration. Additional uncertainties related measurement technique, configuration geometry and material compositions exist. The geometry and material composition uncertainties are the dominant uncertainties for ZPPR-15. A full uncertainty analysis was performed for each ZPPR-15 reference critical configuration. The significant uncertainties related to measurement technique, configuration geometry and material compositions were quantified, and a total uncertainty was derived for each reference critical configuration. The ZPPR-15 experimental records were used to create detailed as-built Monte Carlo models for the reference critical configurations established in ZPPR-15A loading 15, ZPPR-15B loading 88, ZPPR-15C loading 166 and ZPPR-15D loading 185. The as-built models neglect the small, non-uniform gap between matrix halves at full closure, any structures outside the matrix tubes and minor components, e.g., impurities, in some materials. The biases associated with the neglected items were quantified. The experimental value of keff and its associated uncertainty for each reference critical configuration were adjusted to account for biases introduced by items that are neglected in the as-built model for that configuration.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Calibration Probe Uncertainty and Validation for the Hypersonic Material Environmental Test System

This paper presents an uncertainty analysis of the stagnation-point calibration probe surface predictions for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System facility located at NASA Langley Research Center. A second-order stochastic expansion was constructed over 47 uncertain parameters to evaluate the sensitivities, identify the most significant uncertain variables, and quantify the uncertainty in the stagnation-point heat flux and pressure predictions of the calibration probe for a low- and high-enthalpy test condition. A sensitivity analysis showed that measurement bias uncertainty is the most significant contributor to the stagnation-point pressure and heat flux variance for the low-enthalpy condition. For the high-enthalpy condition, a paradigm shift in sensitivities revealed the computational fluid dynamics model input uncertainty as the main contributor. A comparison between the prediction and measurement of the stagnation-point conditions under uncertainty showed that there was evidence of statistical disagreement. A validation metric was proposed and applied to the prediction uncertainty to account for the statistical disagreement when compared to the possible stagnation-point heat flux and pressure measurements.

Brune, Andrew J.↗

Simultaneous three-dimensional velocity and mixing measurements by use of laser Doppler velocimetry and fluorescence probes in a water tunnel

A water tunnel investigation was conducted to demonstrate the capabilities of a laser-based instrument that can measure velocity and fluorescence intensity simultaneously. Fluorescence intensity of an excited fluorescent dye is directly related to concentration level and is used to indicate the extent of mixing in flow. This instrument is a three-dimensional laser Doppler velocimeter (LDV) in combination with a fluorometer for measuring fluorescence intensity variations. This capability allows simultaneous flow measurements of the three orthogonal velocity components and mixing within the same region. Two different flows which were generated by two models were studied: a generic nonaxisymmetric nozzle propulsion simulation model with an auxiliary internal water source that generated a jet flow and an axisymmetric forebody model with a circular sector strake that generated a vortex flow. The off-body flow fields around these models were investigated in the Langley 16- by 24-Inch Water Tunnel. The experimental results were used to calculate 17 quantities that included mean and fluctuating velocities, Reynolds stresses, mean and fluctuating dye fluorescence intensities (proportional to concentration), and fluctuating velocity and dye concentration correlations. An uncertainty analysis was performed to establish confidence levels in the experimental results. In general, uncertainties in mean velocities varied between 1 and 7 percent of free-stream velocity; uncertainties in fluctuating velocities varied between 1 and 5 percent of reference values. The results show characteristics that are unique to each type of flow.

Neuhart, Dan H.↗

Delayed Critical Highly Enriched Uranium Metal Cylinders with Thin Graphite Top and Bottom Reflectors

Nine 7, 11, and 15 in. diam highly enriched uranium (HEU, 93.15 wt % 235 U) metal cylinders were assembled on the vertical assembly machine in the Oak Ridge Critical Experiments Facility (ORCEF) and had 1, 2, or 3 in. thick HLM graphite reflectors on the top and bottom. The experiments, which were performed between April 3, 1970, and February 18, 1971, used 23 operational days at ORCEF. Before those experiments were carried out, unreflected and unmoderated, graphite- and polyethylene-reflected, and polyethylene-moderated HEU metal cylinders had been assembled to obtain delayed criticality at ORCEF in the 1960s and reported by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) at the Nuclear Energy Agency (NEA)*. The data from the nine critical experiments are acceptable for use as criticality safety benchmark experiments for the NEA’s ICSBEP once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with HEU metal at ORCEF, the uncertainties in k eff are expected to be as low as ±0.0004.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC)

The Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC) data is a collection of 4km hourly wind, solar, temperature, humidity, and pressure fields for the contiguous United States under various climate change scenarios. Sup3rCC is downscaled Global Climate Model (GCM) data. The downscaling process was performed using a generative machine learning approach called sup3r: Super-Resolution for Renewable Energy Resource Data (linked below as "Sup3r GitHub Repo"). The data includes both historical and future weather years, although the historical years represent the historical climate, not the actual historical weather that we experienced. You cannot use Sup3rCC data to study historical weather events, although other sup3r datasets may be intended for this. The Sup3rCC data is intended to help researchers study the impact of climate change on energy systems with high levels of wind and solar capacity. Please note that all climate change data is only a representation of the possible future climate and contains significant uncertainty. Analysis of multiple climate change scenarios and multiple climate models can help quantify this uncertainty.

Array↗

Rayleigh Scattering Diagnostic for Dynamic Measurement of Velocity and Temperature

A new technique for measuring dynamic gas velocity and temperature is described. The technique is based on molecular Rayleigh scattering of laser light, so no seeding of the flow is necessary. The Rayleigh scattered light is filtered with a fixed cavity, planar mirror Fabry-Perot interferometer. A minimum number of photodetectors were used in order to allow the high data acquisition rate needed for dynamic measurements. One photomultiplier tube (PMT) was used to measure the total Rayleigh scattering, which is proportional to the gas density. Two additional PMTs were used to detect light that passes through two apertures in a mask located in the interferometer fringe plane. An uncertainty analysis was used to select the optimum aperture parameters and to predict the measurement uncertainty due to photon shot-noise. Results of an experiment to measure the velocity of a subsonic free jet are presented.

Seasholtz, Richard G.↗

The Activity Profiles and Peak Flux of Radar Meteor Showers

Meteor showers are transient phenomena; a limited duration is what distinguishes a shower from a sporadic source. They do not, however, have clear start and end times; instead, shower activity gradually (or rapidly) increases over time, reaches a peak, and then decays. In this report, we examine the activity profiles of 38 meteor showers using 20 years of single-station shower fluxes from the Canadian Meteor Orbit Radar (CMOR). We find that a number of showers, such as the Southern delta Aquariids (SDAs), exhibit a broad maximum in activity rather than a sharp peak. We also find that approximately one-third of showers exhibit asymmetric activity profiles in which the rate in which activity rises prior to the peak differs from the rate at which it decays after the peak. We provide a functional form for meteor shower activity profiles that incorporates these features and use these profile fits to estimate each shower’s peak flux. This report also includes an uncertainty analysis for CMOR fluxes. This includes the first (to our knowledge) characterization of systematic uncertainty in radar meteor fluxes.

A V Moorhead↗

Impact of Model Uncertainties on Quantitative Analysis of FUV Auroral Images: Peak Production Height

We demonstrate that small uncertainties in the modeled height of peak production for FUV emissions can lead to significant uncertainties in the analysis of these sai-ne emissions. In particular, an uncertainty of only 3 km in the peak production height can lead to a 50% uncertainty in the mean auroral energy deduced from the images. This altitude uncertainty is comparable to differences in different auroral deposition models currently used for UVI analysis. Consequently, great care must be taken in quantitative photometric analysis and interpretation of FUV auroral images.

Germany, G. A.↗

State-of-the-Art Reactor Consequence Analysis Project: Sensitivity Analysis Using Dakota

The State-of-the-Art Reactor Consequence Analyses (SOARCA) project has focused on best estimate analyses and uncertainty analysis for postulated accidents at specific nuclear power plants. The consequences of these accidents are estimated using the simulation tools MELCOR and MACCS. To understand which uncertain input variables are important to determining these consequences, analysts have performed sensitivity analyses. The tool used to perform these sensitivity analyses in previous SOARCA work, CompModSA, is no longer supported. Therefore, the current work focuses on migrating these analyses to another tool and evaluating its performance. Dakota, which is a tool developed at Sandia National Laboratories, is used in this work. Sensitivity results are created for three analyses from the SOARCA Surry UA. Though CompModSA and Dakota vary slightly in their algorithms and implementation, their sensitivity results generally agree, which gives confidence in the Dakota approach and increases confidence in the original analyses. It is likely that this methodology is extendable to the rest of SOARCA analyses.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Probabilistic Risk Analysis and Margin Process for a Flexible Thermal Protection System

Atmospheric entry vehicle thermal protection systems are margined due to the uncertainties that exist in entry aeroheating environments and the thermal response of the materials and structures. Entry vehicle thermal protections systems are traditionally over-margined for the heat loads that are experienced along the entry trajectory by designing to survive stacked worst-case scenarios. Additionally, the conventional heat shield design and margin process offers very little insight into the risk of over-temperature during flight and the corresponding reliability of the heat shield performance. A probabilistic margin process can be used to appropriately margin the thermal protection system based on rigorously calculated risk of failure. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and risk trades while preventing excessive margin from being applied. This study presents the methods of the probabilistic margin process and how the uncertainty analysis is used to determine the reliability of the entry vehicle thermal protection system and associated risks of failure.

Tobin, Steven A.↗

Sodium Void Worth and Control Rod Worth Measurements in ZPPR 15

Sodium void worth and control rod worth were measured in Phases A, B, C and D of the ZPPR15 experimental program. Sodium voiding was simulated by replacing stainless steel cans containing sodium by empty stainless steel cans of the same sizes. The control rod worth measurements were measurements of simulated control rods (CRs) and simulated empty control rod positions (CRPs). A CRP consisted of a 2 x 2 array of drawers filled with sodium plates. A CR consisted of a 2 x 2 array of drawers containing alternating columns of boron carbide plates and sodium plates in the front 18 inches and just sodium plates in the back 18 inches. The ZPPR staff published the measured sodium void worths and control rod worths and the statistical uncertainties in the measured values. In reality, the published uncertainty for each of these measurements is only one component of the total uncertainty. There are additional contributions from uncertainties related to measurement technique, plate compositions and reproducibility. However, the dominant uncertainty for the sodium void worth and control rod worth measurements is the uncertainty in βeff which is required to convert from the natural measurement units, cents, to the calculation units, pcm or Δ/k 1 k 2 . A full uncertainty analysis was performed for the sodium void worth and control rod worth measurements. The significant uncertainties were quantified, and a total uncertainty was derived for each sodium void worth or control rod worth measurement. The ZPPR-15 experimental records were used to create detailed as-built Monte Carlo models of the sodium void worth and control rod worth configurations. These models were used to compute the sodium void worths and control rod worths. (C/E – 1) and the related uncertainty in (C/E – 1) were derived for the measured worths.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul↗

Delayed Critical Enriched Uranium Metal, 7-in.-diam. Cylinder with Thin Stainless Steel Top and Bottom Reflectors

Three 7 in. diameter highly enriched uranium (HEU; 93.17 wt % 235 U) metal cylinders were assembled on the vertical assembly machine of the Oak Ridge Critical Experiments Facility (ORCEF) with thin stainless steel reflectors (0.5, 1, and 2 in. thick) on the top and bottom. These experiments were performed during January 13–25, 1965, and used seven operational days at ORCEF. Before these experiments, unreflected and unmoderated 7 in. diameter HEU metal cylinders had been assembled to delayed criticality at ORCEF, and the results were benchmarked in HEU-MET-FAST-051. In addition to the critical experiments, the prompt neutron decay constant was measured via the Rossi-α technique, and those results are also presented in this report. To achieve near-delayed-critical systems, 5 × 5 × 0.03125 in. rectangular uranium metal parts were used on top of 7 in. diameter cylinders inside the top reflector. The delayed critical configuration from the three experiments described herein are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Benchmark Evaluation Program (ICSBEP), coordinated by the Nuclear Energy Agency, once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainty in $k_{eff}$ is expected to be as low as ±0.0002. The prompt neutron time decay data could be the basis of an International Reactor Physics Evaluation Program benchmark.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uranium–Molybdenum Alloy Critical Experiments for the Design of the Health Physics Research Reactor

Clean critical experiments with a uranium-molybdenum alloy (average of 10.1616 wt. % Mo with a density of 17.08 g/cm 3 ) were performed at the Oak Ridge Critical Experiments Facility in 1961 to support the design of the Health Physics Research Reactor (HPRR). The HPRR was similar to the Godiva burst reactor at Los Alamos National Laboratory and was designed to produce 50 microseconds burst of 10 17 fission pulses of radiation for dosimetry measurements, initially in support of the determination of the doses from the nuclear detonations in Japan during World War II. These experiments reported here were used to verify the calculational methods used to design the HPRR. These delayed critical measurements were:1) a solid unreflected and unmoderated 8-in.-dimeter U-Mo cylinder, 2) an unmoderated and unreflected annulus with 8-in.-outside diameter, 2-in.-inside diameter cylinder with a central void, 3) an unmoderated and unreflected annulus with 8-in.-outside diameter, 2-in.-inside diameter cylinder with a central void filled with stainless steel, 4) Same as 3) but with 3-in-thick Plexiglas reflector on top with and without cadmium between the reflector and the U-Mo alloy assembly with steel in the center, and 5) an unmoderated and unreflected annulus which was a modification of the second but with the lower 5 inches of the central hole enlarged to 3.5 in. with various reflector conditions. The reflector conditions were: 1-in.-thick Plexiglas on all outer surfaces-void in the center; 1-in.-thick Plexiglas on all outer surfaces-Plexiglas in the center; 2-in.- thick Plexiglas on radial surface-void in the center; 6-in.-thick Plexiglas on the bottom only-Plexiglas in the center; and 6-in.-thick Plexiglas on bottom, 1-in.-thick on top and on the lower 8.25-cm.-section of the radial surface-void in the center. For some of these reflector conditions 0.025-cm.thick cadmium was located between the reflector and the U-Mo alloy. The uranium contained 93.17 wt. % 235 U. Reflection was a safety concern for this unmoderated and unreflected reactor and reduction of reflection effects was also investigated by insertion of neutron absorber around the U-Mo alloy. The stainless steel 304 contained 18% nickel and 8% chromium and the rest iron. The reflector material was a methacrylate plastic (Plexiglas) containing 5.8 x 10 22 atoms/cm 3 of hydrogen and 3.6 x 10 22 atoms/cm 3 of carbon with a density of 1.20 g/cm 3 . The purpose of this report is to document the experimental information for the measurements performed so that at a later date researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Nuclear Criticality Safety Benchmark Program (ICSBEP) or a EURATON Nuclear Energy Agency (NEA) benchmark. The data from the experiments described should be acceptable for use as criticality safety benchmark experiments for the ICSBEP and the NEA nuclear criticality safety benchmark program, once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainties in k eff could be as low as ±0.0002 for some configurations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multi-Band Atmospheric Correction Algorithm for Ocean Color Retrievals

NASA's current Atmospheric Correction (AC) algorithm for ocean color utilizes two bands and their ratio in the Near Infrared (NIR) to estimate aerosol reflectance and aerosol type. The algorithm then extrapolates the spectral dependence of aerosol reflectance to the visible wavelengths based on modeled spectral dependence of the identified aerosol type. Future advanced ocean color sensors, such as the Ocean Color Instrument (OCI) that will be carried on the Plankton, Aerosol, Cloud, and ocean Ecosystem (PACE) satellite, will be capable of measuring the hyperspectral radiance from 340 to 890 nm at 5-nm spectral resolution and at 7 discrete Short-wave Infrared (SWIR) channels: 940, 1038,1250, 1378, 1615, 2130, and 2260 nm. To optimally employ this unprecedented instrument capability, we propose an improved AC algorithm that utilizes all atmospheric-window channels in the NIR to SWIR spectral range to reduce the uncertainty in the AC process. A theoretical uncertainty analysis of this, namely Multi-Band AC (MBAC), indicates that the algorithm can reduce the uncertainty in remote sensing reflectance (Rrs) retrievals of the ocean caused by sensor random noise. Furthermore, in optically complex waters, where the NIR signal is affected by contributions from highly-reflective turbid waters, the MBAC algorithm can be adaptively weighted to the strongly-absorbing SWIR channels to enable improved ocean color retrievals in coastal waters. We provide here a description of the algorithm and demonstrate the improved performance in ocean color retrievals, relative to the current NASA standard AC algorithm, through comparison with field measurements and assessment of propagated uncertainties in applying the MBAC algorithm to MODIS and simulated PACE OCI data.

PACE↗

Study of Aerothermodynamic Modeling Issues Relevant to High-Speed Sample Return Vehicles

This paper examines the application of state-of-the-art coupled ablation and radiation simulations to highspeed sample return vehicles, such as those returning from Mars or an asteroid. A defining characteristic of these entries is that the surface recession rates and temperatures are driven by nonequilibrium convective and radiative heating through a boundary layer with significant surface blowing and ablation products. Measurements relevant to validating the simulation of these phenomena are reviewed and the Stardust entry is identified as providing the best relevant measurements. A coupled ablation and radiation flowfield analysis is presented that implements a finite-rate surface chemistry model. Comparisons between this finite-rate model and a equilibrium ablation model show that, while good agreement is seen for diffusion-limited oxidation cases, the finite-rate model predicts up to 50% lower char rates than the equilibrium model at sublimation conditions. Both the equilibrium and finite rate models predict significant negative mass flux at the surface due to sublimation of atomic carbon. A sensitivity analysis to flowfield and surface chemistry rates show that, for a sample return capsule at 10, 12, and 14 km/s, the sublimation rates for C and C3 provide the largest changes to the convective flux, radiative flux, and char rate. A parametric uncertainty analysis of the radiative heating due to radiation modeling parameters indicates uncertainties ranging from 27% at 10 km/s to 36% at 14 km/s. Applying the developed coupled analysis to the Stardust entry results in temperatures within 10% of those inferred from observations, and final recession values within 20% of measurements, which improves upon the 60% over-prediction at the stagnation point obtained through an uncoupled analysis. Emission from CN Violet is shown to be over-predicted by nearly and order-of-magnitude, which is consistent with the results of previous independent analyses. Finally, the coupled analysis is applied to a 14 km/s Earth entry representative of a Mars sample return. Although the radiative heating provides a larger fraction of the total heating, the influence of ablation and radiation on the flowfield are shown to be similar to Stardust.

Johnston, Christopher O.↗

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗