Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

SU-E-T-324: The Influence of Patient Positioning Uncertainties in Proton Radiotherapy On Proton Range and Dose Distributions

Purpose: Proton radiotherapy allows radiation treatment delivery with high dose gradients. The nature of such dose distributions increases the influence of patient positioning uncertainties on their fidelity when compared to photon radiotherapy. The present work quantitatively analyzes the influence of setup uncertainties on proton range and dose distributions. Methods: 38 clinical passive scattering treatment fields for small lesions in the head were studied. Dose distributions for shifted and rotated patient positions were Monte Carlo-simulated. Proton range uncertainties at the 50% and 90%-dose falloff position were calculated considering 18 arbitrary combinations of maximal patient position shifts and rotations for two patient positioning methods. Normal tissue complication probabilities (NTCPs), equivalent uniform doses (EUDs) and tumor control probabilities (TCPs) were studied for organs at risk (OARs) and target volumes of eight patients. Results: We identified a median 1σ proton range uncertainty at the 50%-dose falloff of 2.8 mm for anatomy-based patient positioning and 1.6 mm for fiducial-based patient positioning as well as 7.2 mm and 5.8 mm for the 90%-dose falloff position respectively. These range uncertainties were correlated to heterogeneity indices (HIs) calculated for each treatment field (38% < R{sup 2} < 50%). A NTCP increase of more than 10% (absolute) was observed for less than 2.9% (anatomy-based positioning) and 1.2% (fiducial-based positioning) of the studied OARs and patient shifts. TCP decreases larger than 10% (absolute) were seen for less than 2.2% of the target volumes or non-existent. EUD changes were up to 178% for OARs and 35% for target volumes. Conclusion: The influence of patient positioning uncertainties on proton range in therapy of small lesions in the human brain and target and OAR dosimetry were studied. Observed range uncertainties were correlated with HIs. The clinical practice of using multiple compensator-smeared treatment beams selected to avoid distal OAR sparing is considered to be safe. J. L. was supported by a scholarship of the University of Vienna.

60 APPLIED LIFE SCIENCES↗

TH-C-BRD-07: Minimizing Dose Uncertainty for Spot Scanning Beam Proton Therapy of Moving Tumor with Optimization of Delivery Sequence

Purpose: Intensity modulated proton therapy (IMPT) has been shown to be able to reduce dose to normal tissue compared to intensity modulated photon radio-therapy (IMRT), and has been implemented for selected lung cancer patients. However, respiratory motion-induced dose uncertainty remain one of the major concerns for the radiotherapy of lung cancer, and the utility of IMPT for lung patients was limited because of the proton dose uncertainty induced by motion. Strategies such as repainting and tumor tracking have been proposed and studied but repainting could result in unacceptable long delivery time and tracking is not yet clinically available. We propose a novel delivery strategy for spot scanning proton beam therapy. Method: The effective number of delivery (END) for each spot position in a treatment plan was calculated based on the parameters of the delivery system, including time required for each spot, spot size and energy. The dose uncertainty was then calculated with an analytical formula. The spot delivery sequence was optimized to maximize END and minimize the dose uncertainty. 2D Measurements with a detector array on a 1D moving platform were performed to validate the calculated results. Results: 143 2D measurements on a moving platform were performed for different delivery sequences of a single layer uniform pattern. The measured dose uncertainty is a strong function of the delivery sequence, the worst delivery sequence results in dose error up to 70% while the optimized delivery sequence results in dose error of <5%. END vs. measured dose uncertainty follows the analytical formula. Conclusion: With optimized delivery sequence, it is feasible to minimize the dose uncertainty due to motion in spot scanning proton therapy.

60 APPLIED LIFE SCIENCES↗

The influence of patient positioning uncertainties in proton radiotherapy on proton range and dose distributions

Purpose: Proton radiotherapy allows radiation treatment delivery with high dose gradients. The nature of such dose distributions increases the influence of patient positioning uncertainties on their fidelity when compared to photon radiotherapy. The present work quantitatively analyzes the influence of setup uncertainties on proton range and dose distributions. Methods: Thirty-eight clinical passive scattering treatment fields for small lesions in the head were studied. Dose distributions for shifted and rotated patient positions were Monte Carlo-simulated. Proton range uncertainties at the 50%- and 90%-dose falloff position were calculated considering 18 arbitrary combinations of maximal patient position shifts and rotations for two patient positioning methods. Normal tissue complication probabilities (NTCPs), equivalent uniform doses (EUDs), and tumor control probabilities (TCPs) were studied for organs at risk (OARs) and target volumes of eight patients. Results: The authors identified a median 1σ proton range uncertainty at the 50%-dose falloff of 2.8 mm for anatomy-based patient positioning and 1.6 mm for fiducial-based patient positioning as well as 7.2 and 5.8 mm for the 90%-dose falloff position, respectively. These range uncertainties were correlated to heterogeneity indices (HIs) calculated for each treatment field (38% < R{sup 2} < 50%). A NTCP increase of more than 10% (absolute) was observed for less than 2.9% (anatomy-based positioning) and 1.2% (fiducial-based positioning) of the studied OARs and patient shifts. For target volumes TCP decreases by more than 10% (absolute) occurred in less than 2.2% of the considered treatment scenarios for anatomy-based patient positioning and were nonexistent for fiducial-based patient positioning. EUD changes for target volumes were up to 35% (anatomy-based positioning) and 16% (fiducial-based positioning). Conclusions: The influence of patient positioning uncertainties on proton range in therapy of small lesions in the human brain as well as target and OAR dosimetry were studied. Observed range uncertainties were correlated with HIs. The clinical practice of using multiple fields with smeared compensators while avoiding distal OAR sparing is considered to be safe.

60 APPLIED LIFE SCIENCES↗

The Global Aerosol Synthesis and Science Project (GASSP): Measurements and Modeling to Reduce Uncertainty

The largest uncertainty in the historical radiative forcing of climate is caused by changes in aerosol particles due to anthropogenic activity. Sophisticated aerosol microphysics processes have been included in many climate models in an effort to reduce the uncertainty. However, the models are very challenging to evaluate and constrain because they require extensive in situ measurements of the particle size distribution, number concentration, and chemical composition that are not available from global satellite observations. The Global Aerosol Synthesis and Science Project (GASSP) aims to improve the robustness of global aerosol models by combining new methodologies for quantifying model uncertainty, to create an extensive global dataset of aerosol in situ microphysical and chemical measurements, and to develop new ways to assess the uncertainty associated with comparing sparse point measurements with low-resolution models. GASSP has assembled over 45,000 hours of measurements from ships and aircraft as well as data from over 350 ground stations. The measurements have been harmonized into a standardized format that is easily used by modelers and nonspecialist users. Available measurements are extensive, but they are biased to polluted regions of the Northern Hemisphere, leaving large pristine regions and many continental areas poorly sampled. The aerosol radiative forcing uncertainty can be reduced using a rigorous model–data synthesis approach. Nevertheless, our research highlights significant remaining challenges because of the difficulty of constraining many interwoven model uncertainties simultaneously. Although the physical realism of global aerosol models still needs to be improved, the uncertainty in aerosol radiative forcing will be reduced most effectively by systematically and rigorously constraining the models using extensive syntheses of measurements.

54 ENVIRONMENTAL SCIENCES↗

Quantifying the uncertainty of synchrotron-based lattice strain measurements

Crystallographic lattice strains - measured using diffraction techniques - are the same magnitude as typical macroscopic elastic strains. From a research perspective, the main interest is in measuring changes in lattice strains induced during in-situ loading: either from one macroscopic stress level to another or from one cycle to the next. The hope is to link these measurements to deformation-induced changes in the internal structure of crystals, possibly related to inelastic deformation and damage. These measurements are relatively new - little experimental intuition exists and it is difficult to discern whether observed differences are due to actual micromechanical evolution or to random experimental fluctuations. If the measurements are linked to material evolution on the size scale of the individual crystal, they have the potential to change the ideas about grain scale deformation partitioning processes and can be used to validate crystal-based simulation frameworks. Therefore, understanding the uncertainty associated with the lattice strain experiments is a crucial step in their continued development. If the measured lattice strains are of the same order as the random fluctuations that are part of the measurement process, documenting the strains can create more confusion than understanding. Often lattice strain error is quoted as {+-}1 x 10{sup -4}. This simple value fails to account for the range of factors that contribute to the experimental uncertainty - which, if not properly accounted for, may lead to a false confidence in the measurements. The focus of this paper is the development of a lattice strain uncertainty expression that delineates the contributing factors into terms that vary independently: (i) the contribution from the instrument and (ii) the contribution from the material under investigation. These aspects of uncertainty are described, and it is then possible to employ a calibrant powder method (diffraction from an unstrained material with high-precision lattice constants) to quantify the instrument portion of the lattice strain uncertainty. In these experiments, the instrument contribution to the uncertainty has been found to be a function of the Bragg angle and the intensity of the diffracted peaks. To develop a model for the instrument portion of the lattice strain uncertainty two datasets obtained using a MAR345 online image plate at the Cornell High Energy Synchrotron Source and a GE 41RT amorphous silicon detector at the Advanced Photon Source have been examined.

43 PARTICLE ACCELERATORS↗

Cross-section uncertainty propagation in the multigroup slowing-down equations using probability table formalism

In the frame of neutral-particle (neutron, gamma) transport, the uncertainty propagation calculation regarding the uncertainties on cross sections is often carried out without explicitly taking into account their probabilistic distribution. We investigate a new uncertainty propagation formalism where the cross-section uncertainty distributions are represented by probability tables. This technical note develops this approach for the steady-state slowing-down equation without up-scattering and in an infinite medium. This work is based on a deterministic multiband formalism that takes into account multilevel probability tables for cross sections. The first level represents the variation of cross sections versus lethargy (or energy) in each group of the multigroup lethargy mesh and thus corresponds to the classical cross-section probability tables. The higher levels represent the uncertainties on each step of the first-level cross-section probability table. This method is validated against a Monte Carlo calculation in a case of neutron slowing down in a {sup 238}U-hydrogen homogeneous mixture, showing fully consistent numerical results. The main interest of the deterministic multilevel multiband formalism is that it gives not only the mean value and the variance but also a probabilistic distribution of the fluxes. In the near future, we plan to investigate more deeply the robustness of this new approach in relation to high values of cross-section uncertainties and to introduce cross-section uncertainty correlations as well. Meanwhile, the promise of this work is its extension to the general transport steady-state equation solved by the discrete ordinates (S(N)) or Monte Carlo methods. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Budget Analysis for Dimensional Inspection Processes (U)

This paper is intended to provide guidance and describe how to prepare an uncertainty analysis of a dimensional inspection process through the utilization of an uncertainty budget analysis. The uncertainty analysis is stated in the same methodology as that of the ISO GUM standard for calibration and testing. There is a specific distinction between how Type A and Type B uncertainty analysis is used in a general and specific process. All theory and applications are utilized to represent both a generalized approach to estimating measurement uncertainty and how to report and present these estimations for dimensional measurements in a dimensional inspection process. The analysis of this uncertainty budget shows that a well-controlled dimensional inspection process produces a conservative process uncertainty, which can be attributed to the necessary assumptions in place for best possible results.

42 ENGINEERING↗

Uncertainty and sensitivity analysis for photovoltaic system modeling.

We report an uncertainty and sensitivity analysis for modeling DC energy from photovoltaic systems. We consider two systems, each comprised of a single module using either crystalline silicon or CdTe cells, and located either at Albuquerque, NM, or Golden, CO. Output from a PV system is predicted by a sequence of models. Uncertainty in the output of each model is quantified by empirical distributions of each model's residuals. We sample these distributions to propagate uncertainty through the sequence of models to obtain an empirical distribution for each PV system's output. We considered models that: (1) translate measured global horizontal, direct and global diffuse irradiance to plane-of-array irradiance; (2) estimate effective irradiance from plane-of-array irradiance; (3) predict cell temperature; and (4) estimate DC voltage, current and power. We found that the uncertainty in PV system output to be relatively small, on the order of 1% for daily energy. Four alternative models were considered for the POA irradiance modeling step; we did not find the choice of one of these models to be of great significance. However, we observed that the POA irradiance model introduced a bias of upwards of 5% of daily energy which translates directly to a systematic difference in predicted energy. Sensitivity analyses relate uncertainty in the PV system output to uncertainty arising from each model. We found that the residuals arising from the POA irradiance and the effective irradiance models to be the dominant contributors to residuals for daily energy, for either technology or location considered. This analysis indicates that efforts to reduce the uncertainty in PV system output should focus on improvements to the POA and effective irradiance models.

14 SOLAR ENERGY↗

Photovoltaic System Modeling: Uncertainty and Sensitivity Analyses

We report an uncertainty and sensitivity analysis for modeling AC energy from photovoltaic systems. Output from a PV system is predicted by a sequence of models. We quantify uncertainty in the output of each model using empirical distributions of each model’s residuals. We propagate uncertainty through the sequence of models by sampling these distributions to obtain an empirical distribution of a PV system’s output. We consider models that: (1) translate measured global horizontal, direct and global diffuse irradiance to plane-of-array irradiance; (2) estimate effective irradiance; (3) predict cell temperature; (4) estimate DC voltage, current and power; (5) reduce DC power for losses due to inefficient maximum power point tracking or mismatch among modules; and (6) convert DC to AC power. Our analysis considers a notional PV system comprising an array of FirstSolar FS-387 modules and a 250 kW AC inverter; we use measured irradiance and weather at Albuquerque, NM. We found the uncertainty in PV system output to be relatively small, on the order of 1% for daily energy. We found that uncertainty in the models for POA irradiance and effective irradiance to be the dominant contributors to uncertainty in predicted daily energy. Our analysis indicates that efforts to reduce the uncertainty in PV system output predictions may yield the greatest improvements by focusing on the POA and effective irradiance models.

14 SOLAR ENERGY↗

Final Report. Analysis and Reduction of Complex Networks Under Uncertainty

The project was a collaborative effort among MIT, Sandia National Laboratories (local PI Dr. Habib Najm), the University of Southern California (local PI Prof. Roger Ghanem), and The Johns Hopkins University (local PI Prof. Omar Knio, now at Duke University). Our focus was the analysis and reduction of large-scale dynamical systems emerging from networks of interacting components. Such networks underlie myriad natural and engineered systems. Examples important to DOE include chemical models of energy conversion processes, and elements of national infrastructure—e.g., electric power grids. Time scales in chemical systems span orders of magnitude, while infrastructure networks feature both local and long-distance connectivity, with associated clusters of time scales. These systems also blend continuous and discrete behavior; examples include saturation phenomena in surface chemistry and catalysis, and switching in electrical networks. Reducing size and stiffness is essential to tractable and predictive simulation of these systems. Computational singular perturbation (CSP) has been effectively used to identify and decouple dynamics at disparate time scales in chemical systems, allowing reduction of model complexity and stiffness. In realistic settings, however, model reduction must contend with uncertainties, which are often greatest in large-scale systems most in need of reduction. Uncertainty is not limited to parameters; one must also address structural uncertainties—e.g., whether a link is present in a network—and the impact of random perturbations, e.g., fluctuating loads or sources. Research under this project developed new methods for the analysis and reduction of complex multiscale networks under uncertainty, by combining computational singular perturbation (CSP) with probabilistic uncertainty quantification. CSP yields asymptotic approximations of reduceddimensionality “slow manifolds” on which a multiscale dynamical system evolves. Introducing uncertainty in this context raised fundamentally new issues, e.g., how is the topology of slow manifolds transformed by parametric uncertainty? How to construct dynamical models on these uncertain manifolds? To address these questions, we used stochastic spectral polynomial chaos (PC) methods to reformulate uncertain network models and analyzed them using CSP in probabilistic terms. Finding uncertain manifolds involved the solution of stochastic eigenvalue problems, facilitated by projection onto PC bases. These problems motivated us to explore the spectral properties stochastic Galerkin systems. We also introduced novel methods for rank-reduction in stochastic eigensystems—transformations of a uncertain dynamical system that lead to lower storage and solution complexity. These technical accomplishments are detailed below. This report focuses on the MIT portion of the joint project.

97 MATHEMATICS AND COMPUTING↗

Final Report: Optimal Model Complexity in Geological Carbon Sequestration: A Response Surface Uncertainty Analysis

The critical component of a risk assessment study in evaluating GCS is an analysis of uncertainty in CO2 modeling. In such analyses, direct numerical simulation of CO2 flow and leakage requires many time-consuming model runs. Alternatively, analytical methods have been developed which allow fast and efficient estimation of CO2 storage and leakage, although restrictive assumptions on formation rock and fluid properties are employed. In this study, an intermediate approach is proposed based on the Design of Experiment and Response Surface methodology, which consists of using a limited number of numerical simulations to estimate a prediction outcome as a combination of the most influential uncertain site properties. The methodology can be implemented within a Monte Carlo framework to efficiently assess parameter and prediction uncertainty while honoring the accuracy of numerical simulations. The choice of the uncertain properties is flexible and can include geologic parameters that influence reservoir heterogeneity, engineering parameters that influence gas trapping and migration, and reactive parameters that influence the extent of fluid/rock reactions. The method was tested and verified on modeling long-term CO2 flow, non-isothermal heat transport, and CO2 dissolution storage by coupling two-phase flow with explicit miscibility calculation using an accurate equation of state that gives rise to convective mixing of formation brine variably saturated with CO2. All simulations were performed using three-dimensional high-resolution models including a target deep saline aquifer, overlying caprock, and a shallow aquifer. To evaluate the uncertainty in representing reservoir permeability, sediment hierarchy of a heterogeneous digital stratigraphy was mapped to create multiple irregularly shape stratigraphic models of decreasing geologic resolutions: heterogeneous (reference), lithofacies, depositional environment, and a (homogeneous) geologic formation. To ensure model equivalency, all the stratigraphic models were successfully upscaled from the reference heterogeneous model for bulk flow and transport predictions (Zhang & Zhang, 2015). GCS simulation was then simulated with all models, yielding insights into the level of parameterization complexity that is needed for the accurate simulation of reservoir pore pressure, CO2 storage, leakage, footprint, and dissolution over both short (i.e., injection) and longer (monitoring) time scales. Important uncertainty parameters that impact these key performance metrics were identified for the stratigraphic models as well as for the heterogeneous model, leading to the development of reduced/simplified models at lower characterization cost that can be used for the reservoir uncertainty analysis. All the CO2 modeling was conducted using PFLOTRAN – a massively parallel, multiphase, multi-component, and reactive transport simulator developed by a multi-laboratory DOE/SciDAC (Scientific Discovery through Advanced Computing) project (Zhang et al., 2017, in review). Within the uncertainty analysis framework, increasing reservoir depth were investigated to explore its effect on the uncertainty outcomes and the potential for developing gravity-stable injection with increased storage security (Dai et al., 20126; Dai et al., 2017, in review). Finally, to accurately model CO2 fluid-rock reactions and resulting long-term storage as secondary carbonate minerals, a modified kinetic rate law for general mineral dissolution and precipitation was proposed and verified that is invariant to a scale transformation of the mineral formula weight. This new formulation will lead to more accurate assessment of mineral storage over geologic time scales (Lichtner, 2016).

58 GEOSCIENCES↗

Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty

The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Sensitivity and Uncertainty of the IFR-1 BISON Benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This report summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment. For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. The resulting variations in benchmark predictions were normalized to calculate sensitivities. The strongest sensitivities were identified and used to inform input selections for the UQ. The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because of the wide confidence intervals associated with the benchmark predictions. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark development and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗

Sister Rod Destructive Examinations (FY23) Appendix F3: Uncertainty and Conservative Bias in the Cyclic Integrated Reversible-Bending Fatigue Test

The development and application of the Cyclic Integrated Reversible-Bending Fatigue Tester (CIRFT) has been documented over the past 10 years. The CIRFT system was developed in collaboration with the U.S. Nuclear Regulatory Commission (NRC) to address the concern that high-burnup fuel rod fatigue performance was degraded compared to cladding-only behavior. Fatigue data measured by CIRFT on high-burnup fuel rods were then used by the NRC to develop a fatigue response curve for pressurized water reactor fuel rods with Zircaloy-4 cladding in NUREG-2224. Subsequently, CIRFT has been used in the sister rod project to test whether reoriented hydrides associated with vacuum drying influenced the fatigue lifetime, to extend the fatigue testing database to include fuel rods with ZIRLO cladding, and to add to the experience on both Zircaloy-4 and M5 cladding. These data will be used as a reference for subsequent characterization of fuel rods removed from the high-burnup demonstration cask to better understand the effects of long-term dry storage, which can be thought of as a multiyear elevated temperature anneal. The objective of fatigue testing is to provide data that can be used to develop a best-estimate fatigue curve and a conservative fatigue design curve that accounts for uncertainty and can be compared with actual transportation conditions. The process for defining a design fatigue curve for commercial used fuel rods was developed by Oak Ridge National Laboratory (ORNL) in FY22. One issue noted in the fatigue evaluation was that the calculated combined uncertainty in the strain amplitude values determined from the measured data was large. It was proposed then to directly measure the uncertainty in the strain amplitude to either validate the calculated combined uncertainty or update the uncertainty based on the measurement data. Thus, the purpose of this appendix is to document the measured uncertainty in the strain amplitude data. In the process, it was determined that there has been a conservative bias in the calculated strain amplitude that is small enough to be within the measurement uncertainty. This observation is discussed herein, and a case is made to continue to include the conservative bias in the data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty quantification approaches for advanced reactor analyses.

The original approach to nuclear reactor design or safety analyses was to make very conservative modeling assumptions so as to ensure meeting the required safety margins. Traditional regulation, as established by the U. S. Nuclear Regulatory Commission required conservatisms which have subsequently been shown to be excessive. The commission has therefore moved away from excessively conservative evaluations and has determined best-estimate calculations to be an acceptable alternative to conservative models, provided the best-estimate results are accompanied by an uncertainty evaluation which can demonstrate that, when a set of analysis cases which statistically account for uncertainties of all types are generated, there is a 95% probability that at least 95% of the cases meet the safety margins. To date, nearly all published work addressing uncertainty evaluations of nuclear power plant calculations has focused on light water reactors and on large-break loss-of-coolant accident (LBLOCA) analyses. However, there is nothing in the uncertainty evaluation methodologies that is limited to a specific type of reactor or to specific types of plant scenarios. These same methodologies can be equally well applied to analyses for high-temperature gas-cooled reactors and to liquid metal reactors, and they can be applied to steady-state calculations, operational transients, or severe accident scenarios. This report reviews and compares both statistical and deterministic uncertainty evaluation approaches. Recommendations are given for selection of an uncertainty methodology and for considerations to be factored into the process of evaluating uncertainties for advanced reactor best-estimate analyses.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Accounting for Global Climate Model Projection Uncertainty in Modern Statistical Downscaling

Future climate change has emerged as a national and a global security threat. To carry out the needed adaptation and mitigation steps, a quantification of the expected level of climate change is needed, both at the global and the regional scale; in the end, the impact of climate change is felt at the local/regional level. An important part of such climate change assessment is uncertainty quantification. Decision and policy makers are not only interested in 'best guesses' of expected climate change, but rather probabilistic quantification (e.g., Rougier, 2007). For example, consider the following question: What is the probability that the average summer temperature will increase by at least 4 C in region R if global CO{sub 2} emission increases by P% from current levels by time T? It is a simple question, but one that remains very difficult to answer. It is answering these kind of questions that is the focus of this effort. The uncertainty associated with future climate change can be attributed to three major factors: (1) Uncertainty about future emission of green house gasses (GHG). (2) Given a future GHG emission scenario, what is its impact on the global climate? (3) Given a particular evolution of the global climate, what does it mean for a particular location/region? In what follows, we assume a particular GHG emission scenario has been selected. Given the GHG emission scenario, the current batch of the state-of-the-art global climate models (GCMs) is used to simulate future climate under this scenario, yielding an ensemble of future climate projections (which reflect, to some degree our uncertainty of being able to simulate future climate give a particular GHG scenario). Due to the coarse-resolution nature of the GCM projections, they need to be spatially downscaled for regional impact assessments. To downscale a given GCM projection, two methods have emerged: dynamical downscaling and statistical (empirical) downscaling (SDS). Dynamic downscaling involves configuring and running a regional climate model (RCM) nested within a given GCM projection (i.e., the GCM provides bounder conditions for the RCM). On the other hand, statistical downscaling aims at establishing a statistical relationship between observed local/regional climate variables of interest and synoptic (GCM-scale) climate predictors. The resulting empirical relationship is then applied to future GCM projections. A comparison of the pros and cons of dynamical versus statistical downscaling is outside the scope of this effort, but has been extensively studied and the reader is referred to Wilby et al. (1998); Murphy (1999); Wood et al. (2004); Benestad et al. (2007); Fowler et al. (2007), and references within those. The scope of this effort is to study methodology, a statistical framework, to propagate and account for GCM uncertainty in regional statistical downscaling assessment. In particular, we will explore how to leverage an ensemble of GCM projections to quantify the impact of the GCM uncertainty in such an assessment. There are three main component to this effort: (1) gather the necessary climate-related data for a regional SDS study, including multiple GCM projections, (2) carry out SDS, and (3) assess the uncertainty. The first step is carried out using tools written in the Python programming language, while analysis tools were developed in the statistical programming language R; see Figure 1.

58 GEOSCIENCES↗

Evaluation of the Uncertainty in Satellite-Based Crop State Variable Retrievals Due to Site and Growth Stage Specific Factors and Their Potential in Coupling with Crop Growth Models

Coupling crop growth models and remote sensing provides the potential to improve our understanding of the genotype x environment x management (G × E × M) variability of crop growth on a global scale. Unfortunately, the uncertainty in the relationship between the satellite measurements and the crop state variables across different sites and growth stages makes it difficult to perform the coupling. In this study, we evaluate the effects of this uncertainty with MODIS data at the Mead, Nebraska Ameriflux sites (US-Ne1, US-Ne2, and US-Ne3) and accurate, collocated Hybrid-Maize (HM) simulations of leaf area index (LAI) and canopy light use efficiency (LUE Canopy ). The simulations are used to both explore the sensitivity of the satellite-estimated genotype × management (G × M) parameters to the satellite retrieval regression coefficients and to quantify the amount of uncertainty attributable to site and growth stage specific factors. Additional ground-truth datasets of LAI and LUE Canopy are used to validate the analysis. The results show that uncertainty in the LAI/satellite measurement regression coefficients lead to large uncertainty in the G × M parameters retrievable from satellites. In addition to traditional leave-one-site-out regression analysis, the regression coefficient uncertainty is assessed by evaluating the retrieval performance of the temporal change in LAI and LUE Canopy . The weekly change in LAI is shown to be retrievable with a correlation coefficient absolute value (|r|) of 0.70 and root-mean square error (RMSE) value of 0.4, which is significantly better than the performance expected if the uncertainty was caused by random error rather than secondary effects caused by site and growth stage specific factors (an expected |r| value of 0.36 and RMSE value of 1.46 assuming random error). As a result, this study highlights the importance of accounting for site and growth stage specific factors in remote sensing retrievals for future work developing methods coupling remote sensing with crop growth models.

54 ENVIRONMENTAL SCIENCES↗