RAVEN Sensitivity Analysis & Uncertainty Quantification_Workshop Material
This is a workshop material, introducing capabilities of RAVEN for sensitivity analysis and uncertainty quantification.
42 - ENGINEERING↗
SEARCH · Engineering Papers
Results for “Sensitivity and Uncertainty Analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Sensitivity-based Similarity Metrics for New Experiment Design Optimization
The nuclear data used in advanced reactor simulations requires validation. Data from nuclear criticality experiments can provide this validation. New nuclear criticality experiment design requires extensive knowledge and expert judgement such that the experimental design parameters are selected in such a way to keep the experiment subcritical. To aide in this experimental design process, professionals can utilize sensitivity and uncertainty analysis. Sensitivity and uncertainty analysis relies on matching new application experiments with currently existing benchmark experiments. Currently, there is functionality in the Whisper 1.1 software package to calculate a similarity metric based on neutron multiplication factor sensitivity coefficients between a new application designed by the user and existing International Criticality Safety Benchmark Experiment Project (ICSBEP) benchmarks. The Whisper 1.1 software package is included in Monte Carlo N-Particle ® Code Version 6.21 (MCNP ® 6.2). This work is geared toward expanding this capability to new similarity metrics based on beta-effective sensitivity coefficients and reactivity coefficient sensitivity coefficients. While the investigation of these sensitivity coefficients is presented in detail in separate works at this same conference, this work will be primarily focused on studying the similarity metrics in more detail. These similarity metrics will then be incorporated into the optimization algorithms used for experiment design in EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data), which is a Los Alamos National Laboratory (LANL) project designed to constrain nuclear data of interest, such that adjustments can be made to possible inaccuracies. A more detailed optimization can be subsequently performed by breaking down these similarity metrics by isotope, reaction, and energy.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Credible Computations: Standard and Uncertainty
The discipline of computational fluid dynamics (CFD) is at a crossroad. Most of the significant advances related to computational methods have taken place. The emphasis is now shifting from methods to results. Significant efforts are made in applying CFD to solve design problems. The value of CFD results in design depends on the credibility of computed results for the intended use. The process of establishing credibility requires a standard so that there is a consistency and uniformity in this process and in the interpretation of its outcome. The key element for establishing the credibility is the quantification of uncertainty. This paper presents salient features of a proposed standard and a procedure for determining the uncertainty. A customer of CFD products - computer codes and computed results - expects the following: A computer code in terms of its logic, numerics, and fluid dynamics and the results generated by this code are in compliance with specified requirements. This expectation is fulfilling by verification and validation of these requirements. The verification process assesses whether the problem is solved correctly and the validation process determines whether the right problem is solved. Standards for these processes are recommended. There is always some uncertainty, even if one uses validated models and verified computed results. The value of this uncertainty is important in the design process. This value is obtained by conducting a sensitivity-uncertainty analysis. Sensitivity analysis is generally defined as the procedure for determining the sensitivities of output parameters to input parameters. This analysis is a necessary step in the uncertainty analysis, and the results of this analysis highlight which computed quantities and integrated quantities in computations need to be determined accurately and which quantities do not require such attention. Uncertainty analysis is generally defined as the analysis of the effect of the uncertainties involved in all stages of a process on the final responses. There are two approaches for conducting the uncertainty analysis: experimental and computational. These analyses and approaches are briefly described.
Mehta, Unmeel B.↗
Uncertainty and Sensitivity Analysis of Afterbody Radiative Heating Predictions for Earth Entry
The objective of this work was to perform sensitivity analysis and uncertainty quantification for afterbody radiative heating predictions of Stardust capsule during Earth entry at peak afterbody radiation conditions. The radiation environment in the afterbody region poses significant challenges for accurate uncertainty quantification and sensitivity analysis due to the complexity of the flow physics, computational cost, and large number of un-certain variables. In this study, first a sparse collocation non-intrusive polynomial chaos approach along with global non-linear sensitivity analysis was used to identify the most significant uncertain variables and reduce the dimensions of the stochastic problem. Then, a total order stochastic expansion was constructed over only the important parameters for an efficient and accurate estimate of the uncertainty in radiation. Based on previous work, 388 uncertain parameters were considered in the radiation model, which came from the thermodynamics, flow field chemistry, and radiation modeling. The sensitivity analysis showed that only four of these variables contributed significantly to afterbody radiation uncertainty, accounting for almost 95% of the uncertainty. These included the electronic- impact excitation rate for N between level 2 and level 5 and rates of three chemical reactions in uencing N, N(+), O, and O(+) number densities in the flow field.
West, Thomas K., IV↗
Effect of Nuclear Data Covariances on Integral Experiment Design with Sensitivity and Uncertainty Analysis
Washington River Protection Solutions (WRPS) uses MCNP6.2 and the Whisper code for criticality safety analyses of the Hanford Tank Farm. Together the codes derive baseline upper subcritical limits (USLs) for the waste models using experimental benchmarks. Whisper returns higher USLs, i.e. , has less of a conservative penalty, when the neutronic similarity of the experimental benchmarks to the application is high. Unfortunately, few critical benchmarks have high similarity to the Hanford tanks. The waste in the tanks is highly dilute in plutonium and contains large masses of weakly neutron-absorbing elements like iron and manganese. Experimental benchmarks typically have low sensitivity to these absorbers because they are present as structural materials. Lacking similar benchmarks, new Thermal Epithermal eXperiment (TEX) configurations with high Pu content and interstitial iron absorbers have been designed for the criticality safety validation. The features of the design have been iterated upon to maximize the similarity between the experiment and different Hanford waste models. The similarity is quantified with sensitivity analysis and uncertainty quantification using the representativity coefficient, or c k . The representativity calculation requires nuclear data covariances, which may differ between nuclear data libraries and between library versions. Because of these variations, the optimal design may depend on the nuclear data covariances library. A scenario can be envisioned where an experiment is designed, and c k is maximized, with one set of covariance data. However, when the covariance data is changed, say from ENDF/B-VII.1 to ENDF/B-VIII.0, and the benchmark is used in a criticality safety evaluation, the experiment becomes suboptimal with respect to c k . In this paper, we present how the optimal design of the new TEX experiments varied depending on the nuclear data covariances used to calculate c k . We compare ENDF/B-VII.1 and ENDF/B-VIII.0, as if the library had been updated since the design of the experiment. Additionally, we use JEFF3.3 to simulate if the covariance data of a different library had been used. The results show that the covariances do have an important effect on the designs, less so for thermal systems (where the data are more consistent between evaluations) and more so for epithermal systems where more differences exist.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2021)
The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. GDSA Framework is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-21SN01030404) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2021) (M3SF-21SN010304042). It presents high level objectives and strategy for development of uncertainty and sensitivity analysis tools, demonstrates uncertainty quantification (UQ) and sensitivity analysis (SA) tools in GDSA Framework in FY21, and describes additional UQ/SA tools whose future implementation would enhance the UQ/SA capability of GDSA Framework. This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-21SN01030405), the GDSA Repository Systems Analysis work package (SF-21SN01030406), and the GDSA PFLOTRAN Development work package (SF-21SN01030407). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF 20SN010304032.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Advances in Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework.
The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST ''Geologic Disposal Safety Assessment'' (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, ''GDSA Framework'', for evaluating disposal system performance for nuclear waste in geologic media. ''GDSA Framework'' is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-20SN01030403) level 3 milestone — ''Advances in Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework'' (M3SF-20SN010304032). It presents high level objectives and strategy for development of uncertainty and sensitivity analysis tools, demonstrates uncertainty quantification (UQ) and sensitivity analysis (SA) tools in GDSA Framework in FY20, and describes additional UQ/SA tools whose future implementation would enhance the UQ/SA capability of ''GDSA Framework''. This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF- 2051\101030404), the GDSA Repository Systems Analysis work package (SF-2051\101030405), and the GDSA PFLOTRAN Development work package (SF-20SN01030406). This report builds on developments reported in previous ''GDSA Framework'' milestones, particularly M2SF- 19SNO1030403.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2025)
The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. This report describes specific activities in the Fiscal Year (FY) 2025 associated with the GDSA Uncertainty and Sensitivity Analysis Methods work package. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-25SN01030407) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2025) (M3SF-25SN010304072). This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-25SN01030408), the GDSA Repository Systems Analysis work package (SF-25SN01030409), and the GDSA PFLOTRAN Development work package (SF-25SN01030410). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF-24SN010304072.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Summary Findings from the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design
A NATO symposium held in Greece in 2008 identified many promising sensitivity analysis and uncertainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not clear. The NATO Science and Technology Organization, Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic vehicle development problems. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper summarizes findings and lessons learned from the task group.
Benek, John A.↗
Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design
A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.
Benek, John A.↗
Sensitivity and uncertainty analysis of PWR spent fuel observables to operational and model parameters
Sensitivity and uncertainty analyses of spent nuclear fuel (SNF) observables - decay heat, neutron and γ-ray emission rate - to operational and model parameters have been performed. A 2D model representing a typical PWR 17x17 UO{sub 2} fuel assembly has been taken as reference. The Serpent code and ENDF/B-VII.1 evaluated nuclear data library have been used for the analyses. Relative uncertainty of decay heat, neutron and γ-ray emission rates due to Monte Carlo counting statistics, as well as the number of fuel pin radial regions required for an accurate characterization of SNF neutron emission, have been estimated. A parametric study has been carried out to investigate the impact of the homogenization to an average value of the fuel and moderator temperature, boron concentration power and burnup on the prediction of the selected observables. In addition, linear sensitivity coefficients have been calculated. (authors)
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Some Aspects of uncertainty in computational fluid dynamics results
Uncertainties are inherent in computational fluid dynamics (CFD). These uncertainties need to be systematically addressed and managed. Sources of these uncertainty analysis are discussed. Some recommendations are made for quantification of CFD uncertainties. A practical method of uncertainty analysis is based on sensitivity analysis. When CFD is used to design fluid dynamic systems, sensitivity-uncertainty analysis is essential.
Mehta, U. B.↗
Evolution of the Antarctic Ice Sheet from 2000–2300 and beyond: model sensitivity and uncertainty analysis using MPAS-Albany Land Ice
We present a description of the Antarctic Ice Sheet model configuration submitted to the ISMIP6-Antarctica-2300 experiment using the MPAS-Albany Land Ice model, along with three new sets of simulations: (1) a set of extended simulations to 2500 for three forced experiments and to 2775 for the control experiment; (2) a sensitivity analysis of our model configuration to parameters controlling basal sliding and sub-shelf melt, and to model structural choices including the choice of the energy and stress balances; and (3) a 72-member ensemble run on graphics processing units (GPUs) and analysis of variance to determine the primary sources of uncertainty in our ice-sheet model projections. Our extended simulations predict rapid retreat beginning after 2300 for SSP1-2.6 forcing and after 2500 for present-day (control) forcing, primarily in the Amundsen Sea Embayment. We find that varying the sub-shelf melt parameter between the 5th to 95th percentile values for a mean-Antarctic calibration target results in an up to ∼ ± 40 % change in sea-level contribution relative to our baseline simulations that used the median value. Using a linear basal sliding law reduces sea-level contribution by 51 %–73 % relative to our baseline nonlinear sliding law with an exponent of 1/5. When using basal sliding law exponents of 1/3 and 1/10, the overall difference from our baseline simulations at 2300 is on the order of 10 %. The Amundsen Sea Embayment region displays a strongly non-linear dependence of mass loss on the sliding law exponent, with no discernible relationship between the sliding law exponent and the mass loss by 2300, while the sectors feeding the Ross and Filchner-Ronne ice shelves exhibit more mass loss with a more-plastic sliding law. Our model fidelity sensitivity experiments reveal a 9 %–31 % increase in sea-level contribution when using a depth-integrated stress balance approximation relative to our three-dimensional solver, while using a fixed-in-time temperature field increases sea-level contribution by 14 %–88 % relative to two thermomechanically coupled configurations. Our 72-member ensemble and analysis of variance show that the uncertainty in long-term projections is dominated by the choice of Earth system model forcing and the presence or absence of hydrofracture forcing, rather than uncertainty in sliding and sub-shelf melt parameters.
58 GEOSCIENCES↗
Sensitivity and Uncertainty Analysis of Generator Failures under Extreme Temperature Scenarios in Power Systems
This report summarizes work done under the Verification, Validation, and Uncertainty Quantification (VVUQ) thrust area of the North American Energy Resilience Model (NAERM) Program. The specific task of interest described in this report is focused on sensitivity analysis of scenarios involving failures of both wind turbines and thermal generators under extreme cold-weather temperature conditions as would be observed in a Polar Vortex event.
17 WIND ENERGY↗
Extension of the NEAMS workbench to parallel sensitivity and uncertainty analysis of thermal hydraulic parameters using Dakota and Nek5000
Not Available
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept
The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.
Noyes, Connor↗
Development of SCALE Tools for Sensitivity and Uncertainty Analysis Methodology Implementation (TSUNAMI) from SCALE 5 through SCALE 6.2
This review paper provides an abbreviated historical review of the development of the TSUNAMI capabilities in SCALE, beginning with the first initiatives, to provide new insights into validation, uncertainty quantification, and safety assessment. The tools of TSUNAMI have evolved substantially over two decades to meet the growing application analysis and experiment design needs. Even more advancements are emerging as the next generation of innovators continue to use and develop these tools.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2022)
The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. GDSA Framework is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗