Computation of Sobol' indices using Embedded Variance Deconvolution.
Abstract not provided.
Petticrew, James↗
SEARCH · Engineering Papers
Results for “Sobol indices”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A sampling-based approach to solve Sobol' Indices using variance deconvolution for arbitrary uncertainty distributions.
Abstract not provided.
Olson, Aaron↗
A sampling-based approach to solve Sobol' Indices using variance deconvolution for arbitrary uncertainty distributions.
Abstract not provided.
Olson, Aaron↗
Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models
This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.
36 MATERIALS SCIENCE↗
Global Sensitivity Analysis of Large Distribution System with PVs using Deep Gaussian Process
Global sensitivity analysis (GSA) of the voltage to uncertain power injection variations plays an important role for appropriate Volt-VAR optimization. This paper proposes a data-driven GSA method for large-scale distribution systems with a large number of uncertain sources. Specifically, the deep Gaussian process is used to identify the mapping relationship between uncertain power injections and voltages. This allows us to resort to the analysis of variance framework to calculate the Sobol indices for GSA. Unlike the existing polynomial chaos expansion and Gaussian process-based approaches, our proposed method has much better scalability. Test results on the EPRI 1747-node K1 circuit with a different number and different probability distributions of uncertain sources demonstrate that the proposed method can achieve accurate GSA under various conditions.
14 SOLAR ENERGY↗
Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking
The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty
Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.
97 MATHEMATICS AND COMPUTING↗
Quantifying model prediction sensitivity to model-form uncertainty
Computational and mathematical models are essential to understanding complex systems and phenomena. However, when developing such models, limited knowledge and/or resources necessitates the use of simplifying assumptions. It is therefore crucial to quantify the impact of such simplifying assumptions on the reliability and accuracy of resulting model predictions. This work develops a first-of-its-kind approach to quantify the impact of physics modeling assumptions on predictions. Here, we leverage the emerging field of model-form uncertainty (MFU) representations, which are parameterized modifications to modeling assumptions, in combination with grouped Sobol’ indices to quantitatively measure an assumption’s importance. Specifically, we compute the grouped Sobol’ index for the MFU representation’s parameters as a single importance measure of the assumption for which the MFU representation characterizes uncertainty. To ensure this approach is robust to the subjective choice of how to parameterize a MFU representation, we establish bounds for the difference between sensitivity results for two different MFU representations based on differences in model prediction statistics. The capabilities associated with this approach are demonstrated on three exemplar problems: an upscaled subsurface contaminant transport problem, ablation modeling for hypersonic flight, and nuclear waste repository modeling. We found that our grouped approach is able to assess the impact of modeling assumptions on predictions and offers computational advantages over classical Sobol’ index computation while providing more interpretable results.
97 MATHEMATICS AND COMPUTING↗
Sensitivity analysis of in-pile critical heat flux experiments in TREAT for characterization of RIA power-transient effects
A reactivity-initiated accident (RIA) is one type of postulated design basis accident (DBA) that can cause a departure from nucleate boiling (DNB) event in pressurized-water reactors (PWRs). A DNB occurrence and its consequences depend on the thermophysical properties of the fuel components and coolant, characteristics of the transient energy insertion into the fuel rod, and the onset of the critical heat flux (CHF) phenomenon. To leverage the restart of the Transient Reactor Test (TREAT) Facility, an effort is currently underway to better understand the cladding-to-coolant heat transfer mechanisms and the CHF phenomenon under fast-transient irradiation conditions. This paper characterizes the impact of power transients on the thermal-hydraulic behavior of a TREAT Facility reactor heater rodlet CHF experiment to provide the priority of parameters that need to be investigated for an improved CHF model. Sobol sensitivity analysis methods and the Reactor Excursion and Leak Analysis Program (RELAP5-3D) code were used to identify key input parameters on the uncertainty in the prediction of peak outer- and inner-surface temperatures of the heater tube, as well as the time of the DNB event. A series of sensitivity analyses revealed the total energy deposition on the tube and the transient effects of power pulse had large impacts on the maximum temperatures. The CHF multiplier had the largest impact on the time occurrence of CHF. The overall results show the energy deposition rate in the tube is the most influencing factor to the manifestation of CHF and the resulting thermal-hydraulic behaviors of the tube. The multiplier for the CHF, which is interpreted as the predicted CHF value, has the largest Sobol indices for the time of the CHF in all cases, since it directly determines the occurrence of CHF. It is inferred that the uncertainties in the thermal-hydraulic behaviors of fuels increase with respect to the key parameters as the power pulse becomes broader, and an accurate estimation of the energy deposition rate is required to reduce the uncertainty in the evaluation of the integrity of fuel if the CHF is expected to occur near the peak power. Therefore, the outputs are expected to provide rigorous interpretation of ongoing in-pile CHF experiments in the TREAT Facility reactor regarding thermal-hydraulic behavior of the fuel system aiming for a new transient in-pile CHF model.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Uncertainty quantification of bank vegetation impacts on the flood flow field in the American River, California, using large‐eddy simulations
Bank vegetation plays a key role in both hydrodynamics and morphodynamics of natural rivers; however, these effects are often unaccounted for in the computational flow dynamics of natural waterways. Recent studies using the large‐eddy simulation (LES), however, have attempted to gain insights into the impacts of bank vegetation on the mean flow field of the natural rivers using a vegetation model, which applies a sink term to the momentum equations of motion. This approach accounts for the effects of the vegetation and provides a practical approach to account for the complex patches of bank vegetation in large‐scale rivers. To implement the vegetation model, a drag coefficient reflecting the overall resistance of vegetal structures to the flow is needed, but due to the lack of calibrated data and range of size, density and type of vegetation, this parameter can be a significant source of uncertainty in the model results. Here, in this study, we use uncertainty quantification (UQ) to investigate the hydrodynamics and bed shear results when a bank vegetation is incorporated in an LES model. To this end, we used the polynomial chaos expansion and Monte Carlo sampling techniques to determine the uncertainties associated with the drag coefficient in the vegetation model and from uncertainties in the bed roughness and inflow discharge. The UQ analysis provided spatially varying confidence levels for the spanwise and vertical distribution of velocity magnitude and for the bed shear stress distributions. In addition, Sobol indices were computed to indicate the relative influence that each parameter had on the overall uncertainty. In general, it was found that uncertainty in flow discharge was the dominant source of uncertainty; however, the drag coefficient in the vegetation model and the bed roughness parameter also made significant contribution to the uncertainty near the banks and bed, respectively.
54 ENVIRONMENTAL SCIENCES↗
Benchmarking FFTF LOFWOS Test# 13 using SAM code: Baseline model development and uncertainty quantification
The development and deployment of advanced reactors, such as the sodium-cooled fast reactor (SFR), relies on sophisticated modeling tools to ensure the safety of the design under various transients. The predictive capability of these advanced modeling tools requires validation to garner trust in supporting the licensing of the advanced reactors. For this reason, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13.In this study, we present and discuss the benchmarking efforts of the modern system code SAM on the FFTF LOFWOS Test #13. Further, the SAM baseline model was developed according to the benchmark specification, which included a detailed core model with reactivity feedback. Generally, good agreement was observed between the baseline results and benchmark measurements; however, discrepancies persisted, particularly in predicted fuel assembly coolant outlet temperatures. Utilizing the baseline model, uncertainty quantification (UQ) and sensitivity analysis (SA) were conducted with the assistance of various statistical learning and machine learning methods, including kernel density estimation, Gaussian processes, and Sobol indices. Following the baseline model prediction and UQ and SA results, we discuss the reasons for the simulation discrepancies and propose further improvements to the model. This benchmarking effort adheres to the best-estimate plus uncertainty approach and can serve as a valuable example for supporting risk-informed licensing of advanced reactors.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Uncertainty quantification for competing failure mechanisms in unidirectionally reinforced carbon–carbon composites
Microstructure-informed finite element models play a key role in the carbon–carbon composite design process. Variability in manufacturing process parameters and experimental limitations introduce model parameter uncertainty. This study quantifies the effect of model parameter uncertainty on transverse tensile fracture behavior and proposes a methodology to predict the failure mode based on competing microscale damage mechanisms. Finite element simulations incorporate fiber–matrix interface debonding with cohesive zones and matrix damage with a smeared crack band approach in a unidirectional carbon–carbon composite. Results from a variance-based global sensitivity analysis identifies interfacial and matrix damage parameters as the primary source of variability in fracture behavior. Sobol’ indices indicate that matrix and cohesive zone strengths contribute 94% of the variance in the effective ultimate stress. A local analysis elucidates the relationship between these constituent strength parameters and failure mode by estimating the probability of cohesive, matrix, and mixed-mode dominated failure. Based on the results for 4000 simulations, 93% exhibit mixed-mode or interfacial dominated failure, which underscores the crucial role of fiber–matrix interface debonding in the transverse tensile failure of carbon–carbon composites. These uncertainty quantification results facilitate more efficient model calibration and provide a framework for microstructure-informed failure predictions in the face of manufacturing-induced uncertainty.
36 MATERIALS SCIENCE↗
Transient uncertainty quantification and Global Sensitivity Analysis of the open-source Molten Chloride Reactor Experiment (MCRE) using GP-PCA surrogate models
Uncertainties in the thermophysical properties of molten salts impact both the steady-state and transient behavior of Molten Salt Reactors (MSRs). In this work, we aim to quantify the influence of such uncertainties on the transient operation of the Molten Chloride Reactor Experiment (MCRE), utilizing the open-source specifications provided for this reactor. Seven representative transient scenarios are considered. For each scenario, we evaluate the impact of thermophysical property uncertainties on four key multiphysics model output variables of interest (VoIs): maximum power density, maximum fuel temperature, maximum reflector temperature, and average fuel velocity magnitude. In addition, we perform a Global Sensitivity Analysis (GSA) by computing Sobol’ indices for the uncertain input parameters to determine their contribution to the variability of each VoI. Conducting GSA is computationally intensive due to the large number of required evaluations of the high-fidelity multiphysics model. To mitigate this cost, we develop a surrogate modeling framework that combines Gaussian Process (GP) regression with Principal Component Analysis (PCA), enabling efficient sample generation for the GSA. Our results show that for energy-related VoIs, thermal conductivity is the dominant contributor to uncertainty. In contrast, for flow-related VoIs, density and dynamic viscosity are the primary sources of uncertainty. The specific heat of the fuel salt was found to play a secondary role in the transient analyses.
42 - ENGINEERING↗
Application of sensitivity analysis in DYMOND/Dakota to fuel cycle transition scenarios
The ability to perform sensitivity analysis has been enabled for the nuclear fuel cycle simulator DYMOND through its coupling with the design and analysis toolkit Dakota. To test and demonstrate these new capabilities, a transition scenario and multi-parameter study were devised. The transition scenario represents a partial transition from the US nuclear fleet to a closed fuel cycle with small modular LWRs and fast reactors fueled by reprocessed used nuclear fuel. Four uncertain parameters in this transition were studied – start date of reprocessing, total reprocessing capacity, the nuclear energy demand growth, and the rate at which the fast reactors are deployed – with respect to their impact on four response metrics. The responses – total natural uranium consumed, maximum annual enrichment capacity required, total disposed mass, and total cost of the nuclear fuel cycle – were chosen based on measures known to be of interest in transition scenarios and to be significantly impacted by the varying parameters. Furthermore, analysis of this study was performed both from the direct sampling and through surrogate models developed in Dakota to calculate the global sensitivity measures Sobol’ indices. This example application of this new capability showed that the most consequential parameter to most metrics was the share of new build capacity that is fast reactors. However, for the cost metric, the scaling factor of the energy demand growth was significant and had synergistic behavior with the fast reactor new build share.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Field Measurement and Analysis of Frequency and RoCoF for Low-Inertia Power Systems
The frequency measurement and rate of change of frequency (RoCoF) calculations are important for active power, frequency control, and frequency-related protection in power system operations. With the rapid decrease in inertia under modern power systems, however, multiple power variations introduced by variable renewable energy bring large RoCoF and introduce oscillations in frequency measurements. To shed light on this issue, this article proposes a frequency measurement and RoCoF analysis technology, as well as the sensitivity analysis for the real low-inertia power grid. First, a real-world event in an island power grid is analyzed as an example, and an event numerical model is estimated considering four uncertainties, including event RoCoF, oscillation magnitude, oscillation frequency, and underfrequency load-shedding threshold. Then, a sensitivity analysis is performed using the Sobol indices method and quasi-Monte Carlo simulations to identify the dominant uncertainties based on the event model. Here, the dominant uncertainties are compared to provide a guideline for the frequency estimation algorithm selection under different event cases. This algorithm is compared with an enhanced zero-crossing algorithm and gives a 3.41% better RoCoF error rate. Finally, an experiment is conducted using universal grid analyzers to validate the simulation results and the theoretical analysis.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation
Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.
59 BASIC BIOLOGICAL SCIENCES↗
Field Sensitivity Analysis of Turbulence Model Parameters for Flow Over a Wing
Reynolds-averaged-Navier-Stokes (RANS) turbulence models are a critical tool in computational-fluid-dynamics simulations of aerodynamic systems, but simulation results can be highly sensitive to RANS-model parameter choices. Sensitivity analysis can be used to quantify these impacts, and the objective of this study is to demonstrate field sensitivity analysis with respect to ten parameters in the 2003 Menter shear-stress-transport (SST) turbulence model. Here, the analysis is demonstrated for an application relevant to wind energy, namely, flow over a NACA 0015 wing at 12 degree angle of attack and a Reynolds number of 1.5 x 10 6 . We quantify sensitivity using Sobol indices and the mean-squared gradient, which are estimated using polynomial chaos and active subspace models, respectively. Our results indicate that there are substantial spatial variations in parameter sensitivities, with different sets of most-sensitive parameters near the wing, as well as in the downstream wake, consistent with the physical interpretations of the turbulence model inputs. We show that, for this particular turbulence model and flow, simultaneous dimension reduction is possible across all quantities of interest, enabling efficient exploration of model outcomes. Ultimately, this analysis provides new insights into turbulence model parameter sensitivities in incompressible flows, and also demonstrates the implementation of field sensitivity analysis for applications relevant to aerodynamics simulations.
17 WIND ENERGY↗
Sensitivity Analysis for the Component Design App: Analysis of Success Assured Data
A new tool has been developed to perform variance-based global sensitivity analysis (VBGSA) on data from a set-based concurrent engineering software called Success Assured (SA). The tool is part of a digital component design app, which is currently in production as an Accelerated Digital Engineering Pathfinder at Sandia National Laboratories. When working with complex digital models, it is important to understand relationships between inputs and outputs, i.e., how “sensitive” model outputs are to changes in model inputs. After extensive research and trials of various sensitivity analysis methods, it was determined that estimation of Sobol’ indices for VBGSA with Monte Carlo simulation, paired with simple surrogate models, produces the best results for SA data. This tool increases understanding of SA models and streamlines the creation of SA datasets. This report details the methodology and implementation of this sensitivity analysis tool so others can understand it and implement it.
97 MATHEMATICS AND COMPUTING↗