SEARCH · Engineering Papers

Results for “SENSITIVITY ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Uncertainty quantification in elastic constants of SiC f /SiC m tubular composites using global sensitivity analysis

Silicon carbide fiber and silicon carbide matrix (SiC f /SiC m ) tubes produced through the chemical vapor infiltration process have become a candidate cladding material in nuclear applications. The performance of this composite is influenced by many variables such as braiding angle, porosity, material properties, etc., which vary over a range of values due to the inherent fluctuations in the manufacturing process. In this study, the variability in elastic constants of SiC f /SiC m composite has been quantified through multiscale finite element (FE) simulations, variable screening, and high-fidelity surrogate modeling. The key variables dominantly affecting the elastic constants of SiC f /SiC m tubes were identified using global sensitivity analysis. A surrogate to the high-fidelity FE-based model was used in Monte Carlo simulations to generate a hundred thousand samples from which the uncertainty in elastic constants was assessed. It turned out that the coefficient of variation was less than 10%.

Materials Science↗

DOE OSTI2022

Challenges and Lessons Learned in Applying Sensitivity Analysis to Building Stock Energy Models

Uncertainty Analysis (UA) and Sensitivity Analysis (SA) offer essential tools to determine the limits of inference of a model and explore the factors which have the most effect on the model outputs. However, despite a well established body of work applying UA and SA to models of individual buildings, a review of the literature relating to energy models for larger groups of buildings undertaken by Fennell et al. (2019) highlighted very limited application at larger scales. This contribution describes the efforts undertaken by a group of research teams in the context of IEA-EBC Annex 70 working with a diverse set of Building Stock Models (BSMs) to apply global sensitivity analysis methods and compare their results. Since BSMs are a class of model defined by their output and coverage rather than their structure and inputs, they represent a diverse set of modelling approaches. Key challenges for the application of SA are identified and explored, including the influence of model form, input data types and model outputs. This study combines results from 7 different modelling teams, each using different models across a range of urban areas to explore these challenges and begin the process of developing standardised workflows for SA of BSMs.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

DOE OSTI2025

A Review and Comparison of Different Sensitivity Analysis Techniques in Practice

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question – How do sources of uncertainty or changes in the model inputs relate to uncertainty in the output? – different methods are associated with different assumptions, constraints, and required resources, leading to conclusions that may vary in interpretability and level of detail. Thus, it is crucial that the practitioner selects the desired sensitivity analysis method judiciously, making sure to match the selected approach to the specifics of their problem and to their desired objectives. In this chapter, we provide a practical overview of a collection of widely used, widely available sensitivity analysis methods. We focus on global sensitivity approaches, which seek to characterize how uncertainty in the model output may be allocated to sources of uncertainty in model inputs across the entire input space. Generally, this will require the practitioner to specify a probability distribution over the input space. On the other hand, methods for local sensitivity analysis do not require this specification but they have more limited utility, providing insight into sources of uncertainty associated only with a particular, specified location in the input space. Our hope is that this chapter may serve as a decision-making tool for practitioners, helping to guide the selection of a sensitivity analysis approach that will best fit their needs. To support this goal, we have selected a suite of approaches to cover, which, while not exhaustive, we believe provides a flexible and robust sensitivity analysis toolkit. All methods included are widely used and available in standard software packages.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Data and scripts associated with the manuscript "Using Mutual Information for Global Sensitivity Analysis on Watershed Modeling"

This package contains the data and scripts used in "Using Mutual Information for Global Sensitivity Analysis on Watershed Modeling" (Jiang et al., 2022). The ARW_SWAT.zip file contains the SWAT simulation and the sensitivity analysis result in the American River Watershed. The Portage_SWAT.zip file contains the SWAT simulation and the sensitivity analysis result in the Portage River Watershed. The src folder contains the source code of sensitivity analysis and plotting functions. The notebooks folder contains the Jupyter notebooks for performing sensitivity analysis and other post analyses.Global Sensitivity Analysis (GSA) often is applied to assess the sensitivity of model outputs to their inputs using ensemble simulations. However, increasing model complexity and the associated computational cost have limited the use of most GSA approaches for process-based watershed models. We propose to use Mutual Information (MI) as a computationally efficient GSA method for watershed modeling. Such MI computed from several hundred realizations usually can capture nonlinear relationships between inputs and outputs of interest. We perform MI-based watershed sensitivity analyses in studies of the Portage River Watershed in Ohio and the American River Watershed in Washington. In these studies, MI is used to evaluate the sensitivity of river discharges simulated by the Soil and Water Assessment Tool to no less than 20 parameters for each watershed. Our MI-based sensitivity analyses achieved convergence with about 300~500 realizations, a small fraction of the ensemble size (i.e., several thousand) required by the Sobol method. Nevertheless, MI yields similar sensitivity ranking compared to the Sobol method, especially for sensitive parameters. Our study thus sheds new light on the use of MI as an affordable GSA method for computationally intensive models such as the hyper-resolution, watershed hydrobiogeochemical models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Development of Decay Heat Sensitivity Analysis Capability in SCALE/ORIGEN

In this work, a decay heat sensitivity analysis capability was developed and implemented in the ORIGEN code of the SCALE nuclear modeling and simulation suite. This capability introduces improved numerical integration schemes, which overcome the challenges associated with accurately modeling the behavior of adjoint nuclide amounts during coarse time steps for both nuclide amount and decay heat sensitivity calculations. This capability significantly improves the accuracy of calculations without compromising computational efficiency compared to the existing method. Extensive verification was conducted for various benchmark problems, including a 238 Pu decay and an irradiation problem involving 135 Xe, evaluated with both coarse and fine time grids. The results show excellent agreement with reference direct perturbation solutions, reaffirming the computational accuracy of the newly proposed numerical integration methods. Furthermore, sensitivity analyses were performed for fission product inventories ( 147 Sm, 150 Sm, 155 Gd) in pressurized water reactor UO 2 and MOX fuel assemblies. These analyses demonstrated that the ORIGEN sensitivity analysis capability can capture detailed sensitivity coefficients and underlying physics in real applications. Additionally, a decay heat sensitivity analysis for high-assay low-enriched uranium fuel, including various initial 235 U enrichment and burnup points, highlights the extended capabilities of SCALE/ORIGEN in comprehensively assessing the factors influencing total decay heat. These advancements in ORIGEN offer valuable insights for reactor analysis, fuel design, and safety assessments, especially in the context of advanced nuclear fuel development and design changes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

A functional global sensitivity measure and efficient reliability sensitivity analysis with respect to statistical parameters

Sensitivity analysis and reliability assessment are two important aspects of structural and system safety. Epistemic uncertainty with respect to probabilistic model of input parameters due to lack of knowledge is present in many scarce-data applications and complicates the characterization of uncertainty in model response. In this article, we present two importance measures to evaluate the impact of distribution parameters on the probability distribution function (PDF) of the output and the failure probability. The epistemic uncertainty associated with the distribution parameters is modeled as random variables. Additionally, a modified extended polynomial chaos expansion (MEPCE) approach is introduced in which aleatory and epistemic random variables are modeled and propagated simultaneously while allowing the separate assessment for any single epistemic variable. A MEPCE-based kernel density estimation (KDE) construction provides a composite map from each epistemic variable to the response PDF. The functional global sensitivity index of the PDF with respect to the distribution parameters is thus derived, as a function of output, which is both more informative and more efficient than standard scalar sensitivity measures. Reliability sensitivity indices can be readily evaluated by integrating the global sensitivity index function over the failure zone. Three illustrative examples are used to demonstrate the proposed methodology.

42 ENGINEERING↗

DOE OSTI2024

Assessing convergence in global sensitivity analysis: a review of methods for assessing and monitoring convergence

In global sensitivity analysis (GSA) of a model, a proper convergence analysis of metrics is essential for ensuring a level of confidence or trustworthiness in sensitivity results obtained, yet is somewhat deficient in practice. The level of confidence in sensitivity measures, particularly in relation to their influence and support for decisions from scientific, social and policy perspectives, is heavily reliant on the convergence of GSA. We review the literature and summarize the available methods for monitoring and assessing convergence of sensitivity measures based on application purposes. The aim is to expose the various choices for convergence assessment and encourage further testing of available methods to clarify their level of robustness. Furthermore, the review identifies a pressing need for comparative studies on convergence assessment methods to establish a clear hierarchy of effectiveness and encourages the adoption of systematic approaches for enhanced robustness in sensitivity analysis.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Optimal PMU design based on sampling model and sensitivity analysis

The precise measurements of the synchrophasor and frequency from phasor measurement units (PMUs) are widely used in power grid applications. With the improvement of the technique, applications always require stable dynamic performance and higher accuracy for the synchrophasor and frequency measurements, which is challenging for PMU development. To evaluate the contribution of PMU hardware to measurement accuracy, this paper proposes a general-purpose sampling model to analyze the measurement error. In the proposed sampling model, a strict mathematical derivation is derived, where its error is purely determined by the parameters of the PMU hardware. The sensitivity analysis is carried out by three methods, including mathematical analysis, computer simulation, and variance-based sensitivity analysis. Through the sensitivity analysis, this paper establishes the systematic formulation and the inclusion of synchrophasor, frequency, and ROCOF. Experimental results based on the real-world testbench involving distribution-level PMUs match the mathematical analysis conclusion, which verifies the correctness of the general-purpose sampling model. Furthermore, a strategy for the optimal PMU design is proposed, which could guide PMU design in the future.

42 ENGINEERING↗

DOE OSTI2022

Neumann Series Based Voltage Sensitivity Analysis for Three Phase Distribution System

In this letter, a simplified voltage sensitivity analysis technique that can provide accurate estimates of voltage change across the network for a given change in bus power injections in a three-phase unbalanced distribution network is proposed. This technique is derived from the first-order approximation of the Neumann series, which allows maintaining the accuracy of the solution while the computational effort is reduced. Here, the proposed technique is tested on a 559-bus unbalanced distribution system with multiple distributed generation resources. The results show that the average error in the voltage estimates with the proposed method is not more than 0.3% with the execution time of similar order relative to the state-of-the-art sensitivity analysis methods.

42 ENGINEERING↗

DOE OSTI2024

Sensitivity Analysis for the Component Design App: Analysis of Success Assured Data

A new tool has been developed to perform variance-based global sensitivity analysis (VBGSA) on data from a set-based concurrent engineering software called Success Assured (SA). The tool is part of a digital component design app, which is currently in production as an Accelerated Digital Engineering Pathfinder at Sandia National Laboratories. When working with complex digital models, it is important to understand relationships between inputs and outputs, i.e., how “sensitive” model outputs are to changes in model inputs. After extensive research and trials of various sensitivity analysis methods, it was determined that estimation of Sobol’ indices for VBGSA with Monte Carlo simulation, paired with simple surrogate models, produces the best results for SA data. This tool increases understanding of SA models and streamlines the creation of SA datasets. This report details the methodology and implementation of this sensitivity analysis tool so others can understand it and implement it.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Sensitivity analysis of small modular reactor mPower with ATHLET

Small modular reactor (SMR) possesses the characteristics of less radioactive source term, simpler structure, modular design and features like passive safety as well as low risk of proliferation. Developed and designed by Babcock and Wilcox, the mPower reactor is one of pronouncing small modular reactors that adopts the integrated design of the pressurized water reactor, steam generator and a built-in internal control rod drive mechanism. In this paper, the code ATHLET (Analysis of fossil-hydraulics of Leaks and Transients) is used to model the mPower reactor. At the same time, the sensitivity analysis of the core structure and geometric parameters of the pipeline loop, as well as the steady-state simulation and post-exothermic simulation are carried out depending on the given scenarios. In addition, the sensitivity analysis of pressure, temperature and mass flow in the secondary loop is performed. The results of this study will mitigate some of the frequent misunderstanding in the field and will help to better understand the design of SMR and provide basic research data for further research. However, there are limitations in the current research. Considering that the mPower is still in the conceptual design, the established model is only based on the limited public data while detailed parameters are still in myth, which leads to certain level of uncertainties in the calculation. Besides, the research is mainly on the influence of sensitivity analysis under steady state conditions. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Uncertainty quantification and sensitivity analysis of a nuclear thermal propulsion reactor startup sequence

The research presented in this article describes progress in applying stochastic methods, uncertainty quantification, parametric studies, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated via the radiation transport code Griffin to simulate neutronics. Our goal is to develop a reduced-order (surrogate) model that can be rapidly sampled with perturbations to multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums (CDs), which is itself controlled by a hybrid proportional-integral-derivative (PID) controller actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time [Λ] and effective delayed neutron fraction [ β eff ] from a transient Griffin simulation executed via Griffin’s improved quasi-static solver to provide the kinetic parameters) as inputs to functions that control the CD rotation angle. By investigating numerous stochastic approaches, we developed a dual-purpose surrogate model of the NTP system, using polynomial regression in the Multiphysics Object-Oriented Simulation Environment (MOOSE) Stochastic Tools Module (STM). The trained model can be rapidly sampled while simultaneously perturbing various input parameters, such as coefficients on the PID control or temperature (directly affecting the neutron cross section). The surrogate model delivers accurate (within 5%) results at speeds orders of magnitude faster (minutes, not days of computational time) than the base model. Once the surrogate model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs as well as the effects of these inputs on the model output. For example, coefficients used in the PID control system may vary due to some type of physical interference, or uncertainty may exist in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters, and operational boundaries can be determined. The goal of this work is to support development of an advanced control system for operating CDs in a functioning NTP system. This work is a scoping study of the MOOSE STM.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2022

Preliminary Sensitivity Analysis for Sensors Impacts on Building Control Performance

This report describes the preliminary sensitivity analysis for sensor impacts on building control performance through the US Department of Energy’s Oak Ridge National Laboratory’s Flexible Research Platform (FRP-2) building. The rooftop unit system provides cooling and heating to the building. The main heating coil is a gas heating coil. Each zone is served by a variable air volume box with an electricity reheat coil. The rooftop unit and variable air volume box controls adopted the practical control sequences from ASHRAE Guideline 36-2018: High-Performance Sequences of Operation. For sensors, the incipient (time-changing) sensor errors, including bias sensor error and precision sensor error, are the inputs of interest. The outputs are energy consumption and thermal comfort (e.g., the predicted percentage of dissatisfied occupants). The large-scale simulation (3,600 cases) was conducted on a cloud platform by integrating sensor errors and ASHRAE Guideline 36 control sequences into an emulator based on the EnergyPlus simulation program with Python energy management system feature. The surrogate models were developed based on cloud simulation results. The uncertainty analysis showed that the sensor errors substantially affect building energy consumption and thermal comfort. The sensitivity analysis shows a ranking of sensor error impacts for each interested output item (e.g., cooling energy, reheat coil heating energy, predicted percentage of dissatisfied occupants). In FY 2022, sensor locations, types, and costs will be evaluated. The field test in Oak Ridge National Laboratory’s Flexible Research Platform building regarding sensor impacts will also be performed. Finally, a comparative analysis will be conducted based on the field test results and emulator results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Non-Nuclear Advanced Controls Testbed Reactor Mockup

The research presented in this report describes our progress in applying stochastic methods and uncertainty quantification, parametric study, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated with Griffin, with the goal of developing a reduced order (surrogate) model which can be rapidly sampled while perturbing multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums, which are controlled by a hybrid proportional, integral and derivative (PID) controller, actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time and $\beta$ from a transient Griffin simulation executed with the improved quasi-static method to provide the kinetic parameters) as inputs to functions which control the CD rotation angle. Using a number of stochastic method approaches, we developed a dual purpose training-surrogate model of the NTP system using polynomial regression. The trained model can be rapidly sampled while simultaneously perturbing various input parameters of the model, such as coefficients on the PID control, or temperature (directly affect the neutron cross section). The surrogate model delivers accurate results orders-of-magnitude faster (minutes, not days) than the base model. Once the base model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs and their effect on the output. For example, coefficients used in the PID control system may vary due to some physical interference, or there may be uncertainty in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters and operational boundaries can be determined. The goal of this work is to support development of an advanced control system to operate CDs in a functioning NTP system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2025)

The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. This report describes specific activities in the Fiscal Year (FY) 2025 associated with the GDSA Uncertainty and Sensitivity Analysis Methods work package. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-25SN01030407) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2025) (M3SF-25SN010304072). This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-25SN01030408), the GDSA Repository Systems Analysis work package (SF-25SN01030409), and the GDSA PFLOTRAN Development work package (SF-25SN01030410). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF-24SN010304072.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

Field Sensitivity Analysis of Turbulence Model Parameters for Flow Over a Wing

Reynolds-averaged-Navier-Stokes (RANS) turbulence models are a critical tool in computational-fluid-dynamics simulations of aerodynamic systems, but simulation results can be highly sensitive to RANS-model parameter choices. Sensitivity analysis can be used to quantify these impacts, and the objective of this study is to demonstrate field sensitivity analysis with respect to ten parameters in the 2003 Menter shear-stress-transport (SST) turbulence model. Here, the analysis is demonstrated for an application relevant to wind energy, namely, flow over a NACA 0015 wing at 12 degree angle of attack and a Reynolds number of 1.5 x 10 6 . We quantify sensitivity using Sobol indices and the mean-squared gradient, which are estimated using polynomial chaos and active subspace models, respectively. Our results indicate that there are substantial spatial variations in parameter sensitivities, with different sets of most-sensitive parameters near the wing, as well as in the downstream wake, consistent with the physical interpretations of the turbulence model inputs. We show that, for this particular turbulence model and flow, simultaneous dimension reduction is possible across all quantities of interest, enabling efficient exploration of model outcomes. Ultimately, this analysis provides new insights into turbulence model parameter sensitivities in incompressible flows, and also demonstrates the implementation of field sensitivity analysis for applications relevant to aerodynamics simulations.

17 WIND ENERGY↗

DOE OSTI2022

Sensitivity Analysis of an Electrospray Dehumidification System

Electrically enhanced condensation achieved by an electrospray system can enhance dehumidification in HVAC applications if successfully scaled up. The first step towards scale-up is identifying critical design and operating parameters that significantly impact dehumidification for the electrospray system. Sensitivity analysis is one approach for identifying critical parameters. This paper presents a methodology that can efficiently perform quantitative sensitivity analysis on a computationally expensive high fidelity simulation model, which is a computational fluid dynamics (CFD) model of the electrospray system. The methodology employs surrogate modeling and Sobol sensitivity analysis. We estimate the main and total effect Sobol sensitivity indices of four operating parameters of the electrospray system. The results reveal that the most important parameter is the size of the sprayed droplets, followed by the volumetric flow rate of the bulk air and injected water in the system. The water injection velocity of the spray was found to have little to no impact on dehumidification.

Young, David↗

DOE OSTI2022

Sensitivity analysis applied to SiC failure probability in TRISO modeled with BISON

Here, a sensitivity analysis on the failure probability of the Silicon Carbide (SiC) layer in tristructural isotropic (TRISO) nuclear fuel during transient conditions predicted by the BISON fuel performance code is performed. The principal goal of the analysis is to understand the most important parameters dictating SiC failure behavior in BISON during Reactivity Initiated Accidents (RIAs). SiC brittle fracture probability is modeled using Weibull statistics. A total of seven inputs related to SiC failure has been selected for the analysis, including the Weibull statistics parameters, elastic moduli for SiC and Pyrolitic Carbon (PyC) and SiC stress-free temperature. A 1D TRISO BISON model has been established for various reactivity insertions performed at the Nuclear Safety Research Reactor (NSRR). The principal advantage associated with the 1D TRISO model developed in this work is its computational efficiency. The Sobol variance decomposition method is used, and the sensitivity indices are presented for eight different values of the energy deposition. The results show that the two most important parameters impacting the predicted SiC failure probability are the Weibull modulus and the characteristic stress, and a co-variance amongst these parameters is obtained for low reactivity insertions. An additional new finding of this work is that the relative importance of Weibull parameters depends on the energy deposition, and thus reactivity, regime. For low energy depositions, two parameters are of influence on SiC failure probability, while for high energy depositions only one parameter impacts failure probability results. Moreover, optimization of the Weibull modulus and characteristic stress is performed by minimizing the RMSE between BISON failure probability predictions and experimental failure fractions for each energy deposition. This work also demonstrates the validity of the NSRR tests BISON simulations and of the respective sensitivity analysis results as conservative, yet indicative for slower transients characterized by lower deposited energies. Such verification is achieved through the partial extension of the analysis to a group Control Rod Withdrawal reproduced from a previous study. Another novel result of this analysis is that no single set of Weibull parameters can reproduce all reactivity insertion experimental failure results, which is related to the intrinsic nature of SiC failure properties, and a new range for the parameters is proposed to produce a failure probability envelope that encompasses the experimental fractions. Additionaly, this work proposes a new approach for future failure analysis with BISON, consisting in the use of Weibull parameters ranges, rather than fixed sets, along with failure envelopes generation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗