Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity and Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Differential methods for assessing sensitivity in biological models

Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Stastically determined experimental uncertainties in photon Doppler velocimetry (PDV) measurements

Shock-ramp experiments place high demands on the precision, accuracy, and temporal resolution of transformed velocimetry signals. To minimize uncertainty after total propagation of a shockramp experiment, ideally multiple PDV traces are used. However, each trace has some uncertainty that is a function of the PDV system and analysis of the velocimetry data. In order to determine a reasonable experimental estimate of minimum uncertainty, we calculate observed uncertainties in as-fielded PDV systems using multiple channels to sample the velocity on each shot. We also calculate the uncertainty’s sensitivity to choice of analysis methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Sensitivity Analysis of Genome-Scale Metabolic Flux Prediction

TRIMER, Transcription Regulation Integrated with MEtabolic Regulation, is a genome-scale modeling pipeline targeting at metabolic engineering applications. Using TRIMER, regulated metabolic reactions can be effectively predicted by integrative modeling of metabolic reactions with a Transcription Factor (TF)-gene regulatory network (TRN), which is modeled via a Bayesian network (BN). In this paper, we focus on sensitivity analysis of metabolic flux prediction for uncertainty quantification of BN structures for TRN modeling in TRIMER. We propose a computational strategy to construct the uncertainty class of TRN models based on the inferred regulatory order uncertainty given transcriptomic expression data. With that, we analyze the prediction sensitivity of the TRIMER pipeline for the metabolite yields of interest. The obtained sensitivity analyses can guide Optimal Experimental Design (OED) to help acquire new data that can enhance TRN modeling and achieve specific metabolic engineering objectives, including metabolite yield alterations. Here we have performed small- and large-scale simulated experiments, demonstrating the effectiveness of our developed sensitivity analysis strategy for BN structure learning to quantify the edge importance in terms of metabolic flux prediction uncertainty reduction and its potential to effectively guide OED.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

A Review and Comparison of Different Sensitivity Analysis Techniques in Practice

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question – How do sources of uncertainty or changes in the model inputs relate to uncertainty in the output? – different methods are associated with different assumptions, constraints, and required resources, leading to conclusions that may vary in interpretability and level of detail. Thus, it is crucial that the practitioner selects the desired sensitivity analysis method judiciously, making sure to match the selected approach to the specifics of their problem and to their desired objectives. In this chapter, we provide a practical overview of a collection of widely used, widely available sensitivity analysis methods. We focus on global sensitivity approaches, which seek to characterize how uncertainty in the model output may be allocated to sources of uncertainty in model inputs across the entire input space. Generally, this will require the practitioner to specify a probability distribution over the input space. On the other hand, methods for local sensitivity analysis do not require this specification but they have more limited utility, providing insight into sources of uncertainty associated only with a particular, specified location in the input space. Our hope is that this chapter may serve as a decision-making tool for practitioners, helping to guide the selection of a sensitivity analysis approach that will best fit their needs. To support this goal, we have selected a suite of approaches to cover, which, while not exhaustive, we believe provides a flexible and robust sensitivity analysis toolkit. All methods included are widely used and available in standard software packages.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Uncertainty analysis of correlated parameters in automated reaction mechanism generation

Abstract Uncertainty analysis is a useful tool for inspecting and improving detailed kinetic mechanisms because it can identify the greatest sources of model output error. Owing to the very nonlinear relationship between kinetic and thermodynamic parameters and computed concentrations, model predictions can be extremely sensitive to uncertainties in some parameters while uncertainties in other parameters can be irrelevant. Error propagation becomes even more convoluted in automatically generated kinetic models, where input uncertainties are correlated through kinetic rate rules and thermodynamic group values. Local and global uncertainty analyses were implemented and used to analyze error propagation in Reaction Mechanism Generator (RMG), an open‐source software for generating kinetic models. A framework for automatically assigning parameter uncertainties to estimated thermodynamics and kinetics was created, enabling tracking of correlated uncertainties. Local first‐order uncertainty propagation was implemented using sensitivities computed natively within RMG. Global uncertainty analysis was implemented using adaptive Smolyak pseudospectral approximations as implemented in the MIT Uncertainty Quantification Library to efficiently compute and construct polynomial chaos expansions to approximate the dependence of outputs on a subset of uncertain inputs. Cantera was used as a backend for simulating the reactor system in the global analysis. Analyses were performed for a phenyldodecane pyrolysis model. Local and global methods demonstrated similar trends; however, many uncertainties were significantly overestimated by the local analysis. Both local and global analyses show that correlated uncertainties based on kinetic rate rules and thermochemical groups drastically reduce a model's degrees of freedom and have a large impact on the determination of the most influential input parameters. These results highlight the necessity of incorporating uncertainty analysis in the mechanism generation workflow.

Gao, Connie W.↗
DOE OSTI2020

Application of Neutron Multiplicity Counting Experiments to Optimal Cross-Section Adjustments

This paper presents the first application of model calibration to neutron multiplicity counting (NMC) experiments for cross-section optimization that is informed by adjoint-based sensitivity analysis (SA) and first-order uncertainty quantification (UQ). We summarize previous work on SA applied to NMC and describe notable modifications and additions. We give the procedure for first-order UQ and Bayesian-inference-based parameter estimation (PE). We then discuss model calibration applied to NMC of a 4.5-kg sphere of weapons-grade, alpha-phase plutonium metal (the BeRP ball) with the nPod neutron multiplicity counter. For the BeRP ball in bare and polyethylene-reflected configurations, we discuss the sensitivity of the first- and second-moment detector responses (i.e., first and second moments of the NMC distribution, respectively) to the cross sections. We describe the sources of uncertainty in the measured and simulated responses. Specifically, uncertainty in the measured responses is due to both random and systematic sources. Uncertainty in the simulated responses is due to the cross-section covariances. We describe in detail the adjustment to the cross sections and cross-section covariances due to the optimization. Due to the contribution of systematic uncertainties to the measured response uncertainties, the adjustment to the cross sections is similar in trend but larger in magnitude compared to that recommended by previous work. We compare the measured responses to responses simulated with nominal and optimized cross sections, demonstrating that the best-estimate cross sections produce simulations of NMC experiments that are more accurate with reduced uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Emulation of the calculations of final r -process abundance patterns with a neural network

This work explores the construction of a fast emulator for the calculation of the final pattern of nucleosynthesis in the rapid neutron capture process (the r-process). An emulator is built using a feed-forward artificial neural network (ANN). We train the ANN with nuclear data and relative abundance patterns. We take as input the β-decay half-lives and the one-neutron separation energy of the nuclei in the rare-earth region. The output is the final isotopic abundance pattern. In this work, we focus on the nuclear data and abundance patterns in the rare-earth region to reduce the dimension of the input and output space. We show that the ANN can capture the effect of the changes in the nuclear physics inputs on the final r-process abundance pattern in the adopted astrophysical conditions. We employ the deep ensemble method to quantify the prediction uncertainty of the neural network emulator. The emulator achieves a speed-up by a factor of about 20 000 in obtaining a final abundance pattern in the rare-earth region. The emulator may be utilized in statistical analyses such as uncertainty quantification, inverse problems, and sensitivity analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Model bias in simulating major chemical components of PM 2.5 in China

High concentrations of PM 2.5 (particulate matter with an aerodynamic diameter less than 2.5 µm) in China have caused severe visibility degradation. Accurate simulations of PM 2.5 and its chemical components are essential for evaluating the effectiveness of pollution control strategies and the health and climate impacts of air pollution. In this study, we compared the GEOS-Chem model simulations with comprehensive datasets for organic aerosol (OA), sulfate, nitrate, and ammonium in China. Model results are evaluated spatially and temporally against observations. The new OA scheme with a simplified secondary organic aerosol (SOA) parameterization significantly improves the OA simulations in polluted urban areas, highlighting the important contributions of anthropogenic SOA from semivolatile and intermediate-volatility organic compounds. The model underestimates sulfate and overestimates nitrate for most of the sites throughout the year. More significant underestimation of sulfate occurs in winter, while the overestimation of nitrate is extremely large in summer. The model is unable to capture some of the main features in the diurnal pattern of the PM 2.5 chemical components, suggesting inaccuracies in the presented processes. Potential model adjustments that may lead to a better representation of the boundary layer height, the precursor emissions, hydroxyl radical concentrations, the heterogeneous formation of sulfate and nitrate, and the wet deposition of nitric acid and nitrate have been tested in the sensitivity analysis. The results show that uncertainties in chemistry perhaps dominate the model biases. The proper implementation of heterogeneous sulfate formation and the good estimates of the concentrations of sulfur dioxide, hydroxyl radical, and aerosol liquid water are essential for the improvement of the sulfate simulation. The update of the heterogeneous uptake coefficient of nitrogen dioxide significantly reduces the modeled concentrations of nitrate. However, the large overestimation of nitrate concentrations remains in summer for all tested cases. The possible bias in the chemical production and the wet deposition of nitrate cannot fully explain the model overestimation of nitrate, suggesting issues related to the atmospheric removal of nitric acid and nitrate. A better understanding of the atmospheric nitrogen budget, in particular, the role of the photolysis of particulate nitrate, is needed for future model developments. Moreover, the results suggest that the remaining underestimation of OA in the model is associated with the underrepresented production of SOA.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1986

Senstitivity analysis of horizontal heat and vapor transfer coefficients for a cloud-topped marine boundary layer during cold-air outbreaks

The effects of external parameters on the surface heat and vapor fluxes into the marine atmospheric boundary layer (MABL) during cold-air outbreaks are investigated using the numerical model of Stage and Businger (1981a). These fluxes are nondimensionalized using the horizontal heat (g1) and vapor (g2) transfer coefficient method first suggested by Chou and Atlas (1982) and further formulated by Stage (1983a). In order to simplify the problem, the boundary layer is assumed to be well mixed and horizontally homogeneous, and to have linear shoreline soundings of equivalent potential temperature and mixing ratio. Modifications of initial surface flux estimates, time step limitation, and termination conditions are made to the MABL model to obtain accurate computations. The dependence of g1 and g2 in the cloud topped boundary layer on the external parameters (wind speed, divergence, sea surface temperature, radiative sky temperature, cloud top radiation cooling, and initial shoreline soundings of temperature, and mixing ratio) is studied by a sensitivity analysis, which shows that the uncertainties of horizontal transfer coefficients caused by changes in the parameters are reasonably small.

Chang, Y. V.↗
DOE OSTI2020

Assessing the sensitivity of land-atmosphere coupling strength to boundary and surface layer parameters in the WRF model over Amazon

Modeling tools can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations, but subject to uncertainties associated with parameters in model physical parameterizations. Different sensitivity analysis (SA) approaches may lead to different conclusions about the underlying sensitivities. In this study, we quantify simulation uncertainties related to parameter perturbations, and use different approaches to conduct parameter SA on the WRF model pertaining to L-A coupling strength for simulations over the Amazon region. A total of twenty parameters from the Yonsei University (YSU) planetary boundary layer (PBL) and the revised MM5 surface layer (SL) schemes were selected in this analysis. Three different SA methods, the Morris One-at-A-Time (MOAT) method, the Multivariate Adaptive Regression Splines (MARS) method, and the Sobol’ method, were employed to analyze seven WRF-simulated variables and five L-A coupling metrics. Results show that 1) parameter perturbations cause large simulation uncertainties which are comparable to those in the observations; 2) three different SA methods give consistent L-A coupling strength outcomes; 3) six out of the twenty parameters contribute 80%–95% of the total variance in the metrics analyzed, and first-order effects dominate over interaction effects; 4) the twelve variables/metrics of interest show similar sensitivity patterns to the selected parameters, which is consistent across all the methods used. Physical mechanisms for how the sensitive parameters act in determining the L-A coupling strength and associated variables also are illustrated. Our results will help quantifying L-A coupling strength and establishing a basis for parameter calibration over the Amazon region.

Wang, Chen↗
DOE OSTI2022

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2003

Calibration of Passive Microwave Polarimeters that Use Hybrid Coupler-Based Correlators

Four calibration algorithms are studied for microwave polarimeters that use hybrid coupler-based correlators: 1) conventional two-look of hot and cold sources, 2) three looks of hot and cold source combinations, 3) two-look with correlated source, and 4) four-look combining methods 2 and 3. The systematic errors are found to depend on the polarimeter component parameters and accuracy of calibration noise temperatures. A case study radiometer in four different remote sensing scenarios was considered in light of these results. Applications for Ocean surface salinity, Ocean surface winds, and soil moisture were found to be sensitive to different systematic errors. Finally, a standard uncertainty analysis was performed on the four-look calibration algorithm, which was found to be most sensitive to the correlated calibration source.

Piepmeier, J. R.↗
DOE OSTI2020

Verification of the sensitivity and uncertainty-based criticality safety validation techniques: ORNL’s SCALE case study

The use of sensitivity and uncertainty-based techniques has been well-developed in the neutronic community for criticality safety applications. Sensitivity techniques calculate the first-order relative variations in keff due to relative cross-section variations by isotope, reaction type, and incident neutron energy. The result is a vector of sensitivity coefficients which is folded with prior cross-section uncertainties to calculate the so-called similarity indices. Similarity indices are integral quantities which serve as useful mathematical measures for assessing the relevance of existing or new experiments to given application conditions, representing design systems for which the models are to be validated. Despite their importance for a wide range of validation activities, the peer-reviewed literature is non-existent on the development of rigorous verification analysis for their calculated values. Thus, this manuscript proposes a simple non-intrusive method to calculate similarity indices, serving as an independent verification tool for their evaluation. The manuscript derives the theoretical basis for the proposed verification analysis. Next, the verification analysis is applied to the ORNL’s SCALE code suite which employs adjoint-based methods to calculate similarity indices. Numerical experiments using a number of well-known benchmark experiments are employed to verify the calculation of the similarity indices.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1979

A sensitivity analysis of volcanic aerosol dispersion in the stratosphere

A computer sensitivity analysis was performed to determine the uncertainties involved in the calculation of volcanic aerosol dispersion in the stratosphere using a 2 dimensional model. The Fuego volcanic event of 1974 was used. Aerosol dispersion processes that were included are: transport, sedimentation, gas phase sulfur chemistry, and aerosol growth. Calculated uncertainties are established from variations in the stratospheric aerosol layer decay times at 37 latitude for each dispersion process. Model profiles are also compared with lidar measurements. Results of the computer study are quite sensitive (factor of 2) to the assumed volcanic aerosol source function and the large variations in the parameterized transport between 15 and 20 km at subtropical latitudes. Sedimentation effects are uncertain by up to a factor of 1.5 because of the lack of aerosol size distribution data. The aerosol chemistry and growth, assuming that the stated mechanisms are correct, are essentially complete in several months after the eruption and cannot explain the differences between measured and modeled results.

Butler, C. F.↗
DOE OSTI2024

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗
NASA NTRS1985

Development of a sensitivity analysis technique for multiloop flight control systems

This report presents the development and application of a sensitivity analysis technique for multiloop flight control systems. This analysis yields very useful information on the sensitivity of the relative-stability criteria of the control system, with variations or uncertainties in the system and controller elements. The sensitivity analysis technique developed is based on the computation of the singular values and singular-value gradients of a feedback-control system. The method is applicable to single-input/single-output as well as multiloop continuous-control systems. Application to sampled-data systems is also explored. The sensitivity analysis technique was applied to a continuous yaw/roll damper stability augmentation system of a typical business jet, and the results show that the analysis is very useful in determining the system elements which have the largest effect on the relative stability of the closed-loop system. As a secondary product of the research reported here, the relative stability criteria based on the concept of singular values were explored.

Vaillard, A. H.↗