Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity and Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Calibration of reactive burn and Jones-Wilkins-Lee parameters for simulations of a detonation-driven flow experiment with uncertainty quantification

Here, uncertainties in the explosive-specific parameters of the Jones-Wilkins-Lee (JWL) equation of state (EOS) are carefully considered in hydrodynamic simulations of an explosive experiment to minimize the error in the flow prediction. Experimental data of the leading shock position in the transverse direction over time serves as the prediction metric for quantifying simulation prediction error. The uncertainty quantification technique, global sensitivity analysis, is utilized to determine the JWL parameters to which the transverse shock propagation is most sensitive. A polynomial response surface (PRS) is constructed in the space of the most influential JWL parameters, and the point of minimum error between the experimental data and the PRS yields calibrated JWL parameters for the experimental flow. The simulation results following the parameter calibration show good agreement with the experimental data. It was found that two significant parameters, the heat release per unit mass of reactant Q and JWL model exponent R 1 are strongly related, which makes it difficult to identify accurate values.

36 MATERIALS SCIENCE↗
DOE OSTI2020

(U) Radiation Transport Sensitivity Capabilities Applicable to INRAD

Intrinsic radiation (INRAD) calculations involve calculating the neutron and gamma-ray source rate densities from given compositions and densities of materials and the subsequent transport of the neutrons and gamma rays to detectors that may be stood off or internal. Related problems deal with measures of subcritical multiplication, such as the k eff eigenvalue. Realistic estimates of the uncertainties in calculated INRAD results are desired. One approach to uncertainty quantification begins with sensitivity analysis. This report describes the present capabilities that XCP-7 can apply to compute sensitivities in INRAD problems and areas where work is needed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Towards verifiable cancer digital twins: tissue level modeling protocol for precision medicine

Cancer exhibits substantial heterogeneity, manifesting as distinct morphological and molecular variations across tumors, which frequently undermines the efficacy of conventional oncological treatments. Developments in multiomics and sequencing technologies have paved the way for unraveling this heterogeneity. Nevertheless, the complexity of the data gathered from these methods cannot be fully interpreted through multimodal data analysis alone. Mathematical modeling plays a crucial role in delineating the underlying mechanisms to explain sources of heterogeneity using patient-specific data. Intra-tumoral diversity necessitates the development of precision oncology therapies utilizing multiphysics, multiscale mathematical models for cancer. This review discusses recent advancements in computational methodologies for precision oncology, highlighting the potential of cancer digital twins to enhance patient-specific decision-making in clinical settings. We review computational efforts in building patient-informed cellular and tissue-level models for cancer and propose a computational framework that utilizes agent-based modeling as an effective conduit to integrate cancer systems models that encode signaling at the cellular scale with digital twin models that predict tissue-level response in a tumor microenvironment customized to patient information. Furthermore, we discuss machine learning approaches to building surrogates for these complex mathematical models. These surrogates can potentially be used to conduct sensitivity analysis, verification, validation, and uncertainty quantification, which is especially important for tumor studies due to their dynamic nature.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

A New Reflected Target Optical Assessment System: Stage 1 Development Results

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.

Kesseli, Devon (ORCID:0000000193113036)↗
DOE OSTI2022

Addressing Uncertainty in MultiSector Dynamics Research

MultiSector Dynamics (MSD) research explores the dynamics and co-evolutionary pathways of human and Earth systems and the emerging interdependent sectors of energy, water, agriculture, and transportation among others. The interactions between these sectors are central to MSD science, as they capture how processes and feedbacks across Earth, environmental, infrastructure, and societal systems shape transitions, socioeconomic risks, and the provision of services. By definition, MSD research requires deep integration across diverse scientific disciplines, ranging from the natural to the social sciences and engineering. All these disciplines apply a variety of numerical simulation models to study and understand their underlying systems of focus. The utility of these models hinges on the fidelity with which they represent the real systems and their ability to produce novel insights about systems and their interactions. The coupled human-natural systems typically represented are shaped by a multitude of interdependent human and natural processes which, when modeled, translate to highly complex, non-linear, interacting behaviors. This ever-increasing complexity massively expands the uncertainty space of a model and can be found in model inputs, processes and parameters. This is further amplified when several models are combined to answer multisectoral questions, as additional uncertainty regarding coupling relationships and interactions is introduced.

IM3, Uncertainty and Sensitivity Analysis, multise↗
DOE OSTI2022

Differential methods for assessing sensitivity in biological models

Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Stastically determined experimental uncertainties in photon Doppler velocimetry (PDV) measurements

Shock-ramp experiments place high demands on the precision, accuracy, and temporal resolution of transformed velocimetry signals. To minimize uncertainty after total propagation of a shockramp experiment, ideally multiple PDV traces are used. However, each trace has some uncertainty that is a function of the PDV system and analysis of the velocimetry data. In order to determine a reasonable experimental estimate of minimum uncertainty, we calculate observed uncertainties in as-fielded PDV systems using multiple channels to sample the velocity on each shot. We also calculate the uncertainty’s sensitivity to choice of analysis methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Sensitivity Analysis of Genome-Scale Metabolic Flux Prediction

TRIMER, Transcription Regulation Integrated with MEtabolic Regulation, is a genome-scale modeling pipeline targeting at metabolic engineering applications. Using TRIMER, regulated metabolic reactions can be effectively predicted by integrative modeling of metabolic reactions with a Transcription Factor (TF)-gene regulatory network (TRN), which is modeled via a Bayesian network (BN). In this paper, we focus on sensitivity analysis of metabolic flux prediction for uncertainty quantification of BN structures for TRN modeling in TRIMER. We propose a computational strategy to construct the uncertainty class of TRN models based on the inferred regulatory order uncertainty given transcriptomic expression data. With that, we analyze the prediction sensitivity of the TRIMER pipeline for the metabolite yields of interest. The obtained sensitivity analyses can guide Optimal Experimental Design (OED) to help acquire new data that can enhance TRN modeling and achieve specific metabolic engineering objectives, including metabolite yield alterations. Here we have performed small- and large-scale simulated experiments, demonstrating the effectiveness of our developed sensitivity analysis strategy for BN structure learning to quantify the edge importance in terms of metabolic flux prediction uncertainty reduction and its potential to effectively guide OED.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

A Review and Comparison of Different Sensitivity Analysis Techniques in Practice

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question – How do sources of uncertainty or changes in the model inputs relate to uncertainty in the output? – different methods are associated with different assumptions, constraints, and required resources, leading to conclusions that may vary in interpretability and level of detail. Thus, it is crucial that the practitioner selects the desired sensitivity analysis method judiciously, making sure to match the selected approach to the specifics of their problem and to their desired objectives. In this chapter, we provide a practical overview of a collection of widely used, widely available sensitivity analysis methods. We focus on global sensitivity approaches, which seek to characterize how uncertainty in the model output may be allocated to sources of uncertainty in model inputs across the entire input space. Generally, this will require the practitioner to specify a probability distribution over the input space. On the other hand, methods for local sensitivity analysis do not require this specification but they have more limited utility, providing insight into sources of uncertainty associated only with a particular, specified location in the input space. Our hope is that this chapter may serve as a decision-making tool for practitioners, helping to guide the selection of a sensitivity analysis approach that will best fit their needs. To support this goal, we have selected a suite of approaches to cover, which, while not exhaustive, we believe provides a flexible and robust sensitivity analysis toolkit. All methods included are widely used and available in standard software packages.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Uncertainty analysis of correlated parameters in automated reaction mechanism generation

Abstract Uncertainty analysis is a useful tool for inspecting and improving detailed kinetic mechanisms because it can identify the greatest sources of model output error. Owing to the very nonlinear relationship between kinetic and thermodynamic parameters and computed concentrations, model predictions can be extremely sensitive to uncertainties in some parameters while uncertainties in other parameters can be irrelevant. Error propagation becomes even more convoluted in automatically generated kinetic models, where input uncertainties are correlated through kinetic rate rules and thermodynamic group values. Local and global uncertainty analyses were implemented and used to analyze error propagation in Reaction Mechanism Generator (RMG), an open‐source software for generating kinetic models. A framework for automatically assigning parameter uncertainties to estimated thermodynamics and kinetics was created, enabling tracking of correlated uncertainties. Local first‐order uncertainty propagation was implemented using sensitivities computed natively within RMG. Global uncertainty analysis was implemented using adaptive Smolyak pseudospectral approximations as implemented in the MIT Uncertainty Quantification Library to efficiently compute and construct polynomial chaos expansions to approximate the dependence of outputs on a subset of uncertain inputs. Cantera was used as a backend for simulating the reactor system in the global analysis. Analyses were performed for a phenyldodecane pyrolysis model. Local and global methods demonstrated similar trends; however, many uncertainties were significantly overestimated by the local analysis. Both local and global analyses show that correlated uncertainties based on kinetic rate rules and thermochemical groups drastically reduce a model's degrees of freedom and have a large impact on the determination of the most influential input parameters. These results highlight the necessity of incorporating uncertainty analysis in the mechanism generation workflow.

Gao, Connie W.↗
DOE OSTI2020

Application of Neutron Multiplicity Counting Experiments to Optimal Cross-Section Adjustments

This paper presents the first application of model calibration to neutron multiplicity counting (NMC) experiments for cross-section optimization that is informed by adjoint-based sensitivity analysis (SA) and first-order uncertainty quantification (UQ). We summarize previous work on SA applied to NMC and describe notable modifications and additions. We give the procedure for first-order UQ and Bayesian-inference-based parameter estimation (PE). We then discuss model calibration applied to NMC of a 4.5-kg sphere of weapons-grade, alpha-phase plutonium metal (the BeRP ball) with the nPod neutron multiplicity counter. For the BeRP ball in bare and polyethylene-reflected configurations, we discuss the sensitivity of the first- and second-moment detector responses (i.e., first and second moments of the NMC distribution, respectively) to the cross sections. We describe the sources of uncertainty in the measured and simulated responses. Specifically, uncertainty in the measured responses is due to both random and systematic sources. Uncertainty in the simulated responses is due to the cross-section covariances. We describe in detail the adjustment to the cross sections and cross-section covariances due to the optimization. Due to the contribution of systematic uncertainties to the measured response uncertainties, the adjustment to the cross sections is similar in trend but larger in magnitude compared to that recommended by previous work. We compare the measured responses to responses simulated with nominal and optimized cross sections, demonstrating that the best-estimate cross sections produce simulations of NMC experiments that are more accurate with reduced uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Emulation of the calculations of final r -process abundance patterns with a neural network

This work explores the construction of a fast emulator for the calculation of the final pattern of nucleosynthesis in the rapid neutron capture process (the r-process). An emulator is built using a feed-forward artificial neural network (ANN). We train the ANN with nuclear data and relative abundance patterns. We take as input the β-decay half-lives and the one-neutron separation energy of the nuclei in the rare-earth region. The output is the final isotopic abundance pattern. In this work, we focus on the nuclear data and abundance patterns in the rare-earth region to reduce the dimension of the input and output space. We show that the ANN can capture the effect of the changes in the nuclear physics inputs on the final r-process abundance pattern in the adopted astrophysical conditions. We employ the deep ensemble method to quantify the prediction uncertainty of the neural network emulator. The emulator achieves a speed-up by a factor of about 20 000 in obtaining a final abundance pattern in the rare-earth region. The emulator may be utilized in statistical analyses such as uncertainty quantification, inverse problems, and sensitivity analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Model bias in simulating major chemical components of PM 2.5 in China

High concentrations of PM 2.5 (particulate matter with an aerodynamic diameter less than 2.5 µm) in China have caused severe visibility degradation. Accurate simulations of PM 2.5 and its chemical components are essential for evaluating the effectiveness of pollution control strategies and the health and climate impacts of air pollution. In this study, we compared the GEOS-Chem model simulations with comprehensive datasets for organic aerosol (OA), sulfate, nitrate, and ammonium in China. Model results are evaluated spatially and temporally against observations. The new OA scheme with a simplified secondary organic aerosol (SOA) parameterization significantly improves the OA simulations in polluted urban areas, highlighting the important contributions of anthropogenic SOA from semivolatile and intermediate-volatility organic compounds. The model underestimates sulfate and overestimates nitrate for most of the sites throughout the year. More significant underestimation of sulfate occurs in winter, while the overestimation of nitrate is extremely large in summer. The model is unable to capture some of the main features in the diurnal pattern of the PM 2.5 chemical components, suggesting inaccuracies in the presented processes. Potential model adjustments that may lead to a better representation of the boundary layer height, the precursor emissions, hydroxyl radical concentrations, the heterogeneous formation of sulfate and nitrate, and the wet deposition of nitric acid and nitrate have been tested in the sensitivity analysis. The results show that uncertainties in chemistry perhaps dominate the model biases. The proper implementation of heterogeneous sulfate formation and the good estimates of the concentrations of sulfur dioxide, hydroxyl radical, and aerosol liquid water are essential for the improvement of the sulfate simulation. The update of the heterogeneous uptake coefficient of nitrogen dioxide significantly reduces the modeled concentrations of nitrate. However, the large overestimation of nitrate concentrations remains in summer for all tested cases. The possible bias in the chemical production and the wet deposition of nitrate cannot fully explain the model overestimation of nitrate, suggesting issues related to the atmospheric removal of nitric acid and nitrate. A better understanding of the atmospheric nitrogen budget, in particular, the role of the photolysis of particulate nitrate, is needed for future model developments. Moreover, the results suggest that the remaining underestimation of OA in the model is associated with the underrepresented production of SOA.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Assessing the sensitivity of land-atmosphere coupling strength to boundary and surface layer parameters in the WRF model over Amazon

Modeling tools can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations, but subject to uncertainties associated with parameters in model physical parameterizations. Different sensitivity analysis (SA) approaches may lead to different conclusions about the underlying sensitivities. In this study, we quantify simulation uncertainties related to parameter perturbations, and use different approaches to conduct parameter SA on the WRF model pertaining to L-A coupling strength for simulations over the Amazon region. A total of twenty parameters from the Yonsei University (YSU) planetary boundary layer (PBL) and the revised MM5 surface layer (SL) schemes were selected in this analysis. Three different SA methods, the Morris One-at-A-Time (MOAT) method, the Multivariate Adaptive Regression Splines (MARS) method, and the Sobol’ method, were employed to analyze seven WRF-simulated variables and five L-A coupling metrics. Results show that 1) parameter perturbations cause large simulation uncertainties which are comparable to those in the observations; 2) three different SA methods give consistent L-A coupling strength outcomes; 3) six out of the twenty parameters contribute 80%–95% of the total variance in the metrics analyzed, and first-order effects dominate over interaction effects; 4) the twelve variables/metrics of interest show similar sensitivity patterns to the selected parameters, which is consistent across all the methods used. Physical mechanisms for how the sensitive parameters act in determining the L-A coupling strength and associated variables also are illustrated. Our results will help quantifying L-A coupling strength and establishing a basis for parameter calibration over the Amazon region.

Wang, Chen↗
DOE OSTI2022

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Verification of the sensitivity and uncertainty-based criticality safety validation techniques: ORNL’s SCALE case study

The use of sensitivity and uncertainty-based techniques has been well-developed in the neutronic community for criticality safety applications. Sensitivity techniques calculate the first-order relative variations in keff due to relative cross-section variations by isotope, reaction type, and incident neutron energy. The result is a vector of sensitivity coefficients which is folded with prior cross-section uncertainties to calculate the so-called similarity indices. Similarity indices are integral quantities which serve as useful mathematical measures for assessing the relevance of existing or new experiments to given application conditions, representing design systems for which the models are to be validated. Despite their importance for a wide range of validation activities, the peer-reviewed literature is non-existent on the development of rigorous verification analysis for their calculated values. Thus, this manuscript proposes a simple non-intrusive method to calculate similarity indices, serving as an independent verification tool for their evaluation. The manuscript derives the theoretical basis for the proposed verification analysis. Next, the verification analysis is applied to the ORNL’s SCALE code suite which employs adjoint-based methods to calculate similarity indices. Numerical experiments using a number of well-known benchmark experiments are employed to verify the calculation of the similarity indices.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗