Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty quantification (UQ)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Advancements on Multi-Fidelity Random Fourier Neural Networks: Application to Hurricane Modeling for Wind Energy

Multi-fidelity approaches are emerging as effective strategies in computational science to handle otherwise intractable tasks like Uncertainty Quantification (UQ), training of Machine Learning (ML) models, and optimization, for expensive high-fidelity applications in which the amount of available simulations or data is limited. The main idea is simple: large datasets generated for low-fidelity approximations of the problem at hand are fused with a much sparser dataset for the target (high-fidelity) system. In this paper, we build on our recent success in designing random Fourier Neural Networks (rFNNs) [1] to target problems arising in wind energy applications and in particular problems of interest for hurricane modeling. In this context, data for the high-fidelity models are limited and lower fidelity alternatives are needed. In this work, we introduce a novel multi-fidelity training approach for our rFNNs and demonstrate its use on a simple verification problem and on a hurricane modeling problem in which high-fidelity data are generated via Large-Eddy Simulations (LES), while low-fidelity data are given by a mesoscale model. Initial results demonstrate how the multi-fidelity training approach can improve the quality of the resulting surrogate.

Fourier Neural Networks↗

Using PyBioNetFit to leverage qualitative and quantitative data in biological model parameterization and uncertainty quantification

Data generated in studies of cellular regulatory systems are often qualitative. For example, measurements of signaling readouts in the presence and absence of mutations may reveal a rank ordering of responses across conditions but not the precise extents of mutation-induced differences. Qualitative data are often ignored by mathematical modelers or are considered in an ad hoc manner, as in the study of Kocieniewski and Lipniacki (2013) [Phys Biol 10: 035006], which was focused on the roles of MEK isoforms in ERK activation. In this earlier study, model parameter values were tuned manually to obtain consistency with a combination of qualitative and quantitative data. This approach is not reproducible, nor does it provide insights into parametric or prediction uncertainties. Here, starting from the same data and the same ordinary differential equation (ODE) model structure, we generate formalized statements of qualitative observations, making these observations more reusable, and we improve the model parameterization procedure by applying a systematic and automated approach enabled by the software package PyBioNetFit. We also demonstrate uncertainty quantification (UQ), which was absent in the original study. Our results show that PyBioNetFit enables qualitative data to be leveraged, together with quantitative data, in parameterization of systems biology models and facilitates UQ. These capabilities are important for reliable estimation of model parameters and model analyses in studies of cellular regulatory systems and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying Drivers of Methane Hydrobiogeochemistry in a Tidal River Floodplain System

The influence of coastal ecosystems on global greenhouse gas (GHG) budgets and their response to increasing inundation and salinization remains poorly constrained. In this study, we have integrated an uncertainty quantification (UQ) and ensemble machine learning (ML) framework to identify and rank the most influential processes, properties, and conditions controlling methane behavior in a freshwater floodplain responding to recently restored seawater inundation. Our unique multivariate, multiyear, and multi-site dataset comprises tidal creek and floodplain porewater observations encompassing water level, salinity, pH, temperature, dissolved oxygen (DO), dissolved organic carbon (DOC), total dissolved nitrogen (TDN), partial pressure of carbon dioxide (pCO 2 ), nitrous oxide (pN 2 O), methane (pCH 4 ), and the stable isotopic composition of methane (δ 13 CH 4 ). Additionally, we incorporated topographical data, soil porosity, hydraulic conductivity, and water retention parameters for UQ analysis using a previously developed 3D variably saturated flow and transport floodplain model for a physical mechanistic understanding of factors influencing groundwater levels and salinity and, therefore, CH 4 . Principal component analysis revealed that groundwater level and salinity are the most significant predictors of overall biogeochemical variability. The ensemble ML models and UQ analyses identified DO, water level, salinity, and temperature as the most influential factors for porewater methane levels and indicated that approximately 80% of the total variability in hourly water levels and around 60% of the total variability in hourly salinity can be explained by permeability, creek water level, and two van Genuchten water retention function parameters: the air-entry suction parameter α and the pore size distribution parameter m. These findings provide insights on the physicochemical factors in methane behavior in coastal ecosystems and their representation in local- to global-scale Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Producing High-fidelity Synthetic Population Ensembles at Scale

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the US via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. Our initial task involves creating ensembles for 17 US metropolitan areas, each consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system comprised of a research cloud, virtual containerization, GPU-enhanced functionality, and a dual API/CLI to interact with UrbanPop’s maturing Likeness Python ecosystem. We observe a reduction in theoretical execution time while maintaining high-fidelity approximations of residential totals by metropolitan area and the demographic characteristics of neighborhoods. We discuss expansion of our approach to produce synthetic population ensembles for the entire US, particularly plans to establish automated workflows for job orchestration to increase computational efficiency, as well as provide outlook for broadening applications of the ensembles.

Gaboardi, James [ORNL] (ORCID:0000000247766826)↗

Near Real-Time Probabilistic Damage Diagnosis Using Surrogate Modeling and High Performance Computing

This work investigates novel approaches to probabilistic damage diagnosis that utilize surrogate modeling and high performance computing (HPC) to achieve substantial computational speedup. Motivated by Digital Twin, a structural health management (SHM) paradigm that integrates vehicle-specific characteristics with continual in-situ damage diagnosis and prognosis, the methods studied herein yield near real-time damage assessments that could enable monitoring of a vehicle's health while it is operating (i.e. online SHM). High-fidelity modeling and uncertainty quantification (UQ), both critical to Digital Twin, are incorporated using finite element method simulations and Bayesian inference, respectively. The crux of the proposed Bayesian diagnosis methods, however, is the reformulation of the numerical sampling algorithms (e.g. Markov chain Monte Carlo) used to generate the resulting probabilistic damage estimates. To this end, three distinct methods are demonstrated for rapid sampling that utilize surrogate modeling and exploit various degrees of parallelism for leveraging HPC. The accuracy and computational efficiency of the methods are compared on the problem of strain-based crack identification in thin plates. While each approach has inherent problem-specific strengths and weaknesses, all approaches are shown to provide accurate probabilistic damage diagnoses and several orders of magnitude computational speedup relative to a baseline Bayesian diagnosis implementation.

Warner, James E.↗

Combined Error and Uncertainty Estimates for CFD Problems

Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?

Posteriori↗

BISON capability and validation for U3Si2, Cr2O3-doped UO2, FeCrAl, and Cr-coated Zircaloy ATF concepts

Development, implementation, and validation of material and behavior models for accident tolerant fuel (ATF) concepts in the BISON fuel performance code began in 2014 in response to the events that occurred at the Fukushima Daichii nuclear power plant in March 2011. Early on, the focus was on U3Si2 fuel and FeCrAl cladding as part of a high-impact problem through the Nuclear Energy and Advanced Model- ing Simulation program [1]. Then, developments for Cr2O3- doped UO2 fuel, as well as SiC-SiC and Cr-coated Zircaloy cladding began based upon industry interests. Near the end of fiscal year 2018 the Consortium for Advanced Simulation of Light Water Reactors took over further Accident Tolerant Fuel (ATF) work in BISON in support of Nuclear Regulatory Commission (NRC) engagement. Discussions with the NRC clarified their list of priority fuel and cladding concepts, which included Cr2O3-doped UO2 and U3Si2 fuels, as well as Cr-coated Zircaloy and FeCrAl claddings. Further, reports similar in form to NUREG/CR-7024 [2] that was developed for traditional light water reactor (LWR) materials, UO2 fuel with Zircaloy claddings were created for the priority fuel and cladding concepts. In this paper select details from the reports entitled "ATF material model development and validation for priority fuel concepts" [3] and "ATF material model development and validation for priority cladding concepts" [4] are presented. First, a brief overview of the available models and their associated uncertainty are provided for the priority fuel and cladding concepts. Then, for the concepts with experimental data, comparisons between simulation and experiment are shown taking into account forward uncertainty quantification (UQ) techniques. For the concepts without publicly available experimental data, parametric studies incorporating forward UQ are completed to verify claims made about the materials’ behavior.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in reference two. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized* data are perfect; 2. Normality: The prior and posterior PDF are normal; and 3. Linearity: The model is linear. In this work we outline how the framework in 1 could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in 1 to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implement- ing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS, and the stochastic method, respectively.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary Results for Uncertainty Quantification on Asymptotic Hydrogen Redistribution in a Prototypical Yttrium-Hydride Moderated Heat-Pipe-Cooled Microreactor

Yttrium hydride is one of the most promising materials for moderating nuclear microreactors. This is due to its high hydrogen concentration at high operating conditions, high value of thermal conductivity, and chemical stability. However, when subject to thermal and concentration spatial gradients, the hydrogen tends to migrate within the yttrium matrix, potentially leading to power swings and reactivity changes. This paper aims to present selected results concerning the sensitivity of the thermal and hydrogen redistribution response for a prototypical heat-pipe-cooled yttrium-hydride moderated microreactor to thermal properties uncertainty and selected design characteristics. To the best knowledge of the authors, this is the first study examining the impact of uncertainties on microreactor hydrogen redistribution response. To achieve this goal, Bison was used in conjunction with Dakota to create a framework able to perform Uncertainty Quantification (UQ) for the Simplified Microreactor Benchmark Assessment (SiMBA) problem.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Leverage Score Sampling for Parametric PDEs (Final Technical Report)

This final technical report summarizes the accomplishments of work performed under DOE Office of Science Award DE-SC0022266, which is titled “Leverage Score Sampling for Parametric PDEs”. The goal of the project was to extend methods from Randomized Numerical Linear Algebra (RandNLA) to tackle central computational challenges in model order reduction and uncertainty quantification (UQ) for parametric partial differential equations (PDEs). In particular, we sought to use importance sampling methods originally developed for RandNLA to develop sample efficient active learning algorithms for approximating high-dimensional scalar functions, e.g. by polynomials, Gaussian process models, and simple neural networks. Such methods can be immediately applied to developing surrogate models or to approximating quantity of interest (QoI) surfaces. In the context of PDEs, each sample used for learning equates to the solution of the differential equation for a particular set of parameters, so sample efficiency translates to improved computational efficiency for a variety of downstream tasks.

97 MATHEMATICS AND COMPUTING↗

Adaptive, Active Learning, and Multifidelity Monte Carlo Methods in the MOOSE Stochastic Tools Module

MOOSE is an open-source computational platform for constructing multi-physics models and executing them in a massively parallel fashion. It has a stochastic tools module (STM) for forward/inverse uncertainty quantification (UQ) and surrogate modeling. This presentation details some recent developments to the STM with respect to the implementation of adaptive, active learning, and multifidelity Monte Carlo methods for forward UQ of computational models. Specifically, the adaptive Monte Carlo methods include Markov Chain Monte Carlo (MCMC)-driven algorithms like adaptive importance sampling and parallelized subset simulation for statistical QoI estimation, rare events analysis, and stochastic gradient-free optimization. The active learning methods include Gaussian Process (GP) surrogates and their training via Adam optimization, design of acquisition functions, and integration with samplers like Monte Carlo, adaptive importance, and parallelized subset simulation. These active learning methods are also designed to work in a batch mode, wherein, the required calls to the full computational model are executed in parallel whenever a user-specified batch size is met. The multifidelity methods in STM are broadly divided into two categories: hierarchical, where a defined hierarchy exists among the low-fidelity models, and peer, where all the low-fidelity models are treated equally. A GP surrogate is used to learn the differences between the low- and high-fidelity models in both multifidelity categories, and acquisition functions from the active learning classes are used to decide whether to rely on a low-fidelity model or call the expensive high-fidelity model. Alongside the software description and usage, applications are also presented to nuclear engineering computational models including a TRISO nuclear fuel particle, a reactor pressure vessel, and a heat-pipe microreactor.

97 MATHEMATICS AND COMPUTING↗

Numerical Uncertainty Quantification for Radiation Analysis Tools

Recently a new emphasis has been placed on engineering applications of space radiation analyses and thus a systematic effort of Verification, Validation and Uncertainty Quantification (VV&UQ) of the tools commonly used for radiation analysis for vehicle design and mission planning has begun. There are two sources of uncertainty in geometric discretization addressed in this paper that need to be quantified in order to understand the total uncertainty in estimating space radiation exposures. One source of uncertainty is in ray tracing, as the number of rays increase the associated uncertainty decreases, but the computational expense increases. Thus, a cost benefit analysis optimizing computational time versus uncertainty is needed and is addressed in this paper. The second source of uncertainty results from the interpolation over the dose vs. depth curves that is needed to determine the radiation exposure. The question, then, is what is the number of thicknesses that is needed to get an accurate result. So convergence testing is performed to quantify the uncertainty associated with interpolating over different shield thickness spatial grids.

Anderson, Brooke↗

Flow Characterization of the NASA Langley Unitary Plan Wind Tunnel, Test Section 2: Computational Results

This is an abstract for an invited paper at the AIAA Aviation Conference, June 2021. The work described here is part of an effort of coordinated experiments in the Unitary Plan Wind Tunnel (UPWT) facility at the NASA Langley Research Center (LaRC) and matching CFD simulations. The primary goal of the work is to assess the productivity and true predictive accuracy of CFD, absent any guidance from experiment, in the high supersonic speed range as compared to experiments performed at the NASA LaRC’s UPWT facility. This report concerns CFD simulation of the primary flow-path in the empty wind tunnel, including the settling chamber, nozzle, test section, and some of the tunnel downstream of the test section. The Mach number in the test section ranges from M~2.4 to M~4.6, and the required area ratio variation is achieved by translation of a nozzle block which constricts the area of a loosely S-shaped throat. Flow past protuberances in the settling chamber and into this S-bend throat are predicted by CFD to generate streamwise vorticity that may, or may not, persist through the throat and into the test section as coherent vortices. Some flow conditions are notably unsteady at frequencies well below those of turbulence, due to unsteady separated flow ahead of the nozzle block. The bulk flow moves at velocities ranging from 'walking speed' in the settling chamber to M~4.6 in the test section. Heat transfer to the settling chamber walls and buoyancy are significant at high Mach number. Subtle variations in surface curvature in the nozzle generate Mach waves that propagate into the test section. CFD of the empty tunnel serves two purposes. Firstly, the full-tunnel simulations are used to provide upstream boundary conditions for CFD of vehicle aerodynamics which are generally performed in a domain confined to the wind tunnel test section; these companion studies are addressed in other papers. Secondly, it is a challenging test for CFD to resolve all of the empty tunnel flow phenomena relevant to flow in the test section. It requires a more complete definition of geometry than was originally anticipated. In addition, it requires good spatial and temporal accuracy, and turbulence modeling that performs well on specific phenomena such as corner flows. The boundary conditions and solution algorithms must perform well from incompressible to almost hypersonic speeds. The final state of the pre-test CFD was a product of an iterative self-improvement process. The initial simulations of the empty tunnel were deficient in many respects, but hints to those deficiencies were recognized in the solutions, and remedies were implemented. Possible further improvements will be studied in the post-test phase when comparisons with experimental data are possible. The CFD was performed by five separate collaborative teams using four different flow solvers: FUN3D, Overflow, Star-CCM+ and USM3D. The level of effort of these teams varied significantly, but each made important contributions to the goals of the work. A concerted effort to use uncertainty quantification methods (UQ) in CFD is also a goal of this work. To this end, variations in CFD results due to grid refinement, turbulence modeling, and boundary conditions have been characterized. Code-to-code variation is another means of assessing CFD uncertainty. All CFD solvers predict similarity among the primary flow features; these include the variation of Mach number due to changes in Reynolds number, and the bulk flow angularity due to tunnel-wall curvature. All CFD solvers also predict similar trends in secondary flows, such as the downwash in the side-wall boundary layers. Three of the high-spatial resolution simulations give similar predictions of a complex secondary flow phenomena, streamwise vortices generated in the S-bend throat that persist into the side-wall boundary layers of the test section. Two of the highest-resolution simulations, run with the same turbulence model in different CFD solvers, gave encouragingly similar predictions of a complex tertiary flow phenomenon, small transient "sprites" of upwash flows, resulting from vortices that presumably originate in the separated flow near the leading edge of the nozzle block. While the CFD was done in a "blind pre-test" mode, requests from the experimental team for CFD results pertaining to unsteadiness and total temperature variations in the test section resulted in CFD runs that included a cooled wall in settling chamber. This then led to a change in the standard practice for running the Overflow results, which would not have occurred without this "release" of this experimental information. CFD was also used to guide some measurements. The paper will focus on establishing the consensus among CFD results and understanding differences among those results. Initial findings from the efforts to characterize CFD uncertainty have been done and will be included in the paper.

Robert Edward Childs↗

Sensitivity and Uncertainty Quantification of Transition Scenario Simulations

This report documents the first collective attempt at developing and applying capabilities to quantify uncertainties, assess parametric sensitivities, and optimize multiple parameters and metrics in fuel cycle simulations generated by the SA&I Campaign. To do this, external codes that were designed to perform sensitivity analysis and uncertainty quantification (SA&UQ) needed to be coupled to the SA&I Campaign’s nuclear fuel cycle simulators (NFCS). In FY20, two approaches were pursued: 1) coupling Cyclus to an ORNL-internal code called MOT (Metaheuristic Optimization Tool) and 2) coupling DYMOND to the opensource SA&UQ tool kit Dakota. The primary objective of having these NFCS/SA&UQ coupled capabilities is to better inform DOE-NE and other stakeholders on the results generated from the NFCS. For a given set of fuel cycle strategies, policies, and technology assumptions that make up a fuel cycle scenario, these NFCS have traditionally been used by the SA&I Campaign to provide quantitative answers in terms of year-by-year mass flows, infrastructure requirements, costs, etc. With these newly developed coupled capabilities, the SA&I Campaign can now efficiently simulate hundreds or thousands of these scenarios, sample large ranges of parameters and assumptions, and use the unique features of the SA&UQ tools to process the data. This enables providing answers with known and propagated uncertainties, determining the sensitivity of important metrics to different parameters and assumptions, quantifying how much fuel cycle and technology parameters impact each other, and producing optimized fuel cycle strategies for single and multiple variables. To demonstrate these new capabilities, the Cyclus/MOT was used to model several scenarios ranging from simple fleet retirements to transitions to advanced reactors. Specifically, for a transition scenario from LWRs to SFRs and advanced LWRs, uncertainty quantification, sensitivity analysis, and optimization studies were applied to cases involving single and multiple parameter (input) and single and multiple metric (output) variations. In addition, a similar transition scenario was modeled to demonstrate how to optimize the reprocessing capacity parameter to minimize two performance metrics while taking into account uncertainties from two other parameters. Lastly, a depletion module based on SCALE/ORIGEN was added in Cyclus to simulate the third scenario that was designed to quantify the impact of the modeling assumption that all LWR used nuclear fuel have the same burnup. The newly developed DYMOND/Dakota capability was also applied to a transition scenario from the existing fleet to small modular reactors and fast reactors. This particular scenario involves not only explicit isotopic depletion via ORIGEN-2, but also includes multirecycling and utilizing the criticality search feature to determine the fresh fuel composition of recycled fuel, a feature unique to the DYMOND NFCS. A large database of simulations were run with 4 main parameters that were sampled: start date of reprocessing, reprocessing capacity, energy demand growth rate, and advanced reactor share of the fleet. The 4 main metrics were uranium consumption, enrichment requirements, waste generation, and levelized cost of electricity using data from the Cost Basis Report. The demonstrated SA&UQ results include those that inform on how to choose parameters to avoid “failed” scenarios, Sobol’ indices that inform on the importance of various parameters individually and synergistically, and Analysis of Variance (ANOVA) studies that decompose parameter ranges into groups and informs on whether variations are statistically significant.

Feng, B.↗

Nuclear safety Enhanced: A Deep dive into current and future RAVEN applications

As the horizon of nuclear energy expands with the advent of small modular reactors, IV generation reactors, and fusion reactors, there is a growing perspective that the licensing process could benefit from a more comprehensive approach. Moving beyond traditional deterministic and PRA analysis might pave the way for a novel safety analysis paradigm propelled by the increasing computational power at our disposal. This paper explores different methodologies that can improve the outcomes of nuclear safety analysis. These range from uncertainty quantification techniques, aimed at enhancing the precision of safety margins, to deploying dynamic event trees by driving system code simulations, capturing the potential evolutions of severe accidents. These methodologies introduce innovative dimensions to safety analysis, considering the consequences of postulated events and the dynamics of accident sequences. However, they also bring forth challenges, especially in managing the complexity and sheer volume of potential scenarios. The paper touches upon some strategies to counter these challenges, emphasizing the importance of adaptability and continuous evolution in the face of emerging nuclear safety concerns. Additionally, the paper sheds light on the need for advanced tools to apply these methodologies. Among these tools is RAVEN, an open-source software designed for parametric and probabilistic analyses. Its core components, including distribution, sampler, and reduced order model, enable various applications, from risk assessment and mitigation to dynamic learning and plant control logic simulations.

97 - MATHEMATICS AND COMPUTING↗

Multifidelity uncertainty quantification with models based on dissimilar parameters

Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity models are well correlated. However, maintaining a high level of correlation can be challenging, especially when models depend on different input uncertain parameters, which drastically reduces the correlation. Existing MF UQ approaches do not adequately address this issue. In this work, we propose a new sampling strategy that exploits a shared space to improve the correlation among models with dissimilar parameterization. We achieve this by transforming the original coordinates onto an auxiliary manifold using the adaptive basis (AB) method (Tipireddy and Ghanem, 2014). The AB method has two main benefits: (1) it provides an effective tool to identify the low-dimensional manifold on which each model can be represented, and (2) it enables easy transformation of polynomial chaos representations from high- to low-dimensional spaces. This latter feature is used to identify a shared manifold among models without requiring additional evaluations. Here we present two algorithmic flavors of the new estimator to cover different analysis scenarios, including those with legacy and non-legacy high-fidelity (HF) data. We provide numerical results for analytical examples, a direct field acoustic test, and a finite element model of a nuclear fuel assembly. For all examples, we compare the proposed strategy against both single-fidelity and MF estimators based on the original model parameterization.

42 ENGINEERING↗

Global Sensitivity Analysis Using the Ultra‐Low Resolution Energy Exascale Earth System Model

Abstract For decades, Arctic temperatures have increased twice as fast as average global temperatures. As a first step toward quantifying parametric uncertainty in Arctic climate, we performed a variance‐based global sensitivity analysis (GSA) using a fully coupled, ultra‐low resolution (ULR) configuration of version 1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SMv1). Specifically, we quantified the sensitivity of six quantities of interests (QOIs), which characterize changes in Arctic climate over a 75 year period, to uncertainties in nine model parameters spanning the sea ice, atmosphere, and ocean components of E3SMv1. Sensitivity indices for each QOI were computed with a Gaussian process emulator using 139 random realizations of the random parameters and fixed preindustrial forcing. Uncertainties in the atmospheric parameters in the Cloud Layers Unified by Binormals (CLUBB) scheme were found to have the most impact on sea ice status and the larger Arctic climate. Our results demonstrate the importance of conducting sensitivity analyses with fully coupled climate models. The ULR configuration makes such studies computationally feasible today due to its low computational cost. When advances in computational power and modeling algorithms enable the tractable use of higher‐resolution models, our results will provide a baseline that can quantify the impact of model resolution on the accuracy of sensitivity indices. Moreover, the confidence intervals provided by our study, which we used to quantify the impact of the number of model evaluations on the accuracy of sensitivity estimates, have the potential to inform the computational resources needed for future sensitivity studies.

54 ENVIRONMENTAL SCIENCES↗