Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Quantifying Uncertainty in Ice Particle Velocity–Dimension Relationships Using MC3E Observations

Abstract Ice particle terminal fall velocity ( V t ) is fundamental for determining microphysical processes, yet remains extremely challenging to measure. Current theoretical best estimates of V t are functions of Reynolds number. The Reynolds number is related to the Best number, which is a function of ice particle mass, area ratio ( A r ), and maximum dimension ( D max ). These estimates are not conducive for use in most models since model parameterizations often take the form , where ( α , β ) depend on habit and D max . A previously developed framework is used to determine surfaces of equally plausible ( α , β ) coefficients whereby ice particle size/shape distributions are combined with V t best estimates to determine mass- ( V M ) or reflectivity-weighted ( V Z ) velocities that closely match parameterized V M ,SD or V Z ,SD calculated using the ( α , β ) coefficients using two approaches. The first uses surfaces of equally plausible ( a , b ) coefficients describing mass ( M )–dimension relationships (i.e., ) to calculate mass- or reflectivity-weighted velocity from size/shape distributions that are then used to determine ( α , β ) coefficients. The second investigates how uncertainties in A r , D max , and size distribution N ( D ) affect V M or V Z . For seven of nine flight legs flown on 20 and 23 May 2011 during the Mesoscale Continental Convective Clouds Experiment (MC3E), uncertainty from natural parameter variability—namely, the variability in ice particle parameters in similar meteorological conditions—exceeds uncertainties arising from different A r assumptions or D max estimates. The combined uncertainty between A r , D max , and N ( D ) produced smaller variability in ( α , β ) compared to varying M ( D ), demonstrating M ( D ) must be accurately quantified for model fall velocities. Primary sources of uncertainty vary considerably depending on environmental conditions. Significance Statement Ice particle fall velocity is fundamental for numerous processes within clouds, and hence is a critical property that must be accurately represented in weather and climate models. Using aircraft observations of ice particle shapes and sizes obtained in clouds behind midlatitude thunderstorms, this work develops a new framework for estimating ice particle fall velocities and their uncertainty, including quantifying the importance of different uncertainty sources from cloud microphysics measurements. Natural parameter variability contributes the most uncertainty in ice particle fall velocity estimates, although other sources can also be important contributors to uncertainty in certain conditions. Additional work examining ice particle data is needed to further understand how dependent uncertainty in certain ice particle properties are to local environmental conditions.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Insights into the vulnerability of Antarctic glaciers from the ISMIP6 ice sheet model ensemble and associated uncertainty

Abstract. The Antarctic Ice Sheet represents the largest source of uncertainty in future sea level rise projections, with a contribution to sea level by 2100 ranging from −5 to 43 cm of sea level equivalent under high carbon emission scenarios estimated by the recent Ice Sheet Model Intercomparison for CMIP6 (ISMIP6). ISMIP6 highlighted the different behaviors of the East and West Antarctic ice sheets, as well as the possible role of increased surface mass balance in offsetting the dynamic ice loss in response to changing oceanic conditions in ice shelf cavities. However, the detailed contribution of individual glaciers, as well as the partitioning of uncertainty associated with this ensemble, have not yet been investigated. Here, we analyze the ISMIP6 results for high carbon emission scenarios, focusing on key glaciers around the Antarctic Ice Sheet, and we quantify their projected dynamic mass loss, defined here as mass loss through increased ice discharge into the ocean in response to changing oceanic conditions. We highlight glaciers contributing the most to sea level rise, as well as their vulnerability to changes in oceanic conditions. We then investigate the different sources of uncertainty and their relative role in projections, for the entire continent and for key individual glaciers. We show that, in addition to Thwaites and Pine Island glaciers in West Antarctica, Totten and Moscow University glaciers in East Antarctica present comparable future dynamic mass loss and high sensitivity to ice shelf basal melt. The overall uncertainty in additional dynamic mass loss in response to changing oceanic conditions, compared to a scenario with constant oceanic conditions, is dominated by the choice of ice sheet model, accounting for 52 % of the total uncertainty of the Antarctic dynamic mass loss in 2100. Its relative role for the most dynamic glaciers varies between 14 % for MacAyeal and Whillans ice streams and 56 % for Pine Island Glacier at the end of the century. The uncertainty associated with the choice of climate model increases over time and reaches 13 % of the uncertainty by 2100 for the Antarctic Ice Sheet but varies between 4 % for Thwaites Glacier and 53 % for Whillans Ice Stream. The uncertainty associated with the ice–climate interaction, which captures different treatments of oceanic forcings such as the choice of melt parameterization, its calibration, and simulated ice shelf geometries, accounts for 22 % of the uncertainty at the ice sheet scale but reaches 36 % and 39 % for Institute Ice Stream and Thwaites Glacier, respectively, by 2100. Overall, this study helps inform future research by highlighting the sectors of the ice sheet most vulnerable to oceanic warming over the 21st century and by quantifying the main sources of uncertainty.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Propagating neutronic uncertainties for FFTF LOFWOS Test #13

The safety evaluation conducted for licensing a Sodium-cooled Fast Reactor (SFR) may require modeling transients with best-estimate calculation tools that must first be validated against real-world measurements. To provide the community with a valuable benchmarking opportunity for validating SFR analysis tools and methods, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13. The impact of nuclear data uncertainties on neutronics parameters was previously investigated based on the COMMARA-2.0 covariance matrix. Since the transient simulation results are very sensitive to certain reactivity coefficients, it was decided to employ rigorous uncertainty propagation methods to quantify the impact of nuclear data uncertainties on the best-estimate predication of FFTF LOFWOS Test #13. The DAKOTA code is used to propagate neutronic uncertainties through SAS4A/SASSYS-1 transient simulations, while taking into account spatial and reaction-wise correlations within these uncertainties. This study shows that the remaining discrepancies observed between the Argonne National Laboratory (ANL) best-estimate results and the experimental measurements can be partly explained by the uncertainty associated with Gas Expansion Module (GEM) worth, which contributes the majority of the overall nuclear data uncertainty on the output from the FFTF LOFWOS Test #13 transient simulation. This study also confirmed the importance of including spatial and reaction-wise correlations of nuclear data uncertainties on feedback coefficients in the uncertainty propagation to avoid under-estimating their impact during the transient simulations.

42 ENGINEERING↗
DOE OSTI2021

Assessing dynamic vegetation model parameter uncertainty across Alaskan arctic tundra plant communities

Abstract As the Arctic region moves into uncharted territory under a warming climate, it is important to refine the terrestrial biosphere models (TBMs) that help us understand and predict change. One fundamental uncertainty in TBMs relates to model parameters, configuration variables internal to the model whose value can be estimated from data. We incorporate a version of the Terrestrial Ecosystem Model (TEM) developed for arctic ecosystems into the Predictive Ecosystem Analyzer (PEcAn) framework. PEcAn treats model parameters as probability distributions, estimates parameters based on a synthesis of available field data, and then quantifies both model sensitivity and uncertainty to a given parameter or suite of parameters. We examined how variation in 21 parameters in the equation for gross primary production influenced model sensitivity and uncertainty in terms of two carbon fluxes (net primary productivity and heterotrophic respiration) and two carbon (C) pools (vegetation C and soil C). We set up different parameterizations of TEM across a range of tundra types (tussock tundra, heath tundra, wet sedge tundra, and shrub tundra) in northern Alaska, along a latitudinal transect extending from the coastal plain near Utqiaġvik to the southern foothills of the Brooks Range, to the Seward Peninsula. TEM was most sensitive to parameters related to the temperature regulation of photosynthesis. Model uncertainty was mostly due to parameters related to leaf area, temperature regulation of photosynthesis, and the stomatal responses to ambient light conditions. Our analysis also showed that sensitivity and uncertainty to a given parameter varied spatially. At some sites, model sensitivity and uncertainty tended to be connected to a wider range of parameters, underlining the importance of assessing tundra community processes across environmental gradients or geographic locations. Generally, across sites, the flux of net primary productivity (NPP) and pool of vegetation C had about equal uncertainty, while heterotrophic respiration had higher uncertainty than the pool of soil C. Our study illustrates the complexity inherent in evaluating parameter uncertainty across highly heterogeneous arctic tundra plant communities. It also provides a framework for iteratively testing how newly collected field data related to key parameters may result in more effective forecasting of Arctic change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Surrogate-driven design optimization with uncertainty constraints in Monte Carlo simulations

In multi-objective design tasks, the computational cost increases rapidly when high-fidelity simulations are used to evaluate objective functions. Surrogate models help mitigate this cost by approximating the simulation output, simplifying the design process. However, under high uncertainty, surrogate models trained on noisy data can produce inaccurate predictions, as their performance depends heavily on the quality of training data. This study investigates the impact of data uncertainty on two multi-objective design problems modelled using Monte Carlo transport simulations: a neutron moderator and an ion-to-neutron converter. For each, a grid search was performed using five different tally uncertainty levels to generate training data for neural network surrogate models. These models were then optimized using NSGA-III. The recovered Pareto-fronts were analyzed across uncertainty levels: in the moderator problem, normalized hypervolume dropped from 0.886 at 1.0% uncertainty to 0.748 at 10% uncertainty, while in the converter problem it remained near 0.50 for all cases. Average simulation times were also compared to evaluate the trade-off between accuracy and computational cost. Results show that the influence of simulation uncertainty is strongly problem-dependent. In the neutron moderator case, higher uncertainties led to exaggerated objective sensitivities and distorted Pareto-fronts, reducing normalized hypervolume. In contrast, the ion-to-neutron converter task was less affected—low-fidelity simulations produced results similar to those from high-fidelity data. These findings suggest that a fixed-fidelity approach is not optimal. Surrogate models can recover the Pareto-front under noisy conditions, and multi-fidelity studies help identify suitable uncertainty levels for each problem to balance efficiency and accuracy.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2022

Uncertainty in land carbon budget simulated by terrestrial biosphere models: the role of atmospheric forcing

Global estimates of the land carbon sink are often based on simulations by terrestrial biosphere models (TBMs). The use of a large number of models that differ in their underlying hypotheses, structure and parameters is one way to assess the uncertainty in the historical land carbon sink. Here we show that the atmospheric forcing datasets used to drive these TBMs represent a significant source of uncertainty that is currently not systematically accounted for in land carbon cycle evaluations. We present results from three TBMs each forced with three different historical atmospheric forcing reconstructions over the period 1850–2015. We perform an analysis of variance to quantify the relative uncertainty in carbon fluxes arising from the models themselves, atmospheric forcing, and model-forcing interactions. We find that atmospheric forcing in this set of simulations plays a dominant role on uncertainties in global gross primary productivity (GPP) (75% of variability) and autotrophic respiration (90%), and a significant but reduced role on net primary productivity and heterotrophic respiration (30%). Atmospheric forcing is the dominant driver (52%) of variability for the net ecosystem exchange flux, defined as the difference between GPP and respiration (both autotrophic and heterotrophic respiration). In contrast, for wildfire-driven carbon emissions model uncertainties dominate and, as a result, model uncertainties dominate for net ecosystem productivity. At regional scales, the contribution of atmospheric forcing to uncertainty shows a very heterogeneous pattern and is smaller on average than at the global scale. We find that this difference in the relative importance of forcing uncertainty between global and regional scales is related to large differences in regional model flux estimates, which partially offset each other when integrated globally, while the flux differences driven by forcing are mainly consistent across the world and therefore add up to a larger fractional contribution to global uncertainty.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Quantifying uncertainties due to optical potentials in one-neutron knockout reactions

One-neutron knockout reactions have been widely used to extract information about the single-particle structure of nuclei from the valley of stability to the drip lines. The interpretation of knockout data relies on reaction models, where the uncertainties are typically not accounted for. In this work, we quantify uncertainties of optical potentials used in these reaction models and propagate them, for the first time, to knockout observables using a Bayesian analysis. We study two reactions in the present paper, the first of which involves a loosely bound halo projectile, 11 Be, and the second a tightly bound projectile, 12 C. We first quantify the parametric uncertainties associated with phenomenological optical potentials. Complementing this approach, we also quantify the model uncertainties associated with the chiral forces that can be used to construct microscopic optical potentials. For the phenomenological study, we investigate the impact of the imaginary terms of the optical potential on the breakup and stripping components of the knockout cross sections as well as the impact of the angular range. For the 11 Be case, the theoretical uncertainty from the phenomenological method is on the order of the experimental uncertainty of the knockout observables; however, for the 12 C case, the theoretical uncertainty is significantly larger. Additionally, the widths of the uncertainty bands for the knockout observables obtained for the microscopic study and the phenomenological approach are of similar orders of magnitude. Based on this work we conclude that structure information inferred from the ratio of the knockout cross sections will carry a theoretical uncertainty of at least 20% for halo nuclei and at least 40% for tightly bound nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Quantifying Uncertainty in PV Energy Estimates Final Report

Uncertainty in PV energy estimates is "one of the most critical areas of lack of understanding" according to independent engineers, financiers, PV model developers, and other industry stakeholders. The primary problem is a lack of rigorous, transparent, widely accepted methods for quantifying uncertainty in energy production estimates. Uncertainty in energy production estimates arises from variability of the solar resource, inexact PV performance models and their parameters, and system reliability considerations. Uncertainty in annual energy production is frequently calculated for larger projects in order to quantify financial risk. Key statistics for energy, such as the P-values "P50" and "P90" (the annual energy values that are exceeded in future years with 50\% and 90\% probability, respectively) are used by financing institutions to calculate the repayment risk for the project. The current methods to estimate these statistics are typically proprietary, specialized, and involve significant post-processing of commercial performance model results. This black-box approach leads to inconsistent P-value estimates from different parties, which reduces investors' confidence in the results. Since the financial community bases its risk assessment on these estimates, reduced confidence increases perceived project risk, and consequently financing costs. The goal of this project was to establish a set of best practices for quantifying uncertainty in energy production estimates, including identifying what sources of uncertainty must be considered with clear definitions and metrics, determining which sources are the biggest drivers of uncertainty, and providing a computationally efficient framework for combining different sources of uncertainty that is flexible enough to accommodate substitutions of data or methods when better information is available. We engaged a wide set of stakeholders to ensure industry endorsement and adoption, and leveraged complementary projects investigating individual sources of uncertainty in great detail, as well as others' work that started down this path.

ENERGY PLANNING, POLICY, AND ECONOMY,SOLAR ENERGY↗
DOE OSTI2023

Massively Parallel Bayesian Model Calibration and Uncertainty Quantification with Applications to Nuclear Fuels and Materials

The U.S. Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. Fuel behavior in a nuclear reactor is governed by a complex network of mechanisms interacting with various other physics aspects in the reactor system. Any model developed to represent the fuel behavior will likely be idealized resulting in uncertainties in their predictions compared to the observed data. As such, this report was motivated by the need to identify the sources of uncertainties and quantify and propagate them through the fuel model outputs. Such quantification of uncertainties will establish a level of model trustworthiness, identify approaches to improve the model trustworthiness, and even guide optimal experiment design for maximal information gain. To accomplish the uncertainty quantification for computational models, this report has relied on the Bayesian framework which provides probabilistic treatment of models their inputs and outputs. The current state-of-the-art on performing Bayesian Uncertainty Quantification (UQ) for nuclear engineering models using High Performance Computing (HPC) resources have been reviewed. Implementation of capabilities for massively parallel Bayesian UQ in Multiphysics Object-Oriented Simulation Environment (MOOSE) is discussed. Several verification cases are discussed to verify the accuracy of the quantified uncertainties using the developed computational capabilities in MOOSE. Then, the problem of quantifying the uncertainties in TRI-Structural isOtropic (TRISO) fuel silver release is addressed. For the first time, the uncertainties arising from the TRISO Fission Gas Release (FGR) model due to model inadequacy and experimental noise are quantified. Also, the Bayesian capabilities are applied to the calibration of the MATPRO creep model, a widely used model in several fuel assessment cases. The impact of the prediction uncertainties in the MATPRO model on the fuel cladding behavior as part of the TRIBULATION assessment case (which is an integral effects case) is investigated. This report concludes with a discussion on the future work for the UQ for computational models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Characterizing and communicating uncertainty: lessons from NASA’s Carbon Monitoring System

Navigating uncertainty is a critical challenge in all fields of science, especially when translating knowledge into real-world policies or management decisions. However, the wide variance in concepts and definitions of uncertainty across scientific fields hinders effective communication. As a microcosm of diverse fields within Earth Science, NASA’s Carbon Monitoring System (CMS) provides a useful crucible in which to identify cross-cutting concepts of uncertainty. The CMS convened the Uncertainty Working Group (UWG), a group of specialists across disciplines, to evaluate and synthesize efforts to characterize uncertainty in CMS projects. This paper represents efforts by the UWG to build a heuristic framework designed to evaluate data products and communicate uncertainty to both scientific and non-scientific end users. We consider four pillars of uncertainty: origins, severity, stochasticity versus incomplete knowledge, and spatial and temporal autocorrelation. Using a common vocabulary and a generalized workflow, the framework introduces a graphical heuristic accompanied by a narrative, exemplified through contrasting case studies. Envisioned as a versatile tool, this framework provides clarity in reporting uncertainty, guiding users and tempering expectations. Beyond CMS, it stands as a simple yet powerful means to communicate uncertainty across diverse scientific communities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Uncertainty-Informed Volume Visualization using Implicit Neural Representation

The increasing adoption of Deep Neural Networks (DNNs) has led to their application in many challenging scientific visualization tasks. While advanced DNNs offer impressive generalization capabilities, understanding factors such as model prediction quality, robustness, and uncertainty is crucial. These insights can enable domain scientists to make informed decisions about their data. However, DNNs inherently lack ability to estimate prediction uncertainty, necessitating new research to construct robust uncertainty-aware visualization techniques tailored for various visualization tasks. In this work, we propose uncertainty-aware implicit neural representations to model scalar field data sets effectively and comprehensively study the efficacy and benefits of estimated uncertainty information for volume visualization tasks. We evaluate the effectiveness of two principled deep uncertainty estimation techniques: (1) Deep Ensemble and (2) Monte Carlo Dropout (MC-Dropout). These techniques enable uncertainty-informed volume visualization in scalar field data sets. Our extensive exploration across multiple data sets demonstrates that uncertainty-aware models produce informative volume visualization results. Moreover, integrating prediction uncertainty enhances the trustworthiness of our DNN model, making it suitable for robustly analyzing and visualizing real-world scientific volumetric data sets.

Saklani, Shanu↗
DOE OSTI2024

Influence of Local Water Vapor Analysis Uncertainty on Ensemble Forecasts of Tropical Cyclogenesis Using Hurricane Irma (2017) as a Testbed

Abstract Tropical cyclone formation is known to require abundant water vapor in the lower to middle troposphere within the incipient disturbance. In this study, we assess the impacts of local water vapor analysis uncertainty on the predictability of the formation of Hurricane Irma (2017). To this end, we reduce the magnitude of the incipient disturbance’s water vapor perturbations obtained from an ensemble-based data assimilation system that constrained moisture by assimilating all-sky infrared and microwave radiances. Five-day ensemble forecasts are initialized two days before genesis using each set of modified analysis perturbations. Growth of convective differences and intensity uncertainty are evaluated for each ensemble forecast. We observe that when initializing an ensemble forecast with only moisture uncertainty within the incipient disturbance, the resulting intensity uncertainty at every lead time exceeds half that of an ensemble containing initial perturbations to all variables throughout the domain. Although ensembles with different initial moisture uncertainty amplitudes reveal a similar pathway to genesis, uncertainty in genesis timing varies substantially across ensembles since moister members exhibit earlier spinup of the low-level vortex. These differences in genesis timing are traced back to the first 6–12 h of integration, when differences in the position and intensity of mesoscale convective systems across ensemble members develop more quickly with greater initial moisture uncertainty. In addition, the rapid growth of intensity uncertainty may be greatly modulated by the diurnal cycle. Ultimately, this study underscores the importance of targeting the incipient disturbance with high spatiotemporal water vapor observations for ingestion into data assimilation systems. Significance Statement Hurricanes form from clusters of thunderstorms that organize into a coherent system. One of the key ingredients for the formation process is an abundance of moisture. In this study, we test the sensitivity of hurricane formation to the initial moisture content in the vicinity of the cluster of thunderstorms that would become Hurricane Irma (2017). To do so, we initialize sets of forecasts each having a different variability of initial moisture content within the embryonic disturbance. Our results show that the predictability of hurricane formation is highly dependent on the uncertainty of the moisture content within the initial disturbance. Consequently, more high-quality observations of the moisture within the precursor disturbances to hurricanes are expected to improve forecasts of their formation.

Hartman, Christopher M.↗
DOE OSTI2021

Uncertainty Quantification of Geophysical Inversion Using Stochastic Partial Differential Equations (LDRD #218329)

This report summarizes work completed under the Laboratory Directed Research and Development (LDRD) project "Uncertainty Quantification of Geophysical Inversion Using Stochastic Differential Equations." Geophysical inversions often require computationally expensive algorithms to find even one solution, let alone propagating uncertainties through to the solution domain. The primary purpose of this project was to find more computationally efficient means to approximate solution uncertainty in geophysical inversions. We found multiple computationally efficient methods of propagating Earth model uncertainty into uncertainties in solutions of full waveform seismic moment tensor inversions. However, the optimum method of approximating the uncertainty in these seismic source solutions was to use the Karhunen-Love theorem with data misfit residuals. This method was orders of magnitude more computationally efficient than traditional Monte Carlo methods and yielded estimates of uncertainty that closely approximated those of Monte Carlo. We will summarize the various methods we evaluated for estimating uncertainty in seismic source inversions as well as work toward this goal in the realm of 3-D seismic tomographic inversion uncertainty.

58 GEOSCIENCES↗
DOE OSTI2026

On the Statistical Uncertainty of Monte Carlo-Calculated Scattering Sensitivities

Sensitivity coefficients calculated with Monte Carlo codes are widely used for nuclear data uncertainty quantification in the modeling and simulation of complex 3D reactor systems. This study systematically compares sensitivity coefficients and associated statistical uncertainties for the multiplication factor and fuel temperature reactivity across multiple Monte Carlo codes (SCALE/KENO, SCALE/Shift, MCNP, and Serpent) using simple models representing light-water reactors and advanced reactor concepts. For multiplication factor sensitivities, statistical uncertainties are generally acceptable, although scattering sensitivities show significantly larger statistical uncertainties than, for example, fission and capture reactions. Fuel temperature reactivity sensitivities show significantly larger statistical uncertainties across all reactions. Elastic scattering sensitivities are the most problematic: all Monte Carlo codes fail to resolve energy-dependent coefficients, and they produce dramatically different energy-collapsed values. Critically, the use of these sensitivity coefficients in nuclear data uncertainty propagation leads to reduced statistical uncertainties in individual uncertainty contributions. This can lead to the masking of unusable sensitivity coefficients and producing misleading uncertainty results. The findings of this study show that new or enhanced methods are needed to improve Monte Carlo elastic scattering sensitivity calculations. Additionally, this study shows the relevance of verifying sensitivity coefficients through direct perturbation calculations for individual nuclide reactions, instead of only for total cross sections as commonly done.

Bostelmann, Rike [ORNL] (ORCID:0000000165968088)↗
DOE OSTI2021

An uncertainty quantification method relevant to material test reactors

Within material test reactor calculations, energy dependent flux and reaction rate uncertainties are typically not quantified when performing as-run analyses to determine the neutron field experienced by the experiment. When high fidelity Monte-Carlo codes are used in such analyses, straight forward methods to calculate output uncertainties are not available, instead expert opinion is used to postulate computational uncertainties. New methods to propagate uncertainties through these high fidelity simulations are available when sufficient computational power is available. A tool is developed here for sampling any part of an MCNP input from random distributions to determine output uncertainties based on those inputs. Another tool is developed to sample nuclear data cross-section in ACE format using multi-group nuclear data covariances. The Total Monte-Carlo Method and Gesellschaft für Anlagen-und Reaktorsicherheit method (GRS) are implemented and compared to one another as well as MCNP sensitivity and uncertainty calculations. The methods were applied to the Godiva critical sphere k-eigenvalue, the UAM pin-cell benchmark energy dependent flux and reaction rates, and the Advanced Test Reactor energy dependent flux within an experimental location. Furthermore, the two methods agree well, with GRS allowing for an order of magnitude speedup for reaction rate uncertainty calculations and several orders of magnitude for eigenvalue uncertainty calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Development and application of two-step uncertainty propagation and sensitivity analysis methodology for fast reactor safety analysis

Uncertainty quantification (UQ) in nuclear reactors for transients is directly linked with safety assessment through the cross-sections uncertainties, provided as a covariance matrix, which are propagated through the reactor system to output of interest pertaining to reactor safety, such as peak temperatures in fuel/clad/coolant. Using a two-step approach, uncertainties are first quantified and propagated from basic input variables (such as reaction cross-sections) to intermediate quantities (such as reactivity feedback coefficients) through lattice level calculations. Uncertainties of intermediate quantities (from the first step) are then propagated through the system transient calculations, in the second step, to obtain uncertainties on reactor safety output parameters of interest. The scope of this work consists of Uncertainty Quantification & Propagation of nuclear data uncertainties that are highly correlated through unprotected transient overpower and unprotected loss of flow to assess their impact on core safety parameters. This two-step approach in the presence of covariance renders the sensitivity analysis very challenging. In fact, usually the sensitivity analysis is restricted to each step, which limits its application since the sensitivities between the system output quantities and the basic input variables are difficult to obtain. Here, in this work, we address this issue by proposing a simple, general methodology to combine the sensitivity indices obtained in each step by assuming the model behavior being linear. For the first step Generalized Perturbation theory based indices are used while in the second step the recently studied Johnson indices. The uncertainty quantification and sensitivity methodologies discussed here are demonstrated on a generic LFR design which is based on the 500 MWth demonstration Lead-cooled fast reactor (DLFR) using oxide fuel, developed by Westinghouse Electric Company (WEC).

42 - ENGINEERING↗
DOE OSTI2022

Network Uncertainty Quantification for Analysis of Multi-Component Systems

To impact physical mechanical system design decisions and realize the full promise of high-fidelity computational tools, simulation results must be integrated at the earliest stages of the design process. This is particularly challenging when dealing with uncertainty and optimizing for system-level performance metrics, as full-system models (often notoriously expensive and time-consuming to develop) are generally required to propagate uncertainties to system-level quantities of interest. Methods for propagating parameter and boundary condition uncertainty in networks of interconnected components hold promise for enabling design under uncertainty in real-world applications. These methods avoid the need for time consuming mesh generation of full-system geometries when changes are made to components or subassemblies. Additionally, they explicitly tie full-system model predictions to component/subassembly validation data which is valuable for qualification. These methods work by leveraging the fact that many engineered systems are inherently modular, being comprised of a hierarchy of components and subassemblies that are individually modified or replaced to define new system designs. By doing so, these methods enable rapid model development and the incorporation of uncertainty quantification earlier in the design process. The resulting formulation of the uncertainty propagation problem is iterative. We express the system model as a network of interconnected component models, which exchange solution information at component boundaries. We present a pair of approaches for propagating uncertainty in this type of decomposed system and provide implementations in the form of an open-source software library. We demonstrate these tools on a variety of applications and demonstrate the impact of problem-specific details on the performance and accuracy of the resulting UQ analysis. This work represents the most comprehensive investigation of these network uncertainty propagation methods to date.

42 ENGINEERING↗