Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parametric uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Characterizing How Meteorological Forcing Selection and Parameter Uncertainty Influence Community Land Model Version 5 Hydrological Applications in the United States

Despite the increasing use of large-scale Land Surface Models (LSMs) in predicting hydrological responses in extreme conditions, there's a critical gap in understanding the uncertainties in these predictions. This study addresses this gap through a detailed diagnostic evaluation of the uncertainties arising from meteorological forcing selection and model parametrization in hydrological simulations of the Community Land Model version 5 (CLM5). CLM5 is configured at a spatial scale of about 12-km to simulate runoff processes for 464 headwater watersheds, selected from the Catchment Attributes for Large-Sample Studies (CAMELS) dataset to be representative of physiographic and climatic gradients across the conterminous United States. For each watershed, CLM5 is driven by five commonly used gridded forcing datasets in combination with a large ensemble (> 1200) of key CLM5 hydrologic parameters. Our results suggest that uncertainty in CLM5 runoff simulations resulting from both forcing and parametric sources is markedly higher in arid regions, e.g., Great Plains and Midwest regions. Uncertainty in low flow is dominated by parametric uncertainty, while the selection of meteorological forcing contributes more dominantly to high flow and seasonal flows during fall and spring. Our analysis also demonstrates that the selection of forcing datasets and the metrics used to calibrate CLM5 significantly impact the model’s predictive accuracy in extreme event severity for both floods and droughts. Overall, the results from this study highlight the need to understand and account for forcing and parametric uncertainties in CLM5 simulations, particularly for hazard and risk assessments addressing hydrologic extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Uncertainty quantification of optical models in fission fragment deexcitation

Here, we take the first step towards incorporating compound nuclear observables at astrophysically relevant energies into the experimental evidence used to constrain optical models, by propagating the uncertainty in two global optical potentials, one phenomenological and one microscopic, to correlated fission observables using the Monte Carlo Hauser-Feshbach formalism. We compare to a wide range of historic and recent experimental fission measurements, and discuss in detail regions of disagreement. We find that the parametric optical model uncertainty in neutron-fragment correlated observables involving neutron energy is significant. On the other hand, we observe that other experimental features, particularly neutron-fragment correlations near the 132 Sn shell closure and the high energy component of neutron spectra, are unlikely to be explained by the optical potential, and will require further experimental and theoretical effort to explain.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Effects of Photovoltaic Module Materials and Design on Module Deformation Under Load

Quasi-static structural finite-element models of an aluminum-framed crystalline silicon photovoltaic module and a glass-glass thin-film module were constructed and validated against experimental measurements of deflection under uniform pressure loading. Specific practices in the computational representation of module assembly were identified as influential to matching experimental deflection observations. Additionally, parametric analyses using Latin hypercube sampling were performed to propagate input uncertainties related to module materials, dimensions, and tolerances into uncertainties in simulated deflection. Sensitivity analyses were performed on the uncertainty quantification datasets using linear correlation coefficients and variance-based sensitivity indices to elucidate key parameters influencing module deformation. Results identified edge tape and adhesive material properties as being strongly correlated to module deflection, suggesting that optimization of these materials could yield module stiffness gains at par with the conventionally structural parameters, such as glass thickness. This exercise verifies the applicability of finite-element models for accurately predicting mechanical behavior of solar modules and demonstrates a workflow for model-based parametric uncertainty quantification and sensitivity analysis. Finally, applications of this capability include the assessment of field environment loads, derivation of representative loading conditions for reduced-scale testing, and module design optimization, among others.

42 ENGINEERING↗
DOE OSTI2025

Effects of grain size and porosity on cladding failure in high-burnup UO 2 : A sensitivity and uncertainty study

Isotopic taggants are being studied to aid in the provenance assessment of nuclear materials. However, these taggants must be selected such that they do not adversely affect fuel performance during normal operation or accident scenarios. Taggants are known to affect the fuel’s grain size and porosity. In the work described in this paper, the BISON fuel performance code was used to assess the potential effects of taggants (i.e., grain size and porosity) on fuel rod behavior and cladding failure during a high-burnup, large-break loss-of-coolant accident. Here, 281 individual fuel rods from the same reactor core were modeled for a sensitivity study, a parametric study, and uncertainty quantification. The cladding failure predictions often exhibited stochastic behavior. After additional study, it was found that the cladding failure model is highly sensitive to residual error inherent to numerical approximation solvers. Some strategies to mitigate this sensitivity are discussed. The study found no relationship between known taggant effects and cladding failure status. However, taggants were found to affect the time and location of failure in certain rods. In conclusion, future work to continue investigating and validating these findings is briefly discussed.

Doped UO 2↗
DOE OSTI2026

Using PyBioNetFit to leverage qualitative and quantitative data in biological model parameterization and uncertainty quantification

Data generated in studies of cellular regulatory systems are often qualitative. For example, measurements of signaling readouts in the presence and absence of mutations may reveal a rank ordering of responses across conditions but not the precise extents of mutation-induced differences. Qualitative data are often ignored by mathematical modelers or are considered in an ad hoc manner, as in the study of Kocieniewski and Lipniacki (2013) [Phys Biol 10: 035006], which was focused on the roles of MEK isoforms in ERK activation. In this earlier study, model parameter values were tuned manually to obtain consistency with a combination of qualitative and quantitative data. This approach is not reproducible, nor does it provide insights into parametric or prediction uncertainties. Here, starting from the same data and the same ordinary differential equation (ODE) model structure, we generate formalized statements of qualitative observations, making these observations more reusable, and we improve the model parameterization procedure by applying a systematic and automated approach enabled by the software package PyBioNetFit. We also demonstrate uncertainty quantification (UQ), which was absent in the original study. Our results show that PyBioNetFit enables qualitative data to be leveraged, together with quantitative data, in parameterization of systems biology models and facilitates UQ. These capabilities are important for reliable estimation of model parameters and model analyses in studies of cellular regulatory systems and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

The implications of uncertain renewable resource potentials for global wind and solar electricity projections

Studies exploring long-term energy system transitions rely on resource cost-supply curves derived from estimates of renewable energy (RE) potentials to generate wind and solar power projections. However, estimates of RE potentials are characterized by large uncertainties stemming from methodological assumptions that vary across studies, including factors such as the suitability of land and the performance and configuration of technology. Based on a synthesis of modeling approaches and parameter values used in prior studies, we explore the implications of these uncertain assumptions for onshore wind and solar photovoltaic electricity generation projections globally using the Global Change Analysis Model. We show that variability in parametric assumptions related to land use (e.g. land suitability) are responsible for the most substantial uncertainty in both wind and solar generation projections. Additionally, assumptions about the average turbine installation density and turbine technology are responsible for substantial uncertainty in wind generation projections. Under scenarios that account for climate impacts on wind and solar energy, we find that these parametric uncertainties are far more significant than those emerging from differences in climate models and scenarios in a global assessment, but uncertainty surrounding climate impacts (across models and scenarios) have significant effects regionally, especially for wind. Our analysis suggests the need for studies focusing on long-term energy system transitions to account for this uncertainty.

14 SOLAR ENERGY↗
DOE OSTI2023

Performance assessment for climate intervention (PACI): preliminary application to a stratospheric aerosol injection scenario

As the prospect of exceeding global temperature targets set forth in the Paris Agreement becomes more likely, methods of climate intervention are increasingly being explored. With this increased interest there is a need for an assessment process to understand the range of impacts across different scenarios against a set of performance goals in order to support policy decisions. The methodology and tools developed for Performance Assessment (PA) for nuclear waste repositories shares many similarities with the needs and requirements for a framework for climate intervention. Using PA, we outline and test an evaluation framework for climate intervention, called Performance Assessment for Climate Intervention (PACI) with a focus on Stratospheric Aerosol Injection (SAI). We define a set of key technical components for the example PACI framework which include identifying performance goals, the extent of the system, and identifying which features, events, and processes are relevant and impactful to calculating model output for the system given the performance goals. Having identified a set of performance goals, the performance of the system, including uncertainty, can then be evaluated against these goals. Using the Geoengineering Large Ensemble (GLENS) scenario, we develop a set of performance goals for monthly temperature, precipitation, drought index, soil water, solar flux, and surface runoff. The assessment assumes that targets may be framed in the context of risk-risk via a risk ratio, or the ratio of the risk of exceeding the performance goal for the SAI scenario against the risk of exceeding the performance goal for the emissions scenario. From regional responses, across multiple climate variables, it is then possible to assess which pathway carries lower risk relative to the goals. The assessment is not comprehensive but rather a demonstration of the evaluation of an SAI scenario. Future work is needed to develop a more complete assessment that would provide additional simulations to cover parametric and aleatory uncertainty and enable a deeper understanding of impacts, informed scenario selection, and allow further refinements to the approach.

climate intervention↗
DOE OSTI2026

Contrasting Parametric Sensitivities in Two Global Vegetation Models Using Parameter Perturbation Ensembles

Uncertainty in land model projections remains high and the roles of parametric and structural uncertainty are difficult to disentangle. To compare parametric sensitivity across model structures we present two parameter perturbation ensembles using the Community Land Model (CLM) operating in satellite phenology mode. The ensembles contrast two vegetation modules: (a) the default CLM vegetation module and (b) the Functionally Assembled Terrestrial Ecosystem Simulator (CLM-FATES). We perturbed over 300 parameters and quantified their effects on biophysical fluxes globally and across biomes. Most parameters have minimal impact on biophysical fluxes, with only a few substantially influencing results. While both models exhibit similar parameter sensitivity for some fluxes, CLM-FATES shows larger spread in gross primary productivity (GPP), driven by strong sensitivity to carboxylation rate. CLM-FATES also shows a weaker GPP response to soil hydrology parameters and exhibits higher water use efficiency (WUE). Cross-model comparisons reveal similar sensitivities for some parameters (e.g., leaf dimension) but divergent responses to others (e.g., stomatal intercept), highlighting underlying structural differences. Differences in WUE and sensitivity to hydrology and stomatal conductance parameters underscore how model structure fundamentally alters parametric sensitivity. The data sets generated from these ensembles can be used to identify influential parameters and guide future calibration efforts.

Foster, A. C. [NSF National Center for Atmospheric↗
DOE OSTI2025

A Bottom-Up Cost Estimation Tool for Nuclear Microreactors

The rising interest in nuclear microreactors has highlighted the need for comprehensive technoeconomic assessments. However, the scarcity of publicly available designs and cost data has posed significant challenges. To address this issue, the Microreactor Optimization Using Simulation and Economics (MOUSE) tool is developed. MOUSE is a tool that integrates nuclear microreactor design with reactor economics. The design calculations encompass core simulations using the OpenMC Monte Carlo Particle Transport Code [romano2015], along with simplified balance of plant calculations. On the economic side, MOUSE provides detailed bottom-up cost estimates, calculating both the total capital cost and the levelized cost of energy for first-of-a-kind and nth-of-a-kind microreactors. The cost estimation correlations are developed using data from the MARVEL project and additional literature sources. MOUSE has released as an open-source tool on GitHub (MOUSE Tool). By combining design calculations with cost equations, MOUSE enables users to evaluate the impact of various technological consideration, advanced moderators, design changes, material/fuel changes, and geometry modifications—as well as economic parameters like interest rates and construction duration. This comprehensive framework can guide stakeholders towards technological solutions that enhance microreactor competitiveness. Additionally, powered by the WATTS toolkit [romano2022], MOUSE supports optimization studies, parametric analyses, and uncertainty calculations/propagation. Currently, preconceptual designs of three microreactor types are included in MOUSE: a liquid metal thermal microreactor (LTMR), gas cooled TRISO-fueled microreactor (GCMR) and heat-pipe TRISO fueled microreactor (HPMR). To showcase its ability, MOUSE was used to conduct detailed bottom-up cost estimates for the first of a kind (FOAK) and Nth of a kind (NOAK) of the following microreactors • A 20MWt LTMR that is built on the ongoing MARVEL demonstration at Idaho National Laboratory (INL) • A 15 MWt GCMR that was designed to be more representative of the typical commercial microreactor • A 7 MWt HPMR that was built on previous work (Choi 2024) The The reader should note that these three designs and corresponding cost estimates are examples to demonstrate the MOUSE capability. The designs are pre-conceptual, the reactor designs were not optimized, and the cost estimates were developed with incomplete information. Additionally, stakeholders might be interested in a variety of designs that may differ from the examples provided in this report. The MOUSE tool can also be used to study how design choices affect economics. To demonstrate its capability, MOUSE was used conduct parametric studies such as examining the economic impact of the reflector's material and thickness, the moderator's booster material and dimensions, fuel composition and enrichment, core size, and power level. Several insights were gained from these parametric studies.

Hanna, Botros↗
DOE OSTI2023

Closing in on Hydrologic Predictive Accuracy: Combining the Strengths of High-Fidelity and Physics-Agnostic Models

Applications of process-based models (PBM) for predictions are confounded by multiple uncertainties and computational burdens, resulting in appreciable errors. A novel modeling framework combining a high-fidelity PBM with surrogate and machine learning (ML) models is developed to tackle these challenges and applied for streamflow prediction. A surrogate model permits high computational efficiency of a PBM solution at a minimum loss of its accuracy. A novel probabilistic ML model partitions the PBM-surrogate prediction errors into reducible and irreducible types, quantifying their distributions that arise due to both explicitly perceived uncertainties (such as parametric) or those that are entirely hidden to the modeler (not included or unexpected). Using this approach, we demonstrate a substantial improvement of streamflow predictive accuracy for a case study urbanized watershed. Such a framework provides an efficient solution combining the strengths of high-fidelity and physics-agnostic models for a wide range of prediction problems in geosciences.

58 GEOSCIENCES↗
DOE OSTI2022

Need for advanced research reactors for the next-generation reactor physics, analysis tools, and technology

Full text of publication follows. There is an urgent need for design and deployment of advanced research and test reactors in support of design, licensing and operation of advanced power reactors and education of next generation nuclear workforce. Existing research reactors mostly were designed and constructed decades ago with the main objectives of training operators, performing reactor physics experiments, and educating nuclear engineers and scientists. There are already gaps and significant concern about future capabilities for the existing research reactor facilities to address modern instrumentation and/or flexible environments for: performing reactor physics studies for advanced designs which have significantly different core materials forms and compositions, reactor shapes and size; validation of advanced high-fidelity software; development of machine learning algorithms for enhancement of human-machine collaboration in support of reactor monitoring, operation and safeguards; and, effective education of the next-generation workforce. The authors will focus on the need for advanced research reactors to improve and validate fast and accurate simulation tools for high-fidelity modeling and analysis of nuclear reactors in support of their design, optimization, licensing, operation, and monitoring. In the past, simulation tools were limited to relatively coarse models using approximate methodologies that benefited from two main factors: i) allowance for large margins and tolerances; ii) ability to construct prototype (e.g., zero power) reactors for adjustment of approximate methodologies. The next generation reactors have to be designed mainly by using novel high-fidelity computational tools that are accurate and fast, and therefore can be used for parametric studies and uncertainty quantification. To sufficiently demonstrate the accuracy of these tools, advanced research reactors are needed. The authors argue the need for new computational paradigms such as the MRT (Multistage, Response- function Transport) methodology which has resulted in the development of the novel high-fidelity RAPID (Real-time Analysis for Particle-transport and In-situ Detection) code system. Such code systems have to be robust in modeling any complex system, and should be fast and accurate, henceforth their uncertainties can be quantified at reasonable costs. Again, advanced research reactors are needed for the validation of the fidelity and accuracy of new computational tools. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Report on Data Quality Required for Modeling an MSR

Calculations were performed to assess how uncertainties in molten salt property values impact the results of behavior models of molten salt reactor systems under steady-state conditions. The thermophysical and thermochemical properties of salt mixtures being considered for use in molten salt reactors are not yet well characterized and methods used to measure property values to molten salts are not yet well established. The limited property data for salts of interest that are available in the literature are inconsistent and unreliable. Many methods used to measure property values remain developmental in the sense that not all variables affecting measured values have been identified or controlled during the measurement and not all aspects of the measurements affecting data quality are calibrated. A prior report described the repeatability of measurements made at Argonne and the reproducibility of measurements made with the same salts at several institutions is being evaluated. There is significant uncertainty in measured property values due to instrumental limitations and the effects of contaminants in the salts used to make the measurements that impacts predictions of salt behavior in a reactor. Most salts of interest are multicomponent eutectic or near-eutectic mixtures and both uncertainty in the salt composition and uncertainty in measured values. Furthermore, the salt composition evolves over time due to the uptake of impurities from the atmosphere and corrosion of containment vessels. More significantly, fission products will accumulate during operation that change the salt compositions and property values. MSR developers need to understand how this uncertainty in the basic property data of the fuel will impact modeling predictions for normal reactor operation as well was in transient scenarios that will impact the safety basis. The calculations and analyses in this report address the impact of uncertainty in measured property values under steady-state conditions through a generalized parametric study. The pooled uncertainty from contributions by a number of factors were considered and quantified, including varying composition due to impurities and fission products, imprecision in the measured values, and uncontrolled aspects of the measurement. In this way, we can begin to gain an understanding of the magnitude of the impact uncertainty will have in modeling MSR systems.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Fantômas unconfined: global QCD fits with Bézier parameterizations

Fantômas is a C++ toolkit for exploring the parametrization dependence of parton distribution functions (PDFs) and other correlator functions in quantum chromodynamics (QCD). Fantômas facilitates the generation of adaptable polynomial parametrizations for PDFs, called metamorphs, to find best-fit PDF solutions and quantify the epistemic uncertainty associated with the parametrizations during their fitting. The method employs Bézier curves as universal approximators for a variety of PDF shapes. Integrated into the xFitter framework for the global QCD analysis, Fantômas provides a foundation for general models of PDFs, while reducing the computational time compared to the approaches utilizing traditional polynomial parametrizations as well as providing an interpretable alternative to neural-network-based models. This paper outlines the structure and practical usage of the Fantômas toolkit, including its inputs, outputs, and implementation within xFitter. It also provides a practical example of using Fantômas for uncertainty quantification as well as the combination of PDF fits into a single ensemble.

Bézier curves↗
DOE OSTI2025

Uncertainty Visualization of Critical Points of 2D Scalar Fields for Parametric and Nonparametric Probabilistic Models

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization and analysis of scalar fields. The uncertainty inherent in data (e.g., observational and experimental data, approximations in simulations, and compression), however, creates uncertainty regarding critical point positions. Uncertainty in critical point positions, therefore, cannot be ignored, given their impact on downstream data analysis tasks. Here, in this work, we study uncertainty in critical points as a function of uncertainty in data modeled with probability distributions. Although Monte Carlo (MC) sampling techniques have been used in prior studies to quantify critical point uncertainty, they are often expensive and are infrequently used in production-quality visualization software. We, therefore, propose a new end-to-end framework to address these challenges that comprises a threefold contribution. First, we derive the critical point uncertainty in closed form, which is more accurate and efficient than the conventional MC sampling methods. Specifically, we provide the closed-form and semianalytical (a mix of closed-form and MC methods) solutions for parametric (e.g., uniform, Epanechnikov) and nonparametric models (e.g., histograms) with finite support. Second, we accelerate critical point probability computations using a parallel implementation with the VTK-m library, which is platform portable. Finally, we demonstrate the integration of our implementation with the ParaView software system to demonstrate near-real-time results for real datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Requirements on the gain calibration for LiteBIRD polarisation data with blind component separation

The detection of primordial B modes of the cosmic microwave background (CMB) could provide information about the early stages of the Universe's evolution. The faintness of this signal requires exquisite calibration accuracy and control of instrumental systematic effects which otherwise could bias the measurements. In this work, we study the impact of an imperfect relative polarisation gain calibration on the recovered value of the tensor-to-scalar ratio r for the LiteBIRD experiment, through the application of the blind Needlet Internal Linear Combination (NILC) foreground-cleaning method. We derive requirements on the relative calibration accuracy of the overall polarisation gain (Δg ν ) for each LiteBIRD frequency channel. Our results show that minimum variance techniques, as NILC, are less sensitive to systematic gain calibration uncertainties compared to a parametric approach, if the latter is not equipped with a proper modelling of these instrumental effects. In this study, the most stringent requirements are found in the channels where the CMB signal is relatively brighter, with the tightest constraints at 166 GHz (Δg ν ≈ 0.16%). This differs from the outcome of an analogous analysis performed with a parametric method, where the tightest requirements are obtained for the foreground-dominated channels. Gain calibration uncertainties, corresponding to the derived requirements, are then simultaneously propagated into all frequency channels. By doing so, we find that the overall impact on estimated r is lower than the total gain systematic budget for LiteBIRD approximately by a factor 5, due to the correlations of the impacts of gain calibration uncertainties in different frequency channels. In order to decouple the systematic effect from the specific choice of the model, we derive the requirements assuming constant spectral parameters for the foreground emission. To assess the robustness of the obtained results against more realistic scenarios, we repeat the analysis assuming sky models of intermediate and high complexity. In these further cases, we adopt an optimised NILC pipeline, called the Multi-Clustering NILC (MC-NILC). We find that the impact of gain calibration uncertainties on r is lower than the LiteBIRD gain systematics budget for the intermediate-complexity sky model. For the high-complexity case, instead, it would be necessary to tighten the requirements by a factor 1.8.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗
DOE OSTI2023

Leverage Score Sampling for Parametric PDEs (Final Technical Report)

This final technical report summarizes the accomplishments of work performed under DOE Office of Science Award DE-SC0022266, which is titled “Leverage Score Sampling for Parametric PDEs”. The goal of the project was to extend methods from Randomized Numerical Linear Algebra (RandNLA) to tackle central computational challenges in model order reduction and uncertainty quantification (UQ) for parametric partial differential equations (PDEs). In particular, we sought to use importance sampling methods originally developed for RandNLA to develop sample efficient active learning algorithms for approximating high-dimensional scalar functions, e.g. by polynomials, Gaussian process models, and simple neural networks. Such methods can be immediately applied to developing surrogate models or to approximating quantity of interest (QoI) surfaces. In the context of PDEs, each sample used for learning equates to the solution of the differential equation for a particular set of parameters, so sample efficiency translates to improved computational efficiency for a variety of downstream tasks.

97 MATHEMATICS AND COMPUTING↗