SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

All sources NASA NTRS DOE OSTI

DOE OSTI2025

An entropy-based debiasing approach to quantifying experimental coverage for novel applications of interest in the nuclear community

This manuscript proposes a novel information-theoretic approach to the quantification of experimental relevance, i.e., coverage, to achieve optimal data assimilation results for nuclear engineering applications. Specifically, this work posits the need for a new metric, called coverage (q C ) of an application’s quantity of interest, i.e., eigenvalue or power peaking for an advanced reactor concept, defined herein as the theoretically maximum achievable reduction in the quantity’s uncertainty given measurements from a pool of experiments in a manner that is independent of the data assimilation procedure employed. Currently, reduction in a quantity’s uncertainty is strongly biased by the underlying assumptions of the assimilation procedure to account for the under-determined nature of such problems and the similarity criterion employed to identify relevant experiments. To address this challenge, this work has developed a coverage metric, q C , based on mutual information, which establishes a new conceptual framework for assessing coverage, one that is independent of the model parameters and responses degree of variations in both the experimental and application domains, i.e., linear vs non-linear, and their prior uncertainty distributions, i.e., Gaussian vs. non-Gaussian. The q C is an entropic measure capable of addressing coverage for general nonlinear problems with non-Gaussian uncertainties and inclusive of the measurement uncertainties from multiple experiments. Numerical experiments from manufactured analytical problems as well as a set of benchmarks from the ICSBEP handbook are employed to demonstrate its theoretical and practical performance as compared to the c k -based experiment selection methodology, commonly employed in the neutronic community. The manuscript then employs other well-known adaptations to existing data assimilation methodologies for nonlinear and non-Gaussian problems capable of achieving the coverage posited by q C .

Bayesian data assimilation↗

DOE OSTI2022

Quantification of the importance of the modeling fidelity in the Best Estimate Plus Uncertainty analysis

In this work, the multi-physics coupling of CTF-PARCS for both steady-state and transient simulations is evaluated focusing on the quantification of the importance of the modeling fidelity when applied to the Best Estimate Plus Uncertainty safety analysis. For the steady-state, a Picard iteration approach is adopted in the coupled code while for the transient an explicit approach has been developed as a first step. The CTF-PARCS coupling is applied to the REA at HFP BOC scenario proposed in the exercise I-2c of LWR-UAM benchmark Phase III. Two different modeling choices are investigated for the nominal calculations. The first consists of including the 3D burnup information in CTF, and the second of modeling the spacers grids in both PARCS and CTF. It is observed that due to the degradation of the fuel thermal conductivity, the 3D burnup inclusion in CTF leads to significant higher centerline temperatures than the base case, with a difference up to 300 K. The spacer grids modeling shows the expected power and temperature decrease in the axial positions of the spacer grids. For the uncertainty quantification study, the multi-physics modeling including the burnup information in CTF is used. The results show that the inserted reactivity has a relative standard deviation of 13.6% mainly attributed to the nuclear data. The maximum linear power has a relative standard deviation of 16.2% due to the nuclear data as well, while the maximum centerline temperature has a relative standard deviation of 3.5% primarily caused by the fuel thermal conductivity. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2020

Regulatory Decision-Making Process Using 'Weight of Evidence: An Evidence Integration Approach' by the State of Washington at the Hanford Site - 20163

Performance Assessment and Environmental Impact Statement Modeling, Human and Ecological Risk Assessments are the tools used by the Washington State Department of Ecology (Ecology) to make regulatory decisions for permitting and cleanup. These efforts all inherently have large amounts of uncertainty no matter how many alternative approaches are attempted. Professional feedback from tribal governments, stakeholders, federal and state regulators, the public and independent peer review groups are taken into account in this process of informed decision making. The process also includes full evaluation of the comments and the associated reviews made by the various peer review groups such as the Low -Level Waste Disposal Facility Federal Review Group (DOE order 435.1) and the Nuclear Regulatory Commission (NRC). The evolution of technology has produced quicker and more efficient fate and transport modeling tools with related quantification of uncertainties and their significance. Groundwater and vadose zone models have been expanded across the entire Hanford site. Many of the technical approaches identified in the Washington State Regulations are updated using current knowledge to better understand the complexities of the Hanford Site using the latest state of the art tools for risk assessment and modeling. More emphasis and time are directed on defining uncertainty and then managing the uncertainty. One added tool is to run sensitivity cases based on informed decision making. The weight of evidence approach considers all relevant information in an integrative assessment that takes into account the kinds of evidence available, the quality and quantity, the uncertainty and error associated with each type, and how they fit together. Evidence of integration involves looking at systematic reviews and evaluating their strengths and weaknesses. In conclusion, Ecology, Washington State's lead regulatory agency at the Hanford site, has had to modify its site closure approach compared to the rest of the state. A more holistic approach dealing with the Hanford site as an integrated system has evolved leading to a defensible informed approach for regulatory closure decisions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2025

Completion document for MRT 8824 - Upgrade NIF’s gaseous radiochemistry diagnostics (RAGS) to support weapons science

This milestone highlights the successful upgrade and deployment of the Radiochemical Analysis of Gaseous Samples (RAGS) system, which delivers high-quality measurements (<20% uncertainty) of activated gaseous species from NIF implosions. These measurements are critical for supporting Stockpile Stewardship Program (SSP) relevant platforms, including LANL’s Double Shell and LLNL’s Pushered Single Shell campaigns. The RAGS diagnostic technique enables analysis of short-range mixing in implosions using high-Z shells, which are otherwise inaccessible to conventional x-ray diagnostic methods. By facilitating the investigation of high-Z material mixing into fusion burn, this system provides essential data for quantifying and interpreting results in high-energy density (HED) experiments. This report details the physics motivation, diagnostic fundamentals, planned and enacted upgrade work, and the quantification of uncertainty for the upgraded system.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2021

A Confidence-Guided Technique for Tracking Time-Varying Features

Application scientists often employ feature tracking algorithms to capture the temporal evolution of various features in their simulation data. However, as the complexity of the scientific features is increasing with the advanced simulation modeling techniques, quantification of reliability of the feature tracking algorithms is becoming important. One of the desired requirements for any robust feature tracking algorithm is to estimate its confidence during each tracking step so that the results obtained can be interpreted without any ambiguity. To address this, we develop a confidence-guided feature tracking algorithm that allows reliable tracking of user-selected features and presents the tracking dynamics using a graph-based visualization along with the spatial visualization of the tracked feature. Here, the efficacy of the proposed method is demonstrated by applying it to two scientific datasets containing different types of time-varying features.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Iterative Workflow for Quantification and Minimization of Reduced Chemistry-Induced Uncertainties in Reacting Flow Simulation

Reduced chemistry models mitigate computational cost but introduce two sources of uncertainties in reacting flow simulation, including chemical information loss due to model reduction, and approximation errors due to non-optimal projection. We present an iterative workflow for quantification and minimization of reduced chemistry-induced uncertainties in reacting flow simulations.

chemistry↗

DOE OSTI2020

On‐site surrogates for large‐scale calibration

Abstract Motivated by a computer model calibration problem from the oil and gas industry, involving the design of a honeycomb seal, we develop a new Bayesian methodology to cope with limitations in the canonical apparatus stemming from several factors. We propose a new strategy of on‐site design and surrogate modeling for a computer simulator acting on a high‐dimensional input space that, although relatively speedy, is prone to numerical instabilities, missing data, and nonstationary dynamics. Our aim is to strike a balance between data‐faithful modeling and computational tractability in a calibration framework—tailoring the computer model to a limited field experiment. Situating our on‐site surrogates within the canonical calibration apparatus requires updates to that framework. We describe a novel yet intuitive Bayesian setup that carefully decomposes otherwise prohibitively large matrices by exploiting the sparse blockwise structure. Empirical illustrations demonstrate that this approach performs well on toy data and our motivating honeycomb example.

Huang, Jiangeng↗

DOE OSTI2022

Flood hazard model calibration using multiresolution model output

Riverine floods pose a considerable risk to many communities. Improving flood hazard projections has the potential to inform the design and implementation of flood risk management strategies. Current flood hazard projections are uncertain, especially due to uncertain model parameters. Calibration methods use observations to quantify model parameter uncertainty. With limited computational resources, researchers typically calibrate models using either relatively few expensive model runs at high spatial resolutions or many cheaper runs at lower spatial resolutions. This leads to an open question: is it possible to effectively combine information from the high and low resolution model runs? We propose a Bayesian emulation–calibration approach that assimilates model outputs and observations at multiple resolutions. As a case study for a riverine community in Pennsylvania, we demonstrate our approach using the LISFLOOD-FP flood hazard model. Here, the multiresolution approach results in improved parameter inference over the single resolution approach in multiple scenarios. Results vary based on the parameter values and the number of available models runs. Our method is general and can be used to calibrate other high dimensional computer models to improve projections.

multiresolution↗

DOE OSTI2022

Probabilistic constrained Bayesian inversion for transpiration cooling

Abstract To enable safe operations in applications such as rocket combustion chambers, the materials require cooling to avoid material damage. Here, transpiration cooling is a promising cooling technique. Numerous studies investigate possibilities to simulate and evaluate the complex cooling mechanism. One naturally arising question is the amount of coolant required to ensure a safe operation. To study this, we introduce an approach that determines the posterior probability distribution of the Reynolds number using an inverse problem and constraining the maximum temperature of the system under parameter uncertainties. Mathematically, this chance inequality constraint is dealt with by a generalized polynomial chaos expansion of the system. The posterior distribution will be evaluated by different Markov chain Monte Carlo based methods. A novel method for the constrained case is proposed and tested among others on two‐dimensional transpiration cooling models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Deficient precipitation sensitivity to Sahel land surface forcings among CMIP5 models

Abstract The overall performance of the simulated seasonal precipitation response to local terrestrial forcings, namely vegetation abundance and soil moisture, in the Sahel among the Coupled Model Intercomparison Project Phase Five (CMIP5) Earth System Models (ESMs) is systematically investigated and compared with its observational counterpart using a multivariate statistical method. The observed seasonal precipitation response is evaluated against a large ensemble of observational, reanalysis, and satellite data sets to provide quantification of uncertainties. The behaviour of models with and without a Dynamic Global Vegetation Model (DGVM) component is also explored, along with the mechanisms responsible for terrestrial feedback on rainfall. In general, the CMIP5 models can reasonably capture the seasonal evolution of Sahel precipitation and soil moisture, albeit with wet biases during the pre‐monsoon period and dry biases during the peak monsoon period. The non‐DGVM ESMs simulate comparable leaf area indices (LAIs) with observations, while DGVM‐enabled ESMs simulate too much year‐round LAI. The variance of precipitation that is attributed to oceanic forcings in CMIP5 is comparable with observations; however, the variance of precipitation that is attributed to terrestrial forcings is smaller in CMIP5 models than observed, especially for non‐DGVM ESMs. CMIP5 models, especially those without DGVMs, undervalue precipitation's observed response strength to soil moisture anomalies. In both observations and CMIP5 models, none of the atmospheric variables show significant responses to direct vegetation forcing, except for the response in transpiration. Although vegetation has minimal direct effect on the atmospheric state, it can affect the atmosphere by modifying soil moisture and transpiration rate indirectly, which helps explain the more realistic simulation of rainfall in DGVM‐enabled ESMs than non‐DGVM ESMs. Coupling of an ESM to a DGVM is critical in generating reasonable land–atmosphere feedback and examining future ecological and climatic changes over the Sahel.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗

DOE OSTI2024

Quantifying Epistemic Uncertainty in Binary Classification via Accuracy Gain

ABSTRACT Recently, a surge of interest has been given to quantifying epistemic uncertainty (EU), the reducible portion of uncertainty due to lack of data. We propose a novel EU estimator in the binary classification setting, as the posterior expected value of the empirical gain in accuracy between the current prediction and the optimal prediction. In order to validate the performance of our EU estimator, we introduce an experimental procedure where we take an existing dataset, remove a set of points, and compare the estimated EU with the observed change in accuracy. Through real and simulated data experiments, we demonstrate the effectiveness of our proposed EU estimator.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Quantifying sensitivity in numerical weather prediction-modeled offshore wind speeds through an ensemble modeling approach

A decade of research has shown that numerical weather prediction (NWP)-modeled wind speeds can be highly sensitive to the inputs and setups within the NWP model. For wind resource characterization applications, this sensitivity is often addressed by constructing a range of setups and selecting the one that best validates against observations. However, this approach is not possible in areas that lack high-quality hub height observations, especially offshore wind areas. In such cases, techniques to quantify and disseminate confidence in NWP-modeled wind speeds in the absence of observations are needed. We address this need in the present study and propose best practices for quantifying the spread in NWP-modeled wind speeds. We implement an ensemble approach in which we consider 24 different setups to the Weather Research and Forecasting (WRF) model. We construct the ensemble by considering variations in WRF version, WRF namelist, atmospheric forcing, and sea surface temperature (SST) forcing. Our analysis finds that the standard deviation produces more consistent estimates compared to the interquartile range and tends to be the more conservative estimator for ensemble variability. We further find that model spread increases closer to the surface and on shorter time scales. In conclusion, we explore methods to attribute total ensemble variability to the different ensemble components (e.g., atmospheric forcing and SST product) and find that contributions by components also vary depending on time scale. We anticipate that the methods and results presented in this paper will provide a reasonable foundation for further research into ensemble-based wind resource data sets.

17 WIND ENERGY↗

DOE OSTI2024

Assessing decision boundaries under uncertainty

In order to make design decisions, engineers may seek to identify regions of the design domain that are acceptable in a computationally efficient manner. A design is typically considered acceptable if its reliability with respect to parametric uncertainty exceeds the designer’s desired level of confidence. Despite major advancements in reliability estimation and in design classification via decision boundary estimation, the current literature still lacks a design classification strategy that incorporates parametric uncertainty and desired design confidence. To address this gap, this paper offers a novel interpretation of the acceptance region by defining the decision boundary as the hypersurface which isolates the designs that exceed a user-defined level of confidence given parametric uncertainty. This work addresses the construction of this novel decision boundary using computationally efficient algorithms that were developed for reliability analysis and decision boundary estimation. The approach proposed in this paper is verified on two physical examples from structural and thermal analysis using Support Vector Machines and Efficient Global Optimization-based contour estimation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Uncertainty Estimation and Anomaly Detection in Chiral Effective Field Theory Studies of Key Nuclear Electroweak Processes

Chiral effective field theory (χEFT) is a powerful tool for studying electroweak processes in nuclei. I discuss χEFT calculations of three key nuclear electroweak processes: primordial deuterium production, proton-proton fusion, and magnetic dipole excitations of 48 Ca. Further, this article showcases χEFT’s ability to quantify theory uncertainties at the appropriate level of rigor for addressing the different precision demands of these three processes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Estimating building occupancy: a machine learning system for day, night, and episodic events

Building occupancy research increasingly emphasizes understanding the social and physical dynamics of how people occupy space. Opportunities in the open source domain including social media, Volunteered Geographic Information, crowdsourcing, and sensor data have proliferated, resulting in the exploration of building occupancy dynamics at varying spatiotemporal scales. At Oak Ridge National Laboratory, research into building occupancies through the development of a global learning framework that accommodates exploitation of open source authoritative sources, including governmental census and surveys, journal articles, real estate databases, and more, to report national and subnational building occupancies across the world continues through the Population Density Tables (PDT) project. This probabilistic learning system accommodates expert knowledge, experience, and open-source data to capture local, socioeconomic, and cultural information about human activity. It does so through a systematic process of data harmonization techniques in the development of observation models for over 50 building types to dynamically update baseline estimates and report probabilistic diurnal and episodic building occupancy estimates. This discussion will explore how PDT is implemented at scale and expanded based on the development of observation model classes and will explain how to interpret and spatially apply the reported probability occupancy estimates and uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Interlaboratory Study of Digital Volume Correlation Error Due to X-Ray Computed Tomography Equipment and Scan Parameters: an Update from the DVC Challenge

Background: The quality of Digital Volume Correlation (DVC) full-field displacement measurements depends directly on the characteristics of the X-ray Computed Tomography (XCT) equipment, and scan procedures used to acquire the tomographic images. Objective: In this work, we seek to experimentally study the effects of XCT equipment and tomographic scan procedures on the quality of these images for DVC analysis, and to survey the level of DVC error that may be achieved using standard XCT operating procedures. Methods: Six participants in an interlaboratory study acquired high-quality XCT scans of a syntactic foam before and after rigid body motion. The resulting images were correlated using commercial DVC software to quantify error sources due to random image noise, reconstruction artifacts, as well as systematic spatial or temporal distortion. Results: In the absence of rigid body motion, the standard deviation of the displacement measurements ranged from 0.012 to 0.043 voxels using a moderate subvolume size, indicating that subvoxel measurement resolution could readily be achieved with a variety of XCT equipment and scan recipes. Comparison of consecutive scans without rigid body motion showed transient dilatational displacement gradients due to self-heating of the X-ray source and/or thermal expansion of the foam. Evaluation of the scans after rigid body motion showed significant, machine-specific spatial distortion in the displacement fields of up to 0.5 voxels; new approaches to remove this error need to be developed. Conclusions: Analysis of the scan protocols used in the interlaboratory study, as well as a complementary parametric sensitivity study, showed that the DVC error was strongly influenced by the XCT equipment, but could be mitigated by adjusting the total scan duration.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

A Bayesian Approach to the Eagar–Tsai Model for Melt Pool Geometry Prediction with Implications in Additive Manufacturing of Metals

Here, this paper focuses on improving the melt pool geometry predictions and quantifying uncertainties using an adapted version of the Eagar–Tsai (E–T) model that incorporates temperature-dependent properties of the material as well as powder conditions. Additionally, Bayesian inference is employed to predict distributions for the E–T model input parameters of laser absorptivity and powder bed porosity by incorporating experimental results into the analysis. Monte Carlo uncertainty propagation is then used with these parameter distributions to estimate the melt pool depth and associated uncertainty. Our results for the 316L stainless steel suggest that both the absorptivity and powder bed porosity are strongly influenced by the laser power. In contrast, the scanning speed has only a marginal effect on both the absorptivity and powder bed porosity. We constructed a printability map using the Bayesian E–T model based on power-dependent input parameter values to demonstrate the merit of the approach. The Bayesian approach improved the accuracy in predicting the keyhole regions in the laser power-scan speed parameter space for the 316L stainless steel. Although applied to a specific adaptation of the E–T model, the method put forth can be extended to quantify uncertainties in other numerical models as well as in the estimation of unknown parameters.

316L Stainless Steel (SS).↗