Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

CALPHAD Uncertainty Quantification and TDBX

CALPHAD uncertainty quantification (UQ) is the foundation of materials design with quantified confidence. We report a framework and software packages to enable CALPHAD UQ assessment and calculation using commercial CALPHAD software (Thermo-Calc). This Bayesian inference framework is coupled with a Markov chain Monte Carlo algorithm to establish uncertainty traces with a given thermodynamic database file (TDB) and corresponding experimental data points. This general framework is demonstrated with the Ni–Cr binary system. The algorithm is firstly validated on synthetic data with known ground truth. Then it is applied to real experimental data to generate posterior traces. We develop a file format named TDBX, which provides a single source of truth by combining the original TDB content and the traces for each assessed Gibbs energy parameter. CALPHAD UQ calculations are performed based on the TDBX file, from which uncertainties for phase boundaries, enthalpy curves, and solidification range are collected as examples of basic design parameters. This TDBX file with corresponding scripts are made open-source. Finally, the combination of CALPHAD UQ assessments and calculations connected by TDBX supports uncertainty-assisted modeling, enabling the integrated application of modern design with uncertainty methodologies to computational materials design.

36 MATERIALS SCIENCE↗

Topology optimization under uncertainty via non-intrusive polynomial chaos expansion

This paper presents a systematic approach for topology optimization under uncertainty that integrates non-intrusive polynomial chaos expansion with design sensitivity analysis for reliability-based and robust topology optimization. Uncertainty is introduced in loading and in geometry to address the manufacturing variability. The manufacturing variability is modeled via a thresholding technique in which the threshold field is represented by a reduced dimensional random field. Response metrics such as compliance and volume are characterized as polynomial chaos expansions of the underlying uncertain parameters thus allowing accurate and efficient estimation of statistical moments, failure probabilities and their sensitivities. The number of simulations is reduced for linear structures under loading uncertainty by means of superposition. Efficiency of the non-intrusive polynomial chaos approach is highlighted by comparison with the Monte Carlo method in terms of the number of simulations. To demonstrate the effect of uncertainty, optimized designs that consider uncertainty are compared to those that do not. Finally, comparisons of polynomial chaos expansion to existing analytical methods on a benchmark numerical example are also provided for reliability-based and worst case designs.

42 ENGINEERING↗

Uncertainty quantification in multiscale simulation of woven fiber composites

We report woven fiber composites have been increasingly employed as light-weight materials in aerospace, construction, and transportation industries due to their superior properties. These materials possess a hierarchical structure that necessitates the use of multiscale simulations in their modeling. To account for the inherent uncertainty in materials, such simulations must be integrated with statistical uncertainty quantification (UQ) and propagation (UP) methods. However, limited advancement has been made in this regard due to the significant computational costs and complexities in modeling spatially correlated structural variations coupled at different scales. In this work, a non-intrusive approach is proposed for multiscale UQ and UP to address these limitations. We introduce the top-down sampling method that allows to model non-stationary and continuous (but not differentiable) spatial variations of uncertainty sources by creating nested random fields (RFs) where the hyperparameters of an ensemble of RFs is characterized by yet another RF. We employ multi-response Gaussian RFs in top-down sampling and leverage statistical techniques (such as metamodeling and dimensionality reduction) to address the considerable computational costs of multiscale simulations. We apply our approach to quantify the uncertainty in a cured woven composite due to spatial variations of yarn angle, fiber volume fraction, and fiber misalignment angle. Finally, our results indicate that, even in linear analysis, the effect of uncertainty sources on the material’s response could be significant.

42 ENGINEERING↗

Avoiding climate change uncertainties in Strategic Environmental Assessment

This article is concerned with how Strategic Environmental Assessment (SEA) practice handles climate change uncertainties within the Danish planning system. First, a hypothetical model is set up for how uncertainty is handled and not handled in decision-making. The model incorporates the strategies ‘reduction’ and ‘resilience’, ‘denying’, ‘ignoring’ and ‘postponing’. Second, 151 Danish SEAs are analysed with a focus on the extent to which climate change uncertainties are acknowledged and presented, and the empirical findings are discussed in relation to the model. The findings indicate that despite incentives to do so, climate change uncertainties were systematically avoided or downplayed in all but 5 of the 151 SEAs that were reviewed. Finally, two possible explanatory mechanisms are proposed to explain this: conflict avoidance and a need to quantify uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Framework for the assessment of PEMS (Portable Emissions Measurement Systems) uncertainty

Highlights: • Portable Emissions Measurement Systems (PEMS) are used to measure Real-Driving Emissions (RDE) of vehicles. • The uncertainty of PEMS was evaluated based on experimental data and technical requirements prescribed in the European regulation. • The 2017 uncertainty estimation was 43%. European regulation 2016/427 (the first package of the so-called Real-Driving Emissions (RDE) regulation) introduced on-road testing with Portable Emissions Measurement Systems (PEMS) to complement the chassis dynamometer laboratory (Type I) test for the type approval of light-duty vehicles in the European Union since September 2017. The Not-To-Exceed (NTE) limit for a pollutant is the Type I test limit multiplied by a conformity factor that includes a margin for the additional measurement uncertainty of PEMS relative to standard laboratory equipment. The variability of measured results related to RDE trip design, vehicle operating conditions, and data evaluation remain outside of the uncertainty margin. The margins have to be reviewed annually (recital 10 of regulation 2016/646). This paper lays out the framework used for the first review of the NO{sub x} margin, which is also applicable to future margin reviews. Based on experimental data received from the stakeholders of the RDE technical working group in 2017, two NO{sub x} margin scenarios of 0.24–0.43 were calculated, accounting for different assumptions of possible zero drift behaviour of the PEMS during the tests. The reduced uncertainty margin compared to the one foreseen for 2020 (0.5) reflects the technical improvement of PEMS over the past few years.

54 ENVIRONMENTAL SCIENCES↗

A reforecasting-based dynamic reserve estimation for variable renewable generation and demand uncertainty

The installed capacity of renewables-based energy sources has been increasing in traditional power systems. In order to accommodate the increased variability and uncertainty associated with the deeper penetration of renewable sources like solar and wind, adjusted amounts of dynamic reserve are needed. Although probabilistic dynamic reserve estimation methods have been previously developed, most of them consider the uncertainty to be represented by parametric density functions that tend to perform poorly under extreme events and, moreover, neglect uncertainty introduced by the forecasting model itself. Toward addressing these limitations, this work presents, for the first time, a dynamic reserve estimation method for flexibility that incorporates nonparametric density estimation and a machine learning based reforecasting to provide a day-ahead prediction of the mean and spread of uncertainty around the base forecast. The prediction is, in turn, used to estimate the up and down reserve relative to the base forecast. Here, the present method takes various endogenous and exogenous features, including the calendar variables, as input to estimate the day-ahead reserve. Using a combination of reforecasting and dynamic reserve estimation techniques, the method is shown to adjust better to the dynamic nature of reserve requirements providing only what is needed to accommodate the expected deviations. Considering California Independent System Operator (CAISO) solar, wind and load data over an 18 month period, up to 67% reduction in the amount of reserve capacity needed for a one day reserve and reserve penalty for solar uncertainty is demonstrated. Additionally, the risk of reserve insufficiency in meeting the net demand is reduced by 20% with the proposed method.

14 SOLAR ENERGY↗

Limited Impact of Setup and Range Uncertainties, Breathing Motion, and Interplay Effects in Robustly Optimized Intensity Modulated Proton Therapy for Stage III Non-small Cell Lung Cancer

Purpose: To investigate the impact of setup and range uncertainties, breathing motion, and interplay effects using scanning pencil beams in robustly optimized intensity modulated proton therapy (IMPT) for stage III non-small cell lung cancer (NSCLC). Methods and Materials: Three-field IMPT plans were created using a minimax robust optimization technique for 10 NSCLC patients. The plans accounted for 5- or 7-mm setup errors with ±3% range uncertainties. The robustness of the IMPT nominal plans was evaluated considering (1) isotropic 5-mm setup errors with ±3% range uncertainties; (2) breathing motion; (3) interplay effects; and (4) a combination of items 1 and 2. The plans were calculated using 4-dimensional and average intensity projection computed tomography images. The target coverage (TC, volume receiving 95% of prescribed dose) and homogeneity index (D{sub 2} − D{sub 98}, where D{sub 2} and D{sub 98} are the least doses received by 2% and 98% of the volume) for the internal clinical target volume, and dose indexes for lung, esophagus, heart and spinal cord were compared with that of clinical volumetric modulated arc therapy plans. Results: The TC and homogeneity index for all plans were within clinical limits when considering the breathing motion and interplay effects independently. The setup and range uncertainties had a larger effect when considering their combined effect. The TC decreased to <98% (clinical threshold) in 3 of 10 patients for robust 5-mm evaluations. However, the TC remained >98% for robust 7-mm evaluations for all patients. The organ at risk dose parameters did not significantly vary between the respective robust 5-mm and robust 7-mm evaluations for the 4 error types. Compared with the volumetric modulated arc therapy plans, the IMPT plans showed better target homogeneity and mean lung and heart dose parameters reduced by about 40% and 60%, respectively. Conclusions: In robustly optimized IMPT for stage III NSCLC, the setup and range uncertainties, breathing motion, and interplay effects have limited impact on target coverage, dose homogeneity, and organ-at-risk dose parameters.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Impact of parametric uncertainty on estimation of the energy deposition into an irradiated brain tumor

Predictions of the total energy deposited into a brain tumor through X-ray irradiation are notoriously error-prone. We investigate how this predictive uncertainty is affected by uncertainty in both the location of the region occupied by a dose-enhancing iodinated contrast agent and the agent's concentration. This is done within the probabilistic framework in which these uncertain parameters are modeled as random variables. We employ the stochastic collocation (SC) method to estimate statistical moments of the deposited energy in terms of statistical moments of the random inputs, and the global sensitivity analysis (GSA) to quantify the relative importance of uncertainty in these parameters on the overall predictive uncertainty. A nonlinear radiation–diffusion equation dramatically magnifies the coefficient of variation of the uncertain parameters, yielding a large coefficient of variation for the predicted energy deposition. This demonstrates that accurate prediction of the energy deposition requires a proper treatment of even small parametric uncertainty. Our analysis also reveals that SC outperforms standard Monte Carlo, but its relative efficiency decreases as the number of uncertain parameters increases from one to three. A robust GSA ameliorates this problem by reducing this number.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neutron Cross Section Uncertainties in the Thermal and Resonance Regions

In the Atlas of Neutron Resonances, special care was expended to ensure that the resonance parameter information reproduces the various measured thermal cross sections, as well as the infinite dilute resonance integrals for Z = 1-100. In contrast, the uncertainties of the recommended quantities do not match those generated from the uncertainties of the resonance parameters. To address this problem, the present study was initiated to achieve consistency for 15 actinides and 21 structural and coolant moderator materials. This is realized by assigning uncertainties to the parameters of the negative-energy resonances and changing, if necessary, significantly the uncertainties of the low-lying positive-energy resonances. The influence of correlations between parameters on the derived uncertainties is examined and discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Experimental Nuclear Reaction Data Uncertainties: Basic Concepts and Documentation

This paper has been written to provide experimental nuclear data researchers and data compilers with practical guidance on dealing with experimental nuclear reaction data uncertainties. It outlines some of the properties of random variables as well as principles of data uncertainty estimation, and illustrates them by means of simple examples which are relevant to the field of nuclear data. Emphasis is placed on the importance of generating mathematical models (or algorithms) that can adequately represent individual experiments for the purpose of estimating uncertainties in their results. Several types of uncertainties typically encountered in nuclear data experiments are discussed. The requirements and procedures for reporting information on measurement uncertainties for neutron reaction data, so that they will be useful in practical applications, are addressed. Consideration is given to the challenges and opportunities offered by reports, conference proceedings, journal articles, and computer libraries as vehicles for reporting and documenting numerical experimental data. Finally, contemporary formats used to compile reported experimental covariance data in the widely used library EXFOR are discussed, and several samples of EXFOR files are presented to demonstrate their use.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainties in Hauser-Feshbach Neutron Capture Calculations for Astrophysics

The calculation of neutron capture cross sections in a statistical Hauser-Feshbach method has proved successful in numerous astrophysical applications. Of increasing interest is the uncertainty associated with the calculated Maxwellian averaged cross sections (MACS). Aspects of a statistical model that introduce a large amount of uncertainty are the level density model, γ-ray strength function parameter, and the placement of E{sub low} – the cut-off energy below which the Hauser-Feshbach method is not applicable. Utilizing the Los Alamos statistical model code CoH3 we investigate the appropriate treatment of these sources of uncertainty via systematics of nuclei in a local region for which experimental or evaluated data is available. In order to show the impact of uncertainty analysis on nuclear data for astrophysical applications, these new uncertainties will be propagated through the nucleosynthesis code NuGrid.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Utilization of MCNP ® 6 implicit-capture simulations for quantification of systematic uncertainties from experimental environments

In this study, the high statistical precision that can be achieved using modern data collection techniques implies that systematic uncertainties that were ignored or not considered for past experiments must now be explored. The folding of Monte Carlo simulations into experimental data analysis, which is becoming common practice, requires an estimate of the systematic uncertainty present in the experimental result from uncertainties in the library of cross sections used during the simulation, but this source of uncertainty is typically not quantified. Here we describe a method to estimate this systematic uncertainty by varying the cross sections used during simulation runtime. As opposed carrying out hundreds of sequential analog Monte Carlo simulations, this task was accomplished through a post-processing calculation of output from a single simulation that was run using the implicit-capture formalism available with MCNP ® 6.2 and the PTRAC output format.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Transient uncertainty quantification and Global Sensitivity Analysis of the open-source Molten Chloride Reactor Experiment (MCRE) using GP-PCA surrogate models

Uncertainties in the thermophysical properties of molten salts impact both the steady-state and transient behavior of Molten Salt Reactors (MSRs). In this work, we aim to quantify the influence of such uncertainties on the transient operation of the Molten Chloride Reactor Experiment (MCRE), utilizing the open-source specifications provided for this reactor. Seven representative transient scenarios are considered. For each scenario, we evaluate the impact of thermophysical property uncertainties on four key multiphysics model output variables of interest (VoIs): maximum power density, maximum fuel temperature, maximum reflector temperature, and average fuel velocity magnitude. In addition, we perform a Global Sensitivity Analysis (GSA) by computing Sobol’ indices for the uncertain input parameters to determine their contribution to the variability of each VoI. Conducting GSA is computationally intensive due to the large number of required evaluations of the high-fidelity multiphysics model. To mitigate this cost, we develop a surrogate modeling framework that combines Gaussian Process (GP) regression with Principal Component Analysis (PCA), enabling efficient sample generation for the GSA. Our results show that for energy-related VoIs, thermal conductivity is the dominant contributor to uncertainty. In contrast, for flow-related VoIs, density and dynamic viscosity are the primary sources of uncertainty. The specific heat of the fuel salt was found to play a secondary role in the transient analyses.

42 - ENGINEERING↗

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗

Life-cycle assessment of municipal solid waste management alternatives with consideration of uncertainty: SIWMS development and application

This paper describes the development and application of the Stochastic Integrated Waste Management Simulator (SIWMS) model. SIWMS provides a detailed view of the environmental impacts and associated costs of municipal solid waste (MSW) management alternatives under conditions of uncertainty. The model follows a life-cycle inventory approach extended with compensatory systems to provide more equitable bases for comparing different alternatives. Economic performance is measured by the net present value. The model is verified against four publicly available models under deterministic conditions and then used to study the impact of uncertainty on Sydney's MSW management 'best practices'. Uncertainty has a significant effect on all impact categories. The greatest effect is observed in the global warming category where a reversal of impact direction is predicted. The reliability of the system is most sensitive to uncertainties in the waste processing and disposal. The results highlight the importance of incorporating uncertainty at all stages to better understand the behaviour of the MSW system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Atomic Radius and Charge Parameter Uncertainty in Biomolecular Solvation Energy Calculations

Atomic radii and charges are two major parameters used in implicit solvent electrostatics and energy calculations. The optimization problem for charges and radii is under-determined, leading to uncertainty in the values of these parameters and in the results of solvation energy calculations using these parameters. This paper presents a method for quantifying this uncertainty in solvation energies using surrogate models based on generalized polynomial chaos (gPC) expansions. There are relatively few atom types used to specify radii parameters in implicit solvation calculations; therefore, surrogate models for these low-dimensional spaces could be constructed using least-squares fitting. However, there are many more types of atomic charges; therefore, construction of surrogate models for the charge parameter space required compressed sensing combined with an iterative rotation method to enhance problem sparsity. We present results for the uncertainty in small molecule solvation energies based on these approaches. Additionally, we explore the correlation between uncertainties due to radii and charges which motivates the need for future work in uncertainty quantification methods for high-dimensional parameter spaces.

Yang, Xiu↗