Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

A Multi-Band Uncertainty Set Based Robust SCUC With Spatial and Temporal Budget Constraints

The dramatic increase of renewable energy resources in recent years, together with the long-existing load forecast errors and increasingly involved price sensitive demands, has introduced significant uncertainties into power systems operation. In order to guarantee the operational security of power systems with such uncertainties, robust optimization has been extensively studied in security-constrained unit commitment (SCUC) problems, for immunizing the system against worst uncertainty realizations. However, traditional robust SCUC models with single-band uncertainty sets may yield over-conservative solutions in most cases. This paper proposes a multi-band robust model to accurately formulate various uncertainties with higher resolution. By properly tuning band intervals and weight coefficients of individual bands, the proposed multi-band robust model can rigorously and realistically reflect spatial/temporal relationships and asymmetric characteristics of various uncertainties, and in turn could effectively leverage the tradeoff between robustness and economics of robust SCUC solutions. The proposed multi-band robust SCUC model is solved by Benders decomposition (BD) and outer approximation (OA), while taking the advantage of integral property of the proposed multi-band uncertainty set. In addition, several accelerating techniques are developed for enhancing the computational performance and the convergence speed. Numerical studies on a 6-bus system and the modified IEEE 118-bus system verify the effectiveness of the proposed robust SCUC approach for enhancing uncertainty modeling capabilities and mitigating conservativeness of the robust SCUC solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

MAGIC: M arching Cubes Isosurface Uncertainty Visualization for G auss i an Uncertain Data With Spatial C orrelation

Here, in this paper, we study the propagation of data uncertainty through the marching cubes algorithm for isosurface visualization for correlated uncertain data. Consideration of correlation has been shown paramount for avoiding errors in uncertainty quantification and visualization in multiple prior studies. Although the problem of isosurface uncertainty with spatial data correlation has been previously addressed, there are two major limitations to prior treatments. First, there are no analytical formulations for uncertainty quantification of isosurfaces when the data uncertainty is characterized by a Gaussian distribution with spatial correlation. Second, as a consequence of the lack of analytical formulations,existing techniques resort to a Monte Carlo sampling approach, which is expensive and difficult to integrate into visualization tools. To address these limitations, we present a closed-form framework to efficiently derive uncertainty in marching cubes level-sets for Gaussian uncertain data with spatial correlation (MAGIC). To derive closed-form solutions, we leverage the Hinkley's derivation on the ratio of Gaussian distributions. With our analytical framework, we achieve a significant speed-up and enhanced accuracy of uncertainty quantification over classical Monte Carlo methods. We further accelerate our analytical solutions using many-core processors to achieve speed-ups up to 585× and integrability with production visualization tools for broader impact. We demonstrate the effectiveness of our correlation-aware uncertainty framework through experiments on meteorology, urban flow, and astrophysics simulation datasets.

Gaussian↗

Scalable Multilevel Uncertainty Quantification Concepts for Extreme-Scale Multiscale Problems

Our work in this project is aimed at making fundamental advances in multilevel and multiscale methods for problems with uncertainties related to flows in porous media. The main thrust of this research is to develop a systematic multiscale, multilevel parallel approaches for problems with uncertainties and use them in the uncertainty quantification. A key emphasis is on problems without an apparent scale separation in space, time, and uncertainty spaces. Multiscale solution methods are currently under active investigation. However, the develop- ment of multiscale methods for problems with uncertainties where the scales and uncertainties are tightly coupled is a research area that is less explored. During this project, we have made some significant contributions to the developments of multiscale methods, the uncertainty quantification for multiscale methods, multiscale model learning, uncertainty quantification in inverse problems, and applications.

97 MATHEMATICS AND COMPUTING↗

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗

Effect of soil property uncertainties on permafrost thaw projections: A calibration-constrained analysis

The effect of soil property uncertainties on permafrost thaw projections are studied using a three-phase subsurface thermal hydrology model and calibration-constrained uncertainty analysis. The Null-Space Monte Carlo method is used to identify soil hydrothermal parameter combinations that are consistent with borehole temperature measurements at the study site, the Barrow Environmental Observatory. Each parameter combination is then used in a forward projection of permafrost conditions for the 21st century (from calendar year 2006 to 2100) using atmospheric forcings from the Community Earth System Model (CESM) in the Representative Concentration Pathway (RCP) 8.5 greenhouse gas concentration trajectory. A 100-year projection allows for the evaluation of intra-annual uncertainty due to soil properties and the inter-annual variability due to year to year differences in CESM climate forcings. After calibrating to borehole temperature data at this well-characterized site, soil property uncertainties are still significant and result in significant intra-annual uncertainties in projected active layer thickness and annual thaw depth-duration even with a specified future climate. Intra-annual uncertainties in projected soil moisture content and Stefan number are small. A volume and time integrated Stefan number decreases significantly in the future climate, indicating that latent heat of phase change becomes more important than heat conduction in future climates. Out of 10 soil parameters, ALT, annual thaw depth-duration, and Stefan number are highly dependent on mineral soil porosity, while annual mean liquid saturation of the active layer is highly dependent on the mineral soil residual saturation and moderately dependent on peat residual saturation. By comparing the ensemble statistics to the spread of projected permafrost metrics using different climate models, we show that the effect of calibration-constrained uncertainty in soil properties, although significant, is less than that produced by structural climate model uncertainty for this location.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A detailed description of the Monte Carlo method as applied for this analysis is provided. Detailed uncertainty results for the uncertainty in average free stream Mach number as well as other variables of interest are provided. All results are presented as random (variation in observed values about a true value), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty. The largest sources contributing to uncertainty are determined and potential improvement opportunities for the facility are investigated.

Error↗

Measurement Uncertainty Analysis of 6x9 Icing Research Tunnel (IRT)

This paper presents the results of the measurement uncertainty analysis that was performed on the aero-thermal characteristics of the 6- by 9-Foot Icing Research Tunnel (IRT) at the NASA Glenn Research Center. The engineering judgments and statistical methods used to determine the elemental uncertainties are described. Instrumentation uncertainty was quanti ed using MANTUS (Measurement Analysis Tool for Uncertainty in Systems) and instrument speci cation sheets. The Monte Carlo method was used to propagate systematic components of uncertainty in order to quantify the uncertainty of the Variables of Interest (VOI). A detailed description of the Monte Carlo method and the MANTUS tool can be found in the Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel report [1]. Detailed uncertainty results for test section airspeed and temperature as well as other variables of interest are described within this document.

6x9 Icing Research Tunnel↗

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗

UNCERTAINTY ANALYSIS FOR THE TECHA RIVER DOSIMETRY SYSTEM

Uncertainties in the doses estimated for the members of the Techa River Cohort (TRC) are being estimated with a two-dimensional Monte Carlo approach. In order to provide more accurate and precise estimates of individual dose (and thus more precise estimates of radiation risk) for the members of the TRC, a new dosimetric calculation system, the Techa River Dosimetry System-2009 (TRDS-2009) has been prepared. The deterministic version of the improved dosimetry system TRDS-2009D was basically completed in April 2009. Recent developments in evaluation of dose-response models in light of uncertain dose have highlighted the importance of different types of uncertainties in the development of individual dose estimates. These include uncertain parameters that may be either shared (common to some or all individuals) or unshared (a unique value for each person whose dose is to be estimated) within the dosimetric cohort. The nature of the type of uncertainty may be aleatory (random variability of true values due to stochastic processes) or epistemic (due to lack of complete knowledge about a unique quantity). Finally, there is a need to identify whether the structure of the errors is either related to measurement (the estimate differs from the true value by an error that is stochastically independent of the true value; frequently called classical uncertainty) or related to grouping (the true value varies from the estimate by an error that is random and is independent of the estimate; frequently called Berkson uncertainty). An approach has been developed that identifies the nature of the various input parameters and calculational methods incorporated in the Techa River Dosimetry System (based on the TRDS-2009D implementation), and a stochastic calculation model has been prepared to estimate the uncertainties in the dose estimates. This article reviews the concepts of uncertainty analysis, the equations, and input parameters, and then identifies the authors’ interpretations of their general nature. It presents the approach selected so that the stochastic, Monte-Carlo, implementation of the dosimetry system - TRDS-2009MC - provides useful information regarding the uncertainties of the doses.

uncertainty analysis, radiation dosimetry, Techa R↗

Comparison of Burnup Credit Uncertainty Quantification Methods

The recent revision of Interim Staff Guidance (ISG-8 revision 3), issued by the US Nuclear Regulatory Commission, on burnup credit for criticality safety analysis of pressurized water reactor spent fuel in transportation and storage casks expands the nuclides that can be credited in the fuel composition to include minor actinides and fission products. The technical basis for development of the uncertainties associated with calculated nuclide concentrations in spent nuclear fuel that are recommended in ISG-8 was established through the use of measured isotopic data acquired from destructive radiochemical assay data for spent fuel samples. These data provide a direct experimental basis for determining uncertainties in the calculated nuclide concentrations. To provide additional insight into code uncertainties resulting from nuclear data and also the level of conservatism associated with using experimental assay benchmark data for uncertainty evaluation, a new uncertainty analysis tool in the SCALE code system that performs stochastic sampling of nuclear data has been applied to representative burnup credit calculations for spent fuel pool and dry cask storage applications methodology. The nuclear data uncertainty analysis capabilities in Sampler can account for uncertainty contributions from cross sections, fission yields, and decay data by using correlated sampling of covariance files developed for all nuclear data used by SCALE. These uncertainties associated with nuclear data evaluations are compared to corresponding values developed in ISG-8 that are based on destructive assay data, as well as to values obtained using an alternate methodology that was developed by the Electric Power Research Institute based on reactor core simulation data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Use of a State-Level Integrated Assessment Model for Policy Analysis: An Uncertainty Analysis of Energy and Water

This presentation discusses some recent uncertainty assessment work being done on climate policy issues at the state level. The work is being done with the Platform for Regional Integrated Modeling and Analysis (PRIMA), a new climate change policy assessment framework developed at Pacific Northwest National Laboratory in Richland and Seattle, Washington and College Park, Maryland. The central computaional engine of PRIMA is the Global Change Assessment Model (GCAM), a dynamic-recursive integrated assessment model of the world economy, climate policy, and climate change that that has been regionalized to provide policy analysis down to the level of U.S. states. The PRIMA framework also includes detailed sectoral models that address issues in the energy-land-water interface geospatially at the sub-national level as the climate change and socioeconomic change occur. This presentation illustrates two uncertainty analyses conducted with GCAM and with water demand and supply components of PRIMA. The energy uncertainty analysis was conducted with GCAM alone and examines the impact of aggressive residential and commercial building equipment standards across the United States in the context of socioeconomic and climate uncertainty. The analysis focuses on the impact on future net energy service costs under aggressive standards in the residential and commercial building sectors from 2005 to 2050. The analysis uses a combination of discrete scenarios and Monte Carlo sampling approaches to address uncertainties. Results for Arizona and Florida are used to illustrate whether aggressive building equipment standards save energy and reduce net energy service costs when compared with current standards. Analysis of the output indicates a robust result under a broad range of future socioeconomic, policy, and climate scenarios. The water uncertainty analysis demonstrates a multi-model approach used to bound the prospects for future water shortages in Florida, given socioeconomic uncertainty and future water supply under a future climate. In this analysis, water demands from GCAM are coupled with a water management model that simulates regulated streamflows and water supply deficits given naturalized streamflows, water demands, and reservoir operating rules. The naturalized streamflows are simulated with a regional earth system model coupled to a river routing model. The climate is obtained from a regional climate projection of the Intergovernmental Panel on Climate Change (IPCC) Representative Concentration Pathway 8.5 (RCP 8.5) for all of the river basins in the United States. GCAM is used in Monte Carlo mode to estimate the outer bounds of water demand given socioeconomic uncertainty and RCP 8.5 climate. Future water demand is downscaled to a river basin level for Florida in high, low, and middle cases and is compared with available water supply for the same region for RCP 8.5 climate to identify the potential location and severity of water shortages.

Climate change, policy, mitigation, impacts, uncer↗

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗

A decomposition‐based approach to uncertainty analysis of feed‐forward multicomponent systems

SUMMARY To support effective decision making, engineers should comprehend and manage various uncertainties throughout the design process. Unfortunately, in today's modern systems, uncertainty analysis can become cumbersome and computationally intractable for one individual or group to manage. This is particularly true for systems comprised of a large number of components. In many cases, these components may be developed by different groups and even run on different computational platforms. This paper proposes an approach for decomposing the uncertainty analysis task among the various components comprising a feed‐forward system and synthesizing the local uncertainty analyses into a system uncertainty analysis. Our proposed decomposition‐based multicomponent uncertainty analysis approach is shown to be provably convergent in distribution under certain conditions. The proposed method is illustrated on quantification of uncertainty for a multidisciplinary gas turbine system and is compared to a traditional system‐level Monte Carlo uncertainty analysis approach. Copyright © 2014 John Wiley & Sons, Ltd.

Amaral, Sergio↗

Coping with uncertainty in environmental impact assessments: Open techniques

Uncertainty is virtually unavoidable in environmental impact assessments (EIAs). From the literature related to treating and managing uncertainty, we have identified specific techniques for coping with uncertainty in EIAs. Here, we have focused on basic steps in the decision-making process that take place within an EIA setting. More specifically, we have identified uncertainties involved in each decision-making step and discussed the extent to which these can be treated and managed in the context of an activity or project that may have environmental impacts. To further demonstrate the relevance of the techniques identified, we have examined the extent to which the EIA guidelines currently used in Colombia consider and provide guidance on managing the uncertainty involved in these assessments. Some points that should be considered in order to provide greater robustness in impact assessments in Colombia have been identified. These include the management of stakeholder values, the systematic generation of project options, and their associated impacts as well as the associated management actions, and the evaluation of uncertainties and assumptions. We believe that the relevant and specific techniques reported here can be a reference for future evaluations of other EIA guidelines in different countries. - Highlights: • uncertainty is unavoidable in environmental impact assessments, EIAs; • we have identified some open techniques to EIAs for treating and managing uncertainty in these assessments; • points for improvement that should be considered in order to provide greater robustness in EIAs in Colombia have been identified; • the paper provides substantiated a reference for possible examinations of EIAs guidelines in other countries.

54 ENVIRONMENTAL SCIENCES↗

Ignoring correlation in uncertainty and sensitivity analysis in life cycle assessment: what is the risk?

Life cycle assessment (LCA) is an established tool to quantify the environmental impact of a product. A good assessment of uncertainty is important for making well-informed decisions in comparative LCA, as well as for correctly prioritising data collection efforts. Under- or overestimation of output uncertainty (e.g. output variance) will lead to incorrect decisions in such matters. The presence of correlations between input parameters during uncertainty propagation, can increase or decrease the the output variance. However, most LCA studies that include uncertainty analysis, ignore correlations between input parameters during uncertainty propagation, which may lead to incorrect conclusions. Two approaches to include correlations between input parameters during uncertainty propagation and global sensitivity analysis were studied: an analytical approach and a sampling approach. The use of both approaches is illustrated for an artificial case study of electricity production. Results demonstrate that both approaches yield approximately the same output variance and sensitivity indices for this specific case study. Furthermore, we demonstrate that the analytical approach can be used to quantify the risk of ignoring correlations between input parameters during uncertainty propagation in LCA. We demonstrate that: (1) we can predict if including correlations among input parameters in uncertainty propagation will increase or decrease output variance; (2) we can quantify the risk of ignoring correlations on the output variance and the global sensitivity indices. Moreover, this procedure requires only little data. - Highlights: • Ignoring correlation leads to under- or overestimation of the output variance. • We demonstrated that the risk of ignoring correlation can be quantified. • The procedure proposed is generally applicable in life cycle assessment. • In some cases, ignoring correlation has a minimal effect on decision-making tools.

54 ENVIRONMENTAL SCIENCES↗

Assessment of Uncertainties in Treatment Planning for Scanned Ion Beam Therapy of Moving Tumors

Purpose: To provide methods for quantification of uncertainties in 4-dimensional (4D) treatment during treatment planning. Methods and Materials: Uncertainty information was generated by multiple 4D treatment simulations with varying parameters. Sampled data were analyzed using uncertainty visualization methods that have been added to common treatment plan evaluation methods (eg, dose-volume histogram and dose distribution analysis). To illustrate the potential of the introduced methods, uncertainty analysis was completed for a single lung cancer case using 3 motion mitigation techniques: gating, slice-by-slice rescanning, and breath-controlled rescanning. Results: By repeating 4D dose calculations with varying parameters, we were able to show local uncertainties in dose distributions and to evaluate the stability of treatment setups. The new methods were found suitable for uncertainty evaluation in 4D treatment planning of moving tumors. Calculation time of the uncertainty base data was time consuming but contrivable overnight. Conclusions: Uncertainty analysis and visualization for 4D treatment planning provide an important tool in the decision process for an optimal treatment approach.

62 RADIOLOGY AND NUCLEAR MEDICINE↗