Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Comprehensive Analysis of Model Parameter Uncertainty Influence on Evaluation of HVAC Operation to Mitigate Indoor Virus: A Case Study for an Office Building in a Cold and Dry Climate

Simulation-based studies of HVAC operation to mitigate indoor virus have been conducted to understand tradeoffs between indoor air quality (IAQ) and energy consumption. However, the influence of model parameter uncertainty in these studies has not been systematically quantified, which is critical when providing guidance to building operators. To address this gap, we identify 20 model parameters for a typical medium office building system in a cold and dry climate that can influence IAQ and energy consumption for indoor virus scenarios. Next, the distributions of the parameter values are estimated from literature and a set of simulation samples for three representative days is generated that simultaneously sample all of the parameters from their distributions. Two HVAC virus mitigation strategies are studied: increased filtration using MERV 13 filters and increased ventilation, via supply of 100% outdoor air into buildings. The model parameter uncertainty leads to significant variability in the results, particularly for the IAQ because of the highly uncertain virus generation rate. Use of 100% outdoor air can be beneficial for some uncertain scenarios on the hot day, but shows less IAQ improvement and/or significant energy increases on the other days. The virus removal efficiency and pressure drop of the HVAC filter, fan efficiency, and internal heat gain are the most important parameters to determining the tradeoffs of the two strategies. Our results demonstrate how this model parameter uncertainty analysis methodology can provide practical guidance to building operators.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗

Credible Computations: Standard and Uncertainty

The discipline of computational fluid dynamics (CFD) is at a crossroad. Most of the significant advances related to computational methods have taken place. The emphasis is now shifting from methods to results. Significant efforts are made in applying CFD to solve design problems. The value of CFD results in design depends on the credibility of computed results for the intended use. The process of establishing credibility requires a standard so that there is a consistency and uniformity in this process and in the interpretation of its outcome. The key element for establishing the credibility is the quantification of uncertainty. This paper presents salient features of a proposed standard and a procedure for determining the uncertainty. A customer of CFD products - computer codes and computed results - expects the following: A computer code in terms of its logic, numerics, and fluid dynamics and the results generated by this code are in compliance with specified requirements. This expectation is fulfilling by verification and validation of these requirements. The verification process assesses whether the problem is solved correctly and the validation process determines whether the right problem is solved. Standards for these processes are recommended. There is always some uncertainty, even if one uses validated models and verified computed results. The value of this uncertainty is important in the design process. This value is obtained by conducting a sensitivity-uncertainty analysis. Sensitivity analysis is generally defined as the procedure for determining the sensitivities of output parameters to input parameters. This analysis is a necessary step in the uncertainty analysis, and the results of this analysis highlight which computed quantities and integrated quantities in computations need to be determined accurately and which quantities do not require such attention. Uncertainty analysis is generally defined as the analysis of the effect of the uncertainties involved in all stages of a process on the final responses. There are two approaches for conducting the uncertainty analysis: experimental and computational. These analyses and approaches are briefly described.

Mehta, Unmeel B.↗

Sensitivity-based Similarity Metrics for New Experiment Design Optimization

The nuclear data used in advanced reactor simulations requires validation. Data from nuclear criticality experiments can provide this validation. New nuclear criticality experiment design requires extensive knowledge and expert judgement such that the experimental design parameters are selected in such a way to keep the experiment subcritical. To aide in this experimental design process, professionals can utilize sensitivity and uncertainty analysis. Sensitivity and uncertainty analysis relies on matching new application experiments with currently existing benchmark experiments. Currently, there is functionality in the Whisper 1.1 software package to calculate a similarity metric based on neutron multiplication factor sensitivity coefficients between a new application designed by the user and existing International Criticality Safety Benchmark Experiment Project (ICSBEP) benchmarks. The Whisper 1.1 software package is included in Monte Carlo N-Particle ® Code Version 6.21 (MCNP ® 6.2). This work is geared toward expanding this capability to new similarity metrics based on beta-effective sensitivity coefficients and reactivity coefficient sensitivity coefficients. While the investigation of these sensitivity coefficients is presented in detail in separate works at this same conference, this work will be primarily focused on studying the similarity metrics in more detail. These similarity metrics will then be incorporated into the optimization algorithms used for experiment design in EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data), which is a Los Alamos National Laboratory (LANL) project designed to constrain nuclear data of interest, such that adjustments can be made to possible inaccuracies. A more detailed optimization can be subsequently performed by breaking down these similarity metrics by isotope, reaction, and energy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

LTAU (Loss Trajectory Analysis for Uncertainty) is a technique for estimating the uncertainty in a model's predictions for any regression task by approximating the cumulative distribution function (CDF) of the model's errors over the course of training. The approximated CDF, combined with a similarity search algorithm in the model's descriptor space, can then be used to estimate the likelihood that the model's predictions on any given test point will fall below a chosen threshold. LTAU-FF (LTAU in atomistic Force Fields) is the application of LTAU specifically for use with atomistic force fields.

Vita, JoshuaA↗

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗

Summary Findings from the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in Greece in 2008 identified many promising sensitivity analysis and uncertainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not clear. The NATO Science and Technology Organization, Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic vehicle development problems. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper summarizes findings and lessons learned from the task group.

Benek, John A.↗

A Modeling Toolkit for Comparing AC and DC Electrical Distribution Efficiency in Buildings

Recently, there has been considerable research interest in the potential for DC distribution systems in buildings instead of the traditional AC distribution systems. Due to the need for performing power conversions between DC and AC electricity, DC distribution may provide electrical efficiency advantages in some systems. To support comparative evaluations of AC-only, DC-only, and hybrid AC/DC distribution systems in buildings, a new modeling toolkit called the Building Electrical Efficiency Analysis Model (BEEAM) was developed and is described in this paper. To account for harmonics in currents or voltages arising from nonlinear devices, the toolkit implements harmonic power flow, along with nonlinear device behavioral descriptions derived from empirical measurements. This paper describes the framework, network equations, device representations, and an implementation of the toolkit in an open source software package, including a component library and graphical interface for creating circuits. Simulations of electrical behavior and device and system efficiencies using the toolkit are compared with experimental measurements of a small office environment in a variety of operating and load configurations. A detailed analysis of uncertainty estimation is also provided. Key findings were that a comparison of predicted versus measured efficiencies and power losses in the validation testbed using the initial toolkit implementation predicted device- and system-level efficiencies with reasonably good accuracy under both balanced and unbalanced AC scenarios. An uncertainty analysis also revealed that the maximum estimated error for system efficiency across all scenarios was 3%, and measured and modeled system efficiency agreed within the experimental uncertainty in approximately half of the scenarios. Based on the correspondence between simulation and measurement, the toolkit is proposed by the authors as a potentially useful tool for comparing efficiency in AC, DC, and hybrid AC/DC distribution systems in buildings.

DC distribution↗

Dynamics of Fungal and Bacterial Biomass Carbon in Natural Ecosystems: Site-level Applications of the CLM-Microbe Model

Explicitly representing microbial processes has been recognized as a key improvement to Earth system models for the realistic projections of soil carbon (C) and climate dynamics. The CLM-Microbe model builds upon the CLM4.5 and explicitly represents two major soil microbial groups, fungi and bacteria. Based on the compiled time-series data of fungal (FBC) and bacterial (BBC) biomass C from nine biomes, we parameterized and validated the CLM-Microbe model, and further conducted sensitivity analysis and uncertainty analysis for simulating C cycling. The model performance was evaluated with mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R2) for relative change in FBC and BBC. The CLM-Microbe model is able to reasonably capture the seasonal dynamics of FBC and BBC across biomes, particularly for tropical/subtropical forest, temperate broadleaf forest, and grassland, with MAE < 0.49 for FBC and <0.36 for BBC and RMSE <0.52 FBC and <0.39 for BBC, while R2 values are relatively smaller in some biomes (e.g., shrub) due to small sample sizes. We found good consistencies between simulated and observed FBC (R 2 =0.70, P<0.001) and BBC (R 2 =0.26, P<0.05) on average across biomes, but the model is not able to fully capture the large variation in observed FBC and BBC. Sensitivity analysis shows the most critical parameters are turnover rate, carbon-to-nitrogen ratio of fungi and bacteria, and microbial assimilation efficiency. This study confirms that the explicit representation of soil microbial mechanisms enhances model performance in simulating C variables such as heterotrophic respiration and soil organic C density. The further application of the CLM-Microbe model would deepen our understanding of microbial contributions to the global C cycle.

54 ENVIRONMENTAL SCIENCES↗

Capella: Structure and Abundances

The analysis of the Advanced Satellite for Cosmology and Astrophysics (ASCA) spectra of the cool star binary system Capella is reported. The results of EUVE analysis, ASCA analysis, application of EUVE model to ASCA analysis, and Uncertainty Analysis are discussed.

Brickhouse, Nancy S.↗

Analysis of uncertainties in turbine metal temperature predictions

An analysis was conducted to examine the extent to which various factors influence the accuracy of analytically predicting turbine blade metal temperatures and to determine the uncertainties in these predictions for several accuracies of the influence factors. The advanced turbofan engine gas conditions of 1700 K and 40 atmospheres were considered along with those of a highly instrumented high temperature turbine test rig and a low temperature turbine rig that simulated the engine conditions. The analysis showed that the uncertainty in analytically predicting local blade temperature was as much as 98 K, or 7.6 percent of the metal absolute temperature, with current knowledge of the influence factors. The expected reductions in uncertainties in the influence factors with additional knowledge and tests should reduce the uncertainty in predicting blade metal temperature to 28 K, or 2.1 percent of the metal absolute temperature.

Stepka, F. S.↗

Analysis of Uncertainty Impacts on Emissions and Fuel Economy Evaluation for Chassis Dynamometer Testing

This study illustrates a methodology for quantifying the uncertainties encountered in the measurement of tailpipe emissions and in the fuel consumption measurements for light-duty conventional vehicles tested on a four-wheel drive chassis dynamometer. The study leverages high-fidelity experimental data collected over three standard drive cycles, UDDS, HWY and US06, intended to simulate a wide range of operating conditions. Here, a method is developed to estimate the measurement uncertainties in fuel consumption for a test cycle, which occur due to the accumulation of measurement uncertainties propagated through the system. The uncertainty determination model uses statistical analysis and standard propagation techniques to evaluate and combine the uncertainties introduced from various sources (including the vehicle, chassis dynamometer, driver, and instrumentation). The analysis also examines three different experimental methods for determining the fuel consumption: 1) carbon mass balance, 2) volumetric fuel scale and 3) gravimetric fuel scale, and takes into consideration the properties of the instrumentation used. The results show that the most significant influence on the determination of the emissions comes from the concentration measurement, and similarly the biggest impact on the total fuel consumption uncertainty comes from the uncertainty in the determination of the carbon dioxide mass, due to the large presence of this pollutant in the overall emissions. It was found that the fuel consumption uncertainties are in the range of ±1-2% for all three methods analyzed, with the lowest values being obtained for measurements performed using the gravimetric method for all three drive cycles considered.

33 ADVANCED PROPULSION SYSTEMS↗

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Determination of Uncertainties for the New SSME Model

This report discusses the uncertainty analysis performed in support of a new test analysis and performance prediction model for the Space Shuttle Main Engine. The new model utilizes uncertainty estimates for experimental data and for the analytical model to obtain the most plausible operating condition for the engine system. This report discusses the development of the data sets and uncertainty estimates to be used in the development of the new model. It also presents the application of uncertainty analysis to analytical models and the uncertainty analysis for the conservation of mass and energy balance relations is presented. A new methodology for the assessment of the uncertainty associated with linear regressions is presented.

Coleman, Hugh W.↗

Some Aspects of uncertainty in computational fluid dynamics results

Uncertainties are inherent in computational fluid dynamics (CFD). These uncertainties need to be systematically addressed and managed. Sources of these uncertainty analysis are discussed. Some recommendations are made for quantification of CFD uncertainties. A practical method of uncertainty analysis is based on sensitivity analysis. When CFD is used to design fluid dynamic systems, sensitivity-uncertainty analysis is essential.

Mehta, U. B.↗

Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.

Benek, John A.↗

Impact of uncertainty on modeling and testing

A thorough understanding of the uncertainties associated with the modeling and testing of the Space Shuttle Main Engine (SSME) Engine will greatly aid decisions concerning hardware performance and future development efforts. This report will describe the determination of the uncertainties in the modeling and testing of the Space Shuttle Main Engine test program at the Technology Test Bed facility at Marshall Space Flight Center. Section 2 will present a summary of the uncertainty analysis methodology used and discuss the specific applications to the TTB SSME test program. Section 3 will discuss the application of the uncertainty analysis to the test program and the results obtained. Section 4 presents the results of the analysis of the SSME modeling effort from an uncertainty analysis point of view. The appendices at the end of the report contain a significant amount of information relative to the analysis, including discussions of venturi flowmeter data reduction and uncertainty propagation, bias uncertainty documentations, technical papers published, the computer code generated to determine the venturi uncertainties, and the venturi data and results used in the analysis.

Coleman, Hugh W.↗

Nuclear data uncertainty propagation and modeling uncertainty impact evaluation in neutronics core simulation

Uncertainty analysis is a critical requirement in reactor simulation as it is used to quantify the reliability of best-estimate calculation. A comprehensive uncertainty analysis should characterize all sources of uncertainties in a computationally-feasible and scientifically-defendable manner. Here we employ a well-established reduced order modeling (ROM) based uncertainty quantification methodology to propagate uncertainties throughout neutronic calculations. ROM relies on recent advances in randomized data mining techniques applied to large data streams. In our proposed implementation, the nuclear data uncertainties are first propagated from multi-group level through lattice physics calculation to generate few-group parameter uncertainties, described using a vector of mean values and a covariance matrix. Employing an ROM-based compression of the covariance matrix, the few-group uncertainties are then propagated through downstream core simulation in a computationally efficient manner. This straightforward approach, albeit efficient as compared to brute force forward and/or adjoint-based methods, often employs a number of assumptions that have been unquestioned in the literature of neutronic uncertainty analysis. This manuscript argues that these assumptions could introduce another source of uncertainty referred to as modeling uncertainties, whose magnitude needs to be quantified in tandem with nuclear data uncertainties. Thus, our primary goal is to explore the interactions between these two uncertainty sources in order to assess whether modeling uncertainties have an impact on parameter uncertainties. To explore this endeavor, the impact of a number of modeling assumptions on core attributes uncertainties is quantified. The study employs a CANDU reactor model, with Serpent and NEWT as lattice physics solvers and NESTLE-C as core simulator. The modeling assumptions investigated include those related with the uncertainty propagation method employed, e.g., deterministic vs. stochastic, the few-group energy structure employed to represent the cross-sections, the resonance treatment in lattice physics calculation, the reference values for the cross-section, and the number of samples employed to render ROM compression. Results indicate that some of the modeling assumptions could have a non-negligible impact on the core responses propagated uncertainties, highlighting the need for a more comprehensive approach to combine parameter and modeling uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗