Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Simulation Credibility: Advances in Verification, Validation, and Uncertainty Quantification

Decision makers and other users of simulations need to know quantified simulation credibility to make simulation-based critical decisions and effectively use simulations, respectively. The credibility of a simulation is quantified by its accuracy in terms of uncertainty, and the responsibility of establishing credibility lies with the creator of the simulation. In this volume, we present some state-of-the-art philosophies, principles, and frameworks. The contributing authors involved in this publication have been dedicated to advancing simulation credibility. They detail and provide examples of key advances over the last 10 years in the processes used to quantify simulation credibility: verification, validation, and uncertainty quantification. The philosophies and assessment methods presented here are anticipated to be useful to other technical communities conducting continuum physics-based simulations; for example, issues related to the establishment of simulation credibility in the discipline of propulsion are discussed. We envision that simulation creators will find this volume very useful to guide and assist them in quantitatively conveying the credibility of their simulations.

Simulation Credibility↗

Structure and Parameter Uncertainty in Centennial Projections of Forest Community Structure and Carbon Cycling

Secondary forest regrowth shapes community succession and biogeochemistry for decades, including in the Upper Great Lakes region. Vegetation models encapsulate our understanding of forest function, and whether models can reproduce multi‐decadal succession patterns is an indication of our ability to predict forest responses to future change. We test the ability of a vegetation model to simulate C cycling and community composition during 100 years of forest regrowth following stand‐replacing disturbance, asking (a) Which processes and parameters are most important to accurately model Upper Midwest forest succession? (b) What is the relative importance of model structure versus parameter values to these predictions? We ran ensembles of the Ecosystem Demography model v2.2 with different representations of processes important to competition for light. We compared the magnitude of structural and parameter uncertainty and assessed which sub‐model–parameter combinations best reproduced observed C fluxes and community composition. On average, our simulations underestimated observed net primary productivity (NPP) and leaf area index (LAI) after 100 years and predicted complete dominance by a single plant functional type (PFT). Out of 4,000 simulations, only nine fell within the observed range of both NPP and LAI, but these predicted unrealistically complete dominance by either early hardwood or pine PFTs. A different set of seven simulations were ecologically plausible but under‐predicted observed NPP and LAI. Parameter uncertainty was large; NPP and LAI ranged from ~0% to >200% of their mean value, and any PFT could become dominant. The two parameters that contributed most to uncertainty in predicted NPP were plant–soil water conductance and growth respiration, both unobservable empirical coefficients. We conclude that (a) parameter uncertainty is more important than structural uncertainty, at least for ED‐2.2 in Upper Midwest forests and (b) simulating both productivity and plant community composition accurately without physically unrealistic parameters remains challenging for demographic vegetation models.

canopy radiative transfer↗

Uncertainty Quantification of Global Net Methane Emissions From Terrestrial Ecosystems Using a Mechanistically Based Biogeochemistry Model

Quantification of methane (CH4) emissions from wetlands and its sinks from uplands is still fraught with large uncertainties. Here, a methane biogeochemistry model was revised, parameterized, and verified for various wetland ecosystems across the globe. The model was then extrapolated to the global scale to quantify the uncertainty induced from four different types of uncertainty sources including parameterization, wetland type distribution, wetland area distribution, and meteorological input. We found that global wetland emissions are 212 ± 62 and 212 ± 32 Tg CH4 year−1 (1Tg = 1012 g) due to uncertain parameters and wetland type distribution, respectively, during 2000–2012. Using two wetland distribution data sets and three sets of climate data, the model simulations indicated that the global wetland emissions range from 186 to 212 CH4 year−1 for the same period. The parameters were the most significant uncertainty source. After combining the global methane consumption in the range of −34 to −46 Tg CH4 year−1, we estimated that the global net land methane emissions are 149–176 Tg CH4 year−1 due to uncertain wetland distribution and meteorological input. Spatially, the northeast United States and Amazon were two hotspots of methane emission, while consumption hotspots were in the Eastern United States and eastern China. During 1950–2016, both wetland emissions and upland consumption increased during El Niño events and decreased during La Niña events. This study highlights the need for more in situ methane flux data, more accurate wetland type, and area distribution information to better constrain the model uncertainty.

wetland methane emission↗

High Latitude Atmospheric Rivers: Teleconnections and Impacts

Atmospheric rivers (ARs) are long, narrow synoptic scale features that act as moisture transport vehicles by moving water vapor poleward. They are typically found in storm tracks and often have profound implications for regional hydroclimate. For high latitude locales such as Antarctica and the Arctic, ARs are fewer in number but often have an outsized impact by either producing significant snow accumulation events, or, depending on their thermal characteristics, initiating melt events on ice sheets, ice shelves, and sea ice. In this study, we apply both reanalysis and climate model data to evaluate high latitude ARs for both the Arctic and Antarctic in the context of teleconnections and modes of variability. Specifically, we fold in both MERRA-2 and ERA5 reanalysis as well as historical and climate change simulations from the CESM2 (Community Earth System Model, Version 2) and E3SMv2 (Energy Exascale Earth System Model, v2) with multiple ensemble members to better understand natural variability versus climate change signals. An overview of AR climatology and impacts will be presented, including a baseline uncertainty quantification analysis using data from ARTMIP (the Atmospheric River Tracking Method Intercomparison Project). AR impacts during specific modes of variability will be characterized by diagnosing precipitation and boundary layer temperature associated with Ars influencing the cryosphere. Modes of variability investigated include the SAM (Southern Annular Mode), PDO (Pacific Decadal Oscillation), PSA2 (Pacific South American Mode 2), the IOD (Indian Ocean Dipole), and the AO (Arctic Oscillation).

Atmospheric Rivers↗

Effects of Heat Transfer Coefficient Variation on Nuclear Thermal Propulsion Engine Performance

A physics-based Nuclear Thermal Propulsion (NTP) Testing Reference Design (TRD) power balance model was coded in Simulink to investigate engine performance for various design and parameter modifications. Since the primary mode of heat transfer in NTP engines is convective, the convective heat transfer coefficient (HTC) is a key parameter that requires accurate representation. The industry standard Westinghouse correlation has an uncertainty of ±20% which was investigated in this study. The results showed that a 20% decrease in the HTC led to a 4.14% increase in maximum fuel temperature while a 20% decrease in the HTC led to a 1.81% decrease in maximum fuel temperature suggesting that narrowing the uncertainty of this correlation through experimental work would be a critical step in the development of NTP engines. Furthermore, a maximum fuel temperature relationship with specific impulse was developed for the TRD engine which showed potential engine operation between specific impulse values of 715 and 900 seconds with minimal changes to the engine design. This graph could be useful for high level vehicle performance estimations for fuel types with different maximum operating temperatures.

Heat Transfer Coefficient↗

Effects of Varying the Heat Transfer Coefficient on Engine Performance

A physics-based Nuclear Thermal Propulsion (NTP) Testing Reference Design (TRD) power balance model was coded in Simulink to investigate engine performance for various design and parameter modifications. Since the primary mode of heat transfer in NTP engines is convective, the convective heat transfer coefficient (HTC) is a key parameter that requires accurate representation. The industry standard Westinghouse correlation has an uncertainty of ±20% which was investigated in this study. The results showed that a 20% decrease in the HTC led to a 4.14% increase in maximum fuel temperature while a 20% decrease in the HTC led to a 1.81% decrease in maximum fuel temperature suggesting that narrowing the uncertainty of this correlation through experimental work would be a critical step in the development of NTP engines. Furthermore, a maximum fuel temperature relationship with specific impulse was developed for the TRD engine which showed potential engine operation between specific impulse values of 715 and 900 seconds with minimal changes to the engine design. This graph could be useful for high level vehicle performance estimations for fuel types with different maximum operating temperatures.

Heat Transfer Coefficient↗

How Should Machine Learning Be Successfully Used for Wind Speed Vertical Extrapolation?

An accurate characterization of the wind resource available at hub-height is required for an efficient and bankable wind farm project. However, direct measurement of wind speed at the constantly increasing height of the hub of commercial wind turbines is oftentimes challenging and expensive, so that it is common practice to vertically extrapolate the wind resource from lower and more easily accessible levels. Conventional techniques for wind speed vertical extrapolation include the use of a power law and a logarithmic profile. While simple, the limits in accuracy of these methods have been shown in various studies. Recently, machine learning has been proposed as a new method to vertically extrapolate winds. All the published studies on the topic assess the performance of machine learning techniques in vertically extrapolating the wind resource at the same location where the algorithm has been trained. However, in real-world applications, the wind resource is measured at the instrument location, but it then needs to be extrapolated at hub height at the location of the wind turbines within the find farm. To be able to fully recommend the use of machine learning techniques over the simple power law and logarithmic law, the spatial variability of the performance improvements of the machine learning approaches needs to be assessed. Here, we propose a round-robin validation of a machine learning-based method for wind speed extrapolation. We use 20 months of observations at four locations spanning a 100 km wide region at the Southern Great Plains (SGP) atmospheric observatory, in north-central Oklahoma. At each location, we train a random forest to predict 30-min average wind speed at 143 m AGL. We use as input features lidar wind speed at 65 m AGL, time of day, sonic anemometer wind speed at 4 m AGL, turbulent kinetic energy, and Obukhov length. First, we perform a same-site comparison of the performance of the proposed random forest against the conventional techniques for wind speed extrapolation (namely power law and logarithmic profile, with widely accepted stability corrections). We find that the random forest outperforms the power law in vertically extrapolating wind speed in all the considered stability regimes, with a 33% reduction in MAE for stable conditions, and a 31% reduction in unstable conditions. Similar results are found when comparing predictions of extrapolated winds from the logarithmic profile and the random forest with the observed values. Next, we propose a round-robin validation, to use the random forest trained at each site to extrapolate wind speed at the remaining three sites. We find that the performance of the random forest approach degrades when the algorithm is tested at a site different than the training one. However, even under those circumstances, the machine learning-based approach still outperforms the conventional techniques for wind speed extrapolation, with, on average, a reduction in mean absolute error between 15 and 20% over the conventional methods, with the largest benefits obtained under stable conditions.

Monte Carlo↗

NE-COST plug-in: Expanding ACCERT's Capabilities for Life-Cycle Cost Modeling

The Algorithm for the Capital Cost Estimation of Reactor Technologies (ACCERT) is a structured methodology and software tool designed to simplify and standardize cost estimation for nuclear reactor technologies [1]. By utilizing a relational database structure and modular cost estimation algorithms, ACCERT delivers a robust, flexible, and scalable framework for evaluating costs across various reactor types and configurations [2]. The recent integration of the NE-COST plugin further expands ACCERT’s scope by introducing detailed life-cycle cost modeling and probabilistic analysis of uncertainties. This addition enables users to evaluate costs across front-end processes such as uranium enrichment and fabrication, as well as back-end activities including waste disposal and geologic storage. Through Monte Carlo statistical cost simulations, the plugin provides probabilistic insights into cost ranges, offering critical decision-making support for stakeholders including reactor developers, policymakers, and researchers.

Zhou, Jia↗

Systematic Uncertainties of the NOvA Neutrino Oscillation Analysis

NOvA is a two detector long-baseline neutrino oscillation experiment using Fermilab’s 700 kW NuMI muon neutrino beam. It studies the disappearance of muon (anti)neutrinos and the appearance of electron (anti)neutrinos in the beam over a distance of 810 km between the detectors. The observations can be used to constrain neutrino oscillation parameters: $\theta_{23}, \Delta m_{32}^2$ and $\delta_{CP}$ in the standard 3 active neutrinos paradigm. Although statistical uncertainties currently dominate in these measurements, understanding the major sources of systematic uncertainties and their correlations is vital for both the interpretation and precision of the results and also for further improvements of the analysis. This note presents details of the systematic uncertainties affecting NOvA's neutrino oscillation analysis results and how we evaluate them by generating systematically shifted predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for Composite Analysis.

The purpose of this environmental calculation file (ECF) is to provide a summary of methodology, inputs, assumptions, and results of a Special Analysis (SA) titled “Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for the Updated Composite Analysis.” This SA is one of the three SAs conducted in Fiscal Year (FY) 2024 for the Composite Analysis (CA) for the Hanford Site (DOE/RL-2019-52, Composite Analysis for Low-Level Waste Disposal in the Hanford Site Central Plateau (FY 2020)), and it is performed following the Unreviewed Composite Analysis Question Evaluation procedure, UCAQ-24-01-E (UCAQ-24-01-E, Rev. 0).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗

A Rat Body Phantom for Radiation Analysis

To reduce the uncertainties associated with estimating the biological effects of ionizing radiation in tissue, researchers rely on laboratory experiments in which mono-energetic, single specie beams are applied to cell cultures, insects, and small animals. To estimate the radiation effects on astronauts in deep space or low Earth orbit, who are exposed to mixed field broad spectrum radiation, these experimental results are extrapolated and combined with other data to produce radiation quality factors, radiation weighting factors, and other risk related quantities for humans. One way to reduce the uncertainty associated with such extrapolations is to utilize analysis tools that are applicable to both laboratory and space environments. The use of physical and computational body phantoms to predict radiation exposure and its effects is well established and a wide range of human and non-human phantoms are in use today. In this paper, a computational rat phantom is presented, as well as a description of the process through which that phantom has been coupled to existing radiation analysis tools. Sample results are presented for two space radiation environments.

Qualls, Garry D.↗

Evaluation of Uncertainties of Pressure Gain Measurements in Rotating Detonation Combustor

Experimentally measuring the pressure gain of a rotating detonation combustor through the method of equivalent available pressure is prone to many experimental uncertainties. A detailed analysis of sources of random and systematic uncertainties in the thrust and pressure gain is performed using data from a hydrogen/air-operated rotating detonation combustor. The combustor had an axial air inlet and a 50% exit constriction. The measured (negative) pressure gain values agree with the results in the literature for similar inlet-to-exit area ratios. The base drag correction on the centerbody was found to be the greatest source of uncertainty for the thrust. While thrust is the predominant source of random uncertainty in the pressure gain calculation, significant systematic errors can be committed due to the assumed exit Mach number. The impact of this assumption becomes more detrimental the closer to positive the measured pressure gain is. By experimentally evaluating the exit Mach number, the random and systematic uncertainty in pressure gain both decreased, indicating that this should be an essential step. A definitive demonstration of gain is challenging, given the assessed uncertainties, and recommendations are provided to increase the precision of the equivalent available pressure methodology.

Engineering↗

Probabilistic Fatigue Damage Prognosis Using a Surrogate Model Trained Via 3D Finite Element Analysis

Utilizing inverse uncertainty quantification techniques, structural health monitoring can be integrated with damage progression models to form probabilistic predictions of a structure's remaining useful life. However, damage evolution in realistic structures is physically complex. Accurately representing this behavior requires high-fidelity models which are typically computationally prohibitive. In the present work, a high-fidelity finite element model is represented by a surrogate model, reducing computation times. The new approach is used with damage diagnosis data to form a probabilistic prediction of remaining useful life for a test specimen under mixed-mode conditions.

Leser, Patrick E.↗