Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Uncertainty Analysis of Slug Calorimeters in the HyMETS Arc-Jet Facility

The objective of this work is to perform an uncertainty analysis of the deduced stagnation heat flux environment on a slug calorimeter for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System arc-jet facility located at NASA Langley Research Center. Analytical solutions are developed for boundary-value problems on the slug element accounting for non-ideal effects, including spatial variation in the slug heat flux, multi-dimensional thermal conduction, and back-face losses, which departs from the state-of-the-art method derived from the American Society of Testing and Materials. Boundary-value problem definitions are informed by preliminary finite element thermal analysis of the slug calorimeter assembly (including both slug and housing) and just the slug element. The analytical solutions are presented in a general sense and in a truncated form from error analysis. Results are shown in optimizing and validating the analytical models against available slug back-face thermal data. The optimization results indicate that the appropriate epistemic uncertainty of the deduced stagnation heat flux on the slug calorimeter is at most±2.5% for both a high-and low-enthalpy test condition. In addition, a numerical approach is used to determine the aleatory (probabilistic) uncertainty component in the slug stagnation heat flux by applying a marching least-squares slope routine through the steady-state portion of the slug back-face thermal response. Results indicate a compromise between the number of samples and the filter frequency of slug back-face thermal data points when evaluating the standard deviation of the deduced stagnation heat flux statistics. When combining the mixed uncertainty, both aleatory and epistemic, the interval of uncertainty in the deduced stagnation heat flux is determined to be up to ±4%, which is at least a 60% reduction from the standard uncertainty used in the state-of-the-art method.

uncertainty↗
NASA NTRSDate not supplied

Effects of Natural Variability on the Use of Standard Deviation to Represent Measurement Uncertainties in Atmospheric Composition Studies

Measurement uncertainty is defined as a “non-negative parameter characterizing the dispersion of the quantity values being attributed to a measurand”. It is most common that the uncertainties of GAW hourly measurements, such as greenhouse gas measurements, are reported as standard deviations derived from individual sampling at a higher time resolution (e.g., 1 min). In contrast, the uncertainties of GAW measurements of reactive gases and aerosol properties are reported in percentiles covering the same probability. A quick look at hourly CO 2 data from Cape Grim, Australia yielded some interesting findings: the hourly standard deviation is, on average, more than a factor of 10 higher for the measurements under non-background conditions (over 50% observations), while the difference in average CO 2 amount fraction was less than 2 ppm. The dramatic contrast cannot be explained by the difference in measurement uncertainties, but can largely be attributed the natural variability, or episodic ambient CO 2 variation reflecting changes in meteorological conditions or emissions. These initial findings motivated a more in-depth analysis of the ground-based measurements of trace gases and aerosol properties. This analysis will be using continuous 1 min ground site observations to construct time averaged statistical indicators to evaluate whether the standard deviation is adequate to represent the dispersion, especially under marked influence by natural variability. The suitability of this representation can be determined by examining the difference between the standard deviation and percentiles encompassing the same probability. We will examine time intervals of 1 hour, 3 hours, and 24 hours, with the latter time intervals chosen to match those commonly used in model assessments. We will also investigate how natural variability can alter the probability distribution of the measurands and how adequate the quadrature propagation of uncertainties is under these conditions. The results will include several trace gases (e.g., CO 2 , CO, O 3 , and NO 2 ) with a range of measurement techniques (e.g., PANDORA, in situ), atmospheric lifetimes, and aerosol properties (e.g. scattering coefficient). The findings from this analysis should provide some useful feedback on the best practices for uncertainty reporting.

Measurement Uncertainty↗
DOE OSTI2021

Definitions for Testing Whether Evaluated Nuclear Data Relative Uncertainties are Realistic in Size

This document describes various tests that can be used to check whether evaluated relative uncertainties stored in nuclear-data covariances are realistic. To be more specific, these tests check whether nuclear-data uncertainties could be either over- or under-estimated given the input that usually enters the evaluation of nuclear-data mean values and covariances. Warning and error messages on the reliability of nuclear-data uncertainties will result from these tests. If uncertainties of one specific nuclear-data observable trigger warning messages from multiple tests, an evaluator should counter-check the reliability of the relative uncertainties of this particular nuclear-data covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

A Global Methane Observation System to Reduce Uncertainty for Anthropogenic and Natural Sources and Sinks for Detecting and Attributing Climate Feedbacks

Atmospheric methane (CH4) concentrations are accelerating global warming as net emissions increase. Observing systems that quantify sources remain too sparse and fragmented to detect trends—especially in remote regions where climate‐driven natural emissions may be rising. We provide a framework for quantifying uncertainty reductions through the implementation of a global ecosystem‐methane observing system designed to: (i) substantially lower uncertainty in sectoral and regional emissions, (ii) separate co‐occurring anthropogenic and natural fluxes, and (iii) trend detection at regional scales to verify mitigation progress and provide early warning of natural feedbacks. Using bottom‐up inventories and process‐model ensembles for 2014–2023, we show that anthropogenic emissions remain uncertain by ∼32% globally, while natural sources—tropical and boreal‐arctic wetlands, fires, and inland waters—carry far larger uncertainties (+ 70%) and trend uncertainties reaching ∼200%. Additional observations must match spatial emission structure to increase observability of emissions: high‐resolution satellite constellations for point sources combined with expanded flux networks and wetland mapping for diffuse sources, and denser ground‐based atmospheric column measurements to restore observability in under‐sampled tropics and high latitudes. Notional analyses indicate that targeted additions of flux towers and ∼20 in situ atmospheric column concentration instruments per key tropical region could reduce continental‐scale uncertainties at modest cost. Conceptual illustration of a Global Ecosystem Methane Observing System (GEM‐OS) integrating satellites, aircraft, atmospheric networks, and ecosystem measurements to quantify methane emissions from anthropogenic and natural sources. The multi‐scale observing framework improves source attribution, reduces uncertainty in regional methane budgets, and enables early detection of climate‐driven feedbacks from wetlands, fires, permafrost, agriculture, and fossil‐fuel emissions.

Ciais, P↗
DOE OSTI2021

Propagation of Input Uncertainties in Numerical Simulations of Laser Powder Bed Fusion

Laser powder bed fusion has the potential of redefining state-of-the-art processing and production methods, but defect formation and inconsistent build quality have limited the implementation of this process. Numerical models are widely used to study this process and predict the formation of these defects. Presently, the uncertainties of model input parameters and thermophysical properties used by these numerical simulations have not been investigated. In the present study, the uncertainty in these input parameters and material properties are quantified for laser powder bed fusion, with and without a simulated powder bed, to determine their influence on the predictive accuracy of an experimentally validated numerical model. Accounting for all possible sources of uncertainty quickly becomes computationally expensive on account of the curse of dimensionality. Uncertainty in laser absorption, solid, and liquid specific heat of the metal were found to have the largest effect on model prediction reliability with or without the use of a powder bed. Results also illustrate that accounting for these three uncertain parameters still captures the majority of model prediction uncertainty. Furthermore, the methodology of this study may be used to understand the uncertainty in as-built microstructure through propagation to microstructure prediction models, or applied under processing conditions where high Péclet numbers are observed and the thermal convection and fluid flow within the molten pool are substantial.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗
DOE OSTI2021

An Assessment of Global Positioning System Velocity Uncertainty in California

We analyze data from 580 continuous global positioning system (GPS) stations in California to quantify differences in published velocity estimates from five analysis centers. Horizontal and vertical rates for individual stations can differ up to 5 mm/yr, with systematic differences in some areas comparable to deformation rates. Published velocity uncertainties vary between analysis centers and are systematically underreported in the horizontal relative to empirical uncertainties calculated from the scatter of analysis center velocities. In the vertical, published velocity uncertainties are both over and underreported and vary more widely between centers. An interpolated ensemble vertical velocity field shows high-subsidence regions in the Central Valley and Salton Trough have the largest empirical uncertainties, while station density has a modest impact on uncertainties. Applications that rely on subcentimeter GPS accuracy should consider the possibility that formal errors published with velocity rate estimates understate true velocity uncertainties in both the horizontal and vertical.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Uncertainty Analysis in Multi‐Sector Systems: Considerations for Risk Analysis, Projection, and Planning for Complex Systems

Abstract Simulation models of multi‐sector systems are increasingly used to understand societal resilience to climate and economic shocks and change. However, multi‐sector systems are also subject to numerous uncertainties that prevent the direct application of simulation models for prediction and planning, particularly when extrapolating past behavior to a nonstationary future. Recent studies have developed a combination of methods to characterize, attribute, and quantify these uncertainties for both single‐ and multi‐sector systems. Here, we review challenges and complications to the idealized goal of fully quantifying all uncertainties in a multi‐sector model and their interactions with policy design as they emerge at different stages of analysis: (a) inference and model calibration; (b) projecting future outcomes; and (c) scenario discovery and identification of risk regimes. We also identify potential methods and research opportunities to help navigate the tradeoffs inherent in uncertainty analyses for complex systems. During this discussion, we provide a classification of uncertainty types and discuss model coupling frameworks to support interdisciplinary collaboration on multi‐sector dynamics (MSD) research. Finally, we conclude with recommendations for best practices to ensure that MSD research can be properly contextualized with respect to the underlying uncertainties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Compounding Uncertainties in Economic and Population Growth Increase Tail Risks for Relevant Outcomes Across Sectors

Understanding the long-term effects of population and GDP changes requires a multisectoral and regional understanding of the coupled human-Earth system, as the long-term evolution of this coupled system is influenced by human decisions and the Earth system. This study investigates the impact of compounding economic and population growth uncertainties on long-term multisectoral outcomes. We use the Global Change Analysis Model (GCAM) to explore the influence of compounding and feedback between future GDP and population growth on four key sectors: final energy consumption, water withdrawal, staple food prices, and CO 2 emissions. The results show that uncertainties in GDP and population compound, resulting in a magnification of tail risks for outcomes across sectors and regions. Compounding uncertainties significantly impact metrics such as CO 2 emissions and final energy consumption, particularly at the upper tail at both global and regional levels. However, the impact of staple food prices and water withdrawal depends on regional factors. Additionally, an alternative low-carbon transition scenario could compound uncertainties and increase tail risk, particularly in staple food prices, highlighting the influence of emergent constraints on land availability and food-energy competition for land use. The findings underscore the importance of considering and adequately accounting for compounding uncertainties in key drivers of multisectoral systems to enhance our comprehensive understanding of the complex nature of multisectoral systems. The paper provides valuable insights into the potential implications of compounding uncertainties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Characterizing How Meteorological Forcing Selection and Parameter Uncertainty Influence Community Land Model Version 5 Hydrological Applications in the United States

Despite the increasing use of large-scale Land Surface Models (LSMs) in predicting hydrological responses in extreme conditions, there's a critical gap in understanding the uncertainties in these predictions. This study addresses this gap through a detailed diagnostic evaluation of the uncertainties arising from meteorological forcing selection and model parametrization in hydrological simulations of the Community Land Model version 5 (CLM5). CLM5 is configured at a spatial scale of about 12-km to simulate runoff processes for 464 headwater watersheds, selected from the Catchment Attributes for Large-Sample Studies (CAMELS) dataset to be representative of physiographic and climatic gradients across the conterminous United States. For each watershed, CLM5 is driven by five commonly used gridded forcing datasets in combination with a large ensemble (> 1200) of key CLM5 hydrologic parameters. Our results suggest that uncertainty in CLM5 runoff simulations resulting from both forcing and parametric sources is markedly higher in arid regions, e.g., Great Plains and Midwest regions. Uncertainty in low flow is dominated by parametric uncertainty, while the selection of meteorological forcing contributes more dominantly to high flow and seasonal flows during fall and spring. Our analysis also demonstrates that the selection of forcing datasets and the metrics used to calibrate CLM5 significantly impact the model’s predictive accuracy in extreme event severity for both floods and droughts. Overall, the results from this study highlight the need to understand and account for forcing and parametric uncertainties in CLM5 simulations, particularly for hazard and risk assessments addressing hydrologic extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Uncertainty quantification for molecular property predictions with graph neural architecture search

Graph Neural Networks (GNNs) have emerged as a prominent class of data-driven methods for molecular property prediction. However, a key limitation of typical GNN models is their inability to quantify uncertainties in the predictions. This capability is crucial for ensuring the trustworthy use and deployment of models in downstream tasks. To that end, we introduce AutoGNNUQ, an automated uncertainty quantification (UQ) approach for molecular property prediction. AutoGNNUQ leverages architecture search to generate an ensemble of high-performing GNNs, enabling the estimation of predictive uncertainties. Our approach employs variance decomposition to separate data (aleatoric) and model (epistemic) uncertainties, providing valuable insights for reducing them. In our computational experiments, we demonstrate that AutoGNNUQ outperforms existing UQ methods in terms of both prediction accuracy and UQ performance on multiple benchmark datasets, and generalizes well to out-of-distribution datasets. Additionally, we utilize t-SNE visualization to explore correlations between molecular features and uncertainty, offering insight for dataset improvement. AutoGNNUQ has broad applicability in domains such as drug discovery and materials science, where accurate uncertainty quantification is crucial for decision-making.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Templates of expected measurement uncertainties

The covariance committee of CSEWG (Cross Section Evaluation Working Group) established templates of expected measurement uncertainties for neutron-induced total, (n,γ), neutron-induced charged-particle, and (n,xn) reaction cross sections as well as prompt fission neutron spectra, average prompt and total fission neutron multiplicities, and fission yields. Templates provide a list of what uncertainty sources are expected for each measurement type and observable, and suggest typical ranges of these uncertainties and correlations based on a survey of experimental data, associated literature, and feedback from experimenters. Information needed to faithfully include the experimental data in the nuclear-data evaluation process is also provided. These templates could assist (a) experimenters and EXFOR compilers in delivering more complete uncertainties and measurement information relevant for evaluations of new experimental data, and (b) evaluators in achieving a more comprehensive uncertainty quantification for evaluation purposes. This effort might ultimately lead to more realistic evaluated covariances for nuclear-data applications. In this topical issue, we cover the templates coming out of this CSEWG effort–typically, one observable per paper. This paper here prefaces this topical issue by introducing the concept and mathematical framework of templates, discussing potential use cases, and giving an example of how they can be applied (estimating missing experimental uncertainties of 235 U(n,f) average prompt fission neutron multiplicities), and their impact on nuclear-data evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Combining cosmic shear data with correlated photo-z uncertainties: constraints from DESY1 and HSC-DR1

An accurate calibration of the source redshift distribution p(z) is a key aspect in the analysis of cosmic shear data. This, one way or another, requires the use of spectroscopic or high-quality photometric samples. However, the difficulty to obtain colour-complete spectroscopic samples matching the depth of weak lensing catalogs means that the analyses of different cosmic shear datasets often use the same samples for redshift calibration. This introduces a source of statistical and systematic uncertainty that is highly correlated across different weak lensing datasets, and which must be accurately characterised and propagated in order to obtain robust cosmological constraints from their combination. In this paper we introduce a method to quantify and propagate the uncertainties on the source redshift distribution in two different surveys sharing the same calibrating sample. The method is based on an approximate analytical marginalisation of the p(z) statistical uncertainties and the correlated marginalisation of residual systematics. We apply this method to the combined analysis of cosmic shear data from the DESY1 data release and the HSC-DR1 data, using the COSMOS 30-band catalog as a common redshift calibration sample. We find that, although there is significant correlation in the uncertainties on the redshift distributions of both samples, this does not change the final constraints on cosmological parameters significantly. The same is true also for the impact of residual systematic uncertainties from the errors in the COSMOS 30-band photometric redshifts. Additionally, we show that these effects will still be negligible in Stage-IV datasets. Finally, the combination of DESY1 and HSC-DR1 allows us to constrain the "clumpiness" parameter to S 8 = ${0.768}_{-0.017}^{+0.021}$. This corresponds to a ~√(2) improvement in uncertainties with respect to either DES or HSC alone.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Statistical Uncertainty of Inhalation Dose Coefficients: Impact of Particle Deposition in ICRP 66 Human Respiratory Tract Model

Inhaled radioactive materials can pose a long-term health concern, as the material can be incorporated into the body’s metabolic pathways and remain in organs and tissues for extended durations. During the retention period, the radioactive material may localize in a source organ and irradiate adjacent target organs and tissues. Distribution of these materials changes over time, requiring biokinetic modeling to evaluate their movement through various tissues and organs. The evolving distribution depends on multiple inputs characterizing the inhaled material, such as particle size and size distribution, particle density, aspect ratio, specific radionuclide, the chemical form, and solubility. In addition, biological parameters such as breathing rate, breathing type (nasal or nasal/oral), respiratory system morphometry, tidal volume, functional residual capacity, and anatomical dead space all influence material transport. These aerosol properties and physiological characteristics of the respiratory tract jointly define a range of initial conditions that influence the time-dependent distribution of radioactive material. To evaluate both uncertainty in the initial conditions of inhalation exposure and the final output (committed effective dose) from biokinetic models, a Python-based software tool, Radiological Exposure Dose Calculator (REDCAL), was developed to propagate uncertainty within the human respiratory tract model. Focusing on deposition fraction uncertainty, the primary objective was to characterize the initial activity distribution across respiratory regions as a function of anticipated particle sizes and distributions. The impact of the deposition fraction uncertainty was propagated to committed effective dose coefficients for selected radionuclides in a companion publication. For each particle size, a lognormal distribution, characterized by its geometric mean as defined within ICRP Publication 66, serves as the basis for introducing uncertainty into the physical processes governing deposition in various lung regions. Finally, this study addresses the deposition process and examines how uncertainty in deposition mechanisms affects activity distribution in the airways, ultimately presenting the expected range and standard deviation of deposited activity as a function of particle size.

International Commission on Radiological Protectio↗
DOE OSTI2022

A cautionary tale of decorrelating theory uncertainties

A variety of techniques have been proposed to train machine learning classifiers that are independent of a given feature. While this can be an essential technique for enabling background estimation, it may also be useful for reducing uncertainties. We carefully examine theory uncertainties, which typically do not have a statistical origin. We will provide explicit examples of two-point (fragmentation modeling) and continuous (higher-order corrections) uncertainties where decorrelating significantly reduces the apparent uncertainty while the true uncertainty is much larger. These results suggest that caution should be taken when using decorrelation for these types of uncertainties as long as we do not have a complete decomposition into statistically meaningful components.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Modular hybrid modeling to increase efficiency, explore structural uncertainty, and allow multidimensional complexity scaling in land surface models

Land surface models (LSMs) are indispensable tools for predicting hydrologic extremes, as well as a particularly uncertain component of Earth system models that has stubbornly resisted the convergence in projections over several successive generations of model intercomparisons. This uncertainty in LSMs is poorly quantified and poorly attributed to specific processes, which has hampered efforts to focus research in reducing uncertainty. This has resulted from sparse sampling of the possible uncertainty space—which is high-dimensional and has contributions from parametric, structural, initial, and boundary condition uncertainties—as an artifact of CMIP-type ensembles of opportunity and limitations inherent in observational benchmarks. A new approach is needed to understand and reduce this uncertainty, based around individual LSMs that can represent the breadth of assumptions represented in current CMIP-type efforts, while at the same time exploring that uncertainty in a systematic way, confronting multiple types of observations, and where justified, replacing process representations with ML-driven emulators. We propose an approach of modular hybrid modeling to address these challenges.

58 GEOSCIENCES↗
DOE OSTI2021

Uncertainty Analysis and Software Verification

Uncertainty analyses are an important part of calibrations and testing. They allow researchers insight on how to reduce and mitigate errors in testing. Each device used in testing introduces error in a system, as well as other sources such as environmental conditions, electronics, analog to digital, and random errors. Each source is carefully examined to identify how much error it introduces to a system. These sources are then combined using various methods of uncertainty calculations. To verify and validate software, a manual calculation is required to ensure the software is performing as intended. Using Excel to verify the calculations, we can identify discrepancies within the software. The root of the sum of the squares uncertainty (RSS) is used to find the combined uncertainty of a device at one and two standard deviations of the mean. Calibrations on accelerometers are performed using a vibration system along with a back-toback reference accelerometer. The vibration system takes a reference point at 100Hz frequency at 10g amplitude. The sensitivities are collected at each dialed in frequency. The sensitivity of the device represents the electrical output of the UUT (mV, pC, etc.) per unit of acceleration (g). The full history of sensitivities of selected accelerometers are used to find the averaged, standard deviation, and uncertainty of the device at each frequency tested. The uncertainty calculations from excel and the software are then compared.

97 MATHEMATICS AND COMPUTING↗