SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS2017

Daily Ambient Air Pollution Metrics for Five Cities: Evaluation of Data Fusion-Based Estimates and Uncertainties

Spatiotemporal characterization of ambient air pollutant concentrations is increasingly relying on the combination of observations and air quality models to provide well-constrained, spatially and temporally complete pollutant concentration fields. Air quality models, in particular, are attractive, as they characterize the emissions, meteorological, and physiochemical process linkages explicitly while providing continuous spatial structure. However, such modeling is computationally intensive and has biases. The limitations of spatially sparse and temporally incomplete observations can be overcome by blending the data with estimates from a physically and chemically coherent model, driven by emissions and meteorological inputs. We recently developed a data fusion method that blends ambient ground observations and chemical transport-modeled (CTM) data to estimate daily, spatially resolved pollutant concentrations and associatedcorrelations. In this study, we assess the ability of the data fusion method to produce daily metrics (i.e., 1-hr max, 8-hr max, and 24-hr average) of ambient air pollution that capture spatiotemporal air pollution trends for 12 pollutants (CO, NO2, NOx, O3, SO2, PM (sub10), PM (sub 2.5), and five PM (sub 2.5) components) across five metropolitan areas (Atlanta, Birmingham, Dallas, Pittsburgh, and St. Louis), from 2002 to 2008. Three sets of comparisons are performed: (1) the CTM concentrations are evaluated for each pollutant and metropolitan domain, (2) the data fusion concentrations are compared with the monitor data, (3) a comprehensive cross-validation analysis against observed data evaluates the quality of the data fusion model simulations across multiple metropolitan domains. The resulting daily spatial field estimates of air pollutant concentrations and uncertainties are not only consistent with observations, emissions, andmeteorology, but substantially improve CTM-derived results for nearly all pollutants and all cities, with the exception of NO2 for Birmingham. The greatest improvements occur for O3 and PM (sub 2.5). Squared spatiotemporal correlation coefficients range between simulations and observations determined using cross-validation across all cities for air pollutants of secondary and mixed origins are R-squared equal to 0.88-0.93 (O3), 0.81-0.89 (SO4), 0.67-0.83 (PM (sub 2.5)), 0.52-0.72 (NO3), 0.43-0.80 (NH4), 0.32-0.51 (OC), and 0.14-0.71 (PM (sub 10)). Results for relatively homogeneous pollutants of secondary origin, tend to be better than those for more spatially heterogeneous (larger spatial gradients) pollutants of primary origin (NOx, CO, SO2 and EC). Generally, background concentrations and spatial concentration gradients reflect interurban airshed complexity and the effects of regional transport, whereas daily spatial pattern variability shows intra urban consistency in the fused data. With sufficiently high CTM spatial resolution, traffic-related pollutants exhibit gradual concentration gradients that peak toward the urban centers. Ambient pollutant concentration uncertainty estimates for the fused data are both more accurate and smaller than those for either the observations or the model simulations alone.

spatiotemporal fusion↗

NASA NTRS2019

Analytic Spacecraft Attitude and Rate Estimation Performance During Attitude Sensor Outages

Analytic expressions for spacecraft attitude and rate estimation performance of an attitude estimation filter in terms of sensor specifications are useful tools for spacecraft design. Farrenkopf (1978) famously found analytic expressions for steady-state pre-update and post-update attitude and gyro bias estimate error variances for an attitude estimation filter for a single-axis spacecraft with a Rate Output Gyro (ROG). Markley and Reynolds (2000) extended the analysis for a Rate-Integrating Gyro (RIG) with angle white noise. These expressions allow for the rapid evaluation of system performance during preliminary mission design phases. One contribution of this paper is the analytic calculation of the steady-state pre-update and post-update angular rate estimate uncertainty for both the ROG and RIG cases. The primary contribution of this paper is the extension of the results for both the ROG and the RIG cases to the situation of an attitude sensor outage. This situation arises frequently in practice; for example when a star sensor’s field of view is occluded, when a star sensor’s readings are unreliable during a thruster burn that vibrates the spacecraft, or during star sensor outages due to radiation upsets. Analytic expressions for the attitude estimate uncertainty, gyro bias estimate uncertainty, and angular rate estimate uncertainty are given in terms of the attitude sensor outage interval, the star tracker measurement noise, and gyro noise parameters. Validity of the analytic results is demonstrated via Monte Carlo simulation.

Galante, Joseph M.↗

NASA NTRS2019

Analytic Spacecraft Attitude and Rate Estimation Performance During Attitude Sensor Outages

Galante, Joseph M.↗

DOE OSTI2024

A Refined Method to Translate Solar Data Quality Assessment Flags to Estimated Measurement Uncertainty

Integrating solar resource uncertainties due to radiometer measurement performance and operational data quality assessment can provide improved estimates of economic bankability, system design performance, and compliance of solar energy conversion systems. Estimating radiometer measurement uncertainty is an established procedure consistent with recognized best practices and international guidelines. SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report, the fourth of six for the Data Quality and Uncertainty Integration Project, presents a refined algorithm description for software to translate solar resource data quality assessment results into estimated uncertainty values in a Solar Resource Operational Uncertainty Integrator (SROUI) application. This algorithm requires three-component solar irradiance measurements - global horizontal irradiance, direct normal irradiance, and diffuse horizontal irradiance - collected at 1- to 60-minute intervals, as described in the previous deliverables. The development of this report as Deliverable 6.4 was an iterative process that included reviews and feedback from the project team on initial drafts designed to refine how the new software could best support determining solar resource data uncertainty. The results of this effort will contribute to the final software system development by National Renewable Energy Laboratory staff.

14 SOLAR ENERGY↗

DOE OSTI2025

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior due to drifts in the data. The drifts can arise from both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with non-stationary data streams.Online learning can be used to continuously adapt the models with new data as it is acquired. However, traditional online learning can suffer from short-term performance degradation, as ground truth are not available before making the prediction. To address this challenge, we propose uncertainty aware ensemble approach for online learning. We use Deep Gaussian Process Approximation (DGPA) technique for calibrated uncertainty estimation and use the uncertainty values to guide a meta-algorithm that produces predictions based on ensemble of learners. Moreover, DGPA also provides uncertainty estimation along with the predictions for decision makers. This paper demonstrates that the proposed method outperforms traditional online learning approach, and a naive ensemble without uncertainty guidance by about 7% and 6%, respectively, on B-coil deflection prediction at DIII-D Fusion Facility.

Rajput, Kishansingh [Thomas Jefferson National Acc↗

DOE OSTI2025

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Rajput, Kishansingh [Thomas Jefferson National Acc↗

DOE OSTI2021

Optimal interpolation of global dissolved oxygen: 1965–2015

Oxygen inventory of the global ocean has declined in recent decades potentially due to the warming-induced reduction in solubility as well as the circulation and biogeochemical changes associated with ocean warming and increasing stratification. Earth System Models predict continued oxygen decline for this century with profound impacts on marine ecosystem and fisheries. Observational constraint on the rate of oxygen loss is crucial for assessing the ability of models to accurately simulate these changes. There are only a few observational assessments of the global oceanic oxygen inventory reporting a range of oxygen loss. This study develops a gridded data set of dissolved oxygen for the global oceans using optimal interpolation method. The resulting gridded product includes full-depth map of dissolved oxygen as 5-year moving average from 1965 to 2015 with uncertainty estimates. The uncertainty can come from unresolved small-scale and high-frequency variability and mapping errors. The multi-decadal trend of global dissolved oxygen is in the range of -281 to -373 Tmol/decade. This estimate is more conservative than previous works. In this study, the grid points far from the observations are essentially set equal to zero anomaly from the climatology. Calculating global inventory with this approach produces a relatively conservative estimate; thus, the results from this study likely provide a useful lower bound estimate of the global oxygen loss.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Uncertainty guided online ensemble for non-stationary data streams in fusion science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior with distribution drifts, resulted by both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with such non-stationary data streams. Online learning techniques have been leveraged in other domains, however it has been largely unexplored for fusion applications. In this paper, we investigate online learning for continuous adaptation to drifting data streams in the prediction of Toroidal Field (TF) coils deflection at the DIII-D fusion facility. We further address the short-term performance degradation inherent to standard online learning, which arises because ground truth is unavailable at prediction time. To mitigate this issue, we propose an uncertainty-guided online ensemble framework. The method leverages the Deep Gaussian Process Approximation (DGPA) for calibrated uncertainty estimation and uses these uncertainty measures to guide a meta-algorithm that aggregates predictions from learners trained over different historical horizons. Our results show that online learning reduces prediction error by 80% compared to a static model. The online ensemble and the proposed uncertainty-guided ensemble further reduce error by approximately 6%, and 10% respectively, relative to standard single-model online learning, while also providing calibrated uncertainty estimates to support operational decision-making.

AI↗

DOE OSTI2025

Identifying high-impact and high-uncertainty parameters in MiniFuel model predictions

The MiniFuel irradiation platform at Oak Ridge National Laboratory's High Flux Isotope Reactor (HFIR) is a flexible, high-throughput separate effects test capability. Finite element thermal models are relied upon to design MiniFuel experiments and to achieve experimental objectives. Recent reports show good agreement in the model prediction of target fuel temperatures, but as the capability of the experiments is extended to higher temperatures, the uncertainty in the model predictions must be quantified. To that end, high-impact, high-uncertainty parameters that contribute the most uncertainty to the model are identified. The uncertainty quantification was accomplished through a series of screening and sensitivity analyses. The first analysis utilizes the method of Morris to perform a computationally efficient preliminary screening that considers uncertainty in a large number of the model inputs. The most important parameters identified in the Morris screening study were then considered in a Sobol sensitivity analysis that more robustly ranks and quantifies the uncertainty associated with each parameter. From these analyses, it was determined that thermal contact conductance between components is the parameter that contributes the highest uncertainty. The estimated uncertainty of the MiniFuel model fuel temperature predictions is ±80 °C in the removable beryllium and ±40 °C in the vertical experiment facilities. In conclusion, the framework established by the series of sensitivity analyses presented herein could easily be adapted to fit the needs of accelerated fuel qualification processes.

Fuel, Irradiation↗

DOE OSTI2023

DESI mock challenge: constructing DESI galaxy catalogues based on FastPM simulations

Together with larger spectroscopic surveys such as the Dark Energy Spectroscopic Instrument (DESI), the precision of large-scale structure studies and thus the constraints on the cosmological parameters are rapidly improving. Therefore, one must build realistic simulations and robust covariance matrices. We build galaxy catalogues by applying a halo occupation distribution (HOD) model upon the FastPM simulations, such that the resulting galaxy clustering reproduces high-resolution N-body simulations. While the resolution and halo finder are different from the reference simulations, we reproduce the reference galaxy two-point clustering measurements – monopole and quadrupole – to a precision required by the DESI Year 1 emission line galaxy sample down to non-linear scales, i.e. $k\lt 0.5\, h\, \mathrm{Mpc}^{-1}$ or $s\gt 10\, \mathrm{Mpc}\, h^{-1}$. Furthermore, we compute covariance matrices based on the resulting FastPM galaxy clustering – monopole and quadrupole. We study for the first time the effect of fitting on Fourier conjugate (e.g. power spectrum) on the covariance matrix of the Fourier counterpart (e.g. correlation function). We estimate the uncertainties of the two parameters of a simple clustering model and observe a maximum variation of 20 per cent for the different covariance matrices. Nevertheless, for most studied scales the scatter is between 2 and 10 per cent. Consequently, using the current pipeline we can precisely reproduce the clustering of N-body simulations and the resulting covariance matrices provide robust uncertainty estimations against HOD fitting scenarios. We expect our methodology will be useful for the coming DESI data analyses and their extension for other studies.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

RTN-124: Photometric Redshifts for the Vera C. Rubin Observatory Data Preview

We present the photometric redshifts (photo-z) inferred using algorithms implemented in the Redshift Assessment Infrastructure Layers (RAIL) for the NSF-DOE Vera C. Rubin Observatory Data Preview 2 (DP2). We produce a compilation of reference redshift catalog using spectroscopic, grism and many band photometric redshift dataset hosted on the LIneA Photo-z Server. We curate training and testing set for assessing the scientific and technical performance of Rubin photo-z. The algorithm applied to the object catalog are FlexZBoost, BPZ, kNN, GPz, DNF and TPz; with a combination of 6-band and 4-band photo-z depending on availability of u and y photometry. The redshift point estimates and uncertainty estimation in tabular format through the Large Survey DataBase (LSDB).

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2011

Incorporating JULES into NASA's Land Information System (LIS) and Investigations of Land-Atmosphere Coupling

NASA's Land Information System (LIS; lis.gsfc.nasa.gov) is a flexible land surface modeling and data assimilation framework developed over the past decade with the goal of integrating satellite- and ground-based observational data products and advanced land surface modeling techniques to produce optimal fields of land surface states and fluxes. LIS features a high performance and flexible design, and operates on an ensemble of land surface models for extension over user-specified regional or global domains. The extensible interfaces of LIS allow the incorporation of new domains, land surface models (LSMs), land surface parameters, meteorological inputs, data assimilation and optimization algorithms. In addition, LIS has also been demonstrated for parameter estimation and uncertainty estimation, and has been coupled to the Weather Research and Forecasting (WRF) mesoscale model. A visiting fellowship is currently underway to implement JULES into LIS and to undertake some fundamental science on the feedbacks between the land surface and the atmosphere. An overview of the LIS system, features, and sample results will be presented in an effort to engage the community in the potential advantages of LIS-JULES for a range of applications. Ongoing efforts to develop a framework for diagnosing land-atmosphere coupling will also be presented using the suite of LSM and PBL schemes available in LIS and WRF along with observations from the U. S .. Southern Great Plains. This methodology provides a potential pathway to study factors controlling local land-atmosphere coupling (LoCo) using the LIS-WRF system, which will serve as a testbed for future experiments to evaluate coupling diagnostics within the community.

Santanello, Joseph↗

DOE OSTI2024

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗

NASA NTRS2007

Comparison of Seasonal Terrestrial Water Storage Variations from GRACE with Groundwater-level Measurements from the High Plains Aquifer (USA)

This study presents the first direct comparison of variations in seasonal GWS derived from GRACE TWS and simulated SM with GW-level measurements in a semiarid region. Results showed that variations in GWS and SM are the main sources controlling TWS changes over the High Plains, with negligible storage changes from surface water, snow, and biomass. Seasonal variations in GRACE TWS compare favorably with combined GWS from GW-level measurements (total 2,700 wells, average 1,050 GW-level measurements per season) and simulated SM from the Noah land surface model (R = 0.82, RMSD = 33 mm). Estimated uncertainty in seasonal GRACE-derived TWS is 8 mm, and estimated uncertainty in TWS changes is 11 mm. Estimated uncertainty in SM changes is 11 mm and combined uncertainty for TWS-SM changes is 15 mm. Seasonal TWS changes are detectable in 7 out of 9 monitored periods and maximum changes within a year (e.g. between winter and summer) are detectable in all 5 monitored periods. Grace-derived GWS calculated from TWS-SM generally agrees with estimates based on GW-level measurements (R = 0.58, RMSD = 33 mm). Seasonal TWS-SM changes are detectable in 5 out of the 9 monitored periods and maximum changes are detectable in all 5 monitored periods. Good correspondence between GRACE data and GW-level measurements from the intensively monitored High Plains aquifer validates the potential for using GRACE TWS and simulated SM to monitor GWS changes and aquifer depletion in semiarid regions subjected to intensive irrigation pumpage. This method can be used to monitor regions where large-scale aquifer depletion is ongoing, and in situ measurements are limited, such as the North China Plain or western India. This potential should be enhanced by future advances in GRACE processing, which will improve the spatial and temporal resolution of TWS changes, and will further increase applicability of GRACE data for monitoring GWS.

Strassberg, Gil↗

DOE OSTI2025

Reference Correlations for the Density and Viscosity of Molten Alkali and Alkaline Earth Fluoride Salts

While there is a significant body of literature pertaining to thermophysical property measurements of molten salts, there is often a wide degree of variability among independent measurements of the same compounds. As such, the scientific community benefits greatly from an unbiased, independent assessment of duplicate datasets, so that reference correlations which describe these thermophysical properties as functions of temperature can be determined and then commonly used by researchers, scientists, and engineers. With regard to molten fluoride compounds, a significant time has elapsed since density and viscosity reference correlations have been determined; Janz conducted the most recent effort, in 1988, to provide reference correlations for the densities and viscosities of molten fluoride compounds via the National Standard Reference Data System coordinated by the National Bureau of Standards. Since then, new data have been published for molten fluoride compounds, and a new precedent has surfaced for putting forth reference correlations that involve fitting to multiple primary datasets. In this work, reference correlations are put forth for molten alkali and alkaline earth fluoride compounds in an effort to provide updated, improved correlations for general use. For molten alkali fluoride densities, estimated uncertainties with a 95% confidence interval are summarized as follows: LiF (0.63%), NaF (0.48%), KF (0.76%), RbF (0.93%), and CsF (0.75%). For molten alkaline earth fluoride densities, an estimated uncertainty was not able to be quantified for BeF 2 because of limited data; however, estimated uncertainties with a 95% confidence interval are summarized as follows for the remaining alkaline earth fluorides: MgF 2 (1.5%), CaF 2 (0.92%), SrF 2 (1.6%), and BaF 2 (0.23%). For molten alkali fluoride viscosities, uncertainty was not able to be quantified for RbF and CsF because of limited data; however, estimated uncertainties with a 95% confidence interval are summarized as follows for the remaining alkali fluorides: LiF (4.4%), NaF (3.0%), and KF (4.0%). For molten alkaline earth fluoride viscosities, limited consistent data resulted in the recommendation of single datasets (from literature) that are deemed to be the most trustworthy based on the quality of the underlying experimental studies.

Birri, A. [Oak Ridge National Laboratory (ORNL), O↗

DOE OSTI2021

Robust historical evapotranspiration trends across climate regimes

Evapotranspiration (ET) links the hydrological, energy and carbon cycles on the land surface. Quantifying ET and its spatio-temporal changes is also key to understanding climate extremes such as droughts, heatwaves and flooding. Regional ET estimates require reliable observation-based gridded ET datasets, and while many have been developed using physically based, empirically based and hybrid techniques, their efficacy, and particularly the efficacy of their uncertainty estimates, is difficult to verify. In this work, we extend the methodology used in Hobeichi et al. (2018) to derive two new versions of the Derived Optimal Linear Combination Evapotranspiration (DOLCE) product, with observationally constrained spatio-temporally varying uncertainty estimates, higher spatial resolution, more constituent products and extended temporal coverage (1980–2018). After demonstrating the efficacy of these uncertainty estimates with out-of-sample testing, we derive novel ET climatology clusters for the land surface, based on the magnitude and variability of ET at each location on land. The new clusters include three wet and three dry regimes and provide an approximation of Köppen–Geiger climate classes. The verified uncertainty estimates and extended time period then allow us to examine the robustness of historical trends spatially and in each of these six ET climatology clusters. We find that despite robust decreasing ET trends in some regions these do not correlate with behavioural ET clusters. Each cluster, and the majority of the Earth's surface, shows clear robust increases in ET over the recent historical period. The new datasets DOLCE V2.1 and DOLCE V3 can be used for benchmarking global ET estimates and for examining ET trends respectively.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1980

Uncertainty in estimates of the number of extraterrestrial civilizations

Estimation of the number N of communicative civilizations by means of Drake's formula involves the combination of several quantities, each of which is to some extent uncertain. The uncertainty in any quantity may be represented by a probability distribution function, even if that quantity is itself a probability. The uncertainty of current estimates of N is derived principally from uncertainty in estimates of the lifetime of advanced civilizations. It is argued that this is due primarily to uncertainty concerning the existence of a "Galactic Federation" which is in turn contingent upon uncertainty about whether the limitations of present-day physics are absolute or (in the event that there exists a yet-undiscovered "hyperphysics") transient . It is further argued that it is advantageous to consider explicitly these underlying assumptions in order to compare the probable numbers of civilizations operating radio beacons, permitting radio leakage, dispatching probes for radio surveillance or dispatching vehicles for manned surveillance.

Peter A Sturrock↗

DOE OSTI2025

Equation of State for the Thermodynamic Properties of Trans-1,2-dichloroethene [R-1130(E)]

We present an empirical equation of state in terms of the Helmholtz energy for trans-1,2-dichloroethene [R-1130(E)]. The range of validity is from the triple-point temperature, 223.31 K to 525 K with pressures up to 30 MPa. It may be used to calculate all thermodynamic properties in the fluid phase, including liquid, gas, and supercritical regions. Comparisons are given with existing literature data and estimated uncertainties are provided. In addition, checks were made for correct extrapolation behavior so that the equation behaves in a physically realistic manner when used outside of its range of validity, enabling its use in mixture models. The estimated uncertainties (at a k = 2 or 95 % level of confidence) are based on comparisons with critically assessed data and are 0.25 % for vapor pressure for temperatures in the range 300 K < T < 454 K, rising to 1.5 % as the temperature decreases from 300 K to 265 K. For density in the liquid phase the estimated uncertainty is 0.14 % for temperatures 270 K < T < 410 K and for pressures up to 30 MPa. For the vapor phase the estimated uncertainty in density is 3 %. The uncertainty for liquid-phase heat capacity is 1 % at atmospheric pressure over the temperature range 268 K < T < 309 K, and the uncertainty for the speed of sound in the liquid phase is 0.25 % for temperatures 230 K < T < 420 K and for pressures up to 30 MPa. The uncertainties are larger outside of these specified ranges and in the critical region.

1,2-Dichloroethene↗