Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

How Wrong Can the Operational AEP Uncertainty Estimate Be When We Ignore the Correlations Between the Uncertainty Components?

Calculations of wind farm annual energy production (AEP) on operational data are essential for a variety of financial transactions during the life of wind plants. The AEP estimate is associated with an uncertainty value, which is calculated by combining contributions connected to on-site measurements, long-term reference measurements, losses, regression, windiness adjustment, and wind resource interannual variability. Although very limited documentation on the topic exists, the conventional approach currently used by the wind energy community to assess the uncertainty connected to the operational AEP estimate assume that the different uncertainty components are uncorrelated and therefore calculates the overall uncertainty with a sum of squares approach. In this analysis, we contrast the traditional technique to estimate the overall AEP uncertainty by ignoring the correlation between its different components with a novel Monte Carlo based approach, which can instead take into account the correlation between different uncertainty categories. We consider monthly operational data from 472 wind farms from the Energy Information Administration (EIA) 923 database to assess the difference between the two approaches. Long-term wind speed data needed for the AEP assessment are taken from three reanalysis products: the Modern-Era Retrospective analysis for Research and Applications v2 (MERRA-2), the European Reanalysis Interim (ERA-interim), and the National Centers for Environmental Prediction v2 (NCEP-2). The results of the Monte Carlo approach show that three pairs of AEP uncertainty components do show a statistically significant correlation: the uncertainty connected with wind resource inter-annual variability is positively correlated with the one related to the windiness correction and negatively correlated with the one due to the regression, and the wind measurement uncertainty is positively correlated with the regression uncertainty. All these correlations, which are found between uncertainty components which are not only part of an operational analysis, but also of a wind resource assessment, are currently ignored in the conventional techniques used as industry standard. We further investigate the causes of these correlations, in terms of common dependencies of different uncertainty components on wind resource variability, number of data points, and quality of the regression between wind speed and energy production data. Next, we quantify the error in the current industry standard technique, in terms of the percentage difference in total uncertainty calculated with the two considered approaches, for all the analyzed wind farms. We find a mean absolute percentage difference of about 6%, with the largest differences being greater than 20%. The data clearly confirm that ignoring the actual correlation between the uncertainty components can lead to large errors in the assessment of the operational AEP uncertainty, and the proposed Monte Carlo approach should be preferred.

Monte Carlo↗
DOE OSTI2026

Deep Learning Reconstruction of Daily Soil CO 2 Efflux Reveals Biogeochemical Insights and Reduces Annual Estimate Uncertainty Despite Limited Daily Predictability

Soil CO 2 efflux is commonly measured monthly or seasonally, leaving daily dynamics poorly resolved and contributing to global estimation uncertainty. We trained a single Long Short-Term Memory (LSTM) model to predict daily soil CO 2 efflux across 82 globally distributed sites in COSORE, with 0.2%–46.9% daily data coverage from 2003 to 2020. Despite using far fewer sites than are typically used to train a single deep learning model, with observations biased toward temperate mesic sites, the LSTM model performed well at approximately one-third of sites, reconstructed nearly 2 decades of daily efflux, and outperformed commonly used approaches for estimating daily efflux when applied to the same data set. Performance was weakest at pronounced peaks and troughs and at non-temperate sites with <1.5 years of observations and irregular data patterns. Nevertheless, annual efflux from reconstructed daily data had <40% error even at underperforming sites, substantially improving estimates derived from monthly and seasonal sampling (maximum errors of 95% and 136%, respectively). Temperature sensitivity (Q 10 ) estimated from reconstructed daily predictions closely matched estimates from daily observations, whereas Q 10 values derived from monthly or seasonal observations deviated substantially, suggesting that coarse temporal sampling may contribute to uncertainty in reported Q 10 values. Consistent daily reconstructions further enabled trend analyses for well-performing, predominantly temperate sites and showed increasing soil CO 2 efflux at most sites from 2003 to 2020, with more variable summer trends. Despite limitations, these results demonstrate the potential of LSTM models to reconstruct daily soil CO 2 efflux and reduce estimation uncertainties from sparse observations.

Smykalov, Valerie [Pennsylvania State University, ↗
NASA NTRS2017

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗
DOE OSTI2020

NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018

This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Estimating Uncertainties in the SBUV Version 8.6 Merged Profile Ozone Data Set

The combined record of total and profile ozone measurements from the solar backscatter ultraviolet (SBUV) and SBUV/2 series of instruments, known as the SBUV Merged Ozone Data (MOD) product, constitutes the longest satellite-based ozone time series from a single instrument type and as such plays a key role in ozone trend analyses. Following the approach documented in Frith et al. (2014) to analyze the merging uncertainties in the MOD total ozone record, we use Monte Carlo simulations to estimate the potential for uncertainties in the calibration and drift of individual instruments in the profile ozone merged data set. We focus our discussion on the trends and associated merging uncertainty since 2001 in an effort to verify the start of ozone recovery as predicted by chemistry climate models. We find that merging uncertainty dominates the overall estimated uncertainty when considering only the 15 years of data since 2001. We derive trends versus pressure level for the MOD data set that are positive in the upper stratosphere as expected for ozone recovery. These trends appear to be significant when only statistical uncertainties are included but become not significant at the 2o level when instrument uncertainties are accounted for. However, when we use the entire data set from 1979 through 2015 and fit to the EESC (equivalent effective stratospheric chlorine) we find statistically significant fits throughout the upper stratosphere at all latitudes. This implies that the ozone profile data remain consistent with our expectation that chlorine is the dominant ozone forcing term.

Ozone profile↗
NASA NTRS2022

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.

Hydrology↗
DOE OSTI2024

Distribution System Behind-the-Meter DERs: Estimation, Uncertainty Quantification, and Control

This paper summarizes the three-year technical activities of the IEEE Task Force (TF) on behind-the-meter (BTM) distributed energy resources (DERs): estimation, uncertainty quantification, and control. The potential grid services from BTM DERs are discussed in detail. The paper also reviews the state-of-the-art for BTM DERs visibility, uncertainty quantification, and, optimization and control. Furthermore, different aspects of the market structures associated with BTM DERs are covered, including emerging market and business models. Finally, needs and recommendations are provided for additional areas such as system protection, computing capabilities, algorithm development, market structure design, cyberinfrastructure and security, and hardware and software developments.

behind-the-meter↗
DOE OSTI2020

A Bayesian Approach for Estimating Uncertainty in Stochastic Economic Dispatch considering Wind Power Penetration

The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To estimate the uncertainty in this stochastic economic dispatch problem for forecasting purposes, the conventional Monte-Carlo method is prohibitively time-consuming for practical applications. To overcome this problem, here we propose a novel Gaussian-process-emulator-based approach to quantify the uncertainty in the stochastic economic dispatch considering wind power penetration. Facing high-dimensional real-world data representing the correlated uncertainties from wind generation, a manifold-learning-based Isomap algorithm is proposed to efficiently represent the low-dimensional hidden probabilistic structure of the data. In this low-dimensional latent space, with Latin hypercube sampling as the computer experimental design, a Gaussian-process emulator is used, for the first time, to serve as a nonparametric, surrogate model for the original complicated stochastic economic dispatch model. This reduced-order representative allows us to evaluate the economic dispatch solver at sampled values with a negligible computational cost while maintaining a desirable accuracy. Simulation results conducted on the IEEE 118-bus test system reveal the impressive performance of the proposed method.

17 WIND ENERGY↗
DOE OSTI2021

A probability density function model describing height estimation uncertainty due to image pixel intensity noise in digital fringe projection measurements

Digital fringe projection is a surface-profiling technique used for highly accurate non-contact measurements. As with any measurement technique, a variety of sources degrade to the measurement accuracy of the method. Here, this paper presents an analytically-derived probability density function that explicitly models the surface height measurement error due to inevitable phase measurement error, and it includes the specific case of pixel noise inducing the phase measurement error that ultimately leads to the height estimation error. The accuracy of the model was validated through Monte-Carlo simulations of resultant height distributions subject to arbitrarily correlated pixel intensity noise and experimental digital fringe projection measurements where the pixel-by-pixel height uncertainty estimations were compared to the predictions of the derived model.

42 ENGINEERING↗
DOE OSTI2020

Towards real-time monitoring: data assimilated time-lapse full waveform inversion for seismic velocity and uncertainty estimation

SUMMARY Rapid development of time-lapse seismic monitoring instrumentations has made it possible to collect dense time-lapse data for tomographically retrieving time-lapse (even continuous) images of subsurface changes. While traditional time-lapse full waveform inversion (TLFWI) algorithms are designed for sparse time-lapse surveys, they lack of effective temporal constraint on time-lapse data, and, more importantly, lack of the uncertainty estimation of the TLFWI results that is critical for further interpretation. Here, we propose a new data assimilation TLFWI method, using hierarchical matrix powered extended Kalman filter (HiEKF) to quantify the image uncertainty. Compared to existing Kalman filter algorithms, HiEKF allows to store and update a data-sparse representation of the cross-covariance matrices and propagate model errors without expensive operations involving covariance matrices. Hence, HiEKF is computationally efficient and applicable to 3-D TLFWI problems. Then, we reformulate TLFWI in the framework of HiEKF (termed hereafter as TLFWI-HiEKF) to predict time-lapse images of subsurface spatiotemporal velocity changes and simultaneously quantify the uncertainty of the inverted velocity changes over time. We demonstrate the validity and applicability of TLFWI–HiEKF with two realistic CO2 monitoring models derived from Frio-II and Cranfield CO2 injection sites, respectively. In both 2-D and 3-D examples, the inverted high-resolution time-lapse velocity results clearly reveal a continuous velocity reduction due to the injection of CO2. Moreover, the accuracy of the model is increasing over time by assimilating more time-lapse data while the standard deviation is decreasing over lapsed time. We expect TLFWI-HiEKF to be equipped with real-time seismic monitoring systems for continuously imaging the distribution of subsurface gas and fluids in the future large-scale CO2 sequestration experiments and reservoir management.

58 GEOSCIENCES↗
NASA NTRS2003

Estimating Uncertainty in GPCP and TRMM Multi-Satellite Precipitation Estimates

One of the high-priority problems in satellite precipitation estimation is developing algorithms for estimating the errors in precipitation retrievals by individual sensors and subsequent multi-satellite combinations. Classically, we distinguish between "random" and "bias" errors, which do and do not, respectively average to zero over a "big enough" time/space sample. The current operational GPCP and TRMM multi-satellite algorithms are nearly unique in estimating random error for the monthly precipitation estimates from individual sensor systems (including gauge), following Huffman, and then making multi-sensor combinations. No routinely operational global precipitation produces estimates of bias error. Subsequently, a similar scheme has been followed to provide random error estimates for the Multi-satellite Precipitation Analysis (MPA) being computed in real time and after real time for TRMM. The Huffman algorithm for random error is briefly reviewed, including a discussion of the limitations imposed on the algorithm by standard monthly precipitation data sets. Starting from a very simple theoretical treatment of the histogram of precipitation samples in a month, an equation is developed that depends on the estimated average precipitation rate for the month, the number of samples in the month, and two constants. The constants are set separately for each source of precipitation estimate (such as "raingauge") by calibration at selected ground sites. We discuss recent work validating the random error estimates to highlight the successes and limitations of this first-generation approach. We then consider what information is needed from the individual sensor algorithms to facilitate additional accuracy in the estimation of random errors across the time/space span of climate regimes which a global estimation system must handle. In addition, the thorny issue of estimating bias is raised. Finally, the role of error estimates (and the qualitative errors!) in creating combinations of precipitation estimates from different individual sensors is discussed. This issue is particularly important when fine scales in space and time are being considered, say the 0.25 x 0.25-deg 3-hourly estimates in the MPA.

Huffman, G. J.↗
NASA NTRSDate not supplied

Lidar Simulations of Backscatter and Extinction Uncertainty Estimates for ACCP Assessments

As part of the NASA Aerosols and Clouds, Convection, and Precipitation (ACCP) pre-formulation study, several lidar instruments are being assessed for their capabilities in advancing the science objectives enumerated in the most recent Earth Sciences Decadal Survey. These assessments are conducted using the NASA Langley Research Center(LaRC) lidar simulator, which produces profiles of backscatter and extinction uncertainty estimates for a given set of input parameters. Specifically, attention is focused onevaluating the science benefits and improvements of a candidate two-wavelength space-based High Spectral Resolution Lidar (HSRL) compared to an elastic backscatter lidar with similar capabilities to the Cloud-Aerosol Lidar with Orthogonal Polarization(CALIOP), flying aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite. In this talk, simulations of satellite-based HSRL and those of a CALIOP-like system are compared for different atmospheric scenes that capture varying total aerosol loadings, aerosol vertical distributions, and aerosol types.The results of these analyses are presented as functions of averaging resolution(horizontal/vertical), lighting conditions (daytime/nighttime), surface type (land/ocean),and wavelength (532 nm/1064 nm). Also, simulations of multiple aerosol layers and of aerosols beneath transparent cirrus clouds are shown to demonstrate the consequent impacts on underlying backscatter and extinction uncertainties, and to better differentiate the performance of HSRL compared to that of CALIOP for real-world atmospheric scenarios.

Travis D. Toth↗
NASA NTRSDate not supplied

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

In this study, we assimilate Soil Moisture Active Passive (SMAP) mission brightness temperature (Tb) observations into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update surface and root-zone soil moisture simulations. Different time series components of the Tb observations are assimilated including anomalies, inter-annual variations, and high-frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the un-certainties of modeled and observed Tb is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. Results are compared to a benchmark experiment that mimics the operational SMAP Level-4 algorithm, which assimilates Tb observations using a spatially-constant 4 Kelvin (K) observation uncertainty. All DA experiments exhibit notable skill improvements in most regions. Improvements are greatest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for sur-face soil moisture simulations (0.06). Strikingly, however, no notable difference in skill—neither improvement nor deterioration—is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. We show, analytically, that this may be explained by the presence of large observation operator errors, which have the potential to render post-update uncertainty insensitive to inaccuracies in the Kalman gain.

Alexander Gruber↗
NASA NTRS2014

Estimating Uncertainty in Long Term Total Ozone Records from Multiple Sources

Total ozone measurements derived from the TOMS and SBUV backscattered solar UV instrument series cover the period from late 1978 to the present. As the SBUV series of instruments comes to an end, we look to the 10 years of data from the AURA Ozone Monitoring Instrument (OMI) and two years of data from the Ozone Mapping Profiler Suite (OMPS) on board the Suomi National Polar-orbiting Partnership satellite to continue the record. When combining these records to construct a single long-term data set for analysis we must estimate the uncertainty in the record resulting from potential biases and drifts in the individual measurement records. In this study we present a Monte Carlo analysis used to estimate uncertainties in the Merged Ozone Dataset (MOD), constructed from the Version 8.6 SBUV2 series of instruments. We extend this analysis to incorporate OMI and OMPS total ozone data into the record and investigate the impact of multiple overlapping measurements on the estimated error. We also present an updated column ozone trend analysis and compare the size of statistical error (error from variability not explained by our linear regression model) to that from instrument uncertainty.

TOMS and SBUV↗
DOE OSTI2022

Deep learning multiphysics network for imaging CO 2 saturation and estimating uncertainty in geological carbon storage

Multiphysics inversion exploits different types of geophysical data that often complement each other and aims to improve overall imaging resolution and reduce uncertainties in geophysical interpretation. Despite the advantages, traditional multiphysics inversion is challenging because it requires a large amount of computational time and intensive human interactions for preprocessing data and finding trade-off parameters. These issues make it nearly impossible for traditional multiphysics inversion to be applied as a real-time monitoring tool for geological carbon storage. In this paper, we present a deep learning (DL) multiphysics network for imaging CO 2 saturation in real time. The multiphysics network consists of three encoders for analysing seismic, electromagnetic and gravity data and shares one decoder for combining imaging capabilities of the different geophysical data for better predicting CO 2 saturation. The network is trained on pairs of CO 2 label models and multiphysics data so that it can directly image CO 2 saturation. Here we use the bootstrap aggregating method to enhance the imaging accuracy and estimate uncertainties associated with CO 2 saturation images. Using realistic CO 2 label models and multiphysics data derived from the Kimberlina CO 2 storage model, we evaluate the performance of the deep learning multiphysics network and compare its imaging results to those from the deep learning single-physics networks. Our modelling experiments show that the deep learning multiphysics network for seismic, electromagnetic, and gravity data not only improves the imaging accuracy but also reduces uncertainties associated with CO 2 saturation images. Our results also suggest that the deep learning multiphysics network for the non-seismic data (i.e., electromagnetic and gravity) can be used as an effective low-cost monitoring tool in between regular seismic monitoring.

58 GEOSCIENCES↗
NASA NTRS2013

Validation and Uncertainty Estimates for MODIS Collection 6 "Deep Blue" Aerosol Data

The "Deep Blue" aerosol optical depth (AOD) retrieval algorithm was introduced in Collection 5 of the Moderate Resolution Imaging Spectroradiometer (MODIS) product suite, and complemented the existing "Dark Target" land and ocean algorithms by retrieving AOD over bright arid land surfaces, such as deserts. The forthcoming Collection 6 of MODIS products will include a "second generation" Deep Blue algorithm, expanding coverage to all cloud-free and snow-free land surfaces. The Deep Blue dataset will also provide an estimate of the absolute uncertainty on AOD at 550 nm for each retrieval. This study describes the validation of Deep Blue Collection 6 AOD at 550 nm (Tau(sub M)) from MODIS Aqua against Aerosol Robotic Network (AERONET) data from 60 sites to quantify these uncertainties. The highest quality (denoted quality assurance flag value 3) data are shown to have an absolute uncertainty of approximately (0.086+0.56Tau(sub M))/AMF, where AMF is the geometric air mass factor. For a typical AMF of 2.8, this is approximately 0.03+0.20Tau(sub M), comparable in quality to other satellite AOD datasets. Regional variability of retrieval performance and comparisons against Collection 5 results are also discussed.

MODIS collection 6↗
NASA NTRS2017

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗