Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluating WRF-Solar EPS cloud mask forecast using the NSRDB

Improving the accuracy of day-ahead solar forecasts using numerical weather prediction models requires improving the forecasting of cloud occurrence and properties. Validating cloud forecasts is challenging because this requires evaluating different types of clouds over a wide variety of regions. This study analyzes the cloud occurrence (or cloud mask) over the contiguous United States (CONUS), predicted by the Weather Research and Forecasting-Solar Ensemble Prediction System (WRF-Solar EPS), to identify the strengths and limitations of the model in reproducing cloud fields. To enable the in-depth analysis of cloud mask forecasts covering CONUS, we use satellite observations from the National Solar Radiation Database (NSRDB). Two evaluation methods are implemented to consider all clouds and partially removed clouds from the 2-km NSRDB in evaluating the 9-km WRF-Solar EPS cloud mask. Cloud detection metrics as well as the frequency of cloud occurrence are used to quantify the monthly performance of WRF-Solar EPS. Mismatched cloud frequency (MCF) is used to assess the model's capability to predict different types of clouds, which are classified using three levels of cloud optical depth (COD) and cloud top height (CTH). The day-ahead forecasts covering the full year of 2018 demonstrate that WRF-Solar EPS produces MCFs ranging from 27%-46%, 13%-34%, and 8%-19% for thin, mid-thickness, and thick clouds, respectively. For three CTH levels, the model shows MCFs ranging from 19%-46%, 16%-33%, and 8%-27% for low-level, middle-level, and high-level clouds, respectively. This comprehensive characterization of model performance helps identify model weakness and will eventually lead to improvements in cloud and solar radiation forecasting.

14 SOLAR ENERGY↗
NASA NTRS2005

A model to assess the Mars Telecommunications Network relay robustness

The relatively long mission durations and compatible radio protocols of current and projected Mars orbiters have enabled the gradual development of a heterogeneous constellation providing proximity communication services for surface assets. The current and forecasted capability of this evolving network has reached the point that designers of future surface missions consider complete dependence on it. Such designers, along with those architecting network requirements, have a need to understand the robustness of projected communication service. A model has been created to identify the robustness of the Mars Network as a function of surface location and time. Due to the decade-plus time horizon considered, the network will evolve, with emerging productive nodes and nodes that cease or fail to contribute. The model is a flexible framework to holistically process node information into measures of capability robustness that can be visualized for maximum understanding. Outputs from JPL's Telecom Orbit Analysis Simulation Tool (TOAST) provide global telecom performance parameters for current and projected orbiters. Probabilistic estimates of orbiter fuel life are derived from orbit keeping burn rates, forecasted maneuver tasking, and anomaly resolution budgets. Orbiter reliability is estimated probabilistically. A flexible scheduling framework accommodates the projected mission queue as well as potential alterations.

Mars Telecommunications Orbiter (MTO)↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Improving High-Resolution Weather Forecasts using the Weather Research and Forecasting (WRF) Model with an Updated Kain-Fritsch Scheme

Efforts to improve the prediction accuracy of high resolution (1-10 km) surface precipitation distribution and variability are of vital importance to local aspects of air pollution, wet deposition, and regional climate. However, precipitation biases and errors can occur at these spatial scales due to uncertainties in initial meteorological conditions and/or grid-scale cloud microphysics schemes. In particular, it is still unclear to what extent a subgrid-scale convection scheme could be modified to bring in scale-awareness for improving high-resolution short-term precipitation forecasts in the WRF model. To address these issues, we introduced scale-aware parameterized cloud dynamics for high-resolution forecasts by making several changes to the Kain-Fritsch (KF) convective parameterization scheme in the WRF model. These changes include subgrid-scale cloud-radiation interactions, a dynamic adjustment timescale, impacts of cloud updraft mass fluxes on grid-scale vertical velocity, and lifting condensation level-based entrainment methodology that includes scale dependency. A series of 48-hour retrospective forecasts using a combination of three treatments of convection (KF, updated KF, and the use of no cumulus parameterization), two cloud microphysics schemes and two types of initial condition datasets were performed over the U.S. southern Great Plains on 9- and 3-km grid spacings during the summers of 2002 and 2010. Results indicate that (1) the source of initial conditions play a key role in high-resolution precipitation forecasting, and (2) our updated KF scheme greatly alleviates the excessive precipitation at 9-km grid spacing and improves results at 3-km grid spacing as well. Overall, we found that the updated KF scheme incorporated into a high-resolution model does provide better forecasts for precipitation location and intensity.

convective parameterization↗
NASA NTRS1999

Design and Flight Performance of NOAA-K Spacecraft Batteries

The US National Oceanic and Atmospheric Administration (NOAA) operates the Polar Operational Environmental Satellite (POES) spacecraft (among others) to support weather forecasting, severe storm tracking, and meteorological research by the National Weather Service (NWS). The latest in the POES series of spacecraft, named as NOAA-KLMNN, is in orbit and four more are in various phases of development. The NOAA-K spacecraft was launched on May 13, 1998. Each of these spacecraft carry three Nickel-Cadmium batteries designed and manufactured by Lockheed Martin. The battery, which consists of seventeen 40 Ah cells manufactured by SAFT, provides the spacecraft power during the ascent phase, orbital eclipse and when the power demand is in excess of the solar array capability. The NOAA-K satellite is in a 98 degree inclination, 7:30AM ascending node orbit. In this orbit the satellite experiences earth occultation only 25% of the year. This paper provides a brief overview of the power subsystem, followed by the battery design and qualification, the cell life cycle test data, and the performance during launch and in orbit.

Rao, Gopalakrishna M.↗
NASA NTRS1998

Design and Flight Performance of NOAA-K Spacecraft Batteries

The US National Oceanic and Atmospheric Administration (NOAA) operates the Polar Operational Environmental Satellite (POES) spacecraft (among others) to support weather forecasting, severe storm tracking, and meteorological research by the National Weather Service (NWS). The latest in the POES series of spacecraft, named as NOAA-KLMNN', one is in orbit and four more are in various phases of development. The NOAA-K spacecraft was launched on May 13, 1998. Each of these spacecraft carry three Nickel-Cadmium batteries designed and manufactured by Lockheed Martin. The battery, which consists of seventeen 40 Ah cells manufactured by SAFT, provides the spacecraft power during the ascent phase, orbital eclipse and when the power demand is in excess of the solar array capability. The NOAA-K satellite is in a 98 degree inclination, 7:30AM ascending node orbit. In this orbit the satellite experiences earth occultation only 25% of the year. This paper provides a brief overview of the power subsystem, followed by the battery design and qualification, the cell life cycle test data, and the performance during launch and in orbit.

Rao, Gopalakrishna M.↗
DOE OSTI2021

Evaluating the performance of WRF urban schemes and PBL schemes over Dallas-Fort Worth during a dry summer and a wet summer

This study evaluated the Weather Research and Forecasting (WRF) model sensitivity to different planetary boundary layer (PBL) schemes (the YSU and MYJ schemes) and urban schemes including the bulk scheme (BULK), single-layer urban canopy model (UCM), multi-layer building environment parameterization (BEP) model, and multi-layer building energy model (BEM). Daily reinitialization simulations were conducted over Dallas-Fort Worth during a dry summer month (July 2011) and a wet summer month (July 2015) with weaker (stronger) daytime (nocturnal) UHI in 2011 than 2015. All urban schemes overestimated the urban daytime 2m temperature in both summers, but BEP and BEM still reproduced the daytime urban cool island in dry summer. All urban schemes reproduced the nocturnal urban heat island, with BEP producing the weakest one due to its unrealistic urban cooling. BULK and UCM overestimated the urban canopy wind speed, while BEP and BEM underestimated it. The urban schemes showed prominent impact on daytime PBL profiles. UCM+MYJ showed a superior performance than other configurations. The relatively large (small) aspect ratio between building height and road width in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy temperature. The relatively low (high) building height in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy wind speed. Improving urban schemes and providing realistic urban parameters were critical for improving urban canopy simulation.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Model Forecast Skill and Sensitivity to Initial Conditions in the Seasonal Sea Ice Outlook

We explore the skill of predictions of September Arctic sea ice extent from dynamical models participating in the Sea Ice Outlook (SIO). Forecasts submitted in August, at roughly 2 month lead times, are skillful. However, skill is lower in forecasts submitted to SIO, which began in 2008, than in hindcasts (retrospective forecasts) of the last few decades. The multimodel mean SIO predictions offer slightly higher skill than the single-model SIO predictions, but neither beats a damped persistence forecast at longer than 2 month lead times. The models are largely unsuccessful at predicting each other, indicating a large difference in model physics and/or initial conditions. Motivated by this, we perform an initial condition sensitivity experiment with four SIO models, applying a fixed −1 m perturbation to the initial sea ice thickness. The significant range of the response among the models suggests that different model physics make a significant contribution to forecast uncertainty.

Arctic Sea↗
DOE OSTI2026

A multi‐variable framework for selecting WRF physics configurations at convection‐permitting scales: An Amazon wet‐season case study

Tropical convection over rainforests modulates atmospheric circulation and the energy and hydrological cycles across multiple scales. However, the scarcity of observations still limits our understanding of these processes. Although numerical models are utilized to investigate atmospheric physical processes, their performance depends on the choice of parameterizations and grid resolution. Here, in this work, we introduce and apply a multi‐variable, multi‐physics framework to evaluate and rank the Advanced Research Weather Research and Forecasting (WRF–ARW) configurations at 1‐km resolution over the central Amazon during the wet season. A 48‐member ensemble combines three land‐surface models (LSMs), four planetary boundary layer (PBL), and four microphysics (MP) schemes. Model performance for seven convection‐related near‐surface and boundary‐layer variables is assessed using Taylor diagrams and the Taylor skill score (TSS), analysis of variance (ANOVA)‐based sensitivity metrics, and non‐parametric rank tests. We then construct a combined, weighted TSS to identify configurations that are comparatively robust across variables. Results showed that most configurations reproduce near‐surface temperature, sensible and latent heat fluxes, and boundary‐layer height reasonably well, whereas humidity and rainfall remain challenging. LSM choice has the strongest impact on the surface fluxes and a secondary influence on near‐surface temperature and humidity, PBL schemes dominate boundary‐layer height, and MP schemes exert the largest control on rainfall. No single configuration is optimal for all variables, but the combination of Noah (LSM), Yonsei University (PBL), and Morrison (MP) emerges as the most robust configuration for this case, with the WRF single‐moment six‐class scheme (WSM6) providing a competitive, computationally cheaper MP alternative. The framework is general and can be applied to other regions, seasons, and convective regimes.

Amazon rainforest↗
DOE OSTI2021

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗
NASA NTRS2014

The Impacts of Microphysics and Planetary Boundary Layer Physics on Model Simulations of U.S. Deep South Summer Convection

Convection-allowing numerical weather simula- tions have often been shown to produce convective storms that have significant sensitivity to choices of model physical parameterizations. Among the most important of these sensitivities are those related to cloud microphysics, but planetary boundary layer parameterizations also have a significant impact on the evolution of the convection. Aspects of the simulated convection that display sensitivity to these physics schemes include updraft size and intensity, simulated radar reflectivity, timing and placement of storm initi- ation and decay, total storm rainfall, and other storm features derived from storm structure and hydrometeor fields, such as predicted lightning flash rates. In addition to the basic parameters listed above, the simulated storms may also exhibit sensitivity to im- posed initial conditions, such as the fields of soil temper- ature and moisture, vegetation cover and health, and sea and lake water surface temperatures. Some of these sensitivities may rival those of the basic physics sensi- tivities mentioned earlier. These sensitivities have the potential to disrupt the accuracy of short-term forecast simulations of convective storms, and thereby pose sig- nificant difficulties for weather forecasters. To make a systematic study of the quantitative impacts of each of these sensitivities, a matrix of simulations has been performed using all combinations of eight separate microphysics schemes, three boundary layer schemes, and two sets of initial conditions. The first version of initial conditions consists of the default data from large-scale operational model fields, while the second features specialized higher- resolution soil conditions, vegetation conditions and water surface temperatures derived from datasets created at NASA's Short-term Prediction and Operational Research Tran- sition (SPoRT) Center at the National Space Science and Technology Center (NSSTC) in Huntsville, AL. Simulations as outlined above, each 48 in number, were conducted for five midsummer weakly sheared coastal convective events each at two sites, Mobile, AL (MOB) and Houston, TX (HGX). Of special interest to operational forecasters at MOB and HGX were accuracy of timing and placement of convective storm initiation, reflectivity magnitudes and coverage, rainfall and inferred lightning threat.

McCaul, Eugene W., Jr.↗
DOE OSTI2021

Concurrent Optimization of Capital Cost and Expected O&M

Concentrating solar power (CSP) technologies can utilize heat from concentrated sunlight from a field of tracking mirrors to generate electricity, reform fuel, provide process heat, or augment fossil plant heat sources. Electricity-generating power tower systems focus light from thousands of independent heliostats onto a thermal receiver, which uses the focused light to warm a heat transfer fluid (HTF), typically, a molten nitrate salt. The HTF is then sent to a power generation cycle or diverted into thermal energy storage (TES) for later use. Thermal storage is – in principle – a straightforward proposition. However, optimal utilization of a TES resource is complex and multi-faceted: thermal energy may be dispatched to produce electricity immediately upon first availability, or thermal energy may be reserved for next-day peak periods at risk of filling storage and dumping energy, or a portion of the thermal energy can be reserved to maintain equipment temperatures, reducing power cycle startup time, etc. Many possible dispatch permutations variously emphasize producing peak power, operating through transients, expediting daily startup, etc. The best operation strategy can change day-to-day throughout the year, depending on the weather and market pricing forecasts. The project we describe in this report develops a software package that allows users to explore design optimization, operations decisions, and performance characterization of concentrating solar power tower plants. Users interface with the tool through a scripting language, and results are reported in time series tables, plots, runtime logs, and design outputs. Users choose from a list of variables such as tower height, solar multiple, design-point irradiance, thermal storage size, etc., and specify information about the system using a list of parameters. The software can then optimize the specified variables to reduce the cost of energy produced by the system while meeting certain production requirements, accounting for uncertain weather and electricity price forecasts, and correcting for equipment failures or repair time. The software we develop is the first comprehensive design tool of its kind to incorporate all of these aspects while being deployed as open source.

14 SOLAR ENERGY↗
DOE OSTI2022

Convolutional neural networks for intra-hour solar forecasting based on sky image sequences

Accurate and timely solar forecasts play an increasingly critical role in power systems. Compared to longer forecasting timescales, very short-term solar forecasting has lagged behind in both research and practice. In this paper, we propose deep convolutional neural networks (CNNs) to provide operational intra-hour (10-minute-ahead to 60-minute-ahead) solar forecasts. We develop two CNN structures inspired by a widely-used CNN architecture. The CNNs are tailored to our solar forecasting regression tasks and rely solely on sky image sequences. Case studies based on six years of data (over 150,000 data points) demonstrate that the best CNN model has forecast skill scores of 20%-39% over the naive persistence of cloudiness benchmark, even at these very short timescales. The CNNs also have consistently superior performance when compared to shallow machine learning models with meteorological predictors, where the improvement averages around 7%. The sensitivity analyses show that the sky image length, resolution, and weather conditions have impacts on the deep learning model accuracy. In our intra-hour problem with specific setups, two sky images with a 10-minute 128 x 128 resolution yield the most accurate forecasts. Current limitations, future work, and deployment challenges and solutions are also discussed.

14 SOLAR ENERGY↗
DOE OSTI2023

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Temporal Convolutional Network Using Empirical Mode Decomposition to Detect Faults in Grid Connected Systems

Grid-connected power electronic systems require timely and reliable fault detection to prevent equipment damage and reduce downtime. This paper presents a forecasting-based anomaly detection pipeline that decomposes voltage and current measurements into intrinsic mode functions (IMFs) using empirical mode decomposition (EMD), then trains a causal temporal convolutional network (TCN) on normal-operation IMF data to predict short-horizon future dynamics. Deviations between forecasts and observations are summarized as reliability-weighted residual scores and thresholded per sensor using robust statistics with temporal persistence constraints to suppress false positives. To reduce runtime, EMD is performed on downsampled signals for detection, while raw-rate EMD is applied only within a short region of interest for high-frequency interpretability near detected events. Results on a simulated grid-connected converter system demonstrate that IMF-domain forecasting improves anomaly separability relative to raw-signal forecasting and provides interpretable evidence of faults across decomposition channels.

Sutton, Elizabeth [ORNL] (ORCID:0009000078885935)↗
NASA NTRS2011

Coupling Between Doppler Radar Signatures and Tornado Damage Tracks

On April 27, 2011, the southeastern United States was raked with several episodes of severe weather. Numerous tornadoes caused extensive damage, and tragically, the deaths of over 300 people. In Alabama alone, there were 61 confirmed tornados, 4 of them produced EF5 damage, and several were on the ground an hour or more with continuous damage tracks exceeding 80km. The use of Doppler radars covering the region provided reflectivity and velocity signatures that allowed forecasters to monitors the severe storms from beginning to end issuing hundreds of severe weather warnings throughout the day. Meteorologists from the the NWS performed extensive surveys to assess the intensity, duration, and ground track of tornadoes reported during the event. Survey activities included site visits to the affected locations, analysis of radar and satellite data, aerial surveys, and interviews with eyewitnesses. Satellite data from NASA's MODIS and ASTER instruments played a helpful role in determining the location of tornado damage paths and in the assessment. High resolution multispectral and temporal composites helped forecasters corroborate their damage assessments, determine starting and ending points for tornado touchdowns, and helped to provide forecasters with a better big-picture view of the damage region. The imagery also helped to separate damage from the April 27th tornados from severe weather that occurred earlier that month. In a post analysis of the outbreak, tornado damage path signatures observed in the NASA satellite data have been correlated to "debris ball" signatures in the NWS Doppler radars and a special ARMOR dual-polarization radar operated by the University of Alabama Huntsville during the event. The Doppler radar data indicates a circular enhanced reflectivity signal and rotational couplet in the radial velocity likely associated with the tornado that is spatially correlated with the damage tracks in the observed satellite data. An algorithm to detect and isolate the "debris ball" from precipitation signatures in the dual polarization radar data has been developed and verified using the NASA damage track data.

Jedlovec, Gary J.↗
DOE OSTI2021

Does Bayesian model averaging improve polynomial extrapolations? Two toy problems as tests

We assess the accuracy of Bayesian polynomial extrapolations from small parameter values, x, to large values of x. We consider a set of polynomials of fixed order, intended as a proxy for a fixed-order effective field theory (EFT) description of data. We employ Bayesian model averaging (BMA) to combine results from different order polynomials (EFT orders). Our study considers two 'toy problems' where the underlying function used to generate data sets is known. We use Bayesian parameter estimation to extract the polynomial coefficients that describe these data at low x. A 'naturalness' prior is imposed on the coefficients, so that they are $\mathcal{O}(1)$. We BMA different polynomial degrees by weighting each according to its Bayesian evidence and compare the predictive performance of this BMA with that of the individual polynomials. In conclusion, the credibility intervals on the BMA forecast have the stated coverage properties more consistently than does the highest evidence polynomial, though BMA does not necessarily outperform every polynomial.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗