Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗
NASA NTRS2021

The Contributions of Gauge-Based Precipitation and SMAP Brightness Temperature Observations to the Skill of the SMAP Level-4 Soil Moisture Product

Soil Moisture Active Passive (SMAP) mission L-band brightness temperature (Tb) observations are routinely assimilated into the Catchment land surface model to generate Level-4 Soil Moisture (L4_SM) estimates of global surface and root-zone soil moisture at 9-km, 3-hourly resolution with ~2.5-day latency. The Catchment model in the L4_SM algorithm is driven with ¼-degree, hourly surface meteorological forcing data from the Goddard Earth Observing System (GEOS). Outside of Africa and the high latitudes, GEOS precipitation is corrected using Climate Prediction Center Unified (CPCU) gauge-based, ½-degree, daily precipitation. L4_SM soil moisture was previously shown to improve over land model-only estimates that use CPCU precipitation but no Tb assimilation (CPCU_SIM). Here, we additionally examine the skill of model-only (CTRL) and Tb assimilation-only (SMAP_DA) estimates derived without CPCU precipitation. Soil moisture is assessed versus in situ measurements in well-instrumented regions and globally through the Instrumental Variable (IV) method using independent soil moisture retrievals from the Advanced Scatterometer. At the in situ locations, SMAP_DA and CPCU_SIM have comparable soil moisture skill improvements relative to CTRL for the unbiased root-mean-square error (surface and root-zone) and correlation metrics (root-zone only). In the global average, SMAP Tb assimilation increases the surface soil moisture anomaly correlation by 0.10-0.11 compared to an increase of 0.02-0.03 from the CPCU-based precipitation corrections. The contrast is particularly strong in central Australia, where CPCU is known to have errors and observation-minus-forecast Tb residuals are larger when CPCU precipitation is used. Validation versus streamflow measurements in the contiguous U.S. reveals that CPCU precipitation provides most of the skill gained in L4_SM runoff estimates over CTRL.

SMAP↗
NASA NTRS2022

Leveraging Pre-storm Soil Moisture Estimates for Enhanced Land Surface Model Calibration in Ungauged Hydrologic Basins

Despite long-standing efforts, hydrologists still lack robust tools for calibrating land surface model (LSM) streamflow estimates within ungauged basins. Using surface soil moisture estimates from the Soil Moisture Active Passive Level 4 Soil Moisture (L4_SM) product, precipitation observations, and streamflow gauge measurements for 617 medium-scale (200-10,000 km2) basins in the contiguous United States, we measure the temporal (Spearman) rank correlation between antecedent (i.e., pre-storm) surface soil moisture (ASM) and the storm-scale runoff coefficient (RC; the fraction of storm-scale precipitation accumulation converted into streamflow). In humid and semi-humid basins, this rank correlation is shown to be sufficiently strong to allow for the substitution of storm-scale RC observations (available only in basins that are both lightly regulated and gauged) with high-quality ASM values (available quasi-globally from L4_SM) in streamflow calibration procedures. Using this principle, we define a new, basin-wise LSM streamflow calibration approach based on L4_SM alone and successfully apply it to identify LSM configurations that produce a high rank correlation with observed RC. However, since the approach cannot detect RC bias, it is less successful in identifying LSM configurations with low mean-absolute error. Plain Text Summary Accurately forecasting the fraction of rainfall that runs off into streams, as opposed to infiltrates into the soil, is critical for flash-flood prediction, water-resource monitoring, and tracking the transport of nutrients from agricultural fields into local waterways. Such forecasting is typically performed by hydrologic models that attempt to represent the physical processes responsible for surface runoff generation. However, to provide accurate streamflow forecasts, these models typically need to be calibrated against actual streamflow observations. This is problematic given the relatively poor, and declining, global availability of stream gauges. This paper presents a novel model calibration strategy that uses soil moisture from remote sensing and numerical modeling in place of streamflow observations during calibration. This transition has significant practical advantages because, unlike streamflow observations, the soil moisture data are continuously available across space. Our results demonstrate that this new approach can significantly improve hydrologic models within humid and semi-humid basins lacking sufficient ground-based instrumentation for traditional streamflow calibration.

hydrologic models↗
NASA NTRS2020

Impact of Bias in the Marine Air Temperature Observation Set on Atmospheric Reanalyses

Marine air temperature observations are collected by volunteer observing ships carrying automatic meteorological sensor packages. Close proximity of the package mount to a dark colored ship's deck is known to introduce a warm bias on sunny afternoons in summer under low wind conditions. This observation set is used as an influential constraint in the MERRA-2 reanalysis, as well as several other reanalyses, in the poorly sampled surface marine boundary layer. Here we explore the consequences of bias in the marine air temperature observation set during the 36 year period 1980-2015. Marine air temperature observations have mainly been collected along major shipping routes, with the densest coverage in the North Atlantic and North Pacific. In the first part of this presentation we review the historical observation coverage and compare air temperature and contemporaneous SST measurements to identify systematic differences. The comparison suggests the presence of diurnal bias in the air temperature observations peaking in subtropics and midlatitudes latitudes in mid-afternoon local time. In the second part we explore the impact of the marine air temperature observations on MERRA-2 through analysis of the terms in the temperature forecast tendency equation, the equation which describes the contributions to changes in temperature during each analysis cycle. Examination of the temperature forecast tendency equation allows us to separate systematic errors due to such processes and radiation, mixing, and advection and allows us to identify the major source of systematic forecast tendencies. The results show that the marine air temperature measurements introduce an error that can reach 0.4K/dy which also peaks in local afternoon at subtropical latitudes. This bias varies with season and has gradually reduced from the beginning of the MERRA-2 reanalysis in 1980. In the final part we conduct numerical experiments with a version of the MERRA-2 analysis system, comparing experiments when the marine air temperature observations are included or withheld from the analysis system.

Akella, Santharam↗
NASA NTRS2001

A New Ensemble Canonical Correlation Prediction Scheme for Seasonal Precipitation

Department of Mathematical Sciences, University of Alberta, Edmonton, Canada This paper describes the fundamental theory of the ensemble canonical correlation (ECC) algorithm for the seasonal climate forecasting. The algorithm is a statistical regression sch eme based on maximal correlation between the predictor and predictand. The prediction error is estimated by a spectral method using the basis of empirical orthogonal functions. The ECC algorithm treats the predictors and predictands as continuous fields and is an improvement from the traditional canonical correlation prediction. The improvements include the use of area-factor, estimation of prediction error, and the optimal ensemble of multiple forecasts. The ECC is applied to the seasonal forecasting over various parts of the world. The example presented here is for the North America precipitation. The predictor is the sea surface temperature (SST) from different ocean basins. The Climate Prediction Center's reconstructed SST (1951-1999) is used as the predictor's historical data. The optimally interpolated global monthly precipitation is used as the predictand?s historical data. Our forecast experiments show that the ECC algorithm renders very high skill and the optimal ensemble is very important to the high value.

Kim, Kyu-Myong↗
NASA NTRS2001

TRMM Data Assimilation at NASA

We give an overview of the research at NASA in assimilating tropical rainfall and total precipitable water (TPW) retrievals derived from the TRMM Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments. Global analyses currently contain order-one errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. We show that an effective strategy to assimilate tropical rainfall data is to use observations to compensate for errors in moisture tendencies produced by the assimilation model. Results show that assimilating TMI and SSM/I surface rainrates and TPW estimates improves shortrange forecasts and reduces state-dependent systematic errors in the hydrological cycle and related climate parameters such as cloud, radiation, and the large-scale circulation in the tropics. The study provides a demonstration of the potential of using rainfall and moisture observations derived from passive microwave instruments to improve the quality of 4-dimensional global datasets for climate analysis and weather forecasting applications.

Hou, Arthur Y.↗
NASA NTRS2012

An OSSE on Mesoscale Model Assimilation of Simulated HIRAD-Observed Hurricane Surface Winds

The hazards of landfalling hurricanes are well known, but progress on improving the intensity forecasts of these deadly storms at landfall has been slow. Many cite a lack of high-resolution data sets taken inside the core of a hurricane, and the lack of reliable measurements in extreme conditions near the surface of hurricanes, as possible reasons why even the most state-of-the-art forecasting models cannot seem to forecast intensity changes better. The Hurricane Imaging Radiometer (HIRAD) is a new airborne microwave remote sensor for observing hurricanes, and is operated and researched by NASA Marshall Space Flight Center in partnership with the NOAA Atlantic Oceanographic and Meteorological Laboratory/Hurricane Research Division, the University of Central Florida, the University of Michigan, and the University of Alabama in Huntsville. This instrument?s purpose is to study the wind field of a hurricane, specifically observing surface wind speeds and rain rates, in what has traditionally been the most difficult areas for other instruments to study; the high wind and heavy rain regions. Dr. T. N. Krishnamurti has studied various data assimilation techniques for hurricane and monsoon rain rates, and this study builds off of results obtained from utilizing his style of physical initializations of rainfall observations, but obtaining reliable observations in heavy rain regions has always presented trouble to our research of high-resolution rainfall forecasting. Reliable data from these regions at such a high resolution and wide swath as HIRAD provides is potentially very valuable to mesoscale forecasting of hurricane intensity. This study shows how the data assimilation technique of Ensemble Kalman Filtering (EnKF) in the Weather Research and Forecasting (WRF) model can be used to incorporate wind, and later rain rate, data into a mesoscale model forecast of hurricane intensity. The study makes use of an Observing System Simulation Experiment (OSSE) with a simulated HIRAD dataset sampled during a hurricane and uses EnKF to forecast the track and intensity prediction of the hurricane. Comparisons to truth and error metrics are used to assess the model?s forecast performance.

Albers, Cerese↗
DOE OSTI2022

Forecasting distributed energy resources adoption for power systems

Failing to incorporate accurate distributed energy resource penetration forecasts into long-term resource and transmission planning can lead to cost inefficiencies at best and system failures at worst. We have developed an open-source tool that employs an advanced Bass specification to calibrate and forecast technology adoption. The advanced specification includes geographic clustering, exogenously estimated market size, and dynamic time steps. Training on historical adoption of rooftop photovoltaics at the U.S. county-level and using detailed techno-economic estimates, our model achieves a two-year average mean-absolute-percentage-error of 19% in predicting system counts at the county-level, weighted by population. Model error was negatively correlated with market maturity - the error was 12% for counties in states with at least 28 W-per-capita of installed capacity. The advanced specification significantly reduces unweighted forecasting percent error compared to a conventional Bass specification: from 196% to 25% for capacity and from 226% to 22% for system count.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Improved Prediction of Cold-Air Pools in the Weather Research and Forecasting Model Using a Truly Horizontal Diffusion Scheme for Potential Temperature

The terrain-following vertical coordinate system used by many atmospheric models, including the Weather Research and Forecasting (WRF) Model, is prone to errors in regions of complex terrain. These errors stem, in part, from the calculation of horizontal gradients within the diffusion term of the momentum or scalar evolution equations. In WRF, such gradients can be calculated along coordinate surfaces, or using metric terms that help account for grid skewness. However, neither of these options ensures a truly horizontal gradient calculation, especially if a grid cell is skewed enough that the heights of the neighboring grid points used in the calculation fall outside the vertical range of the cell. In this work, an improved scheme that uses Taylor series approximations to vertically interpolate variables to the level necessary for a truly horizontal gradient calculation is implemented in WRF for the diffusion of potential temperature. The scheme is validated using an atmosphere-at-rest configuration, in which spurious flows develop only as a result of numerical errors and can thus be used as a proxy for model performance. Following validation, the method is applied to the simulation of cold-air pools (CAPs), which occur in regions of complex terrain and are characterized by strong near-surface temperature gradients. Using the truly horizontal scheme, idealized simulations demonstrate reduced numerical mixing in a quiescent CAP, and a realistic case study in the Columbia River basin shows a reduction in positive wind speed bias by up to roughly 20% compared to observations from the Second Wind Forecast Improvement Project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Day-Ahead Probabilistic Forecasting of Net-Load and Demand Response Potentials with High Penetration of Behind-the-Meter Solar-plus-Storage

The goal of this project is to develop advanced methods for day-ahead net-load forecasting, by leveraging the state-of-the-art machine learning techniques. The developed models produce both point and probabilistic forecasts for a variety of use cases, and are versatile to work with different types of data sets. The innovation lies in the novel design of the architectures, leveraging the most recent advances in machine learning that have not been explored in power systems, accompanied by techniques in the broader artificial intelligence fields such as fuzzy systems. This project has achieved the following accomplishments: (1) preprocessing of over 10 data sets covering varying geographical regions, time horizons, and system levels, which form a robust foundation for training and evaluating forecasting models across a wide range of realistic grid scenarios; (2) development of an interactive web app that enables exploratory analysis of load and generation data, and supports better understanding of data trends, anomalies, and correlations, facilitating model development and stakeholder engagement; (3) implementation of over 10 benchmark models for point and probabilistic forecasting, which include a mix of conventional machine learning methods and state-of-the-art deep learning approaches, providing a comprehensive baseline for performance comparison and validation of the proposed models; (4) development of a fuzzy system based gradient boosting model, tailored for small (less than 3 years) data sets, which achieves a mean absolute percentage error (MAPE) of 4% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (5) development of a Transformer (a state-of-the-art deep learning architecture) based neural network model, tailored for large (3 years or more) data sets, which achieves a MAPE of 2% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (6) development of a methodology for quantifying DR potential, and extensions of the previous models for multi-target forecasting of net load and DR potential, which achieve a MAPE of 10% for DR potential.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Probabilistic Day-Ahead Forecasting Using an Analog Ensemble Approach for Wind Farm Grid Services

Wind resource assessment and wind power forecasting are used in research and industry to anticipate future power output at scales ranging from individual wind turbines to entire wind farms. Probabilistic day-ahead wind forecasting is useful for anticipating how a wind farm could potentially participate in the day-ahead market by providing upper and lower bounds for expected power generation, thus informing grid operators of its uncertainty. Understanding this uncertainty is part of a larger project focused on building a platform that combines efforts in weather forecasting, aerodynamic and economic modeling to create maximum value of a wind plant to better provide services to the grid. This effort is also known as the Atmosphere to Electrons to Grid (A2E2G) project. One method for producing a probabilistic forecast is through the analog ensemble approach (Delle Monache et al., 2011). This method leverages historical forecasts and their corresponding observations as a training data set from which future forecasts can be made. For some future forecast, the most similar historical forecasts (analogs) are identified on a regular time basis such as once per a 3-hour window. The most similar analogs, based on a metric such as root mean square error (RMSE), are recorded and their corresponding verifying observations are used as an ensemble member for this future forecast. Prior work in this area demonstrates improvements over raw Numerical Weather Prediction (NWP) forecasts and shows skill similar to techniques such as logistic regression and machine learning (Delle Monache et al., 2013; Alessandrini et al., 2015). Here, we take the High-Resolution Rapid Refresh model (HRRR) day-ahead forecast (0-36 hours) to create a probabilistic day-ahead forecast using an analog ensemble approach. The HRRR has an hourly temporal resolution, with a spatial resolution of 3 km. The 12 UTC HRRR model run is downloaded every day for one year from August 2019 - July 2020, with the first 11 months serving as a bank of analogs from which the forecasting algorithm can create a probabilistic forecast. Once downloaded, the original HRRR forecast is temporally interpolated to 5-minutes, aligning with both the temporal resolution of the observations as well as the timescale relevant for day-ahead power forecasts. The forecast is validated at the M2 tower at the Flatirons Campus of the National Renewable Energy Laboratory (NREL) at a typical wind turbine height of 80 m. Variables such as wind speed, wind direction, and turbulence intensity are incorporated into the probabilistic forecast model and weighted according to their relative importance to the forecast. Based on metrics such as mean bias error (MBE), mean absolute error (MAE), and root mean square error, the analog ensemble forecast outperforms the raw HRRR forecast during the testing period of July 2020. Figure 1 illustrates an example day-ahead forecast compared against the verifying observations. The general variability and ramps are captured throughout the day, with potential to further improve the analog ensemble model through machine learning techniques.

numerical weather prediction↗
NASA NTRS1991

Fitting dynamic models to the Geosat sea level observations in the tropical Pacific Ocean. I - A free wave model

Free, equatorially trapped sinusoidal wave solutions to a linear model on an equatorial beta plane are used to fit the Geosat altimetric sea level observations in the tropical Pacific Ocean. The Kalman filter technique is used to estimate the wave amplitude and phase from the data. The estimation is performed at each time step by combining the model forecast with the observation in an optimal fashion utilizing the respective error covariances. The model error covariance is determined such that the performance of the model forecast is optimized. It is found that the dominant observed features can be described qualitatively by basin-scale Kelvin waves and the first meridional-mode Rossby waves. Quantitatively, however, only 23 percent of the signal variance can be accounted for by this simple model.

Fu, Lee-Lueng↗
NASA NTRS2003

Variational Continuous Assimilation of TMI and SSM/I Rain Rates: Impact on GEOS-3 Hurricane Analyses and Forecasts

We describe a variational continuous assimilation (VCA) algorithm for assimilating tropical rainfall data using moisture and temperature tendency corrections as the control variable to offset model deficiencies. For rainfall assimilation, model errors are of special concern since model-predicted precipitation is based on parameterized moist physics, which can have substantial systematic errors. This study examines whether a VCA scheme using the forecast model as a weak constraint offers an effective pathway to precipitation assimilation. The particular scheme we exarnine employs a '1+1' dimension precipitation observation operator based on a 6-h integration of a column model of moist physics from the Goddard Earth Observing System (GEOS) global data assimilation system DAS). In earlier studies, we tested a simplified version of this scheme and obtained improved monthly-mean analyses and better short-range forecast skills. This paper describes the full implementation ofthe 1+1D VCA scheme using background and observation error statistics, and examines how it may improve GEOS analyses and forecasts of prominent tropical weather systems such as hurricanes. Parallel assimilation experiments with and without rainfall data for Hurricanes Bonnie and Floyd show that assimilating 6-h TMI and SSM/I surfice rain rates leads to more realistic storm features in the analysis, which, in turn, provide better initial conditions for 5-day storm track prediction and precipitation forecast. These results provide evidence that addressing model deficiencies in moisture tendency may be crucial to making effective use of precipitation information in data assimilation.

Hou, Arthur Y.↗
DOE OSTI2020

Assessing Uncertainties and Approximations in Solar Heating of the Climate System

In calculating solar radiation, climate models make many simplifications, in part to reduce computational cost and enable climate modeling, and in part from lack of understanding of critical atmospheric information. Whether known errors or unknown errors, the community's concern is how these could impact the modeled climate. The simplifications are well known and most have published studies evaluating them, but with individual studies it is difficult to compare. Here, we collect a wide range of such simplifications in either radiative transfer modeling or atmospheric conditions and assess potential errors within a consistent framework on climate-relevant scales. We build benchmarking capability around a solar heating code (Solar-J) that doubles as a photolysis code for chemistry and can be readily adapted to consider other errors and uncertainties. The broad classes here include: use of broad wavelength bands to integrate over spectral features; scattering approximations that alter phase function and optical depths for clouds and gases; uncertainty in ice-cloud optics; treatment of fractional cloud cover including overlap; and variability of ocean surface albedo. We geographically map the errors in W m -2 using a full climate re-creation for January 2015 from a weather forecasting model. For many approximations assessed here, mean errors are ~2 W m -2 with greater latitudinal biases and are likely to affect a model’s ability to match the current climate state. Combining this work with previous studies, we make priority recommendations for fixing these simplifications based on both the magnitude of error and the ease or computational cost of the fix.

58 GEOSCIENCES↗
NASA NTRS2001

Improved Use of Satellite Imagery to Forecast Hurricanes

This project tested a novel method that uses satellite imagery to correct phase errors in the initial state for numerical weather prediction, applied to hurricane forecasts. The system was tested on hurricanes Guillermo (1997), Felicia (1997) and Iniki (1992). We compared the performance of the system with and without phase correction to a procedure that uses bogus data in the initial state, similar to current operational procedures. The phase correction keeps the hurricane on track in the analysis and is far superior to a system without phase correction. Compared to operational procedure, phase correction generates somewhat worse 3-day forecast of the hurricane track, but better forecast of intensity. It is believed that the phase correction module would work best in the context of 4-dimensional variational data assimilation. Very little modification to 4DVar would be required.

Louis, Jean-Francois↗
NASA NTRS1987

Predictability in the extended range

This paper describes the results of extended range predictability experiments using an efficient two-level spherical quasi-geostrophic model. The experiments have an initial rms doubling time of about two days. This growth rate, along with an initial error of about one-half the initial error of present operational models, produces an rms error equal to the climatological rms error and a correlation of 0.5 on about day 12 of the forecast. On the largest scales, this limiting point is reached shortly thereafter. The error continues to grow at a decreasing rate until at about 30 days the forecast skill is extremely small and comparable to the skill of a persistence forecast. Various time averages at various lags are examined for skill in the extended range. Filters that weighted most strongly in the initial forecast days provide increased skill.

Roads, John O.↗
NASA NTRS1986

Ground-based time-guidance algorithm for control of airplanes in a time-metered air traffic control environment: A piloted simulation study

The rapidly increasing costs of flight operations and the requirement for increased fuel conservation have made it necessary to develop more efficient ways to operate airplanes and to control air traffic for arrivals and departures to the terminal area. One concept of controlling arrival traffic through time metering has been jointly studied and evaluated by NASA and ONERA/CERT in piloted simulation tests. From time errors attained at checkpoints, airspeed and heading commands issued by air traffic control were computed by a time-guidance algorithm for the pilot to follow that would cause the airplane to cross a metering fix at a preassigned time. These tests resulted in the simulated airplane crossing a metering fix with a mean time error of 1.0 sec and a standard deviation of 16.7 sec when the time-metering algorithm was used. With mismodeled winds representing the unknown in wind-aloft forecasts and modeling form, the mean time error attained when crossing the metering fix was increased and the standard deviation remained approximately the same. The subject pilots reported that the airspeed and heading commands computed in the guidance concept were easy to follow and did not increase their work load above normal levels.

Knox, C. E.↗
NASA NTRS2010

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗