Engineering PapersSearch

Engineering topics

Liu, Qing

Publications and source records attributed to Liu, Qing.

At least 19 records

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan

A General Framework for Error-controlled Unstructured Scientific Data Compression

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression ratios. We present a multi-component, error-bounded compression framework designed to enhance the compression of floating-point unstructured mesh data, which is common in scientific applications. Our approach involves interpolating mesh data onto a rectilinear grid and then separately compressing the grid interpolation and the interpolation residuals. This method is general, independent of mesh types and typologies, and can be seamlessly integrated with existing lossy compressors for improved performance. We evaluated our framework across twelve variables from two synthetic datasets and two real-world simulation datasets. The results indicate that the multi-component framework consistently outperforms state-of-the-art lossy compressors on unstructured data, achieving, on average, a 2.3 − 3.5× improvement in compression ratios, with error bounds ranging from 1 × 10 the −6 to 1×10−2. We further investigate impact of hyperparameters, such as grid spacing and error allocation, to deliver optimal compression ratios in diverse datasets.

Gong, Qian

Land-Focused Changes in the Updated GEOS FP System (Version 5.25)

Many of the changes imposed in the January 2020 upgrade from Version 5.22 to 5.25 of the Goddard Earth Observing System (GEOS) Forward Processing (FP) analysis system were designed to increase the realism of simulated land variables. The changes, which consist of both land model parameter updates and improvements to the physical treatments employed for various land processes, have generally positive or neutral impacts on the character of the FP product, as documented here.

Koster, Randal D.

Spatial Correlation Structures in SMAP Near-Surface Soil Moisture (How Spatially Correlated are the Temporal Variations of Soil Moisture at Different Locations? and Why Is This of Interest?)

Spatial correlation structures can describe the degree to which soil moisture at a specified location co-varies in time with that at other, remote locations. Using four years of warm season SMAP Level 2 near-surface soil moisture data, we compute these spatial correlation structures for points across North America. The character of these structures is seen to differ geographically; the structures found for the west-central US, for example, are significantly more spatially extensive. We then demonstrate how these structures can potentially be used to reconstruct soil moisture fields during the pre-SMAP era. In this exercise, we consider as "truth" the soil moistures produced in a long-term offline land surface model simulation (1980-2014) that utilizes precipitation forcing based on a high density of precipitation gauges. Then, for a given location within the continent, we construct an"estimated" soil moisture time series based solely on historical soil moisture information simulated at least 300 km distant from the location, using the SMAP-based spatial correlation structures to determine how to make best use of the remote information. The reconstructed soil moistures are found to have significant skill relative to the assumed truth, suggesting that the same approach, when applied in areas of low rain gauge density (i.e., in areas for which historically simulated soil moistures are necessarily inaccurate), could provide useful historical soil moisture estimates through the SMAP-guided extraction of relevant information from neighboring gauged regions.

Koster, Randal

The SMAP Level-4 ECO Project: Improving Terrestrial Flux Estimates Through Coupled Hydrology-Vegetation Data Assimilation

Simulations of hydrologic and vegetation states as well as water, energy and carbon fluxes from the land surface to the atmosphere are crucial for a wide range of applications, including agricultural advisories, forecasts of (short-term) atmospheric behavior and seasonal weather predictions including forecasts of extreme events, such as heatwaves or droughts. The NASA Soil Moisture Active Passive (SMAP) mission Level-4 Eco-Hydrology (L4-ECO) project aims to improve modeled estimates of the terrestrial water, energy and carbon fluxes and states by developing a fully-coupled hydrology-vegetation data assimilation system. This system is developed around the NASA Goddard Earth Observing System (GEOS) Catchment-CN land surface model, which combines land hydrology and energy balance components of the GEOS Catchment model with dynamic vegetation components of the Community Land Model version 4. Catchment-CN fully couples the terrestrial water, energy and carbon cycles, allowing feedbacks from the land hydrology to the biosphere and vice versa.Here, we implement a calibration of the Catchment-CN vegetation parameterization against observations of the fraction of absorbed photosynthetically active radiation (FPAR) from the Moderate Resolution Imaging Spectroradiometer (MODIS) to improve the model's standalone skill. Later, the DA algorithm used to produce the SMAP L4 soil moisture product will be adapted to Catchment-CN to assimilate SMAP brightness temperatures and inform the model's land hydrology component. Finally, the DA system will be further extended to assimilate MODIS FPAR observations in order to constrain the model's dynamic vegetation component.In this presentation, we demonstrate that the Catchment-CN parameter calibration leads to more realistic vegetation simulations and reduces the root mean squared error between modeled and observed vegetation states across the model's various plant functional types. We also show that the assimilation of SMAP observations is able to improve the average correlation, bias and unbiased RMSE between the modeled surface and root zone soil moisture estimates, and ground observations from the SMAP core validation sites.

Kolassa, Jana

Recent Updates in the SMAP Level-4 Soil Moisture Algorithm

The NASA Soil Moisture Active Passive (SMAP) mission generates, among other data sets, the Level-4 Soil Moisture (L4_SM) product. The L4_SM data are published with a mean latency of ~2.5 days from the time of observation and provide global, three-hourly, 9-km resolution estimates of surface and root-zone soil moisture and related land surface states and fluxes. The L4_SM algorithm is based on the assimilation of SMAP radiometer brightness temperature observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF). In 2018, the L4_SM algorithm was upgraded from Version 3 to Version 4. Underlying the new version is a revised modeling system that includes improved input parameter datasets for land cover, topography, and vegetation height that are based on recent, high-quality, space-borne remote sensing observations. Additionally, SMAP Level-2 soil moisture retrievals and in situ soil moisture measurements were used to calibrate a particular Catchment model parameter that governs the recharge of surface soil moisture from below under non-equilibrium conditions, which brings the model's surface soil moisture more in line with the SMAP Level-2 and in situ soil moisture. Moreover, the calibration of the assimilated SMAP brightness temperatures changed substantially from Version 3 to Version 4, and the "catchment deficit" model variable was removed from the EnKF state vector to avoid degrading the model's groundwater estimates.Considerable effort went into the version upgrade, creating an expectation that the new version is improved over the old version. Indeed, some aspects of the new version are clearly better. However, other aspects are not. In this presentation we summarize the skill of the new and old versions vs. independent in situ measurements and in terms of data assimilation diagnostics, including, for example, the statistics of the (soil moisture) analysis increments and the observation-minus-forecast (brightness temperatures) residuals. We share our experience with trying to improve to the L4_SM product and the lessons learned from the effort.

Reichle, Rolf H.

Soil Moisture Active Passive (SMAP) Project Assessment Report for Version 4 of the L4_SM Data Product

This report provides an assessment of Version 4 of the SMAP Level 4 Surface and Root Zone Soil Moisture (L4_SM) product, released on 14 June 2018. The assessment includes comparisons of L4_SM soil moisture and temperature estimates with in situ measurements from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product, including observation-minus-forecast (O-F) brightness temperature residuals and soil moisture analysis increments.Together, the core validation site comparisons and the statistics of the assimilation diagnostics areconsidered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid-cell scale of the data product.The Version 4 L4_SM product benefits from an improved land surface modeling system and from retrospective surface meteorological forcing data that are as consistent as possible with the present-day datain terms of their climatology. Specifically, the model changes include revised parameters and parameterizations for (i) the surface energy balance, (ii) recharge from below of the model's surface excess reservoir, and (iii) the snow depletion curve. Updated ancillary inputs include improved datasets for landcover, topography, and vegetation height. The Version 4 algorithm further includes a revised approach to precipitation corrections that improves the precipitation climatology in Africa and the high-latitudes. Moreover, for system calibration the model is forced retrospectively with MERRA-2 reanalysis data, which are more consistent with the near-real time GEOS forward processing (FP) data used during the SMAP period than the retrospective GEOS data that were available for previous L4_SM versions. An analysis of the time-average surface and root zone soil moisture shows that the global pattern ofarid and humid regions is captured by the Version 4 L4_SM estimates. Owing to the changes in the landsurface modeling system, surface soil moisture is typically drier by several volumetric percent in Version 4 compared to Version 3, whereas root zone soil moisture is wetter in Version 4 in some regions and drierin others. Because of these climatological differences, the Version 3 and Version 4 products should not be combined into a single dataset for use in applications.Results from the core validation site comparisons indicate that Version 4 of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the RMSE after removal of the long-term mean difference (ubRMSE). The overall ubRMSE of the 3-hourly L4_SM dataat the 9 km scale is 0.039 m3 m-3 for surface soil moisture and 0.029 m3 m-3 for root zone soil moisture,below the 0.04 m3 m-3 requirement. The L4_SM estimates are an improvement over estimates from a model-only Nature Run version 7.2 (NRv7.2), which demonstrates the beneficial impact of the SMAP brightness temperature data. Overall, L4_SM surface and root zone soil moisture estimates are more skillful than NRv7.2 estimates, with statistically significant improvements at the 5% level for surface soil moisture R and anomaly R values. Results from comparisons of the L4_SM product to i

Reichle, Rolf H.

Improving the SMAP Level-4 Soil Moisture Product

The NASA Soil Moisture Active Passive (SMAP) mission generates, among other data sets, the Level 4 Soil Moisture (L4 SM) product. The L4 SM algorithm is based on the assimilation of SMAP radiometer brightness temperature observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. The L4 SM data are published with a mean latency of approx. 2.5 days from the time of observation and provide global, three-hourly, 9 km resolution estimates of surface and root-zone soil moisture and related land surface states and fluxes. In 2018, the product was upgraded from Version 3 to Version 4. Underlying the new version is a revised modeling system that includes improved input parameter datasets for land cover, topography, and vegetation height that are based on recent, high quality space-borne remote sensing observations. Land cover inputs were updated to the GlobCover2009 product, which is based on satellite observations from the Medium Resolution Imaging Spectrometer. Topographic statistics now rely on observations from the Shuttle Radar Topography Mission. Finally, vegetation height inputs are derived from space-borne Lidar measurements. Additionally, SMAP Level-2 soil moisture retrievals and in situ soil moisture measurements were used to calibrate a particular Catchment model parameter that governs the recharge of soil moisture from the models root-zone excess reservoir into the surface excess reservoir. Specifically, the replenishment of soil moisture near the surface from below under non-equilibrium conditions was substantially reduced, which brings the models surface soil moisture more in line with the SMAP Level 2 and in situ soil moisture. Finally, the calibration of the assimilated SMAP brightness temperatures changed substantially from Version 3 to Version 4. Considerable effort went into the version upgrade, creating an expectation that the new version is improved over the old version. Indeed, some aspects of the new version are clearly better. However, other aspects are not, and on balance, the overall improvement is modest at best. In this presentation we summarize the skill of the new and old versions vs. independent in situ measurements and in terms of data assimilation diagnostics, including, for example, the statistics of the (soil moisture) analysis increments and the observation minus forecast (brightness temperatures) residuals. We share our experience with trying to improve to the L4 SM product and the lessons learned from the effort.

Reichle, Rolf

Using Data Assimilation Diagnostics to Assess the SMAP Level-4 Soil Moisture Product

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx.2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

SMAP

Global Assessment of the SMAP Level-4 Soil Moisture Product Using Assimilation Diagnostics

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx. 2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

Reichle, Rolf

The SMAP Level-4 ECO Project: Linking the Terrestrial Water and Carbon Cycles

The SMAP (Soil Moisture Active Passive) Level-4 projects aims to develop a fully coupled hydrology-vegetation data assimilation algorithm to generate improved estimates of modeled hydrological fields and carbon fluxes. This includes using the new NASA Catchment-CN (Catchment-Carbon-Nitrogen) model, which combines the Catchment land surface hydrology model with dynamic vegetation components from the Community Land Model version 4 (CLM4). As such, Catchment-CN allows a more realistic, fully coupled feedback between the land hydrology and the biosphere. The L4 ECO project further aims to inform the model through the assimilation of Soil Moisture Active Passive (SMAP) brightness temperature observations as well as observations of Moderate Resolution Imaging Spectroradiometer (MODIS) fraction of absorbed photosynthetically active radiation (FPAR). Preliminary results show that the assimilation of SMAP observations leads to consistent improvements in the model soil moisture skill. An evaluation of the Catchment-CN modeled vegetation characteristics showed that a calibration of the model's vegetation parameters is required before an assimilation of MODIS FPAR observations is feasible.

MODIS

Version 3 of the SMAP Level 4 Soil Moisture Product

The NASA Soil Moisture Active Passive (SMAP) Level 4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root zone (0-100 cm) soil moisture as well as related land surface states and fluxes from 31 March 2015 to present with a latency of 2.5 days. The ensemble-based L4_SM algorithm is a variant of the Goddard Earth Observing System version 5 (GEOS-5) land data assimilation system and ingests SMAP L-band (1.4 GHz) Level 1 brightness temperature observations into the Catchment land surface model. The soil moisture analysis is non-local (spatially distributed), performs downscaling from the 36-km resolution of the observations to that of the model, and respects the relative uncertainties of the modeled and observed brightness temperatures. Prior to assimilation, a climatological rescaling is applied to the assimilated brightness temperatures using a 6 year record of SMOS observations. A new feature in Version 3 of the L4_SM data product is the use of 2 years of SMAP observations for rescaling where SMOS observations are not available because of radio frequency interference, which expands the impact of SMAP observations on the L4_SM estimates into large regions of northern Africa and Asia. This presentation investigates the performance and data assimilation diagnostics of the Version 3 L4_SM data product. The L4_SM soil moisture estimates meet the 0.04 m3m3 (unbiased) RMSE requirement. We further demonstrate that there is little bias in the soil moisture analysis. Finally, we illustrate where the assimilation system overestimates or underestimates the actual errors in the system.

GEOS-

Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the “Version 2” validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities.

SMAP L4_SM

Technical Report Series on Global Modeling and Data Assimilation, Volume 43: Initial Evaluation of the Climate - MERRA-2

The years since the introduction of MERRA have seen numerous advances in the GEOS-5 Data Assimilation System as well as a substantial decrease in the number of observations that can be assimilated into the MERRA system. To allow continued data processing into the future, and to take advantage of several important innovations that could improve system performance, a decision was made to produce MERRA-2, an updated retrospective analysis of the full modern satellite era. One of the many advances in MERRA-2 is a constraint on the global dry mass balance; this allows the global changes in water by the analysis increment to be near zero, thereby minimizing abrupt global interannual variations due to changes in the observing system. In addition, MERRA-2 includes the assimilation of interactive aerosols into the system, a feature of the Earth system absent from previous reanalyses. Also, in an effort to improve land surface hydrology, observations-corrected precipitation forcing is used instead of model-generated precipitation. Overall, MERRA-2 takes advantage of numerous updates to the global modeling and data assimilation system. In this document, we summarize an initial evaluation of the climate in MERRA-2, from the surface to the stratosphere and from the tropics to the poles. Strengths and weaknesses of the MERRA-2 climate are accordingly emphasized.

MERRA-2

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Assessment Report for the Beta-Release L4_SM Data Product - Volume 40

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public beta release scheduled for 30 October 2015. The primary objective of the beta release is to allow users to familiarize themselves with the data product before the validated product becomes available. The beta release also allows users to conduct their own assessment of the data and to provide feedback to the L4_SM science data product team. The assessment of the L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 1 validation and supports the beta release of the data. The validation against sparse network measurements and the evaluation of the assimilation diagnostics address Stage 2 validation criteria by expanding the assessment to regional and global scales.

ubRMSE

Land Boundary Conditions for the Goddard Earth Observing System Model Version 5 (GEOS-5) Climate Modeling System: Recent Updates and Data File Descriptions

The Earths land surface boundary conditions in the Goddard Earth Observing System version 5 (GEOS-5) modeling system were updated using recent high spatial and temporal resolution global data products. The updates include: (i) construction of a global 10-arcsec land-ocean lakes-ice mask; (ii) incorporation of a 10-arcsec Globcover 2009 land cover dataset; (iii) implementation of Level 12 Pfafstetter hydrologic catchments; (iv) use of hybridized SRTM global topography data; (v) construction of the HWSDv1.21-STATSGO2 merged global 30 arc second soil mineral and carbon data in conjunction with a highly-refined soil classification system; (vi) production of diffuse visible and near-infrared 8-day MODIS albedo climatologies at 30-arcsec from the period 2001-2011; and (vii) production of the GEOLAND2 and MODIS merged 8-day LAI climatology at 30-arcsec for GEOS-5. The global data sets were preprocessed and used to construct global raster data files for the software (mkCatchParam) that computes parameters on catchment-tiles for various atmospheric grids. The updates also include a few bug fixes in mkCatchParam, as well as changes (improvements in algorithms, etc.) to mkCatchParam that allow it to produce tile-space parameters efficiently for high resolution AGCM grids. The update process also includes the construction of data files describing the vegetation type fractions, soil background albedo, nitrogen deposition and mean annual 2m air temperature to be used with the future Catchment CN model and the global stream channel network to be used with the future global runoff routing model. This report provides detailed descriptions of the data production process and data file format of each updated data set.

GEOS-5

Observation-Corrected Precipitation Estimates in GEOS-5

Several GEOS-5 applications, including the GEOS-5 seasonal forecasting system and the MERRA-Land data product, rely on global precipitation data that have been corrected with satellite and or gauge-based precipitation observations. This document describes the methodology used to generate the corrected precipitation estimates and their use in GEOS-5 applications. The corrected precipitation estimates are derived by disaggregating publicly available, observationally based, global precipitation products from daily or pentad totals to hourly accumulations using background precipitation estimates from the GEOS-5 atmospheric data assimilation system. Depending on the specific combination of the observational precipitation product and the GEOS-5 background estimates, the observational product may also be downscaled in space. The resulting corrected precipitation data product is at the finer temporal and spatial resolution of the GEOS-5 background and matches the observed precipitation at the coarser scale of the observational product, separately for each day (or pentad) and each grid cell.

Data Assimilation

Connecting Satellite Observations with Water Cycle Variables Through Land Data Assimilation: Examples Using the NASA GEOS-5 LDAS

A land data assimilation system (LDAS) can merge satellite observations (or retrievals) of land surface hydrological conditions, including soil moisture, snow, and terrestrial water storage (TWS), into a numerical model of land surface processes. In theory, the output from such a system is superior to estimates based on the observations or the model alone, thereby enhancing our ability to understand, monitor, and predict key elements of the terrestrial water cycle. In practice, however, satellite observations do not correspond directly to the water cycle variables of interest. The present paper addresses various aspects of this seeming mismatch using examples drawn from recent research with the ensemble-based NASA GEOS-5 LDAS. These aspects include (1) the assimilation of coarse-scale observations into higher-resolution land surface models, (2) the partitioning of satellite observations (such as TWS retrievals) into their constituent water cycle components, (3) the forward modeling of microwave brightness temperatures over land for radiance-based soil moisture and snow assimilation, and (4) the selection of the most relevant types of observations for the analysis of a specific water cycle variable that is not observed (such as root zone soil moisture). The solution to these challenges involves the careful construction of an observation operator that maps from the land surface model variables of interest to the space of the assimilated observations.

Land data assimilation