Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Data assimilation and model evaluation experiment datasets

The Institute for Naval Oceanography, in cooperation with Naval Research Laboratories and universities, executed the Data Assimilation and Model Evaluation Experiment (DAMEE) for the Gulf Stream region during fiscal years 1991-1993. Enormous effort has gone into the preparation of several high-quality and consistent datasets for model initialization and verification. This paper describes the preparation process, the temporal and spatial scopes, the contents, the structure, etc., of these datasets. The goal of DAMEE and the need of data for the four phases of experiment are briefly stated. The preparation of DAMEE datasets consisted of a series of processes: (1) collection of observational data; (2) analysis and interpretation; (3) interpolation using the Optimum Thermal Interpolation System package; (4) quality control and re-analysis; and (5) data archiving and software documentation. The data products from these processes included a time series of 3D fields of temperature and salinity, 2D fields of surface dynamic height and mixed-layer depth, analysis of the Gulf Stream and rings system, and bathythermograph profiles. To date, these are the most detailed and high-quality data for mesoscale ocean modeling, data assimilation, and forecasting research. Feedback from ocean modeling groups who tested this data was incorporated into its refinement. Suggestions for DAMEE data usages include (1) ocean modeling and data assimilation studies, (2) diagnosis and theoretical studies, and (3) comparisons with locally detailed observations.

Lai, Chung-Cheng A.↗

Evaluation of remote sensing-based evapotranspiration products at low-latitude eddy covariance sites

Remote sensing-based evapotranspiration (ET) products have been evaluated primarily using data from northern middle latitudes; therefore, little is known about their performance at low latitudes. To address this bias, an evaluation dataset was compiled using eddy covariance data from 40 sites between latitudes 30° S and 30° N. The flux data were obtained from the emerging network in Mexico (MexFlux) and from openly available databases of FLUXNET, AsiaFlux, and OzFlux. This unique reference dataset was then used to evaluate remote sensing-based ET products in environments that have been underrepresented in earlier studies. The evaluated products were: MODIS ET (MOD16, both the discontinued collection 5 (C5) and the latest collection (C6)), Global Land Evaporation Amsterdam Model (GLEAM) ET, and Atmosphere-Land Exchange Inverse (ALEXI) ET. Products were compared with unadjusted fluxes (ETorig) and with fluxes corrected for the lack of energy balance closure (ETebc). Three common statistical metrics were used: coefficient of determination (R2), root mean square error (RMSE), and percent bias (PBIAS). The effect of a vegetation mismatch between pixel and site on product evaluation results was investigated by examining the relationship between the statistical metrics and product-specific vegetation match indexes. Evaluation results of this study and those published in the literature were used to examine the performance of the products across latitudes. Differences between the MOD16 collection 5 and 6 datasets were generally smaller than differences with the other products. Performance and ranking of the evaluated products depended on whether ETorig or ETebc was used. When using ETorig, GLEAM generally had the highest R2, smallest PBIAS, and best RMSE values across the studied land cover types and climate zones. Neither MOD16 nor ALEXI performed consistently better than the other. When using ETebc, none of the products stood out in terms of both low bias and strong correlations. The use of ETebc instead of ETorig affected the biases more than the correlations. The product evaluation results showed no significant relationship with the degree of match between the vegetation at the pixel and site scale. The latitudinal comparison showed tendencies of lower R2 (all products) but better PBIAS and normalized RMSE values (MOD16 and GLEAM) for forests at low latitudes than for forests at northern middle latitudes. For non-forest vegetation, the products showed no clear latitudinal differences in performance.

Diego Salazar-Martínez↗

Comparison of Dust Optical Depth From Multi-Sensor Products and MONARCH (Multiscale Online Non-hydrostatic AtmospheRe CHemistry) Dust Reanalysis Over North Africa, the Middle East, and Europe

Aerosol reanalysis datasets are model-based, observationally constrained, continuous 3D aerosol fields with a relatively high temporal frequency that can be used to assess aerosol variations and trends, climate effects, and impacts on socioeconomic sectors, such as health. Here we compare and assess the recently published MONARCH (Multiscale Online Non-hydrostatic AtmospheRe CHemistry) high-resolution regional desert dust reanalysis over northern Africa, the Middle East, and Europe (NAMEE) with a combination of ground-based observations and space-based dust retrievals and products. In particular, we compare the total and coarse dust optical depth (DOD) from the new reanalysis with DOD products derived from MODIS (MODerate resolution Imaging Spectroradiometer), MISR (Multi-angle Imaging SpectroRadiometer), and IASI (Infrared Atmospheric Sounding Interferometer) spaceborne instruments. Despite the larger uncertainties, satellite-based datasets provide a better geographical coverage than ground-based observations, and the use of different retrievals and products allows at least partially overcoming some single-product weaknesses in the comparison. Nevertheless, limitations and uncertainties due to the type of sensor, its operating principle, its sensitivity, its temporal and spatial resolution, and the methodology for retrieving or further deriving dust products are factors that bias the reanalysis assessment. We, therefore, also use ground-based DOD observations provided by 238 stations of the AERONET (AErosol RObotic NETwork) located within the NAMEE region as a reference evaluation dataset. In particular, prior to the reanalysis assessment, the satellite datasets were evaluated against AERONET, showing moderate underestimations in the vicinities of dust sources and downwind regions, whereas small or significant overestimations, depending on the dataset, can be found in the remote regions. Taking these results into consideration, the MONARCH reanalysis assessment shows that total and coarse-DOD simulations are consistent with satellite- and ground-based data, qualitatively capturing the major dust sources in the area in addition to the dust transport patterns. Moreover, the MONARCH reanalysis reproduces the seasonal dust cycle, identifying the increased dust activity that occurred in the NAMEE region during spring and summer. The quantitative comparison between the MONARCH reanalysis DOD and satellite multi-sensor products shows that the reanalysis tends to slightly overestimate the desert dust that is emitted from the source regions and underestimate the transported dust over the outflow regions, implying that the model's removal of dust particles from the atmosphere, through deposition processes, is too effective. More specifically, small positive biases are found over the Sahara desert (0.04) and negative biases over the Atlantic Ocean and the Arabian Sea (−0.04), which constitute the main pathways of the long-range dust transport. Considering the DOD values recorded on average there, such discrepancies can be considered low, as the low relative bias in the Sahara desert (< 50 %) and over the adjacent maritime regions (< 100 %) certifies. Similarly, over areas with intense dust activity, the linear correlation coefficient between the MONARCH reanalysis simulations and the ensemble of the satellite products is significantly high for both total and coarse DOD, reaching 0.8 over the Middle East, the Atlantic Ocean, and the Arabian Sea and exceeding it over the African continent. Moreover, the low relative biases and high correlations are associated with regions for which large numbers of observations are available, thus allowing for robust reanalysis assessment.

Michail Mytilinaios↗

The Top-of-Atmosphere, Surface and Atmospheric Cloud Radiative Kernels Based on ISCCP-H Datasets: Method and Evaluation

This study aims to create observation-based cloud radiative kernel (CRK) datasets and evaluate them by direct comparison of CRK and the CRK-derived cloud feedback datasets. Based on the International Satellite Cloud Climatology Project (ISCCP) H datasets, we calculate CRKs (called ISCCP-FH or FH CRKs) as 2D joint function/histogram of cloud optical depth and cloud top pressure for shortwave (SW), longwave (LW), and their sum, Net, at the top of atmosphere (TOA), as well as, for the first time, at the surface (SFC) and in the atmosphere (ATM). With cloud fraction change (CFC) datasets from doubled-CO2 simulation and short-term observational anomalies, we derive all the TOA, SFC and ATM cloud feedback for SW, LW and Net using our CRKs.The direct comparison with modeled and observed CRKs (or cloud radiative effects), cloud feedback from previous model results and the Clouds and the Earth's Radiant Energy System products show that our CRKs and CRK-derived cloud feedback are reasonably well validated. We estimate the uncertainty for the CRK-derived cloud feedback and show that the CFC-associated uncertainty contributes >98.5% of the total cloud feedback uncertainty while CRK's is very small. Our preliminary evaluation also shows that some near-zero/small cloud feedback in the TOA-alone feedback indeed results from the compensation of sizable cloud feedback of the SFC and ATM feedback and reveals some significant surface and atmospheric cloud feedback whose sum appears insignificant in TOA-alone feedback. In addition, the atmospheric longwave cloud feedback seems to play a role in enhancing meridional atmospheric energy transport.

cloud radiative kernel↗

Harmonizing Multi-Disciplinary Data for Applied Research: A Comprehensive Analysis of GES DISC Datasets through NLP and TF-IDF Techniques

Data centers distribute data encompassing multiple disciplines, making it necessary to evaluate dataset applicability to applied research. Typically, these datasets are generated by specialized science teams and consist of single-discipline data, such as atmospheric temperature, pressure, and precipitation, leading to unique dataset formats and access services. However, in applied research, the utilization of datasets from multiple disciplines is commonly necessary. The increasing availability of research literature citing Earth Science datasets presents an opportunity to analyze the usage of datasets in multi-disciplinary research. This study proposes a novel approach wherein research publications citing datasets archived at the GES DISC (Goddard Earth Sciences Data and Information Services Center) are collected, and each publication is associated with specific research topics through the application of Natural Language Processing (NLP), using the Term Frequency Inverse Document Frequency (TF-IDF) technique on the publication titles and abstracts. Through this analysis, we gain insights into the distribution of dataset disciplines as they are being used in various applied research areas. This knowledge is essential for the development of dataset tools and services tailored to effectively support applied research studies, as it enhances a data center's comprehension of how datasets from multiple disciplines are integrated into research endeavors.

Infometrics↗

A 30+ Year AVHRR LAI and FAPAR Climate Data Record: Algorithm Description, Validation, and Case Study

In- land surface models, which are used to evaluate the role of vegetation in the context ofglobal climate change and variability, LAI and FAPAR play a key role, specifically with respect to thecarbon and water cycles. The AVHRR-based LAIFAPAR dataset offers daily temporal resolution,an improvement over previous products. This climate data record is based on a carefully calibratedand corrected land surface reflectance dataset to provide a high-quality, consistent time-series suitablefor climate studies. It spans from mid-1981 to the present. Further, this operational dataset is availablein near real-time allowing use for monitoring purposes. The algorithm relies on artificial neuralnetworks calibrated using the MODIS LAI/FAPAR dataset. Evaluation based on cross-comparisonwith MODIS products and in situ data show the dataset is consistent and reliable with overalluncertainties of 1.03 and 0.15 for LAI and FAPAR, respectively. However, a clear saturation effect isobserved in the broadleaf forest biomes with high LAI (greater than 4.5) and FAPAR (greater than 0.8) values.

MODIS↗

Long-Term, Non-Anthropogenic Groundwater Storage Changes Simulated by Three Global-Scale Hydrological Models

This study examined long-term, natural (i.e., excluding anthropogenic impacts) variability of groundwater storage worldwide. Groundwater storage changes were estimated by forcing three global-scale hydrological models with three 50+ year meteorological datasets. Evaluation using in situ groundwater observations from the U.S. and terrestrial water storage derived from the Gravity Recovery and Climate Experiment (GRACE) satellites showed that these models reasonably represented inter-annual variability of water storage, as indicated by correlations greater than 0.5 in most regions. Empirical orthogonal function analysis revealed influences of the El Niño Southern Oscillation (ENSO) on global groundwater storage. Simulated groundwater storage, including its global average, exhibited trends generally consistent with that of precipitation. Global total (natural) groundwater storage decreased over the past 5-7 decades with modeled rates ranging from 0.01 to 2.18 mm year-1. This large range can be attributed in part to groundwater’s low frequency (inter-decadal) variability, which complicates identification of real long-term trends even within a 50+ year time series. Results indicate that non-anthropogenic variability in groundwater storage is substantial, making knowledge of it fundamental to quantifying direct human impacts on groundwater storage.

Groundwater storage↗

Long-Term, Non-Anthropogenic Groundwater Storage Changes Simulated by Three Global-Scale Hydrological Models

This study examined long-term, natural (i.e., excluding anthropogenic impacts) variability of groundwater storage worldwide. Groundwater storage changes were estimated by forcing three global-scale hydrological models with three 50+ year meteorological datasets. evaluation using in situ groundwater observations from the U.S. and terrestrial water storage derived from the Gravity Recovery and Climate experiment (GRACe) satellites showed that these models reasonably represented inter-annual variability of water storage, as indicated by correlations greater than 0.5 in most regions. Empirical orthogonal function analysis revealed influences of the El Niño Southern Oscillation (ENSO) on global groundwater storage. simulated groundwater storage, including its global average, exhibited trends generally consistent with that of precipitation. Global total (natural) groundwater storage decreased over the past 5–7 decades with modeled rates ranging from 0.01 to 2.18 mm year−1. this large range can be attributed in part to groundwater’s low frequency (inter-decadal) variability, which complicates identification of real long-term trends even within a 50+ year time series. Results indicate that non-anthropogenic variability in groundwater storage is substantial, making knowledge of it fundamental to quantifying direct human impacts on groundwater storage.

Bailing Li↗

Satellite Soil Moisture Data Assimilation Impacts on Modeling Weather Variables and Ozone in the Southeastern US – Part 2: Sensitivity to Dry-Deposition Parameterizations

Ozone (O3) dry deposition is a major O3 sink. As a follow-up study of Huang et al. (2021), we quantify the impact of satellite soil moisture (SM) on model representations of this process when different dry-deposition parameterizations are implemented, based on which the implications for interpreting O3 air pollution levels and assessing the O3 impacts on human and ecosystem health are provided. The SM data from NASA's Soil Moisture Active Passive mission are assimilated into the Noah-Multiparameterization (Noah-MP) land surface model within the NASA Land Information System framework, semicoupled with Weather Research and Forecasting model with online Chemistry (WRF-Chem) regional-scale simulations covering the southeastern US. Major changes in the modeling system used include enabling the dynamic vegetation option, adding the irrigation process, and updating the scheme for the surface exchange coefficient. Two dry-deposition schemes are implemented, i.e., the Wesely scheme and a “dynamic” scheme, in the latter of which dry-deposition parameterization is coupled with photosynthesis and vegetation dynamics. It is demonstrated that, when the dynamic scheme is applied, the simulated O3 dry-deposition velocities vd and their stomatal and cuticular portions, as well as the total O3 fluxes Ft, are larger overall; vd and Ft are 2–3 times more sensitive to the SM changes due to the data assimilation (DA). Further, through case studies at two forested sites with different soil types and hydrological regimes, we highlight that, applying the Community Land Model type of SM factor controlling stomatal resistance (i.e., β factor) scheme in replacement of the Noah-type β factor scheme reduced the v(d) sensitivity to SM changes by ∼75 % at one site, while it doubled this sensitivity at the other site. Referring to multiple evaluation datasets, which may be associated with variable extents of uncertainty, the model performance of vegetation, surface fluxes, weather, and surface O3 concentrations shows mixed responses to the DA, some of which display land cover dependency. Finally, using model-derived concentration- and flux-based policy-relevant O3 metrics as well as their matching exposure–response functions, the relative biomass/crop yield losses for several types of vegetation/crops are estimated to be within a wide range of 1 %–17 %. Their sensitivities to the model's dry-deposition scheme and the implementation of SM DA are discussed.

Min Huang↗

Climate Model Evaluation using New Datasets from the Clouds and the Earth's Radiant Energy System (CERES)

There are some in the science community who believe that the response of the climate system to anthropogenic radiative forcing is unpredictable and we should therefore call off the quest . The key limitation in climate predictability is associated with cloud feedback. Narrowing the uncertainty in cloud feedback (and therefore climate sensitivity) requires optimal use of the best available observations to evaluate and improve climate model processes and constrain climate model simulations over longer time scales. The Clouds and the Earth s Radiant Energy System (CERES) is a satellite-based program that provides global cloud, aerosol and radiative flux observations for improving our understanding of cloud-aerosol-radiation feedbacks in the Earth s climate system. CERES is the successor to the Earth Radiation Budget Experiment (ERBE), which has widely been used to evaluate climate models both at short time scales (e.g., process studies) and at decadal time scales. A CERES instrument flew on the TRMM satellite and captured the dramatic 1998 El Nino, and four other CERES instruments are currently flying aboard the Terra and Aqua platforms. Plans are underway to fly the remaining copy of CERES on the upcoming NPP spacecraft (mid-2010 launch date). Every aspect of CERES represents a significant improvement over ERBE. While both CERES and ERBE measure broadband radiation, CERES calibration is a factor of 2 better than ERBE. In order to improve the characterization of clouds and aerosols within a CERES footprint, we use coincident higher-resolution imager observations (VIRS, MODIS or VIIRS) to provide a consistent cloud-aerosol-radiation dataset at climate accuracy. Improved radiative fluxes are obtained by using new CERES-derived Angular Distribution Models (ADMs) for converting measured radiances to fluxes. CERES radiative fluxes are a factor of 2 more accurate than ERBE overall, but the improvement by cloud type and at high latitudes can be as high as a factor of 5. Diurnal cycles are explicitly resolved by merging geostationary satellite observations with CERES and MODIS. Atmospheric state data are provided from a frozen version of the Global Modeling and Assimilation Office- Data Assimilation System at the NASA Goddard Space Flight Center. In addition to improving the accuracy of top-of-atmosphere (TOA) radiative fluxes, CERES also produces radiative fluxes at the surface and at several levels in the atmosphere using radiative transfer modeling, constrained at the TOA by CERES (ERBE was limited to the TOA). In all, CERES uses 11 instruments on 7 spacecraft all integrated to obtain climate accuracy in TOA to surface fluxes. This presentation will provide an overview of several new CERES datasets of interest to the climate community (including a new adjusted TOA flux dataset constrained by estimates of heat storage in the Earth system), show direct comparisons between CERES ad ERBE, and provide a detailed error analysis of CERES fluxes at various time and space scales. We discuss how observations can be used to reduce uncertainties in cloud feedback and climate sensitivity and strongly argue why we should NOT "call off the quest".

Loeb, Norman G.↗

The SPoRT-WRF: Evaluating the Impact of NASA Datasets on Convective Forecasts

The Short-term Prediction Research and Transition Center (SPoRT) is a collaborative partnership between NASA and operational forecasting entities, including a number of National Weather Service offices. SPoRT transitions real-time NASA products and capabilities to its partners to address specific operational forecast challenges. One challenge that forecasters face is applying convection-allowing numerical models to predict mesoscale convective weather. In order to address this specific forecast challenge, SPoRT produces real-time mesoscale model forecasts using the Weather Research and Forecasting (WRF) model that includes unique NASA products and capabilities. Currently, the SPoRT configuration of the WRF model (SPoRT-WRF) incorporates the 4-km Land Information System (LIS) land surface data, 1-km SPoRT sea surface temperature analysis and 1-km Moderate resolution Imaging Spectroradiometer (MODIS) greenness vegetation fraction (GVF) analysis, and retrieved thermodynamic profiles from the Atmospheric Infrared Sounder (AIRS). The LIS, SST, and GVF data are all integrated into the SPoRT-WRF through adjustments to the initial and boundary conditions, and the AIRS data are assimilated into a 9-hour SPoRT WRF forecast each day at 0900 UTC. This study dissects the overall impact of the NASA datasets and the individual surface and atmospheric component datasets on daily mesoscale forecasts. A case study covering the super tornado outbreak across the Ce ntral and Southeastern United States during 25-27 April 2011 is examined. Three different forecasts are analyzed including the SPoRT-WRF (NASA surface and atmospheric data), the SPoRT WRF without AIRS (NASA surface data only), and the operational National Severe Storms Laboratory (NSSL) WRF (control with no NASA data). The forecasts are compared qualitatively by examining simulated versus observed radar reflectivity. Differences between the simulated reflectivity are further investigated using convective parameters along with model soundings to determine the impacts of the various NASA datasets. Additionally, quantitative evaluation of select meteorological parameters is performed using the Meteorological Evaluation Tools model verification package to compare forecasts to in situ surface and upper air observations.

Zavodsky, Bradley↗

Deriving Three Dimensional Reservoir Bathymetry from Multi-Satellite Datasets

We evaluate different techniques that rebuild reservoir bathymetry by combining multi-satellite imagery of surface water elevation and extent. Digital elevation models (DEMs) are processed in two distinct ways in order to determine 3-D reservoir bathymetry. They are defined as (a) linear extrapolation and (b) linear interpolation. The first one linearly extrapolates the land slope, defining the bottom as the intersection of all extrapolated lines. The second linearly interpolates the uppermost and lowermost pixels of the reservoir's main river, repeating the process for all other tributaries. A visible bathymetry, resulting from the combination of radar altimetry and water extent masks, can be coupled with the DEM, improving the accuracy of techniques (a) and (b). Envisat-and Altika-based altimetric time series is combined to a Landsat-based water extent database over the2002-2016 period in order to generate the visible bathymetry, and topography is derived from the 3-arcsecHydroSHEDS DEM. Fourteen 3-D bathymetries derived from the combination of these techniques and datasets, plus the inclusion of upstream and downstream riverbed elevations, are evaluated over Lake Mead. Accuracy is measured using ground observations, and show that metrics improve as a function of added data requirement and processing. Best bathymetry estimates are obtained when the visible bathymetry, linear extrapolation technique and riverbed elevation are combined. Water storage variability is also evaluated and shows that best results are derived from the aforementioned combination. This study contributes to our understanding and representation of reservoir water impoundment impacts on the hydrological cycle.

HydroSHEDS↗

Synergistic Retrievals of Ice in High Clouds From Elastic Backscatter Lidar, Ku-band Radar and Submillimeter Wave Radiometer Observations

In this study, we investigate the synergy of elastic backscatter lidar, Ku-band radar, and sub-millimeter-wave radiometer measurements in the retrieval of ice from satellite observations. The synergy is analyzed through the generation of a large dataset of IceWater Content (IWC) profiles and simulated lidar, radar and radiometer observations. The characteristics of the instruments e.g. frequencies, sensitivities, etc. are set based on the expected characteristics of instruments of the Atmosphere Observing System (AOS) mission. A hold-out validation methodology is used to assess the accuracy of the IWC profiles retrieved from various combinations of observations from the three instruments. Specifically, the IWC and associated observations are randomly divided into two datasets, one for training and the other for evaluation. The training dataset is used to train the retrieval algorithm, while the evaluation dataset is used to assess the retrieval performance. The dataset of IWC profiles is derived from CloudSat reflectivity and CALIOP lidar observations. The retrieval of the ice water content IWC profiles from the computed observations is achieved in two steps. In the first step, a class, out of 18 potential classes characterized by different vertical distribution of IWC, is estimated from the observations. The 18 classes are predetermined based on the k-Means clustering algorithm. In the second step, the IWC profile is estimated using an Ensemble Kalman Smoother (EKS) algorithm that uses the estimated class as a priori information. The results of the study show that the synergy of lidar, radar, and radiometer observations is significant in the retrieval of the IWC profiles. Nevertheless, it should be mentioned that this synergy was found under idealized conditions, and additional work might be required to materialize it in practice. The inclusion of the lidar backscatter observations in the retrieval process has a larger impact on the retrieval performance than the inclusion of the radar observations. As ice clouds have a significant impact on atmospheric radiative processes, this work is relevant to ongoing efforts to reduce uncertainties in climate analyses and projections.

Mircea Grecu↗

Influence of Sub-grid-Scale Isentropic Transports on McRAS Evaluations using ARM-CART SCM Datasets

In GCM-physics evaluations with the currently available ARM-CART SCM datasets, McRAS produced very similar character of near surface errors of simulated temperature and humidity containing typically warm and moist biases near the surface and cold and dry biases aloft. We argued it must have a common cause presumably rooted in the model physics. Lack of vertical adjustment of horizontal transport was thought to be a plausible source. Clearly, debarring such a freedom would force the incoming air to diffuse into the grid-cell which would naturally bias the surface air to become warm and moist while the upper air becomes cold and dry, a characteristic feature of McRAS biases. Since, the errors were significantly larger in the two winter cases that contain potentially more intense episodes of cold and warm advective transports, it further reaffirmed our argument and provided additional motivation to introduce the corrections. When the horizontal advective transports were suitably modified to allow rising and/or sinking following isentropic pathways of subgrid scale motions, the outcome was to cool and dry (or warm and moisten) the lower (or upper) levels. Ever, crude approximations invoking such a correction reduced the temperature and humidity biases considerably. The tests were performed on all the available ARM-CART SCM cases with consistent outcome. With the isentropic corrections implemented through two different numerical approximations, virtually similar benefits were derived further confirming the robustness of our inferences. These results suggest the need for insentropic advective transport adjustment in a GCM due to subgrid scale motions.

Sud, Y. C.↗

Daily evaluation of 26 precipitation datasets using Stage-IV gauge-radar data for the CONUS

New precipitation (P) datasets are released regularly, following innovations in weather forecasting models, satellite retrieval methods, and multi-source merging techniques. Using the conterminous US as a case study, we evaluated the performance of 26 gridded (sub-)daily P datasets to obtain insight into the merit of these innovations. The evaluation was performed at a daily timescale for the period 2008–2017 using the Kling–Gupta efficiency (KGE), a performance metric combining correlation, bias, and variability. As a reference, we used the high-resolution (4 km) Stage-IV gauge-radar P dataset. Among the three KGE components, the P datasets performed worst overall in terms of correlation (related to event identification). In terms of improving KGE scores for these datasets, improved P totals (affecting the bias score) and improved distribution of P intensity (affecting the variability score) are of secondary importance. Among the 11 gauge-corrected P datasets, the best overall performance was obtained by MSWEP V2.2, underscoring the importance of applying daily gauge corrections and accounting for gauge reporting times. Several uncorrected P datasets outperformed gauge-corrected ones. Among the 15 uncorrected P datasets, the best performance was obtained by the ERA5-HRES fourth-generation reanalysis, reflecting the significant advances in earth system modeling during the last decade. The (re)analyses generally performed better in winter than in summer, while the opposite was the case for the satellite-based datasets. IMERGHH V05 performed substantially better than TMPA-3B42RT V7, attributable to the many improvements implemented in the IMERG satellite P retrieval algorithm. IMERGHH V05 outperformed ERA5-HRES in regions dominated by convective storms, while the opposite was observed in regions of complex terrain. The ERA5-EDA ensemble average exhibited higher correlations than the ERA5-HRES deterministic run, highlighting the value of ensemble modeling. The WRF regional convection-permitting climate model showed considerably more accurate P totals over the mountainous west and performed best among the uncorrected datasets in terms of variability, suggesting there is merit in using high-resolution models to obtain climatological P statistics. Our findings provide some guidance to choose the most suitable P dataset for a particular application.

Hylke E. Beck↗

Simultaneous Retrieval of Selected Optical Water Quality Indicators From Landsat-8, Sentinel-2, and Sentinel-3

Constructing multi-source satellite-derived water quality (WQ) products in inland and nearshore coastal waters from the past, present, and future missions is a long-standing challenge. Despite inherent differences in sensors’ spectral capability, spatial sampling, and radiometric performance, research efforts focused on formulating, implementing, and validating universal WQ algorithms continue to evolve. This research extends a recently developed machine-learning (ML) model, i.e., Mixture Density Networks (MDNs) (Pahlevan et al., 2020; Smith et al., 2021), to the inverse problem of simultaneously retrieving WQ indicators, including chlorophyll-a (Chla), Total Suspended Solids (TSS), and the absorption by Colored Dissolved Organic Matter at 440 nm (a cdom (440)), across a wide array of aquatic ecosystems. We use a database of in situ measurements to train and optimize MDN models developed for the relevant spectral measurements (400–800 nm) of the Operational Land Imager (OLI), MultiSpectral Instrument (MSI), and Ocean and Land Color Instrument (OLCI) aboard the Landsat-8, Sentinel-2, and Sentinel-3 missions, respectively. Our two performance assessment approaches, namely hold-out and leave-one-out, suggest significant, albeit varying degrees of improvements with respect to second-best algorithms, depending on the sensor and WQ indicator (e.g., 68%, 75%, 117% improvements based on the hold-out method for Chla, TSS, and a cdom (440), respectively from MSI-like spectra). Using these two assessment methods, we provide theoretical upper and lower bounds on model performance when evaluating similar and/or out-of-sample datasets. To evaluate multi-mission product consistency across broad spatial scales, map products are demonstrated for three near-concurrent OLI, MSI, and OLCI acquisitions. Overall, estimated TSS and a cdom (440) from these three missions are consistent within the uncertainty of the model, but Chla maps from MSI and OLCI achieve greater accuracy than those from OLI. By applying two different atmospheric correction processors to OLI and MSI images, we also conduct matchup analyses to quantify the sensitivity of the MDN model and best-practice algorithms to uncertainties in reflectance products. Our model is less or equally sensitive to these uncertainties compared to other algorithms. Recognizing their uncertainties, MDN models can be applied as a global algorithm to enable harmonized retrievals of Chla, TSS, and a cdom (440) in various aquatic ecosystems from multi-source satellite imagery. Local and/or regional ML models tuned with an apt data distribution (e.g., a subset of our dataset) should nevertheless be expected to outperform our global model.

Machine learning↗