Engineering Papers⌕ Search

Engineering topics

Hsu, Kuolin

Publications and source records attributed to Hsu, Kuolin.

At least 19 records

Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Geology↗

Investigating the Impact of Irrigation on Malaria Vector Larval Habitats and Transmission Using a Hydrology‐Based Model

Abstract A combination of accelerated population growth and severe droughts has created pressure on food security and driven the development of irrigation schemes across sub‐Saharan Africa. Irrigation has been associated with increased malaria risk, but risk prediction remains difficult due to the heterogeneity of irrigation and the environment. While investigating transmission dynamics is helpful, malaria models cannot be applied directly in irrigated regions as they typically rely only on rainfall as a source of water to quantify larval habitats. By coupling a hydrologic model with an agent‐based malaria model for a sugarcane plantation site in Arjo, Ethiopia, we demonstrated how incorporating hydrologic processes to estimate larval habitats can affect malaria transmission. Using the coupled model, we then examined the impact of an existing irrigation scheme on malaria transmission dynamics. The inclusion of hydrologic processes increased the variability of larval habitat area by around two‐fold and resulted in reduction in malaria transmission by 60%. In addition, irrigation increased all habitat types in the dry season by up to 7.4 times. It converted temporary and semi‐permanent habitats to permanent habitats during the rainy season, which grew by about 24%. Consequently, malaria transmission was sustained all‐year round and intensified during the main transmission season, with the peak shifted forward by around 1 month. Lastly, we evaluated the spatiotemporal distribution of adult vectors under the effect of irrigation by resolving habitat heterogeneity. These findings could help larval source management by identifying transmission hotspots and prioritizing resources for malaria elimination planning.

60 APPLIED LIFE SCIENCES↗

Topographic hydro-conditioning to resolve surface depression storage and ponding in a fully distributed hydrologic model

Land surface depressions play a central role in the transformation of rainfall to ponding, infiltration and runoff, yet digital elevation models (DEMs) used by spatially distributed hydrologic models that resolve land surface processes rarely capture land surface depressions at spatial scales relevant to this transformation. Methods to generate DEMs through processing of remote sensing data, such as optical and light detection and ranging (LiDAR) have favored surfaces without depressions to avoid adverse slopes that are problematic for many hydrologic routing methods. Here, in this study, we present a new topographic conditioning workflow, Depression-Preserved DEM Processing (D2P) algorithm, which is designed to preserve physically meaningful surface depressions for depression-integrated and efficient hydrologic modeling. D2P includes several features: (1) an adaptive screening interval for delineation of depressions, (2) the ability to filter out anthropogenic land surface features (e.g., bridges), (3) the ability to blend river smoothing (e.g., a general downslope profile) and depression resolving functionality. From a case study in the Goodwin Creek Experimental Watershed, D2P successfully resolved 86% of the ponds at a DEM resolution of 10 m. Topographic conditioning was achieved with minimum impact as D2P reduced the number of modified cells from the original DEM by 51% compared to a conventional algorithm. Furthermore, hydrologic simulation using a D2P processed DEM resulted in a more robust characterization on surface water dynamics based on higher surface water storage as well as an attenuated and delayed peak streamflow.

54 ENVIRONMENTAL SCIENCES↗

Performance of New Near-Real-Time PERSIANN Product (PDIR-Now) for Atmospheric River Events over the Russian River Basin, California

Most heavy precipitation events and extreme flooding over the U.S. Pacific coast can be linked to prevalent atmospheric river (AR) conditions. Thus, reliable quantitative precipitation estimation with a rich spatiotemporal resolution is vital for water management and early warning systems of flooding and landslides over these regions. At the same time, high-quality near-real-time measurements of AR precipitation remain challenging due to the complex topographic features of land surface and meteorological conditions of the region: specifically, orographic features occlude radar measurements while infrared-based algorithms face challenges, differentiating between both cold brightband (BB) precipitation and the warmer nonbrightband (NBB) precipitation. It should be noted that the latter precipitation is characterized by greater orographic enhancement. In this study, we evaluate the performance of a recently developed near-real-time satellite precipitation algorithm: Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN) Dynamic Infrared–Rain Rate-Now (PDIR-Now). This model is primarily dependent on infrared information from geostationary satellites as input; consequently, PDIR-Now has the advantage of short data latency, 15–60-min delay between observation to precipitation product delivery. The performance of PDIR-Now is analyzed with a focus on AR-related events for cases dominated by NBB and BB precipitation over the Russian River basin. In our investigations, we utilize S-band (3-GHz) precipitation profilers with Joss/Parsivel disdrometer measurements at the Middletown and Santa Rosa stations to classify BB and NBB precipitation events. In general, our analysis shows that PDIR-Now is more skillful in retrieving precipitation rates over both BB and NBB events across the topologically complex study area as compared to PERSIANN-Cloud Classification System (CCS). Also, we discuss the performance of well-known operational near-real-time precipitation products from 2017 to 2019. Conventional categorical and volumetric categorical indices, as well as continuous statistical metrics, are used to show the differences between various high-resolution precipitation products such as Multi-Radar Multi-Sensor (MRMS).

54 ENVIRONMENTAL SCIENCES↗

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests

Accurate and reliable near-real-time satellite precipitation estimation is of great importance for operational large-scale flood forecasting and drought monitoring. The state-of-the-art precipitation post-processing model is based on a deterministic approach to construct relationships between satellites estimates and ground observations. We propose a probabilistic postprocessor, the Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates using Quantile Regression Forests (QRF4P-NRT), based on quantile modeling, yielding both deterministic and probabilistic predictions. The experimental design incorporates different solutions of near-real-time predictors to further improve the model performance. Using the Integrated Multi-satellitE Retrievals Early Run for Global Precipitation Measurement Mission (IMERG-E) product as an example, we illustrate that the proposed method significantly improves the overall quality of the raw IMERG-E and is also superior to the bias-corrected product (IMERG Final Run, IMERG-F) at daily scale in a complex mountain basin. Evaluations of the corrected IMERG-E, raw IMERG-E, and IMERG-F using ground observation show that the corrected IMERG-E improves correlation coefficients (0.7), mean error (-0.14 mm/day) and root mean square error (3.3 mm/day) relative to the raw IMERG-E (0.31, -0.72 and 5.5 mm/day) and IMERG-F (0.34, -0.09 and 6.0 mm/day). The error decomposition further confirms that the QRF4P-NRT improves on the various deficiencies of the raw IMERG-E product. The ensemble assessment also demonstrates that the quantile outputs provide reliable prediction spread and sharp prediction intervals. The promising results indicate the great potential of the proposed method for probabilistic post-processing for near-real-time satellite precipitation estimates, and for further applications such as hydrological ensemble forecasting.

54 ENVIRONMENTAL SCIENCES↗

Deep Neural Network High Spatiotemporal Resolution Precipitation Estimation (Deep-STEP) Using Passive Microwave and Infrared Data

Recent developments in “headline-making” deep neural networks (DNNs), specifically convolutional neural networks (CNNs), along with advancements in computational power, open great opportunities to integrate massive amounts of real-time observations to characterize spatiotemporal structures of surface precipitation. This study aims to develop a CNN algorithm, named Deep Neural Network High Spatiotemporal Resolution Precipitation Estimation (Deep-STEP), that ingests direct satellite passive microwave (PMW) brightness temperatures (Tbs) at emission and scattering frequencies combined with infrared (IR) Tbs from geostationary satellites and surface information to automatically extract geospatial features related to the precipitable clouds. These features allow the end-to-end Deep-STEP algorithm to instantaneously map surface precipitation intensities with a spatial resolution of 4 km. The main advantages of Deep-STEP, as compared to current state-of-the-art techniques, are 1) it learns and estimates complex precipitation systems directly from raw measurements in near–real time, 2) it uses the automatic spatial neighborhood feature extraction approach, and 3) it fuses coarse-resolution PMW footprints with IR images to reliably retrieve surface precipitation at a high spatial resolution. We anticipate our proposed DNN algorithm to be a starting point for more sophisticated and efficient precipitation retrieval systems in terms of accuracy, fine spatial pattern detection skills, and computational costs.

54 ENVIRONMENTAL SCIENCES↗

New Insights Into Error Decomposition for Precipitation Products

Abstract It is very important to quantify errors of precipitation estimation products. However, the existing methods do not describe all error components and are therefore not comprehensive enough. In this study, we propose a four‐component error decomposition method (4CED) that decomposes the total errors of precipitation products into four independent parts: hit positive bias, hit negative bias, false bias, and missed bias. And we use it to evaluate the performance of the three latest satellite precipitation products in the eastern monsoon region of China. Our study reveals 4CED has apparent improvements compared with the previous method. Results also provide new insights for tracking error sources and quantifying the error magnitudes of precipitation products. Moreover, the proposed 4CED can be extended to different spatial and temporal scales. Our new method will not only contribute to product upgrades, but also provide guidance for potential applications.

58 GEOSCIENCES↗

Error Characteristics and Scale Dependence of Current Satellite Precipitation Estimates Products in Hydrological Modeling

Satellite precipitation estimates (SPEs) are promising alternatives to gauge observations for hydrological applications (e.g., streamflow simulation), especially in remote areas with sparse observation networks. However, the existing SPEs products are still biased due to imperfections in retrieval algorithms, data sources and post-processing, which makes the effective use of SPEs a challenge, especially at different spatial and temporal scales. In this study, we used a distributed hydrological model to evaluate the simulated discharge from eight quasi-global SPEs at different spatial scales and explored their potential scale effects of SPEs on a cascade of basins ranging from approximately 100 to 130,000 km 2 . The results indicate that, regardless of the difference in the accuracy of various SPEs, there is indeed a scale effect in their application in discharge simulation. Specifically, when the catchment area is larger than 20,000 km2, the overall performance of discharge simulation emerges an ascending trend with the increase of catchment area due to the river routing and spatial averaging. Whereas below 20,000 km 2 , the discharge simulation capability of the SPEs is more randomized and relies heavily on local precipitation accuracy. Our study also highlights the need to evaluate SPEs or other precipitation products (e.g., merge product or reanalysis data) not only at the limited station scale, but also at a finer scale depending on the practical application requirements. Here we have verified that the existing SPEs are scale-dependent in hydrological simulation, and they are not enough to be directly used in very fine scale distributed hydrological simulations (e.g., flash flood). More advanced retrieval algorithms, data sources and bias correction methods are needed to further improve the overall quality of SPEs.

DTVGM↗

PERSIANN-CCS-CDR, a 3-hourly 0.04° global precipitation climate data record for heavy precipitation studies

Accurate long-term global precipitation estimates, especially for heavy precipitation rates, at fine spatial and temporal resolutions is vital for a wide variety of climatological studies. Most of the available operational precipitation estimation datasets provide either high spatial resolution with short-term duration estimates or lower spatial resolution with long-term duration estimates. Furthermore, previous research has stressed that most of the available satellite-based precipitation products show poor performance for capturing extreme events at high temporal resolution. Therefore, there is a need for a precipitation product that reliably detects heavy precipitation rates with fine spatiotemporal resolution and a longer period of record. Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Cloud Classification System-Climate Data Record (PERSIANN-CCS-CDR) is designed to address these limitations. This dataset provides precipitation estimates at 0.04° spatial and 3-hourly temporal resolutions from 1983 to present over the global domain of 60°S to 60°N. Evaluations of PERSIANN-CCS-CDR and PERSIANN-CDR against gauge and radar observations show the better performance of PERSIANN-CCS-CDR in representing the spatiotemporal resolution, magnitude, and spatial distribution patterns of precipitation, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗

Predicting distribution of malaria vector larval habitats in Ethiopia by integrating distributed hydrologic modeling with remotely sensed data

Abstract Larval source management has gained renewed interest as a malaria control strategy in Africa but the widespread and transient nature of larval breeding sites poses a challenge to its implementation. To address this problem, we propose combining an integrated high resolution (50 m) distributed hydrological model and remotely sensed data to simulate potential malaria vector aquatic habitats. The novelty of our approach lies in its consideration of irrigation practices and its ability to resolve complex ponding processes that contribute to potential larval habitats. The simulation was performed for the year of 2018 using ParFlow-Common Land Model (CLM) in a sugarcane plantation in the Oromia region, Ethiopia to examine the effects of rainfall and irrigation. The model was calibrated using field observations of larval habitats to successfully predict ponding at all surveyed locations from the validation dataset. Results show that without irrigation, at least half of the area inside the farms had a 40% probability of potential larval habitat occurrence. With irrigation, the probability increased to 56%. Irrigation dampened the seasonality of the potential larval habitats such that the peak larval habitat occurrence window during the rainy season was extended into the dry season. Furthermore, the stability of the habitats was prolonged, with a significant shift from semi-permanent to permanent habitats. Our study provides a hydrological perspective on the impact of environmental modification on malaria vector ecology, which can potentially inform malaria control strategies through better water management.

59 BASIC BIOLOGICAL SCIENCES↗

PERSIANN Dynamic Infrared–Rain Rate (PDIR-Now): A Near-Real-Time, Quasi-Global Satellite Precipitation Dataset

This study presents the Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Dynamic Infrared Rain Rate (PDIR-Now) near-real-time precipitation dataset. This dataset provides hourly, quasi-global, infrared-based precipitation estimates at 0.04° × 0.04° spatial resolution with a short latency (15–60 min). It is intended to supersede the PERSIANN–Cloud Classification System (PERSIANN-CCS) dataset previously produced as the near-real-time product of the PERSIANN family. We first provide a brief description of the algorithm’s fundamentals and the input data used for deriving precipitation estimates. Second, we provide an extensive evaluation of the PDIR-Now dataset over annual, monthly, daily, and subdaily scales. Last, the article presents information on the dissemination of the dataset through the Center for Hydrometeorology and Remote Sensing (CHRS) web-based interfaces. The evaluation, conducted over the period 2017–18, demonstrates the utility of PDIR-Now and its improvement over PERSIANN-CCS at all temporal scales. Specifically, PDIR-Now improves the estimation of rain/no-rain days as demonstrated by a critical success index (CSI) of 0.53 compared to 0.47 of PERSIANN-CCS. In addition, PDIR-Now improves the estimation of seasonal and diurnal cycles of precipitation as well as regional precipitation patterns erroneously estimated by PERSIANN-CCS. Finally, an evaluation is carried out to examine the performance of PDIR-Now in capturing two extreme events, Hurricane Harvey and a cluster of summer thunderstorms that occurred over the Netherlands, where it is shown that PDIR-Now adequately represents spatial precipitation patterns as well as subdaily precipitation rates with a correlation coefficient (CORR) of 0.64 for Hurricane Harvey and 0.76 for the Netherlands thunderstorms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improving near real-time precipitation estimation using a U-Net convolutional neural network and geographical information

Reliable near real-time precipitation estimates are essential for monitoring and managing of natural disasters such as floods. Quality of inputs and capability of the retrieval algorithm are two important aspects for developing satellite-based precipitation datasets. Most retrieval algorithms utilize infrared (IR) information as their input due to its fine spatiotemporal resolution and near-instantaneous availability. However, their sole reliance on IR information limits their capability to learn different mechanisms of precipitation during training, resulting in less accurate estimates. Moreover, recent advances in the field of machine learning offer attractive opportunities to improve the precipitation retrieval algorithms. This work investigates the effectiveness of adding geographical information (i.e. latitude and longitude) to IR information and the application of a U-Net-based convolutional neural network for improving the accuracy of retrieval algorithms. This research suggests that applying an appropriate CNN architecture on geographical and IR information provides an opportunity to improve the satellite-based precipitation products.

42 ENGINEERING↗

PERSIANN Dynamic Infrared–Rain Rate Model (PDIR) for High-Resolution, Real-Time Satellite Precipitation Estimation

Precipitation measurements with high spatiotemporal resolution are a vital input for hydrometeorological and water resources studies; decision-making in disaster management; and weather, climate, and hydrological forecasting. Moreover, real-time precipitation estimation with high precision is pivotal for the monitoring and managing of catastrophic hydroclimate disasters such as flash floods, which frequently transpire after extreme rainfall. While algorithms that exclusively use satellite infrared data as input are attractive owing to their rich spatiotemporal resolution and near-instantaneous availability, their sole reliance on cloud-top brightness temperature (T b ) readings causes underestimates in wet regions and overestimates in dry regions—this is especially evident over the western contiguous United States (CONUS). We introduce an algorithm, the Precipitation Estimations from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN) Dynamic Infrared–Rain rate model (PDIR), which utilizes climatological data to construct a dynamic (i.e., laterally shifting) T b –rain rate relationship that has several notable advantages over other quantitative precipitation-estimation algorithms and noteworthy skill over the western CONUS. Validation of PDIR over the western CONUS shows a promising degree of skill, notably at the annual scale, where it performs well in comparison to other satellite-based products. Analysis of two extreme landfalling atmospheric rivers show that solely IR-based PDIR performs reasonably well compared to other IR- and PMW-based satellite rainfall products, marking its potential to be effective in real-time monitoring of extreme storms. This research suggests that IR-based algorithms that contain the spatiotemporal richness and near-instantaneous availability needed for rapid natural hazards response may soon contain the skill needed for hydrologic and water resource applications.

54 ENVIRONMENTAL SCIENCES↗

Reaching for 20 Years with the IMERG Multi-Satellite Products

The latest releases of Global Precipitation Measurement (GPM) mission products cap five years of vigorous development cycle since the launch of the GPM Core Observatory, and these now provide datasets that are relatively homogeneous across the joint Tropical Rainfall Measuring Mission (TRMM) and GPM eras. Version 06 of the U.S. GPM team's Integrated Multi-satellitE Retrievals for GPM (IMERG) merged precipitation product enforces a consistent intercalibration for all precipitation products computed from individual satellites with the TRMM and GPM Core Observatory sensors as the TRMM- and GPM era calibrators, respectively, and incorporates monthly surface gauge data. The basic IMERG algorithm now features precipitation motion vectors (used to drive the Lagrangian interpolation, or "morphing") that arecomputed by tracking vertically integrated vapor fields analyzed in MERRA2 and GEOS5. This innovation provides globally complete coverage, expanding IMERG's coverage beyond the 60°N-S latitude band provided by IR-based vectors, although we continue to mask out precipitation over snowy/icy surfaces as unreliable. A second innovation is the Quality Index (QI) data field. The half-hourly QI is taken as the approximate Kalman Filter correlation computed in the morphing calculation.

Huffman, George J.↗

PERSIANN-CNN: Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Convolutional Neural Networks

Abstract Accurate and timely precipitation estimates are critical for monitoring and forecasting natural disasters such as floods. Despite having high-resolution satellite information, precipitation estimation from remotely sensed data still suffers from methodological limitations. State-of-the-art deep learning algorithms, renowned for their skill in learning accurate patterns within large and complex datasets, appear well suited to the task of precipitation estimation, given the ample amount of high-resolution satellite data. In this study, the effectiveness of applying convolutional neural networks (CNNs) together with the infrared (IR) and water vapor (WV) channels from geostationary satellites for estimating precipitation rate is explored. The proposed model performances are evaluated during summer 2012 and 2013 over central CONUS at the spatial resolution of 0.08° and at an hourly time scale. Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN)–Cloud Classification System (CCS), which is an operational satellite-based product, and PERSIANN–Stacked Denoising Autoencoder (PERSIANN-SDAE) are employed as baseline models. Results demonstrate that the proposed model (PERSIANN-CNN) provides more accurate rainfall estimates compared to the baseline models at various temporal and spatial scales. Specifically, PERSIANN-CNN outperforms PERSIANN-CCS (and PERSIANN-SDAE) by 54% (and 23%) in the critical success index (CSI), demonstrating the detection skills of the model. Furthermore, the root-mean-square error (RMSE) of the rainfall estimates with respect to the National Centers for Environmental Prediction (NCEP) Stage IV gauge–radar data, for PERSIANN-CNN was lower than that of PERSIANN-CCS (PERSIANN-SDAE) by 37% (14%), showing the estimation accuracy of the proposed model.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of PERSIANN-CDR Constructed Using GPCP V2.2 and V2.3 and A Comparison with TRMM 3B42 V7 and CPC Unified Gauge-Based Analysis in Global Scale

Providing reliable long-term global precipitation records at high spatial and temporal resolutions is crucial for climatological studies. Satellite-based precipitation estimations are a promising alternative to rain gauges for providing homogeneous precipitation information. Most satellite-based precipitation products suffer from short-term data records, which make them unsuitable for various climatological and hydrological applications. However, Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Climate Data Record (PERSIANN-CDR) provides more than 35 years of precipitation records at 0.25° × 0.25° spatial and daily temporal resolutions. The PERSIANN-CDR algorithm uses monthly Global Precipitation Climatology Project (GPCP) data, which has been recently updated to version 2.3, for reducing the biases in the output of the PERSIANN model. In this study, we constructed PERSIANN-CDR using the newest version of GPCP (V2.3). We compared the PERSIANN-CDR dataset that is constructed using GPCP V2.3 (from here on referred to as PERSIANN-CDR V2.3) with the PERSIANN-CDR constructed using GPCP V2.2 (from here on PERSIANN-CDR V2.2), at monthly and daily scales for the period from 2009 to 2013. First, we discuss the changes between PERSIANN-CDR V2.3 and V2.2 over the land and ocean. Second, we evaluate the improvements in PERSIANN-CDR V2.3 with respect to the Climate Prediction Center (CPC) unified gauge-based analysis, a gauged-based reference, and Tropical Rainfall Measuring Mission (TRMM 3B42 V7), a commonly used satellite reference, at monthly and daily scales. The results show noticeable differences between PERSIANN-CDR V2.3 and V2.2 over oceans between 40° and 60° latitude in both the northern and southern hemispheres. Monthly and daily scale comparisons of the two bias-adjusted versions of PERSIANN-CDR with the above-mentioned references emphasize that PERSIANN-CDR V2.3 has improved mostly over the global land area, especially over the CONUS and Australia. The updated PERSIANN-CDR V2.3 data has replaced V2.2 data for the 2009–2013 period on CHRS data portal and NOAA National Centers for Environmental Information (NCEI) Program.

54 ENVIRONMENTAL SCIENCES↗