Engineering Papers⌕ Search

Engineering topics

Shuai, Pin

Publications and source records attributed to Shuai, Pin.

At least 19 records

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

54 ENVIRONMENTAL SCIENCES↗

River–aquifer interactions enhancing evapotranspiration in a semiarid riparian zone: A modelling study

The hydrologic flows across the river–aquifer interface play an important role in groundwater dynamics and biogeochemical reactions within the subsurface; however, little is known about the effects of river–aquifer interactions on land surface processes. In this study, we developed a fully coupled three-dimensional (3D) land surface and subsurface model at a high resolution (~1 km) that accounts for high-frequency hydrologic exchange flow conditions to investigate how river–aquifer interactions modulate surface water budgets in the Upper Columbia-Priest Rapids watershed, a typical semiarid watershed located in the northwestern United States where river stage fluctuates in response to reservoir releases changing. Our results show that the spatiotemporal dynamics of river–aquifer interactions are highly heterogeneous, driven mainly by river-stage fluctuations. Adding 6.64 × 10 6 m 3 year –1 of water over the watershed from the river to groundwater owing to the lateral flow, river–aquifer interactions led to an increase in soil evaporation and transpiration supplied by higher soil moisture content, particularly in deeper subsurface. In a hypothetic future scenarios where a 5-m rise in river stage was assumed, the hydrologic flow exchange rates were intensified, resulting in higher surface water over the entire watershed. Overall, lateral flow induced by river–aquifer exchanges leads to an increase in evapotranspiration of ~75% in the historical period and of ~83% in the hypothetical future scenario. Finally, our study demonstrates the potential of coupled model as an effective tool for understanding river–aquifer–land surface interactions, and indicates that river–aquifer interactions fundamentally alter the water balance of the riparian zone for the semiarid watershed and will likely become more frequent and intense in the future under the effects of climate change.

54 ENVIRONMENTAL SCIENCES↗

The importance of explicitly representing the streambed in watershed models

Abstract The streambed is the critical interface between the aquatic and terrestrial systems and hosts important biogeochemical hot spots within river corridors. Although the streambed characteristics are significantly different from those of its surrounding soil, the streambed itself has not been explicitly represented in watershed models. Here, we explicitly incorporated a streambed layer into an integrated hydrologic model through model parameterization and discretization. We examined the hydrological effects of streambed characteristics, including hydraulic conductivity ( K ), layer thickness, and resolution, on the exchange fluxes across the streambed as well as the streamflow at the watershed outlet. The numerical experiments were performed in the American River Watershed, a headwater, mountainous watershed within the Yakima River Basin in central Washington. Despite having a negligible effect on the watershed streamflow, an explicit representation of the streambed with distinctive properties dramatically changed the magnitude and variability of the exchange flux. In general, a larger streambed K along with a thicker streambed layer induced larger exchange fluxes. The exchange flux was most sensitive to the streambed resolution. A finer streambed resolution increased exchange fluxes per unit area while reducing the overall exchange volumes across the entire streambed. The amount of baseflow decreased by 6% as the streambed resolution increased from 250 to 50 m. This finding is important because these hydrological changes may, in turn, affect the exchange of nutrients and contaminants between surface water and groundwater and the associated biogeochemical processes. Our work demonstrated the importance of representing streambeds in fully distributed, process‐based watershed models to better capture the exchange flow dynamics in river corridors.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with the manuscript evaluating the hydrologic responses of the Pacific Northwest watersheds to wildfires (v2)

This data package is associated with the publication “Evaluating Post-fire Watershed Response to Varying Burn Severity and Precipitation Regimes Using Fully-distributed and Integrated Hydrologic Models” submitted to Journal of Hydrology (Li et al. 2025). In this study, we employed the Advanced Terrestrial Simulator (ATS), an integrated watershed model that couples surface flow, subsurface flow, and canopy biophysical processes, to investigate post-fire hydrologic responses in a few selected watersheds with varying burn severity.The data package contains the required input data (meteorological forcing, Leaf Area Index, wildfire burn severities, etc.) to run the model, configuration files, the Jupyter notebooks in Python to pre-process and post-process data, the figures in the manuscript, and the modeling output files. The variables include watershed-averaged evapotranspiration, watershed-averaged surface/subsurface/canopy water content, and river discharge at watershed outlet.The data package contains a file-level metadata that lists and describes all the files contained in the data package (ATS_flmd.csv), a data dictionary file that defines columns headers across all csv files contained in the data package (ATS_dd.csv), a data package level readme file (the current file), and four zipped folders.The ‘data’ folder provides data needed to run the model in .h5, .i2s, .xyz, .shp, and .exo formats. The sub-folders are for each data types. The ‘model’ folder provides input files (.xml format) and essential model outputs. Each sub-folder provides the files from each simulated watershed. The ‘notebooks’ folder provides the Jupyter notebooks (.ipynb format) for pre- and post- processing model files, and for producing the figures in the manuscript. The ‘figures’ folder provides the figures associated with manuscript in .pdf and .png formats.The ‘model’ folder and the ‘data’ folder have been split into 5GB-large pieces using the Linux command ‘split -b 5120m model.zip model.zip.’ and ‘split -b 5120m data.zip data.zip.’, respectively. They can be merged back using the Linux command ‘cat model.zip.* > model.zip’ and ‘cat data.zip.* > data.zip’, respectively.

54 ENVIRONMENTAL SCIENCES↗

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado

Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.

54 ENVIRONMENTAL SCIENCES↗

Data-model files associated with the manuscript titled "The Importance of Explicitly Representing the Streambed in Watershed Models" (Shuai et al., 2023 HP)

This data package contains the model inputs and outputs used in the manuscript titled "The Importance of Explicitly Representing the Streambed in Watershed Models" (Shuai et al., 2023 HP). The data.zip file contains the data used to drive the Advanced Terrestrial Simulator (ATS) model simulations. The model.zip file contains the XML input file for ATS. The notebook.zip file contains the Jupyter notebooks for pre- and post- processing model results. The figures.zip file contains the raw figures associated with the manuscript. We generated this data package in support of the manuscript and research reproducibility. The background of this study is that the streambed itself has not been explicitly represented in watershed models, although the streambed characteristics are significantly different from those of its surrounding soil. We aim to answer the following questions: 1) How do streambed properties including hydraulic conductivity, thickness and resolution impact the groundwater-surface water exchange fluxes across the streambed? 2) Is an explicit representation of streambed important in watershed modeling?; 3) Is a high-resolution streambed needed for watershed simulations?

54 ENVIRONMENTAL SCIENCES↗

Watershed Workflow: A toolset for parameterizing data-intensive, integrated hydrologic models

Integrated, distributed hydrologic models leverage advances in computational power and data accessibility to improve predictive understanding of the water cycle. While impressive advances in this area of environmental modeling have been accomplished, such models are still rarely used, partially because of difficulty integrating model and data. This research describes the release of Watershed Workflow version 1.2, a new library aiming to automate and enable complex workflows defining inputs to high resolution, integrated, distributed hydrologic models. Watershed Workflow provides tools enabling the discovery, acquisition, mapping, and coordination of watershed geometry, land cover, soil properties, and meteorological data. It enables the construction of unstructured meshes that incorporate this data, and provides tools for automating a “first” simulation on any watershed in the United States. We present the design of the workflow tool, and describe best practices for its usage, culminating in a final example from watershed specification to simulation at the Coweeta Hydrologic Laboratory.

Integrated hydrologic modeling↗

Using Ensemble Data Assimilation to Estimate Transient Hydrologic Exchange Flow Under Highly Dynamic Flow Conditions

Abstract Quantifying dynamic hydrologic exchange flows (HEFs) within river corridors that experience high‐frequency flow variations caused by dam regulations is important for understanding the biogeochemical processes at the river water and groundwater interfaces. Heat has been widely used as a tracer to infer steady‐state flow velocities through analytical solutions of heat transport defined by the diurnal temperature signals. Under sub‐daily dynamic flow conditions, however, such analytical solutions are not applicable due to the violation of their fundamental assumptions. In this study, we developed a data assimilation‐based approach to estimate the sub‐daily flux under highly dynamic flow conditions using multi‐depth temperature observations at a 5‐min resolution. If the hydraulic gradient is measured, Darcy's law was used to calculate the flux with permeability estimated from temperature responses below the riverbed. Otherwise, flux was estimated directly by assimilating multi‐depth temperature data at 1‐ or 2‐hr time intervals assuming one‐dimensional flow and heat transport governing equation. By comparing estimated fluxes with model‐generated synthetic truth, we demonstrated that both schemes have robust performance in estimating fluxes under highly dynamic flow conditions. This data assimilation‐based flux estimation method was able to capture the vertical sub‐daily fluxes using multi‐depth high‐resolution temperature data alone, even in the presence of multi‐dimensional flow. This approach has been successfully applied to real field temperature data collected at the Hanford site, which experiences highly dynamic HEFs. Our study shows the promise of adopting distributed 1‐D temperature monitoring to capture spatial and temporal exchange dynamics in river corridors at a watershed scale or beyond.

54 ENVIRONMENTAL SCIENCES↗

Data-model files associated with the manuscript "The Effects of Spatial and Temporal Resolution of Gridded Meteorological Forcing on Watershed Hydrological Responses" (Shuai et al., 2022 HESS)

This data package contains the model inputs and outputs used in "The Effects of Spatial and Temporal Resolution of Gridded Meteorological Forcing on Watershed Hydrological Responses" (Shuai et al., 2022 HESS). The data.zip file contains the data used to drive the model simulations. The model.zip file contains the XML input file for ATS. The notebook.zip file contains the Jupyter notebooks for pre- and post- processing model results. The figures.zip file contains the raw figures associated with the manuscript.Meteorological forcing plays a critical role in accurately simulating the watershed hydrological cycle. With the advancement of high-performance computing and the development of integrated watershed models, simulating the watershed hydrological cycle at high temporal (hourly to daily) and spatial resolution (10s of meters) has become efficient and computationally affordable. These hyperresolution watershed models require high resolution of meteorological forcing as model input to ensure the fidelity and accuracy of simulated responses. In this study, we utilized the Advanced Terrestrial Simulator (ATS), an integrated watershed model, to simulate surface and subsurface flow and land surface processes using unstructured meshes at the Coal Creek Watershed near Crested Butte (Colorado). We compared simulated watershed hydrologic responses including streamflow, and distributed variables such as evapotranspiration, snow water equivalent (SWE), and groundwater table driven by three publicly available, gridded meteorological forcings (GMFs) -- Daily Surface Weather and Climatological Summaries (Daymet), Parameter-elevation Regressions on Independent Slopes Model (PRISM), and North American Land Data Assimilation System (NLDAS). By comparing various spatial resolutions (ranging from 400 m to 4 km) of PRISM, the simulated streamflow only becomes marginally worse when spatial resolution of meteorological forcing is coarsened to 4 km (or 30% of the watershed area). However, the 4 km resolution has much worse performance than finer resolution in spatially distributed variables such as SWE. Using temporally disaggregated PRISM, we compared models forced by different temporal resolutions (hourly to daily), sub-daily resolution preserves the dynamic watershed responses (e.g., diurnal fluctuation of streamflow) that are absent in results forced by daily resolution. Conversely, the simulated streamflow shows better performance using daily resolution compared to that using sub-daily resolution. Our findings suggest that the choice of GMF and its spatiotemporal resolution depends on the quantity of interest and its spatial and temporal scale, which may have important implications on model calibration and watershed management decisions.

54 ENVIRONMENTAL SCIENCES↗

Modeling framework for evaluating the impacts of hydrodynamic pressure on hydrologic exchange fluxes and residence time for a large-scale river section over a long-term period

Quantifying hydrologic exchange fluxes (HEF) at the river and subsurface interface and their residence times (RT) in subsurface are important for managing the water quality and ecosystem health in dynamic river corridor systems. In this study, a modeling framework is developed for coupling the three-dimensional (3D) multi-phase surface, subsurface flow transport, and numerical tracer model for RT in a large-scale river section over a long period. The framework is utilized to evaluate the impacts of hydrodynamic pressure on HEFs and RT for a 30 km section of the Columbia River in Washington State over a three-year period. Based on comparisons between model simulations with and without considering hydrodynamic pressure, we found that hydrodynamic pressure increases the net HEFs by 7% with river gaining water from the subsurface domain, and leads to slight reduction of RT.

54 ENVIRONMENTAL SCIENCES↗

Building Intelligent Cyberinfrastructure to Learn Iteratively from both Observations and Models for Understanding Watershed Dynamics

Focal Area(s): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection). Science Challenge: Watershed processes, such as the fate and transport of sediment, carbon and nutrients across landscapes and their fluxes to water bodies (e.g., streams, rivers and lakes), have important implications for global and regional carbon and nutrient dynamics, biogeochemical functioning of terrestrial ecosystems, and soil functions. The magnitude of lateral surface/subsurface transport and fluxes of sediment, carbon and nutrients are key factors controlling the vulnerability of watersheds to climate extremes such as droughts, wildfires, and floods. Recent field observations and other scientific evidence suggest that the magnitudes of lateral transport and fluxes of sediment, carbon and nutrients are governed primarily by the spatial and vertical heterogeneity of landscape and soil properties and by pedogenic processes. However, the current generation of land surface and watershed models do not mechanistically couple the terrestrial and hydrologic systems, nor do they represent sufficiently the spatial and vertical heterogeneity of land surface and subsurface properties. On the other hand, increasing complexity of coupled watershed and land surface models requires more data to parameterize, calibrate and validate. Remote sensing (RS) provides a means to acquire spatial data and characterize their heterogeneity at the watershed scale, overcoming a major limitation associated with conventional point measurements. To improve the representation of land-surface and surface/subsurface process coupling and sub-grid heterogeneity in watershed models, it is essential to build our predictive understanding by learning from both the multi-scale multi-process modeling and diverse multi-scale data while leveraging powerful artificial intelligence (AI) techniques.

54 ENVIRONMENTAL SCIENCES↗

Towards Trustworthy and Interpretable Deep Learning-assisted Ecohydrological Models

The transformational science question we plan to address is: How do we leverage in-situ observations and simulations from process-based ecohydrological model to construct interpretable and trustworthy deep learning (DL) models for improved reliability of prediction of quantities of interest (QoIs) under hydro-climatic extremes?

54 ENVIRONMENTAL SCIENCES↗

Estimating Watershed Subsurface Permeability From Stream Discharge Data Using Deep Neural Networks

Subsurface permeability is a key parameter in watershed models that controls the contribution from the subsurface flow to stream flows. Since the permeability is difficult and expensive to measure directly at the spatial extent and resolution required by fully distributed watershed models, estimation through inverse modeling has had a long history in subsurface hydrology. The wide availability of stream surface flow data, compared to groundwater monitoring data, provides a new data source to infer soil and geologic properties using integrated surface and subsurface hydrologic models. As most of the existing methods have shown difficulty in dealing with highly nonlinear inverse problems, we explore the use of deep neural networks for inversion owing to their successes in mapping complex, highly nonlinear relationships. We train various deep neural network (DNN) models with different architectures to predict subsurface permeability from stream discharge hydrograph at the watershed outlet. The training data are obtained from ensemble simulations of hydrographs corresponding to an permeability ensemble using a fully-distributed, integrated surface-subsurface hydrologic model. The trained model is then applied to estimate the permeability of the real watershed using its observed hydrograph at the outlet. Our study demonstrates that the permeabilities of the soil and geologic facies that make significant contributions to the outlet discharge can be more accurately estimated from the discharge data. Their estimations are also more robust with observation errors. Compared to the traditional ensemble smoother method, DNNs show stronger performance in capturing the nonlinear relationship between permeability and stream hydrograph to accurately estimate permeability. Our study sheds new light on the value of the emerging deep learning methods in assisting integrated watershed modeling by improving parameter estimation, which will eventually reduce the uncertainty in predictive watershed models.

54 ENVIRONMENTAL SCIENCES↗

High-Performance Simulation of Dynamic Hydrologic Exchange and Implications for Surrogate Flow and Reactive Transport Modeling in a Large River Corridor

Hydrologic exchange flows (HEFs) have environmental significance in riverine ecosystems. Key river channel factors that influence the spatial and temporal variations of HEFs include river stage, riverbed morphology, and riverbed hydraulic conductivity. However, their impacts on HEFs were often evaluated independently or on small scales. In this study, we numerically evaluated the combined interactions of these factors on HEFs using a high-performance simulator, PFLOTRAN, for subsurface flow and transport. The model covers 51 square kilometers of a selected river corridor with large sinuosity along the Hanford Reach of the Columbia River in Washington, US. Three years of spatially distributed hourly river stages were applied to the riverbed. Compared to the simulation when riverbed heterogeneity is not ignored, the simulation using homogeneous riverbed conductivity underestimated HEFs, especially upwelling from lateral features, and overestimated the mean residence times derived from particle tracking. To derive a surrogate model for the river corridor, we amended the widely used transient storage model (TSM) for riverine solute study at reach scale with reactions. By treating the whole river corridor as a batch reactor, the temporal changes in the exchange rate coefficient for the TSM were derived from the dynamic residence time estimated from the hourly PFLOTRAN results. The TSM results were evaluated against the effective concentrations in the hyporheic zone calculated from the PFLOTRAN simulations. Our results show that there is potential to parameterize surrogate models such as TSM amended with biogeochemical reactions while incorporating small-scale process understandings and the signature of time-varying streamflow to advance the mechanistic understanding of river corridor processes at reach to watershed scales. However, the assumption of a well-mixed storage zone for TSM should be revisited when redox-sensitive reactions in the storage zones play important roles in river corridor functioning.

Fang, Yilin↗