Abstract
Forecasting groundwater changes is a crucial step towards effective water resource planning and sustainable management. Conventional models still demonstrated insufficient performance when aquifers have high spatio-temporal heterogeneity or inadequate availability of data in simulating groundwater behavior. In this regard, a spatio-temporal groundwater deep learning model is proposed to be applied for monthly groundwater prediction over the entire Choushui River Alluvial Fan in Central Taiwan. The combination of the Convolution Neural Network (CNN) and Long Short-Term Memory (LSTM) known as Convolutional Long Short-Term Memory (CLSTM) Neural Network is proposed and investigated. Result showed that the monthly groundwater simulations from the proposed neural model were better reflective of the original observation data while producing significant improvements in comparison to only the CNN, LSTM as well as classical neural models. The study also explored the performance of the Masked CLSTM model which is designed to handle missing data by reconstructing incomplete spatio-temporal input images, enhancing groundwater forecasting through image inpainting. The findings indicated that the neural architecture can efficiently extract the relevant spatial features from the past incomplete information of hydraulic head observations under various masking scenarios while simultaneously handling the varying temporal dependencies over the entire study region. The proposed model showed strong reliability in reconstructing and simulating the spatial distribution of hydraulic heads for the following month, as evidenced by low RMSE values and high correlation coefficients when compared to observed data.
1 Introduction
Groundwater is a vital resource of freshwater that is being utilized for a variety of purposes such as agriculture, drinking, and industrial production (Famiglietti, ; Kulkarni et al., ; Megdal et al., ; Mukherjee, ). Recently, significant global warming, e.g., rise in global temperature (Sen, ; Zhang et al., ), rapid unchecked population growth, and urban expansion (Deacon et al., ; Famiglietti, ), has adversely affected these groundwater resources. Monitoring groundwater changes is an important step for its planning and management (Bai and Tahmasebi, ) which could ultimately lead to its sustainable usage (Solgi et al., ). However, developing spatio-temporal groundwater prediction models that accurately quantify and represent the complexity of groundwater systems still poses a serious challenge since the fluctuations are heavily controlled by temporal and spatial variations of rainfall, pumping, and land cover change.
Using advanced machine learning and deep learning adequately captures the spatio-temporal dependencies of groundwater levels without requiring any knowledge of the underlying physical process, making such models more efficient. One of the most popular neural network models adopted for time series prediction has been the long short-term memory (LSTM) (Hochreiter and Schmidhuber, ), which is superior in capturing the long-term dependencies and was originally created to solve the vanishing gradient problem in the recurrent neural network (RNN). The LSTM model has demonstrated great forecasting capabilities in groundwater research (Solgi et al., ; Vu et al., ; Wu et al., ; Sun et al., ). However, it has been shown to perform poorly when the modeling involves prediction over a large number of time series sequences simultaneously (Patra et al., ). In this regard, convolutional neural network (CNN) can capture spatial features effectively that has also shown tremendous performance for spatio-temporal modeling in groundwater field (Wunsch et al., ; Hakim et al., ). Although the performance of standalone CNN and LSTM models has been varied across regions and might not capture spatio-temporal variation effectively. In this context, the convolution process can be integrated with LSTM as convolutional long short-term memory (CLSTM) neural network that provides a great alternative for spatio-temporal modeling tasks, especially in environmental and hydrological modeling. This integration showed its superiority for accurate air quality prediction in comparison to various statistical and deep learning models (Zhang and Li, ). Furthermore, the CNN-LSTM was also shown to outperform standalone CNN and LSTM models for a variety of environmental modeling applications such as water quality (Yang et al., ), multiple lakes water level (Barzegar et al., ), and river flow prediction (Li et al., ). For groundwater prediction, the CNN-LSTM model produced more accurate groundwater simulations than the traditional LSTM and CNN architecture (Seo and Lee, ; Yang and Zhang, ). However, most of these studies relied on various hydrometeorological and remote sensing variables, making their model applicable with such complete dataset.
The current literature on groundwater prediction using neural networks reveals a noticeable gap in the implementation of spatio-temporal reconstruction, particularly within the context of the CLSTM model through image inpainting. The fundamental principle of image inpainting is to explicitly use neural models to recover missing pixels based on the information in the existing parts of the image. Image inpainting in the field of computer vision applications has been gaining great attraction that helps restore damaged or incomplete images with missing or unknown pixel values. Advanced neural techniques have been proposed to restore high-quality images (Zhu et al., ; Wang et al., ; Quan et al., ; Chen et al., ) while also evolving considerably for spatio-temporal data prediction (Bapaume et al., ; Liu and Liu, ; Liu et al., ). The primary objective of this research is to fully embrace the potential of leveraging this innovative method for data recovery in groundwater monitoring when facing challenges such as incomplete information in modeling due to sensory errors or power outages. The integration of image inpainting into the existing framework could prove to be a pivotal solution in addressing data availability issues in groundwater modeling. This novel approach marks a crucial step forward in introducing a CLSTM technique for enhancing the reliability of groundwater simulations, which was not considered in previously related studies (Seo and Lee, ; Yang and Zhang, ).
Addressing the highlighted research gaps, this study primarily concentrates on achieving the following objectives and making significant contributions to fill the identified voids in the existing literature: (1) A hybrid integration of CNN and LSTM, i.e., CLSTM, was proposed for next-month hydraulic head prediction by solely using its current observations and compared to its standalone counterparts, i.e., CNN and LSTM. (2) Spatio-temporal hydraulic head forecasting task using CLSTM was further formulated as an image inpainting problem under various masking scenarios to propose a modified model known as Masked CLSTM. The rest of this article is compiled as follows. The study area adopted for this research and a detailed description of the adopted dataset are introduced in Section 2. Section 3 presents the framework of each model along with the experimental setup conducted for the image-based monthly hydraulic head forecasting and its inpainting. The experimental results and their subsequent discussions are described in Sections 4 and 5, respectively, whereas the final conclusions are drawn in Section 6.
2 Materials and study area
2.1 Study area
The hydrological area adopted for this study was the Choushui River Alluvial Fan (CRAF), situated on the western coast of Central Taiwan within Changhua and Yunlin County (Figure 1a). The alluvial fan approximately covers 1,800 km2 area and has primarily been subdivided into distal, mid, and proximal fans. In general, the eastern mountainous region is designated as the proximal fan, where a majority of the aquifer recharge occurs since the area is predominantly composed of coarse sand and gravel (Jang et al., ). The west includes mid- and distal fans with a thicker aquifer system mainly comprising of silt and clay. The sediments in CRAF, such as quartzite, shale, sandstone, mudstone, and metamorphic, originate through the rock developments in the upstream watershed (Liu et al., ). CRAF is an important agricultural hub in Taiwan where groundwater extraction is conducted for a variety of purposes ranging from irrigation to aquaculture as well as industrial needs. A long-term survey of groundwater pumping in the area between 1970 and 1990 revealed that a total volume of 1.02 billion m3 per year was withdrawn from the aquifer system (Jang et al., ), while a more recent study indicated the annual figures to be crossing 3 billion m3 (Lee et al., ). The region regularly suffers from drought (Wang et al., ) and aquifer salinization (Liu et al., ), while the most predominant issues are caused by land subsidence (Tung and Hu, ; Wang et al., ; Ali et al., ; Chen et al., ; Chu et al., ,; Hung et al., ; Ku et al., ; Ku and Liu, ; Tatas et al., ) due to severe groundwater withdrawals. This issue has inflicted various socio-economic impacts on the area that alluded to water security and the safety of critical infrastructures such as the Taiwan High-Speed Rail. As per the subsurface geological survey conducted between 1992 and 1998 (Jang et al., ), the alluvial fan mainly consists of four aquifers, where “Aquifer-I” is the unconfined layer while the remaining represent confining units, i.e., “Aquifer-II,” “Aquifer-III,” and “Aquifer-IV” (Figure 1b). The Aquifer-II has the largest spatial extent and is the primary source of freshwater for the local population. Each aquifer is separated by a thick semi-permeable material known as aquitards and is defined by T1, T2, and T3. These aquitards are most prevalent in the distal and mid-fan areas.
Figure 1
2.2 Data
The hydraulic head measurements were collected from an extensive network of 51 monitoring wells spread across CRAF (Figure 1a) established by the Water Resource Agency of Taiwan. The measurements collected in this study spanned 21 years, starting from January 2001 to January 2022. These near-real-time monitoring wells measure the head changes within the aquifer system, particularly in “Aquifer-II.” The monitoring wells were selected following an initial assessment where < 5% of the data were missing. Since the primary objective of this study was to conduct monthly spatio-temporal groundwater prediction, firstly, the daily observations were transformed to monthly average values. A hydraulic head data cube (monthly image time series) was generated using the spatial interpolation technique, i.e., inverse distance weighting (Shepard,
A total of 253 monthly uninterrupted images of hydraulic heads spanning over 21 years were prepared in this study for spatio-temporal groundwater modeling. For proper evaluation of these spatio-temporal models, the data cube of the hydraulic head was segregated into a training set that consisted of 180 images (from January 2001 to December 2015), while the remaining 73 images (from January 2016 to January 2022) were used as evaluation set, with further subdivision into validation set (2016–18) and testing set (2019–22/01).
3 Methods
Figure 2 shows the standalone CNN, LSTM, and hybrid CLSTM as image-based model structures in the context of groundwater autocorrelation modeling proposed in this study.
Figure 2

Groundwater model architectures of (a) CNN, (b) LSTM, and (c) CLSTM.
3.1 CNN and LSTM models
A CNN architecture was proposed in this study having one convolution layer with max pooling followed by a hidden and an output layer (see Figure 2a). CNN incorporates specific feature extraction using convolution operations to process high-dimensional datasets. CNN includes filters with varying sizes or capacities to extract any relevant features from a particular portion of the image. Filters have the capability to slide across images to extract important features from various parts of the image. The versatility of CNN involves greater control over the size, number, and movement of these convolution filters across multiple images. In this study, 2D convolution filter was utilized. Equation 1 is provided to illustrate the 2D convolution operation (Yang and Zhang,
where F(i, j) is the feature map at a specific position (i, j) after convolution; K and I represent the size of the convolution filter and input image array, respectively. As the convolution filters slide across the image to extract relevant features, the corresponding feature elements are multiplied and summed. The feature map is then processed by an activation function to make it non-linear. Following the convolution process, the ReLU activation function introduces non-linearity into the network, enabling it to capture and model complex patterns and relationships. A pooling operation is conducted to downscale the feature map to preserve the most important information. Later, the downscaled 2D feature map array is flattened into a 1D vector before feeding it to a fully connected layer. Finally, the reshape function was used to transform the 1D prediction vector to a spatial image of next-month hydraulic heads (Figure 2a).
The LSTM models are critically acclaimed in various research works dealing with time series prediction, especially in the realm of groundwater (Solgi et al.,
3.2 CLSTM hybrid model
For spatio-temporal time series prediction involving many multivariate sequences, it would be advantageous to consider the ability of CNN to extract useful spatial information, and incorporate it with a dynamic LSTM memory cell for handling temporal dependencies that would serve the purpose of accurate and reliable spatio-temporal prediction of groundwater. A hybrid integration of convolution operation with LSTM in the form of CLSTM model (Seo and Lee,
where ht and ht+1 are the current and next month's hydraulic heads, respectively. The CLSTM model in this study uses a single convolution layer followed by a max pooling layer for extracting the most relevant spatial features pertaining to groundwater over CRAF. Feature maps were then flattened and given to the LSTM layer for handling the temporal change followed by a single hidden layer. Finally, an output layer alongside the reshape function was used to transform the 1D prediction vector to a spatial image of next-month hydraulic heads (see Figure 2c).
3.3 Masked CLSTM
This study further analyzes the data recovery ability of Masked CLSTM through spatio-temporal image inpainting for time-varying groundwater simulation. The model was designed to generate a complete next month (t + 1) image of the hydraulic head using the incomplete or masked current month (t) hydraulic head image as inputs. The Masked CLSTM expression can be represented by the image inpainting problem proposed here, as shown below:
where represents a masked (no-data) current month (t) hydraulic head image; represents a complete next month (t + 1) image of the hydraulic head.
This Masked CLSTM was inspired by the previously proposed encoder–decoder architecture, a type of scalable vision learners trained on masked random patches of input images to reconstruct the missing pixels (He et al.,
Figure 3

Spatio-temporal image inpainting in groundwater modeling using Masked CLSTM based on masked dataset scenarios such as random point masking and regional masking.
Figure 4

Randomly masked (a) 10%, (b) 20%, (c) 30%, (d) 40%, (e) 50%, (f) 60%, (g) 70%, (h) 80%, and (i) 90% for previous timestep; regionally masked (j) downstream and (k) upstream of hydraulic head images.
3.4 Data normalization, model calibration, and its assessment
The data dimensionality significantly impacts the convergence rate of deep learning models. The piezometric records from the confined aquifer over CRAF had varying ranges owing to the significant elevation change observed in the area. These piezometric readings were normalized to a common range of [0, 1] for accelerated model calibration and its convergence for accurate predictions. Normalization was applied separately to the training and evaluation datasets to prevent data leakage. The evaluation dataset (2016–22/01) was normalized using the minimum and maximum values derived from the training period (2001–15). For this study, the normalization was carried out using minimum and maximum values of a given pixel from the time series of hydraulic head images (Equation 4).
where h(i, j) and are the original and normalized hydraulic heads at a given pixel location (i, j) in the hydraulic head image. and define the minimum and maximum value obtained at the given pixel location (i, j) based on the sequence of hydraulic head images.
The model calibration was conducted over 15 years (2001–15) of the training data for 200 epochs and the corresponding assessment on the remaining 6 years (2016–22/01) of the evaluation dataset that includes both validation (2016–18) and testing (2019–22/01) sets. The objective (loss) function was set to mean squared error (MSE) with “Adam” (Kingma and Ba,
Here, ho, k and hs, k represent the observed and simulated hydraulic head values, respectively, Similarly, and are the mean values of the observed and simulated hydraulic head sequence, respectively.
4 Results
4.1 Performance of CNN, LSTM, and CLSTM models
Evaluation of model performances was carried out using RMSE and correlation coefficient (r) for spatio-temporal hydraulic head prediction. Figure 5 provides the spatial error distribution maps obtained for the MLP, RNN, CNN, LSTM, and CLSTM models. For the sake of brevity, we primarily focused on analyzing model results over the evaluation dataset, which was the unseen period (2016–22/01). The relative performance of the hybrid CLSTM model showed much wider improvements across the alluvial fan in comparison to the baseline models, i.e., MLP, RNN, LSTM, and CNN. The RMSE for the next month's hydraulic head simulations dropped from almost 2 m to well below 1 m in coastal areas of Changhua County. Similarly, the r value also jumped significantly from 0.6 to over 0.85 in many locations as well here. Widespread enhancements in predictions were also observed across areas of proximal fan and mid-fan regions. RMSE values fell from 1 m to nearly 0.6 m here, while some areas close to mountains exhibited a remarkable drop of almost 50% drop. The CLSTM (RMSE ~3.3 m) model also demonstrated strong predictive skill in the southwest coastal area (drawdown-dominated) of Yunlin County in comparison to the MLP, RNN, LSTM (RMSE ~5 m), and CNN (RMSE 4–5 m) models. Consequently, r values also improved remarkably from roughly 0.8 (MLP, RNN, and LSTM) and 0.7 (CNN) to 0.95 in CLSTM model here. The nearby Central Yunlin area having severe subsidence (Ali et al.,
Figure 5

Spatial maps of RMSE (a–e) and r(f–j) obtained during the evaluation period (2016–22/01) from MLP, RNN, LSTM, CNN, and CLSTM models.
Table 1
| Models | Layers | Filters | Nodes | Kernel/pool size | Activation |
|---|---|---|---|---|---|
| MLP | First hidden layer | – | 64 | – | ReLU |
| Second hidden layer | – | 32 | – | ReLU | |
| Third hidden layer | – | 16 | – | ReLU | |
| Fourth hidden layer | – | 8 | – | ReLU | |
| RNN/LSTM | RNN/LSTM | – | 64 | – | ReLU |
| Hidden layer | – | 64 | – | ReLU | |
| CNN | Convolution | 64 | – | (3, 3) | ReLU |
| Max pooling | – | – | (2, 2) | – | |
| Hidden layer | – | 32 | – | ReLU | |
| CLSTM | Convolution | 64 | – | (3, 3) | ReLU |
| Max pooling | – | – | (2, 2) | – | |
| LSTM | – | 32 | – | ReLU | |
| Hidden layer | – | 32 | – | ReLU |
Optimal parameters for MLP, RNN, LSTM, CNN, and CLSTM models.
Optimizer: Adam; loss function: mean squared error (MSE); Epochs: 200; early stopping patience: 10 epochs.
For the sake of brevity, the comparative analysis of the CLSTM model from here on is mainly emphasized with CNN and LSTM, as the performance of RNN was drastically poorer than LSTM, whereas the MLP consistently underperformed compared to the CNN, especially in terms of RMSE. The time series plots are depicted in Figure 6 for the three models (CNN, LSTM, and CLSTM) over six arbitrarily chosen wells spread across CRAF. It is clearly observed that the peaks and troughs simulated by the CLSTM model were the best reflections of the observations. The residual plots for the evaluation set from CLSTM model nearly followed a normal distribution (see Figure 7c) due to their strong spatio-temporal contextual learning ability, and a slight skewness was witnessed for both LSTM and CNN (Figures 7a, b). While the LSTM model showed slightly better r values in comparison to CNN and CLSTM models, through the graphical visualization, it can be inferred that the CLSTM model adequately captured the seasonal variability of the groundwater system and provided the best estimation. This can also be further evidenced through the simulated spatial distribution of hydraulic heads illustrated in Figure 8, representing the recent winter (January 2021), summer (July 2021), and fall seasons (October 2021). The summer and fall periods are usually dominated by frequent downpours in Taiwan. The spatial distribution of hydraulic heads simulated by the CLSTM model was more accurate in representing the spatial distribution of next-month groundwater condition. Overestimations were witnessed in the summer season (July 2021) from the standalone LSTM and CNN models in the southwest coastal area (drawdown-dominated) of Yunlin County, as was evident from the RMSE maps. Furthermore, stepwise feature assessment on lags of up to 4 months indicated that the current month (ht) input (Figures 5e, j) was the best feature in driving the precision of model estimations, where its removal considerably increased RMSE (>5 m) and decreased r (< 0.1) (Figure A1) across the region. In addition to this, the proposed CLSTM model outperformed and showed widespread improvements in RMSE and r in comparison to other traditional models such as MLP and RNN (Figures 5a, b, f, g). Additional evaluation was also conducted by modifying the periods considered in training (2007–22/01) and evaluation (2001–2006) sets for model training. The spatial error maps for the evaluation set during 2016–22/01 (Figure 5) or 2001–2006 (Figure A2) are mostly identical, and CLSTM model manages to outperform the standalone CNN and LSTM models. This shows the superiority of CLSTM while dealing with image time series prediction of groundwater that combines the relevant spatial features extracted by the convolution filter together with the power of LSTM memory cell to simultaneously handle various temporal dependencies, thereby improving the adaptability and robustness of the combined model. Moreover, it is worth pointing out that the CLSTM model was trained only using the past observation of hydraulic head which could be a reliable surrogate for the regional variability of rainfall and anthropogenic activities. This makes the model proposed in this research more applicable over a wider range of groundwater basins for near-real-time groundwater monitoring and management through reliable spatio-temporal forecasts of monthly hydraulic heads when adequate availability of meteorological variables is relatively scarce. The learning curves associated with the three models' training are provided in Figure A3 of the Appendix section. The learning curves reveal important insights into the training process and performance of the models. The LSTM model (Figure A3a) shows considerable fluctuation in both training and validation loss, particularly in the initial epochs, indicating challenges in stabilizing and generalizing to spatial heterogeneity associated with regional groundwater variation. The CNN model (Figure A3b) demonstrates a rapid reduction in training loss, suggesting efficient learning of spatial features. However, the greater variation in validation loss highlights potential issues with temporal generalization. In contrast, the CLSTM model (Figure A3c) exhibits a rapid and stable reduction in both training and validation loss, reflecting its ability to effectively capture both spatial and temporal dependencies. The close alignment of training and validation losses for the CLSTM model underscores its robust generalization capabilities, making it better suited for regional modeling tasks compared to standalone CNN and LSTM models. The spatial maps of RMSE and correlation coefficient (r) obtained for the training subset through CNN, LSTM, and CLSTM models are given in Figure A4.
Figure 6

Time series plots of the simulated groundwater by LSTM, CNN, and CLSTM models over six distinct wells (a–f) during training (2001–15) and evaluation (2016–22/01) periods.
Figure 7

Distribution of model residue obtained for the evaluation period (2016–22/01): (a) LSTM, (b) CNN, and (c) CLSTM (unit: m).
Figure 8

Observed vs. simulated spatial distribution of hydraulic head from LSTM, CNN, and CLSTM models in January (a–d), July (e–h), and October (i–l) of 2021.
4.2 Spatio-temporal reconstruction in groundwater forecasting
The Masked CLSTM model was also proposed and evaluated under various masking scenarios in simulating complete spatial images of monthly hydraulic heads. The spatial maps for RMSE and r obtained for all random point masking scenarios over the evaluation set are depicted in Figures 9, 10, respectively. All obtained error maps having 10–90% masked pixels are somewhat identical to the error distributions witnessed under the no masking condition (Figures 5e, j). However, the model performance starts to slowly deplete, beginning at 60% masking, especially in terms of r (Figure 10f) with the most prominent errors observed for 80% (Figures 9h, 10h) and 90% (Figures 9i, 10i). Still, the Masked CLSTM model showed greater data recovery capability with 80% and 90% missing pixels where over 90% of the data were adequately recovered, which is evident from their error distribution maps (see Figures 9h, i, 10h, i). The (3, 3) sized convolution filter developed in this study could still learn the contextual information even after several missing pixels, which is indicative of the superiority demonstrated by such advanced CNN-based deep learning technique in the field of groundwater modeling. The time series plots observed for six masked wells (red circle in Figure 1) are also indicative of the high level of spatio-temporal extrapolative ability of the Masked CLSTM model (Figure A5). For all scenarios, the simulated hydraulic head values were much closer to the originally recorded fluctuations. However, at 80 and 90% masking, as previously indicated, the model predictions slightly deviated more from the observation values at some locations. The peaks and troughs were occasionally under-predicted due to significant information loss. Still, the model showed potential signs of adequate learning capabilities under masked scenarios by authentically capturing the overall seasonal variability of the masked locations, which is a sign of reliability over its simulated groundwater conditions when significant dataset is limited. The results reported in this section for random point masking were based on the same model parameter values of CLSTM given in Table 1.
Figure 9

RMSE maps for the random point masking scenario in the evaluation set (2016–22/01) in Masked CLSTM considering (a) 10%, (b) 20%, (c) 30%, (d) 40%, (e) 50%, (f) 60%, (g) 70%, (h) 80%, and (i) 90% masking.
Figure 10

Correlation coefficient (r) maps of the random point masking scenario in the evaluation set (2016–22/01) in Masked CLSTM: (a) 10%, (b) 20%, (c) 30%, (d) 40%, (e) 50%, (f) 60%, (g) 70%, (h) 80%, and (i) 90% masking.
For the regional masking scenario, the downstream region that was selected from the Yunlin area is primarily used for aquaculture activities, which induces various uncertainties in the hydraulic head records. The upstream side is a major recharge zone where most of the groundwater recharge occurs, thereby heavy influence from natural hydrological cycles. The model under two distinct hydrological conditions satisfactorily provides good data recovery opportunities. The error maps (Figure 11) obtained under two regions, specifically the masked areas (black squares), retained relatively close RMSE and r values over most of the masked pixels compared to the results with no masking (Figures 5e, j). However, some parts of the upstream side that were masked (central) witnessed a slight increase in RMSE (Figure 11b). The simulated sequences (Figures A6, A7) observed for both cases within the masked region indicate that the model reasonably predicts the hydraulic head in the masked coastal parts and the upstream. There is less variance in the hydraulic head records in the upstream area having limited pumping and reduced anthropogenic interference. In contrast, the coastal side that was masked for this case study is vastly covered with anthropogenic pumping for aquaculture and several other uncertainties induced by the infiltration from nearby fish ponds or leakage through the pumping wells (Liu et al.,
Figure 11

Spatial maps of RMSE (a, b) and r(c, d) in the evaluation set (2016–22/01) (note: black squares are the regionally masked areas) in Masked CLSTM for regional masking scenarios at downstream and upstream.
5 Discussion
5.1 CLSTM for spatio-temporal groundwater modeling
The study highlights the effectiveness of the CLSTM hybrid architecture as a superior alternative to the baseline LSTM and CNN models in groundwater modeling. By extracting relevant features through convolution filters and downsampling via max pooling, the trained LSTM layer demonstrated the ability to generalize across images, resulting in more accurate forecasts of the future state of groundwater. The CLSTM model outperformed the standalone LSTM model that is widely adopted for time series prediction tasks. The standalone LSTM and CNN models demonstrated extremely poor results in the drawdown-dominated southwest coast, with RMSE almost touching 5 m and r values 0.6–0.7, whereas the CLSTM model reduced RMSE 3.2 m and achieved better r value of about 0.9. The southwest coastal region is characterized by significant groundwater drawdown due to extensive pumping, leading to complex and high variance in groundwater levels. Standalone CNN and LSTM models, which might excel in capturing spatial or temporal patterns individually, struggle to accurately model these interactions. CNNs are primarily designed to capture spatial features but lack the capability to effectively model temporal dependencies, which are crucial in regions with significant drawdown and variable groundwater extraction rates. LSTMs are effective at capturing temporal sequences but are not inherently designed to model complex spatial heterogeneity, such as varying subsurface conditions or localized pumping effects. This spatial heterogeneity is particularly pronounced in drawdown-dominated regions, leading to suboptimal performance when using LSTM alone. These limitations resulted in poorer performance from standalone models in regions where simultaneous consideration of spatial and temporal dynamics is critical. Moreover, these models showed poor performance in northern parts of Changhua and nearby coast, where the improvement in RMSE and r was observed around 20%−50% from CLSTM model. Interestingly, the number of nodes for the LSTM layer and the subsequent hidden layer reduced from 64 to 32 in CLSTM when compared to the standalone LSTM model (see Table 1). Such a considerable decrease in node requirements can be attributed to the decreased complexity of the LSTM layer after convolution and max pooling operations since subsequent layers are only trained on downscaled but essential features. A standalone LSTM model mostly performs inefficiently for such tasks since it was not designed to handle large multiple time series sequences simultaneously while considering their interdependencies. In addition, the CLSTM converged faster and required relatively less epoch to learn the spatio-temporal dependencies, making it the most efficient model in our study. This model also addresses one of the potential limitations in the Local-LSTM models that were previously proposed (Patra et al.,
5.2 Masked CLSTM in groundwater modeling
Similar to the Masked Autoencoder (He et al.,
The investigations illustrated in this study imply toward the potential implementation of an AI-based image inpainting approach in groundwater monitoring and management, particularly on the inputs from sensors that are seldomly obscured by power outages or sensor errors leading to the unavailability of spatial signatures. This approach can be further integrated into (1) operationalization of incomplete datasets where water resource monitoring agencies/industry could benefit from this research, thereby operationalizing these models that handle incomplete data effectively which can lead to more efficient use of available information, and (2) mitigation pertaining to data collection challenges that usually involve time-consuming field work, costly equipment, and inaccessible locations. The model can provide reasonable estimates in the absence of certain information and can be instrumental in mitigating these challenges and making predictions possible with partial datasets. Previous studies (Seo and Lee,
6 Conclusion
An effective CLSTM architecture was presented for spatio-temporal prediction of groundwater variations and was then assessed against the conventional LSTM and CNN models as well as MLP and RNN. The hybrid model contains great forecasting capabilities in temporal groundwater changes from LSTM and captures spatial features of groundwater patterns using CNN. The statistical evaluation of the simulations generated by these models involved the use of RMSE and correlation coefficients across the evaluation dataset. Results revealed that the CLSTM model significantly outperforms MLP, RNN, CNN, and LSTM models in most cases. This spatial feature extraction allows the model to retain essential spatial information and combine it with the temporal dynamics processed by the LSTM layer. The model achieved better simulations over most of the locations within upstream and southwest pumping-dominated coastal regions of CRAF while showing commendable improvements in the coastal regions of Northern Changhua and its nearby coastal area. Moreover, Masked CLSTM promoted a reliable assessment of the spatial distribution of hydraulic heads simulated to make a well-informed decision on the most appropriate approach for subsequent image inpainting experiments. Consequently, the Masked CLSTM was tasked to solve the spatio-temporal reconstruction problem using image inpainting for groundwater prediction. This model demonstrated greater capabilities in recovering the data under various masking scenarios and provided acceptable results from the lagged hydraulic head images with missing pixels, especially with 80% masking. Results are indicative of the advantages and potential of adopting Masked CLSTM beyond only groundwater prediction on historical datasets to recover groundwater information over locations that suffer from sensory errors or power outage issues.
This study provides a sophisticated study on the CLSTM model for reliable and efficient groundwater forecasting over a wider spatial extent, even with partial data. This study is an essential step toward effective groundwater resource planning and sustainable management that substantially contributes to mitigate groundwater depletion. Future studies can strive to explore the effects or sensitivity to missing data over the data recovery capabilities of the Masked CLSTM model with image inpainting on groundwater modeling over other regions. Moreover, future studies could expand upon the use of other iterations of hybrid/generative AI models such as transformers, generative adversarial networks, and graph neural networks for groundwater modeling or assessing the impacts of climate change on groundwater by considering more hydrometeorological data into the models.
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
SP: Data Curation, Formal Analysis, Investigation, Validation, Visualization, Conceptualization, Methodology, Writing – original draft. H-JC: Data Curation, Funding Acquisition, Investigation, Resources, Conceptualization, Supervision, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was supported by National Science and Technology Council (NSTC), Taiwan and Miin Wu School of Computing, NCKU.
Acknowledgments
The authors would like to thank the editors and reviewers for providing suggestions for paper improvement. Furthermore, the study was supported by the National Science and Technology Council (NSTC), NCKU Miin Wu School of Computing, and Water Resources Agency, Taiwan.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frwa.2024.1471258/full#supplementary-material
References
1
AliM. Z.ChuH. J.BurbeyT. J. (2020). Mapping and predicting subsidence from spatio-temporal regression models of groundwater-drawdown and subsidence observations. Hydrogeol. J.28, 2865–2876. 10.1007/s10040-020-02211-0
2
AliM. Z.ChuH. J.Tatas BurbeyT. J. (2021). Spatio-temporal estimation of monthly groundwater levels from GPS-based land deformation. Environ. Model. Softw.143:105123. 10.1016/j.envsoft.2021.105123
3
BaiT.TahmasebiP. (2023). Graph neural network for groundwater level forecasting. J. Hydrol.616:128792. 10.1016/j.jhydrol.2022.128792
4
BapaumeT.ComeE.RoosJ.AmeliM.OukhellouL. (2021). Image inpainting and deep learning to forecast short-term train loads. IEEE Access9, 98506–98522. 10.1109/ACCESS.2021.3093987
5
BarzegarR.AalamiM. T.AdamowskiJ. (2021). Coupling a hybrid CNN-LSTM deep learning model with a boundary corrected maximal overlap discrete wavelet transform for multiscale lake water level forecasting. J. Hydrol.598:126196. 10.1016/j.jhydrol.2021.126196
6
ChenM.ZangS.AiZ.ChiJ.YangG.ChenC.et al. (2023). RFA-Net: residual feature attention network for fine-grained image inpainting. Eng. Appl. Artif. Intell.119:105814. 10.1016/j.engappai.2022.105814
7
ChenY. A.ChangC. P.HungW. C.YenJ. Y.LuC. H.HwangC. (2021). Space-time evolutions of land subsidence in the choushui river alluvial fan (Taiwan) from multiple-sensor observations. Remote Sens.13, 1–21. 10.3390/rs13122281
8
ChuH. J.AliM. Z.BurbeyT. J. (2021a). Spatio-temporal data fusion for fine-resolution subsidence estimation. Environ. Model. Softw.137:104975. 10.1016/j.envsoft.2021.104975
9
ChuH. J.AliM. Z.Tatas BurbeyT. J. (2021b). Development of spatially varying groundwater-drawdown functions for land subsidence estimation. J. Hydrol. Reg. Stud.35:100808. 10.1016/j.ejrh.2021.100808
10
DeaconJ. E.WilliamsA. E.WilliamsC. D.WilliamsJ. E. (2007). Fueling population growth in Las Vegas: how large-scale groundwater withdrawal could burn regional biodiversity. Bioscience57, 688–698. 10.1641/B570809
11
FamigliettiJ. S. (2014). The global groundwater crisis. Nat. Clim. Change4, 945–948. 10.1038/nclimate2425
12
HakimW. L.NurA. S.RezaieF.PanahiM.LeeC.-W.LeeS. (2022). Convolutional neural network and long short-term memory algorithms for groundwater potential mapping in Anseong, South Korea. J. Hydrol. Reg. Stud.39:100990. 10.1016/j.ejrh.2022.100990
13
HeK.ChenX.XieS.LiY.DollarP.GirshickR. (2022). “Masked autoencoders are scalable vision learners,” in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (New Orleans, LA: IEEE), 15979–15988. 10.1109/CVPR52688.2022.01553
14
HochreiterS.SchmidhuberJ. (1997). Long short-term memory. Neural. Comput.9, 1735–1780. 10.1162/neco.1997.9.8.1735
15
HungW. C.HwangC.ChangC. P.YenJ. Y.LiuC. H.YangW. H. (2010). Monitoring severe aquifer-system compaction and land subsidence in Taiwan using multiple sensors: Yunlin, the southern Choushui river Alluvial fan. Environ. Earth Sci. 59, 1535–1548. 10.1007/s12665-009-0139-9
16
HungW. C.HwangC.SneedM.ChenY. A.ChuC. H.LinS. H. (2021). Measuring and Interpreting multilayer aquifer-system compactions for a sustainable groundwater-system development. Water Resour. Res.57:e2020WR028194. 10.1029/2020WR028194
17
JangC.-S.ChenS.-K.Ching-ChiehL. (2008a). Using multiple-variable indicator kriging to assess groundwater quality for irrigation in the aquifers of the Choushui River alluvial fan. Hydrol. Process.22, 4477–4489. 10.1002/hyp.7037
18
JangC.-S.LiuC. W.ChiaY.ChengL. H.ChenY. C. (2008b). Changes in hydrogeological properties of the River Choushui alluvial fan aquifer due to the 1999 Chi-Chi earthquake, Taiwan. Hydrogeol. J.16, 389–397. 10.1007/s10040-007-0233-6
19
JosephF. J. J.NonsiriS.MonsakulA. (2021). “Keras and TensorFlow: a hands-on experience,” in Advanced Deep Learning for Engineers and Scientists: A Practical Approach, eds. K. B. Prakash, R. Kannan, S. A. Alexander, and G. R. Kanagachidambaresan (New York, NY: EAI/Springer Innovations in Communication and Computing), 85–111. 10.1007/978-3-030-66519-7_4
20
KingmaD. P.BaJ. L. (2015). “Adam: a method for stochastic optimization,” in 3rd Int. Conf. Learn. Represent. ICLR 2015 - Conf. Track Proc. (San Diego), 1–15. 10.48550/arXiv.1412.6980
21
KuC.-Y.LiuC.-Y. (2023). Modeling of land subsidence using GIS-based artificial neural network in Yunlin County, Taiwan. Sci. Rep.13:4090. 10.1038/s41598-023-31390-5
22
KuC.-Y.LiuC.-Y.LuH.-C. (2022). Spatial variability in land subsidence and its relation to groundwater withdrawals in the choshui delta. Appl. Sci.12:12464. 10.3390/app122312464
23
KulkarniH.ShahM.Vijay ShankarP. S. (2015). Shaping the contours of groundwater governance in India. J. Hydrol. Reg. Stud.4, 172–192. 10.1016/j.ejrh.2014.11.004
24
LeeM.YuC. Y.ChiangP. C.HouC. H. (2018). Water-energy nexus for multi-criteria decision making in water resource management: a case study of Choshui river basin in Taiwan. Water 10. 10.3390/w10121740
25
LiX.XuW.RenM.JiangY.FuG. (2022). Hybrid CNN-LSTM models for river flow prediction. Water Supply22, 4902–4919. 10.2166/ws.2022.170
26
LiuC.-W.LinK.-H.ChenS.-Z.JangC.-S. (2003). Aquifer salinization in the Yun-Lin Coastal Area, Taiwan. J. Am. Water Resour. Assoc.39, 817–827. 10.1111/j.1752-1688.2003.tb04407.x
27
LiuC. H.PanY. W.LiaoJ. J.HuangC. T.OuyangS. (2004). Characterization of land subsidence in the Choshui River alluvial fan, Taiwan. Environ. Geol.45, 1154–1166. 10.1007/s00254-004-0983-6
28
LiuL.LiuY. (2022). Load image inpainting: an improved U-Net based load missing data recovery method. Appl. Energy327:119988. 10.1016/j.apenergy.2022.119988
29
LiuY.DuttaS.KongA. W. K.YeoC. K. (2023). An image inpainting approach to short-term load forecasting. IEEE Trans. Power Syst.38, 177–187. 10.1109/TPWRS.2022.3159493
30
MegdalS. B.GerlakA. K.VaradyR. G.HuangL.-Y. (2015). Groundwater governance in the united states: common priorities and challenges. Groundwater53, 677–684. 10.1111/gwat.12294
31
MoudgilP. S.RaoG. S. (2023). Groundwater levels estimation from GRACE/GRACE-FO and hydro-meteorological data using deep learning in Ganga River basin, India. Environ. Earth Sci.82:441. 10.1007/s12665-023-11137-1
32
MukherjeeA. (2018). “Overview of the groundwater of South Asia,” in Groundwater of South Asia, ed. A. Mukherjee (Singapore: Springer), 3–20. 10.1007/978-981-10-3889-1_1
33
MüllerJ.ParkJ.SahuR.VaradharajanC.AroraB.FaybishenkoB.et al. (2021). Surrogate optimization of deep neural networks for groundwater predictions. J. Glob. Optim.81, 203–231. 10.1007/s10898-020-00912-0
34
PatraS. R.ChuH.Tatas (2023). Regional groundwater sequential forecasting using global and local LSTM models. J. Hydrol. Reg. Stud.47:101442. 10.1016/j.ejrh.2023.101442
35
QuanW.ZhangR.ZhangY.LiZ.WangJ.YanD. M. (2022). Image inpainting with local and global refinement. IEEE Trans. Image Process.31, 2405–2420. 10.1109/TIP.2022.3152624
36
SenZ. (2009). Global warming threat on water resources and environment: a review. Environ. Geol.57, 321–329. 10.1007/s00254-008-1569-5
37
SeoJ. Y.LeeS.-I. (2021). Predicting changes in spatiotemporal groundwater storage through the integration of multi-satellite data and deep learning models. IEEE Access9, 157571–157583. 10.1109/ACCESS.2021.3130306
38
ShepardD. (1968). “A two-dimensional interpolation function for irregularly-spaced data,” in Proceedings of the 1968 23rd ACM National Conference (New York, NY: ACM Press), 517–524. 10.1145/800186.810616
39
SolgiR.LoáicigaH. A.KramM. (2021). Long short-term memory neural network (LSTM-NN) for aquifer level time series forecasting using in-situ piezometric observations. J. Hydrol.601:126800. 10.1016/j.jhydrol.2021.126800
40
SunJ.HuL.LiD.SunK.YangZ. (2022). Data-driven models for accurate groundwater level prediction and their practical significance in groundwater management. J. Hydrol.608:127630. 10.1016/j.jhydrol.2022.127630
41
Tatas ChuH.-J.BurbeyT. J.LinC.-W. (2023). Mapping regional subsidence rate from electricity consumption-based groundwater extraction. J. Hydrol. Reg. Stud.45:101289. 10.1016/j.ejrh.2022.101289
42
Tatas ChuH. J.BurbeyT. J. (2022). Estimating future (next-month's) spatial groundwater response from current regional pumping and precipitation rates. J. Hydrol.604:127160. 10.1016/j.jhydrol.2021.127160
43
TungH.HuJ. C. (2012). Assessments of serious anthropogenic land subsidence in Yunlin County of central Taiwan from 1996 to 1999 by persistent scatterers InSAR. Tectonophysics578, 126–135. 10.1016/j.tecto.2012.08.009
44
VuM. T.JardaniA.MasseiN.FournierM. (2021). Reconstruction of missing groundwater level data by using long short-term memory (LSTM) deep neural network. J. Hydrol.597:125776. 10.1016/j.jhydrol.2020.125776
45
WangN.ZhangY.ZhangL. (2021). Dynamic Selection Network for Image Inpainting. IEEE Trans. Image Process.30, 1784–1798. 10.1109/TIP.2020.3048629
46
WangS.-T.ChenY.-W.HuangW.-J.ChangL.-C.ChiangC. J.WangY.-S.et al. (2019). A study on the characteristics of groundwater in Choushui River Alluvial Fan - analysis of groundwater decline. J. Taiwan Agric. Eng.65, 12–22. 10.29974/JTAE.201906_65(2).0002
47
WangS. J.LeeC. H.HsuK. C. (2015). A technique for quantifying groundwater pumping and land subsidence using a nonlinear stochastic poroelastic model. Environ. Earth Sci.73, 8111–8124. 10.1007/s12665-014-3970-6
48
WuC.ZhangX.WangW.LuC.ZhangY.QinW.et al. (2021). Groundwater level modeling framework by combining the wavelet transform with a long short-term memory data-driven model. Sci. Total Environ.783:146948. 10.1016/j.scitotenv.2021.146948
49
WunschA.LieschT.BrodaS. (2021). Groundwater level forecasting with artificial neural networks: a comparison of long short-term memory (LSTM), convolutional neural networks (CNNs), and non-linear autoregressive networks with exogenous input (NARX). Hydrol. Earth Syst. Sci.25, 1671–1687. 10.5194/hess-25-1671-2021
50
YangX.ZhangZ. (2022). A CNN-LSTM model based on a meta-learning algorithm to predict groundwater level in the middle and lower reaches of the Heihe River, China. Water 14. 10.3390/w14152377
51
YangY.XiongQ.WuC.ZouQ.YuY.YiH.et al. (2021). A study on water quality prediction by a hybrid CNN-LSTM model with attention mechanism. Environ. Sci. Pollut. Res.28, 55129–55139. 10.1007/s11356-021-14687-8
52
ZhangJ.LiS. (2022). Air quality index forecast in Beijing based on CNN-LSTM multi-model. Chemosphere308:136180. 10.1016/j.chemosphere.2022.136180
53
ZhangX.HaoZ.SinghV. P.ZhangY.FengS.XuY.et al. (2022). Drought propagation under global warming: characteristics, approaches, processes, and controlling factors. Sci. Total Environ.838:156021. 10.1016/j.scitotenv.2022.156021
54
ZhuX.QianY.ZhaoX.SunB.SunY. (2018). A deep learning approach to patch-based image inpainting forensics. Signal Process. Image Commun.67, 90–99. 10.1016/j.image.2018.05.015
Summary
Keywords
CNN, groundwater forecasting, LSTM, image inpainting, CLSTM
Citation
Patra SR and Chu H-J (2024) Convolutional long short-term memory neural network for groundwater change prediction. Front. Water 6:1471258. doi: 10.3389/frwa.2024.1471258
Received
26 July 2024
Accepted
22 October 2024
Published
13 November 2024
Volume
6 - 2024
Edited by
Ali Saber, University of Windsor, Canada
Reviewed by
Reetik Sahu, International Institute for Applied Systems Analysis (IIASA), Austria
Sadra Shadkani, University of Tabriz, Iran
Updates

Check for updates
Copyright
© 2024 Patra and Chu.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hone-Jay Chu honejaychu@geomatics.ncku.edu.tw
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.