Abstract
The Sudan-Sahel region in West Africa is highly vulnerable to rainfall variability, which poses significant challenges to agriculture and water resource management. This study provides an assessment of seasonal rainfall prediction models in the region, focusing on the West African Regional Climate Outlook Forum (WARCOF, 1998–2023), the latest generation of the seasonal forecasting system from the European Centre for Medium-Range Weather Forecasts (ECMWF SEAS5, 1981-2023), and a novel atmospheric circulation-pattern-based logistic regression model (1981–2023). The circulation-pattern-based model, which integrates key atmospheric dynamics like near-surface wind anomalies, outperforms both WARCOF and SEAS5 in predicting interannual rainfall variability. While WARCOF and SEAS5 demonstrate some predictive skill, both models exhibit biases: WARCOF has a dry bias, and SEAS5 displays both dry and wet biases. The circulation-pattern-based model, despite a slight wet bias, delivers more accurate categorical predictions and offers greater reliability. An economic value analysis reveals that the circulation-pattern-based model provides a broader range of positive economic outcomes, making it more suitable for decision-making across various cost-loss scenarios. By introducing this novel model and evaluating traditional forecasting techniques, this study lays the groundwork for more accurate and reliable seasonal rainfall predictions.
1 Introduction
The Sudan-Sahel region has experienced significant interannual variability in seasonal rainfall over recent decades (Nouaceur and Murarescu, ; Rauch et al., ), presenting a major challenge due to the high dependence on rain-fed agriculture and pastoralism (Zampaligré et al., ; Coly et al., ). Livelihoods are highly vulnerable to changes in seasonal rainfall patterns (Mertz et al., ). Accurate seasonal rainfall forecasts are therefore critical for reducing vulnerability and enhancing resilience in sectors such as agriculture and water resource management (Yengoh, ). Inaccurate or limited predictions of droughts, for instance, can have far-reaching effects on food security, economic stability, and water availability (Wilhite et al., ; Hao et al., ). Thus, improving seasonal rainfall predictions would enable stakeholders to better prepare for such events, mitigating their adverse effects and enhancing disaster preparedness (Portele et al., ).
In many parts of the world, seasonal predictions are generated by Regional Climate Outlook Forums (RCOFs), which bring together climate experts from national, regional, and international institutions (Semazzi, ). These forums aim to develop and disseminate seasonal climate outlooks, typically once or multiple times a year, tailored to specific geographic regions. The forum currently serving the Sudan-Sahel region in West Africa is known as Prévisions Climatiques Saisonnières en Afrique Soudano-Sahélienne (PRESASS). This forum is organized by the African Centre of Meteorological Application for Development (ACMAD) and the Centre Regional de Formation et d'Application en Agrométéorologie et Hydrologie Opérationelle (AGRYMET), which regularly convene in April or May to produce forecasts for the rainy season (Bliefernicht et al., ). These forecasts focus on June, July, August or July, August, September (JAS) periods and are disseminated to stakeholders in the form of maps and advisory documents, which serve as critical tools for decision-making across various sectors. The forecasting process categorizes seasonal rainfall into terciles (below-average, near-average, and above-average), where each tercile represents one-third of the long-term climatological data (typically 1981-2010). These categories are communicated through maps that indicate the likelihood of each category occurring across different regions. This approach helps simplify complex climate data into actionable insights for local decision-makers (Figure 1). For a more detailed discussion of this forecasting methodology, see Bliefernicht et al. () and Pirret et al. ().
Figure 1
Mason and Chidzambwa (
Operational seasonal forecasting models that support the WARCOF are relatively rare in West Africa. Many downscaling studies have primarily focused on developing and evaluating dynamical approaches (e.g., Siegmund et al.,
To address these challenges, the present study applies the CP-based logistic regression downscaling method developed by Rauch et al. (
In addition, it presents a more comprehensive and current evaluation of the WARCOF performance compared to previous studies like Mason and Chidzambwa (
2 Material and methods
This section outlines the target region, materials and methods used for the preprocessing, development, and evaluation of the selected seasonal rainfall prediction models for the Sudan-Sahel region. An overview of the workflow is provided in Figure 3.
2.1 Target region
For this evaluation, we focus on the Sudan-Sahel region (5.5°W 11°N to 2.4°E 13.5°N, Figure 2) as the target area, following a similar domain as Bliefernicht et al. (
Figure 2

The dashed domain indicates the predictor domain (30°W 5°S to 40°E 40°N), the smaller domain (solid) highlights the target area (5.5°W 11°N to 2.4°E 13.5°N).
2.2 CHIRPS
Due to the lack of access to recent observational data and the goal of developing an operational framework, we use the Climate Hazards Group Infrared Precipitation with Stations (CHIRPS) product (Funk et al.,
We select all grid points within the target area of Figure 2, average them spatially to extract a single daily time series, and then aggregate this to standardized annual JAS sums (denoted hereafter as RA). RA is then discretized into ordinal classes using two quantile thresholds (q1 and q2), where q1 represents the first and q2 the second tercile. This classification results in three categories: RA ≤ q1 (Class 1, below-average condition), q1<RA<q2 (Class 2, near-average condition), and RA≥q2 (Class 3, above-average condition). These categorizations serve as the target variables in a multi-class logistic regression model (similar to Rauch et al.,
As illustrated in Figure 4, the standardized JAS annual rainfall amounts from 1981 to 2023 capture the severe droughts of the 1980s, followed by a recovery in rainfall extending into the early 2020s (Hagos and Cook,
Figure 3

Workflow for seasonal rainfall prediction model evaluation in the Sudan-Sahel region. The process involves three prediction models: WARCOF (West African Regional Climate Outlook Forum), SEAS5 TP (“raw” total precipitation output from SEAS5), and CP-based logistic regression (Rauch et al.,
Figure 4

The standardized interannual rainfall variability for the target region (, σ = 78.01mm) and the period from 1981 to 2023 based on CHIRPS. The solid black line indicates the actual values of standardized annual rainfall sums (JAS). The two dashed lines mark the first and second tercile, dividing the data into three categories: below-average (yellow circle, below the first dashed line), near-average (red square, between the two dashed lines), and above-average (blue diamond, above the second dashed line).
2.3 West African Regional Climate Outlook Forum
WARCOF provides seasonal rainfall forecasts tailored for the main rainy season (JAS). The forecasts use tercile-based probabilities to categorize rainfall as below-average, near-average, or above-average (Figure 1). We use the WARCOF forecast maps from 1998 to 2017 archived by Pirret et al. (
2.4 Seasonal prediction system from ECMWF
The fifth version of ECMWF's seasonal prediction system (SEAS5) is based on a medium-range atmospheric model integrated with ocean, sea ice, land, and wave models (Johnson et al.,
As a second benchmark, we use the total precipitation (TP) variable from the forecast system initialized from 1 May. We select all available grid points within the target domain (Figure 2) to obtain an areal average of the JAS rainfall sums. This average is then categorized into ordinal classes: below-average, near-average, and above-average conditions, similar to the CHIRPS preprocessing (Section 2.2) but using mean and standard deviation of the system itself. However, each ensemble member is categorized individually to create probabilities for each tercile-based category. The results can be found in Supplementary Table S2.
2.5 The CP-based logistic regression model
The CP-based logistic regression model employed here closely aligns with that outlined in Rauch et al. (
In this equation, i = 1, ..., L represents the grid points, t = 1, ..., T denotes the time steps in days, e = 1, ..., E indicates the ensemble members, signifies the long-term mean over time and all ensemble members, and s(i) indicates the standard deviation of the time series over time and all ensemble members. This standardized unfiltered daily anomalies are then used to generate daily CPs with cluster counts ranging from 5 to 15 using k-means, and the respective clusters' annual occurrence frequencies are computed for each ensemble individually. These frequencies serve as predictor variables in a multi-class logistic regression model. The predictants in this regression are the classes: below-average, near-average, and above-average conditions (as described in Section 2.2 and shown in Figure 4). The logistic regression model predicts the category of each rainfall condition for every ensemble, generating probabilistic forecasts similar to those used in WARCOF by assigning probabilities to each tercile-based category. Methodological details about the different components (e.g., k-means or logistic regression) and the general workflow can be found in Rauch et al. (
Table 1
| Name | Abbreviation | Levels | Units | Input |
|---|---|---|---|---|
| Pressure-level variables | ||||
| U-component of wind | U | All levels | m s−1 | - |
| V-component of wind | V | All levels | m s−1 | - |
| Wind direction | WD | All levels | degrees | U, V |
| Wind speed | WS | All levels | m s−1 | U, V |
| Single-level variables | ||||
| 10 m U wind component | 10U | - | m s−1 | - |
| 10 m V wind component | 10V | - | m s−1 | - |
| Mean sea level pressure | MSLP | - | Pa | - |
Atmospheric variables from SEAS5, ECMWF: Listing of abbreviations, associated atmospheric pressures, units, and input variables for computation.
The designation “all levels” includes atmospheric pressures at 200hPa, 700hPa, 850hPa, and 925hPa.
2.6 Validation and performance measures
The models are trained on the SEAS5 hindcast period (1981 to 2016) and validated using the operational forecast period (2017–2023). The RPSS is calculated separately for the training (t) and validation (v) periods using this split-sampling approach, with further analysis performed using multicategory reliability diagrams, and the economic value and comparisons made to WARCOF and the raw TP output from SEAS5. The evaluation measures are further explained in the subsequent sections.
2.6.1 Ranked probability skill score
To evaluate the performance of our proposed model, one key metric is the Ranked Probability Score (RPS), which is widely used for probabilistic forecast verification (Kumar et al.,
where N is the total number of forecasts, K is the number of cumulative categories (e.g., below, near-average, above), Fi, k represents the cumulative forecast probability for the i-th event up to and including category k, and Oi, k represents the cumulative observed outcome for the i-th event up to and including category k (1 if the event is in or below category k; 0 otherwise). A lower RPS indicates better forecast accuracy, reflecting a closer alignment between predicted probabilities and observed events.
To further assess the forecast skill, we calculate the Ranked Probability Skill Score (RPSS), which measures the performance of our forecasts relative to reference forecasts. The RPSS is computed as follows:
where RPSref is the RPS of the reference forecast. An RPSS value greater than 0 indicates that the model outperforms the reference forecast, while a value of 1 indicates a perfect forecast.
In this study, we first calculate the RPS for two types of reference forecasts: a persistence forecast, which assumes that decadal variability strongly influences interannual rainfall variability, and a uniform distribution forecast, which assigns equal probabilities to each category (0.33, 0.33, 0.33) for each year. Given that the uniform distribution forecast has a lower RPS value (0.45 compared to 0.93 for the persistence forecast), indicating better baseline performance, we use it as the reference forecast for calculating the skill score.
While the RPSS provides a single metric of improvement over a reference forecast, additional diagnostic tools are required to understand the nature of the forecast errors. In the literature, reliability diagrams are often used to assess quality for seasonal forecast products to determine conditional biases in the forecast product (Mason and Chidzambwa,
2.6.2 Multicategory reliability diagram
In this chapter, we extend the traditional reliability diagram to evaluate probabilistic forecasts using the Multicategory Reliability Diagram (MCRD; Hamill,
The following explanations are strongly based on Hamill (
The calibration (or reliability) at a given quantile q, denoted as Cq, is defined as the probability that the observed rainfall category oi is less than the forecast category . This metric allows us to quantify how well the forecasted categories align with the actual observations across different quantiles. Formally, the calibration for a given quantile q is computed by averaging over all N forecast years as follows:
For any given year, one of three calibration scenarios will occur:
Observed category is less than the forecast category (): The observed category is lower than the forecast category, so .
Observed category equals the forecast category (): In this case, we interpolate between the minimum and maximum quantiles where the forecast and observed categories match. The calibration is determined using the following formula:
where qmin and qmax are the lowest and highest quantiles where .
Observed category is greater than the forecast category (): The observed category exceeds the forecast category, so .
For perfect calibration, Cq should equal the quantile q, meaning that, for example, 25% of observations should fall below the 25th percentile of the forecast distribution. The MCRD is generated by plotting Cq against q, with an uncertainty range representing the 95% confidence interval derived from bootstrap resampling, repeated 1,000 times.
In addition to the calibration plot, the MCRD includes a checkerboard plot that visualizes the mean absolute category error across quantiles. This helps identify systematic biases or inconsistencies in forecast performance. The checkerboard plot complements the calibration diagram by revealing sharpness and skill across the full range of potential outcomes. For instance, significant deviations between forecast and observed categories at certain quantiles could indicate overconfidence or underprediction in the probabilistic forecasts.
2.6.3 Economic value
Besides to forecast skill and quality, it is crucial to address the economic value of a forecast. Consider a decision maker who is concerned about a specific weather event, such as the forecast of rainfall falling into one of the defined tercile categories. For instance, the event A might be defined as “above-average” or “below-average” categories in a seasonal forecast. These forecasts are particularly significant for various sectors, where the amount of rainfall can have substantial economic and safety implications. If this unfavorable weather event occurs and no preventative measures are taken, the decision maker is expected to incur a loss L. The forecast is valuable only if it enables the decision maker to take action to reduce or avoid the potential loss. In this simplified scenario, the decision maker has two options: either continue with normal activities or take protective measures to mitigate the loss. Implementing such measures would incur an additional cost C beyond the usual expenses.
A deterministic binary forecasting system provides a straightforward yes/no prediction regarding the occurrence of a specific weather event A. The decision maker opts to take protective measures if the forecast indicates that event A will occur and takes no action if the forecast suggests otherwise. The usefulness of such forecasts for a series of past events can be evaluated by analyzing a contingency table compiled from those previous events (see Richardson,
To compute the economic value V of the forecast, we first established the cost-loss ratio α = C/L, which represents the cost of taking preventive action divided by the potential loss incurred if the event occurs without any action. This ratio is critical as it quantifies the decision-maker's trade-off between the cost of action and the potential loss, influencing whether protective measures should be taken based on the forecast.
In probabilistic forecasts, for each probability threshold pt, the hit rate H and false alarm rate F can be derived from a contingency table, reflecting the system's ability to correctly predict events. Here, a represents the number of correct predictions of the event occurring, b the false alarms, c the missed events, and d the correct predictions of the event not occurring. The total number of events observed, n, is n = a+b+c+d (Wilks,
The economic value V was then calculated using the following formula:
where represents the baseline probability (Richardson,
The value score ranges from −∞ to 1, where a score of 1 indicates perfect forecast performance and a score of 0 represents no added value over climatology. Negative values suggest that the forecast system is less effective than the climatological baseline, i.e., increase the decision-maker's costs compared to simply ignoring the forecast and using historical climatology.
3 Results
3.1 Ranked probability skill score
Table 2 presents the top three performing configurations of the CP-based logistic regression model based on the combined (RPSSt, v) for both training and validation periods. The table also includes the RPSS for the training (RPSSt, 1981-2016) and validation (RPSSv, 2017-2023) periods, along with the number of CPs used. Benchmark results for WARCOF and the TP variable from SEAS5 are also shown. The WS925-based model, using 13 CPs, outperformed the other configurations with an RPSSt, v of 0.233. It showed a good training performance (RPSSt = 0.218) and reasonable validation skill (RPSSv = 0.310). The WARCOF and SEAS5 TP benchmarks performed worse, with RPSSt, v values of 0.070 and 0.039, respectively. These three solutions are further discussed and evaluated in the subsequent sections of this results section. It should be noted here that the WARCOF period is from 1998 to 2023, while the SEAS5 period is from 1981 to 2023, and thus they are not directly comparable.
Table 2
| Configuration | CP count | RPSSt | RPSSv | RPSSt, v |
|---|---|---|---|---|
| WS925 | 13 | 0.218 | 0.310 | 0.233 |
| V925 | 11 | 0.212 | 0.298 | 0.226 |
| V10 | 12 | 0.226 | 0.212 | 0.223 |
| WARCOF* | - | 0.051 | 0.122 | 0.070 |
| TP | - | 0.051 | -0.022 | 0.039 |
Top three performing configurations of the CP-based logistic regression according to RPSSt,v.
The table shows RPSS values for the training, validation, and combined periods, along with the count of CPs for each configuration. The benchmarks WARCOF and TP from SEAS5 are also included. *Note that the WARCOF period is from 1998-2023, while the SEAS5 period is from 1981-2023, and thus they are not directly comparable.
3.2 Multicategory reliability diagram
The performance of the probabilistic seasonal rainfall forecasts is further evaluated using a MCRD which is presented on the left-hand side of each row, with the corresponding checkerboard plots on the right-hand side (Figure 5). Each row represents the performance of one forecasting model: WARCOF model (top row, 1998–2023), SEAS5 TP dynamical model (middle row, 1981–2023), and CP-based logistic regression model (bottom row, 1981–2023).
Figure 5

Multicategory reliability diagrams for WARCOF (1998-2023), SEAS5 TP (1981–2023), and CP-based logistic regression (1981–2023). The left column shows the observed frequency vs. forecast quantiles, with perfect calibration as the diagonal dashed line and 95% confidence interval (CI) shaded. The right column displays checkerboard plots of forecast errors, where darker shades indicate more accurate predictions (zero error).
The WARCOF forecasts exhibit good calibration at lower quantiles (below 0.20), where the predicted probabilities align closely with the observed frequencies. However, there is notable under-prediction between quantiles 0.20 and 0.90 (dry bias). This may be because forecasters often assign a higher probability to near-normal conditions to minimize the risk of incorrectly predicting one of the other two categories. This is also shown by Mason and Chidzambwa (
The SEAS5 TP model exhibits the best overall calibration, with a slight over-prediction in the lower quantiles (0.10–0.40) and under-prediction in the higher quantiles (above 0.60). The 95% confidence intervals are narrower than those for WARCOF, particularly in the mid-range quantiles, suggesting higher certainty. This may be attributed to the larger sample size, which provides more reliable estimates across the forecast distribution. SEAS5 TP shows slightly better performance in terms of categorical error compared to WARCOF. There is a larger concentration of darker shading near zero error, particularly in the mid-quantiles, indicating more frequent correct predictions in these ranges or just an error of one category. However, in the low and high quantiles, there is some spread, with errors of one or two categories being more frequent. The average category error for SEAS5 TP is 0.83 (95% CI: [0.74, 0.91]), representing a modest improvement over WARCOF.
The CP-based logistic regression model shows good calibration, particularly in the lower quantiles (up to 0.40), with slight over-prediction beyond this point. The confidence intervals are the narrowest of the three models, especially for mid-range quantiles (0.40–0.70). The CP-based logistic regression model shows the best performance in the category error, with the darkest regions concentrated around zero category error, especially in the mid-quantiles (0.20–0.60), where this model consistently performs well. Errors of two categories are rare, particularly in the mid-quantiles. The average category error for this model is the lowest, at 0.72 (95% CI: [0.63, 0.82]), indicating fewer category mismatches than the other models.
All three models show generally moderate to good calibration, with the SEAS5 TP model performing the best overall, followed by CP-based logistic regression, and then WARCOF. However, the CP-based model consistently provides more accurate category predictions, as indicated by the lower mean category error and clustered errors around zero. SEAS5 TP shows modest improvement over WARCOF which suffers from slightly larger deviations from perfect calibration and more frequent category mismatches, particularly in the mid-quantile range (0.20–0.80).
3.3 Value of the forecast system
Figure 6 presents a comparison of the economic values (V) for the three models across two rainfall categories: below-average and above-average. V is plotted against the cost-loss ratio, representing the trade-off faced by decision-makers between the cost of preventive measures and the potential loss incurred if no action is taken. On the vertical axis, economic value ranges from 0 to 1, with 1 indicating perfect forecast performance and 0 indicating no added value over climatology. The horizontal axis denotes the cost-loss ratio (α), where lower values suggest a relatively small cost of action compared to potential loss, and higher values indicate a higher relative cost.
Figure 6

Economic value V as a function of the cost-loss ratio is shown for two rainfall categories below-average and above-average using the CP-based logistic regression, SEAS5 TP, and WARCOF at the threshold maximizing VV. The left panels correspond to “below-average” rainfall, while the right panels correspond to “above-average” rainfall.
Notably, V displayed for each model represent the maximum value obtained using the optimal forecast threshold. This optimal threshold is determined by evaluating a range of probability thresholds from 0.1 to 0.9 in increments of 0.01 (similar to Bliefernicht et al.,
The left panel of Figure 6 shows the results for below-average rainfall. The CP-based logistic regression model (green curve) achieves its maximum economic value at a probability threshold of 0.25, suggesting that preventive measures should be taken when the forecasted probability of below-average rainfall exceeds 25%. This model provides a broad range of positive economic values across the cost-loss ratio spectrum, indicating its usability in various decision-making contexts. In contrast, the SEAS5 TP model (orange curve) reaches its maximum economic value at a slightly higher threshold of 0.28, but its economic value declines rapidly as the cost-loss ratio increases, indicating limited applicability to specific scenarios. Similarly, the WARCOF model (blue curve) peaks at a threshold of 0.26, showing a narrow range of utility with diminishing economic value at higher cost-loss ratios.
The right panel of Figure 6 presents the results for above-average rainfall. Here, the CP-based logistic regression model outperforms the other models, with a maximum economic value at a threshold of 0.53. This higher threshold suggests that preventive actions are recommended only when there is greater confidence in the forecast (i.e., when the probability exceeds 53%). The model demonstrates robust performance, maintaining positive economic values across a wide range of cost-loss ratios, making it particularly suitable for high-cost scenarios. SEAS5 TP peaks at a threshold of 0.21, but, similar to its performance in the below-average category, its economic value declines sharply beyond this point, indicating effectiveness only within narrowly defined conditions. WARCOF performs best at a threshold of 0.36, yet exhibits a similarly narrow range of utility, especially at higher cost-loss ratios.
One key takeaway from this analysis is the crucial role of selecting the appropriate probability threshold to maximize the economic value of each forecasting model. The CP-based logistic regression model proves to be the most robust across both rainfall categories, maintaining positive economic values over a wider range of cost-loss ratios due to its higher optimal thresholds. This adaptability makes it suitable for various decision-making scenarios. In contrast, SEAS5 TP and WARCOF, while effective under specific conditions, show rapid declines in economic value as the cost-loss ratio increases. SEAS5 TP shows a sharp peak in economic value when the cost of action is low but diminishes quickly beyond its optimal threshold. Similarly, WARCOF offers utility primarily at lower thresholds and cost-loss ratios.
Furthermore, this analysis provides insights for decision-makers, where rainfall forecasts play a critical role. Understanding the relationship between probability thresholds, cost-loss ratios, and economic value helps optimize strategies for taking preventive action. The threshold selection process is crucial in guiding when action should be taken. For instance, using the CP-based logistic regression model, preventive measures are advisable if the forecasted probability of below-average rainfall exceeds 25%. This threshold reflects the point at which the benefits of action outweigh the costs. Lower thresholds, such as 0.25, support a more conservative approach, appropriate for risk-averse sectors like flood management or critical infrastructure. Higher thresholds, like 0.53 for above-average rainfall, suggest action should be taken only when there is greater confidence in the forecast, which may be more suitable for high-cost industries like large-scale agriculture, where unnecessary actions are expensive. Additionally, the cost-loss ratio provides another layer of decision-making support. A lower cost-loss ratio indicates that taking action is relatively inexpensive compared to potential losses, encouraging more frequent responses to forecasted events. Conversely, a higher cost-loss ratio suggests that preventive actions are more costly, necessitating selective decisions that rely on higher forecast confidence levels.
This section highlights the value of optimizing probability thresholds in rainfall forecasting models to maximize their economic usage. While the CP-based logistic regression model demonstrates robust performance across various scenarios, SEAS5 TP and WARCOF have more limited applications. These findings underscore the importance of context-specific decision-making in sectors reliant on accurate rainfall forecasting.
3.4 Summary of performance results
To provide an overview of each performance, we compared key evaluation metrics across the three prediction models (WARCOF, SEAS5 TP, and CP-based logistic regression) in Table 3 as a summary of RPSS, calibration, category error, and economic value (Vmax) for below-average and above-average rainfall conditions. The CP-based logistic regression model demonstrated the highest RPSS, suggesting superior predictive accuracy over the other models. SEAS5 TP showed the best calibration overall, with a lower category error compared to WARCOF, but higher than the CP-based logistic regression model. In economic value analysis, the CP-based logistic regression model provided substantial advantages under conditions of below- and above-average rainfall, highlighting its effectiveness for decision-making applications.
Table 3
| Model | RPSS | Calibration | Category error | Vmax | |
|---|---|---|---|---|---|
| Below average | Above average | ||||
| WARCOF | 0.070 | Moderate | 0.86 | 0.15 | 0.15 |
| SEAS5 TP | 0.039 | Best | 0.83 | 0.34 | 0.25 |
| CP-based Log. Regr. | 0.233 | Good | 0.72 | 0.58 | 0.65 |
Comparison of the three seasonal rainfall prediction models (WARCOF, SEAS5 TP, and CP-based logistic regression) across key performance metrics: Ranked Probability Skill Score (RPSS), calibration quality, category error, and maximum economic value (Vmax) for below-average and above-average rainfall scenarios.
3.5 The CP-based logistic regression model
Given the necessity of not only achieving strong forecast evaluation scores but also ensuring a model's reliability and meaningfulness in terms of statistical downscaling, it is crucial to establish a robust connection between large-scale atmospheric patterns and the target variable, in this case, the rainfall categories derived through the logistic regression model. Therefore, Figure 7 shows the composites of the spatial CPs derived from WS925 anomalies (the best model, Table 2), which signify changes in wind speed in the lower troposphere, around an altitude of 700–800 m. These changes are often associated with variations in the upper-air wind patterns. The monsoon winds at 925 hPa are generally southwesterly during the monsoon season (approximately June to September) (see Figure 1.19 from Fink et al.,
Figure 7

Atmospheric CPs for the WS925 variable as the chosen solution for the CP-based logistic regression model. The color scale signifies the mean intensity of the measured variable, where red and blue shades represent positive and negative anomalies, respectively. The Wetness Index (WI) [-] is defined as the ratio of the conditional rainfall amount of a CP to the unconditional rainfall amount for the studied period.
This relationship is also reflected in our analysis of CPs. Specifically, CPs exhibiting strong positive anomalies in the region from 0° to 15°N, where southwesterly winds typically occur, are associated with wetter-than-average conditions (WI>1),1 as seen in CP11 and CP12. This suggests an increase in wind speeds, which in turn enhances the southwesterly flow. Conversely, CPs characterized by strong negative anomalies in this region, such as CP6 and CP9, are associated with drier-than-average conditions (WI < 1). This indicates a decrease in wind speeds, leading to a slowdown of the southwesterlies. The association between these wind patterns and rainfall outcomes may explains these CPs as reasonable predictors for categorizing rainfall as below or above average in the context of seasonal forecasting.
The findings from the logistic regression model further support this hypothesis (Figure 8). The purpose of these coefficients is to measure the likelihood of each CP occurring under specific categories, thereby providing a foundation for understanding their sensitivity in terms of seasonal rainfall forecasting. For CP11 and CP12, the coefficients are positive during wet years (0.15 and 0.20, respectively) but negative during dry years (-0.15 for CP12), aligning with the observed occurrence of these CPs. This suggests that these patterns play a role in enhancing rainfall when they indicate an increase in the southwesterly flow. In contrast, for CP6 and CP9, the model indicates positive coefficients during dry years (0.23 for CP6 and 0.11 for CP9) and negative coefficients during wet years (-0.20 for CP6 and -0.15 for CP9). This behavior underscores their role in the suppression of rainfall, indicating how reduced wind speeds in these patterns correlate with drier conditions. CP4 and CP8 present more neutral roles, with CP4 showing a slightly positive coefficient in wet years (0.06) and negative in dry years (-0.19), while CP8 has relatively small coefficients in both categories (-0.10 for dry and 0.07 for wet). This suggests a context-dependent influence, potentially modulated by other atmospheric factors not directly captured in this model.
Figure 8

Heat map of coefficients from the multi-class logistic regression model. The color coding indicates the importance of each CP for dry, normal, or wet years.
These results underline the importance of incorporating atmospheric dynamics into the statistical downscaling process. The associations between near-surface wind patterns, and rainfall outcomes validate the use of the logistic regression model, emphasizing its ability to capture the physical mechanisms underlying rainfall variability in the region. This insight enhances the predictive capability of the model, making it not only statistically reliable but also meaningful in a meteorological context.
4 Discussion
This study presents an evaluation of probabilistic seasonal rainfall forecasts for the Sudan-Sahel region using three models: WARCOF, SEAS5 TP, and a CP-based logistic regression model. As highlighted, seasonal rainfall variability poses significant risks to agriculture and water resource management in the Sudan-Sahel region, making accurate predictions critical for mitigating adverse impacts. The results from this study provide valuable insights into the performance of these models, showcasing their potential for improving forecast accuracy and decision-making in vulnerable sectors.
The CP-based logistic regression model demonstrated the best overall performance, particularly in terms of category error and economic value. This model is based on WS925 anomalies, which are strongly associated with southwesterly monsoon winds that influence moisture transport from the Gulf of Guinea, a key atmospheric process driving rainfall variability in the region (Janicot and Sultan,
The calibration evaluation with the MCRD analysis further underscores the usability of all three forecasting products for seasonal rainfall forecasting. However, the lower average category error and stronger performance in the economic value analysis of the CP-based logistic regression model indicate that it provides more accurate predictions than the other models. This improvement in category error aligns with the goals mentioned in previous studies (e.g., Pirret et al.,
One key aspect affecting model performance is the difference in temporal coverage between the models. The CP-based logistic regression model and SEAS5 TP cover the period 1981-2023, whereas WARCOF covers the shorter period of 1998–2023. This difference in dataset length makes direct comparisons between these models more challenging, as the longer time period likely contributes to the narrower confidence intervals in SEAS5 TP and the CP-based model, given that a larger sample size typically enhances forecast reliability. Nevertheless, this study builds upon and extends previous analyses of WARCOF, incorporating additional evaluation tools such as the MCRD for recent time periods (Mason and Chidzambwa,
Despite the strengths of the CP-based logistic regression model, it is important to acknowledge certain limitations. One key limitation is the model's wet bias, which may reduce its ability to accurately predict droughts and lead to an overestimation of wetter-than-average years. Given the vulnerability of the Sudan-Sahel region to both drought and excess rainfall, a bias toward wet conditions could negatively impact drought management strategies. This bias might reduce the model's effectiveness for sectors like agriculture, where underestimating dry conditions could result in insufficient preparation for crop failures or water shortages. Addressing this wet bias is crucial for building resilience in the region (Mertz et al.,
To mitigate the wet bias and further improve the model's accuracy, additional predictors could be incorporated. For instance, integrating sea surface temperatures (Fontaine and Bigot,
One limitation of this study is the use of CHIRPS rainfall data as a reference dataset instead of relying directly on ground-based observations. Although CHIRPS has been validated in numerous studies and generally shows good performance compared to ground-based observations (e.g., Garba et al.,
While the CP-based logistic regression model shows promise, further research is needed to test its applicability in other regions, such as the Sahel or Guinea zones. Expanding the model to different geographic contexts would allow for a better understanding of how effective it is in regions with different climatic drivers. Moreover, this statistical downscaling approach could benefit from the application of more advanced techniques like deep learning, which have shown potential in capturing non-linear relationships between atmospheric predictors and rainfall variability (Pan et al.,
However, the simplicity of statistical downscaling methods like CP classification in combination with logistic regression makes them accessible and computationally efficient, particularly for operational use in developing countries. These advantages should not be overlooked when considering model improvements, but integrating more complex techniques may further enhance model performance and accuracy.
5 Conclusion
This study advances seasonal rainfall prediction for West Africa by applying the statistical downscaling method developed by Rauch et al. (
The results demonstrate that, while each of the models evaluated (WARCOF, SEAS5 TP, and the CP-based logistic regression model) has distinct strengths, the CP-based model shows the greatest potential for interannual rainfall prediction. This novel approach effectively links southwesterly monsoon winds to rainfall variability, providing a robust statistical downscaling framework that captures the key physical mechanisms driving precipitation variability in the region.
Calibration analysis based on a multicategory reliability diagram (Hamill,
Furthermore, the CP-based model provides significant potential to enhance existing forecasting frameworks like WARCOF. While WARCOF has traditionally relied on subjective expert judgment and reinterpretation of statistical and global forecasts (Bliefernicht et al.,
In conclusion, this study lays a strong foundation for further enhancing seasonal forecasting in West Africa. The improved accuracy and economic value demonstrated by the CP-based logistic regression model highlight its potential as a reliable forecasting tool, capable of supporting more informed and impactful decision-making. As forecasting tools continue to evolve, the development of adaptable, region-specific models will be key to improving resilience against climate variability in the region.
Statements
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
MR: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft, Writing – review & editing. JB: Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing. WS: Writing – original draft, Writing – review & editing. SS: Writing – original draft, Writing – review & editing. MW: Writing – original draft, Writing – review & editing. HK: Funding acquisition, Project administration, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was part of the FURIFLOOD (Current and future risks of urban and rural flooding in West Africa) project, which was funded by the Federal Ministry of Education and Research in Germany (grant number: 01LG2086A).
Acknowledgments
We would like to thank our partners involved in the FURIFLOOD project for their invaluable support over the past three years. We also thank the editor and the two reviewers for their helpful comments that improved the quality of the manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declare that Generative AI was used in the creation of this manuscript. Chat-GPT was used for grammar and spell checking.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frwa.2024.1523898/full#supplementary-material
Footnotes
1.^Wetness Index (WI): Ratio of CP-specified rainfall to the long-term average.
References
1
ACMAD (2022). Regional Climate Outlook Forum for Sudano-Sahelian Region (Presass 9). Available at: https://acmad.org/index.php/regional-climate-outlook-forum-for-sudano-sahelian-regionpresass-9/
2
BliefernichtJ.RauchM.LauxP.KunstmannH. (2022). Atmospheric circulation patterns that trigger heavy rainfall in West Africa. Int. J. Climatol. 42, 6515–6536. 10.1002/joc.7613
3
BliefernichtJ.WaongoM.SalackS.SeidelJ.LauxP.KunstmannH. (2019). Quality and value of seasonal precipitation forecasts issued by the West African Regional Climate Outlook Forum. J. Appl. Meteorol. Climatol. 58, 621–642. 10.1175/JAMC-D-18-0066.1
4
ChristensenH. M.MorozI. M.PalmerT. N. (2015). Evaluation of ensemble forecast uncertainty using a new proper score: application to medium–range and seasonal forecasts. Q. J. R. Meteorol. Soc. 141, 538–549. 10.1002/qj.2375
5
ColyS. M.ZoromM.LeyeB.GuiroA.KarambiriH. (2024). Assessing climate change vulnerability and livelihood strategies in Burkina Faso including insecurity paradigm: a focus on rain-fed agriculture households. Environ Dev Sustain (2024). 10.1007/s10668-024-05442-3
6
DembéléM.ZwartS. J. (2016). Evaluation and comparison of satellite-based rainfall products in Burkina Faso, West Africa. Int. J. Remote Sens. 37, 3995–4014. 10.1080/01431161.2016.1207258
7
DescroixL.GuichardF.GrippaM.LambertL.PanthouG.MahéG.et al. (2018). Evolution of surface hydrology in the sahelo-sudanian strip: an updated review. Water10:748. 10.3390/w10060748
8
DidiS. R. M.MouhamedL.KouakouK.AdelineB.AronaD.Houebagnon SaintJ.et al. (2020). Using the CHIRPS dataset to investigate historical changes in precipitation extremes in West Africa. Climate8:84. 10.3390/cli8070084
9
DiedhiouS.RauchM.DiengA. L.BliefernichtJ.SyS.SallS. M.et al. (2024). Extreme rainfall in Dakar (Senegal): a case study for September 5, 2020. Front. Water6:1439404. 10.3389/frwa.2024.1439404
10
DotseS.-Q. (2024). Deep learning-based long short-term memory recurrent neural networks for monthly rainfall forecasting in Ghana, West Africa. Theoret. Appl. Climatol. 155, 3033–3045. 10.1007/s00704-023-04773-x
11
FinkA. H.EngelT.ErmertV.van der LindenR.SchneidewindM.RedlR.et al. (2017). “Mean climate and seasonal cycle,” in Meteorology of Tropical West Africa (Hoboken, NJ: Wiley), 1–39.
12
FontaineB.BigotS. (1993). West African rainfall deficits and sea surface temperatures. Int. J. Climatol. 13, 271–285. 10.1002/joc.3370130304
13
FunkC.PetersonP.LandsfeldM.PedrerosD.VerdinJ.ShuklaS.et al. (2015). The climate hazards infrared precipitation with stations-a new environmental record for monitoring extremes. Scientific Data2, 1–21. 10.1038/sdata.2015.66
14
GarbaJ. N.DiassoU. J.WaongoM.SawadogoW.DahoT. (2023). Performance evaluation of satellite-based rainfall estimation across climatic zones in Burkina Faso. Theor Appl Climatol.154, 1051–1073. 10.1007/s00704-023-04593-z
15
GlawionL.PolzJ.KunstmannH.FerschB.ChwalaC. (2023). spateGAN: spatio-temporal downscaling of rainfall fields using a cGAN approach. Earth Space Sci. 10:10. 10.1029/2023EA002906
16
GuèyeA. K.JanicotS.NiangA.SawadogoS.SultanB.Diongue-NiangA.et al. (2011). Weather regimes over Senegal during the summer monsoon season using self-organizing maps and hierarchical ascendant classification. Part I: synoptic time scale. Clim. Dynam. 36, 1–18. 10.1007/s00382-010-0782-6
17
GuèyeA. K.JanicotS.NiangA.SawadogoS.SultanB.Diongue-NiangA.et al. (2012). Weather regimes over Senegal during the summer monsoon season using self-organizing maps and hierarchical ascendant classification. Part II: Interannual time scale. Clim. Dynam. 39, 2251–2272. 10.1007/s00382-012-1346-8
18
HagosS. M.CookK. H. (2008). Ocean warming and late-twentieth-century sahel drought and recovery. J. Clim. 21, 3797–3814. 10.1175/2008JCLI2055.1
19
HamillT. M. (1997). Reliability diagrams for multicategory probabilistic forecasts. Weather Forecast. 12, 736–741.
20
HaoZ.SinghV. P.XiaY. (2018). Seasonal drought prediction: advances, challenges, and future prospects. Rev. Geophys. 56, 108–141. 10.1002/2016RG000549
21
HoungniboM. C. M.MinoungouB.TraoreS. B.MaidmentR. I.AlhassaneA.AliA. (2023). Validation of high-resolution satellite precipitation products over West Africa for rainfall monitoring and early warning. Front. Clim. 5:1185754. 10.3389/fclim.2023.1185754
22
JanicotS.SultanB. (2001). Intra-seasonal modulation of convection in the West African Monsoon. Geophys. Res. Lett. 28, 523–526. 10.1029/2000GL012424
23
JohnsonS. J.StockdaleT. N.FerrantiL.BalmasedaM. A.MolteniF.MagnussonL.et al. (2019). SEAS5: the new ECMWF seasonal forecast system. Geosci. Model Dev. 12, 1087–1117. 10.5194/gmd-12-1087-2019
24
KleinC.HeinzellerD.BliefernichtJ.KunstmannH. (2015). Variability of West African monsoon patterns generated by a WRF multi-physics ensemble. Clim. Dynam. 45, 2733–2755. 10.1007/s00382-015-2505-5
25
KouakouC.PaturelJ. E.SatgéF.TramblayY.DefranceD.RouchéN. (2023). Comparison of gridded precipitation estimates for regional hydrological modeling in West and Central Africa. J. Hydrol. 47:101409. 10.1016/j.ejrh.2023.101409
26
KumarA.BarnstonA. G.HoerlingM. P. (2001). Seasonal predictions, probabilistic verifications, and ensemble size. J. Clim. 14, 1671–1676. 10.1175/1520-0442(2001)014%3C1671:SPPVAE%3E2.0.CO;2
27
LéléM. I.LeslieL. M.LambP. J. (2015). Analysis of low-level atmospheric moisture transport associated with the West African Monsoon. J. Clim. 28, 4414–4430. 10.1175/JCLI-D-14-00746.1
28
LorenzM.BliefernichtJ.HaeseB.KunstmannH. (2018). Copula-based downscaling of daily precipitation fields. Hydrol. Process. 32, 3479–3494. 10.1002/hyp.13271
29
LosadaT.Rodríguez-FonsecaB.JanicotS.GervoisS.ChauvinF.RutiP. (2010). A multi-model approach to the Atlantic Equatorial mode: impact on the West African monsoon. Clim. Dynam. 35, 29–43. 10.1007/s00382-009-0625-5
30
ManzanasR. (2017). Assessing the suitability of statistical downscaling approaches for seasonal forecasting in Senegal. Atmosph. Sci. Lett. 18, 381–386. 10.1002/asl.767
31
MasonS.ChidzambwaS. (2009). “Position paper: verification of African RCOF forecasts,” in IRI Technical Report (International Research Institute for Climate and Society).
32
MertzO.D'haenS.MaigaA.MoussaI. B.BarbierB.DioufA.et al. (2012). Climate variability and environmental stress in the Sudan-Sahel Zone of West Africa. Ambio41, 380–392. 10.1007/s13280-011-0231-8
33
MoronV.RobertsonA. W.WardM. N.NdiayeO. (2008). Weather types and rainfall over Senegal. Part I: observational analysis. J. Clim. 21, 266–287. 10.1175/2007JCLI1601.1
34
NdiayeO.WardM. N.ThiawW. M. (2011). Predictability of seasonal sahel rainfall using GCMs and lead-time improvements through the use of a coupled model. J. Clim. 24, 1931–1949. 10.1175/2010JCLI3557.1
35
NicholsonS. E.KlotterD. (2021). The Tropical Easterly Jet over Africa, its representation in six reanalysis products, and its association with Sahel rainfall. Int. J. Climatol. 41, 328–347. 10.1002/joc.6623
36
NouaceurZ.MurarescuO. (2020). Rainfall variability and trend analysis of rainfall in West Africa (Senegal, Mauritania, Burkina Faso). Water12:1754. 10.3390/w12061754
37
PaethH.FinkA. H.PohleS.KeisF.MächelH.SamimiC. (2011). Meteorological characteristics and potential causes of the 2007 flood in sub-Saharan Africa. Int. J. Climatol. 31, 1908–1926. 10.1002/joc.2199
38
PaethH.PaxianA.SeinD. V.JacobD.PanitzH.-J.WarscherM.et al. (2017). Decadal and multi-year predictability of the West African monsoon and the role of dynamical downscaling. Meteorologische Zeitschrift26, 363–377. 10.1127/metz/2017/0811
39
PanB.AndersonG. J.GoncalvesA.LucasD. D.BonfilsC. J. W.LeeJ. (2022). Improving seasonal forecast using probabilistic deep learning. J. Adv. Model. Earth Syst. 14:2766. 10.1029/2021MS002766
40
PatilK. R.DoiT.BeheraS. K. (2023). Predicting extreme floods and droughts in East Africa using a deep learning approach. NPJ Clim. Atmosph. Sci. 6:108. 10.1038/s41612-023-00435-x
41
PirretJ. S. R.DaronJ. D.BettP. E.FournierN.FoamouhoueA. K. (2020). Assessing the skill and reliability of seasonal climate forecasts in Sahelian West Africa. Weather Forecast. 35, 1035–1050. 10.1175/WAF-D-19-0168.1
42
PolaskyA.EvansJ. L.FuentesJ. D. (2024). Statistical downscaling for precipitation projections in West Africa. Theoret. Appl. Climatol. 155, 327–347. 10.1007/s00704-023-04637-4
43
PorteleT. C.LorenzC.DibraniB.LauxP.BliefernichtJ.KunstmannH. (2021). Seasonal forecasts offer economic benefit for hydrological decision making in semi-arid regions. Sci. Rep. 11:10581. 10.1038/s41598-021-89564-y
44
RauchM.BliefernichtJ.LauxP.SalackS.WaongoM.KunstmannH. (2019). Seasonal forecasting of the onset of the rainy season in West Africa. Atmosphere10:528. 10.3390/atmos10090528
45
RauchM.BliefernichtJ.MarananM.FinkA. H.KunstmannH. (2024). Interannual rainfall variability in west africa: reconstruction based on atmospheric circulation patterns. Int. J. Climatol. 10.5281/zenodo.14046484
46
RichardsonD. S. (2000). Skill and relative economic value of the ECMWF ensemble prediction system. Q. J. R. Meteorol. Soc. 126, 649–667. 10.1256/smsqj.56312
47
RichardsonD. S. (2011). “Economic value and skill,” in Forecast Verification (Hoboken, NJ: Wiley), 167–184.
48
SemazziF. (2011). Framework for climate services in developing countries. Clim. Res. 47, 145–150. 10.3354/cr00955
49
SiabiE. K.KabobahA. T.AkpotiK.AnornuG. K.Amo-BoatengM.NyantakyiE. K. (2021). Statistical downscaling of global circulation models to assess future climate changes in the Black Volta basin of Ghana. Environm. Challen. 5:100299. 10.1016/j.envc.2021.100299
50
SiegmundJ.BliefernichtJ.LauxP.KunstmannH. (2015). Toward a seasonal precipitation prediction system for West Africa: Performance of CFSv2 and high–resolution dynamical downscaling. J. Geophys. Res.: Atmosph. 120, 7316–7339. 10.1002/2014JD022692
51
ThorncroftC. D.NguyenH.ZhangC.PeyrilléP. (2011). Annual cycle of the West African monsoon: regional circulations and associated water vapour transport. Q. J. R. Meteorol. Soc. 137, 129–147. 10.1002/qj.728
52
WeigelA. P.LinigerM. A.AppenzellerC. (2007). The discrete brier and ranked probability skill scores. Monthly Weather Rev. 135, 118–124. 10.1175/MWR3280.1
53
WilhiteD. A.SvobodaM. D.HayesM. J. (2007). Understanding the complex impacts of drought: A key to enhancing drought mitigation and preparedness. Water Resour. Managem. 21, 763–774. 10.1007/s11269-006-9076-5
54
WilksD. (2006). Statistical Methods in the Atmospheric Sciences. Amsterdam: Elsevier.
55
WilksD. S. (2001). A skill score based on economic value for probability forecasts. Meteorol. Appl. 8, 209–219. 10.1017/S1350482701002092
56
YengohG. (2012). Climate and food production: understanding vulnerability from past trends in Africa's Sudan-Sahel. Sustainability5:52–71. 10.3390/su5010052
57
ZampaligréN.DossaL. H.SchlechtE. (2014). Climate change and variability: perception and adaptation strategies of pastoralists and agro-pastoralists across different zones of Burkina Faso. Regional Environm. Change14, 769–783. 10.1007/s10113-013-0532-5
Summary
Keywords
seasonal rainfall prediction, rainfall variability, Sudan-Sahel region, West Africa, k-means, logistic regression
Citation
Rauch M, Bliefernicht J, Sawadogo W, Sy S, Waongo M and Kunstmann H (2025) Seasonal prediction of rainfall variability for the West African Sudan-Sahel. Front. Water 6:1523898. doi: 10.3389/frwa.2024.1523898
Received
15 November 2024
Accepted
24 December 2024
Published
10 January 2025
Volume
6 - 2024
Edited by
Shaomin Liu, Beijing Normal University, China
Reviewed by
Lisheng Song, Anhui Normal University, China
Fasikaw Atanaw Zimale, Bahir Dar University, Ethiopia
Updates

Check for updates
Copyright
© 2025 Rauch, Bliefernicht, Sawadogo, Sy, Waongo and Kunstmann.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Harald Kunstmann harald.kunstmann@kit.edu
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.