Abstract
Shear strength of rock, characterized by the internal friction angle (φ) and cohesion (c), is the basis for the design and stability evaluation of foundation, rock slope and underground excavation. Obtaining φ and c through traditional methods such as laboratory or on-site tests is usually time-consuming and costly. This study adopts three algorithm-optimized machine learning models: Particle Swarm optimized (PSO) Support Vector Machine (SVM), Dung Beetle optimized (DBO) Random Forest (RF) and Adaptive Moment estimation optimized (ADAM) Feedforward Neural Network (FNN) to predict φ and c. The inputs of the model are three easily obtainable indices: point load strength index Is(50), Schmidt hammer rebound number Srn, and ultrasonic S-wave pulse velocity Vs, and the outputs are φ and c. The training data of the model comes from the laboratory tests of 63 groups of quartzite specimens in Malaysia. This study also uses R2 and four error indicators - mean absolute error (MAE), average absolute percentage error (MAPE), root mean square error (RMSE) and relative percentage error (REP) - to evaluate the performance of the model. The results show that the R2 of the three models is more than 0.85, and the relative error of φ and c is basically less than 10%. Among them, the PSO-SVM model has the best predictive performance, with the highest R2 and the lowest error index (within 5% relative error). DBO-RF and ADAM-FNN models also have good prediction accuracy. This shows that all three models can predict the rock shear strength under a limited amount of data based on three portable indices, saving costs for engineering projects.
1 Introduction
Rock shear strength is crucial to the stability and safety of engineering structures such as tunnels, foundations and underground openings (; Zhang et al., 2022; ; ). Shear strength is characterized by two parameters: the internal friction angle (φ), representing the frictional resistance between rock particles, and cohesion (c), reflecting the inherent bonding strength among particles (Singh et al., 2020). The methods for determining φ and c include direct shear tests, triaxial compression tests, and in-situ testing techniques (). However, these methods are often time-consuming and costly (; ; Zhao et al., 2023).
In some emergency engineering projects, such as assessing the risk of rock explosion during underground excavation and carrying out support design, there is an urgent need for the estimation method of φ and c that can be quickly implemented on site (; ). Therefore, researchers have turned to alternative methods such as point load tests, Schmidt hammer rebound tests, and ultrasonic pulse velocity tests. These portable tests correspond to three parameters: point load strength index Is(50), Schmidt hammer rebound number Srn, and ultrasonic S-wave pulse velocity Vs. These have been widely used to estimate uniaxial compressive strength (UCS) (; ; ; ; ), Brazillian tensile strength (BTS) (; ; ), and shear strength (; ; Zhang et al., 2020).
Machine learning techniques have been widely used to predict rock mechanical properties. Early studies mainly focused on the prediction of UCS and BTS (; Wang and Aladejare, 2016; ; ), while recent studies have gradually expanded to modeling φ and c (; ; ; ; ; ; ; ; ; ; ). Among various modeling methods, support vector machines (SVM), random forests (RF), and feedforward neural networks (FNN) are widely used because they can capture complex linear and nonlinear relationships (; ; ; ; ; ; ; ).
To further improve the predictive performance of the models, this study uses three algorithms to optimize the model, including Particle Swarm optimization (PSO), Dung Beetle optimization (DBO) and Adaptive Moment estimation optimization (ADAM) (; ; ). The effectiveness of these optimization strategies has been verified in many studies. For example, applied six metaheuristic algorithms, including PSO, to optimize the Long Short-Term Memory (LSTM) model and found that the PSO-LSTM combination achieved the best performance. Similarly, showed that the DBO-optimized RF model (DBO-RF) outperformed other methods in predicting φ and c. These results highlight the potential of PSO and DBO in improving the predictive ability of the models, while the efficiency of ADAM in neural network training has also been verified in related studies (Zhang, 2018).
However, most existing studies rely on large datasets, and investigations of machine learning performance under small-sample conditions remain limited. To address this gap, this study systematically develops and compares three algorithm-optimized hybrid models—PSO-SVM, DBO-RF, and ADAM-FNN—for predicting φ and c of quartzite using easily obtainable indices obtainable through portable equipment (Is(50), Srn, and Vs) as input. Predictive accuracy, fitting capability, and statistical performance of each model are evaluated on a small-sample dataset, providing a reliable methodology and practical guidance for rapid assessment of rock shear strength under limited-data conditions.
2 Database
2.1 Data collection and analysis
A total of 63 groups of quartzite samples were collected from metro and foundation projects in the Klang Valley, Malaysia, where Paleozoic–Mesozoic quartzite formations with local granite intrusions predominate. To ensure lithological consistency, each group was defined such that all specimens originated from the same borehole core or from adjacent boreholes at similar depths. Each group consisted of eight specimens, including one for UCS test, one for BTS test, three for direct shear tests, and three for point load index tests, on which the nondestructive tests (UPV and Schmidt hammer tests) were also performed. The test results are summarized in Table 1, and an overview of the dataset is presented in Table 2.
TABLE 1
| Group number | UCS (MPa) | BTS (MPa) | φ (°) | c (MPa) | Is(50) (MPa) | (n) | Vs (m/s) |
|---|---|---|---|---|---|---|---|
| 1 | 66.34 | 9.46 | 42.5 | 24.5 | 3.51 | 40 | 6048 |
| 2 | 69.52 | 10.26 | 41.7 | 24.3 | 3.52 | 40 | 6139 |
| 3 | 52.98 | 7.41 | 38.1 | 17.2 | 2.56 | 37 | 5857 |
| 4 | 77.46 | 9.74 | 42.3 | 25.6 | 3.47 | 42 | 6210 |
| 5 | 47.20 | 6.76 | 36.7 | 16.7 | 1.75 | 35 | 5600 |
| 6 | 58.15 | 7.15 | 39.4 | 18.8 | 2.37 | 36 | 5833 |
| 7 | 98.71 | 9.60 | 47.7 | 27.1 | 4.14 | 42 | 6173 |
| 8 | 69.33 | 8.93 | 43.5 | 20.4 | 3.08 | 41 | 6024 |
| 9 | 87.69 | 9.62 | 45.1 | 23.3 | 3.71 | 43 | 6474 |
| 10 | 61.65 | 7.65 | 41.3 | 20.9 | 2.72 | 39 | 6036 |
| 11 | 56.30 | 6.95 | 34.6 | 18.2 | 2.18 | 37 | 5749 |
| 12 | 94.62 | 10.11 | 46.9 | 27.1 | 4.02 | 41 | 6284 |
| 13 | 70.87 | 8.47 | 44.6 | 24.0 | 3.51 | 38 | 5914 |
| 14 | 96.16 | 9.72 | 44.3 | 25.7 | 3.79 | 41 | 6289 |
| 15 | 75.14 | 9.70 | 43.4 | 22.6 | 3.25 | 40 | 5965 |
| 16 | 69.92 | 8.53 | 46.9 | 26.8 | 3.64 | 40 | 6005 |
| 17 | 78.05 | 9.14 | 42.2 | 23.5 | 3.33 | 40 | 6111 |
| 18 | 76.55 | 7.69 | 40.9 | 18.9 | 2.74 | 39 | 6121 |
| 19 | 89.59 | 10.50 | 48.3 | 25.7 | 4.26 | 43 | 6336 |
| 20 | 91.03 | 10.28 | 44.7 | 24.5 | 4.44 | 44 | 6515 |
| 21 | 89.84 | 9.26 | 43.8 | 24.1 | 4.19 | 42 | 6345 |
| 22 | 117.76 | 10.53 | 49.6 | 29.6 | 4.92 | 47 | 6623 |
| 23 | 67.62 | 7.13 | 37.9 | 18.2 | 2.48 | 37 | 5947 |
| 24 | 75.73 | 9.39 | 43.7 | 25.4 | 3.36 | 39 | 6249 |
| 25 | 79.75 | 8.52 | 45.0 | 26.3 | 3.67 | 38 | 6224 |
| 26 | 104.70 | 10.26 | 45.6 | 28.7 | 4.32 | 44 | 6401 |
| 27 | 92.58 | 9.41 | 44.9 | 25.8 | 3.54 | 42 | 6298 |
| 28 | 92.63 | 9.19 | 42.4 | 26.9 | 3.65 | 43 | 6331 |
| 29 | 90.95 | 9.85 | 46.8 | 27.5 | 3.92 | 44 | 6184 |
| 30 | 56.52 | 7.55 | 39.2 | 20.2 | 2.51 | 37 | 5966 |
| 31 | 81.67 | 9.51 | 43.5 | 25.0 | 3.74 | 41 | 6042 |
| 32 | 92.60 | 9.93 | 43.5 | 22.8 | 4.31 | 45 | 6491 |
| 33 | 76.74 | 7.63 | 40.3 | 19.3 | 2.80 | 38 | 5970 |
| 34 | 99.50 | 9.90 | 47.5 | 26.7 | 4.09 | 44 | 6313 |
| 35 | 94.36 | 9.92 | 46.7 | 26.9 | 3.93 | 46 | 6449 |
| 36 | 75.27 | 7.81 | 41.2 | 18.8 | 2.77 | 39 | 6090 |
| 37 | 79.38 | 9.06 | 42.8 | 21.4 | 3.25 | 42 | 6273 |
| 38 | 90.74 | 9.58 | 43.9 | 24.6 | 3.62 | 41 | 6169 |
| 39 | 68.27 | 6.92 | 36.4 | 17.5 | 2.41 | 35 | 5863 |
| 40 | 106.13 | 10.85 | 48.5 | 28.5 | 4.66 | 47 | 6558 |
| 41 | 98.42 | 10.11 | 45.1 | 24.9 | 4.04 | 45 | 6377 |
| 42 | 53.04 | 7.97 | 37.7 | 17.2 | 2.18 | 38 | 5696 |
| 43 | 58.35 | 7.49 | 40.6 | 23.7 | 2.69 | 39 | 6127 |
| 44 | 65.62 | 7.34 | 40.4 | 19.3 | 2.56 | 37 | 5942 |
| 45 | 118.30 | 10.82 | 48.3 | 29.7 | 4.81 | 48 | 6615 |
| 46 | 82.16 | 9.70 | 43.5 | 20.6 | 3.22 | 42 | 6358 |
| 47 | 67.32 | 8.87 | 42.6 | 21.1 | 3.09 | 40 | 6191 |
| 48 | 89.34 | 9.35 | 44.0 | 24.7 | 3.47 | 43 | 6183 |
| 49 | 80.41 | 8.01 | 42.2 | 20.4 | 2.94 | 39 | 5991 |
| 50 | 95.40 | 10.18 | 47.9 | 26.8 | 4.06 | 46 | 6415 |
| 51 | 86.59 | 8.91 | 43.1 | 22.5 | 3.52 | 43 | 6255 |
| 52 | 90.75 | 10.33 | 44.9 | 24.2 | 3.58 | 44 | 6390 |
| 53 | 80.86 | 8.74 | 46.1 | 27.0 | 3.85 | 41 | 6204 |
| 54 | 68.52 | 8.64 | 40.8 | 19.5 | 2.70 | 40 | 6093 |
| 55 | 57.88 | 7.80 | 38.5 | 17.3 | 2.24 | 38 | 5904 |
| 56 | 91.43 | 9.92 | 46.3 | 27.6 | 3.99 | 45 | 6397 |
| 57 | 86.92 | 9.17 | 42.7 | 23.8 | 3.36 | 42 | 6208 |
| 58 | 80.11 | 9.21 | 42.4 | 24.1 | 3.34 | 39 | 6012 |
| 59 | 77.56 | 9.53 | 43.0 | 25.9 | 3.47 | 42 | 6265 |
| 60 | 56.74 | 8.52 | 38.6 | 16.9 | 2.51 | 40 | 5736 |
| 61 | 91.38 | 9.30 | 46.6 | 28.2 | 3.85 | 44 | 6359 |
| 62 | 82.20 | 9.85 | 45.2 | 27.7 | 3.91 | 43 | 6410 |
| 63 | 86.32 | 9.94 | 43.8 | 25.3 | 3.42 | 40 | 6324 |
The dataset of strength parameters and indices.
TABLE 2
| Parameter | φ (°) | c (MPa) | UCS (MPa) | BTS (MPa) | Is(50) (MPa) | Srn | Vs (m/s) |
|---|---|---|---|---|---|---|---|
| Count | 63 | 63 | 63 | 63 | 63 | 63 | 63 |
| Average | 43.22 | 23.47 | 80.41 | 9.04 | 3.41 | 41.06 | 6173.35 |
| Median | 43.50 | 24.20 | 80.41 | 9.30 | 3.51 | 41.00 | 6191.00 |
| Max value | 49.60 | 29.70 | 118.30 | 10.85 | 4.92 | 48.00 | 6623.00 |
| Min value | 34.60 | 16.70 | 47.20 | 6.76 | 1.75 | 35.00 | 5600.00 |
| Standard deviation | 3.28 | 3.63 | 15.71 | 1.09 | 0.70 | 3.02 | 230.76 |
Statistical summary of rock specimen parameters.
Prior to model construction, the linear correlations among the seven parameters were evaluated to identify appropriate combinations of input features. As illustrated by the correlation matrix in Figure 1, relatively weak linear relationships were found between φ and c with UCS and BTS (R2 ranging from 0.64 to 0.70). Considering that UCS and BTS are not easily measured under field conditions, the study selected Is(50), Srn, and Vs as the input parameters for prediction modeling.
FIGURE 1
2.2 Data preprocessing
Given the limited sample size (N = 63), outlier values were likely to exert substantial influence on model accuracy. To address this, outliers were identified using Tukey’s interquartile range (IQR) method (Tukey, 1977). A data point was classified as an outlier if it met the condition specified in Equation 1:where x represents an independent observation, Q1 and Q3 denote the first and third quartiles, and IQR = Q3 − Q1 is the interquartile range.
A total of 3 outliers (4.76% of the dataset) were identified: Is(50) in Group 8, c in Group 29, and Srn in sample 55, and these outliers were replaced using the moving median imputation method. (Tukey, 1977). This method can smooth noise data and reduce the impact of abnormal data. To enhance the model’s Ability to capture nonlinear relationships, This study expands the three input characteristics (Is(50), Srn, and Vs) to ten, including three original features, respective square terms (Is(50))2, (Srn)2, and (Vs)2, three interactive terms (Is(50) × Srn, Is(50) × Vs, Srn × Vs), and the sample median.
Subsequently, this study used a cross-verification method (LOO-CV) to divide the data set. (). Leave a cross-validation is a special form of k-fold cross-validation, and its number k is equal to the total number of samples N. The method takes a single sample as a test set, and the remaining N-1 samples participate in model training and train N times to find the best model. The hyperparameter optimization of the models in this study was nested within each LOO-CV training fold.
Following the data division, the standardization method was adopted based on the absolute deviation median (MAD) to standardize the ten characteristics (). This method is applicable to small data sets with non-normal distribution, which can effectively reduce the impact of extreme values on feature normalization. The standardized value can be calculated using Equation 2.where Median(X) is the median of the data set, and MAD(X) is the median of absolute deviation. The data preprocessing process is shown in Figure 2.
FIGURE 2
3 Prediction models for φ and c
3.1 Selection of prediction models
This study selects three representative machine learning models: SVM, RF and FNN. These models have been widely used in geotechnical parameter prediction (; ; ; ).
SVM is a supervised learning method that can transform low-dimensional nonlinear problems into linear problems in high-dimensional space with the help of kernel functions such as radial basis function (RBF), which is especially suitable for multi-input parameter data sets. The model has a simple structure and a small number of hyperparameters, which is easy to combine with other optimization algorithms to improve the prediction performance.
RF is an integrated learning method based on the principle of decision tree and bagging (). It improves the stability and generalization ability of the model by integrating the decision tree of multiple subset training. RF is suitable for input-output relationships or problems that are difficult to clarify. To further optimize RF, this study adopts the DBO to adjust the core hyperparameters of the decision tree.
FNN is a fully connected neural network including input layer, hidden layer and output layer. It has strong nonlinear approximation ability but is more sensitive to small sample training sets. Therefore, this study adopts the ADAM optimization algorithm to adaptively adjust the learning rate during the training process, which not only improves the convergence speed but also reduces the risk of over-mitting.
The three models correspond to statistical learning, integrated learning and deep learning in the field of machine learning respectively. And three optimization algorithms were matched: PSO, DBO, and ADAM to improve the prediction performance of the model. All processes are implemented based on MATLAB software.
3.2 Establishment of prediction models
3.2.1 PSO-SVM model
The SVM model maps the input data (Is(50), Srn, and Vs) to a high-dimensional space through the radial basis function (RBF). The performance of SVM is mainly affected by two core hyperparameters: the penalty parameter C and the kernel width γ. Among them, C is used to balance the relationship between training error minimization and classification interval maximization, and γ determines the influence range of a single training sample in high-dimensional space.
To optimize C and γ, this study integrates the PSO algorithm into the SVM model. In PSO, each particle represents a group of candidate solutions (i.e., a group of C and γ), and the algorithm minimizes the cross-verification error by iterating the position of the particle in the search space. In this study, the particle swarm scale is set to 30 and the number of iterations is set to 50. The workflow of the PSO-SVM model is shown in Figure 3, and the details of the optimized parameters are listed in Table 3.
FIGURE 3
TABLE 3
| Output parameter | Parameter | The value or range of parameters |
|---|---|---|
| Penalty parameter (C) | SVM | Search range: [10–3, 103] |
| Kernel parameter (γ) | SVM | Search range: [10–3, 103] |
| Population size | PSO | 30 |
| Max iterations | PSO | 50 |
| Inertia weight (w) | PSO | Linearly decreasing from 0.9 to 0.4 |
| Cognitive and social coefficients (c1, c2) | PSO | c1 = c2 = 1.5 |
Parameters setting of the PSO-SVM model.
3.2.2 DBO-RF model
The RF model combines self-aggregation (bagging) and random feature selection strategy. Its core hyperparameters include the number of features considered when each tree splits (m), the number of regression trees (n) and the minimum number of samples required for each leaf node. Choosing the right hyperparameter is crucial to the performance of the model (
). The construction steps of the model are as follows.
Bootstrap sampling () was used to generate independent training subsets from 63 sets of raw data.
At each node split, m candidate features were randomly selected from the complete feature set, and the optimal splitting feature is determined.
The final prediction was obtained by averaging the outputs of all n regression trees to get the final predicted value.
Key RF hyperparameters include the number of sampled features m, the number of trees n, and the minimum number of samples per leaf node. Selecting appropriate values for these parameters is crucial for maximizing model performance ().
The DBO algorithm is a meta-inspiration algorithm that simulates the natural behavior of beetles rolling, burying and locating dung balls, and can realize global and local search. DBO can effectively balance exploration and development capabilities, which is suitable for hyperparametric tuning of complex models, and can avoid the premature convergence of algorithms. The optimization process is as follows.
Initializing the beetle population, and each individual corresponds to a set of randomly generated hyperparameters.
Using the root mean square error (RMSE) as an evaluation index to evaluate the adaptability of each hyperparameter.3. Updating positions based on beetle behavior patterns and selecting the best-performing configureuration.
Updating positions based on beetle behavior patterns and selecting the best-performing configureuration.
Final training of the RF model using the optimal hyperparameters obtained.
The optimized DBO-RF parameters are shown in Table 4, and the modeling workflow is illustrated in Figure 4.
TABLE 4
| Parameter | Source of parameter | The value or range of parameters |
|---|---|---|
| Number of trees | RF | [80, 250] |
| Max depth | RF | [5, 12] |
| Min leaf size | RF | [3, 10] |
| Population size | DBO | 12 |
| Max iterations | DBO | 25 |
| Initial Inertia weight | DBO | 0.9 |
| Weight decay rate | DBO | 0.5 |
| Local search probability | DBO | 0.3 |
| Global exploration probability | DBO | 0.7 |
Parameters setting of the DBO-RF model.
FIGURE 4
3.2.3 ADAM-FNN model
The FNN used in this study comprised an input layer of 10 nodes, two hidden layers with 64 and 32 neurons, and an output layer with a single neuron corresponding to either φ or c. The Rectified Linear Unit (ReLU) activation function was employed in the hidden layers to enhance nonlinear learning capability, while a linear activation function was applied in the output layer for regression purposes.
This study uses the He initialization method to initialize the weight and bias (), which scales the weight variance according to the number of input neurons. The ADAM algorithm integrates the advantages of the momentum method and the RMSProp algorithm, and adjusts the learning rate by using the first-order moment and second-order moment of the gradient (). The parameter update mechanism of ADAM is shown in Equations 3–6.
First-moment estimate (mean):
Second-moment estimate (variance):
Bias correction:
Parameter update:where t is the time step, gt represents the gradient at t, η is the learning rate, and β1 and β2 are the exponential decay rates of the first-order moment estimate and the second-order moment estimate respectively. In this study, η = 0.001, β1 = 0.9, and β2 = 0.999 were adopted following the default settings recommended by Kingma and Ba (), which have been validated to ensure stable and efficient convergence. The small constant ϵ = 10–8 is introduced in the formula to prevent division by zero errors, and θ represents the model parameters (weights and biases) to be optimized.
To prevent overfitting, early stopping is used during training: training is terminated if the validation error does not improve for 20 consecutive training epochs. In addition, a random Dropout technique is applied at a ratio of 0.3 during training to improve the model’s generalization ability. Table 5 lists the final optimization parameters used in the ADAM-FNN model, and the overall modeling process is shown in Figure 5.
TABLE 5
| Parameter | Source of parameter | The value of parameters |
|---|---|---|
| Input layer nodes | FNN | 10 |
| Hidden layer 1 | FNN | 64 |
| Hidden layer 2 | FNN | 32 |
| Output layer | FNN | 1 |
| Dropout rate | FNN | 0.3 |
| Initial learning rate | ADAM | 0.001 |
| Β1 | ADAM | 0.9 |
| β2 | ADAM | 0.99 |
| ε | ADAM | 10–8 |
| Drop factor | ADAM | 0.5 |
| Drop Period | ADAM | 30 |
Parameters setting of the ADAM-FNN model.
FIGURE 5
4 Accuracy assessment of the models
4.1 Statistical evaluation metrics
To evaluate the predictive performance of the model, this study uses four commonly used statistical indicators: coefficient of determination (R2), mean absolute error (MAE), mean absolute percentage error (MAPE), and root mean square error (RMSE). Their mathematical expressions are shown in Equations 7–10.where yi and are the measured and predicted values of the ith observation, respectively; is the mean of the measured values; and n = 63 represents the total number of data observations in the dataset.
R2 can explain the degree of variation of the model. MAE is the average value of the absolute value of the sample prediction error, which can reflect the prediction accuracy of the model. MAPE is the percentage of the real value of the error, which is convenient for error comparison between data sets of different scales. RMSE gives a higher weight to the large error, and can sensitively identify significant prediction deviations. The above indicators comprehensively evaluate the performance of the model from the two dimensions of absolute error and relative error. The closer r2 is to 1, the closer MAE, MAPE and RMSE are to 0, the higher the prediction accuracy and reliability of the model.
4.2 Error analysis of predictive models
4.2.1 PSO-SVM model
The model’s predictive performance can also be evaluated using the percentage relative error (REP), as shown in Figure 6. For both φ and c, the predicted values closely follow the trends of the actual values, and all relative errors are below 10%. Specifically, the REP for φ ranges from 0.34% to 2.69%, and the REP for c ranges from 0.57% to 4.68%, indicating that the model has excellent predictive accuracy and generalization ability.
FIGURE 6
Figure 7 shows the relationship between the measured values of φ and c and the predicted values of the PSO-SVM model. The R2 for φ reaches 0.9476, and the R2 for c reaches 0.9632, confirming a good correlation between the parameters and the model’s good fit. The narrow 95% confidence interval and the predicted interval shown in the figure are attributed to the limited range of variation in the data itself, as well as the high consistency between the measured and predicted values, further confirming the model’s stability.
FIGURE 7
4.2.2 DBO-RF model
Figure 8 presents the relative error results for φ and c predictions using the DBO-RF model. Relative errors for φ ranged from 0.43% to 4.03%, and for c from 1.05% to 9.68%. Though these are slightly higher than those achieved by PSO-SVM, all values remained under 10%, reflecting acceptable prediction accuracy.
FIGURE 8
Figure 9 shows the scatter plots of actual versus predicted values for φ and c. The R2 values were 0.8979 for φ and 0.9107 for c, indicating strong, though slightly weaker, model performance compared to PSO-SVM. Most data points fell within the 95% confidence intervals, confirming reliable model fitting.
FIGURE 9
4.2.3 ADAM-FNN model
Figure 10 presents the relative error distributions for φ and c predictions. For φ, relative errors ranged from 0.36% to 3.36%, while those for c ranged from 1.32% to 9.55%. Although these errors are slightly higher than those of the PSO-SVM model, they are comparable to the DBO-RF model and remain within acceptable limits.
FIGURE 10
Figure 11 shows the actual versus predicted scatter plots for both parameters. The R2 value for φ was 0.9176, and for c it was 0.9012, indicating strong predictive ability and a well-fitted model. The narrow prediction intervals and tight clustering of points along the diagonal line demonstrate the model’s reliability in capturing the relationship between input and output variables.
FIGURE 11
4.3 Comparison of model evaluation metrics
Table 6 lists the statistical metrics for each model. Figure 12A shows the results for φ. In terms of R2, the PSO-SVM model has the best prediction performance, followed by the DBO-RF and ADAM-FNN models. All three have R2 values exceeding 0.89, indicating good model fit. Regarding MAE, the PSO-SVM model performs best (0.6765), followed by the ADAM-FNN model (0.8466) and the DBO-RF model (0.9449), highlighting the advantage of PSO-SVM in absolute error control. PSO-SVM also outperforms the other two models in MAPE and RMSE.
TABLE 6
| Parameter | Model | R2 | MAE | MAPE (%) | RMSE | Rank |
|---|---|---|---|---|---|---|
| φ | PSO-SVM | 0.9476 | 0.6765 | 1.5641 | 0.5557 | 1 |
| DBO-RF | 0.8979 | 0.9449 | 2.1858 | 1.0402 | 3 | |
| ADAM-FNN | 0.9176 | 0.8466 | 1.9516 | 0.9346 | 2 | |
| c | PSO-SVM | 0.9632 | 0.6161 | 2.6422 | 0.6915 | 1 |
| DBO-RF | 0.9107 | 0.9698 | 4.2014 | 1.0774 | 2 | |
| ADAM-FNN | 0.9012 | 1.0002 | 4.3376 | 1.1331 | 3 |
Statistical metrics for the models.
FIGURE 12
Figure 12B shows the results for c. The PSO-SVM model again performs best, with the R2 of 0.9632, significantly higher than the DBO-RF model (0.9107) and the ADAM-FNN model (0.9012). The DBO-RF model is slightly better than the ADAM-FNN model in MAE, MAPE and RMSE. These results indicate that the PSO-SVM model is not only better in terms of error values, but also statistically more reliable, which further supports its superiority.
During model training, Is(50) was found to exert a significant influence on the model, while Srn and Vs had a relatively minor impact. This is likely because the point load test involves a combined failure mechanism of tension and shear, where the tensile component is correlated with c and the shear component with φ, thus forming an intrinsic link with shear strength. In contrast, Srn (surface hardness) and Vs (elastic wave velocity/compactness) have a weaker correlation with the shear failure mechanism, resulting in their lower influence.
To further evaluate the differences between the models, paired t-tests were conducted based on the relative errors of each sample for both φ and cohesion c, where p is the significance level, indicating the probability that the difference between models is caused by random variation. The significance levels of 0.05 and 0.01 were used. For both φ and c, the results show that the PSO-SVM model performs significantly better than the other models (p < 0.01).
The excellent performance of the PSO-SVM model is mainly attributed to two core factors: first, the SVM model has a simple structure and good robustness on small sample data; second, the PSO algorithm can efficiently complete parameter optimization in the medium-dimensional search space. These characteristics make the model achieve a good balance between generalization ability and fitting accuracy. Due to the characteristics of self-discrete splitting, the RF model may have limitations in capturing subtle nonlinear relationships; under the condition of limited sample size, the FNN model may still have a fitting phenomenon even if it is optimized by the ADAM algorithm. In general, all three models can give reliable prediction results.
In previous studies, developed a PSO-LSTM model with R2 values of 0.9983 (c) and 0.9831 (φ) using 244 sandstone datasets, while achieved optimal performance with the DBO-RF model (R2 = 0.9989 for c, R2 = 0.9952 for φ) based on 199 multi-lithology samples. Although the proposed models in this study exhibit slightly lower prediction accuracy (R2 = 0.9632 for c, R2 = 0.9476 for φ), they still provide valuable region-specific empirical insights for shear strength prediction of quartzite in the Klang Valley area of Malaysia, supplementing existing research focused on different rock types and geological contexts.
For engineering applications, the PSO-SVM model is suitable for projects requiring high overall precision, such as the support design of high-risk slopes. The DBO-RF model is slightly superior to the ADAM-FNN model in predicting cohesion c, while the ADAM-FNN model outperforms the DBO-RF model slightly in predicting friction angle φ. For projects with lower precision requirements, such as foundation pit engineering, the model can be selected according to specific needs.
This study has certain limitations. The dataset size is relatively small, and the models were only validated by LOO-CV without an independent external test dataset, which may compromise the persuasiveness of the models. In addition, the established models are developed for quartzite in Malaysia, thus their applicability to other rock types and geological regions outside the study area is limited. Nevertheless, these models still provide valuable experience for predicting the shear strength of quartzite within the study area. Future research will expand the sample database with more independent datasets covering diverse lithologies and geological settings, and adopt rigorous external validation methods to further enhance the applicability of the models.
5 Conclusion
This study establishes three machine learning models of PSO-SVM, DBO-RF and ADAM-FNN, and uses three easy-to-obtain indicators on the spot (Is (50), Srn, Vs.) to predict the φ and
cof quartzite in the ancient region of Klang, Malaysia. And use
R2, MAE, MAPE, RMSE, REP and other statistical indicators to evaluate the prediction performance of the model. The main conclusions are as follows.
Data preprocessing can effectively improve the quality of data sets, and the LOO-CV method has significant advantages under small sample conditions. PSO, DBO and ADAM algorithms can improve the prediction effect of SVM, RF and FNN models respectively.
The prediction relative error of the three models is less than 10%, and the deterministic coefficient R2 is higher than 0.85. It shows that three models can reliably predict the φ and c of quartzite.
Among the three models, PSO-SVM performs best, with the highest R2 and the lowest MAE, MAPE, RMSE, and the relative error of φ and c is controlled within 5%. The performance differences of the three models mainly stem from their different adaptability to small data sets and resistance to overfitting.
Statements
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
XZ: Writing – original draft, Writing – review and editing. MS: Writing – review and editing. HH: Writing – review and editing. JD: Writing – review and editing.
Funding
The author(s) declared that financial support was received for this work and/or its publication. The authors are grateful for the financial support provided by the Fundamental Research Grant Scheme (FRGS/1/2020/TK0/UM/02/43), RU grant (GPF049A-2020) from Ministry of Higher Education of Malaysia, China Scholarship Council (CSC) (Grant No. CSC202210710011), Independent Research Project of State Key Laboratory of Safety and Resilience of Civil Engineering in Mountain Area (Grant No. SQQZ2025203), and Early Career Youth Talent Training Project of Jiangxi Province (Grant No. S202519741).
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
BaiJ.DiaoY.JiaC.LiuC.ZhangM.WangC. (2022). A review of advances in triaxial tests: instruments, test techniques and prospects. KSCE J. Civ. Eng.26 (8), 3325–3341. 10.1007/s12205-022-1345-1
2
BeikiM.MajdiA.GivshadA. D. (2013). Application of genetic programming to predict the uniaxial compressive strength and elastic modulus of carbonate rocks. Int. J. Rock Mech. Min. Sci.63, 159–169. 10.1016/j.ijrmms.2013.08.004
3
BreimanL. (1996). Bagging predictors. Mach. Learn.24 (2), 123–140. 10.1007/BF00058655
4
BreimanL. (2001). Random forests. Mach. Learn.45 (1), 5–32. 10.1023/A:1010933404324
5
ChenC.XueX. (2022). A novel hybrid intelligent model for the prediction of creep coefficients based on random forest and support vector machine. Ocean. Eng.266, 113191. 10.1016/j.oceaneng.2022.113191
6
ChoiS.JeongH.CheonD.-S. (2022). Prediction of mohr-coulomb constants of selected Korean rocks based on extreme gradient boosting method and its evaluation. KSCE J. Civ. Eng.26 (5), 2468–2477. 10.1007/s12205-022-1388-3
7
Çobanoğluİ.ÇelikS. B. (2008). Estimation of uniaxial compressive strength from point load strength, schmidt hardness and P-wave velocity. Bull. Eng. Geol. Environ.67 (4), 491–498. 10.1007/s10064-008-0158-x
8
DaiJ.GongF.HeZ.XuL. (2024a). Quantitative estimation method for the excavation-induced weakening effect of rock mass parameters in deep tunnels. Eng. Geol.330, 107416. 10.1016/j.enggeo.2024.107416
9
DaiJ.GongF.XuL. (2024b). Rockburst criterion and evaluation method for potential rockburst pit depth considering excavation damage effect. J. Rock Mech. Geotechnical Eng.16 (5), 1649–1666. 10.1016/j.jrmge.2023.08.016
10
Fathipour-AzarH. (2022). Data-oriented prediction of rocks’ mohr–Coulomb parameters. Archive Appl. Mech.92 (8), 2483–2494. 10.1007/s00419-022-02190-6
11
GaoJ.Nait AmarM.MotahariM. R.HasanipanahM.Jahed ArmaghaniD. (2020). Two novel combined systems for predicting the peak shear strength using RBFNN and meta-heuristic computing paradigms. Eng. Comput.38, 129–140. 10.1007/s00366-020-01059-y
12
HajdarwishA.ShakoorA. (2006). Predicting the Shear Strength Parameters of Mudrocks.
13
HanD.XueX. (2024). Machine learning-based prediction of shear strength parameters of rock materials. Rock Mech. Rock Eng.57 (10), 8795–8819. 10.1007/s00603-024-04012-3
14
HastieT. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer. 10.1007/978-0-387-84858-7
15
HeK.ZhangX.RenS.SunJ. (2015). Delving Deep into Rectifiers: Surpassing Human-Level Performance on Imagenet Classification. 2015 IEEE International Conference on Computer Vision ICCV. 10.1109/ICCV.2015.123
16
HeidariM.KhanlariG. R.Torabi KavehM.KargarianS. (2012). Predicting the uniaxial compressive and tensile strengths of gypsum rock by point load testing. Rock Mech. Rock Eng.45 (2), 265–273. 10.1007/s00603-011-0196-8
17
HibaM.IbrahimA. F.ElkatatnyS.AliA. (2021). Prediction of cohesion and friction angle from well-logging data using decision tree and random forest. Arabian J. Geosciences15 (1), 26. 10.1007/s12517-021-09154-0
18
HuangM.HongC.ChenJ.MaC.LiC.HuangY. (2021). Prediction of peak shear strength of rock joints based on back-propagation neural network. Int. J. Geomechanics21 (6), 04021085. 10.1061/(ASCE)GM.1943-5622.0002033
19
Jahed ArmaghaniD.HajihassaniM.Yazdani BejarbanehB.MartoA.TonnizamE. (2014). Indirect measure of shale shear strength parameters by means of rock index tests through an optimized artificial neural network. Measurement55, 487–498. 10.1016/j.measurement.2014.06.001
20
JamshidiA. (2022). A comparative study of point load index test procedures in predicting the uniaxial compressive strength of sandstones. Rock Mech. Rock Eng.55 (7), 4507–4516. 10.1007/s00603-022-02877-w
21
KahramanS. (2014). The determination of uniaxial compressive strength from point load strength for pyroclastic rocks. Eng. Geol.170, 33–42. 10.1016/j.enggeo.2013.12.009
22
KahramanS.GunaydinO.AlberM.FenerM. (2009). Evaluating the strength and deformability properties of Misis fault breccia using artificial neural networks. Expert Syst. Appl.36 (3, Part 2), 6874–6878. 10.1016/j.eswa.2008.08.002
23
KaintholaA.SinghP. K.VermaD.SinghR.SarkarK.SinghT. N. (2015). Prediction of strength parameters of himalayan rocks: a statistical and ANFIS approach. Geotechnical Geol. Eng.33 (5), 1255–1278. 10.1007/s10706-015-9899-z
24
KaramanK.CihangirF.ErcikdiB.KesimalA.DemirelS. (2015). Utilization of the Brazilian test for estimating the uniaxial compressive strength and shear strength parameters. J. South. Afr. Inst. Min. Metallurgy115 (3), 185–192. 10.17159/2411-9717/2015/v115n3a3
25
KarevV. I.KhimuliaV. V.ShevtsovN. I. (2021). Experimental studies of the deformation, destruction and filtration in rocks: a review. Mech. Solids56 (5), 613–630. 10.3103/S0025654421050125
26
KhandelwalM.MartoA.FatemiS. A.GhoroqiM.ArmaghaniD. J.SinghT. N.et al (2018). Implementing an ANN model optimized by genetic algorithm for estimating cohesion of limestone samples. Eng. Comput.34 (2), 307–317. 10.1007/s00366-017-0541-y
27
KingmaD. P.BaJ. (2014). Adam: a method for stochastic optimization. Corr. abs/1412.6980. 10.48550/arXiv.1412.6980
28
KurtulusC.SertçelikF.Sertcelikİ. (2018). Estimation of unconfined uniaxial compressive strength using schmidt hardness and ultrasonic pulse velocity. Teh. Vjesn.25, 1569–1574. 10.17559/TV-20170217110722
29
LeiD.ZhangY.LuZ.WangG.LaiZ.LinM.et al (2025). A machine learning framework for predicting shear strength properties of rock materials. Sci. Rep.15 (1), 8748. 10.1038/s41598-025-91436-8
30
LeysC.LeyC.KleinO.BernardP.LicataL. (2013). Detecting outliers: do not use standard deviation around the mean, use absolute deviation around the median. J. Exp. Soc. Psychol.49 (4), 764–766. 10.1016/j.jesp.2013.03.013
31
MaZ.ZuoJ.ZhuF.LiuH.XuC. (2023). Non-orthogonal failure behavior of roadway surrounding rock subjected to deep complicated stress. Rock Mech. Rock Eng.56 (9), 6261–6283. 10.1007/s00603-023-03397-x
32
MahmoodzadehA.MohammadiM.Ghafoor SalimS.Farid Hama AliH.Hashim IbrahimH.Nariman AbdulhamidS.et al (2022). Machine learning techniques to predict rock strength parameters. Rock Mech. Rock Eng.55 (3), 1721–1741. 10.1007/s00603-021-02747-x
33
Mohammadi BehboudM.RamezanzadehA.TokhmechiB.MehradM.DavoodiS. (2023). Estimation of geomechanical rock characteristics from specific energy data using combination of wavelet transform with ANFIS-PSO algorithm. J. Petroleum Explor. Prod. Technol.13 (8), 1715–1740. 10.1007/s13202-023-01644-z
34
MoussasV. C.DiamantisK. (2021). Predicting uniaxial compressive strength of serpentinites through physical, dynamic and mechanical properties using neural networks. J. Rock Mech. Geotechnical Eng.13 (1), 167–175. 10.1016/j.jrmge.2020.10.001
35
MunemoP. K. a. P.MunemoP. (2021). Investigating the correlations between point load strength index, uniaxial compressive strength and Brazilian tensile strength of sandstones. A case study of QwaQwa sandstone deposit. Int. J. Min. Mineral Eng.12 (1), 67–83. 10.1504/ijmme.2021.114915
36
MuralhaJ.GrasselliG.TatoneB.BlümelM.ChryssanthakisP.YujingJ. (2014). ISRM suggested method for laboratory determination of the shear strength of rock joints: revised version. Rock Mech. Rock Eng.47, 291–302. 10.1007/s00603-013-0519-z
37
OuyangS.ZhangX.MaY.YaoC.YangJ.YeZ.et al (2025). Shear failure behavior and a shear strength prediction model of unbonded rock–cement interface. Int. J. Geomechanics25 (6), 04025082. 10.1061/IJGNAI.GMENG-10809
38
RastegarF.NejatiH. R.GhazvinianA.HadeiM. R.NazerigiviA. (2020). On applicability of some indirect tests for estimation of tensile strength of anisotropic rocks. J. Min. Environ.11 (3), 711–720. 10.22044/jme.2020.9220.1813
39
ŞahinM.UlusayR.KarakulH. (2020). Point load strength index of half-cut core specimens and correlation with uniaxial compressive strength. Rock Mech. Rock Eng.53, 3745–3760. 10.1007/s00603-020-02137-9
40
ShahaniN. M.UllahB.ShahK. S.HassanF. U.AliR.ElkotbM. A.et al (2022). Predicting angle of internal friction and cohesion of rocks based on machine learning algorithms. Mathematics10 (20), 3875. 10.3390/math10203875
41
ShenJ.JimenezR. (2018). Predicting the shear strength parameters of sandstone using genetic programming. Bull. Eng. Geol. Environ.77 (4), 1647–1662. 10.1007/s10064-017-1023-6
42
ShinodaM.MiyataY.KurokawaU.KondoK. (2019). Regional landslide susceptibility following the 2016 Kumamoto earthquake using back-calculated geomaterial strength parameters. Landslides16 (8), 1497–1516. 10.1007/s10346-019-01171-1
43
SiddigO.IbrahimA. F.ElkatatnyS. (2023). Estimation of rocks’ failure parameters from drilling data by using artificial neural network. Sci. Rep.13 (1), 3146. 10.1038/s41598-023-30092-2
44
SinghA.AyothiramanR.RaoK. S. (2020). Failure criteria for isotropic rocks using a smooth approximation of modified mohr–coulomb failure function. Geotechnical Geol. Eng.38 (4), 4385–4404. 10.1007/s10706-020-01287-5
45
TukeyJ. W. (1977). Exploratory Data Analysis. Springer. 10.1007/978-0-387-32833-1_136
46
WangY.AladejareA. E. (2016). Bayesian characterization of correlation between uniaxial compressive strength and Young's modulus of rock. Int. J. Rock Mech. Min. Sci.85, 10–19. 10.1016/j.ijrmms.2016.02.010
47
ZhangZ. (2018). “Improved adam optimizer for deep neural networks,” in 2018 IEEE/ACM 26th International Symposium on Quality of Service (Iwqos). 10.1109/IWQoS.2018.8624183
48
ZhangZ.ShengQ.FuX.ZhouY.HuangJ.DuY. (2020). An approach to predicting the shear strength of soil-rock mixture based on rock block proportion. Bull. Eng. Geol. Environ.79, 2423–2437. 10.1007/s10064-019-01658-0
49
ZhangX.ZhuX.YaoC.OuyangS.YangJ.JiangQ. (2022). Investigation on the shear behavior of rough rock joints prepared by three-dimensional engraving technique. J. Test. Eval.50 (3), 1425–1440. 10.1520/JTE20210282
50
ZhaoJ.HuL.FengX.XiaoY.GuoY. (2023). Shear failure mechanisms of sandstone subjected to direct, true triaxial and confining shear test conditions. Rock Mech. Rock Eng.56 (9), 6889–6903. 10.1007/s00603-023-03410-3
Summary
Keywords
machine learning, optimization algorithm, portable index tests, rock mechanics, shear strength
Citation
Zhu X, Suhatril M, Hashim H and Dai J (2026) Predicting shear strength of quartzite using portable index tests: a machine learning approach. Front. Earth Sci. 14:1811030. doi: 10.3389/feart.2026.1811030
Received
17 February 2026
Revised
19 March 2026
Accepted
30 April 2026
Published
20 May 2026
Volume
14 - 2026
Edited by
Chong Xu, Ministry of Emergency Management, China
Reviewed by
Meng Wang, Central South University, China
Sufi Gulzar, National Institute of Technology Patna, India
Updates
Copyright
© 2026 Zhu, Suhatril, Hashim and Dai.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Meldi Suhatril, meldi@um.edu.my
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.