ORIGINAL RESEARCH article

Front. Genet., 01 December 2025

Sec. Epigenetics and Genome Architecture

Volume 16 - 2025 | https://doi.org/10.3389/fgene.2025.1642286

FusDRM-m5C: a hybrid model for accurate prediction of 5-methylcytosine modification sites based on feature fusion and attention mechanism

  • School of Information Engineering, Jingdezhen Ceramic University, Jingdezhen, China

Abstract

Introduction:

The precise identification of 5-methylcytosine (m5C), an epitranscriptomic modification fundamental to RNA function, is crucial yet proves difficult to achieve experimentally. Consequently, computational prediction offers a promising avenue; however, refining its predictive accuracy and ensuring its robustness remain ongoing objectives. To address these limitations, this study introduces a deep learning framework designed for highly accurate m5C site prediction from RNA sequences.

Methods:

We propose FusDRM-m5C, a deep learning framework featuring a multi-branch architecture designed to process three distinct feature types: one-hot vector representation (one-hot), Z-curve-based geometrical features (Z-curve), and local RNA secondary structure (RSS). Each feature type is processed by a separate, parallel branch. Within each branch, a Dilated Convolutional Neural Network (DCNN) captures multi-scale patterns, followed by a Multi-Head Self-Attention (MHSA) mechanism with residual connections to weigh context-dependent information. For feature fusion, the high-level representations from the three branches are then integrated via concatenation. This fused feature vector is subsequently fed into a final fully connected network, which generates the prediction probability for precise m5C site identification.

Results:

The performance of FusDRM-m5C was rigorously evaluated using both 5-fold cross-validation (CV) and independent dataset testing. On the 5-fold CV benchmark dataset, the model achieved high predictive accuracy, reflected by a Sensitivity (Sn) reaching 0.995, Specificity (Sp) of 0.971, Accuracy (ACC) at 0.983, Matthews correlation coefficient (MCC) measuring 0.966, and an Area Under the Receiver Operating Characteristic Curve (AUC) of 0.997. Crucially, when assessed on an independent test dataset, the model maintained strong generalization capability, attaining an Sn of 0.900, Sp of 0.965, Acc of 0.933, MCC of 0.867, and an AUC of 0.986. Furthermore, we assessed the cross-species prediction performance of FusDRM-m5C. The results demonstrated that the model consistently maintained high accuracy and robustness across datasets from multiple species, outperforming several existing state-of-the-art methods.

Discussion:

The proposed FusDRM-m5C model demonstrates highly accurate and robust prediction of m5C sites, comparing favorably with existing methods. Its architecture effectively integrates diverse biological features through distinct processing pathways fused via attention, offering a powerful tool for m5C identification.

1 Introduction

RNA modifications represent a crucial layer of post-transcriptional gene regulation, influencing various aspects of RNA metabolism including stability, splicing, nuclear export, localization, translation efficiency, and interactions with RNA-binding proteins (; Zaccara et al., 2023). Among over 170 known types of RNA modifications (), 5-methylcytosine (m5C) has gained increasing attention due to its widespread occurrence and functional significance. m5C has been identified in multiple RNA species, including messenger RNA (mRNA), transfer RNA (tRNA), ribosomal RNA (rRNA), and long non-coding RNA (lncRNA) (; ). Its presence has been associated with diverse biological processes, such as stem cell differentiation, cellular stress response, embryonic development, and tumorigenesis (; Yang et al., 2017). Therefore, accurate and comprehensive identification of m5C sites is crucial for elucidating its biological roles and understanding its involvement in both normal physiology and disease pathogenesis.

To detect m5C modifications at single-nucleotide resolution, several high-throughput experimental techniques have been developed, including bisulfite sequencing (BS-seq) (), 5-azacytidine–mediated RNA immunoprecipitation (Aza-IP) (), and methylation individual-nucleotide resolution crosslinking and immunoprecipitation (miCLIP) (). These methods have greatly advanced our understanding of m5C distribution and function in various transcriptomes. However, they still suffer from several practical limitations. For example, BS-seq is prone to false positives due to incomplete conversion or structural resistance, Aza-IP and miCLIP require specialized reagents and antibodies, and all these methods typically demand large quantities of high-quality RNA input. Furthermore, the dynamic, tissue-specific, and condition-dependent nature of RNA methylation makes it challenging to achieve comprehensive and consistent experimental profiling across diverse biological contexts.

In response to these challenges, computational approaches have emerged as effective and scalable alternatives to assist in m5C site discovery. By exploiting known sequence characteristics, structural signals, and evolutionary conservation, machine learning–based and deep learning–based models can predict putative m5C sites from RNA sequence data. These computational tools represent a significant improvement over labor-intensive wet-lab approaches, primarily by delivering superior speed and cost-effectiveness. Furthermore, they enable the efficient analysis of large-scale transcriptomic datasets, thereby circumventing the need for supplementary experimental procedures. Importantly, computational methods also enable hypothesis generation for functional studies, guide experimental validation, and facilitate the annotation of RNA methylomes in species or cell types where experimental data are scarce.

Following the initial experimental challenges, the development of computational predictors for m5C sites began to gain momentum. Feng et al. pioneered this area by proposing m5C-PseDNC (), a support vector machine (SVM)-based model that utilized pseudo-K-tuple nucleotide composition (PseKNC) to identify m5C sites in Homo sapiens. Subsequently, Qiu et al. introduced iRNAm5C-PseDNC (), which employed random forests (RF) and incorporated physicochemical properties into PseDNC. In 2019, Fang et al. presented RNAm5CPred (), an SVM-based model that compared balanced and imbalanced datasets while utilizing KNF, K-spaced nucleotide pair frequency (KSNPF), and PseDNC. The field continued to diversify in 2020, with Lv et al. developing iRNA-m5C (), an RF-based predictor for four species that combined PseKNC, MNBE, KNFC, and natural vector (NV) features and also offered a web server. In the same year, Chen et al. introduced m5CPred-SVM (), focusing on three species and innovatively incorporating position-specific propensity features (PSNP, PSDP) along with KNF, KSNPF, PseDNC, and chemical property with density (CPD), also making it available via a web server. Dou et al. further contributed to the development of iRNA-m5C_SVM () for A. thaliana, an SVM-based model that combines position-specific propensity (PSP), k-mer, pseudo electron-ion interaction potentials (PseEIIP), and pseudo dinucleotide composition (PCPseDNC).

The application of more advanced machine learning techniques and deep learning began to emerge prominently thereafter. Chai et al. introduced Staem5 (), employing a stacking ensemble model with various base classifiers for A. thaliana and M. musculus. Concurrently, the exploration of deep learning intensified, with Hasan et al. proposing Deepm5C (), a deep learning-based hybrid framework that utilizes a stacking strategy for human m5C site identification. Liu et al. developed m5Cpred-XS (), leveraging XGBoost and SHAP for feature interpretation and prediction in H. sapiens, M. musculus, and A. thaliana. Xiao et al. focused on m5C sites in human promoters using m5C-HPromoter (), an ensemble deep learning approach that employs frequency-based One-Hot encoding. A unique contribution was made by He et al. with m5CRegpred (), which addressed the substrate specificity of m5C writers and readers.

More recent advancements have continued to push the boundaries of deep learning applications. Aslam et al. proposed a 1D Convolutional Neural Network (CNN) based predictor (). Malebary et al. further explored deep learning architectures such as GRU, LSTM, and Bi-LSTM in their m5c-iDeep model (). Kurata et al. developed MLm5C (), a high-precision predictor that utilizes a stacking ensemble of hybrid machine learning models and evaluates a broad set of 11 distinct features. Transformer-based architectures, known for their success in natural language processing, were introduced to this domain by Fu et al. with Trans-m5C (). Jiang et al. enhanced prediction accuracy in Feadm5C () by incorporating physicochemical molecular graph features with BiLSTM. Concurrently, efforts to refine k-mer-based approaches and ensemble strategies continued, as evidenced by m5C-TNKmer () and m5c-iEnsem (), which focused on bagging and boosting techniques. These collective efforts highlight a continuous drive towards more accurate, robust, and interpretable computational models for m5C site prediction across diverse species and biological contexts.

Although these approaches have significantly advanced m5C prediction, several limitations remain. Many models rely heavily on sequence-derived features while underutilizing the RNA structural context. Certain methods are hindered by architectural designs that offer insufficient representational capacity, consequently impeding their ability to capture the long-range dependencies crucial for precise prediction. Moreover, a number of current tools demonstrate suboptimal predictive performance, especially when evaluated on unseen datasets, which clearly indicates difficulties in generalization. Cross-species applicability and model interpretability also remain open issues.

To address the limitations of current m5C site prediction methods, we propose FusDRM-m5C, a hybrid deep learning framework. The main contributions of this study are as follows:

  • FusDRM-m5C adopts a tailored deep learning architecture that integrates multiple neural components to effectively capture distinct biological features. By combining dilated 1D convolutions for modeling long-range dependencies, 2D convolutions for extracting spatial patterns from RNA secondary structure, and multi-head self-attention for enhancing global contextual awareness, the model ensures comprehensive and stable feature extraction. Residual connections further support training convergence and the flow of information.

  • The model’s multi-feature fusion architecture processes sequence (one-hot, Z-curve) and secondary structure inputs through parallel channels. Each channel’s output is first refined by a dedicated multi-head attention mechanism before the representations are concatenated and fed to a fully connected network. This method ensures an effective integration of diverse biological information, leading to enhanced predictive accuracy.

  • FusDRM-m5C achieved competitive results on diverse benchmark datasets. In both five-fold cross-validation and independent testing, the model showed improved performance over several existing approaches in key metrics including AUROC and accuracy, which suggests its potential effectiveness and reliability in m5C site prediction.

  • The proposed model showed promising generalization capabilities in cross-species validation tasks. The results indicated high predictive accuracy across several tested transcriptomes, suggesting its potential for broader application across different biological systems.

  • To enhance usability, we have developed an online prediction platform. This web server features an intuitive and efficient interface, enabling users to readily submit RNA sequences and obtain m5C site predictions. Consequently, FusDRM-m5C can be more conveniently applied in biological research and various other fields.

Taken together, these contributions highlight the strength of FusDRM-m5C in accurately and robustly identifying m5C sites across species and data conditions. By effectively combining diverse biological features and advanced neural components, our framework provides a reliable tool for predicting transcriptome-wide m5C sites and offers new opportunities for understanding the regulatory roles of RNA methylation in various organisms.

2 Materials and methods

2.1 Benchmark dataset

For robust model evaluation and fair comparison, we utilized the publicly available benchmark dataset developed by Hasan et al. for their Deepm5C predictor (). This dataset provides a large-scale, standardized resource for identifying human m5C sites. The construction of this benchmark began with sourcing experimentally validated positive m5C sequences from the m6A-Atlas database (Tang et al., 2021), which initially yielded 95,390 sequences. To minimize redundancy and potential bias, these sequences were processed with CD-HIT () at a 90% identity threshold, resulting in a final set of 58,159 non-redundant positive samples. Due to the scarcity of experimentally verified non-m5C sites, the negative samples were constructed following a strategy widely adopted in previous studies (; Xu et al., 2020; ). Specifically, 41 nt fragments centered on a cytosine were generated from all human chromosomes, and any fragments overlapping with the known positive m5C sites were excluded. This pool was then filtered using CD-HIT (90% threshold) to remove internal redundancy. From this large set of negative candidates, 58,159 sequences were randomly selected to create a balanced dataset with an equal number of positive samples. The rationale for this balanced approach was to prevent the model from developing a bias towards a majority class during training, ensuring that the classifier could effectively learn the distinguishing features of both true m5C sites and non-sites, thereby guaranteeing the reliability and fairness of performance metrics.

All sequences in the dataset are 41 nt long, centered on the cytosine. Crucially, the data was pre-partitioned into distinct training and independent test sets, with 80% of the data serving as the training set and the remaining 20% constituting the independent test set. We adopted this established split, where the training set is used solely for model development and the independent test set is reserved strictly for final performance evaluation. The exact number of positive and negative samples in the training and independent test sets are detailed in Table 1. Using this well-curated, non-redundant, and pre-partitioned benchmark ensures the reliability and comparability of our findings with state-of-the-art methods, which are evaluated on the same data foundation.

TABLE 1

Dataset componentPositive samplesNegative samplesTotal samples
Training set46,52946,52993,038
Independent test set11,63011,63023,260

Distribution of the benchmark data set.

2.2 Feature coding schemes

2.2.1 One-hot encoding

One-hot encoding constitutes a widely accepted technique for translating categorical data, such as nucleotides within an RNA sequence, into a numerical format amenable to machine learning algorithms. This approach transforms each symbolic category into a distinct binary vector. For the four canonical RNA bases , the conventional one-hot mapping is delineated as shown in Equation 1.

In this representation, each nucleotide corresponds to a 4-dimensional vector where only the dimension associated with that specific nucleotide is “hot” (set to 1), while all other dimensions are “cold” (set to 0). Applying this transformation position-by-position along an RNA sequence of length yields a feature matrix of dimensions . The primary advantages of one-hot encoding are its simplicity and computational efficiency. The mapping is straightforward and typically implemented via a fast lookup operation. Furthermore, the method generates a clear, orthogonal representation for each nucleotide, thereby precluding the implication of any artificial ordinal relationships. This characteristic proves vital for maintaining the inherent categorical distinctiveness of the bases throughout subsequent analyses.

2.2.2 Z-curve encoding

To capture the sequence composition information, we employed the Z-curve (Zhang and Zhang, 1994; ) encoding method. The Z-curve technique provides a unique numerical representation of a DNA or RNA sequence by mapping it into a three-dimensional space, based on the frequency distribution of its constituent bases. The coordinates of the curve at a given position n along the sequence reflect the cumulative counts of nucleotides up to that point, as calculated in Equation 2.

For an input RNA sequence of length , this Z-curve encoding process generates a sequence of corresponding 3-dimensional vectors. Therefore, the final numerical representation of the sequence used as input for the subsequent model components is a matrix or tensor with the shape . Each row corresponds to a nucleotide position in the sequence, and the three columns represent the calculated , , and coordinates derived from the cumulative base distribution.

2.2.3 RNA secondary structure encoding

RNA secondary structure (RSS), describing intramolecular base-pairing, provides crucial information beyond the primary sequence. Incorporating this structural information markedly boosts the predictive capabilities of deep learning models across a spectrum of RNA-related bioinformatics applications. Indeed, the efficacy of RNA secondary structure features, frequently represented as graphs, has been widely substantiated in diverse contexts (Zhou et al., 2023; ). In this study, we predicted the secondary structure for each RNA sequence using the ViennaRNA Package 2.0 (). This package outputs the predicted structure in dot-bracket notation, where parentheses indicate paired bases and dots represent unpaired ones. To make this structural information compatible with our deep learning model, we transformed the dot-bracket string for each RNA into an N × N adjacency matrix, with N being the RNA sequence length. In this matrix, an entry signifies a base pair between nucleotides and , while otherwise. This adjacency matrix, effectively a graph representation of the secondary structure, was then utilized as an input channel for our deep learning model, complementing the primary sequence information.

2.3 Model architecture

Deep learning has proven to be highly effective in RNA modification site prediction (; ; ), owing to its powerful capability to capture complex patterns and hierarchical features from biological sequences. Building on this foundation, we propose FusDRM-m5C, a deep learning framework designed to accurately predict m5C modification sites by integrating multiple sources of biological information. As shown in Figure 1, FusDRM-m5C employs a multi-branch architecture that processes three complementary types of input features: one-hot encoded nucleotide sequences, Z-curve representations reflecting physicochemical and geometrical properties, and RNA secondary structure matrices capturing local structural context. Each of these feature types is first transformed into a fixed-size matrix representation and then passed through a dedicated convolutional module. Specifically, one-hot and Z-curve features are processed using two layers of 1D Dilated Convolutional Neural Networks (1D-DCNNs), which are effective in extracting multi-scale sequential patterns and long-range dependencies. The secondary structure information, inherently two-dimensional, is handled by a two-layer 2D-DCNN to model spatial interactions between base pairs. After the initial feature extraction stage, the output of each of the three branches is passed through its own multi-head self-attention mechanism. This enables the model to adaptively assign weights and focus on the most informative signals within each feature space. The three resulting feature representations are then integrated through a concatenation operation. Finally, this fused vector is passed to a fully connected layer to produce the ultimate prediction probability of m5C site presence. To improve training stability and promote gradient flow, residual connections are also employed throughout the model.

FIGURE 1

2.3.1 Dilated convolutional networks

Dilated Convolutions (Yu and Koltun, 2015), also known as Atrous Convolutions, are an effective Convolutional Neural Network (CNN) operation designed to exponentially increase the receptive field of neurons without significantly increasing the number of parameters or computational cost. This is achieved by introducing a fixed gap—the dilation rate ()—between the elements of the convolution kernel. When the dilation rate is 1, a dilated convolution is equivalent to a standard convolution. For a 1D input sequence x and a filter w of size , the output of a dilated convolution at position s is given by Equation 3:

Where is the dilation rate. When , the kernel skips elements when processing the input sequence. This effectively enlarges the input region that each output unit “sees” without sacrificing spatial resolution or substantially increasing the number of parameters. In sequence information extraction tasks, especially when processing biological sequences such as RNA or DNA, dilated convolutions enable the capture of longer-range contextual dependencies. By incorporating stacked dilated convolutional layers with diverse (often exponentially increasing) dilation rates, a model is able to establish a hierarchical feature representation. This methodology proficiently integrates sequence information from various scales, proving indispensable for detecting distant conserved patterns or structural features within sequences. Such capability makes dilated convolutions a powerful tool for learning complex patterns from long sequences.

2.3.2 Multi-head self-attention layer

In the field of RNA sequence analysis, particularly for the precise prediction of post-transcriptional RNA modification sites, the Multi-Head Self-Attention (MHSA) (Vaswani et al., 2017) mechanism has become a key technology for constructing deep learning models. This mechanism was originally proposed by Vaswani et al. within the Transformer architecture. For RNA sequences, typically composed of nucleotides, MHSA can effectively capture complex long-range dependencies and local contextual features within the sequence, which is instrumental in identifying key sequence patterns that determine specific RNA modifications. When an input RNA sequence is processed and converted into a numerical representation via an embedding layer, MHSA projects into different representation subspaces, enabling the model to scrutinize sequence information from multiple perspectives in parallel. For the -th attention head (), its specific query , key , and value are obtained through the mappings given in Equation 4:

Here, , , and are learnable projection parameter matrices, is the nucleotide embedding dimension, and and are the key and value dimensions, respectively, typically set to Each head then independently computes its attention as shown in Equation 5:

The scaling factor herein helps stabilize gradients. In this manner, different heads might learn to focus on distinct features within the RNA sequence, such as specific conserved motifs, nucleotides at particular distances from the target modification site, or patterns indicative of local secondary structures. The outputs of these parallelly computed attention heads are then concatenated and passed through a final linear transformation to obtain the aggregated output of the MHSA layer, as shown in Equation 6:where is the output projection matrix, and is often consistent with the input embedding dimension . In the context of RNA modification site prediction, the contextual representations learned by MHSA enable the model to integrate signals from different regions of the RNA sequence that contribute to the classification decision, thereby enhancing its ability to distinguish true modification sites from unmodified ones.

2.3.3 Residual connection

Residual Connections are a groundbreaking technique in deep learning, first introduced by He et al. in their Residual Networks (ResNets) (), designed to address the degradation problem encountered when training very deep neural networks. As network depth increases, model performance often saturates and then degrades rapidly, a phenomenon not entirely caused by overfitting but rather by the difficulty of optimizing deep architectures. Residual connections alleviate this issue by introducing “shortcut connections” that allow information to bypass one or more layers. Specifically, if the desired underlying mapping to be learned by a few stacked layers is , the residual learning framework lets these layers fit a residual mapping . The original mapping is thus recast as . The output y of a residual block is defined by Equation 7:where xx is the input, and represents the residual function learned by the layers with weights . This formulation enables layers to learn an identity mapping easily. If contributes little, thereby not impeding effective information flow. More importantly, residual connections significantly improve gradient propagation during backpropagation, enabling the effective training of substantially deeper networks. This has led to significant performance gains in various computer vision tasks and other domains, including sequence modeling. Residual connections have since become a standard component in the design of deep neural networks.

2.3.4 Fully connected neural network

Fully Connected Neural Networks (FCNNs), often referred to as Dense Layers or Multilayer Perceptrons (MLPs), represent a foundational architecture in neural networks where each neuron in one layer is connected to every neuron in the subsequent layer. This dense connectivity allows FCNNs to learn complex, non-linear relationships between inputs and outputs. The computation within a single fully connected layer transforming an input vector to an output vector is given by Equation 8.where is the weight matrix, is the bias vector for layer , and denotes a non-linear activation function, such as the Rectified Linear Unit (ReLU), sigmoid, or tanh function. Through the stacking of multiple such layers, FCNNs can approximate a wide range of functions, making them powerful universal function approximators. While Convolutional Neural Networks (CNNs) or Recurrent Neural Networks (RNNs) might be more efficient for data with specific structures, FCNNs remain crucial components in many deep learning models, often employed as classification or regression modules following feature extraction, or as key transformation layers within more complex architectures.

2.4 Performance evaluation

To comprehensively assess the predictive capability of the proposed FusDRM-m5C model, its performance was evaluated using five widely recognized statistical metrics: Sensitivity (SN), Specificity (SP), Accuracy (ACC), Matthews correlation coefficient (MCC), and the Area Under the Receiver Operating Characteristic Curve (AUC). The formulas used for calculation are given in Equation 9:

The terms True Positives (TP), False Positives (FP), True Negatives (TN), and False Negatives (FN) used in the formulas above represent counts derived from the classification results. Specifically, TP is the number of actual positive instances correctly identified as positive; FP is the number of negative instances incorrectly classified as positive; TN is the number of actual negative instances correctly identified as negative; and FN is the number of actual positive instances incorrectly classified as negative. The Area Under the Receiver Operating Characteristic Curve (AUC), calculated based on the ROC curve, further summarizes the model’s overall ability to discriminate between the positive and negative classes across all possible classification thresholds, with a value closer to 1 indicating better discriminatory power. While all these metrics (SN, SP, ACC, MCC, AUC) offer valuable insights, in this study, we placed particular emphasis on ACC and MCC as key indicators reflecting the model’s overall predictive accuracy and its balanced performance across both classes.

2.5 Instructions for setting hyperparameters

To ensure a fair comparison with existing studies, the FusDRM-m5C model was trained on the identical dataset. Computational acceleration was facilitated by an NVIDIA GeForce RTX 4080 GPU. During training, the Adam with Weight Decay (AdamW) optimizer was employed to enhance the stability of gradient updates and mitigate convergence to local optima. To prevent model overfitting, a combination of strategies including regularization, dropout, and early stopping was utilized. Hyperparameters were optimized via comparative experiments: the learning rate was fixed at after logarithmic search in ; the batch size was set to 64 considering both efficiency and generalization; and a dropout rate of 0.2 was chosen to reduce overfitting. The maximum number of epochs was limited to 300, with early stopping triggered if validation loss failed to improve for 30 consecutive epochs. Network depth was determined through ablation experiments to balance representational capacity and model complexity. The implementation was conducted in Python 3.10 with PyTorch 2.0.0 + cu11.8, and the final hyperparameter settings are summarized in Table 2.

TABLE 2

ParametersNumber
Layer 1 dilation rate1
Layer 1 kernel size3
Layer 2 dilation rate2
Layer 2 kernel size5
Num heads4
Drop out0.2
FCNNs layer sizes[128, 64, 32, 16, 8, 4, 2]

Description of the hyperparameters in the FusDRM-m5C model.

3 Result and discussion

3.1 Classification performance and computational efficiency

To comprehensively evaluate the classification performance of our proposed FusDRM-m5C model, we conducted both 5-fold cross-validation and independent testing on the benchmark dataset. During 5-fold cross-validation, the model demonstrated consistently high predictive accuracy across all folds, with sensitivity, specificity, accuracy, Matthews correlation coefficient (MCC), and area under the ROC curve (AUC) reaching 0.992, 0.971, 0.982, 0.946, and 0.997, respectively. The receiver operating characteristic (ROC) curves from each fold tightly converged near the top-left corner, clearly indicating minimal variability and robust generalization within the training data. Of particular note, the average AUC across all folds reached 0.994, accompanied by a low standard deviation of merely ±0.001, further solidifying the model’s overall robustness (Figure 2A). Evaluation on the independent test set revealed a slight yet acceptable drop in performance, with sensitivity, specificity, accuracy, MCC, and AUC values of 0.900, 0.965, 0.932, 0.867, and 0.985, respectively. Despite this reduction, the high AUC and balanced Sn and Sp demonstrate that the model maintains strong discriminative capability on unseen data. Furthermore, the ROC curve generated from the independent test set exhibits a steep upward trend, effectively distinguishing positive from negative instances (Figure 2B). Collectively, these findings indicate that the model possesses strong classification capability and promising generalization performance, highlighting its potential practical utility for m5C site prediction in both in-sample and out-of-sample contexts.

FIGURE 2

In addition to its classification performance, the model’s computational efficiency was tested on a computing platform running Windows 11 with an AMD Ryzen 9 7840HX processor, 16.0 GB of RAM, and an NVIDIA GeForce RTX 4060 GPU. As detailed in Table 3, the model demonstrates significant acceleration capabilities when utilizing a GPU, achieving a speed-up of approximately 4.6 times compared to using only the CPU for 50,000 samples. It should also be noted that the model requires an initial overhead of about 38 s for import and warm-up on its first run; this one-time cost is not included in the net prediction times in the table, and its impact is amortized when processing large-scale or continuous tasks. While the GPU acceleration is significant, the model’s value is further highlighted by its broad accessibility. Even in a CPU-only environment, its performance remains highly efficient—processing a task of 50,000 samples in approximately 19 s. This result indicates that the model’s performance in a CPU environment also makes it practically usable for researchers with limited computational resources, which helps to broaden its scope of application as a research tool.

TABLE 3

Sample sizeCPU onlyGPU used
200000:00.86000:00.196
10,00000:04.09400:00.893
50,00000:19.32300:04.228

Computational performance of the FusDRM-m5C model with varying sample sizes.

Time format is presented as minutes:seconds.milliseconds.

3.2 Comparison with CNN variants

To systematically evaluate the performance of different convolutional neural network variants, we trained the standard CNN, Dilated Convolutional Neural Network (DCNN), Temporal Convolutional Network (TCN) (), and Densely Connected Convolutional Networks (DenseNet) () on the same dataset. The average metrics were obtained through 5-fold cross-validation, with the results presented in Table 4, where all metrics are reported as mean ± standard deviation. The standard CNN showed relatively limited performance, with an accuracy of 0.808 ± 0.036, suggesting that its shallow architecture is insufficient for modeling complex sequential features. DenseNet, while effective in enhancing feature reuse through dense connections in image-related tasks, achieved an accuracy of only 0.833 ± 0.044 in this study, indicating a limited capacity for capturing long-range dependencies within sequences. In contrast, TCN, which integrates causal and dilated convolutions, demonstrated a strong ability to capture temporal dependencies, achieving a higher accuracy of 0.952 ± 0.020. The DCNN achieved the best performance across all metrics, with an accuracy of 0.983 ± 0.003, an MCC of 0.966 ± 0.006, and an AUC of 0.997 ± 0.001. The use of dilated convolutions significantly enlarges the receptive field without increasing the number of parameters, enabling the model to simultaneously capture both local details and global contextual information. This property explains why DCNN exhibited superior feature representation and classification performance compared with the other CNN variants.

TABLE 4

MethodSnSpACCMCCAUC
CNN0.808 ± 0.0440.809 ± 0.0340.808 ± 0.0360.616 ± 0.0720.882 ± 0.035
DCNN0.995 ± 0.0030.971 ± 0.0050.983 ± 0.0030.966 ± 0.0060.997 ± 0.001
TCN0.943 ± 0.0320.961 ± 0.0110.952 ± 0.0200.905 ± 0.0400.988 ± 0.007
Densenet0.772 ± 0.0550.895 ± 0.0370.833 ± 0.0440.672 ± 0.0860.908 ± 0.040

Performance comparison of CNN and its variants under 5-fold cross-validation.

Each value in the table is expressed as mean ± SD. where the mean is the average of the 5-fold cross-validation results and SD is their standard deviation. The best experimental results are highlighted in bold.

In summary, although TCN and DenseNet achieved competitive performance in certain metrics, the dilated convolution-based DCNN consistently demonstrated the best and most stable results in the 5-fold cross-validation. Therefore, DCNN was selected as the core model in this study to better capture sequential features and enhance prediction accuracy.

3.3 Ablation study

To elucidate the contribution of individual feature encoding schemes and architectural components to the overall predictive performance, comprehensive ablation studies were conducted. To assess the efficacy of various feature encoding strategies and their synergistic effects, a systematic investigation was conducted, as detailed in Figure 3. Among the standalone feature sets, “one-hot” encoding established a solid baseline, particularly excelling in sensitivity (Sn) and accuracy (ACC). In contrast, “z-curve” and “RSS” features, when considered individually, presented varied outcomes. Specifically, “RSS” consistently registered inferior scores across the majority of metrics, most notably for MCC. Crucially, the integration of features in pairwise combinations, such as “one-hot+z-curve” and “one-hot+RSS,” frequently led to substantial performance gains compared to their isolated counterparts, thereby affirming their inherent complementarity. However, the most significant and consistent enhancement across all evaluated metrics—Sn, specificity (Sp), ACC, Matthews correlation coefficient (MCC), and Area Under the Curve (AUC)—was achieved when all feature types were integrated (‘all’). These findings underscore the synergistic advantages offered by a holistic feature representation. By integrating diverse facets of the sequence information, such a representation significantly boosts predictive accuracy, ultimately yielding the highest AUC and a well-rounded overall performance.

FIGURE 3

Similarly, Figure 4 presents the results of ablating key architectural components of the proposed FusDRM-m5C model to assess their individual importance. The removal of each component—ResNet (“w/o ResNet”), Multi-Head Self-Attention (“w/o MHSA”), Deep Convolutional Neural Networks (“w/o DCNNs”), and Fully Connected Neural Networks (“w/o FCNNs”)—resulted in a discernible degradation of performance compared to the complete FusDRM-m5C model. The omission of DCNNs resulted in a significant decline across all evaluated metrics, with MCC and AUC showing the most pronounced deterioration. This underscores their critical contribution to extracting essential hierarchical features. Similarly, the absence of MHSA also visibly diminished performance, highlighting its effectiveness in capturing long-range dependencies. While the removal of ResNet and FCNNs also diminished predictive capabilities, the complete FusDRM-m5C model, which integrates all these components, consistently achieved the highest scores across Sn, Sp, ACC, MCC, and AUC. This affirms that each architectural element contributes uniquely and synergistically to the model’s overall efficacy, justifying the integrated design of FusDRM-m5C.

FIGURE 4

3.4 Visualization with T-distributed stochastic neighbor embedding

To qualitatively assess the discriminative capabilities of different feature encoding strategies and the benefit of their integration, t-SNE (t-distributed Stochastic Neighbor Embedding) was employed to visualize the high-dimensional feature spaces in two dimensions (Figure 5). The t-SNE plot for one-hot features reveals that Non-m5C (blue) and m5C (orange) samples form two relatively distinct, albeit somewhat elongated and intermingled, primary clusters. This suggests that one-hot encoding provides a foundational level of separability. In stark contrast, the visualization for RSS (RNA Secondary Structure) features shows a highly fragmented distribution. Both Non-m5C and m5C samples are scattered across numerous small, overlapping sub-clusters, indicating that RSS features alone offer limited discriminative power for these classes. The z-curve features present an intermediate scenario. While some clustering is evident, with a general separation between a larger blue mass and a more dispersed orange region, there is still considerable overlap, particularly at the interface between the two classes. Crucially, the t-SNE visualization of the testing set, which implicitly utilizes the fused representation of all three feature types, demonstrates a marked improvement in class separability. The Non-m5C and m5C samples form more coherent, compact, and distinctly segregated clusters with a visibly clearer boundary between them compared to any of the individual feature sets. This visual evidence strongly supports the hypothesis that the fusion of diverse feature encodings (one-hot, z-curve, and RSS) captures a more comprehensive and discriminative representation, thereby enhancing the model’s ability to distinguish between m5C and Non-m5C sites.

FIGURE 5

3.5 Performance comparison with existing methods

To better understand the strengths and limitations of different m5C predictors under consistent evaluation settings, we compared FusDRM-m5C with four representative models: Deepm5C (), im5C-DSCGA (), m5C-Seq (), and im7G-DCT (). All methods were retrained and tested on the same datasets to ensure fair and objective comparison. As summarized in Table 5, FusDRM-m5C achieved the best overall performance in 5-fold cross-validation. Its sensitivity was 0.995, specificity was 0.971, accuracy reached 0.983, MCC was 0.966, and AUC was 0.997, all surpassing those of existing methods. Among the baselines, im7G-DCT performed the strongest, yet FusDRM-m5C outperformed it by 32.33% in MCC and 6.29% in AUC. These metrics are particularly important in imbalanced classification tasks. AUC gauges a model’s effectiveness in distinguishing between classes across various thresholds. MCC, on the other hand, offers a more robust measure of prediction quality by integrating all four components of the confusion matrix. The substantial improvements suggest that FusDRM-m5C not only excels in class separation but also produces balanced and reliable outputs across both positive and negative instances.

TABLE 5

MethodSnSpACCMCCAUC
Deepm5C0.835 ± 0.060.875 ± 0.010.855 ± 0.070.697 ± 0.100.941 ± 0.05
im5C-DSCGA0.814 ± 0.020.885 ± 0.020.850 ± 0.000.721 ± 0.000.926 ± 0.00
m5C-seq0.821 ± 0.0010.862 ± 0.0040.841 ± 0.0010.683 ± 0.0020.888 ± 0.002
im7G-DCT0.851 ± 0.040.879 ± 0.010.865 ± 0.020.730 ± 0.040.938 ± 0.02
FusDRM-m5C0.995 ± 0.0030.971 ± 0.0050.983 ± 0.0030.966 ± 0.0060.997 ± 0.001

Comparison of FusDRM-m5C with existing models.

Each value in the table is expressed as mean ± SD. where the mean is the average of the 5-fold cross-validation results and SD is their standard deviation. The best experimental results are highlighted in bold.

On the independent test set, as shown in Table 6, FusDRM-m5C demonstrated strong generalization ability, achieving an ACC of 0.933 and an MCC of 0.867, both the highest among the evaluated models. Compared to im7G-DCT, it improved MCC by 21.94% and AUC by 6.59%, confirming that the model’s advantage is not limited to the training data. In terms of sensitivity and specificity, FusDRM-m5C achieved a balanced performance with values of 0.900 and 0.965, respectively. In contrast, other models tended to prioritize one over the other. For instance, im5C-DSCGA showed high specificity but lower sensitivity, while Deepm5C displayed the opposite trend. Such balance is critical in biological applications where both false positives and false negatives can have significant downstream consequences.

TABLE 6

MethodSnSpACCMCCAUC
Deepm5C0.8460.8570.8520.6910.938
im5C-DSCGA0.8100.9080.8590.7210.926
m5C-seq0.8520.8060.8270.6570.870
im7G-DCT0.8110.8970.8540.7110.925
FusDRM-m5C0.9000.9650.9330.8670.986

Comparison of FusDRM-m5C with the existing predictor on independent dataset.

The best experimental results are highlighted in bold.

Furthermore, an examination of the relative performance among existing methods reveals inherent limitations concerning either their feature extraction strategies or their underlying model architectures. For instance, methods like Deepm5C and m5C-Seq often exhibited only moderate AUC scores and comparatively low MCC values. This suggests a struggle in effectively capturing ambiguous sequence signals or, alternatively, in consistently generating robust predictions. Although im7G-DCT incorporated dual-channel transformations to enhance feature representation, its performance plateaued. This suggests that further modeling of contextual dependencies and hierarchical patterns may be necessary—areas where FusDRM-m5C offers specific advantages.

In summary, these comprehensive results suggest that FusDRM-m5C can achieve a high level of prediction performance with good generalization and a well-balanced output on the tested datasets. These strengths support its potential as a reliable tool for transcriptome-wide identification of m5C sites.

3.6 Cross-species performance of the FusDRM-m5C model

The purpose of this analysis was to assess the cross-species generalization performance of the FusDRM-m5C prediction tool. This assessment utilized the benchmark datasets described in the work of , which were constructed from the m5C-Atlas database (), with the specific distribution detailed in Table 7. These datasets, covering M. musculus, H. sapiens, D. melanogaster, and D. rerio, were processed to create balanced positive and negative samples, which were then split into distinct training and independent test sets. The models were trained on one species’ training dataset and evaluated on the independent test sets from all four species.

TABLE 7

SpeciesTrainingIndependent
PositiveNegativeAllPositiveNegativeAll
M. musculus8,4898,48916,9782,1222,1224,244
H. Sapiens65,54365,543131,08616,38616,38632,772
D. melanogaster3,0103,0106,0207527521,504
D. rerio4,8144,8149,6281,2041,2042,408

Distribution of the benchmark data set.

Table 8 highlights FusDRM-m5C’s superior intra-species predictive performance over existing methods. The heatmaps (Figure 6) further visualize this, with models trained and tested on the same species, which correspond to the diagonal elements, consistently yielding the highest ACC and MCC scores; for example, these values were 0.861/0.727 for M. musculus and 0.869/0.738 for D. rerio. Critically, FusDRM-m5C also demonstrates notable cross-species generalization, exemplified by a model trained on D. melanogaster achieving a remarkable ACC of 0.808 and an MCC of 0.626 when tested on D. rerio; this suggests the capture of deeply conserved m5C regulatory features or highly generalizable sequence patterns. Similarly, training on H. sapiens resulted in strong predictive power on M. musculus, achieving an ACC of 0.737 and an MCC of 0.476, which demonstrates effective knowledge transfer between these closely related mammals. However, performance varied across other species pairs; training on D. rerio and testing on H. sapiens, for instance, yielded lower scores with an ACC of 0.583 and an MCC of 0.190, a trend also observed when training on H. sapiens and testing on D. melanogaster, which produced an ACC of 0.608 and an MCC of 0.217. These observed discrepancies could stem from various factors, including differing evolutionary conservation of m5C motifs, variations in sequence context preferences, or even specific characteristics of the datasets employed. Nevertheless, the overall findings clearly highlight FusDRM-m5C’s capability to learn transferable features. This firmly positions it as a highly promising tool for m5C site prediction, particularly valuable in situations where species-specific data is scarce.

TABLE 8

DatasetsMethodSnSpACCMCCAUC
M. musculusm5C-seq0.7130.7010.7070.4130.765
m5CStack0.7220.7340.7280.457-
FusDRM-m5C0.9250.6790.8610.7270.940
H. sapiensm5C-seq0.6240.6120.6180.2360.658
m5CStack0.6220.6500.6310.262-
FusDRM-m5C0.7060.6210.6740.3500.741
D. reriom5C-seq0.7290.7600.7430.4870.799
m5CStack0.7780.7530.7650.531-
FusDRM-m5C0.8770.7190.8690.7380.943
D. melanogasterm5C-seq0.7610.7550.7580.5160.814
m5CStack0.7490.7980.7730.547-
FusDRM-m5C0.8360.5170.7810.5660.858

Comparison of FusDRM-m5C with the existing predictor on independent dataset.

The best experimental results are highlighted in bold.

FIGURE 6

3.7 Cross-species comparison of Sequence Motifs

Considering the substantial performance variations we observed, especially the pronounced variability and asymmetry in cross-species predictions, these findings prompted us to conduct a focused cross-species motif analysis. Our goal was to obtain more profound mechanistic insights and to elucidate the sequence features driving these discrepancies. To this end, we employed the STREME () tool from the MEME Suite () to perform a comparative motif analysis on sequences surrounding m5C sites across the different species. Figure 7 visually corroborates the potential basis for these performance discrepancies by revealing distinct m5C consensus motifs across the studied species. Notably, mammalian species, H. sapiens and M. musculus, exhibit predominantly G/C-rich motifs. H. sapiens displays a strong “CCCGGGC” consensus, while M. musculus shows a related but distinct “GCCCUGG” pattern. In stark contrast, D. melanogaster and D. rerio present pyrimidine-rich motifs, characterized by “UCCUCCA” and “CUCCA,” respectively. The distinct disparity between the G/C-rich motifs found in mammals and the U/C-rich motifs characteristic of non-mammalian species provides a strong rationale for the observed limited transferability of models across these taxonomic groups.

FIGURE 7

To more quantitatively assess these motif similarities, we performed a pairwise comparison of the consensus motifs discovered across species using the TOMTOM (; Tanaka et al., 2011) tool from the MEME Suite. The data presented in Table 9 provides strong statistical support for the performance discrepancies we observed. For instance, the motifs between the two mammalian species, H. sapiens and M. musculus, are not significantly similar (p = 0.217), which aligns with the asymmetric predictive performance between them. More strikingly, the motifs of the non-mammalian species D. rerio and D. melanogaster show significant similarity (p = 0.015), explaining the better cross-species prediction performance observed between them. Conversely, comparisons between mammalian and non-mammalian motifs (e.g., H. sapiens vs. D. rerio, p = 0.927) show high dissimilarity, which is consistent with the observed limited transferability of models across these taxonomic groups. Furthermore, even within these evolutionarily closer species, subtle variations in nucleotide composition and positional preferences—such as differences in G/C abundance or pyrimidine positioning—likely contribute to asymmetric predictive performance. The insights gained from these observations point to the possibility that m5C-associated enzymes likely target highly specific and evolutionarily constrained sequence contexts. These contexts, in turn, appear to be sculpted by both species-specific regulatory demands and prevailing selective pressures. Consequently, prediction models trained on one species may fail to fully capture the discriminative features required for accurate m5C site identification in another, emphasizing the need to account for interspecies variation when developing cross-species epitranscriptomic tools.

TABLE 9

SpeciesH. sapiensM. musculusD. rerioD. melanogaster
H. sapiensN/A0.2170.9270.927
M. musculus0.217N/A0.6580.466
D. rerio0.9270.658N/A0.015
D. melanogaster0.9270.4660.015N/A

Cross-species motif similarity comparison.

Tomtom similarity comparison p-values for m5C motifs across the four species. Lower p-values indicate greater similarity. Bold indicates statistical significance (p < 0.05); N/A denotes self-comparison.

3.8 Web server

To maximize the utility and accessibility of our FusDRM-m5C model, we have developed and deployed a user-friendly web server, freely available at https://complete-pretty-hog.ngrok-free.app. Our new online platform is set to considerably ease access for researchers, particularly those from experimental backgrounds who may not have extensive computational support or specialized expertise, to our powerful m5C prediction tools. To use it, simply paste your RNA sequences (in FASTA format) into the input box on the web interface, as Figure 8 demonstrates.

FIGURE 8

This platform supports two flexible input methods: users can either directly upload RNA sequence files in FASTA format or choose to paste the sequence data directly into the provided text box, with an option to “Load Example Data” for familiarization with the required input format. Upon sequence submission, the server promptly executes the FusDRM-m5C prediction pipeline, presenting the results directly within the “Prediction Results” area. For improved readability and easier interpretation, predicted m5C sites are clearly color-coded according to their confidence levels: green for High, yellow for Medium, and red for Low. The platform also incorporates convenient search and item management functionalities. Additionally, users may opt to provide an email address to receive a copy of their prediction results.

4 Conclusion

This study introduces FusDRM-m5C, a novel deep learning framework for the accurate prediction of m5C sites from RNA sequences. A core contribution of the work is its multi-branch architecture that effectively integrates three distinct feature types: one-hot encoding, Z-curve-based geometrical features, and secondary structure. By utilizing Dilated Convolutional Neural Networks and a Multi-Head Self-Attention mechanism within each branch, the model captures multi-scale patterns and weighs context-dependent information from each feature type. These distinct high-level representations are then integrated via concatenation before being fed into fully connected layers, demonstrating outstanding performance and high robustness in both cross-validation and independent testing. Building on this, the application of STREME for cross-species motif analysis not only corroborated the model’s predictive capabilities but, more importantly, uncovered both conserved and species-specific motifs around m5C sites. These findings provide crucial biological insights into the model’s variable generalization performance across species and illuminate potential evolutionary divergences in m5C regulation.

Despite its excellent performance, several limitations of FusDRM-m5C should be acknowledged. First, the cross-species analysis highlighted that its generalization capability is influenced by species-specific features, indicating that patterns learned from one species may not be fully transferable to distantly related ones. Second, the model was trained and evaluated on balanced datasets. This approach was intentionally chosen to prevent the model from developing a bias towards the vastly more abundant negative class of non-m5C sites, thereby forcing it to learn the distinguishing features of true positive sites. However, this method does not reflect the naturally occurring distribution of m5C sites, which is highly imbalanced. Consequently, the model’s performance metrics, particularly precision, might be overestimated when applied to whole-transcriptome screening, where the false positive rate could be a more significant concern. Third, the model’s predictive power is constrained by the availability and reliability of training data, a limitation that directly impacts its practical utility across diverse research scenarios. While the model may perform robustly on data-rich model organisms, such as human and mouse, its prediction confidence is substantially diminished when applied to species that lack high-quality, large-scale datasets. Lastly, the model currently relies on features derived from the primary sequence and predicted secondary structure. This reliance on external tools for secondary structure prediction is an inherent vulnerability, as inaccuracies from these tools can propagate through the model and introduce errors. Beyond this, the model does not yet incorporate other potentially influential biological information, such as RNA tertiary structure or evolutionary conservation scores, which may further limit its predictive precision.

Future research should be directed at addressing these limitations. To enhance cross-species predictive capability, future work could explore advanced transfer learning strategies or explicitly integrate phylogenetic information into the model architecture. To better simulate real-world applications and address the data imbalance issue, models should be developed or evaluated on imbalanced datasets, potentially using techniques like focal loss or cost-sensitive learning. This would also involve assessing the current model on large-scale transcriptomic sequences to more accurately gauge its practical utility and false-positive rate. Additionally, to address potential errors introduced by external RNA structure prediction tools, future models could incorporate end-to-end architectures that learn structural representations directly from the sequence, thereby reducing dependency on pre-computed predictions. Another promising direction is to enrich the feature set by incorporating multi-omics data, such as RBP binding sites and gene expression profiles, could create more powerful prediction models. Finally, the species-specific motifs identified in this study warrant experimental validation to confirm their roles in m5C regulation and deepen the understanding of the biological significance of this modification. By systematically addressing these points, future iterations of the model are expected to achieve superior predictive accuracy and broader applicability in transcriptome-wide methylation studies.

Statements

Data availability statement

Publicly available datasets were analyzed in this study. The data and code for this study are available at: https://github.com/hhui0/FusDRM-m5C-code.

Author contributions

HH: Data curation, Investigation, Methodology, Software, Writing – original draft, Writing – review and editing. FZ: Formal Analysis, Project administration, Funding acquisition, Writing – review and editing. JJ: Conceptualization, Resources, Methodology, Supervision, Writing – review and editing.

Funding

The authors declare that financial support was received for the research and/or publication of this article. This work was partially supported by the Scientific Research Plan of the Department of Education of Jiangxi Province, China (GJJ2400909, GJJ2402711). These funders had no role in the study design, data collection and analysis, decision to publish or preparation of the manuscript.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The authors declare that no Generative AI was used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Summary

Keywords

m5C site identification, multi-feature fusion, deep learning, dilated convolutional neural networks, multi-head self-attention

Citation

Huang H, Zhou F and Jia J (2025) FusDRM-m5C: a hybrid model for accurate prediction of 5-methylcytosine modification sites based on feature fusion and attention mechanism. Front. Genet. 16:1642286. doi: 10.3389/fgene.2025.1642286

Received

10 June 2025

Revised

02 November 2025

Accepted

03 November 2025

Published

01 December 2025

Volume

16 - 2025

Edited by

Yufeng Yuan, Dongguan University of Technology, China

Reviewed by

Xiaolei Zhu, Anhui Agricultural University, China

Yuanpeng Li, Guangxi Normal University, China

Yuki Kagaya, Purdue University, United States

Updates

Copyright

*Correspondence: Fenglin Zhou,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics