MSC-CSMC: A multi-objective semi-supervised clustering algorithm based on constraints selection and multi-source constraints for gene expression data

Abstract

Many clustering techniques have been proposed to group genes based on gene expression data. Among these methods, semi-supervised clustering techniques aim to improve clustering performance by incorporating supervisory information in the form of pairwise constraints. However, noisy constraints inevitably exist in the constraint set obtained on the practical unlabeled dataset, which degenerates the performance of semi-supervised clustering. Moreover, multiple information sources are not integrated into multi-source constraints to improve clustering quality. To this end, the research proposes a new multi-objective semi-supervised clustering algorithm based on constraints selection and multi-source constraints (MSC-CSMC) for unlabeled gene expression data. The proposed method first uses the gene expression data and the gene ontology (GO) that describes gene annotation information to form multi-source constraints. Then, the multi-source constraints are applied to the clustering by improving the constraint violation penalty weight in the semi-supervised clustering objective function. Furthermore, the constraints selection and cluster prototypes are put into the multi-objective evolutionary framework by adopting a mixed chromosome encoding strategy, which can select pairwise constraints suitable for clustering tasks through synergistic optimization to reduce the negative influence of noisy constraints. The proposed MSC-CSMC algorithm is testified using five benchmark gene expression datasets, and the results show that the proposed algorithm achieves superior performance.

1 Introduction

The rapid development of microarray technology has generated a large amount of gene expression data and mining the inherent patterns in the massive gene expression data is a major challenge in the current bioinformatics field (Bandyopadhyay et al., 2007; Pirooznia et al., 2008). As an important unsupervised data mining method, clustering has become a powerful tool for gene expression data analysis. One of the main tasks of gene expression data clustering is to identify co-expressed genomes, which is a useful tool for further research on gene function (Bandyopadhyay et al., 2007; Chen et al., 2019). Compared with the unsupervised clustering methods, the semi-supervised clustering methods use prior information to guide the clustering process through data labels or pairwise constraints, which can effectively improve the performance of clustering (Wagstaff et al., 2001; Bilenko et al., 2004; Yin et al., 2010).

For semi-supervised clustering algorithms, the pairwise constraints are usually used to describe if two data belong to the same cluster. Specifically, the must-link constraint (ML) means that two data must be divided into the same cluster, and the cannot-link constraint (CL) means that two data must be divided into different clusters. The quality of the selected pairwise constraints is of vital importance, which significantly affects the performance of semi-supervised clustering algorithms (Grira et al., 2008; Vu et al., 2012; Masud et al., 2019; Abin and Vu, 2020). The pairwise constraints can be generated by directly using part of the known data labels (Lai et al., 2021) or by using an active learning method (Masud et al., 2019). In practical, most gene expression data are unlabeled, for which it is impossible to obtain pairwise constraints based on labels. Vu et al. (2012) indicated that the generation of the pairwise constraints should mainly focus on the data samples on the cluster boundaries, which are more likely to be misclassified. To this end, Basu et al. (2004) developed a farthest-first traversal scheme-based active learning method to obtain pairwise constraints. However, this method has been reported to be sensitive to noise (Davidson and Qi, 2008). Grira et al. (2008) proposed an active learning method to generate pairwise constraints by determining cluster boundary data using membership obtained by fuzzy clustering. Vu et al. (2012) identified data in sparse regions based on k-nearest neighbor graphs and constructed pairwise constraints. However, it was claimed that some pairwise constraints might not be generated by this method (Abin and Vu, 2020). Liu et al. (2018) proposed an entropy-based query strategy to select the most uncertain pairwise constraints. Abin (2018) proposed a random walk approach on the adjacency graph of data for querying informative constraints. Masud et al. (2019) used local density estimation to identify the most informative objects as pairwise constraints. Abin and Vu (2020) proposed a density tracking method which takes into account the density relationship between data, and uses the information about boundaries and skeleton of clusters to generate the pairwise constraints.

Although the above methods can automatically mine and learn the pairwise constraints of unlabeled datasets through different approaches, there are inevitably noisy constraints, i.e., constraints inconsistent with the ground-truth clusters, in the obtained pairwise constraints (Yin et al., 2010; Lai et al., 2021). However, the existing semi-supervised clustering algorithms are mostly based on the assumption that pairwise constraints conform to real cluster information, and usually susceptible to noisy constraints. Therefore, it is necessary to implement constraints selection, where noisy constraints are filtered out, and only pairwise constraints that are beneficial for semi-supervised clustering are retained. In addition, most of the pairwise-constraints-based semi-supervised clustering algorithms were developed for single-source constraints, i.e., the pairwise constraints are obtained only from the data itself. In real-world applications, many data also possess related domain information. For example, Gene Ontology (GO) (Ashburner et al., 2000), which describes gene products in terms of their associated biological processes, cellular components and molecular functions, can further provide gene annotation information for gene expression data. In this paper, the multi-source constraints are the pairwise constraints formed by the data itself and domain information. Apparently, compared with the single-source pairwise constraints based solely on gene expression data, the multi-source constraints formed by the fusion of gene ontology can provide more comprehensive information about the structure of gene clusters and help to guide semi-supervised clustering to obtain more accurate clustering results.

Aiming at the unlabeled gene expression data and from the perspective of reducing the negative impact of noisy constraints and integrating multi-source constraints, a method called multi-objective semi-supervised clustering algorithm based on constraints selection and multi-source constraints (MSC-CSMC) is proposed in this research. At first, the proposed algorithm uses gene expression data and GO information to generate multi-source pairwise constraints. Then, under the multi-objective optimization framework of Non-dominated Sorting Genetic Algorithm-II (NSGA-II), the constraints selection and the cluster prototypes are collaboratively optimized to realize the selection of pairwise constraints suitable for clustering with respect to the multi-source constraints and to improve the accuracy of semi-supervised clustering of gene expression data by reducing the negative impact of noisy constraints.

2 Methods

In this section, the details of our proposed MSC-CSMC algorithm are described. Our proposed method consists of two parts. Firstly, multi-source pairwise constraints are generated by integrating gene expression and gene ontology (GO) information. Then, by using the improved penalty weights as well as mixed chromosome encoding strategy of cluster prototype and constraints selection, multi-objective semi-supervised clustering based on constraints selection and multi-source constraints is performed to identify co-expressed gene groups. The workflow of MSC-CSMC is shown in Figure 1.

FIGURE 1

2.1 Generation of multi-source pairwise constraints

Gene expression data and gene ontology (GO) describe gene-related information from the abundance of mRNA of genes and gene annotation. Compared with the method only using gene expression data, the combination of these two aspects of information can help to further improve the clustering accuracy of gene expression data (Giri and Saha, 2020; Li et al., 2022). In this paper, we use gene expression data and gene ontology information to generate multi-source pairwise constraints for semi-supervised clustering.

In view of the superior performance of the density tracking method (Abin and Vu, 2020), we use this method to generate the initial gene expression constraint set. The method consists of three steps: density estimation, density following, and constraints generation. Let denote a d-dimensional gene expression dataset with n genes. Gene x_i’s density is obtained bywhere N_b(x_i) is the set of b nearest genes of gene x_i; is the Euclidean distance. Based on the density in Formula 1, the density tracking method constructs density chains according to the density relationship between data. Specifically, starting from each gene x_i, the closest gene x_j ∈ N_b(x_i) whose density is greater than that of x_i is selected, and the relation between them is recorded as density chain x_i → x_j. Then start from gene x_j and continue the above density tracking until there exists no gene whose density is greater than that of the gene at the end of the chain. Consequently, the density chain Chains (x_i) can be denoted as x_i → x_j → ⋯ → x_e. After constructing all the density chains, the total times of gene x_i appearing in all the chains is referred to as centrality and denoted by Centrality (x_i). The sum of centrality with respect to all genes in a density chain is used as the centrality of the density chain. All density chains with a common endpoint are considered connected density chains and the points belonging to them are considered to be in the same density group. Besides, the impurity of gene x_i is defined as follows:with |Groups| being the total number of groups, S = {x_i ∪ N_b(x_i)}, Group(x_j) being the group index of x_j, being the indictor function.

FIGURE 2

For a set of genes to be analyzed, each gene can be annotated with several GO terms. Thus, the functional similarity between genes can be deduced based on the term similarity. In the proposed MSC-CSMC algorithm, we adopt the aggregate information content (AIC) (Song et al., 2014) to measure the semantic similarity of GO terms t₁ and t₂:withHere, T_t is the set of ancestors of term t in the GO graph, p(t) is the frequency of the term appearing in the GO database, IC(t) = − log  p(t) is the information content of term t. The higher the annotation frequency, the more general the information contained and the smaller the corresponding IC value. SW(t) normalizes the knowledge reflected by 1/IC(t), describing the semantic weight of term t. Consequently, the functional similarity of genes x_i and x_j can be obtained as follows:whereis the similarity of gene x_i and term t₂. ann(x_i) and ann(x_j) represent the sets of GO terms that annotate the two genes, respectively. The cardinalities of ann(x_i) and ann(x_j) are denoted by |ann(x_i)| and |ann(x_j)|, respectively.

The gene function similarity obtained through GO can also reflect the pairwise constraint relationship between genes to a certain extent. In the proposed MSC-CSMC algorithm, gene pairs with a similarity of more than 0.9 constitute the GO must-link constraint set , gene pairs with a similarity less than 0.1 constitute the GO cannot-link constraint set , and then generate the GO pairwise constraint set . Finally, the gene expression pairwise constraint set Ω and the gene ontology pairwise constraint set Ω* together constitute multi-source constraints for gene clustering.

2.2 Semi-supervised clustering objective functions based on multi-source constraints

At present, multi-objective optimization has gradually become a mainstream method for solving gene expression data clustering problems, which can achieve better clustering results on gene expression data compared with single-objective optimization methods. In the unsupervised multi-objective clustering problem of gene expression data, the cluster validity indices J_FCM (Bezdek et al., 1981) and XB (Xie and Beni, 1991), which measure the intra-cluster compactness and inter-cluster separation respectively, are commonly used as objective functions to realize the evolution of decision variables based on two conflicting objectives (Bandyopadhyay et al., 2007; Maulik et al., 2009; Mukhopadhyay et al., 2013; Li et al., 2022). In this paper, the proposed MSC-CSMC algorithm uses XB and the function based on quadratic-regularized fuzzy c-means with constraint violation penalty, namely, J_P (Mei, 2019), as the objective functions. Furthermore, the constraint violation penalty weights in J_P are improved to achieve semi-supervised clustering of gene expression data based on the multi-source constraints in the NSGA-II framework. The objective functions of XB and J_P are as follows:Here,is the cth cluster prototype. k is the number of clusters, parameters η and β control the level of fuzziness and the contribution of the penalty term during clustering, respectively. u_ic is the membership degree of the datum x_i belonging to the cth cluster, obtained bywhere w_ij ∈ W is the penalty weight for violating pairwise constraint . In order to simultaneously consider both the gene expression constraint set Ω = Ω_ML ∪ Ω_CL and gene ontology constraint set , that is, the multi-source constraints proposed in this paper, we improve the constraint violation penalty weights through the following analysis: (1) if pairwise constraint exists in both Ω_ML and , or in both Ω_CL and , it means that the same category information of gene pair can be obtained from gene expression and gene annotation, so the weight of violating this constraint should be increased; (2) if pairwise constraint exists in Ω_ML but not in , or exists in Ω_CL but not in , it indicates that the category information of gene pair is not clear enough, thus the penalty weight w_ij should be decreased; (3) if pairwise constraint exists in both Ω_ML and , or in both Ω_CL and , it should be regarded as a contradictory constraint and removed from the constraint sets Ω and Ω*. Based on the above idea, the MSC-CSMC algorithm proposed in this paper improves the constraint violation penalty weight as follows:with θ > 0 being the GO action parameter. It can be seen that the improved penalty weights can effectively integrate the gene expression and Gene Ontology information, and provide reasonable violation penalty for pairwise constraints in semi-supervised clustering.

2.3 Mixed chromosome encoding strategy used in MSC-CSMC

For the purpose of co-optimizing the constraints selection and clustering in the process of multi-objective evolution, a mixed encoding strategy combining the constraints selection and cluster prototype is adopted, as shown in Figure 3. Let P denote the genetic population, N be the population size, and s be the number of pairwise constraints to be selected. Considering the existence of noisy constraints in the initial pairwise constraint set and to improve the search efficiency of the algorithm, 2s constraints are randomly selected from the initial pairwise constraint set to generate the candidate constraint set Ω_p, and a serial number is assigned for each pairwise constraint. For a gene expression dataset with k clusters , the rth individual in the lth generation consists of two parts: the cluster prototype and the constraints selection . Among them, encode k cluster prototypes with real numbers, encode the serial numbers of s pairwise constraints selected from Ω_p with integers.

FIGURE 3

In the proposed algorithm, the two parts of the chromosomes are initialized separately. For the cluster prototype part, in order to ensure initialization quality and population diversity, half of the individuals are encoded as the k cluster prototypes obtained by the density peak method (Rodriguez and Laio, 2014), and the other half are encoded from the randomly generated cluster prototypes. For the constraints selection part of each individual, the components are initialized with non-repeated random integers in .

2.4 Genetic operations

In the genetic evolution process of the MSC-CSMC algorithm, the roulette wheel strategy is first used to implement the selection. Since the NSGA-II algorithm tends to select individuals with lower non-domination ranks, for the rth individual of the lth generation, the selection probability (Zhou and Zhu, 2018) is calculated as follows:Here, is the selection parameter, f_rank is the non-domination rank of individual .

For the parent individuals and , let the crossover probability be p_c, different crossover operators are used for the cluster prototypes and constraints selection. Among them, and generate offspring through the normal distribution crossover operator (Zhang and Luo, 2009), and the offspring cluster prototypes are:where is a random variable of normal distribution. The constraints selection and adopts the single-point crossover operator, for a random integer rand_c in , the offspring constraints selections are:If repeated pairwise constraints appear after crossover, non-repeated pairwise constraints are randomly selected from the candidate constraint set Ω_p as a replacement. For individual P_r(l), different mutation operators are adopted for the two parts. The polynomial mutation operator (Rousseeuw, 1987) is applied for , where site v_r,ci mutates with probability p_m:where, v_u and v_l are the upper and lower bounds of the cluster prototype, respectively. For normalized gene expression data, the bounds are set to 1 and 0. δ is determined as follows (Deb and Tiwari, 2008):Here, η_m is the distribution index, rand_m is a random number in . For , random mutation is used, that is, first randomly select a position in , and then replace its value with a random integer in that is not repeated with others. In summary, the procedure of the MSC-CSMC algorithm is shown as follows:

Output: The Pareto optimal solutions.

3 Results

3.1 Datasets

In this study, five benchmark gene expression datasets, namely, Yeast Galactose Metabolism, Yeast Cell Cycle, Yeast Sporulation, Serum, and Arabidopsis are used for the experiment.

The Yeast Galactose Metabolism dataset (Ideker et al., 2001) is composed of 205 genes whose expression patterns reflect four functional categories. The gene expression profiles were measured with four replicate assays across 20 time points. The Yeast Cell Cycle dataset (Cho et al., 1998) contains the expression levels of 384 genes involved in yeast cell cycle regulation at 17 time points, and these data are related with five phases of cell cycle. The Yeast sporulation dataset (Chu et al., 1998) contains the expression levels of more than 6,000 genes measured during the sporulation process of budding yeast across seven time points. The genes that showed no significant changes in expression during the harvesting were excluded, and the resulting set consists of 474 genes. The Serum dataset (Iyer et al., 1999) contains the expression levels of 517 human genes. The dataset has 13 dimensions corresponding to 12 time points and 1 unsynchronized sample. The Arabidopsis dataset (Reymond et al., 2000) consists of 138 Arabidopsis Thaliana genes. Each gene has eight expression values that correspond to eight time points. The details of the datasets are shown in Table 1.

3.2 Model evaluation criteria and parameter assignment

In order to evaluate the effectiveness of the model, the silhouette index (Rousseeuw, 1987) is chosen as the evaluation criterion for the clustering results. For gene x_i, the silhouette width is calculated as follows:Here, a(i) is the average distance from gene x_i to other genes in the same cluster, b(i) is the minimum average distance between gene x_i and genes in the other clusters. The silhouette index SI of dataset X is the mean value of the silhouette widths of all genes, with . A greater SI value represents the algorithm with better clustering quality. Besides, as suggested by (Saha and Bandyopadhyay, 2013), the final solution of MSC-CSMS is selected from Pareto optimal solutions by using the silhouette index.

According to (Mei, 2019) and (Abin and Vu, 2020), the parameters of MSC-CSMC are assigned as follows: ɛ = 0.8, b = 10, η = 0.001, β = 0.1, N = 100, L_max = 300, α = 0.3, η_m = 5, p_c = 0.8, p_m = 0.1. The number of pairwise constraints s is chosen as 0, 5, 10, 15, 20, and 25. In gene expression data analysis, the determination of the number of clusters k is an open problem. Generally, there are two approaches to determine the value of k; one is to directly set it as the true number of clusters (Yu et al., 2018; Zhao et al., 2021; Li et al., 2022; Liu et al., 2022; Wu and Ma, 2022); The other approach is applicable to the case where the true number of clusters is unknown, in which the variation range of k is determined firstly, and the k corresponding to the optimal value of an index (Silhouette index, Dunn index, Davies–Bouldin index, etc.) can be chosen as the optimal number of clusters (Gao et al., 2019; Acharya et al., 2020; López-Cortés et al., 2020; Zhang et al., 2022). In this paper, we adopt the first approach, and the number of clusters k is selected according to Table 1. In order to analyze the impact of the GO action parameter θ, we set θ from 0.1 to 0.9 at intervals of 0.1 under the condition that the number of the pairwise constraints is 15. The results are shown in Figure 4. It can be seen that the value of SI barely changes as θ increases, which means that the algorithm is not very sensitive to the value of θ. For Yeast Galactose Metabolism, Yeast Cell Cycle, Yeast Sporulation, Serum, and Arabidopsis, the θ values are respectively set to 0.4, 0.7, 0.6, 0.5, and 0.4, which lead to the optimal clustering performances.

FIGURE 4

3.3 Result analysis and model comparison

For the purpose of inspecting the performance of the proposed MSC-CSMC algorithm, several advanced semi-supervised clustering algorithms based on single-source constraints, including COP-Kmeans (Wagstaff et al., 2001), PCKMeans (Basu et al., 2004), MPCKMeans (Bilenko et al., 2004), PCCA (Grira et al., 2008), PCFCMq (Mei, 2019) and MSC-CS (Zhao and Li, 2022), are used for comparison. Among them, the MSC-CS algorithm is the single-source constrained version of MSC-CSMC, which does not consider the annotation information provided by GO. In the above algorithms, the pairwise constraints are randomly selected from the initial gene expression constraint set Ω. To avoid the influence of randomness, each method is run for ten times under the same number of pairwise constraints, and the mean value of the clustering results is taken as the final result. The SI values of all seven algorithms applied to five datasets are shown in Tables 2–6, the optimal solutions in each row are highlighted in bold.

According to Tables 2–6, it can be seen that the proposed MSC-CSMS algorithm and its single-source constraint version MSC-CS can always achieve optimal and suboptimal clustering results on five gene expression datasets, demonstrating the effectiveness of the constraints selection. The mixed chromosome encoding strategy combining the constraint selection and cluster prototype can find the pairwise constraints suitable for clustering in the co-evolution process and improve clustering accuracy, and the highly accurate clustering results can further improve the constraint selection ability of the algorithm in turn. Conversely, the algorithms for comparison are based on the assumption that the pairwise constraints conform to the real cluster information and are easily affected by noisy constraints. This is consistent with the analysis of the negative effects of noisy constraints by (Yin et al., 2010) and (Lai et al., 2021). In addition, the MSC-CSMC algorithm is better than MSC-CS in most cases, indicating that using multi-source constraints can improve the performance of semi-supervised clustering. The gene ontology used to generate multi-source pairwise constraints in our MSC-CSMC algorithm can explain gene expression profiles from the perspective of gene function. By effectively integrating the gene expression and Gene Ontology information, the proposed penalty weights can provide reasonable violation penalty for pairwise constraints.

In the case of s = 0, that is, there is no pairwise constraint, both MSC-CSMC and MSC-CS degenerate into unsupervised multi-objective clustering methods, turning out the same result. Compared with PCFCMq, which uses J_P as the single objective function, the better performance of MSC-CSMC and MSC-CS shows the advantages of using multi-objective optimization in clustering gene expression data.

Among the comparison algorithms, the performance of the PCFCMq algorithm, which is based on fuzzy clustering, is generally better than the hard clustering-based COP-Kmeans, PCKMeans, and MPCKMeans algorithms. According to (Gasch and Eisen, 2002), genes may be co-expressed with different genomes under different measurement conditions, and there is usually overlap between gene clusters. Therefore, compared with hard clustering algorithms, fuzzy clustering algorithms are more suitable for analyzing gene expression data. Furthermore, due to the proposed constraints selection and multi-source constraint fusion strategy, the MSC-CSMC algorithm achieves better clustering results than the PCFCMq algorithm. In terms of the robustness of the clustering results, the performances of semi-supervised clustering algorithms for comparison fluctuate with the increase of pairwise constraints, which is mainly due to the quality of randomly selected pairwise constraints. As stated by Lai et al. (2021), even non-noisy constraints that conform to the real cluster information may have a negative impact on the clustering results, which further illustrates the necessity of constraints selection in semi-supervised clustering algorithms. The proposed MSC-CSMC algorithm can select pairwise constraints suitable for clustering based on the co-evolution of the cluster prototype and constraints selection, which guarantees both accuracy and stability of the clustering results.

To illustrate the consistency of the gene clusters obtained by the MSC-CSMC algorithm, the Eisen plots and cluster profile plots corresponding to the clustering results of five datasets are shown in Figure 5 and Figure 6. In the Eisen plots, each row corresponds to a gene, each column to a time point (sample), and each entry of the plot represents the expression level of a gene at a specific time point by coloring the corresponding cell. To illustrate more clearly the gene clusters obtained by MSC-CSMC, the genes partitioned into the same cluster are placed together. In the cluster profile plots, the X- and Y-axis represent the time points and gene expression values, respectively. The expression values of genes partitioned into the same cluster are plotted in the same subplot. In the subplots, each green line indicates the normalized expression values of a gene over all time points, and the black line represents the mean expression level of the genes in the corresponding cluster. It can be seen in the Eisen plots that the color patterns (expression levels) of genes in the same cluster are similar to each other, while genes in different clusters show different color patterns. According to Figure 6, the cluster profiles of different clusters are different from each other, and the cluster profiles within a cluster reveal consistency.

FIGURE 5

FIGURE 6

In order to inspect the biological significance of the gene clusters obtained by the MSC-CSMC algorithm, enrichment analysis is carried out using the GO annotation database, which results in the significant GO terms shared by genes in each cluster and their corresponding p-values. Taking the case where the number of pairwise constraints in the Yeast Sporulation dataset is 15 as an example, we focus on the three most significant GO terms (corresponding to the three lowest p-values) in each of the six clusters obtained by each algorithm. Figure 7 shows the plot of the average p-values. To illustrate the difference significantly, the p-values are negative log-transformed and the clusters are sorted in descending order according to the transformed values. Table 7 reports the three most significant GO terms and the corresponding p-values in each cluster obtained by MSC-CSMC.

FIGURE 7

From Figure 7, it can be seen that the curve corresponding to MSC-CSMC is higher than those of the other algorithms, indicating that MSC-CSMC gains the result with the highest biological significance. Moreover, all the p-values of the significant GO terms listed in Table 7 are far less than 0.01, indicating that the MSC-CSMC algorithm can identify biologically relevant gene clusters.

4 Conclusion

Aiming at the problem that current semi-supervised clustering methods based on pairwise constraints are easily affected by noisy constraints and do not take the fusion of multi-source constraints into account, in this paper, we propose a multi-objective semi-supervised clustering algorithm based on constraints selection and multi-source constraints (MSC-CSMC). The proposed algorithm uses gene expression data and GO information to generate multi-source pairwise constraints and applies the multi-source constraints to the semi-supervised clustering process through improved constraint violation penalty weights. On this basis, a collaborative multi-objective optimization framework for constraints selection and cluster prototypes is constructed, and the negative impact of the noisy constraints is reduced by selecting pairwise constraints suitable for clustering. Experimental results on multiple gene expression datasets show that the MSC-CSMC algorithm effectively improves the performance of semi-supervised clustering. The validity of the proposed method proposed is not limited to the cluster analysis of gene expression data. Other semi-supervised clustering studies with multi-source information or constrained selection requirements can also be enlightened.

The effectiveness of the algorithm in this paper has been verified in small and medium-sized gene expression datasets. With the increase in the data size, the augment in the number of decision variables in the process of multi-objective evolution will lead to a decrease in algorithm efficiency and optimization performance. Therefore, the next step is to use decision variable analysis and other methods to design a multi-objective evolution strategy of the algorithm so as to further improve the applicability of the algorithm in practical clustering problems. In addition, we will also try to use various evaluation indices and design a multi-objective optimization framework with variable coding length (Rodríguez-Méndez et al., 2019) to optimize the number of clusters for gene expression data.

References

• 1

  AbinA. A. (2018). A random walk approach to query informative constraints for clustering. IEEE Trans. Cybern.48, 2272–2283. 10.1109/TCYB.2017.2731868

  • CrossRef
  • Google Scholar
  • View reference in article

• 2

  AbinA. A.VuV. (2020). A density-based approach for querying informative constraints for clustering. Expert Syst. Appl.161, 113690. 10.1016/j.eswa.2020.113690

  • CrossRef
  • Google Scholar
  • View reference in article

• 3

  AcharyaS.SahaS.PradhanP. (2020). Multi-factored gene-gene proximity measures exploiting biological knowledge extracted from gene ontology: Application in gene clustering. IEEE/ACM Trans. Comput. Biol. Bioinforma.17, 207–219. 10.1109/TCBB.2018.2849362

  • CrossRef
  • Google Scholar
  • View reference in article

• 4

  AshburnerM.BallC. A.BlakeJ. A.BotsteinD.ButlerH.CherryJ. M.et al (2000). Gene ontology: Tool for the unification of biology. The gene ontology consortium. Nat. Genet.25, 25–29. 10.1038/75556

  • CrossRef
  • Google Scholar
  • View reference in article

• 5

  BandyopadhyayS.MukhopadhyayA.MaulikU. (2007). An improved algorithm for clustering gene expression data. Bioinformatics23, 2859–2865. 10.1093/bioinformatics/btm418

  • CrossRef
  • Google Scholar
  • View reference in article

• 6

  BasuS.BanerjeeA.MooneyR. J. (2004). “Active semi-supervision for pairwise constrained clustering,” in Proceedings of the 2004 SIAM International Conference on Data Mining (Philadelphia, Pennsylvania: SIAM), 333–344. 10.1137/1.9781611972740.31

  • CrossRef
  • Google Scholar
  • View reference in article

• 7

  BezdekJ. C.CorayC.GundersonR.WatsonJ. (1981). Detection and characterization of cluster substructure i. linear structure: Fuzzy c-lines. SIAM J. Appl. Math.40, 339–357. 10.1137/0140029

  • CrossRef
  • Google Scholar
  • View reference in article

• 8

  BilenkoM.BasuS.MooneyR. J. (2004). “Integrating constraints and metric learning in semi-supervised clustering,” in Proceedings of the Twenty-First International Conference on Machine Learning (New York, NY, USA: Association for Computing Machinery), 11. 10.1145/1015330.1015360

  • CrossRef
  • Google Scholar
  • View reference in article

• 9

  ChenX.HuangJ. Z.WuQ.YangM. (2019). Subspace weighting co-clustering of gene expression data. IEEE/ACM Trans. Comput. Biol. Bioinforma.16, 352–364. 10.1109/TCBB.2017.2705686

  • CrossRef
  • Google Scholar
  • View reference in article

• 10

  ChoR. J.CampbellM. J.WinzelerE. A.SteinmetzL.ConwayA.WodickaL.et al (1998). A genome-wide transcriptional analysis of the mitotic cell cycle. Mol. Cell2, 65–73. 10.1016/s1097-2765(00)80114-8

  • CrossRef
  • Google Scholar
  • View reference in article

• 11

  ChuS.DeRisiJ.EisenM.MulhollandJ.BotsteinD.BrownP. O.et al (1998). The transcriptional program of sporulation in budding yeast. Science282, 699–705. 10.1126/science.282.5389.699

  • CrossRef
  • Google Scholar
  • View reference in article

• 12

  DavidsonI.QiZ. (2008). “Finding alternative clusterings using constraints,” in 2008 Eighth IEEE International Conference on Data Mining (Pisa, Italy: IEEE), 773–778. 10.1109/ICDM.2008.141

  • CrossRef
  • Google Scholar
  • View reference in article

• 13

  DebK.TiwariS. (2008). Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization. Eur. J. Operational Res.185, 1062–1087. 10.1016/j.ejor.2006.06.042

  • CrossRef
  • Google Scholar
  • View reference in article

• 14

  GaoY.ZhouX.ZhangW. (2019). An ensemble strategy to predict prognosis in ovarian cancer based on gene modules. Front. Genet.10, 366. 10.3389/fgene.2019.00366

  • CrossRef
  • Google Scholar
  • View reference in article

• 15

  GaschA. P.EisenM. B. (2002). Exploring the conditional coregulation of yeast gene expression through fuzzy k-means clustering. Genome Biol.3, RESEARCH0059–22. 10.1186/gb-2002-3-11-research0059

  • CrossRef
  • Google Scholar
  • View reference in article

• 16

  GiriS. J.SahaS. (2020). “Multi-view gene clustering using gene ontology and expression-based similarities,” in 2020 IEEE Congress on Evolutionary Computation (CEC) (Glasgow, UK: IEEE), 1–8. 10.1109/CEC48606.2020.9185885

  • CrossRef
  • Google Scholar
  • View reference in article

• 17

  GriraN.CrucianuM.BoujemaaN. (2008). Active semi-supervised fuzzy clustering. Pattern Recognit.41, 1834–1844. 10.1016/j.patcog.2007.10.004

  • CrossRef
  • Google Scholar
  • View reference in article

• 18

  IdekerT.ThorssonV.RanishJ. A.ChristmasR.BuhlerJ.EngJ. K.et al (2001). Integrated genomic and proteomic analyses of a systematically perturbed metabolic network. Science292, 929–934. 10.1126/science.292.5518.929

  • CrossRef
  • Google Scholar
  • View reference in article

• 19

  IyerV. R.EisenM. B.RossD. T.SchulerG.MooreT.LeeJ. C.et al (1999). The transcriptional program in the response of human fibroblasts to serum. Science283, 83–87. 10.1126/science.283.5398.83

  • CrossRef
  • Google Scholar
  • View reference in article

• 20

  LaiY.HeS.LinZ.YangF.ZhouQ.ZhouX. (2021). An adaptive robust semi-supervised clustering framework using weighted consensus of random k k-means ensemble. IEEE Trans. Knowl. Data Eng.33, 1877–1890.

  • Google Scholar
  • View reference in article

• 21

  LiD.GuH.ChangQ.WangJ.QinP. (2022). A joint optimization framework integrated with biological knowledge for clustering incomplete gene expression data. Soft Comput.2022, 1–18. 10.1007/s00500-022-07180-y

  • CrossRef
  • Google Scholar
  • View reference in article

• 22

  LiuY.LiH.XuY.LiuY.PengX.WangJ. (2022). Isocell: An approach to enhance single cell clustering by integrating isoform-level expression through orthogonal projection. IEEE/ACM Trans. Comput. Biol. Bioinforma.20, 1–475. 10.1109/TCBB.2022.3147193

  • CrossRef
  • Google Scholar
  • View reference in article

• 23

  LiuY.LiuK.ZhangC.WangX.WangS.XiaoZ. (2018). Entropy-based active sparse subspace clustering. Multimedia Tools Appl.77, 22281–22297. 10.1007/s11042-018-5945-1

  • CrossRef
  • Google Scholar
  • View reference in article

• 24

  López-CortésX. A.MatamalaF.MaldonadoC.Mora-PobleteF.ScapimC. A. (2020). A deep learning approach to population structure inference in inbred lines of maize. Front. Genet.11, 543459. 10.3389/fgene.2020.543459

  • CrossRef
  • Google Scholar
  • View reference in article

• 25

  MasudM. A.HuangJ. Z.ZhongM.FuX. (2019). Generate pairwise constraints from unlabeled data for semi-supervised clustering. Data and Knowl. Eng.123, 101715. 10.1016/j.datak.2019.101715

  • CrossRef
  • Google Scholar
  • View reference in article

• 26

  MaulikU.MukhopadhyayA.BandyopadhyayS. (2009). Combining pareto-optimal clusters using supervised learning for identifying co-expressed genes. BMC Bioinforma.10, 27–16. 10.1186/1471-2105-10-27

  • CrossRef
  • Google Scholar
  • View reference in article

• 27

  MeiJ. (2019). Semisupervised fuzzy clustering with partition information of subsets. IEEE Trans. Fuzzy Syst.27, 1726–1737. 10.1109/tfuzz.2018.2889010

  • CrossRef
  • Google Scholar
  • View reference in article

• 28

  MukhopadhyayA.MaulikU.BandyopadhyayS. (2013). An interactive approach to multiobjective clustering of gene expression patterns. IEEE Trans. Biomed. Eng.60, 35–41. 10.1109/TBME.2012.2220765

  • CrossRef
  • Google Scholar
  • View reference in article

• 29

  PiroozniaM.YangJ. Y.YangM. Q.DengY. (2008). A comparative study of different machine learning methods on microarray gene expression data. BMC Genomics9, S13–S13. 10.1186/1471-2164-9-S1-S13

  • CrossRef
  • Google Scholar
  • View reference in article

• 30

  ReymondP.WeberH.DamondM.FarmerE. E. (2000). Differential gene expression in response to mechanical wounding and insect feeding in arabidopsis. Plant Cell12, 707–720. 10.1105/tpc.12.5.707

  • CrossRef
  • Google Scholar
  • View reference in article

• 31

  RodriguezA.LaioA. (2014). Machine learning. Clustering by fast search and find of density peaks. Science344, 1492–1496. 10.1126/science.1242072

  • CrossRef
  • Google Scholar
  • View reference in article

• 32

  Rodríguez-MéndezI. A.UreñaR.Herrera-ViedmaE. (2019). Fuzzy clustering approach for brain tumor tissue segmentation in magnetic resonance images. Soft Comput.23, 10105–10117. 10.1007/s00500-018-3565-3

  • CrossRef
  • Google Scholar
  • View reference in article

• 33

  RousseeuwP. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math.20, 53–65. 10.1016/0377-0427(87)90125-7

  • CrossRef
  • Google Scholar
  • View reference in article

• 34

  SahaS.BandyopadhyayS. (2013). A generalized automatic clustering algorithm in a multiobjective framework. Appl. Soft Comput.13, 89–108. 10.1016/j.asoc.2012.08.005

  • CrossRef
  • Google Scholar
  • View reference in article

• 35

  SongX.LiL.SrimaniP. K.PhilipS. Y.WangJ. Z. (2014). Measure the semantic similarity of go terms using aggregate information content. IEEE/ACM Trans. Comput. Biol. Bioinforma.11, 468–476. 10.1109/TCBB.2013.176

  • CrossRef
  • Google Scholar
  • View reference in article

• 36

  VuV.LabrocheN.Bouchon-MeunierB. (2012). Improving constrained clustering with active query selection. Pattern Recognit.45, 1749–1758. 10.1016/j.patcog.2011.10.016

  • CrossRef
  • Google Scholar
  • View reference in article

• 37

  WagstaffK.CardieC.RogersS.SchrödlS. (2001). “Constrained k-means clustering with background knowledge,” in Proceedings of the Eighteenth International Conference on Machine Learning (Burlington, MA, USA: Morgan Kaufmann Publishers Inc.), 577–584. 10.5555/645530.655669

  • CrossRef
  • Google Scholar
  • View reference in article

• 38

  WuW.MaX. (2022). Network-based structural learning nonnegative matrix factorization algorithm for clustering of scrna-seq data. IEEE/ACM Trans. Comput. Biol. Bioinforma.20, 1–575. 10.1109/TCBB.2022.3161131

  • CrossRef
  • Google Scholar
  • View reference in article

• 39

  XieX. L.BeniG. (1991). A validity measure for fuzzy clustering. IEEE Trans. Pattern Analysis Mach. Intell.13, 841–847. 10.1109/34.85677

  • CrossRef
  • Google Scholar
  • View reference in article

• 40

  YinX.ChenS.HuE.ZhangD. (2010). Semi-supervised clustering with metric learning: An adaptive kernel method. Pattern Recognit.43, 1320–1333. 10.1016/j.patcog.2009.11.005

  • CrossRef
  • Google Scholar
  • View reference in article

• 41

  YuZ.LuoP.LiuJ.WongH.YouJ.HanG.et al (2018). Semi-supervised ensemble clustering based on selected constraint projection. IEEE Trans. Knowl. Data Eng.30, 2394–2407. 10.1109/tkde.2018.2818729

  • CrossRef
  • Google Scholar
  • View reference in article

• 42

  ZhangG.PengZ.YanC.WangJ.LuoJ.LuoH. (2022). Multigatae: A novel cancer subtype identification method based on multi-omics and attention mechanism. Front. Genet.13, 855629. 10.3389/fgene.2022.855629

  • CrossRef
  • Google Scholar
  • View reference in article

• 43

  ZhangM.LuoW. J.WangX. F. (2009). A normal distribution crossover for epsilon-moea. J. Softw.20, 305–314. 10.3724/sp.j.1001.2009.00305

  • CrossRef
  • Google Scholar
  • View reference in article

• 44

  ZhaoM.LiD. (2022). “Multi-objective semi-supervised clustering algorithm based on constraint set optimization for gene expression data,” in 2022 41st Chinese Control Conference (CCC) (Hefei, China: IEEE), 6570–6575. 10.23919/CCC55666.2022.9902131

  • CrossRef
  • Google Scholar
  • View reference in article

• 45

  ZhaoY.FangZ.LinC.DengC.XuY.LiH. (2021). Rfcell: A gene selection approach for scrna-seq clustering based on permutation and random forest. Front. Genet.27, 665843. 10.3389/fgene.2021.665843

  • CrossRef
  • Google Scholar
  • View reference in article

• 46

  ZhouZ.ZhuS. (2018). Kernel-based multiobjective clustering algorithm with automatic attribute weighting. Soft Comput.22, 3685–3709. 10.1007/s00500-017-2590-y

  • CrossRef
  • Google Scholar
  • View reference in article