Abstract
We present Clustering and Lineage Inference in Single-Cell Transcriptional Analysis (CALISTA), a numerically efficient and highly scalable toolbox for an end-to-end analysis of single-cell transcriptomic profiles. CALISTA includes four essential single-cell analyses for cell differentiation studies, including single-cell clustering, reconstruction of cell lineage specification, transition gene identification, and cell pseudotime ordering, which can be applied individually or in a pipeline. In these analyses, we employ a likelihood-based approach where single-cell mRNA counts are described by a probabilistic distribution function associated with stochastic gene transcriptional bursts and random technical dropout events. We illustrate the efficacy of CALISTA using single-cell gene expression datasets from different single-cell transcriptional profiling technologies and from a few hundreds to tens of thousands of cells. CALISTA is freely available on https://www.cabselab.com/calista.
Introduction
The differentiation of stem cells into multiple cell types relies on the dynamic regulation of gene expression (Ralston and Shaw, ). In this regard, advances in single-cell gene transcriptional profiling technology have given a tremendous boost in elucidating the decision making process governing stem cell commitment to different cell fates (Kalisky et al., ). The applications of single-cell transcriptional analysis have led to new insights on the functional role of cell-to-cell gene expression heterogeneity in the physiological cell differentiation process (Guo et al., ; Kumar et al., ; Cacchiarelli et al., ; Reinius et al., ; Richard et al., ). Along with the surge in single-cell transcriptional profiling studies, algorithms for analyzing single-cell transcriptomics data have received increasing attention. In comparison to measurements from aggregate or bulk samples of cell population, single-cell gene expression profiles display much higher variability, not only due to technical reasons, but also because of the intrinsic stochastic (bursty) dynamics of the gene transcriptional process (Kærn et al., ). In particular, the stochastic gene transcription has been shown to generate highly non-Gaussian mRNA count distributions (Raj et al., ), which complicate data analysis using established methods that rely on a standard noise distribution model (e.g., Gaussian or Student's t-distribution).
Numerous algorithms have recently been developed specifically for the analysis of single-cell gene expression data. A class of these computational algorithms is geared toward identifying cell groups or clusters within a heterogeneous cell population. Traditional clustering algorithms such as k-means and hierarchical clustering have been applied for such a purpose (Grün et al., ; Treutlein et al., 2016; Stumpf et al., 2017). Several other single-cell clustering strategies, such as CIDR (Lin et al., ), pcaREDUCE (Žurauskiene and Yau, 2016) and SNN-cliq (Xu and Su, 2015), adapt more advanced algorithms such as nearest neighbors search. Time-variant clustering strategies have also been implemented to elucidate the appearance of multiple cell lineages (Huang et al., ; Marco et al., ). In addition, consensus clustering methods, such as SC3 (Kiselev et al., ), have received much interest thanks to their superior stability and robustness. Finally, a likelihood-based method called Simulated Annealing for Bursty Expression Clustering (SABEC) (Ezer et al., ) employs a mechanistic model of the bursty stochastic dynamics of gene transcriptional process to cluster cells.
Another important class of algorithms deals with the reconstruction of lineage progression during cell differentiation process and the pseudotemporal ordering of single cells along the cell developmental path(s). The lineage progression describes the transition of stem cells through one or several developmental stages during the cell differentiation. This progression may comprise a single developmental path from the progenitor cells to one final cell fate, as well as bifurcating paths leading to multiple cell fates. In this class of algorithms, the reconstruction of the lineage progression and developmental paths is commonly implemented for the purpose of pseudotemporal cell ordering. The pseudotime of a cell represents the relative position of the cell along the developmental path and is typically normalized to be between 0 and 1. By plotting the gene expression against the pseudotime of the cells along a developmental path, one obtains a dynamic trajectory of the gene expression based on which the gene regulations driving the cell fate decision-making can be inferred. Numerous algorithms are available for single-cell transcriptional data analysis for cell lineage inference and cell ordering, notably DPT (Haghverdi et al., ), MONOCLE 2 (Trapnell et al., 2014; Qiu et al., ), and PAGA ((Wolf et al., 2019); for a more complete list, see a recent review by Cannoodt et al. ().
In this work, we developed Clustering and Lineage Inference in Single Cell Transcriptional Analysis (CALISTA), a numerically efficient and highly scalable toolbox for an end-to-end analysis of single-cell transcriptomics data. CALISTA is capable of and has been tested for analyzing datasets from major single-cell transcriptional profiling technologies, including scRT-qPCR and scRNA-sequencing with both plate-based (e.g., SMART-seq) and droplet-based platforms (scDrop-seq). CALISTA enables four essential analyses of single-cell transcriptomics in stem cell differentiation studies, namely single-cell clustering, reconstruction of lineage progression, transition gene identification and cell pseudotime ordering. In existing literature, these analyses are typically carried out by stringing several task-specific tools together in a bioinformatics pipeline. But, the basic assumptions behind different tools (e.g., regarding the distribution of data noise) maybe incompatible, an issue that has not been delved into more carefully in the literature. In contrast, the different analyses in CALISTA are fully compatible with each other as they are based on the same likelihood-based approach using probabilistic models of gene transcriptional bursts and random dropout events.
In the next section, we describe the algorithmic aspects and functionalities of CALISTA. The single-cell clustering of CALISTA is adapted from a previous method SABEC with a significant improvement in computational times, while the remaining CALISTA analyses represent novel contributions. For this reason, we focus the performance evaluation of CALISTA on lineage inference and cell pseudotime ordering, and compare CALISTA with widely-used bioinformatics packages including MONOCLE2 (Trapnell et al., 2014; Qiu et al., ) and SCANPY (Wolf et al., 2018). Subsequently, we illustrate CALISTA's end-to-end analysis using single-cell transcriptional profiles from the differentiation of human induced pluripotent stem cells (iPSCs) into mesodermal (M) or undesired endodermal (En) cells (Bargaje et al., ). Finally, we demonstrate the scalability of CALISTA in analyzing large datasets from scDrop-seq studies.
Results
Single-Cell Transcriptional Analysis Using CALISTA
Figure 1 summarizes the four analyses of single-cell transcriptional profiles in CALISTA, including: (1) clustering of cells, (2) reconstruction of cell lineage progression, (3) identification of key transition genes, and (4) pseudotemporal ordering of cells. In CALISTA, we adopt a likelihood-based approach where the likelihood of a cell is computed using a probability distribution of mRNA defined according to the two-state model of gene transcriptional process (Peccoud and Ycart, ) and when appropriate, a random dropout event model (see section Methods). A random dropout occurs when mRNA molecules of a gene are not detected even though the true mRNA count is non-zero. The single-cell clustering in CALISTA is an adaptation of the algorithm SABEC (Ezer et al., ), where the single-cell clustering is carried out in two steps as illustrated in Figure 1b: (1) independent runs of maximum likelihood clustering, and (2) consensus clustering. SABEC has a high computational requirement due to the implementation of simulated annealing in the maximum likelihood step. This requirement prohibits the application of SABEC to large scRNA datasets with >10 K cells, such as from scDrop-Seq. CALISTA offers a substantial numerical speed-up over SABEC thanks to the implementation of a greedy algorithm and the reduction in the model parameter space (see Supplementary Note S1 and Supplementary Table S1). CALISTA offers a parallel computing option which enables running the analysis over multiple computing cores for further speed-up.
Figure 1
The rest of the single-cell analyses in CALISTA represent new contributions of this work. For reconstructing cell lineage progression, we treat single-cell clusters as cell states through which stem cells transition during the cell differentiation. Here, CALISTA allows the calculation of distances between any pair of cell clusters. The cluster distance—defined as the maximum difference in the cumulative likelihood value upon reassigning the cells from the original cluster to the other cluster (see section Methods)—gives a measure of dissimilarity in their gene expression distributions between any two clusters. CALISTA generates the lineage progression graph by sequentially adding state transition edges connecting closely distanced clusters until every cell cluster is connected to at least another cluster (Figure 1c). CALISTA also provides an interface for users to edit the lineage progression graph, i.e., adding or removing state transition edges, based on the cluster distances and other available information about the cell differentiation. For assigning directionality to the edges, CALISTA relies on user-provided information, for example information on the cell stage or sampling time, the starter/progenitor cells or the expected temporal profiles of the expression of marker genes. CALISTA also allows multiple initial clusters.
For any two connected clusters in the lineage progression, one can further use CALISTA to obtain the set of transition genes. The transition genes are determined based on the differences of the likelihood between having the cells in separate clusters and having them together in a single cluster (see section Methods). Here, the likelihood difference corresponding to a gene reflects the informative power of that gene for segregating cells into two clusters. The transition genes may point to candidate gene markers and genes regulating the state transition during differentiation. SABEC also allows the determination of transition genes, but using a different strategy, called Estimation of Pairwise changes in Kinetics (EPiK), that is based on the statistical significance of the difference in the two-state model parameters between any two clusters.
The final component of CALISTA concerns with the pseudotemporal ordering of cells along a developmental path—defined as a sequence of connected clusters—in the lineage progression graph (Figure 1d). More specifically, given a developmental path in the reconstructed lineage progression, CALISTA produces a list of the cells ordered in increasing pseudotimes. For this purpose, we first assign a pseudotime to each cluster, which is normalized such that the starting cluster in the lineage progression graph has a pseudotime of 0 and the final cell cluster (or clusters) has a pseudotime of 1. Subsequently, we assign each cell to a transition edge that is pointing to or emanating from the cluster to which the cell belongs, again by adopting the maximum likelihood principle (see section Methods). Here, we assume that the distribution of the single-cell gene expression varies monotonically between cell states (clusters). For simplicity, the likelihood of a cell along a transition edge is computed using a linear interpolation of the cell likelihood values from the connected clusters. Each cell is then assigned to the transition edge that maximizes its likelihood value. Analogously, the cell pseudotime is computed by a linear interpolation of the cluster pseudotimes and set to the corresponding maximum point of the cell likelihood value.
Comparison of CALISTA Performance With Other Methods
We compared the performance of CALISTA with two widely-used single-cell bioinformatics packages for lineage inference and pseudotime cell ordering: MONOCLE 2 (Qiu et al., ) and SCANPY (Wolf et al., 2018). More specifically, in SCANPY package, we used Partition-based Graph Abstraction (PAGA) for lineage progression inference (Wolf et al., 2019) and Diffusion Pseudotime (DPT) for pseudotime cell ordering (Haghverdi et al., ).
In the first comparison, we generated in silico single-cell expression data of the cell differentiation of central nervous system (CNS) using a stochastic differential equation (SDE) model proposed by Qiu et al. (). We simulated single-cell data for 9 time points and 200 cells per time point, totaling 1,800 cells (see section Methods). As shown in Figure 2A, the simulated single-cell data clearly display two cell lineage bifurcations, as expected in this cell differentiation system (Qiu et al., , ): (1) CNS precursors (pCNSs) differentiating into neurons and glia cells; (2) glia cells differentiating into astrocytes and oligodendrocytes (ODCs). Figures 2B–D show the reconstructed lineage progressions produced by MONOCLE 2, PAGA, and CALISTA, respectively. PAGA produced the most inaccurate lineage, deviating significantly from the expected lineage (Figure 2C vs. Figure 2A). MONOCLE 2 performed better than PAGA, producing a lineage progression that is in general agreement with the in silico lineage graph. But, looking at MONOCLE 2's lineage more carefully, the method identified many more bifurcation or branching points than expected (13 vs. 2). CALISTA outperformed both MONOCLE 2 and PAGA, generating a lineage progression that agrees very well with the in silico lineage.
Figure 2
Figures 2E,F depict the pseudotemporal cell ordering for the simulated CNS single-cell expression produced by MONOCLE2, DPT, and CALISTA, respectively. Besides visual comparisons of the pseudotemporal ordering, we also computed the correlations between the pseudotimes from each of the methods and the in silico times of the cells, i.e., the simulation times at which the single-cell mRNA data were sampled (see Supplementary Table S2). Among the three algorithms compared, CALISTA's pseudotimes have the highest correlation with the in silico cell times (correlation ρ of 0.856), followed by DPT (ρ = 0.769) and lastly MONOCLE 2 (ρ = 0.571). The cell orderings in Figures 2E–G further confirm the advantage of CALISTA over the other methods.
We further evaluated CALISTA's performance using four single-cell gene transcriptional datasets from cell differentiation systems with a variety of lineage topologies, including Bargaje et al. study on the differentiation of human induced pluripotent stem cells (iPSC) into cardiomyocytes (Bargaje et al.,
Figure 3

Comparison of lineage progressions reconstructed from single-cell transcriptional profiles by MONOCLE 2, PAGA, and CALISTA. (Top row) Induced pluripotent stem cell (iPSC) differentiation into cardiomyocytes in Bargaje et al. study (Bargaje et al.,
Figure 4

Comparison of pseudotemporal cell ordering using single-cell transcriptional profiles by MONOCLE 2, DPT, and CALISTA. (Top row) Induced pluripotent stem cell (iPSC) differentiation into cardiomyocytes in Bargaje et al. study (Bargaje et al.,
Application to the Differentiation of Induced Pluripotent Stem Cells to Cardiomyocytes
In the following, we demonstrated an end-to-end analysis of single-cell gene expression data using CALISTA. Here, we used the single-cell gene expression dataset from the differentiation of human iPSCs into cardiomyocytes in Bargaje et al. study (Bargaje et al.,
Figure 5

End-to-end analysis of single-cell transcriptional profiles during iPSC differentiation into cardiomyocytes. The single-cell gene expression dataset was taken from the study of Bargaje et al. (
First, we clustered the cells by using CALISTA. The optimal number of clusters was chosen to be five based on the eigengap plot (see Supplementary Figure S1). The single-cell clustering of CALISTA, as shown in Figure 5B, recapitulates the previously identified developmental states. Here, clusters 1, 2, and 5 contain mostly E, PS, and En cells, respectively, while M cells are split between clusters 3 and 4 that are demarcated by different capture times (see cluster compositions in Supplementary Figure S2).
After single-cell clustering, we employed CALISTA to infer the lineage progression graph. The cluster pseudotimes were set to the modes (most frequent values) of the cell capture times in the clusters divided by the maximum cell capture time (see Supplementary Figure S3). The directionality of the state transition edges was set according to the cluster pseudotimes, pointing from a cluster with a lower pseudotime to that with a higher pseudotime. As shown in Figure 5C, the lineage progression graph reconstructed by CALISTA reproduces the lineage bifurcation event as the cells transition from PS-like cells to take on either M or En cell fates (Bargaje et al.,
Finally, we employed CALISTA to generate the pseudotemporal ordering of cells along the two distinct developmental paths in the lineage progression: (1) the M path forming mesodermal cells (cluster 1–2–3–4; see red dashed path in Figure 5D) and (2) the En path forming endodermal cells (cluster 1–2–5; see green dashed path in Figure 5D). After assigning cells to the state transition edges and prescribing the cell pseudotimes, we ordered cells belonging to each developmental trajectory in increasing pseudotimes with a total of 1,408 cells in the M path and 1,215 cells in the En path.
The likelihood value of each cell computed during the pseudotemporal cell ordering can further be visualized as a landscape plot. Figure 5E depicts the negative log-likelihood surface of the cells over the first two principal components. A higher value on the surface indicates a cell state with broader mRNA distributions, i.e., a state of higher uncertainty in the gene expression. As shown in Figure 5E, iPSC cells start their journey from a valley in this surface, implying that the progenitor cells are at a low uncertainty state. As the cell differentiation progresses, cells pass through an intermediate state with higher uncertainty, where a peak uncertainty is reached at or around the cell lineage bifurcation. After the bifurcation, cells follow two paths toward lower uncertainty, leading to two valleys corresponding to distinct cell fates (M and En fates). The rise-and-fall in gene expression uncertainty have also been reported in other cell differentiation systems, suggesting that stem cells go through a transition state of high uncertainty before committing to their final cell fate(s) (Richard et al.,
To visualize the gene expression trajectories along the two cell differentiation paths, we calculated the moving average expression values of transition genes for the pseudotemporally ordered cells using a moving window comprising 10% of the total cells in each path (see Figures 5F–H and Supplementary Figure S5). A number of transition genes follow highly similar expression trajectories along the M and En paths, with an increase in expression from E to PS-like state, followed by a decrease in expression from PS-like to M or En state (see Figure 5F). The majority of genes with the aforementioned trajectory are known PS-like markers [for example EOMES, GSC, MESP1, and MIXL1; (Ng et al.,
Finally, we constructed gene co-expression networks for the M and En developmental paths based on the pseudotemporal profiles of the gene expression (pairwise Pearson correlation, p ≤ 0.01 and correlation value ≥ 0.8, see Supplementary Figure S6). We identified cliques in the M and En gene co-expression networks, i.e., a subset of genes (at least 5) that are connected to each other, using a maximal clique analysis by the Bron-Kerbosch algorithm (Bron and Kerbosch,
Application of CALISTA to Massively Parallel Drop-Seq Datasets
To demonstrate the scalability of CALISTA, we analyzed single-cell expression datasets from droplet-based assays. Single-cell Drop-seq is a massively parallel genome-wide expression profiling technology capable of analyzing thousands of cells in a single experiment. However, the bioinformatic analysis of large single-cell transcriptomics datasets poses a significant computational challenge (Angerer et al.,
We first tested the single-cell clustering performance of CALISTA in analyzing Drop-seq datasets using the single-cell study of mouse spinal cord neurons by Sathyamurthy et al. (
We then tested CALISTA's lineage progression reconstruction on scDrop-seq data of ~38K cells, taken from 12 developmental stages of zebrafish embryogenesis (Farrell et al.,
Figure 6

Analysis of single-cell Drop-seq gene expression data of zebrafish embryogenesis (Farrell et al.,
Discussion
CALISTA provides four bioinformatic analyses for single-cell expression data that are essential in studies of stem cell differentiation. The analyses can be implemented either sequentially in a data analytics pipeline or separately in a standalone application. Throughout the development of the analyses in CALISTA, we used the same likelihood approach based on the two-state stochastic gene transcriptional model. Thus, the analyses are fully compatible with each other. The use of a mechanistic model in CALISTA brings an additional advantage, because the model parameters have relevance to the mechanism of gene transcription process and thus can provide insights into the gene regulations during stem cell differentiation. To the best of our knowledge, CALISTA is the first mechanistic model-based toolbox that allows an end-to-end analysis of single-cell transcriptional profiles. Despite the focus on stem cells in our work, each of the tools in CALISTA is agnostic to the source of the single-cell transcriptomic data analysis and thus can be used for other studies.
CALISTA's single-cell clustering analysis is an adaptation of another method called SABEC (Ezer et al.,
30696980example in setting the number of cell clusters or during the curation of the lineage progression graph (see CALISTA tutorials on https://www.cabselab.com/calista). The user interface enables incorporating existing biological knowledge of the cell differentiation system, which is often difficult—if not impossible—to codify. Although such prior knowledge is not necessary for using CALISTA, the ability to incorporate this knowledge, whenever available, is a useful and important feature in the analysis of single-cell transcriptional profiles.
Obviously, the transcriptome only provides one aspect of the cell phenotype. Besides single-cell transcriptomic profiling, single-cell sequencing technology have enabled other types of molecular profiling at the single cell level, such as the genome and epigenome. Integrating gene expression with other single-cell profiling data is an area of active interest for algorithmic development (Stuart and Satija, 2019). A few notable examples of recent algorithms include those for the integration of scRNA-seq data and single-cell data of DNA accessibility from ATAC-seq (Duren et al.,
Methods
Input Data and Data Preprocessing
The single-cell gene expression matrix should be formatted into a N × G matrix, where G denotes the number of genes, N denotes the number of cells, and the matrix element mn,g is the transcriptional expression value of gene g in the n-th cell. CALISTA accepts expression values from RT-qPCR ( value) and scRNA-Seq including both plate-based [e.g., log(RPKM) or log(TPM)] and droplet-based measurements (e.g., gene UMI counts). For UMI data from scDrop-seq, CALISTA further scales the expression matrix by dividing each gene UMI count with the total UMI count in the corresponding cell and then multiplying the value with the median of the total UMI counts among cells (Zheng et al., 2017).
Before performing single-cell analysis, we first preprocess the single-cell expression matrix by removing the genes and cells (i.e., columns and rows of the expression matrix, respectively) with a large fraction of zero expression values, exceeding a user-defined threshold (default threshold: 100% for genes and 100% for cells). For scRNA-seq datasets, CALISTA further selects a number of informative genes Y for the single-cell analysis following a previously described procedure (Macosko et al.,
Next, CALISTA scales the single-cell expression values such that the maximum value of any gene is 200. The scaling is carried out as follows:
where mn,g and represent the original and scaled expression value of gene g in the n-th cell respectively, and mmax,g is the maximum expression value in gene g (i.e., the maximum of mn,g over all cells). The scaling above allows CALISTA to use a pre-computed table for the maximum likelihood in the clustering analysis, thereby reducing the computational cost significantly. We tested using in silico single-cell gene expression datasets generated using the two-state gene transcriptional model, and confirmed that the scaling does not affect the clustering accuracy (see Supplementary Note S3). After scaling, for scDrop-Seq data, we re-rank the top Y genes in increasing value of the gene-wise likelihood vg computed following Equation (10) below, with the random dropout model in Equation (4) incorporated in the calculation of likelihood. A lower gene-wise likelihood value indicates a broader distribution of single-cell expression. Genes with likelihood values exceeding a given threshold (by default set at the elbow of the curve of likelihood vs. gene rank) is removed from further analysis.
Stochastic Two-State Gene Transcriptional Model
For describing the mRNA distribution of a gene, CALISTA relies on the two-state model developed by Peccoud and Ycart (
where θon is the rate of the promoter activation, θoff is the rate of the promoter inactivation, θtis the rate of mRNA production when the promoter is active, θd is the rate constant of mRNA degradation, and m denotes the number of mRNA molecules. At steady state, the probability distribution of mRNA count m can be approximated by the following density function (Raj et al.,
where 1F1 represents the confluent hypergeometric function of the first kind.
Random Dropout Event Model
If desired and when appropriate, users can account for random dropout events in CALISTA. The inclusion of random dropouts is particularly suitable when dealing with single-cell transcriptional profiles from Drop-Seq technology. In CALISTA, the dropout probability is modeled by a negative exponential function with an optimal decay constant of λ, as follows:
where P(0|m) denotes the probability that the measured single-cell mRNA count is zero when the true number of mRNA molecules is m. A decay constant λ = 0 gives a dropout probability of 1, i.e., dropout occurs regardless of the true mRNA count. The parameter λ is estimated from the plot of the fraction of zeros against the mean expression across all measured genes, following the procedure described in Pierson et al. (Pierson and Yau,
Cell Clustering
As illustrated in Figure 1B, CALISTA combines maximum likelihood and consensus clustering algorithms for single-cell clustering analysis. Following a previous method SABEC (Ezer et al.,
Lineage Inference
The first novel algorithm in CALISTA is the reconstruction of cell lineage graph, which reflects the lineage progression in the differentiation process (Figure 1C). Based on the view that cell clusters represent cell states, the nodes of the lineage graph comprise cell clusters, while the edges represent state transitions in the lineage progression. For inferring the lineage graph, CALISTA computes cluster distances based on dissimilarities in the gene expressions among cells from two clusters. Again, CALISTA adopts a likelihood-based strategy using the probability distribution of mRNA from the stochastic two-state gene transcription model to define the cluster distances.
Cluster Distance
Given K clusters from CALISTA single-cell clustering analysis above or the clustering provided by the user, CALISTA evaluates a K × K dissimilarity matrix S where the element skj gives the likelihood of cells from cluster k to be assigned to cluster j, computed as follows:
where Nk is the set of cell indices for the cells in cluster k and is the parameter vector of two-state gene transcription that maximizes the joint probability of obtaining the gene expression values for gene g of the cells in the cluster j, as follows:
The probability is computed using the steady state probability distribution from the two-state gene transcription model as given in Equation (2) (assuming that random dropout events are insignificant) or using the distribution function defined in Equation (4).
Note that the diagonal element skk is the sum of the cell likelihood in the original cluster assignment, i.e., , and thus are larger than other elements skj, j ≠ k. The dissimilarity coefficients in the matrix S is subsequently normalized by subtracting each element with the diagonal element of the corresponding rows, as follows:
Since the likelihood always takes on negative values, the normalized dissimilarity coefficient assumes a positive value. A larger reflects a higher degree of dissimilarity between the two clusters. The distance between the j-th and k-th cluster, denoted by dkj, is defined as:
Lineage Graph Construction
CALISTA generates a lineage graph by connecting single-cell clusters (states) based on the cluster distances. The lineage graph describes the state transition of stem cells during the cell differentiation process, under the assumption that the transitions occur between closely related cell states (i.e., between clusters with low distances). Briefly, CALISTA starts with a fully disconnected graph of single cell clusters, and sequentially adds one transition edge at a time in increasing magnitude of cluster distance until each cluster is connected by at least one edge. Once the lineage graph has been established, CALISTA assigns directionalities to the edges in the lineage graph according to user-provided information, e.g., starting cells/clusters or expected gene expression profiles. Given information of the starting cells, CALISTA defines the cell cluster(s) containing these cells as the starting cluster(s). On the other hand, given the expected trajectory of some marker genes, CALISTA uses the mean expression of the gene marker(s) in each cell cluster to determine the starting cell cluster.
When the stage or time information is provided for the cells, CALISTA implements the following lineage reconstruction procedure. First, large outliers in the cluster distances (i.e., cluster distances that are larger than the median value by 3 scaled median absolute deviation) are removed from further consideration. Single-cell clusters are then labeled by their most frequent (mode) cell stage or time. Clusters with the lowest stage/time label are the starting clusters. CALISTA constructs a connected graph by assigning one (and only one) incoming edge for each cluster, except for the starting cluster(s), from the cluster with the lowest cluster distance among the set of feasible parent cluster(s). Here, the feasible parents of a given cluster j are any clusters with time/stage labels that are the nearest to but do not exceed a cutoff cell times/stages in cluster j. The default cutoff is set to the 5th percentile of the cell times/stages in cluster j. This cutoff is used to ensure that there exists sufficient difference in the cell times between the parent and daughter cell clusters.
Besides the automated lineage reconstruction above, CALISTA further allows the users to manually add or remove transition edges between pairs of clusters/nodes through a user-friendly GUI (see CALISTA user manual).
Transition Genes
Another novel contribution in CALISTA is an algorithm to extract the set of transition genes between any two connected clusters in the lineage graph. Here, transition genes are defined as genes whose single-cell expressions are highly informative in grouping cells into the two clusters. More specifically, CALISTA evaluates the likelihood difference between having cells assigned to two separate clusters and having the cells together in one cluster, again using the steady-state distribution of mRNA from the two-state gene transcription model. Given two clusters j and k, we compute the following:
with
where the optimal parameter vector θ*(g, j + k) is obtained according to Equation (6) for all cells from clusters j and k together. The value of reflects the informativeness of single-cell gene expression of gene g for grouping cells into two clusters j and k by the maximum likelihood principle in CALISTA. For each edge in the lineage graph, CALISTA generates a rank list of genes in decreasing values of . The transition genes correspond to the set of top genes in the list such that the ratio between the sum of among these genes and the total sum of among all genes exceeds a given threshold (default threshold: 50%).
Pseudotemporal Ordering of Cells
Given a lineage progression graph among cell clusters, the third and last novel algorithm in CALISTA concerns with the pseudotemporal ordering of cells. For this purpose, we first assign a pseudotime to each cluster. If the time or stage information of the cells is provided, then the pseudotime of a cluster is set to the mode of the time/stage of the cells in the cluster divided by the largest time/stage. When the time/stage information is not available, but the starting cluster is known (e.g., from knowledge of starting cells or marker genes), we assign a pseudotime of 0 for the starting cluster. We then evaluate the sum of the cluster distances along each path in the lineage progression and identify the maximum cumulative cluster distance. The pseudotime of a cluster is given by its cumulative cluster distance to the starting cluster divided by the maximum cumulative cluster distance. Once the cluster pseudotimes have been set, we assign each cell to one of the state transition edges and compute the cell pseudotime using the maximum likelihood principle (see Cell assignment to transition edges below). Finally, given a developmental path in the linage progression, CALISTA provides a pseudotemporal ordering of cells that have been assigned to the edges belonging to the path.
Cell Assignment to Transition Edges
For pseudotemporal ordering of the cells, CALISTA first assigns cells to the edges in the lineage graph. In the following illustration, let us consider a cell n in cluster k. CALISTA allocates the cell n to one of the edges that are incident to cluster k, again following the maximum likelihood principle. For this purpose, we define the likelihood value of a cell n to belong to an edge pointing from any cluster j to cluster k as follows:
where tk denotes the cluster pseudotime label and Λk(n) defines the likelihood value of the n-th cell to be in cluster k, i.e., . Similarly, we define the likelihood value of the same cell to belong to an edge pointing from cluster k to any cluster l by the following:
CALISTA computes all possible Λj→k(n) and Λk→l(n) lineage graph, and assigns the cell to the edge that gives the maximum of all Λj→k(n) and Λk→l(n) values. The pseudotime of the cell t(n) is set to t that gives the maximum likelihood value, as follows:
depending on the cell assignment to edges above.
Cell Ordering Along a Developmental Path
Given a lineage progression graph, users can identify one or several developmental paths. A developmental path is defined as the sequence of connected clusters in the lineage progression graph with transition edges pointing from one cluster to the next in the sequence. CALISTA generates a pseudotemporal ordering along a given developmental path by first identifying cells belonging to the state transition edges in the path and order these cells according to their pseudotimes. Note that in defining the likelihood function for assigning cells to edges, we have assumed that the steady state probability distributions of gene expressions vary linearly between two connected clusters or states. But the result of the cell ordering does not change if we replace the linear interpolation function with any monotonic function.
In silico Single-Cell Time-Stamped Expression Data Generation
For testing the performance of CALISTA, we simulated synthetic single-cell gene expression data using the stochastic differentiation equation (SDE) model of the gene network (12 genes) governing the differentiation of central nervous system (CNS) proposed by Qiu et al. (
Statements
Data availability statement
The datasets generated for this study are available on request to the corresponding author.
Author contributions
NP and RG designed the computational framework and workflow and wrote the manuscript. NP developed open-course tool and performed all data analyses. NP, TH, and TF collected all necessary data and performed the preliminary analysis. All authors read and approved the final manuscript.
Funding
This work was supported by the Swiss National Science Foundation (grant number 157154 and 176279 - SinCity).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe.2020.00018/full#supplementary-material
Supplementary Table S1Comparison of computational runtimes for single-cell clustering: SABEC vs. CALISTA.
Supplementary Table S2Comparison of pseudotimes: in silico (ground truth), Monocle 2, DPT, and CALISTA.
Supplementary Table S3Transition genes in Bargaje et al. study (Bargaje et al.,
Single-cell clustering evaluation: cell cluster assignments, adjusted Rand index, and in silico datasets.
Supplementary Video S1Three-dimensional projection of single-cell gene expression and lineage progression of zebrafish embryogenesis (Farrell et al.,
References
1
AngererP.SimonL.TritschlerS.WolfF. A.FischerD.TheisF. J. (2017). Single cells make big data: new challenges and opportunities in transcriptomics. Curr. Opin. Syst. Biol.4, 85–91. 10.1016/j.coisb.2017.07.004
2
BargajeR.TrachanaK.SheltonM. N.McGinnisC. S.ZhouJ. X.ChadickC.et al. (2017). Cell population structure prior to bifurcation predicts efficiency of directed differentiation in human induced pluripotent cells. Proc. Natl. Acad. Sci. U.S.A.114, 2271–2276. 10.1073/pnas.1621412114
3
BhatA. (2014). K-medoids clustering using partitioning around medoids for performing face recognition. Int. J. Soft Comput. Math. Control3, 1–12. 10.14810/ijscmc.2014.3301
4
BronC.KerboschJ. (1973). Algorithm 457: finding all cliques of an undirected graph. Commun. ACM16, 575–577. 10.1145/362342.362367
5
CacchiarelliD.TrapnellC.ZillerM. J.SoumillonM.CesanaM.KarnikR.et al. (2015). Integrative analyses of human reprogramming reveal dynamic nature of induced pluripotency. Cell162, 412–424. 10.1016/j.cell.2015.06.016
6
CannoodtR.SaelensW.SaeysY. (2016). Computational methods for trajectory inference from single-cell transcriptomics. Eur. J. Immunol.46, 2496–2506. 10.1002/eji.201646347
7
ChuL.-F.LengN.ZhangJ.HouZ.MamottD.VereideD. T.et al. (2016). Single-cell RNA-seq reveals novel regulators of human embryonic stem cell differentiation to definitive endoderm. Genome Biol.17:173. 10.1186/s13059-016-1033-x
8
DavidsonK. C.AdamsA. M.GoodsonJ. M.McDonaldC. E.PotterJ. C.BerndtJ. D.et al. (2012). Wnt/β-catenin signaling promotes differentiation, not self-renewal, of human embryonic stem cells and is repressed by Oct4. Proc. Natl. Acad. Sci. U.S.A.109, 4485–4490. 10.1073/pnas.1118777109
9
DurenZ.ChenX.ZamanighomiM.ZengW.SatpathyA. T.ChangH. Y.et al. (2018). Integrative analysis of single-cell genomics data by coupled nonnegative matrix factorizations. Proc. Natl. Acad. Sci. U.S.A.115, 7723–7728. 10.1073/pnas.1805681115
10
EzerD.MoignardV.GöttgensB.AdryanB. (2016). Determining physical mechanisms of gene expression regulation from single cell gene expression data. PLoS Comput. Biol.12:e1005072. 10.1371/journal.pcbi.1005072
11
FarrellJ. A.WangY.RiesenfeldS. J.ShekharK.RegevA.SchierA. F. (2018). Single-cell reconstruction of developmental trajectories during zebrafish embryogenesis. Science360:eaar3131. 10.1126/science.aar3131
12
GrünD.LyubimovaA.KesterL.WiebrandsK.BasakO.SasakiN.et al. (2015). Single-cell messenger RNA sequencing reveals rare intestinal cell types. Nature525, 251–255. 10.1038/nature14966
13
GuoG.HussM.TongG. Q.WangC.Li SunL.ClarkeN. D.et al. (2010). Resolution of cell fate decisions revealed by single-cell gene expression analysis from zygote to blastocyst. Dev. Cell18, 675–685. 10.1016/j.devcel.2010.02.012
14
HaghverdiL.BüttnerM.WolfF. A.BuettnerF.TheisF. J. (2016). Diffusion pseudotime robustly reconstructs lineage branching. Nat. Methods13, 845–848. 10.1038/nmeth.3971
15
HuaJ.Lin HuangM.WangG. (2018). Graph layout performance comparisons of force-directed algorithms. Int. J. Performabil. Eng.14, 67–76. 10.23940/ijpe.18.01.p8.6776
16
HuangW.CaoX.BiaseF. H.YuP.ZhongS. (2014). Time-variant clustering model for understanding cell fate decisions. Proc. Natl. Acad. Sci. U.S.A.111, E4797–E4806. 10.1073/pnas.1407388111
17
JagtapS.MeganathanK.GasparJ.WaghV.WinklerJ.HeschelerJ.et al. (2011). Cytosine arabinoside induces ectoderm and inhibits mesoderm expression in human embryonic stem cells during multilineage differentiation. Br. J. Pharmacol.162, 1743–1756. 10.1111/j.1476-5381.2010.01197.x
18
KærnM.ElstonT. C.BlakeW. J.CollinsJ. J. (2005). Stochasticity in gene expression: from theories to phenotypes. Nat. Rev. Genet.6, 451–464. 10.1038/nrg1615
19
KaliskyT.OrielS.Bar-LevT. H.Ben-HaimN.TrinkA.WinebergY.et al. (2018). A brief review of single-cell transcriptomic technologies. Brief. Funct. Genomics17, 64–76. 10.1093/bfgp/elx019
20
KiselevV. Y.KirschnerK.SchaubM. T.AndrewsT.YiuA.ChandraT.et al. (2017). SC3: consensus clustering of single-cell RNA-seq data. Nat. Methods14, 483–486. 10.1038/nmeth.4236
21
KumarR. M.CahanP.ShalekA. K.SatijaR.DaleyKeyserA. J.LiH.et al. (2014). Deconstructing transcriptional heterogeneity in pluripotent stem cells. Nature516, 56–61. 10.1038/nature13920
22
LinP.TroupM.HoJ. W. K. (2017). CIDR: Ultrafast and accurate clustering through imputation for single-cell RNA-seq data. Genome Biol.18:59. 10.1186/s13059-017-1188-0
23
MacoskoE. Z.BasuA.SatijaR.NemeshJ.ShekharK.GoldmanM.et al. (2015). Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets. Cell161, 1202–1214. 10.1016/j.cell.2015.05.002
24
MaoQ.WangL.GoodisonS.SunY. (2015). Dimensionality reduction via graph structure learning, in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD'15 (New York, NY: ACM Press), 765–774.
25
MarcoE.KarpR. L.GuoG.RobsonP.HartA. H.TrippaL.et al. (2014). Bifurcation analysis of single-cell gene expression data reveals epigenetic landscape. Proc. Natl. Acad. Sci. U.S.A.111, 5643–5650. 10.1073/pnas.1408993111
26
MoignardV.MacaulayI. C.SwiersG.BuettnerF.SchütteJ.Calero-NietoF. J.et al. (2013). Characterization of transcriptional networks in blood stem and progenitor cells using high-throughput single-cell gene expression analysis. Nat. Cell Biol.15, 363–372. 10.1038/ncb2709
27
NgE. S.AzzolaL.SourrisK.RobbL.StanleyE. G.ElefantyA. G. (2005). The primitive streak gene Mixl1 is required for efficient haematopoiesis and BMP4-induced ventral mesoderm patterning in differentiating ES cells. Development132, 873–874. 10.1242/dev.01657
28
NgV. Y.AngS. N.ChanJ. X.ChooA. B. H. (2010). Characterization of Epithelial cell adhesion molecule as a surface marker on undifferentiated human embryonic stem cells. Stem Cells28, 29–35. 10.1002/stem.221
29
PeccoudJ.YcartB. (1995). Markovian modeling of gene-product synthesis. Theor. Popul. Biol.48, 222–234. 10.1006/tpbi.1995.1027
30
PiersonE.YauC. (2015). ZIFA: dimensionality reduction for zero-inflated single-cell gene expression analysis. Genome Biol.16:241. 10.1186/s13059-015-0805-z
31
QiuX.DingS.ShiT. (2012). From understanding the development landscape of the canonical fate-switch pair to constructing a dynamic landscape for two-step neural differentiation. PLoS ONE7:e49271. 10.1371/journal.pone.0049271
32
QiuX.MaoQ.TangY.WangL.ChawlaR.PlinerH. A.et al. (2017). Reversed graph embedding resolves complex single-cell trajectories. Nat. Methods14, 979–982. 10.1038/nmeth.4402
33
QiuX.RahimzamaniA.WangL.MaoQ.DurhamT.Mcfaline-FigueroaJ. L.et al. (2018). Towards inferring causal gene regulatory networks from single cell expression measurements. bioRxiv426981. 10.1101/426981
34
RajA.PeskinC. S.TranchinaD.VargasD. Y.TyagiS. (2006). Stochastic mRNA synthesis in mammalian cells. PLoS Biol.4:e309. 10.1371/journal.pbio.0040309
35
RalstonA.ShawK. (2008). Gene expression regulates cell differentiation. Nat. Educ. 1, 127. Available online at: https://www.nature.com/scitable/topicpage/gene-expression-regulates-cell-differentiation-931/
36
ReiniusB.Plaza ReyesA.EdsgärdD.CodeluppiS.PetropoulosS.DengQ.et al. (2016). Single-Cell RNA-seq reveals lineage and X chromosome dynamics in human preimplantation embryos. Cell165, 1012–1026. 10.1016/j.cell.2016.03.023
37
RichardA.BoulluL.HerbachU.BonnafouxA.MorinV.VallinE.et al. (2016). Single-cell-based analysis highlights a surge in cell-to-cell molecular variability preceding irreversible commitment in a differentiation process. PLoS Biol.14:e1002585. 10.1371/journal.pbio.1002585
38
SathyamurthyA.JohnsonK. R.MatsonK. J. E.DobrottC. I.LiL.RybaA. R.et al. (2018). Massively parallel single nucleus transcriptional profiling defines spinal cord neurons and their activity during behavior. Cell Rep.22, 2216–2225. 10.1016/j.celrep.2018.02.003
39
SmootM. E.OnoK.RuscheinskiJ.WangP.-L.IdekerT. (2011). Cytoscape 2.8: new features for data integration and network visualization. Bioinformatics27, 431–432. 10.1093/bioinformatics/btq675
40
StuartT.SatijaR. (2019). Integrative single-cell analysis. Nat. Rev. Genet.20, 257–272. 10.1038/s41576-019-0093-7
41
StumpfP. S.SmithR. C. G.LenzM.SchuppertA.MüllerF.-J.BabtieA.et al. (2017). Stem cell differentiation as a non-markov stochastic process. Cell Syst.5, 268–282.e7. 10.1016/j.cels.2017.08.009
42
ThomasT.NowkaK.LanL.DerwahlM. (2006). Expression of endoderm stem cell markers: evidence for the presence of adult stem cells in human thyroid glands. Thyroid16, 537–544. 10.1089/thy.2006.16.537
43
TiyaboonchaiA.Cardenas-DiazF. L.YingL.MaguireJ. A.SimX.JobaliyaC.et al. (2017). GATA6 Plays an important role in the induction of human definitive endoderm, development of the pancreas, and functionality of pancreatic β cells. Stem Cell Rep.8, 589–604. 10.1016/j.stemcr.2016.12.026
44
TrapnellC.CacchiarelliD.GrimsbyJ.PokharelP.LiS.MorseM.et al. (2014). The dynamics and regulators of cell fate decisions are revealed by pseudotemporal ordering of single cells. Nat. Biotechnol.32, 381–386. 10.1038/nbt.2859
45
TreutleinB.LeeQ. Y.CampJ. G.MallM.KohW.ShariatiS. A. M.et al. (2016). Dissecting direct reprogramming from fibroblast to neuron using single-cell RNA-seq. Nature534, 391–395. 10.1038/nature18323
46
WolfF. A.AngererP.TheisF. J. (2018). SCANPY: large-scale single-cell gene expression data analysis. Genome Biol.19:15. 10.1186/s13059-017-1382-0
47
WolfF. A.HameyF. K.PlassM.SolanaJ.DahlinJ. S.GöttgensB.et al. (2019). PAGA: graph abstraction reconciles clustering with trajectory inference through a topology preserving map of single cells. Genome Biol.20:59. 10.1186/s13059-019-1663-x
48
XuC.SuZ. (2015). Identification of cell types from single-cell transcriptomes using a novel clustering method. Bioinformatics31, 1974–1980. 10.1093/bioinformatics/btv088
49
ZengW.ChenX.DurenZ.WangY.JiangR.WongW. H. (2019). DC3 is a method for deconvolution and coupled clustering from bulk and single-cell genomics data. Nat. Commun.10:4613. 10.1038/s41467-019-12547-1
50
ZhengG. X. Y.TerryJ. M.BelgraderP.RyvkinP.BentZ. W.WilsonR.et al. (2017). Massively parallel digital transcriptional profiling of single cells. Nat. Commun.8:14049. 10.1038/ncomms14049
51
ŽurauskieneJ.YauC. (2016). pcaReduce: hierarchical clustering of single cell transcriptional profiles. BMC Bioinform.17:140. 10.1186/s12859-016-0984-y
Summary
Keywords
single-cell, gene expression, transcriptional bursts, random dropouts, cell clustering, lineage progression, pseudotime, cell differentiation
Citation
Papili Gao N, Hartmann T, Fang T and Gunawan R (2020) CALISTA: Clustering and LINEAGE Inference in Single-Cell Transcriptional Analysis. Front. Bioeng. Biotechnol. 8:18. doi: 10.3389/fbioe.2020.00018
Received
25 September 2019
Accepted
10 January 2020
Published
04 February 2020
Volume
8 - 2020
Edited by
Xianwen Ren, Peking University, China
Reviewed by
Xiaojian Shao, National Research Council Canada (NRC-CNRC), Canada; Yong Wang, Academy of Mathematics and Systems Science (CAS), China
Updates

Check for updates
Copyright
© 2020 Papili Gao, Hartmann, Fang and Gunawan.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Rudiyanto Gunawan rgunawan@buffalo.edu
This article was submitted to Bioinformatics and Computational Biology, a section of the journal Frontiers in Bioengineering and Biotechnology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.