PMCCPMCCPMCC

Search tips
Search criteria 

Advanced


 
Formats
Article sections
Authors
Related links
Logo of bmcbioiBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Bioinformatics
 
BMC Bioinformatics. 2012; 13(Suppl 5): S5.
Published online 2012 April 12. doi:  10.1186/1471-2105-13-S5-S5
PMCID: PMC3358665
Copyright ©2012 Ho et al.; licensee BioMed Central Ltd.
Parametric modeling of cellular state transitions as measured with flow cytometry
Hsiu J Ho,1 Tsung I Lin,1,2 Hannah H Chang,3,4,5 Steven B Haase,6 Sui Huang,7 and Saumyadipta Pynecorresponding author8,9
1Department of Applied Mathematics and Institute of Statistics, National Chung Hsing University, Taichung 402, Taiwan
2Department of Public Health, China Medical University, Taichung 404, Taiwan
3Department of Pathology and Surgery, Children's Hospital Boston, Harvard Medical School, Boston, MA 02115, USA
4Program in Biophysics, Harvard University, Cambridge, MA 02139, USA
5MD-PhD Program, Harvard Medical School, Boston, Massachusetts 02115, USA
6Department of Biology, Duke University, Durham, North Carolina, USA
7Institute for Biocomplexity and Informatics, University of Calgary, Calgary, Alberta T2N 1N4, Canada
8Broad Institute of MIT and Harvard University, Cambridge, MA 02142, USA
9Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA 02115, USA
corresponding authorCorresponding author.
Hsiu J Ho: hsiujho/at/gmail.com; Tsung I Lin: tilin/at/amath.nchu.edu.tw; Hannah H Chang: hchang52/at/gmail.com; Steven B Haase: shaase/at/duke.edu; Sui Huang: sui.huang/at/ucalgary.ca; Saumyadipta Pyne: spyne/at/broad.mit.edu
Supplement
Selected articles from the First IEEE International Conference on Computational Advances in Bio and medical Sciences (ICCABS 2011): Bioinformatics
Ion Mandoiu, Teresa Przytycka, and Sanguthevar Rajasekaran
Conference
First IEEE International Conference on Computational Advances in Bio and medical Sciences (ICCABS 2011)
3-5 February 2011
Orlando, FL, USA
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Background
Gradual or sudden transitions among different states as exhibited by cell populations in a biological sample under particular conditions or stimuli can be detected and profiled by flow cytometric time course data. Often such temporal profiles contain features due to transient states that present unique modeling challenges. These could range from asymmetric non-Gaussian distributions to outliers and tail subpopulations, which need to be modeled with precision and rigor.
Results
To ensure precision and rigor, we propose a parametric modeling framework StateProfiler based on finite mixtures of skew t-Normal distributions that are robust against non-Gaussian features caused by asymmetry and outliers in data. Further, we present in StateProfiler a new greedy EM algorithm for fast and optimal model selection. The parsimonious approach of our greedy algorithm allows us to detect the genuine dynamic variation in the key features as and when they appear in time course data. We also present a procedure to construct a well-fitted profile by merging any redundant model components in a way that minimizes change in entropy of the resulting model. This allows precise profiling of unusually shaped distributions and less well-separated features that may appear due to cellular heterogeneity even within clonal populations.
Conclusions
By modeling flow cytometric data measured over time course and marker space with StateProfiler, specific parametric characteristics of cellular states can be identified. The parameters are then tested statistically for learning global and local patterns of spatio-temporal change. We applied StateProfiler to identify the temporal features of yeast cell cycle progression based on knockout of S-phase triggering cyclins Clb5 and Clb6, and then compared the S-phase delay phenotypes due to differential regulation of the two cyclins. We also used StateProfiler to construct the temporal profile of clonal divergence underlying lineage selection in mammalian hematopoietic progenitor cells.
Background
Flow Cytometry is among the most widely used platforms in biomedical research and clinical labs. It is used for investigation of a wide variety of biological problems at single cell level. Classical applications of flow cytometry include quantitative measurements of DNA content and cell cycle progression [1]. It is also one of the key platforms for studying dynamic cellular properties such as differentiation, proliferation and apoptosis, especially in the contexts of stem cells and cancer [2]. Such applications make flow cytometry the ideal platform for the purpose of identifying and monitoring the myriad states and functions in different specimens that vary over time under particular conditions and stimuli.
Typically, a flow sample is stained with fluorescent dyes, possibly attached to antibodies, and per cell events such as the expression of a cell-surface marker or the DNA content are measured in terms of fluorescence intensity. The distribution of these events are then plotted or modeled statistically for identification of important features in the sample. While developments in computational cytomics have produced many useful analytical methods (e.g. [3]), several important problems have not yet been addressed adequately. One such issue involves precise parametric modeling of dynamic features in temporal profiles such that the model parameters can characterize the transition of the populations in a sample through different cellular states. Often simple statistics such as population mean or size can be imprecise in the presence of unusually shaped distributions and outliers in temporal profiles. The modeling scenario could be complicated further by the adoption of different trajectories by different subpopulations. Indeed a rigorous algorithm for modeling cellular state transitions can not only automate the traditionally manual approach, which is subjective and labor-intensive, but also extend it to increasingly complex and high-throughput experiments.
Many major cytometric studies have highlighted the importance of characterizing temporal profiles at single cell resolution for a variety of purposes such as cell cycle expression kinetics (e.g. [4,5]), pharmacodynamics (e.g. [6,7]), signaling alterations in specific subpopulations (e.g. [8,9]), dynamics of differentiation into distinct lineages (e.g. [10,11]), and so on. Clearly, mathematical formulation of a cellular state-space, and the transitions therein, can help us model a given collection of temporal flow cytometric profiles with the required rigor. Thereupon we can study the changes in features (say, in comparison with those in control profiles) and monitor trends in parametric detail. Precise probabilistic modeling of sample distributions at each stage can automatically reveal such dynamic features as emergence of a tail subpopulation or change in the skewness of a cluster that are statistically well-defined as well as biologically insightful [3].
Temporal profiling of cellular state transitions in flow data can, however, present unique modeling challenges. Often the transient states produce non-Gaussian features such as asymmetric or trailing subpopulations owing to rush or delay in progression from one state to another [5]. Intermediate states might also produce outliers that cannot be clearly distinguished from the more distinctive states. Moreover certain metastable states may appear only inconsistently in a given time course [11]. Often the transient features appear and disappear at the tails of the more prominent distributions, and may be hard to model via automation. Thus a framework that uses robust probabilistic density functions to model time course data may be the best way to represent the underlying state-space, and reveal any sudden or gradual transition therein. In terms of the distribution of events in a flow sample, characteristics of different states may be determined by variation in size (say, percentage of cells in a peak or cluster), location (such as mean or mode) or significance (peak density) of the model components. While traditionally such changes were detected with manual or non-parametric techniques, several model-based frameworks have recently been applied with success, e.g. [3,12-15].
Here we present StateProfiler, a new framework based on finite mixture models of skew t-Normal distributions (STNMIX) for statistical characterization of flow cytometric time course data. In particular, we present in StateProfiler a new greedy Expectation-Maximization (EM) algorithm for fitting our STNMIX model. The greedy EM algorithm starts with a minimum number of distributions (or components) and sequentially inserts a new component to the mixture until model convergence is achieved. This parsimonious approach allows us to detect the dynamic appearance (and disappearance) of transient features that are characteristic of many state transitions. In addition, intermediate states are known to produce spatial features in the form of distributions with unusual shapes or low separation, which can lead to overlapping components, and hence to an overestimated number of model components. For optimal model selection, we therefore also provide in StateProfiler a new procedure for merging skew t-Normal components that are significantly overlapping in the mixture such that the change in entropy of the resulting model is minimal. Besides profiling of unusually shaped distributions and less well-separated features, this allows StateProfiler to tackle cellular heterogeneity that exists even within clonal populations.
We applied StateProfiler to learn the temporal features of cell cycle progression in two mutant strains of budding yeast Saccharomyces cerevisiae. Based on knockout of S-phase triggering cyclins Clb5 and Clb6, we compared the S-phase delay phenotypes resulting from the differential regulation of the two cyclins. Also we used StateProfiler to construct the overall temporal profile of clonal divergence underlying lineage selection in mammalian hematopoietic progenitor EML cells. By comparing the fitted models at each time point, we observed a slow and non-montonic convergence of clonal outlier subpopulations to a final median state.
Results and discussion
Temporal profiling with StateProfiler has several distinct advantages. First, the skew t-Normal mixture fitted to the data is defined by a probability density function (pdf). This function is well-defined at any resolution and can be visualized as a smooth profile, which is, unlike kernel-based non-parametric representations, not dependent on bandwidth specification. Importantly, the pdf rigorously specifies the significance of every feature, which allows us to detect the significant ones in the profile, while ignoring the ones which are not. StateProfiler bases its optimal modeling on 3 strategies: (1) to begin with, asymmetric and heavy-tailed STNMIX components model the data precisely even in the presence of outliers or skewed populations, further (2) the parsimonious fitting of the model with greedy EM yields accurately estimated components, and finally, (3) any redundant components are merged into a well-fitted output profile. By design, our STNMIX model is computationally faster to fit than the skew t mixture (STMIX) model [3,12,16,17] without sacrificing precision or rigor. Ho et al. [13] summarized the differences between the STMIX and STNMIX models and showed the implementation of the STNMIX model is generally much simpler and faster than that of STMIX model.
For temporal profiling, certain parameters of STNMIX model such as shape are uniquely suited to detect lagging or hastening trends in subpopulations (such as delay phenotypes in gene knockout experiments) that directly correspond to interesting cellular states and functions. Clearly this is neither possible with non-parametric representations nor using traditional parametric models based on Gaussian, t or other symmetric components [5]. Moreover, such shape or size parameters could be used to test for separability among components - i.e. to identify tendencies of subpopulations to move towards or away from each other without actually changing their mean locations. Parametric "snapshots" of such back-and-forth trends can shed light on the the discrete (switch-like) or continuous (spectrum-like) nature of the state transitions, leading to statistical observation of systems exhibiting multistable dynamics [10].
To illustrate some applications of StateProfiler, we analyzed two previously generated datasets for studying (a) cell division cycle and (b) cell differentiation in different species.
Cell cycle profiling
We applied StateProfiler to identify the temporal features of budding yeast cell cycle progression based on knockout of S-phase triggering cyclins Clb5 and Clb6. In late G1-phase, while both Clb5 and Clb6 activate Cdc28p to promote initiation of DNA synthesis, the exact mechanisms and extents of regulating this transition from G1 to S phase are distinct for the two cyclins [4]. In particular, Clb5 knockout causes a more prominent S phase defect during cell cycle progression in yeast cells than Clb6 knockout. Since DNA replication happens in S phase, we studied the dynamics of transition from the start and end states corresponding of one and two copies of the chromosomes (respectively, G1 and G2-M phases) while passing through intermediate states corresponding to S phase delay in the mutants. Interestingly, while genetic mutations are long known to produce delay phenotypes in cell cycle progression, few algorithms prior to StateProfiler could model the lag in the DNA distributions with precision.
We fitted STNMIX models to flow samples from two cell cycle time courses with 10 time-points each in yeast cells with knockout of Clb5 (Clb5Δ) and Clb6 (Clb6Δ3P). The time courses spanned more than one cell cycle period with respect to wild-type yeast cells dividing under the same protocol. The fitted mixture models identified two or more components in every sample, which typically corresponded to the 1C and 2C peaks before and after DNA synthesis, along with subpopulations in the intermediate S-phase, thus characterizing an overall spectrum of profiles of different state transitions (Figure ​(Figure11).
Figure 1
Figure 1
Cell cycle time-course profiles. Cell cycle time-course profiles. Overall spectrum of temporal profiles based on STNMIX modeling of flow cytometric DNA content data.
The smooth profiles of the noisy DNA histograms at every time-point are constructed with StateProfiler according to optimal change in the entropy values of the fitted model (Figure ​(Figure2).2). For example, the entropy plot (Figure 2a, b) suggests a jump in entropy (or elbow) beyond g = 2 components for Clb5Δ data at t = 25 min (blue histogram in Figure ​Figure2c).2c). The resulting 2-component profile is depicted by the orange curve in Figure ​Figure2c.2c. The individual components involved in the model are identified and shown as black dotted curves. Their parameters could be used to detect features for purposes like sorting cells (FACS) or monitoring trends in specific subpopulations (e.g. note the lag in the left component in Figure ​Figure22).
Figure 2
Figure 2
Modeling a temporal flow cytometric profile. Modeling a temporal flow cytometric profile. (a) Entropy values for a profile combining a given number of components (g) based on the results of the Greedy EM algorithm for Clb5Δ at t = 25 min. (b) (more ...)
To determine the precision of STNMIX, we computed log-likelihood maxima equation M1, BIC values, and distances Dn based on Kolmogorov-Smirnov (K-S) test statistic, and compared in Table ​Table11 with the same for four competing 2-component mixture models (of normal, t, skew normal, and skew t) known from the literature [3,18]. According to BIC, the optimal selection of the STNMIX model with equal dfs is evident (e.g. the 2-component model at t = 25). As seen from Dn, we also conclude that STNMIX achieves the most precise modeling in terms of both the count and asymmetry of components in the given data. Further, we used the models for objective comparison of profiles both within and across time-courses. We computed the Gap statistic [19] as a measure of dispersion of cellular events between the two extreme states corresponding to the 1C and 2C peaks or clusters. Tested against a reference distribution of data with no clustering, the Gap statistics support the biological observation of Jackson et al. [4] that the Clb5 mutant shows more pronounced S-phase delay phenotypes than the Clb6 mutant and hence has less well-separated components in mid-cell cycle (e.g. t = 25). The contrast between the samples in terms of cells showing a slower state transition from 1C to 2C may be observed in Table ​Table22 for different time-points. Finally, we observe the gradual variation in the key features at each successive time-point to gain insights into the differential regulation of the S-phase by the cyclins Clb5 and Clb6 (Figure ​(Figure33).
Table 1
Table 1
Details of competing models for Clb5 data
Table 2
Table 2
Measuring dispersion of events at each time point
Figure 3
Figure 3
Comparison of time-course profiles. Comparison of time-course profiles constructed with StateProfiler. The orange-red and green-blue curves represent DNA distributions of Clb5Δ and Clb6Δ3P cells respectively. The time-points in minutes (more ...)
Cell differentiation profiling
Another key area in which flow data are extremely insightful about different state transitions is cell differentiation. In recent years, many important advances in biology have been made by studying the modes and mechanisms of differentiation especially in the context of stem cells and cancer. Stem cell differentiation has also been studied for their clinical applications such as in the field of regenerative medicine. An excellent review of the field is given in a recent text edited by Krishan et al. [2]. Over the course of differentiation, the profiles of expression of various markers - including those indicating stemness or commitment to a lineage - vary according to transitions of populations through unstable, metastable and eventually stable states. Often measurable phenotypic diversity appears due to cell-to-cell variability even within clonal populations, which are manifest and can be studied as outlier events or asymmetric or tail subpopulations. Sometimes these features are transient and peripheral, and could be hard to distinguish via automation. Accurate modeling of dynamic flow profiles is thus essential to identify or monitor transitional features as and when they appear (or disappear) for objective temporal characterization of the state-space components involved in differentiation.
In the present study, we analyzed clonal populations of EML cells, a multipotent mouse haematopoietic cell line that can differentiate into myeloid, erythroid, and other lineages. In a recent study, Chang et al. [11] measured the expression levels of the stem cell marker Sca-1 in different subpopulations of EML cells as time course data. They observed that cell-to-cell heterogeneity in this clonal progenitor population gave rise to Sca-1 outlier cells - cells that exhibit very high or low Sca-1 expression - and possessed distinct gene expression patterns. The heterogeneity could not be attributed to measurement noise or cell-cycle-dependent cell size variation. Eventually, however, each of these distinct Sca-1 subpopulations' profiles became similar to that of the median cells, thus revealing an attractor state. Yet it was noted [11] that the divergence lasted long enough to allow different propensities for either subpopulation, i.e. low and high Sca-1, to enter into a transient state that primes them for either the erythroid or the myeloid lineage, as captured by their differential expression of lineage-specific transcription factors.
For precise characterization of the dynamics by which population heterogeneity arose in this clonal population via outliers and subsided ultimately, cells with the lowest, middle and highest levels of Sca-1 expression were isolated by [11] using fluorescence-activated cell sorting (FACS). We call these subsets Sca-1low, Sca-1mid, and Sca-1high. Following FCAS, the sorted cells were immediately stripped of the staining antibody and cultured in standard growth medium. Subsequently, Sca-1 fluorescence intensity were measured individually for each of the 3 subpopulations as time course data. Similar measurements were made for an original clonal population of EML cells for comparison (we call it Sca-1all).
We applied the StateProfiler framework to model the flow profiles for 14-point time course data for each of the 4 populations. Often finite mixtures of Gaussians are used for modeling the theoretical subpopulation structure in such profiles [11,20]. However, using Gaussian components, precise modeling in the presence of outliers due to cell-to-cell heterogeneity is particularly difficult for clonal populations. This is because an optimal model must be able to accommodate such heterogeneity without requiring extra components, but Gaussian components with sharp tails are hardly robust against outliers. It leads to sub-optimal models with spurious subpopulations, which makes their biological interpretation difficult.
StateProfiler addressed the modeling problem in two ways. First, its skew t-Normal components are robust to outliers and asymmetry in the distributions. This helps in modeling transitional features even if they lead to unusually shaped or heavy tailed distributions. Second, even if redundant subpopulations were identified, the new merging procedure in StateProfiler can re-construct any significantly overlapping components in a statistically optimal fashion, i.e. to produce a combined profile by causing minimal change in entropy of the model pre- and post-reconstruction.
The dual advantages of the StateProfiler modeling algorithm allowed us to compute highly accurate profiles of Sca-1 expression in the time course datasets for the three sorted and the unsorted EML cells. The steps of the merging procedure through which an optimal structure for the model is "stitched" together are illustrated with an example in Figure ​Figure4.4. Finally, we compared the divergence of the 3 sorted subsets from the corresponding unsorted population using Kullback-Leibler distances between the probability density functions specifying their profiles. A visual comparison of the profiles is shown in Figure ​Figure5.5. The trend of decreasing divergence, as the 3 sorted profiles become similar to the unsorted profile with progression of time, is shown in Figure ​Figure66.
Figure 4
Figure 4
An example of merging mixture components. The Sca-1 expression data for the unsorted population of EML cells at 264 h is shown in the histogram. At each step of the merging algorithm, the fitted profile is shown as a thick grey curve, and the individual (more ...)
Figure 5
Figure 5
Comparison of time-course profiles. The temporal profiles of the 3 sorted subsets and the unsorted clonal population are constructed with StateProfiler, and plotted for visual comparison.
Figure 6
Figure 6
The trend of convergence to the unsorted profile. Kullback-Leibler (KL) distance of the profiles for each of the 3 sorted subpopulations from the unsorted profile at a given time-point. While the distances decrease with time, the trend is slow and does (more ...)
StateProfiler's parametric characterization can reveal various features and trends of interest in terms of specific parameters. For instance, we observe that by 3 days, both Sca-1mid and Sca-1high have already started to resemble the unsorted population, and by 6 days, they actually have their own low Sca-1 tails. Another trend of possible interest is the slow but continuous fluctuation in the proportion of low Sca-1 outliers in the unsorted population. Finally, it appears that the eventual stable state when the 3 profiles finally coincide is reached at a point of time much later than 9 days, as suggested by [11], and takes probably double that time (432 h). In the mean time, as we see in Figure ​Figure6,6, the states might continue to drift closer and apart as in a dynamical system exhibiting multistable behaviour. If indeed the departure from the average state has biological functionality in the priming of cell fate commitment, then a non-monotonic, delayed restoration of the underlying molecular mechanisms may be justified by having more than a few cells with random fluctuation and call for further investigation.
Conclusions
In this study, we described StateProfiler, a framework to construct temporal profiles with flow data, which can facilitate parametric modeling of cellular state transitions Towards this, we presented 3 key features of the framework. First, we described a finite mixture of skew t-Normal distributions. Second, we presented a new greedy EM algorithm for fast and optimal model selection. The parsimonious approach of our greedy algorithm allows us to detect the variation in the features as and when they appear and disappear at different points of time thereby offering a parametric characterization of the overall nature of state transition. Third, we designed a mixture merging procedure for ensuring robust estimation of the fitted profile. The code implementing the framework is available from the authors upon request. Indeed the proposed framework is effective, general and may be applied to other similar domains.
Methods and materials
Mixtures of skew Student-t-normal distributions
We describe the skew t-Normal mixture model (STNMIX) of StateProfiler. To simplify notation, we let ϕ(.) and Φ(.) denote the probability density function (pdf) and the cumulative distribution function (cdf) of the standard normal distribution, respectively. Let
equation M13
denote the pdf of the t distribution with location ξ, scale σ2 and degrees of freedom (df) v, and t(x|v ) simply for the case when ξ = 0 and σ = 1; and let Γ(α,β) be the gamma distribution with density g(x|α, β) [proportional, variant] xα-1exp{-βx}. We start by defining the STN distribution and then note further properties.
As introduced by Gómez et al. [21], a random variable Y is said to follow the STN with location parameter ξ [set membership] R, scale parameter σ2 [set membership] (0, ∞), skewness parameter λ [set membership] R and degrees of freedom v [set membership] (0,∞) it is has the density
equation M14
(1)
We shall write Y~ STN(ξ,σ2,λ,v) if Y has the density of (1).
Ho et al. [13] give following hierarchical representation of STN to establish an EM-type algorithm [22].
equation M15
(2)
where T N(µ, σ2; (a, b)) represents the truncated normal distribution for N(µ, σ2) lying within the truncated interval (a, b).
Consider n independent random variables Y1,..., Yn, which are taken from a mixture of STN distributions. The pdf of a g-component STNMIX model is
equation M16
(3)
Where wi's are mixing proportions which are constrained to be positive and equation M17is the STN density defined in (1) and Θg= (w1,..., wg-1, θ1,..., θg) represents all unknown parameters. Note that the component vector θi consists of equation M18
Based on (2), a practical ECM/ECME algorithm [23,24] proceeds are described by Ho et al. [13] as follows:
E-step: Given equation M19compute following equation M20, equation M21, equation M22 and equation M23 for i = 1,..., g and j = 1,..., n.
equation M24
where equation M25
CM-step: Update the estimation by
equation M26
where equation M27, equation M28, equation M29, equation M30, equation M31and equation M32
If the dfs are assumed to be identical, say v1 = (...) = vg = v, we could update equation M33by
equation M34
The E-step and CM/CML-steps are alternately repeated until a suitable convergence rule is satisfied, e.g., the Aitken acceleration based stopping criterion equation M35where equation M36is the observed log-likelihood evaluated at equation M37is the asymptotic estimate of the log-likelihood at iteration h + 1 (see [18]; Chap. 4.9) and ε is the desired tolerance. For numerical analyses in this paper, a default value of ε = 10-6 was used to terminate the iterations.
Greedy learning for STN mixtures
In this section, we present a new greedy version of the EM algorithm to determine the optimum number of components in the fitting of STNMIX models. The greedy EM approach was first introduced by Vlassis and Likas [25]. The fundamental concept of the greedy EM algorithm is to start from a minimum number of components and sequentially insert a new component to the mixture until convergence is achieved. The stopping criterion can be a pre-specified maximum number of components or a pre-specified convergence tolerance.
Suppose a new component equation M38 is added to a g-component equation M39. The resulting mixture takes the form of
equation M40
where 0 < a <1 and equation M41 with equation M42being the added parameters equation M43 Given an old mixture equation M44, the weight a and equation M45are optimally chosen to maximize the new log-likelihood
equation M46
(4)
To find the optimal solution in (4), we start by performing a local search with for the newly inserted component. This gives rise to the following partial EM steps where equation M47denotes and the partial ML estimates of θ. For notational simplicity, the subscript (g + 1) is suppressed below in the Partial E-step.
Partial E-step: Calculating the conditional expectation of latent variables at the kth iteration, this yields
equation M48
Where equation M49
Partial M-step: Updating the new parameters in (a, θg+1), we get
equation M50
Where equation M51, equation M52, equation M53, equation M54, and equation M55.
The above partial EM steps constitute a fast and simple procedure to locally seek for the maximum of equation M56. To our experience, this local search scheme is very sensitive the initialization of a and ξg+1. Similar to Vlassis and Likas [25], we provided a global search strategy for extracting proper parameter initialization for a and equation M57. By a second-order Taylor expansion for equation M58, we obtain the following approximation:
equation M59
(5)
where equation M60 and equation M61 are the first and second derivatives of equation M62 evaluated at a = a0. It can be deduced from (5) that a local maximum of equation M63 around a0 = 0.5 is given by
equation M64
(6)
with
equation M65
So the the optimal value of a can be calculated as
equation M66
(7)
Following the suggestion of Li and Barron [26], one may set equation M67 for g = 1 and equation M68 for g ≥ 2 as a default recommendation when the estimated value (7) fall outside the range of (0, 1).
In our global search, a convenience choice of equation M69 is n-1/5 times half of the sample variance equation M70 whereas equation M71 and equation M72 are always fixed at 0 and 10, respectively. For the initial choice of ξg+1, we search over the 5th, 10th, 15th, (...) 95th quantiles of y and set equation M73 to the one that maximizes (6).
The implementation of the greedy EM algorithm is summarized below.
1. Start with g = 1 and compute the ML estimates of the single-component STNMIX model via the ECME algorithm.
2. If g >1, estimate Θg via the EM-type algorithms.
3. Perform a global search to find a proper initialization of a and ξg+1.
4. Apply the partial EM-steps until convergence. For instance, equation M74.
5. If equation M75 then terminate, where m >0 is a penalty term. Otherwise allocate the new component to the model and go to 2. Set g = g + 1.
Given r candidates (we have 19 quantiles of sample), the time complexity of our greedy EM algorithm is O(ngr). If overall sample was considered as candidates in the global search, then the running time is similar to Vlassis and Likas [25].
Merging mixture algorithm
The greedy EM algorithm provides a convenient method for automatically selecting a number of components for a mixture model under reasonable assumptions (such as convexity of components). Yet if data have certain spatial features due to distributions with unusual shapes or low separation [8], it can lead to overlapping components, and hence to overestimation in the number of components in spite of the parsimonious approach. To augment our greedy algorithm for obtaining a robust estimate of the number of components, we extend the merging mixture approach of Baudry et al. [27] to skew t-Normal components. While merging techniques have been applied in the past to symmetric distributions [27,28], designing a procedure for asymmetric distributions obviates any need for spurious components that may be required for the sole purpose of modeling asymmetry, and thus avoids redundant merging.
The basic idea behind the procedure is to use the maximum merged entropy to iteratively combine two possibly overlapping clusters, until the result of combination belong a single cluster (see implementation in [28]). The steps of the merging algorithm in StateProfiler are described below.
1. Calculate the mean entropy of maximum estimation for g components as
equation M76
where equation M77 denotes the posterior probability given Θg fix at equation M78.
2. Two clusters l and l' to be combined are those maximizing the criterion:
equation M79
among all possible pairs of clusters (l, l').
3. Obtain the merged entropy
equation M80
where equation M81 is the posterior probability of the new cluster l [union or logical sum] l'.
4. Update equation M82 consists of the unmerged and merged posterior probabilities.
5. Set g = g - 1 and go to 2. Repeat until g = 1.
6. A solution of number of components can be identified (i) a sudden jump or "elbow" in a plot of the entropy of clustering versus the number of clusters, or (ii) peaks in a plot of the number of clusters versus the difference in entropy.
Data and experiments
For details of the yeast cell cycle experiments and timecourse data analyzed by StateProfiler, see [4]. For details of EML cell differentiation data, see [11].
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
HJH and TIL co-developed the statistical methods and performed data analysis. SP conceived the project, designed the approach, and analyzed the results. All authors contributed to the development of the methodology and to writing the manuscript. HJH and TIL contributed equally and are the first authors as well as listed in alphabetical order.
Acknowledgements
TIL was partially supported by National Science Council of Taiwan (Grant NO. NSC99-2118-M-005-001-MY2).
This article has been published as part of BMC Bioinformatics Volume 13 Supplement 5, 2012: Selected articles from the First IEEE International Conference on Computational Advances in Bio and medical Sciences (ICCABS 2011): Bioinformatics. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcbioinformatics/supplements/13/S5.
References
  • Darzynkiewicz Z, Crissman H, Jacobberger JW. Cytometry of the cell cycle: cycling through history. Cytometry A. 2004;58:21–32. [PubMed]
  • Krishan A, Krishnamurthy H, Totey S. Applications of Flow Cytometry in Stem Cell Research and Tissue Regeneration. John Wiley & Sons Inc; 2010.
  • Pyne S, Hu X, Wang K, Rossin E, Lin TI, Maier LM, Baecher-Allan C, McLachlan GJ, Tamayo P, Hafler DA, Jager PLD, Mesirov JP. Automated high-dimensional flow cytometric data analysis. Proc Natl Acad Sci USA. 2009;106:8519–8524. doi: 10.1073/pnas.0903028106. [PubMed] [Cross Ref]
  • Jackson LP, Reed SI, Haase SB. Distinct mechanisms control the stability of the related S-phase cyclins Clb5 and Clb6. Mol Cell Biol. 2006;26:2456–2466. doi: 10.1128/MCB.26.6.2456-2466.2006. [PMC free article] [PubMed] [Cross Ref]
  • Niu W, Li Z, Zhan W, Iyer VR, Marcotte EM. Mechanisms of cell cycle control revealed by a systematic and quantitative overexpression screen in S. cerevisiae. PLoS Genet. 2008;4:e1000120. doi: 10.1371/journal.pgen.1000120. Doi:10.1371/journal.pgen.1000120. [PMC free article] [PubMed] [Cross Ref]
  • Hedley DW, Chow S, Goolsby C, Shankey TV. Pharmacodynamic monitoring of molecular-targeted agents in the peripheral blood of leukemia patients using flow cytometry. Toxicol Pathol. 2008;36:133–139. doi: 10.1177/0192623307310952. [PubMed] [Cross Ref]
  • Krishan A, Hamelik RM. Flow cytometric monitoring of fluorescent drug retention and efflux. Methods Mol Med. 2005;111:149–166. [PubMed]
  • Kotecha N, Flores NJ, Irish JM, Simonds EF, Sakai DS, Archambeault S, Diaz-Flores E, Coram M, Shannon KM, Nolan GP, Loh ML. Single-cell profiling identifies aberrant STAT5 activation in myeloid malignancies with specific clinical and biologic correlates. Cancer Cell. 2008;14(4):335–343. doi: 10.1016/j.ccr.2008.08.014. [PMC free article] [PubMed] [Cross Ref]
  • Irish JM, Myklebust JH, Alizadeh AA, Houot R, Sharman JP, Czerwinski DK, Nolan GP, Levy R. B-cell signaling networks reveal a negative prognostic human lymphoma cell subset that emerges during tumor progression. Proc Natl Acad Sci USA. 2010;107:12747–12754. doi: 10.1073/pnas.1002057107. [PubMed] [Cross Ref]
  • Chang HH, Oh PY, Ingber DE, Huang S. Multistable and multistep dynamics in neutrophil differentiation. BMC Cell Biol. 2006;7:11. doi: 10.1186/1471-2121-7-11. [PMC free article] [PubMed] [Cross Ref]
  • Chang HH, Hemberg M, Barahona M, Ingber DE, Huang S. Transcriptome-wide noise controls lineage choice in mammalian progenitor cells. Nature. 2008;453(7194):544–547. doi: 10.1038/nature06965. [PubMed] [Cross Ref]
  • Frühwirth-Schnatter S, Pyne S. Bayesian inference for finite mixtures of univariate and multivariate skew-normal and skew-t distributions. Biostatistics. 2010;11:317–336. doi: 10.1093/biostatistics/kxp062. [PubMed] [Cross Ref]
  • Ho HJ, Pyne S, Lin TI. Maximum likelihood inference for mixtures of skew Student-t-normal distributions through practical EM-type algorithms. Stat Comput. 2012;22:287–299. doi: 10.1007/s11222-010-9225-9. [Cross Ref]
  • Lin TI, Lee JC, Yen SY. Finite mixture modelling using the skew normal distribution. Stat Sinica. 2007;17:909–927.
  • Rossin E, Lin TI, Ho HJ, Mentzer SJ, Pyne S. A framework for analytical characterization of monoclonal antibodies based on reactivity profiles in different tissues. Bioinformatics. 2011;27(19):2746–2753. doi: 10.1093/bioinformatics/btr468. [PMC free article] [PubMed] [Cross Ref]
  • Lin TI, Lee JC, Hsieh WJ. Robust mixture modeling using the skew t distribution. Stat Comput. 2007;17:81–92. doi: 10.1007/s11222-006-9005-8. [Cross Ref]
  • Lin TI. Robust mixture modeling using multivariate skew t distributions. Stat Comput. 2010;20:343–356. doi: 10.1007/s11222-009-9128-9. [Cross Ref]
  • McLachlan GJ, Krishnan T. The EM algorithm and extensions. John Wiley & Sons Inc; 2008.
  • Tibshirani R, Walther G, Hastie T. Estimating the number of clusters in a data set via the gap statistic. J R Stat Soc Ser B Methodol. 2001;63:411–423. doi: 10.1111/1467-9868.00293. [Cross Ref]
  • Song C, Phenix H, Abedi V, Scott M, Ingalls BP, Kaern M, Perkins TJ. Estimating the stochastic bifurcation structure of cellular networks. PLoS Comput Biol. 2010;6(3):e1000699. doi: 10.1371/journal.pcbi.1000699. [PMC free article] [PubMed] [Cross Ref]
  • Gómez HW, Venegas O, Bolfarine H. Skew-symmetric distributions generated by the distribution function of the normal distribution. Environmetrics. 2007;18:395–407. doi: 10.1002/env.817. [Cross Ref]
  • Dempster AP, Laird NM, Rubin DB. Maximum likelihood from incomplete data via the EM algorithm (with discussion) J R Stat Soc Ser B Methodol. 1977;39:1–38.
  • Meng XL, Rubin DB. Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika. 1993;80:267–278. doi: 10.1093/biomet/80.2.267. [Cross Ref]
  • Liu CH, Rubin DB. The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika. 1994;81:633–648. doi: 10.1093/biomet/81.4.633. [Cross Ref]
  • Vlassis N, Likas A. A greedy EM algorithm for Gaussian mixture learning. Neural Process Lett. 2002;15:77–87. doi: 10.1023/A:1013844811137. [Cross Ref]
  • Li JQ, Barron AR. In: Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29 - December 4, 1999. Solla SA, Leen TK, Müller KR, editor. The MIT Press; 1999. Mixture Density Estimation; pp. 279–285.
  • Baudry JP, Raftery AE, Celeux G, Lo K, Gottardo R. Combining Mixture Components for Clustering. J Comput Graph Stat. 2010;9:332–353. [PMC free article] [PubMed]
  • Finak G, Bashashati A, Brinkman R, Gottardo R. Merging mixture components for cell population identification in flow cytometry. Adv Bioinformatics. 2009;2009:Article ID 247646. Doi:10.1155/2009/247646. [PMC free article] [PubMed]
Articles from BMC Bioinformatics are provided here courtesy of
BioMed Central