Search tips
Search criteria 


Logo of plosonePLoS OneView this ArticleSubmit to PLoSGet E-mail AlertsContact UsPublic Library of Science (PLoS)
PLoS One. 2013; 8(3): e58173.
Published online 2013 March 5. doi:  10.1371/journal.pone.0058173
PMCID: PMC3589343

T3_MM: A Markov Model Effectively Classifies Bacterial Type III Secretion Signals

Dov Joseph Stekel, Editor



Type III Secretion Systems (T3SSs) play important roles in the interaction between gram-negative bacteria and their hosts. T3SSs function by translocating a group of bacterial effector proteins into the host cytoplasm. The details of specific type III secretion process are yet to be clarified. This research focused on comparing the amino acid composition within the N-terminal 100 amino acids from type III secretion (T3S) signal sequences or non-T3S proteins, specifically whether each residue exerts a constraint on residues found in adjacent positions. We used these comparisons to set up a statistic model to quantitatively model and effectively distinguish T3S effectors.


In this study, the amino acid composition (Aac) probability profiles conditional on its sequentially preceding position and corresponding amino acids were compared between N-terminal sequences of T3S and non-T3S proteins. The profiles are generally different. A Markov model, namely T3_MM, was consequently designed to calculate the total Aac conditional probability difference, i.e., the likelihood ratio of a sequence being a T3S or a non-T3S protein. With T3_MM, known T3S and non-T3S proteins were found to well approximate two distinct normal distributions. The model could distinguish validated T3S and non-T3S proteins with a 5-fold cross-validation sensitivity of 83.9% at a specificity of 90.3%. T3_MM was also shown to be more robust, accurate, simple, and statistically quantitative, when compared with other T3S protein prediction models. The high effectiveness of T3_MM also indicated the overall Aac difference between N-termini of T3S and non-T3S proteins, and the constraint of Aac exerted by its preceding position and corresponding Aac.


An R package for T3_MM is freely downloadable from: T3_MM web server:


The bacterial type III secretion system (T3SS) is a needle-like hollow secretion apparatus which is expressed on the surface of a wide variety of gram-negative bacteria [1][4]. T3SS can mediate the translocation of a group of proteins from bacteria into the cytoplasm of host cells; therefore, it plays an important role in the interactions between bacteria and their hosts [1], [5][6]. The proteins specifically recognized, secreted and translocated by the T3SS are called type III secreted (T3S) effectors, which exert their biological activities in host cells in concert to cause pathogenicity [7].

The N-termini of T3S effectors have been shown to contain important signals that guide their specific recognition by T3SSs [8][14]. Due to great diversity, no consensus sequences or common motifs have been identified from this region of T3S effectors [10], [15][16]. The limited physicochemical property preference of amino acids (e.g., charged and polar) only gave few clues about the specificity of T3S signals [15]. It was suggested that N-termini of T3S effectors frequently adopted more flexible secondary or tertiary structure [7]. However, integration of these secondary structure features and others (such as solvent accessibility) did not facilitate the identification of T3S signal sequences, indicating that these properties in T3S proteins couldn't be distinct from those in non-T3S proteins, and they couldn't be the major factors guiding specific type III recognition [15], [17]. Till now, very few N-terminal sequences of T3S effectors have been resolved for three-dimensional structures, hindering the observation and inference of the possible recognition specificity of T3S signals. No simple, general and comprehensively-representative features have been observed, which could well distinguish T3S and non-T3S proteins. Consequently, instead, multiple-aspect, subtle, and partially-representative properties of T3S signal sequences were analysed, extracted and combined to train different non-linear classification models [15], [17][20]. These models greatly prompted the identification of new effectors, and meanwhile facilitated our understanding of type III secretion mechanisms and the evolution of T3S effectors.

Here, we further explored the features differently represented by T3S and non-T3S proteins. Different amino acids have been observed to be preferred in T3S N-terminal sequences generally [15] and position-specifically [17]. For example, serine is most preferred by T3S signal sequences generally and specifically in most positions [10], [15], [17]. Does this mean that a stretch of serines should be theoretically the best optimal T3S signal sequence? Could amino acids in a T3S signal sequence exert some constraint on amino acid composition (Aac) at their sequentially succeeded positions? Furthermore, is this constraint different from that of non-T3S sequences? If so, could these features be used for discriminating T3S proteins? This study aimed to answer these questions.


Different Aac Probability Profiles Conditional on Amino Acids at Sequentially Preceding Position

We previously reported that specific type III secretion guiding signals were buried in the N-terminal 100 amino acid region of T3S effectors [17]. In this study, N-terminal 100 amino acids of T3S and non-T3S proteins were extracted for feature analysis. The absolute composition of each species of amino acid was calculated and compared between T3S and non-T3S sequences. Furthermore, to observe the constraint of specific amino acids on the Aac at succeeding positions, the conditional probability of each amino acid on each amino acid at the preceding position was also calculated and compared.

As for absolute composition of single amino acids, T3S sequences had higher proportion of serine, leucine and alanine and lower proportion of tryptophan, cysteine, tyrosine and methionine (Fig. S1). However, T3S and non-T3S sequences didn't show marked differences except for serine and tryptophan, with serine being enriched and tryptophan being depleted in T3S sequences (Fig. S1).

For each amino acid, the probability conditional on each type of preceding amino acid was compared with its absolute probability. As shown in Fig. S2 (marked with star above the bar), there were many amino acids for which the conditional probability was significantly different from their absolute probability in T3S sequences (p<0.05), indicating probabilistic dependence of Aac on its sequentially preceding amino acid. The difference was not significant in non-T3S sequences (data not shown), indicating there was a T3S-specific Aac dependence or constraint. An alternative binomial distribution-based statistics was also adopted to compare the real conditional probability of each amino acid with its expected value under independent hypothesis. The results further confirmed the conclusion about position dependency in T3S sequences (Fig. 1; red and grey background representing significantly enriched and depleted amino acids in real T3S sequence, respectively; significance set as FDR <0.05). The T3S-specific Aac dependence was tested further with the third strategy. On each amino acid, the conditional probability of its succeeding amino acid was ordered and ranked. The rank difference between the conditional and the absolute probability of each type of succeeding amino acid was calculated. There were a lot of cases, which were observed with significant rank difference (absolute value of difference ≥5; Fig. S2, marked with upward or downward arrow above the bar). The results further confirmed that the Aac in T3S sequences was influenced by its preceding position.

Figure 1
Distribution of bi-amino acids (bi-aa) with significant difference of Aac conditional probability in T3S signal sequences.

Many Aac conditional probabilities on each amino acid at preceding position were significantly different between T3S and non-T3S sequences (Fig. 1, with upward or downward arrow; significance set as FDR <0.05). Notably, the proportion of leucine was generally lower in T3S sequences than in non-T3S sequences, though it was frequently enriched after different types of amino acids in T3S sequences (Fig. 1). Similarly, alanine was no longer differentially composed between T3S and non-T3S sequences; cysteine, histidine and methionine were not strikingly depleted in T3S sequences compared with non-T3S sequences (Fig. 1). Some other amino acids, e.g., aspartic acid and glutamine, were frequently higher while valine was frequently lower in T3S than non-T3S sequences, though they were not significantly enriched or depleted in T3S sequences (Fig. 1).

The ranks of Aac conditional probabilities on each amino acid at preceding position also showed an apparent difference between T3S and non-T3S sequences (Fig. S2; marked with backward or forward arrow below the bar). This difference could be caused by the superimposed or loosened constraint by adjacent position in T3S proteins (or in non-T3S proteins). For example, when the first position is isoleucine, the ranks of asparagine and valine were apparently different in T3S and non-T3S sequences (Fig. S2). The higher and lower order of asparagine and valine composition in T3S than non-T3S sequences, was potentially caused by the increased and decreased asparagine and valine after isoleucine, respectively, in T3S sequences (Fig. S2). There were many similar examples, such as ‘NI’ and ‘NG’, ‘PP’ and ‘PR’, ‘WN’ and ‘WK’, and so on (Fig. S2). Therefore, there were different Aac probability profiles conditional on amino acids at sequentially preceding position in T3S and non-T3S sequences.

Fig. S2 also demonstrated a trend that serine was preferred after each type of amino acid in the preceding position in T3S sequences. However, statistically, the dimer ‘SS’ was not most significantly enriched when compared to other dimers (Fig. S2). The occurrence rank of ‘SS’ among dimers beginning with ‘S’ was not most significantly different between T3S and non-T3S sequences (Fig. S2). This might partly explain why a continual stretch of serines was not frequently found in N-terminal sequences of T3S proteins.

Probabilistic Modeling of the Overall Difference of Conditional Probability Profiles between T3S and Non-T3S Proteins

A sequential likelihood ratio variable based on Markov model, R, was created to measure the overall difference of conditional probability profiles on position-adjacent Aac between T3S and non-T3S proteins (Methods). The R values were calculated and statistically analyzed for T3S and non-T3S sequences.

As shown in Fig. 2A, the R values for T3S and non-T3S sequences could be fit to two distinct distributions. According to the forms, the distribution of T3S R values was approximated to a normal distribution with a mean of 0.28 and a standard deviation of 0.26, while the distribution of non-T3S R values was approximated to another normal distribution with a mean of −0.28 and a standard deviation of 0.22 (Fig. 2A). Both normal Q–Q plot analysis and Shapiro-Wilk normality test supported the normal approximation for the two distributions (Fig. 2A).

Figure 2
Probabilistically modelling the overall difference of conditional probability profiles of T3S and non-T3S sequences.

The absolute probabilities of individual amino acids were considered as coefficients to calculate the weighted R values of T3S and non-T3S sequences. Like R values, the weighted R values of two types of proteins also followed distinct approximated normal distribution (mean and standard deviation were respectively 0.29 and 0.24 for T3S sequences, and −0.29 and 0.22 for non-T3S sequences) (Fig. 2B).

Classification of T3S Signal Sequences Based on R and Derived Values

Based on the probabilistic modeling results, a protein could be classified as T3S or non-T3S sequence according to a selected cutoff R value. The training dataset with 154 putative T3S effectors and 308 non-T3S proteins were used for classifying performance evaluation (Text S1).

With T3_MM, the prediction model based on distribution of R values, the sensitivity and selectivity varied with different cutoff values (Fig. 3). According to the ROC curve, an optimized cutoff was selected, ensuring the best distinguishing power. For T3_MM, a cutoff R value of 0 could well distinguish T3S sequences, with a sensitivity of 89.6% at a selectivity of 90.9% (Fig. 3 and Table 1). The cutoff based on ROC curve was very similar to the discriminant function resulted value (−0.025, Methods).

Figure 3
Receiver Operating Characteristic curves of different T3S protein classification models.
Table 1
The classifying performance of different models on T3S and non-T3S training data.

The performance of weighted R values based model (wT3_MM) and individual amino acid probability based model (T3_iAA) were also evaluated, and compared with that of T3_MM (Fig. 3 and Table 1). As shown by the ROC figure and different performance parameters, T3_MM was best among all three models, though the difference between T3_MM and wT3_MM was not striking (Fig. 3 and Table 1). Both T3_MM and wT3_MM significantly outperformed T3_iAA, with respect to sensitivity, specificity, accuracy, MCC, and others (Fig. 3 and Table 1).

Support Vector Machine (SVM), Generalized Linear Model (GLM) and RandomForest (RF) models were also used to train the Aac conditional probability features. Among them, SVM could achieve a better specificity but at a loss of sensitivity and accuracy (Table S1). The other two models, however, performed significantly worse than T3_MM (Table S1).

Performance Evaluation and Comparison of T3_MM and other Established T3S Protein Prediction Methods

To better evaluate the performance of T3_MM to predict T3S signal sequences, a 5-fold cross validation strategy was adopted to the training datasets. As shown in Table 2, the method achieved an average sensitivity of ~ 83.9% at a specificity of ~ 90.3%. There are other well-established software programs to predict T3S proteins, among which BPBAac and Effective T3 were reported with best performance [15], [17]. With the same training dataset, all the parameters including sensitivity, specificity, accuracy, and MCC, showed that, T3_MM performed better than Effective T3 (Table 2) and other softwares such as SIEVE, SSE-ACC, etc. (data not shown). However, BPBAac achieved better performance than T3_MM (Table 2).

Table 2
Performance comparison between T3_MM, BPBAac and Effective T3 on training dataset.

Other new test datasets, of which the sequences were not included in the training dataset, were also collected to further compare the performance of models. A Ralstonia T3S and non-T3S protein dataset was tested, from which all the sequences were not included in the training data of T3_MM or Effective T3, and were excluded from the training data of BPBAac model (Methods; Text S2) [21]. As shown in Table 3, T3_MM could most effectively distinguish the T3S and non-T3S proteins, whereas the BPBAac and Effective T3 seemed not very stable, with a quite low recall value even at a comparable (or slightly higher) selectivity.

Table 3
Performance comparison between T3_MM, BPBAac and Effective T3 on new datasets.

To avoid overestimating the general prediction performance of T3_MM based on a specific genus or species, another large-scale T3S dataset from different Pseudomonas strains was also included for performance evaluation [22]. Again, T3_MM showed the best classification performance, with marked increase of recall value and general prediction accuracy, at a cost of slightly lowered selectivity (Table 3).

It is still possible that T3_MM only works well for some specific genera and is not generally applicable. An inter-genera cross validation strategy (Methods) was adopted to observe the inter-genera prediction capability of this R value-based model. For most genera, the recall percentage of known effectors was high (~ 80%) at an acceptable specificity (>85%) (Fig. 4). Even in the worst case scenario (i.e., classification of Chlamydia effectors based on non-Chlamydia model), 68% of the known effectors (13/19) were correctly recognized (Fig. 4).

Figure 4
Inter-species cross validation of the T3S effector predictions.

Taken together, the T3_MM algortithm was able to efficiently classify T3S proteins from non-T3S proteins with high sensitivity and general prediction accuracy. The model could also be applied to different bacterial genera or phyla. The actual specificity of T3_MM could be higher since the “non-T3S” sequences in the training or testing datasets could contain some unknown effectors.

Amino Acid Composition Properties of T3S Signal Sequences

Based on the probability matrix and T3_MM model, any given peptide sequence could be calculated for its probability to be a T3S sequence. However, it is extremely computationally demanding to calculate or compare the probability of all possible peptides of length 100 aa. To analyze the preferred and unfavorable amino acid composition in T3S signal sequences, a selected group of continual bi-amino acid (bi-aa) sequences were computationally simulated and classified using T3_MM and BPBAac, respectively (Table S2). According to the general composition of single amino acids and the relative composition preference in T3S and non-T3S proteins (Fig. S1), a sequence purely composed by serine was expected to have the highest prediction value. Consistent with this hypothesis, BPBAac gave the sequence formed by continuous serines the highest score, since the serine composition in most positions was apparently higher than other amino acids and different between T3S and non-T3S proteins (Table S2; Table 4). T3_MM, however, predicted that a string of proline and ‘NS’ (together with ‘SN’ because ‘SN’ could not be excluded from the continual ‘NS’ string) were more likely to be T3S secreted sequences (Table S2; Table 4). The discrepancy between T3_MM and BPBAac results was likely caused by the different basis of the T3_MM model: dependence on sequentially adjacent amino acids rather than absolute or relative composition of individual amino acids. The bi-aa composition of ‘PP’ or ‘NS’ was significantly different between T3S and non-T3S sequences, and the difference was more marked than ‘SS’, leading to the higher T3_MM prediction score for ‘PP’ or ‘NS’ than ‘SS’ string (Fig. 1). Similarly, BPBAac frequently scored bi-aa strings higher values if either of the two amino acids were selectively preferred by T3S proteins, such as ‘SX’ or ‘XS’, where ‘X’ represented any amino acid (Table S2; Table 4). In contrast, T3_MM often gave these bi-aa strings different prediction values. For example, all the ‘SX’ or ‘XS’ strings were predicted with high scores using BPBAac, while the scores predicted by T3_MM were apparently different, with 3 pairs of strings (‘SC’/‘CS’, ‘SW’/’WS’, and ‘SM’/‘MS’) classified as non-T3S sequences (Table S2). Moreover, some amino acids were either not enriched in T3S signal sequences, or not differently preferred by T3S and non-T3S sequences, such as isoleucine and cysteine (Fig. S1). Therefore, most ‘CX’/‘XC’ and ‘IX’/‘XI’ strings (including ‘CI’/‘IC’ string) were predicted by BPBAac to be non-T3S sequences (Table S2). T3_MM also classified strings solely composed of isoleucine or cysteine as non-T3S proteins (Table S2). However, the bi-aa composition of ‘IC’ or ‘CI’ conditional on the preceding amino acid (‘I’ or ‘C’, respectively) was significantly different between T3S and non-T3S proteins, and consequently, T3_MM gave ‘IC’/‘CI’ strings quite high score and classified them to be T3S sequences (Table S2). The 30 bi-aa sequences given the highest and lowest prediction scores with T3_MM and BPBAac, respectively are shown in Table 4.

Table 4
The 30 simulated bi-aa sequences of highest (Pos) and lowest (Neg) prediction scores with T3_MM and BPBAac.

Because there are too many combinations of amino acids in 100 positions, we cannot test all possible peptides with the method described above. A dynamic programming algorithm was further designed to find out the most favorable and unfavorable signal sequences for T3S recognition. The results were shown in Table 5. The continual stretch of proline was found to be most favorable. Interestingly, in the most unfavorable T3S sequence, proline covered nearly 1/3 of the total 100 positions (Table 5) further demonstrating the significant constraint imposed by adjacent amino acids in T3S sequences. The most favorable and unfavorable T3S sequences were also classified with BPBAac, with a confidently high and a low SVM score, respectively (Table 5).

Table 5
The most favorable and unfavorable T3S peptide sequence inferred by dynamic programming algorithm.

Prediction and Comparison of Salmonella T3S Effectors

T3_MM was applied to predict T3S effectors from Salmonella genomes of different serovars (Methods). The number of predicted effectors was generally proportional to the genome size, with the number of T3_MM predicted effectors representing 12.2±1.3% of the total number of genome-encoding proteins. In comparison, the ratio of effector proteins predicted by BPBAac was 5.6±0.5% (Table S3 and S4; Fig. 5 and Table 6). A stable percentage of effectors (about 25% of the number predicted by BPBAac) were predicted by both software programs (Table 6; Table S5). For each strain, the number of effectors predicted by T3_MM was about 2-fold of that predicted with BPBAac (2.18±0.29; Table 6). Some recently identified effectors were successfully predicted by T3_MM but not BPBAac. For example, GtgE (i.e., SL14028 STM14_1196 and its orthologs in S. Typhimurium strains) was an effector validated recently, which could render S. typhi the ability to infect mice (Table S3 and S4) [23][24]. GtgE was not included in the training dataset of T3_MM or BPBAac, but it could be recalled by T3_MM rather than BPBAac. Therefore, though at the cost of more possible false positives, the larger number of candidates predicted by T3_MM should also provide more true T3S effectors.

Figure 5
Summary of the total genome-encoding proteins, T3_MM predicted T3S effectors and BPBAac predicted T3S effectors in Salmonella.
Table 6
Summary of Salmonella effectors predicted by T3_MM and BPBAac.

The shared effectors predicted by both T3_MM and BPBAac were further analyzed since these effectors should have both position-specific and adjacent-constraint T3S signal features and therefore could be more likely to be true ones (Table S5). There were 70 effectors predicted by both programs in S. enterica serovar Typhimurium LT2 (Table 6); 17 (24.3%) of these were currently known T3S effectors (Table S5, Type I or II). Another 3 of the predicted genes, STM2584, STM1318 and STM2050, may also encode T3S effectors (Table S5, Type III), based on predictions taking into account various structural features (Wang et al., unpublished data). 13 genes (18.6%, 13/70) were hypothetical with unknown function, or originated from bacteriophages (Table S5, Type IV). Two other genes, invE and STM1082, were closely related with T3SS function (Table S5, Type V). InvE encodes an accessory protein which is necessary for type 3 secretion of substrates while STM1082 encodes an AraC-family transcriptional regulator, an important type of T3SS gene regulator [2]. It is worth noting that there were also predicted effectors (11.4%, 8/70), which were annotated as flagella-related proteins (Table S5, Type VI). T3SSs were reported to be evolutionarily related to flagella, and therefore, the flagella-related proteins and T3S effectors could share many sequence properties. These genes could also be improperly annotated as flagella-related proteins. The remaining 27 predicted effectors could participate in different biological processes or pathways (Table S5, Type VII).

The number of predicted effectors was different in different Salmonella strains (Table S5). It is interesting to identify strain-specific effectors. A comprehensive comparison was consequently performed to the effector sets in 3 Salmonella serovar Typhimurium strains, LT2, 14028s, and SL1344. The LT2 genome was sequenced ten years ago, while the genomes of 14028s and SL1344 were published recently [25][26]. Table 7 showed the specific effectors of individual strains. Two LT2-specific genes, STM2703 and STM0909, both encoding hypothetical proteins with unknown function, did not have orthologs in 14028s or SL1344 (Table 7, in bold). It is possible that STM2703 and STM0909 were obtained by horizontal transfer events. SL1344 and 14028s have two and four potential horizontally-acquired strain-specific genes, respectively, including known sopE (SL2674) in SL1344 (Table 7, in bold). In addition to the possible effectors without sequence homologs, each Typhimurium strain also had strain-specific effectors with sequence homologs in at least one other strain (Table 7, in italic). Closer analysis of the homologous sequences in other strains indicated they may have lost T3S signal features as a result of mutation and therefore were not recognized by T3SS.

Table 7
Predicted strain-specific T3S effectors.


It is still an enigma how bacterial type III effectors are specifically recognized and secreted by type III secretion conduits. Previous experimental and bioinformatic analysis indicated that the signal sequences of type III effectors contained specific amino acid composition, such as being enriched in serine residues [10], [15], [17]. It is not yet known whether the amino acid composition influences the specificity of type III secretion, although some researchers have hypothesized that the amino acid composition is important for keeping the sequence more flexible and useful for specific recognition [7]. In this research, we further analyzed specific Aac features of T3S proteins. Our results highlighted the existence of Aac dependence relationship between adjacent positions in T3S signal sequences (Fig. 1). A closer observation and exploration of the dependence between adjacent amino acids could possibly provide interesting clues about the evolution and recognition mechanisms of type III signal sequences.

In this research, we used a simple Markov model-based variable for the Aac dependent on adjacent residues, followed by an observation and approximation of the variable distribution, for prediction of new T3S effectors [15], [17][20]. The Markov model was adopted because it is simple, statistically sound and can be well fit to time or space sequences. It also has been widely applied in biological sequence modeling. Our model was proved to be both effective and quantitative for predicting T3S effectors. The simplicity of the model suggests that further exploration of the Aac features of T3S signal sequences could yield important information about secretion recognition. Simplicity also ensures a more stable classification performance of the model, as was demonstrated by training data and different test datasets (Tables 1, ,2,2, ,3).3). We also tried other learning and classifying models, including widely adopted SVM, GLM and RF. However, none of these methods was comparable to T3_MM, to classify the T3S and non-T3S proteins based on the conditional Aac features (Table S1). This could be caused by the conditional Aac features, which are sequence-based and therefore more suitable for a sequence-based Markov model. The T3_MM model is sequence-based rather than position-based, therefore, the model is tolerant to insertion or deletion of one or several amino acids, or the possibility of alternative start codons (data not shown). In addition, the T3_MM model is not sensitive to the variance of sequence length because it has been normalized for sequence length. We also developed a wT3_MM model weighted by the probabilities of individual amino acids. Although the wT3_MM R values seemed better fit to known normal distributions, the classifying performance was not as good as that of original R values (Fig. 3 and Table 1). Therefore, we recommend that T3_MM be applied in practice instead of wT3_MM.

Effective T3 and BPBAac are two T3S effector prediction tools with the best prediction performance. The T3_MM model consistently outperformed Effective T3 with the training dataset and on test datasets from Ralstonia and Pseudomonas species (Table 2 and and3).3). BPBAac performed best for classification of the training dataset (Table 2), but significantly worse than T3_MM when new independent datasets were used, especially for sensitivity and accuracy (Table 3). Excellent inter-genera classification results further demonstrated the stable performance of T3_MM (Fig. 4). In practice, users are suggested to adopt different strategies to apply the software for different objectives. T3_MM is a better choice when more effectors are expected to be found, because T3_MM can predict more true effectors which other software cannot predict correctly (e.g., the effector GtgE in S. Typhimurium, Tables S3 and S4). This is especially useful for identification of new effectors in model species, in which many effectors have been found and highly-specific software, such as BPBAac, could not provide new candidates. To combine T3_MM and BPBAac is also a good choice when higher specificity is desired. The prediction results of this combinational strategy have both sequential bi-residue composition features and position-specific Aac features, and these candidates are more specific, though with a tradeoff being a loss of many new effectors. In this research, we first predicted Salmonella T3S effectors with T3_MM, and found it could give a larger number of possible candidates, some of which were recently validated by experiments and not predicted by BPBAac. A combined prediction strategy was further used to screen more specific effectors for further comparison and analysis (the percentage of known effectors in all predictions was increased to ~25% from ~5% for T3_MM and ~9% for BPBAac). Many candidates were predicted by both programs, and most of them were conserved among different Salmonella serovars and stains (Table S5). In addition to the conserved and well-characterized effectors, the strain-specific ones, especially those whose encoding genes reside in a mobile region (e.g., prophage), are more interesting (Table 7). These potential effectors could be obtained through strain-specific horizontal gene transfer events, and exert a strain-specific molecular function. Careful comparison of the effectors among different bacterial strains would give some clues about the evolution or other knowledge of T3S effectors. For example, Salmonella was diverged to two currently observable species, S. enterica and S. bongori. All S. enterica strains contain two T3SSs (SPI-1 and SPI-2) while S. bongori didn’t obtain the SPI-2 T3SS [27]. Comparison of the S. bongori predictions with those of S. enterica strains, indicated that none of known SPI-2 T3S effectors were present while most SPI-1 effectors were present in S. bongori. This indicates that SPI-1 effectors were likely acquired before divergence of Salmonella species and that SPI-2 effectors may have been acquired in S. enterica subspecies or strains after the species divergence (Table S5; data not shown). The effector SlrP, which was previously considered as an effector of both SPI-1 and SPI-2 T3SSs [28], was present in S. bongori. This is an indication that slrP, as well as other inter-species conserved candidate effector genes, could participate in the SPI-1 T3SS activities. There were also many predicted S. bongori effectors that were not identified in S. enterica. These predicted SPI-1 T3SS effectors could potentially play important, species-specific and phenotype-specific roles in S. bongori and its interaction with cold-blooded hosts [27].

Based on the likelihood ratio matrices of adjacent bi-residues (and the first-position residues) between T3S and non-T3S proteins, the most favored and unfavored T3S sequence compositions were calculated using a dynamic programming algorithm (Table 5). The most preferred sequence was not composed of a stretch of serine resiudes, as was expected. This was also demonstrated by modelling analysis (Table 4). The results indicate that, due to the constraint exerted by neighbouring positions, the most significant preference of some residue (eg., serine) doesn’t necessarily mean the similar preference of continuous composition of that residue. In simulating analysis, however, we found a stretch of proline was most favorable, though proline was not as preferred by T3S proteins as serine in most N-terminal positions (Table 4 and and5).5). Experiments are required to test whether this is the case. Interestingly, the proline was also present in about 1/3 of the positions in the most unfavorable T3S sequence, further indicating the constraint of amino acid composition cause by its adjacent position (Table 5). It should be pointed out that in this modeling process, position information (i.e., position-specific bi-residue composition) was not considered, which could be more accurate theoretically but requires more known T3S proteins. Based on currently available validated T3S effectors, we calculated the most favorable T3S sequence by dynamic programming algorithms. The results were far different (e.g., the most favorable sequence of N-terminal 10-aa peptide being ‘TSWFAGDEKK’), and yet they were not stable, especially for the residues close to the C-termini. As more T3S effectors are validated, modeling based on position-specific bi-residue composition will become more feasible. These types of models are more likely to reveal hidden T3S motifs or unique amino acid composition features.

In conclusion, the T3_MM model that we have developed can be applied to identify new effectors from different bacterial species based on their genome sequences. As more T3S proteins are experimentally identified, the estimated parameters can be optimized and the model can be improved.


Data Source

The T3S and non-T3S training protein dataset was described in detail previously (Text S1) [17]. The dataset consisted of 154 non-homologous validated T3S proteins and 308 non-T3S proteins. The proteins were manually collected from different animal and plant pathogens or symbiotic bacteria, except Ralstonia [2], [17]. The non-T3S proteins were selected from the proteins encoded by different bacteria strains after removing the known effectors.

Two independent datasets were used for testing and comparing the performance of T3_MM and other software programs. For the first test dataset, the Ralstonia validated effectors were collected from a recent large-scale experimental study [21]. These effectors were identified by Cya translocation assay [21]. In total, 35 effectors and randomly selected 70 non-effectors from Ralstonia were included in this dataset (Text S2). None of the Ralstonia proteins were used in training dataset. The other testing dataset consists the most comprehensive list of known Pseudomonas effectors (Text S3) [22]. These effectors were annotated from literature with different experimental evidence [22]. 291 known effectors and 582 randomly selected control proteins from Pseudomonas were included. The control proteins were selected with a strategy similar with that of the training dataset. The ratio of size between positive and negative training/testing sequences was maintained at 1[ratio]2, according to previous experience and related reports [17], [29].

Assumption, Definition and Markov Model

Let vector An external file that holds a picture, illustration, etc.
Object name is pone.0058173.e001.jpg denotes a peptide sequence in which A represents amino acid while the number represents position and n represents the total length of S. Besides, let A0 denotes a hypothetically initial state of sequence S. Assume A0 probability P(A0) is 1 for each sequence S. The conditional probability of Ai+1 on the amino acid at sequentially preceding position is denoted as: P(Ai+1|Ai), where 0≤i<n. Assume the amino acid composition at one position is only dependent on its sequentially preceding position; consequently, the generating probability of an sequence S could be described as an one-order Markov chain:

equation image

Assume there are two categories of sequences (C1 and C2), and S could be sampled either from C1 or C2. The likelihood of sequence S belonging to category C is:

equation image

where C represents C1 or C2.

For each sequence S, a statistic variable R, is constructed to describe logarithm of the likelihood ratio between P(S|C1) and P(S|C2), i.e.,

equation image

where the base is set as 2, and log[P(Ai+1|Ai,C1)/P(Ai+1|Ai,C2)] is predefined as zero when P(Ai+1|Ai,C) equals to 0.

For the models studied in this work, C1 and C2 represent T3S and non-T3S proteins, respectively. The probabilities of individual amino acids for T3S and non-T3S proteins, are used as the coefficients for weighted T3_MM model (wT3_MM).

T3_iAA assumes that amino acids in sequence S are independent on each other, and the probabilities of different S with fixed length of n sum to 1. Therefore, the probability of S equals to the probability product of each constitute amino acid. T3_iAA also calculates the logarithm value of likelihood ratio that S being T3S or non-T3S protein.

All the conditional probabilities, P(Ai|C) or P(Ai+1|Ai,C) (0≤i<n, C = C1 or C2), are estimated using maximum likelihood method. The negative logarithm of probability is also calculated for more direct comparison and observation.

Probability Distribution, Parameter Estimation and Decision Function

The R values for each T3S protein are calculated, and a histogram is drawn afterwards to represent the R distribution. A density curve is derived from the normal Q–Q plot and Shapiro-Wilk normality test are further adopted to test whether the observed distribution is a normal distribution. For normal distribution, the parameters, mean (μ) and standard deviation (σ), are estimated using a maximum likelihood method. The R values for non-T3S proteins, and weighted R values for T3S and non-T3S proteins, are all calculated and analysed with the same strategy.

R values of T3S and non-T3S proteins are ideally fitting to two distinct probability distributions: FC1 and FC2, respectively. Suppose mean μ(FC1) is not smaller than μ(FC2). For any sequence S and its R value r, PC1(R|R≤r) and PC2(R|R≥r) represent the probability of S according to FC1 and FC2 distribution, respectively. Let discriminant function D(r) = PC1(R|R≤r)−PC2(R|R≥r). If D(r)≥0, r follows FC1 distribution and S belongs to C1 or T3S proteins; otherwise, D(r)<0, r follows FC2 distribution and S belongs to C2. When r follows FC1 distribution, the probability of S being a C1 or T3S protein is the mean of PC1(R|R≤r) and 1−PC2(R|R≥r). When r follows FC2 distribution, the probability of S being a C2 or non-T3S protein is the mean of PC2(R|R≥r) and 1−PC1(R|R≤r).

Performance Assessment

Accuracy (A), Specificity (Sp), Sensitivity (Sn), Receiver Operating Characteristic (ROC) curve and Matthews Correlation Coefficient (MCC) were utilized to assess the predictive performance. In the following formula, A denotes the percentage of both positive instances (T3S) and negative instances (non-T3S) correctly predicted. Sn (true positive rate) and Sp (true negative rate) respectively represent the percentage of positive instances (T3S) and the percentage of negative instances (non-T3S) correctly predicted. An ROC curve is a plot of Sn versus (1-Sp), and is generated by shifting the decision threshold. AUC gives a measure of classifier performance. MCC takes into account true and false positives and false negatives and is generally regarded as a balanced measure which can be used even if the classes are of very different sizes.

equation image

where TP, TN, FP and FN denotes the number of true positives, true negatives, false positives and false negatives, respectively.

To avoid overfitting of T3_MM, a 5-fold cross-validation strategy was adopted to evaluate its classification performance. The training dataset was divided into 5 subsets, each with identical number of positive and negative sequences. Four subsets were put together for training and the remaining subset was used for testing. The process was repeated so that all sequences were tested once. The performance parameters were evaluated as the average values of the cross-validation results.

To test the robustness of T3_MM, an inter-species cross-validation strategy was adopted. The T3S and non-T3S proteins of a targeted genus (or phylum/subgroup) were extracted from the training dataset at first. The remaining sequences were used to re-train the model, which in turn was used to test the proteins of targeted genus (or phylum/subgroup). The sensitivity and specificity were calculated thereafter.

Comparison with other Software Programs

The Support Vector Machine (SVM), Generalized Linear Model (GLM) and RandomForest (RF) were also used for training the conditional Aac features. Because the size of features was large (400), and the length of signal sequences was 100 aa, only the bi-residues statistically different between T3S and non-T3S sequences were included for training (binomial test, FDR-corrected p<0.05). R packages were adopted to implement SVM (‘e1071’), GLM (‘faraway’) and RF (‘RandomForest’), respectively (

The performance of T3_MM was also compared with other established T3S protein prediction models, Effective T3 [15] and BPBAac [17]. The original methods and optimal parameters were used for re-training the models with new training datasets. To compare the performance of each type of software to classify the two testing datasets, the default parameters were used, except sensitive cutoff values were adopted for either model (a probability of 0.95 for Effective T3 and an SVM value of 0.0 for BPBAac), since selective cutoff values for both models gave quite low recalls for the test datasets [15], [17].

Most and Least Possible T3S Signal Sequences

A dynamic programming algorithm was designed to find out the most and least possible T3S signal sequences based on the log odds of probabilities of individual amino acids and di-residues. Local maximal (minimal) sum of log odds of first-position individual amino acids and sequential di-residues between T3S and non-T3S sequences were recursively calculated. The path for continual local maximal (minimal) values was recorded and it was recognized as the most (least) possible T3S signal sequence.

Prediction, Comparison and Annotation of Salmonella Effectors

Genome and genome-encoding protein sequences of Salmonella strains were downloaded from the NCBI website: The strains and their genome accessions included: S. typhimurium LT2 (NC_003197), 14028s (CP001363), SL1344 (NC_016810), DT104, S. typhi CT18 (NC_003198), Ty2 (NC_004631), S. paratyphi A AKU_12601 (NC_011147), ATCC9150 (NC_006511), S. paratyphi B SPB7 (NC_010102), S. paratyphi C RKS4594 (NC_012125), S. enteritidis P125109 (AM933172), S. gallinarum 287/91 (NC_011274), S. dublin CT_02021853 (NC_011205), S. Schwarzengrund CVM19633 (NC_011094), S. newport SL254 (NC_011080), S. heidelberg SL476 (NC_011083), S. choleraesuis SC-B67 (NC_006905), S. agona SL483 (NC_011149), S. bongori NCTC_12419 (NC_015761), and S. arizonae RSK2980 (NC_010067). The genome-encoding sequences were input to the T3_MM server ( with default parameters for T3S protein prediction. BPBAac ( was also used to predict effectors in different bacteria. A sensitive cutoff value, 0.0, was set for BPBAac prediction. To find out the orthologs of two strains, a reciprocal alignment was performed to the protein sequences of any pair of genomes with blast program (blastp, evalue <0.0005). The orthologs were defined as the mutual best alignment hits. Gene order information was also analyzed and used as additional evidence. The Genbank annotations for LT2 and other genomes were referred for function annotation of predicted effectors.

Supporting Information

Figure S1

Amino acid composition difference between T3S and non-T3S sequences. Horizontal axis: twenty types of amino acids. Vertical axis: negative logarithm of the composition probability of corresponding amino acid.


Figure S2

Comparison of Aac probability profiles conditional on preceding-position amino acid. Horizontal axis: sequentially adjacent two amino acids. Vertical axis: negative logarithm of the conditional probability of corresponding bi-amino acids (bi-aa). T3S and non-T3S sequences were shown in black bars and grey bars, repectively. WW, WY and MV were not present in T3S sequences, therefore, the probability for these residues was replaced with 1/1000 so as to avoid an infinite logarithm value. Bi-aa with conditional probability significantly different from absolute probability in T3S sequences but not significant in non-T3S sequences were marked with a star above the bar (T test, p<0.05). Among bi-aas with the same first-position residue in T3S sequences, bi-aa with the rank of conditional probability significantly different from that of absolute probability was marked with an upward (rank difference between conditional and absolute probability ≤−5; the smaller the rank value, the higher the probability) or downward arrow (difference ≥5) above the bar. Similarly, among bi-aas with the same first-position residue, bi-aa with the rank of conditional probability in T3S sequences significantly different from that of non-T3S sequences was marked with a backward arrow (rank difference between conditional probability of T3S and non-T3S sequences ≤−5) or forward arrow (difference ≥5) below the bar.


Table S1

Performance comparison for Markov model (T3_MM), SVM, GLM and RF training the conditional Aac features.


Table S2

Predicted score of simulated sequences.


Table S3

T3_MM predicted Salmonella effectors.


Table S4

BPBAac predicted Salmonella effectors.


Table S5

Salmonella effectors predicted by T3_MM and BPBAac.


Text S1

Training sequences.


Text S2

Mukaihara 2010 Ralstonia T3S proteins.


Text S3

Baltrus 2011 comprehensive Pseudomonas T3S protein.


Funding Statement

The authors have no support or funding to report.


1. Hueck CJ (1998) Type III protein secretion systems in bacterial pathogens of animals and plants. Mol. Biol. Rev., 62, 379–433. [PMC free article] [PubMed]
2. Wang Y, Huang H, Sun M, Zhang Q, Guo D (2012) T3DB: an integrated database for bacterial Type III Secretion System. BMC Bioinformatics 13: 66. [PMC free article] [PubMed]
3. Enninga J, Rosenshine I (2009) Imaging the assembly, structure and activity of type III secretion systems.Cell Microbiol., 11, 1462–1470. [PubMed]
4. Izoré T, Job V, Dessen A (2011) Biogenesis, regulation, and targeting of the type III secretion system. Structure, 19, 603–12. [PubMed]
5. Lindeberg M, Collmer A (2009) Gene Ontology for type III effectors: capturing processes at the host-pathogen interface. Trends Microbiol., 17, 304–11. [PubMed]
6. Feng F, Zhou JM (2012) Plant-bacterial pathogen interactions mediated by type III effectors. Curr Opin Plant Biol., 15, 469–476. [PubMed]
7. Galán JE, Wolf-Watz H (2006) Protein delivery into eukaryotic cells by type III secretion machines. Nature, 444, 567–73. [PubMed]
8. Karavolos MH, Roe AJ, Wilson M, Henderson J, Lee JJ, et al. . (2005) Type III secretion of the Salmonella effector protein SopE is mediated via an N-terminal amino acid signal and not an mRNA sequence. J. Bacteriol., 187, 1559–1567. [PMC free article] [PubMed]
9. Lloyd SA, Norman M, Rosqvist R, Wolf-Watz H (2001) Yersinia YopE is targeted for type III secretion by N-terminal, not mRNA, signals. Mol. Microbiol., 39, 520–531. [PubMed]
10. Lloyd SA, Sjöström M, Andersson S, Wolf-Watz H (2002) Molecular characterization of type III secretion signals via analysis of synthetic N-terminal amino acid sequences. Mol. Microbiol., 43, 51–59. [PubMed]
11. Rüssmann H, Kubori T, Sauer J, Galán JE (2002) Molecular and functional analysis of the type III secretion signal of the Salmonella enterica InvJ protein. Mol. Microbiol., 46, 769–779. [PubMed]
12. Stebbins CE, Galán JE (2001) Maintenance of an unfolded polypeptide by a cognate chaperone in bacterial type III secretion. Nature, 414, 77–81. [PubMed]
13. Wang Y, Hou Y, Huang H, Liu GR, White AP, et al. . (2008) Two oral HBx vaccines delivered by live attenuated Salmonella: both eliciting effective anti-tumor immunity. Cancer Lett, 263, 67–76. [PubMed]
14. Subtil A, Delevoye C, Balañá ME, Tastevin L, Perrinet S, et al. . (2005) A directed screen for chlamydial proteins secreted by a type III mechanism identifies a translocated protein and numerous other new candidates. Mol. Microbiol., 56,1636–47. [PubMed]
15. Arnold R, Brandmaiers, Kleie F, Tischler P, Heinz E, et al. . (2009) Sequence-based prediction of type III secreted proteins. PLoS pathogens, 5, e1000376. [PMC free article] [PubMed]
16. Arnold R, Jehl A, Rattei T (2010) Targeting effectors: the molecular recognition of Type III secreted proteins. Microbes Infect., 12, 346–358. [PubMed]
17. Wang Y, Zhang Q, Sun MA, Guo D (2011) High-accuracy prediction of bacterial type III secreted effectors based on position-specific amino acid composition profiles. Bioinformatics, 2011, 27, 777–84. [PubMed]
18. Löwer M, Schneider G (2009) Prediction of type III secretion signals in genomes of gram-negative bacteria. PloS one, 4, e5917. [PMC free article] [PubMed]
19. Samudrala R, Heffron F, McDermott JE (2009) Accurate prediction of secreted substrates and identification of a conserved putative secretion signal for type III secretion systems. PLoS pathogens, 5, e1000375. [PMC free article] [PubMed]
20. Yang Y, Zhao J, Morgan RL, Ma W, Jiang T (2010) Computational prediction of type III secreted proteins from gram-negative bacteria. BMC Bioinformatics, 11 Suppl 1, S47. [PMC free article] [PubMed]
21. Mukaihara T, Tamura N, Iwabuchi M (2010) Genome-wide identification of a large repertoire of Ralstonia solanacearum type III effector proteins by a new functional screen. MPMI, 23, 251–262. [PubMed]
22. Baltrus DA, Nishimura MT, Romanchuk A, Chang JH, Mukhtar MS, et al. (2011) Dynamic Evolution of Pathogenicity Revealed by Sequencing and Comparative Genomics of 19 Pseudomonas syringae Isolates. PLoS Pathog 7(7): e1002132. [PMC free article] [PubMed]
23. Spanò S, Liu X, Galán JE (2011) Proteolytic targeting of Rab29 by an effector protein distinguishes the intracellular compartments of human-adapted and broad-host Salmonella. Proc Natl Acad Sci U S A. 108: 18418–18423 [PubMed]
24. Spanò S, Galán JE (2012) A Rab32-dependent pathway contributes to Salmonella typhi host restriction. Science 338: 960–963 [PubMed]
25. Jarvik T, Smillie C, GroismanEA, Ochman H (2010) Short-term signatures of evolutionary change in the Salmonella enterica serovar typhimurium 14028 genome. J. Bacteriol., 192 (2), 560–7. [PMC free article] [PubMed]
26. Kröger C, Dillon SC, Cameron AD, Papenfort K, Sivasankaran SK, et al. . (2012) The transcriptional landscape and small RNAs of Salmonella enterica serovar Typhimurium. Proc. Natl. Acad. Sci. U S A., 109 (20), E1277–86. [PubMed]
27. Fookes M, Schroeder GN, Langridge GC, Blondel CJ, Mammina C, et al. . (2011) Salmonella bongori provides insights into the evolution of the Salmonellae. PLoS Pathog., 7(8), e1002191. [PMC free article] [PubMed]
28. Burnal-Bayard J, Cardenal-Munoz E, Ramos-Morales F (2010) The Salmonella type III secretion effector, Salmonella leucine-rich repeat protein (SlrP), targets the human chaperone ERdj3. J Bio Chem., 285(21), 16360–16368. [PMC free article] [PubMed]
29. Kim JH, Lee J, Oh B, Kimm K, Koh I (2004) Prediction of phosphorylation sites using SVMs. Bioinformatics, 20, 3179–3184. [PubMed]
30. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B 57: 289–300

Articles from PLoS ONE are provided here courtesy of Public Library of Science