Home | About | Journals | Submit | Contact Us | Français |

**|**BioData Min**|**v.3; 2010**|**PMC3017041

Formats

Article sections

- Abstract
- Introduction
- Background
- Methods
- Results and Discussion
- Conclusion
- Abbreviations
- Competing interests
- Authors' contributions
- References

Authors

Related links

BioData Min. 2010; 3: 11.

Published online 2010 December 17. doi: 10.1186/1756-0381-3-11

PMCID: PMC3017041

Derrick K Rollins: ude.etatsai@snillord; AiLing Teh: moc.liamg@48lahet

Received 2010 June 30; Accepted 2010 December 17.

Copyright ©2010 Rollins and Teh; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Microarray data sets provide relative expression levels for thousands of genes for a small number, in comparison, of different experimental conditions called *assays*. Data mining techniques are used to extract specific information of genes as they relate to the assays. The multivariate statistical technique of principal component analysis (PCA) has proven useful in providing effective data mining methods. This article extends the PCA approach of Rollins et al. to the development of ranking genes of microarray data sets that ** express most differently **between two biologically different grouping of assays. This method is evaluated on real and simulated data and compared to a current approach on the basis of false discovery rate (FDR) and statistical power (SP) which is the ability to correctly identify important genes.

This work developed and evaluated two new test statistics based on PCA and compared them to a popular method that is not PCA based. Both test statistics were found to be effective as evaluated in three case studies: (i) exposing *E. coli *cells to two different ethanol levels; (ii) application of myostatin to two groups of mice; and (iii) a simulated data study derived from the properties of (ii). The proposed method (PM) effectively identified critical genes in these studies based on comparison with the current method (CM). The simulation study supports higher identification accuracy for PM over CM for both proposed test statistics when the gene variance is constant and for one of the test statistics when the gene variance is non-constant.

PM compares quite favorably to CM in terms of lower FDR and much higher SP. Thus, PM can be quite effective in producing accurate signatures from large microarray data sets for differential expression between assays groups identified in a preliminary step of the PCA procedure and is, therefore, recommended for use in these applications.

It is well known that living organisms have complicated gene structures. However, while major advancements have been made in recent years, understanding of the biological functions of each individual gene is still quite limited. Active research is strongly focused on understanding the behavior of genes and as well as the highly complex metabolism and regulatory network inside living cells [1]. This effort falls under a molecular biological field called functional genomics (FG). There are at least three areas in which experimental techniques are widely applied in FG: transcriptomics, proteomics, and metabolomics [2]. A combination of leading scientific techniques as well as powerful mathematical and statistical tools for data analysis makes the task of identifying important transcriptome, proteome, and metabolome corresponding to a biological effect promising. Typical studies in these areas involve the identification of possible behavior and responses of species under various genetic backgrounds as well as environmental factors (i.e. assay).

There are different high technology techniques applied in FG field to advance understanding of the transcriptional genetic response of many organisms in various environmental perturbations [1]. One of the techniques that have been adopted in this field is a multiplex technology called DNA microarray [3]. A new technique that is becoming popular and will probably displace array-based measurement in FG is next-generation sequencing (RNAseq) [4,5]. These techniques have the ability to generate data sets that consist of expression levels of thousands of genes, providing a wealth of information that is hidden by high noise levels, low signal levels, and a relatively small number of experimental units to the number of genes studied. More specifically, since the data set containing the gene expression measurements consists of a lot more genes than assays, analytical techniques are needed to provide accurate gene identification under a large number of gene candidates that is much greater than the number of experimental runs.

To achieve this objective, traditional statistical methods, such as principal component analysis (PCA) [2-8], the focus of this article, are being retrofitted to provide effective statistical inference in this challenging context of microarray data analysis. Other methods used in this field included linear model analysis [9-14], Bayesian method [15-17] and network component analysis (NCA) [18-20]. Thus, statistics is playing a critical role through the development of methodologies that give high statistical power (SP) (i.e., accurate identification), and low false discovery rate (FDR)[21] (i.e. low misidentification). To this end, this article introduces two new PCA based statistics for determining gene rank for *differential expression *between two PCA identified assay groups. This work extends the technique introduced by Rollins et al.[2] that determines gene rank for a *single *PCA identified assay group. Thus, the proposed method (PM) in this work is aimed at finding the genes with high expression levels in one group and low expression levels in the other group.

The PM uses PCA to first establish the existence of the assay groupings of interest. Then using the results that established the grouping, the differential contribution for each gene is determined using a statistic based on eigenvalues. This article proposes and evaluates two statistics. The first one is the group averaged difference of eigenvalue linear combinations that we call *T _{diff}*. The second one divides

The CM and PM are applied in the following three case studies to compare their effectiveness (i.e., power) in identifying assay-specific signature: (i) exposure of *E. coli *cells to two different levels of ethanol concentration [22]; (ii) the use of myostatin as inhibitor of skeletal muscle growth for five 5-weeks-old myostatin and non-treated mice [10]; and (iii) a simulation study based on statistical properties of the second case study.

This work is organized into the following sections. The Background Section gives a brief review of PCA and connects it to our application in FG's data analysis. This section is followed by the Methods Section that derives and presents the test statistics of the CM and PM. These test statistics are evaluated and compared in three studies in the Results and Discussion Section. The final section summarizes the results and gives concluding remarks on the contribution of this work.

The microarray data set is given as an *m *by *n *matrix **X **where *n *is the number of assays expressed along columns (i.e. variables) and *m *represents the number of genes expressed along rows. The cells in this matrix are given as *x _{ij }*which is the expression level of the

An illustration is given in Figure Figure11 that shows a visual representation of a two-dimensional data system (*x*) and a rotated data system (*z*). As shown, the new coordinated system points *z _{1 }*in the direction with the greatest spread in the data. The other variable,

The top of Figure Figure22 shows the relationship between the original data matrix, **X**, the *n *by *n *PC loading matrix, **L**, and the *m *by *n *pseudo data matrix, called the scores matrix, **S**. The PCs derived from **X **are called eigengenes (EG) because the elements of **S **represent pseudo values for gene expression. In Figure Figure22 the bottom set of matrices are derived from the transpose of **X **which is an *n *by *m *matrix. In this case the loading matrix is *m *by *n *in dimension and the scores matrix is *n *by *n *in dimension. The PCs derived from the transpose of **X **are called eigenassays (EA) because the elements of the scores matrix represent pseudo assays. The proposed method (PM), following Rollins et al. [2], uses both EG and EA approaches to develop signatures sets of ranked genes. In the next section we derive the EG and EA statistics for determining gene contribution for the PM.

The first step in the eigengene (EG) approach of the PM is to standardized the elements of **X **to give the standardized matrix **Z **with each element equal to ${z}_{ij}=\left({x}_{ij}-{\overline{x}}_{j}\right)/{s}_{j}$, where ${\overline{x}}_{j}$ and *s _{j }*are the sample mean and sample standard deviation of the data in column

$$\begin{array}{c}{s}_{ij}^{EG}={\ell}_{1j}^{EG}{z}_{i1}+{\ell}_{2j}^{EG}{z}_{i2}+\dots +{\ell}_{nj}^{EG}{z}_{in}={\displaystyle \sum _{k=1}^{n}{\ell}_{kj}^{EG}{z}_{ik}}\\ ={g}_{ij1}^{EG}+{g}_{ij2}^{EG}+\dots +{g}_{ijn}^{EG}={\displaystyle {\sum}_{k=1}^{n}{g}_{ijk}^{EG};}\\ i=1,\dots ,m;j=1,\dots ,n;k=1,\dots ,n\end{array}$$

(1)

where ${s}_{ij}^{EG}$ is the score for the *i*^{th }gene using the *j*^{th }vector of EG loadings, ${\ell}_{ij}^{EG}$ is the *i*^{th }loading for the *j*^{th }EG vector, and ${g}_{ijk}^{EG}$ is the contribution for the *i*^{th }gene, on the *k*^{th }assay from the *j*^{th }EG loading vector. Let A = Group A with *n _{A }*assay members and B = Group B with

$$\text{2}\le {n}_{A}+{n}_{B}\le n$$

(2)

The mean contribution for *i*^{th }gene from the *j*^{th }EG loading vector for Groups A and B, respectively are

$${\overline{g}}_{ij}^{E{G}_{A}}=\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime}{\ell}_{k\prime j}^{EG}{z}_{ik\prime}}=\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime}{g}_{ijk\prime}^{EG}}$$

(3)

$${\overline{g}}_{ij}^{E{G}_{B}}=\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime \prime}{\ell}_{k\prime \prime j}^{EG}{z}_{ik\prime \prime}}=\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime \prime}{g}_{ijk\prime \prime}^{EG}}$$

(4)

where *k' *and *k'' *are the assay members in Groups A and B, respectively. Finally, the EG differential gene contribution between Groups A and B for the *i*^{th }gene from the *j*^{th }EG loading vector is given as

$$d\text{\hspace{0.05em}}{\overline{g}}_{ij}^{EG}={\overline{g}}_{ij}^{E{G}_{A}}-{\overline{g}}_{ij}^{E{G}_{B}}$$

(5)

The basic difference between the method in Rollins et al. [2] and this extension is that work developed gene signatures for individual groups using equations of the form given by (3) and (4) and this work uses equation of the form given by Eq. 5.

As stated above, the EA approach uses the transpose of **X **as the data matrix treating the genes as the variables. Following Rollins et al. [2], **X**^{T }is not standardized in the EA approach as in the EG approach. The elements of scores matrix, **S**^{EA}, are determined from Eq. 6 as follows:

$$\begin{array}{c}{s}_{ij}^{EA}={\ell}_{1j}^{EA}{x}_{1i}+{\ell}_{2j}^{EA}{x}_{2i}+\dots +{\ell}_{mj}^{EA}{x}_{mi}\\ ={\displaystyle {\sum}_{p=1}^{m}{\ell}_{pj}^{EA}{x}_{pi}={\displaystyle {\sum}_{p=1}^{m}{g}_{ijp}^{EA}}};\\ i=1,\dots ,n;j=1,\dots ,n;p=1,\dots ,m\end{array}$$

(6)

where ${s}_{ij}^{EG}$ is the score for the *i*^{th }assay using the *j*^{th }vector of EA loadings, ${\ell}_{ij}^{EG}$ is the *i*^{th }loading for the *j*^{th }EA vector, and ${g}_{ijp}^{EA}$ is the contribution for the *p*^{th }gene, on the *i*^{th }assay from the *j*^{th }EA loading vector. As above, for A = Group A with *n _{A }*assay members and B = Group B with

$${\overline{g}}_{jp}^{E{A}_{A}}=\frac{{\ell}_{pj}^{EA}}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\prime}{x}_{pi\prime}}=\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\prime}{g}_{i\prime jp}^{EA}}$$

(7)

$${\overline{g}}_{jp}^{E{A}_{B}}=\frac{{\ell}_{pj}^{EA}}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\prime \prime}{x}_{pi\prime \prime}}=\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\prime \prime}{g}_{i\prime \prime jp}^{EA}}$$

(8)

respectively, where *i' *and *i" *represent the assay members in Groups A and B, respectively. Finally, the EA differential gene contribution between Groups A and B for the *p*^{th }gene from the *j*^{th }EG loading vector is given as

$$d\text{\hspace{0.05em}}{\overline{g}}_{jp}^{EA}={\overline{g}}_{jp}^{E{A}_{A}}-{\overline{g}}_{jp}^{E{A}_{B}}$$

(9)

The next step after deriving the gene contribution equations is to define the decision or test statistics based on these derivations. *T _{diff }*for EG and EA are equivalent to Eqs. 5 and 9, respectively. More specifically,

$$\begin{array}{c}{T}_{dif{f}_{ij}}^{EG}=d\text{\hspace{0.05em}}{\overline{g}}_{ij}^{EG}={\overline{g}}_{ij}^{E{G}_{A}}-{\overline{g}}_{ij}^{E{G}_{B}}\\ =\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime}{\ell}_{k\prime \text{\hspace{0.17em}}j}^{EG}{z}_{ik\prime}-\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\prime \prime}{\ell}_{k\prime \prime j}^{EG}{z}_{ik\prime \prime}}}\text{}\end{array}$$

(10)

$$\begin{array}{l}{T}_{dif{f}_{jp}}^{EA}=d\text{\hspace{0.05em}}{\overline{g}}_{jp}^{EA}={\overline{g}}_{jp}^{E{G}_{A}}-{\overline{g}}_{jp}^{E{G}_{B}}\\ =\frac{{\ell}_{pj}^{EA}}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\u05f3}{x}_{pi\u05f3}-\frac{{\ell}_{pj}^{EA}}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i"}{x}_{pi"}}}\\ ={\ell}_{pj}^{EA}\left({\overline{x}}_{Ap}-{\overline{x}}_{Bp}\right)\text{}\end{array}$$

(11)

The variances for the components of these equations are given below by treating the loadings as fixed variables (making these expressions approximations):

$$\begin{array}{c}V\left({\overline{g}}_{ij}^{E{G}_{A}}\right)=V\left(\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{'}}{\ell}_{k\text{'}j}^{EG}}{z}_{ik\text{'}}\right)\\ \approx \frac{1}{{n}_{A}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{'}}{\left({\ell}_{k\text{'}j}^{EG}\right)}^{2}}{\sigma}_{{z}_{i}}^{2}=\frac{{\sigma}_{zi}^{2}}{{n}_{A}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{'}}{\left({\ell}_{k\text{'}j}^{EG}\right)}^{2}}\end{array}$$

(12)

$$\begin{array}{c}V({\overline{g}}_{ij}^{E{G}_{B}})=V\left(\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}\text{\'}}{\ell}_{k"j}^{EG}}{z}_{ik"}\right)\\ \approx \frac{1}{{n}_{B}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\left({\ell}_{k"j}^{EG}\right)}^{2}}{\sigma}_{{z}_{i}}^{2}=\frac{{\sigma}_{{z}_{i}}^{2}}{{n}_{B}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}{\left({\ell}_{k"j}^{EG}\right)}^{2}}\end{array}$$

(13)

$$\begin{array}{c}V({\overline{g}}_{jp}^{E{A}_{A}})=V\left(\frac{{\ell}_{pj}^{EA}}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\text{'}}{x}_{pi\text{'}}}\right)\\ \approx \frac{{\left({\ell}_{pj}^{EA}\right)}^{2}}{{n}_{A}^{2}}{n}_{A}{\sigma}_{xp}^{2}={\left({\ell}_{pj}^{EA}\right)}^{2}\frac{{\sigma}_{xp}^{2}}{{n}_{A}}\end{array}$$

(14)

$$\begin{array}{c}V({\overline{g}}_{jp}^{E{A}_{B}})=V\left(\frac{{\ell}_{pj}^{EA}}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i"}{x}_{pi"}}\right)\\ \approx \frac{{({\ell}_{pj}^{EA})}^{2}}{{n}_{B}^{2}}{n}_{B}{\sigma}_{xp}^{2}={\left({\ell}_{pj}^{EA}\right)}^{2}\frac{{\sigma}_{xp}^{2}}{{n}_{B}}\end{array}$$

(15)

Thus, combining Eqs. 10-11, the variances for ${T}_{dif{f}_{ij}}^{EG}$ and ${T}_{dif{f}_{jp}}^{EA}$ respectively are:

$$\begin{array}{c}V({T}_{dif{f}_{ij}}^{EG})\approx \frac{{\sigma}_{{z}_{i}}^{2}}{{n}_{A}^{2}}{\displaystyle \sum _{o\nu er\text{\hspace{0.17em}}k\text{\'}}{\left({\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}\right)}^{2}}+\frac{{\sigma}_{{z}_{i}}^{2}}{{n}_{B}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\left({\ell}_{k\text{\'}\text{\'}\text{\hspace{0.05em}}j}^{EG}\right)}^{2}}\\ ={\sigma}_{{z}_{i}}^{2}\left[\frac{1}{{n}_{A}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}{\left({\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}\right)}^{2}}+\frac{1}{{n}_{B}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\left({\ell}_{k"\text{\hspace{0.17em}}j}^{EG}\right)}^{2}}\right]\end{array}$$

(16)

$$\begin{array}{c}V({T}_{dif{f}_{pj}}^{EA})\approx {\left({\ell}_{pj}^{EA}\right)}^{2}\frac{{\sigma}_{xp}^{2}}{{n}_{A}}+{\left({\ell}_{pj}^{EA}\right)}^{2}\frac{{\sigma}_{xp}^{2}}{{n}_{B}}\\ ={\left({\ell}_{pj}^{EA}\right)}^{2}{\sigma}_{xp}^{2}\left[\frac{1}{{n}_{A}}+\frac{1}{{n}_{B}}\right]\end{array}$$

(17)

The scale test statistic in the EG case can now be given by dividing Eq. 10 by the estimated standard deviation using Eq. 16:

$$\begin{array}{c}{T}_{scale{d}_{ij}}^{EG}=\frac{{T}_{dif{f}_{ij}}^{EG}}{{\left[\widehat{V}\left({T}_{dif{f}_{ij}}^{EG}\right)\right]}^{}}\\ =\frac{\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}{\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}{z}_{ik\text{\'}}-\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\ell}_{k"\text{\hspace{0.05em}}j}^{EG}{z}_{ik"}}}}{{s}_{pooled\text{}{z}_{i}}\sqrt{\frac{1}{{n}_{A}^{2}}{{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}\left({\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}\right)}}^{2}+\frac{1}{{n}_{B}^{2}}{{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}\left({\ell}_{k"\text{\hspace{0.05em}}j}^{EG}\right)}}^{2}}}\end{array}$$

(18)

where

$${s}_{pooled\text{\hspace{0.17em}}{z}_{i}}^{2}=\frac{{n}_{A}-1}{{n}_{A}+{n}_{B}-2}{s}_{A{z}_{i}}^{2}+\frac{{n}_{B}-1}{{n}_{A}+{n}_{B}-2}{s}_{B{z}_{i}}^{2}$$

(19)

${s}_{A{z}_{i}}^{2}$ and ${s}_{B{z}_{i}}^{2}$ are the sample variances for the standardized expression levels for Groups A and B, respectively, corresponding to the *i*^{th }gene. Note that when ${x}_{ij}\stackrel{indep}{~}N\left({\mu}_{{x}_{j}},{\sigma}^{2}\right),\text{\hspace{0.17em}}\forall i,j,\text{\hspace{0.17em}}\text{then}\text{\hspace{0.17em}}{\overline{x}}_{j}\stackrel{indep}{~}N\left({\mu}_{{x}_{j}},{\sigma}^{2}/m\right)\forall \text{\hspace{0.17em}}j$. Therefore, ${Z}_{ij}\text{\hspace{0.17em}}=\left({x}_{ij}\text{\hspace{0.17em}}-{\overline{x}}_{j}\right)/{s}_{j}\sim N\left(0,1\right),$ approximately, since ${\overline{x}}_{j}\approx {\mu}_{{x}_{j}}$ and ${s}_{j}^{2}\approx {\sigma}^{2}\forall \text{\hspace{0.17em}}j$ because *m *is very large. In this case where the variation of the assays are all similar, V(*z _{ij}*) is taken to equal 1 and

$${T}_{scale{d}_{ij}}^{EG}=\frac{\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}{\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}{z}_{ik\text{\'}}-\frac{1}{{n}_{B}}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\ell}_{k"\text{\hspace{0.05em}}j}^{EG}}{z}_{ik"}}{\sqrt{\frac{1}{{n}_{A}^{2}}{{\displaystyle \sum _{over\text{\hspace{0.17em}}k\text{\'}}\left({\ell}_{k\text{\'}\text{\hspace{0.05em}}j}^{EG}\right)}}^{2}+\frac{1}{{n}_{B}^{2}}{\displaystyle \sum _{over\text{\hspace{0.17em}}k"}{\left({\ell}_{k"\text{\hspace{0.05em}}j}^{EG}\right)}^{2}}}}$$

(20)

Similarly, the scaled test statistic in the EA case can also be given now by dividing Eq. 11 by the estimated standard deviation using Eq. 17:

$$\begin{array}{c}{T}_{scale{d}_{jp}}^{EG}=\frac{{T}_{dif{f}_{jp}}^{EA}}{{\left[\widehat{V}\left({T}_{dif{f}_{jp}}^{EA}\right)\right]}^{1/2}}\\ =\frac{{\ell}_{pj}^{EA}\left[\frac{1}{{n}_{A}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i\text{\'}}{x}_{pi\text{\'}}}-\frac{1}{{n}_{B}}{\displaystyle \sum _{over\text{\hspace{0.17em}}i"}{x}_{pi"}}\right]}{{\ell}_{pj}^{EA}{s}_{poole{d}_{{x}_{p}}}\sqrt{\left[\frac{1}{{n}_{A}}+\frac{1}{{n}_{B}}\right]}}\\ =\frac{{\overline{x}}_{{A}_{p}}-{\overline{x}}_{{B}_{p}}}{{s}_{poole{d}_{{x}_{p}}}\sqrt{\left[\frac{1}{{n}_{A}}+\frac{1}{{n}_{B}}\right]}}\end{array}$$

(21)

where

$${s}_{pooled\text{\hspace{0.17em}}{x}_{p}}^{2}=\frac{{n}_{A}-1}{{n}_{A}+{n}_{B}-2}{s}_{A{x}_{p}}^{2}+\frac{{n}_{B}-1}{{n}_{A}+{n}_{B}-2}{s}_{B{x}_{p}}^{2}$$

(22)

${s}_{A{x}_{p}}^{2}$ and ${s}_{B{x}_{p}}^{2}$ are the sample variances for the un-standardized expression levels for Groups A and B, respectively, corresponding to the *p*^{th }gene. Note that ${T}_{scal{e}_{JP}}^{EA}$ is independent PCA loadings and thus, does not benefit from PCA. In actuality, Eq. 21 is the commonly known Student's *t-*statistics [14]; thus,

$${T}_{pooled,p}={T}_{scal{e}_{JP}}^{EA}$$

(23)

From Eq. 23 it is clear that scaling the EA differential contribution is not providing any new technique in PCA and therefore is not a useful result under the PM. Thus, we do not propose scaling for the EA approach.

The steps for applying the PM are as follows:

1. Standardize **X **to obtain **Z**.

2. Obtain the loading and scores matrices for **X **(EG) based on correlation.

3. Obtain the loading and scores matrices for **X*** ^{T }*(EA) based on covariance.

4. For each of the *n *EG loading vectors, plot its loadings against the assay number. Select the plot(s) that separate the assays into desired or interesting groups for further analysis.

5. For each *n *EA score vectors, plot its scores against the assay number. Select the plot(s) that separate the assays into desired or interesting groups for further analysis.

6. For each selected EG loading vector in Step 4, using **Z **and Eq. 5 determine the differential EG contribution for each gene.

7. For each selected EA loading vector in Step 5, using **X **and Eq. 9 determine the differential EA contribution for each gene.

8. For each case in Steps 6 and 7, rank order the differential contribution and then table (with the corresponding gene) and plot these values against the rank. These signature plots can be used to determine where to make cutoffs as described in Rollins et al. [2].

In the next section we evaluate the proposed test statistics that we have derived in this section against a current method that uses the Student's *t*-test statistic. This work also includes an evaluation to determine when it is better to choose *T _{diff }*or

The best choice for a test statistics is the one that has the highest statistical power (SP) and the lowest false discovery rate (FDR) [21]. This section presents three case studies to evaluate the proposed test statistics against one another and against a current method (CM) that uses *T _{pooled}*. The first study revisits the single group analysis in Rollins et al. [2] involving exposure of

The data set for the first case study contains *E. coli *cells that were exposed to two different ethanol concentrations. In Rollins et al.[2] ranked signatures were obtained for non-ethanol (i.e., non-treated) (Group A) and ethanol (Group B) separately. Thus, these signatures ranked the genes based on their contribution to the score of their group. However, the goal of this work is to obtain a ranked signature of the genes that is based on the ** difference of gene contribution **between the two groups. Therefore, under this objective, genes with high contribution in both groups would not be ranked high; whereas, genes with low contribution in one group and high contribution in the other group could be ranked high based on the greatest negative, positive, or absolute difference, depending on the interests of the experimenter. For this study, we ranked the genes based on absolute difference for evaluative purposes.

The results of this study using the PM are given in Table Table11 and Figure Figure3.3. These results were obtained from the first PC for an EA analysis (since it indicated the strongest separation) using ${T}_{dif{f}_{i1}}^{EA}$ only to determine differential gene contribution. This PC was selected, as supported by Figure Figure3,3, because it separated the two groups in the score plot quite well. The plot on the right in Figure Figure33 gives the differential contribution calculated from ${T}_{dif{f}_{i1}}^{EA}$ by rank with the rank decreasing with increasing value on the horizontal axis. As this figure shows, the top genes clearly standout by their distinct separation and how they line up almost vertically along the vertical axis. Table Table11 gives the top 20 genes that expressed the most differently between ethanol treated and non-ethanol treated groups. This list contains some of the top genes in the ethanol and non-ethanol signatures in Rollins et al.[2] as indicated. In addition, it contains genes that were not ranked very high in either signature. However, note that each gene is at opposite ends of the signatures in Rollins et al.[2] in support of their differential significance. Thus, the PM has potentially found genes that might express relatively low within assays of similar conditions but quite differently between assays of different conditions. Follow up experiments would be necessary to verify these findings which are beyond the scope of this work.

Top 20 genes that showed distinct difference between ethanol and non-ethanol along with their ranking

The second study is a data set that involved the use of myostatin as inhibitor of skeletal muscle growth for five 5-week-old myostatin (called "mutant") and non-treated (called "wild-type") mice in each group. A powerful method for ranking genes and determining the size of signatures is the Q-method developed by Storey and Tibshirani [12]. The Q-method uses *T _{pooled }*and a novel method for achieving high SP and low FDR. The Q-method first uses

PCA results for PM are given in Figure Figure4.4. These results were obtained from the first PC for an EA analysis (since it indicated the strongest separation) using ${T}_{dif{f}_{i1}}^{EA}$ only to determine differential gene contribution. This PC was selected, as supported by Figure Figure4,4, because it separated the two groups in the score plot quite well. As shown by the ${T}_{dif{f}_{i1}}^{EA}$ plot on the right, the top genes clearly standout by their distinct separation and by how they line up along the vertical axis. The top genes that the PM identified were genes identified in Steelman et al. [10]. In addition, it also identified genes that were not previously identified in their work.

A comparison of the PM and the CM is given in Table Table2.2. In this table, the top 200 genes of the CM are selected as the base set. The number and percentage of the top 10, 20, . . ., 100 genes of the PM in this set are given. For an example, if one will to compute the percentage of top 10 genes found using the PM in comparison to the 200 genes found using CM (base set). The computation can be done simply dividing the number of genes in common between two groups by 10. This analysis is represented by the first three columns in the table. In addition, this table gives results that switch the roles of the PM and CM. More specifically, the top 200 genes of the PM are selected as the base set and the number and percentage of the top 10, 20, . . ., 100 genes of the CM in this set are determined. This analysis is represented by the last three columns in Table Table2.2. With the CM as the base set, the results range from 70% of the top 10 genes to 22% of the top 100 genes of the PM being in set of the top 200 genes of the CM. Similarly, with the PM as the base set, the results range from 50% of the top 10 genes to 22% of the top 100 genes of the CM being in the set of the top 200 genes of the PM. Thus, while there is agreement between the two approaches, the lack of agreement warrants further investigation on the best choice of method based on the criteria of highest SP and lowest FDR. Our last study is a Monte Carlo simulation data study to compare these two approaches under these criteria.

As stated above, the purpose of the simulated data study is to evaluate and compare the PM and CM to identify genes with significant differential effects. We simulated several data sets based on the statistical properties of the data matrix from the second study. More specifically, each data matrix contained 40,000 genes with 10 assays of five samples in each group. The distribution for the simulated data can be described as follows:

$${x}_{ij}\stackrel{}{~}N\left({\mu}_{{x}_{j}},{\sigma}_{{x}_{i}}^{2}\right),\text{\hspace{0.17em}}\forall i,j$$

(24)

such that

$${\mu}_{{x}_{j}}=\{\begin{array}{cc}\begin{array}{l}5.3+\delta ,\\ 5.3,\end{array}& \begin{array}{l}\delta >0;i=1,\text{\hspace{0.17em}}\dots ,\text{\hspace{0.17em}}200;\text{\hspace{1em}}j=1,\dots ,5\\ otherwise\end{array}\end{array}$$

(25)

Thus, 200 of the genes for each of the assays in Group A had the largest mean and were significantly different than all the other genes that had a mean of 5.3. The study will evaluate the ability of the CM and PM to identify these 200 genes when the variance for all the data in the data matrix is the same (Part 1) and when the variance differs from gene to gene (Part 2). Each result in the simulation study is an average of five trials. For simplicity, all the results in this study will be based on eigengene (EG) principal components (PCs) as it gave strong separation of the groups.

In the first simulation study we evaluated the techniques under different levels of ${\sigma}_{x}^{2}$ with δ = 1. (Note that for, δ = 1, the value of σ* _{x }*is the same as the coefficient of variation defined as σ

In the second simulation study we evaluated the techniques by varying levels of ${\sigma}_{{x}_{i}}^{2}$ for each gene and two levels of δ: 1 and 3. More specifically, the distribution for ${\sigma}_{{x}_{i}}$ was log normal with mean 0.37 and variance 0.37^{2}. Thus, for each data table a ${\sigma}_{{x}_{i}}$ was randomly generated for each gene *i*, *i *= 1, ..., *m*, and then ten simulated expression values, one for each assay, were generated according to Eqs. 24 and 25 for the given level of δ.

Identification results for this part of the study are given in Figure Figure77 as the percent of the SDG that are in the top 200 and top 400 ranks determined by the three test statistics. The best performing method this time is ${T}_{scaled}^{EG}$, followed by *T _{pooled }*, and then by ${T}_{diff}^{EG}$. At δ = 3, all three methods are close but spread out at δ = 1. While the spread at δ = 1 for ${T}_{scaled}^{EG}$ and

Our final analysis in this study evaluated performance in signature size determination. The CM is the Q-method developed by Storey and Tibshirani [12] that uses the p-values of the *t*-test (i.e., *T _{pooled}*) and cuts the list off at a maximum Q-value, commonly 0.05, the value used in this analysis. The PM is the Inflection Method (IM) that is described in Rollins et al.[2] that cuts the list off at the greatest change in the signature plot of the ranked genes. The results are from Part 1 of the simulation study with a constant ${\sigma}_{{x}_{i}}$ for all the genes in a data table.

The results of this analysis are given in Figure Figure8.8. The plot gives the signature size (SS) (i.e., the number of genes in the signature) and the SDG against${\sigma}_{{x}_{i}}$. Statistical Power (SP) is seen by the height of the SDG curve. As typical, SP, as indicated by this line, decreases as ${\sigma}_{{x}_{i}}$ increases. Hence, the PM signature performance is seen to be significantly better than the CM in terms of SP. An indication of the false discovery rate (FDR) of the methods can be compared by the separation of their two lines in Figure Figure8.8. These lines for the PM are very close except at the highest levels of${\sigma}_{{x}_{i}}$. This indicates that the number of insignificant genes in the signatures of the PM is quite small and hence, has a small FDR. The FDR of the CM appears to be much higher for low values ${\sigma}_{{x}_{i}}$ and the SS drops to zero relatively quite fast so that performance at low ${\sigma}_{{x}_{i}}$ is not too meaningful since there are very few genes in the signature. Thus, the IM with the test statistics of the PM for determining signature cutoffs appears to have merit as a viable approach.

This work proposed a new principal component analysis (PCA) method for analyzing large dimensional data set such as gene expressions data set. The strength of the proposed method (PM) comes from its data driven nature. It is data driven because the relationships obtained by PCA are only determined by those that exist in the data. Thus, no predetermined grouping or any á priori knowledge has influence on the principal components (PCs) obtained. After obtaining the PCs, they are used to match and verify the existence of the assay groups of interests. From the PCs that have the strongest match, the contribution of each gene providing the greatest differential expressions are identified and ranked. Thus, a PM signature is not just a difference of expression levels for genes but differences in a direction verified to have the characteristics of interests. This approach distinguishes PM from methods that do not form groups on the basis of data analysis and develop signatures from the differences between two groups in the original data space. One should be cautioned that as the number of members in the groups becomes smaller, the probability a particular order of the assays increases. Thus, for a small number of assays, one should require greater separation of groups for high confidence in the true existence of the groups.

Following Rollins et al. [2], the PM develops test statistics treating the assays as variables (eigengenes, EG) and the genes as variables (eigenassays, EA). These test statistics are linear combinations of these variables (i.e., pseudo variables) as determined from the elements of the eigenvectors. One test statistic, called *T _{diff }*is the difference of the average expression levels between two groups of pseudo variables. The other test statistics, called

We are applying the PM in a variety of applications involving biological as well as physical phenomenon, with promising results. These applications include: 1. Nitric Oxide- and S-nitrosoglutathione-responsive genes in *E*-*coli*; 2. analysis of DNA microarray data for juvenile small round blue cell tumors; 3. analysis of metabolite data from corn tissues (silk, pollen, coleoptile, and seedlings) for differential expression levels between the wild type and genetic mutations; 4. analysis of spectroscopy data for super alloys; and 5. the enhancement of nondestructive tests for ceramic armor in the resistance of ballistic penetration. Thus, the PM has potential application in a variety of situations where differential analysis is needed on large data sets with a relatively small number of different conditions or assays. It appears to have promise for these applications for high SP and low FDR as compared to other currently available methods.

CM: current method; EA: Eigenassay; EG: Eigengene; FDR: false discovery rate; FG: functional genomics; IM: inflection method; *g _{i}*: gene contribution for

The authors declare that they have no competing interests.

DK developed and extended the methodology used in this work. DK and AL both participated in research to verify the methodology through a simulation study as well as real data studies, drafted the manuscript, read and approved the final manuscript.

We would like to thank Professor Daniel S. Nettleton for his valuable advice and suggestions in conducting the simulation study. We are also grateful for his assistance in statistical software package used in this work. Funding for this work was provided through a grant from the Army Research Laboratory under Cooperative Agreement W911NF-08-0036.

- Dharmadi Y, Gonzalez R. DNA Microarrays: Experimental Issues, Data Analysis, and Application to Bacterial Systems. Biotechnol Progress. 2004;5:1309–1324. doi: 10.1021/bp0400240. [PubMed] [Cross Ref]
- Rollins DK, Zhai D, Joe AL, Guidarelli JW, Murarka A, Gonzalez R. A novel data mining method to identify assay-specific signatures in functional genomic studies. BMC Bioinformatics. 2006;7:377. doi: 10.1186/1471-2105-7-377. [PMC free article] [PubMed] [Cross Ref]
- Zhang W, Carriquiry A, Nettleton D, Dekkers JCM. Pooling mRNA in Microarray Experiments and Its Effect on Power. Gene Expression. 2007;23:1217–1224. [PubMed]
- Shendure J, Ji H. Next-generation DNA sequencing. Nature Biotechnology. 2008;26:10. doi: 10.1038/nbt1486. [PubMed] [Cross Ref]
- Morozova O, Marra MA. Applications of next-generation sequencing in functional genomics. Genomics. 2008;92:255–264. doi: 10.1016/j.ygeno.2008.07.001. [PubMed] [Cross Ref]
- Raychaudhuri S, Stuart JM, Altman RB. Principal Component Analysis to Summarize Microarray Experiments: Application to Sporulation Time Series. Pacific Symposium on Biocomputing. 2000;5:452–463. [PMC free article] [PubMed]
- Misra JW, Hwang D, Hsiao LL, Gullans S, Stephhanopoulos G. Interactive exploration of microarray gene expression patterns in a reduced dimensional space. Genome Res. 2002;12:1112–1120. doi: 10.1101/gr.225302. [PubMed] [Cross Ref]
- Sharov AA, Dudekula DB, Ko MSH. A web-based tool for principal component and significance analysis of microarray data. Bioinformatics. 2005;21:2548–2549. doi: 10.1093/bioinformatics/bti343. [PubMed] [Cross Ref]
- Nettleton D. A discussion of Statistical Methods for Design and Analysis of Microarray Experiments for Plant Scientists. The Plant Cell. 2006;18:2112–2121. doi: 10.1105/tpc.106.041616. [PubMed] [Cross Ref]
- Steelman CA, Recknor JC, Nettleton D, Reecy JM. Transcriptional profiling of myostatin-knockout mice implicates Wnt signaling in postnatal skeletal muscle growth and hypertrophy. The FASEB Journal. 2006;20:580–582. [PubMed]
- Dudoit S, Yang YH, Callow MJ, Speed TP. Statistical Methods for Identifying Differentially Expressed Genes in Replicated cDNA Microarray Experiments. Stat Sinica. 2002;12:111–139.
- Storey JD, Tibshirani R. Statistical significance for genomewide studies. Proc Natl Acad Sci USA. 2003;100:9440–9445. doi: 10.1073/pnas.1530509100. [PubMed] [Cross Ref]
- Ge Y, Sealfon SC, Speed TP. Statistical Methods in Medical Research. Statistical Method in MedicalResearch. 2009;18:543. doi: 10.1177/0962280209351899. [PubMed] [Cross Ref]
- Devore JL. Probability and Statistics for Engineering and the Sciences. 7. Duxbury Press; 2007.
- Sartor MA, Tomlinson CR, Wesselkamper SC, Sivaganesan S, Leikauf GD, Medvedovic M. Intensity-based Hierarchical Bayes Method Improves Testing for Differentially Expressed Genes in Microarray Experiments. BMC Bioinformatics. 2006;7:538. doi: 10.1186/1471-2105-7-538. [PMC free article] [PubMed] [Cross Ref]
- Kendziorski CM, Newton MA, Lan H, Gould MN. On Parametric Empirical Bayes Methods for Comparing Multiple Groups Using Replicated Gene Expression Profiles. Statistics in Medicine. 2003;22:3899–3914. doi: 10.1002/sim.1548. [PubMed] [Cross Ref]
- Efron B, Tibshirani R, Storey JD, Tusher V. Empirical Bayes Analysis of a Microarray Experiment. Journal of American Statistical Association. 2001;96:456. doi: 10.1198/016214501753382129. [Cross Ref]
- Liao JC, Boscolo R, Yang YL, Sabatti C, Rpoychowdhury VP. Network component analysis: Reconstruction of regulatory signals in biological systems. The National Academy of Sciences. 2003;100:15522–15527. doi: 10.1073/pnas.2136632100. [PubMed] [Cross Ref]
- Tran LM, Brynildsen MP, Kao KC, Suen JK, Liao JC. gNCA: A framework for determining transcription factor activity baed on transcriptome: identifiability and numerical implementation. Metabolic Engineering. 2005;7:128–141. doi: 10.1016/j.ymben.2004.12.001. [PubMed] [Cross Ref]
- Hyduke DR, Jarboe LR, Tran LM, Chou KJY, Liao JC. Integrated network analysis identifies nitric oxide response networks and didihydratase as crucial target in. Proceedings of the National Academy of Sciences of the United States of America. 2007;104:8488–8489. doi: 10.1073/pnas.0610888104. [PubMed] [Cross Ref]
- Benjamini Y, Hochberg Y. Controlling the false discovery rate: apractical and powerful approach to multiple testing. Journal of Royal Statistical Society Series B. 1995;57:289–300.
- Gonzalez R, Tao H, Purvis JE, Shanmugam KT, York SW, Ingram LO. Gene Array-Based Identification of Changes That Contribute to Ethanol Tolerance in Ethanologenic
*Escherichia coli*: Comparison of KO11 (Parent) to LY01 (Resistant Mutant) Biotechnol Prog. 2003;19:612–623. doi: 10.1021/bp025658q. [PubMed] [Cross Ref] - Johnson RA, Wichern DW. Applied Multivariate Statistical Analysis. 6. Pearson Prentice Hall; 2008. pp. 430–470.

Articles from BioData Mining are provided here courtesy of **BioMed Central**