PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bibLink to Publisher's site
 
Brief Bioinform. Nov 2011; 12(6): 723–735.
Published online Feb 17, 2011. doi:  10.1093/bib/bbr002
PMCID: PMC3220872
The what, where, how and why of gene ontology—a primer for bioinformaticians
Louis du Plessis, Nives Škunca, and Christophe Dessimozcorresponding author
corresponding authorCorresponding author.
Corresponding author. Christophe Dessimoz, ETH Zurich, Computer Science, Universitätstr. 6, 8092 Zurich, Switzerland. E-mail: cdessimoz/at/inf.ethz.ch
Received September 28, 2010; Accepted January 12, 2011.
Abstract
With high-throughput technologies providing vast amounts of data, it has become more important to provide systematic, quality annotations. The Gene Ontology (GO) project is the largest resource for cataloguing gene function. Nonetheless, its use is not yet ubiquitous and is still fraught with pitfalls. In this review, we provide a short primer to the GO for bioinformaticians. We summarize important aspects of the structure of the ontology, describe sources and types of functional annotations, survey measures of GO annotation similarity, review typical uses of GO and discuss other important considerations pertaining to the use of GO in bioinformatics applications.
Keywords: gene ontology, gene annotation, semantic similarity, gene function, function prediction
The first attempts at classifying gene functions made use of natural language annotations in databases. Early on it was found that natural language by itself is too vague and unspecific to accurately capture the function of genes [1], as it is difficult to perform searches and establish relationships with natural language annotations. The first efforts towards a structured and controlled annotation of genes were schemes such as the enzyme classification (EC) system representing the function of an enzyme using a four digit sequence of numbers [2]. Such classification schemes are still widely used but were found to be insufficient to accurately describe gene function. This motivated the introduction of the Gene Ontology (GO) [3], which has grown to be the largest resource of its kind.
The ‘GO Consortium’ consists of a number of large databases working together to define standardized ontologies and provide annotations to the GO. The three ontologies it encompasses are non-redundant and share a common space of identifiers and a well-specified syntax. Apart from providing a standardized vocabulary for describing gene and gene product functions, one key motivation behind the GO was the observation that similar genes often have conserved functions in different organisms. The combination of information from all organisms in one central repository makes it possible to integrate knowledge from different databases and to infer the functionality of newly discovered genes. Originally, the GO was developed for a general eukaryotic cell [3]. The initial GO vocabulary, as well as the available GO term annotations present in the first years of its existence reflects this fact (Figure 1). However, the GO Consortium now includes several annotation groups that focus on prokaryotes [5], further contributing to the expansion of the vocabulary and annotations.
Figure 1:
Figure 1:
Increase in the number of experimentally verified GO term assignments available for the respective organism between September 2002 and September 2010. The GO consortium was initially focused on Eukaryotes, a fact reflected in the distribution and increase (more ...)
The goal of this review is to provide a primer to the GO for bioinformaticians. After a brief introduction to the structure of the ontology, we discuss the different types of annotations associated with the GO. Not all annotations are assigned in the same way and some are more trustworthy than others. Computational inference methods are described in more detail in this section, as they are used to assign a large fraction of GO annotations. The subsequent section discusses common measures of similarity to compare the function of genes quantitatively. The last section reviews typical uses of the GO and common pitfalls for the novice GO user.
The GO is a structured and controlled vocabulary of terms. The terms are subdivided in three non-overlapping ontologies, Molecular Function (MF), Biological Process (BP) and Cellular Component (CC) [6]. Each ontology describes a particular aspect of a gene or gene product functionality, as well as the relations between the terms. These relations are either ‘is_a’, ‘part_of’, ‘has_part’ or ‘regulates’ relationships. There are two subclasses of the ‘regulates’ relationships: ‘positively regulates’ and ‘negatively regulates’. The ‘is_a’ relationship is not used to imply that a term is an instance of another term; instead, it connects a subtype to its more general counterpart (Figure 2). The ‘part_of’ and ‘has_part’ relationships are logical complements of each other [7]. The relationships form the edges of a Directed Acyclic Graph (DAG), where the terms are the nodes (Figure 2). This allows for more flexibility than a hierarchy, since each term can have multiple relationships to broader parent terms and more specific child terms. Any path from a term towards the root becomes more general as terms are subsumed by parent terms.
Figure 2:
Figure 2:
The structure of the GO is illustrated on some of the paths of term GO:0060491 to its root term. Note that it is possible for a term to have multiple parents.
Each gene is associated with the most specific set of terms that describe its functionality. By definition, if a gene is associated with a term, it is also associated with all the parents of that term. The annotation process is discussed in more detail in the next section.
The GO undergoes frequent revisions to add new relationships and terms or remove obsolete ones. If a term is deleted from the ontology, the identifier for the term stays valid, but is labelled as obsolete and all relationships to the term are removed [8]. Changes to the relationships do not affect annotations, because annotations always refer to specific terms, not their location within the GO.
It is clear that relationships between the three ontologies exist. For example, an instance of a BP is the execution of one or more MFs [9]. Similarly, relationships exist between the MF and CC ontologies. Recently, these relationships have been integrated into the GO by introducing some inter-ontology links [7]. It should be noted that for the moment there are two concurrent versions of the GO, the filtered and the full GO. The main difference is that the filtered GO does not contain any ‘has_part’ or inter-ontology relationships. Many of the analysis tools can only use the filtered GO. Thus, the full expressivity of the GO structure is not always available.
Annotations connect genes and gene products to GO terms. Each annotation in the GO has a source and a database entry attributed to it. The source can be a literature reference, a database reference or computational evidence [4, 6]. In addition, there are three qualifiers used to modify the interpretation of an annotation, ‘contributes_to’, ‘colocalizes_with’ and ‘NOT’, making them an integral part of the annotation [8].
Perhaps the most important attribute of an annotation is the evidence code. The 18 evidence codes available describe the basis for the annotation (Figure 3). These evidence codes are divided into four categories. General guidelines for deciding which evidence code to use are given in Figure 4. It should be kept in mind that one gene can be annotated to the same term with more than one evidence code and that multiple annotations to the same term for the same gene could even share the same reference. This makes it possible to see whether an annotation is supported by more than one type of evidence. However, if the gene is annotated with more than one evidence code and one evidence code is a superclass of another, the annotation with the more general evidence code does not need to be specified explicitly.
Figure 3:
Figure 3:
GO evidence codes and their abbreviations. Evidence code NR (not recorded) is used for annotations assigned prior to the use of evidence codes, and is not assigned to new annotations.
Figure 4:
Figure 4:
A decision tree for deciding which evidence code to use. Figure adapted from http://www.geneontology.org/GO.evidence.tree.shtml.
The most reliable annotations are those inferred directly from experimental evidence. Such annotations are also important to seed the ontology so that the gene function of related genes can be inferred by computational methods [10]. At present, most researchers do not directly add their findings to the GO. The largest fraction of manual annotations are made by professional curators examining the literature [11]. In principle, researchers directly annotating genes they themselves characterized would be more efficient, but this practice has not yet caught on because annotation is time consuming and annotation guidelines are complicated [12]. There are efforts underway to make it compulsory for authors to submit GO term suggestions with article manuscripts [13]. A short overview of how annotations are made is given in [9].
There are seven evidence codes associated with computational inference, out of which six imply manual curation (ISS, ISO, ISA, ISM, IGC, RCA). The evidence code IEA is used for all inferences made without any human supervision, regardless of the method used. The IEA evidence code is by far the most abundantly used evidence code (Figure 5). The Gene Ontology Annotation project (GOA, [14]) is the largest contributor of IEA annotations, most of which are derived from the protein domain database InterPro [15]. The guiding idea behind computational function annotation is the notion that genes with similar sequences or structures are likely to be evolutionarily related, and thus, assuming they largely kept their ancestral function, they might still have similar functional roles today. In this section, we briefly review the main computational methods used to infer function. For an in-depth treatment of the topic, we refer the interested reader to two recent reviews [16, 17]. Alongside each method mentioned here, we indicate the evidence code that would be used to support the respective GO annotation.
Figure 5:
Figure 5:
The distribution of evidence codes among annotations in the GO on 1 April 2010.
The most straightforward approach of computational functional annotation is to infer the function of a gene based on the functions of genes returned by a database search for similar genes. Traditionally, only sequence similarity is used [18], but some methods also use structural similarity. For instance, Liu et al. [19] introduced a method that makes use of the similarity of protein surface pockets to infer GO terms related to the protein. The ISS evidence code was originally used for all annotations derived from sequence-based analyses and is appropriate when multiple kinds of computational evidence are used. Note that annotations marked with ISS evidence code can also be partly derived from structural similarity.
ISS is a superclass for the ISA, ISO and ISM evidence codes. The three sub-categories of the ISS should be used when only one method was used to make the inference. For example, to improve the accuracy of function propagation by sequence similarity, many methods take into account the phylogenetic relations of genes. Most of these methods rely on orthology (ISO evidence code), because the function of orthologs is believed to be largely conserved across species [20]. In a typical analysis, characterized and uncharacterized genes are clustered based on sequence similarity measures and phylogenetic relationships. The function of unknown genes is then inferred from the function of characterized genes within the same cluster (e.g. [20,21]).
Alternatively, methods based on protein profiles account for the fact that sequence conservation might be very uneven across the length of two functionally related genes. This is because the function of a protein is often dictated not by the shape and structure of the whole protein, but rather by specific regions and residues, such as catalytic sites, prosthetic group attachment sites or other binding sites [22, 23].
Another approach to function prediction consists of supervised machine learning based on features derived from protein sequence [24–27] (ISM evidence code). Such methods use a training set of classified sequences to learn features that can be used to infer gene functions. Although few explicit assumptions about the complex relationship between protein sequence and function are required, the results are dependent on the accuracy and completeness of the training data.
As Rentzsch and Orengo [16] argue, one of the biggest challenges of automated function prediction is choosing the right threshold beyond which function can be propagated. Using a predefined cut-off level is not a good practice as the optimal threshold will vary depending on which genes are evaluated. Indeed, there are several instances of proteins with high sequence similarity but different functions, and conversely, of proteins with similar function but highly divergent sequences [28, 29] and the user of annotations derived by computational methods should always have these intricacies in mind.
INFERRED FROM AUTHOR STATEMENT
Annotations in this group fall into two categories. Traceable Author Statements (TAS) refer to papers where the result is cited, but not the original evidence itself, such as review papers. On the other hand a Non-traceable Author Statement refers to a statement in a database entry or statements in papers that cannot be traced to another paper.
Three evidence codes fall in this category: IC, ND and NR. If an assignment of a GO term is made using the curator’s expert knowledge, concluding from the context of the available data, but without any ‘direct’ evidence available, the IC evidence code is used. The ND evidence code indicates that the function is currently unknown (i.e. that no characterization of the gene is currently available). Such an annotation is made to the root of the respective ontology to indicate which functional aspect is unknown. Hence, the ND evidence code allows for a subtle difference between unannotated genes and uncharacterized genes. Note that the ND code is also different from an annotation with the ‘NOT’ qualifier (which indicates the absence of a particular function). The NR evidence code labels annotations that were made before the introduction of evidence codes and as such may not be used for new annotations. It is obsolete and has been superceded by the ND evidence code. Although a few legacy NR annotations remain within the GO they will probably be removed in the nearby future.
GO annotations should always be considered with their qualifier and evidence code. A qualifier, such as ‘NOT’, changes the interpretation of an annotation. Similarly, although the evidence code is not a direct measure of the quality of the annotation, some evidence codes are regarded as more trustworthy. Terms annotated with ND are typically ignored as no knowledge is available on the function of these genes. NR annotations are obsolete and should be ignored since the evidence type used for the annotation is not known.
Most studies also disregard all terms annotated without curation (IEA) [30–33], consequently leaving out more than 98% of the annotations in the GO (Figure 5). The mistrust many researchers have towards IEA annotations is backed by studies suggesting that annotations from the available databases should be used with caution [34]. One of the leading factors why IEA annotations are not used is because this often leads to circular reasoning when used in computational analyses. On the other hand, IEA annotations are useful in providing a first approximation to experimental biologists. Ultimately, no annotations should be regarded with complete confidence, as some studies show that even the curated annotations in GO are not free from annotation errors [35].
To estimate the reliability of unsupervised computational assignments, we compared the September 2008 and September 2010 versions of GO annotation data for four representative Eukaryotes (Arabidopsis thaliana, Caenorhabditis elegans, Drosophila melanogaster and Saccharomyces cerevisiae). We considered all IEA annotations of the 2008 database that either had an experimental evidence code or were completely absent in the 2010 release. We used the annotations confirmed experimentally as surrogate for correct predictions and the annotations dropped from the database as surrogates for wrong predictions. In addition, to estimate the coverage of computational predictions, we computed the fraction of newly added experimental annotations that had been previously computationally predicted. This yielded Figure 6.
Figure 6:
Figure 6:
Estimation of correctness and coverage of computationally inferred GO terms (IEA) from September 2008. The estimation is based on data for four well annotated Eukaryotes: A. thaliana, C. elegans, Drosophila melanogaster and Saccharomyces cerevisiae. Confirmed (more ...)
Most terms lie in the upper half of the graph, which suggests that most computational predictions are correct. As one would expect, more general terms tend to be better predicted, and in many cases are better covered as well. A notable exception is the term GO:0005515 (protein binding) in the MF ontology. The reason for its particularly low coverage is likely due to its usage guideline: ‘Annotation to this term should use the IPI evidence code so that the protein being bound can be specified in the with modifier of the evidence code’ (http://gowiki.tamu.edu/wiki/index.php/Category: GO:0005515\_!\_protein\_binding#Notes).
Terms falling in the bottom right part of the chart have high coverage at the expense of accuracy. Consider for instance term GO:0016021 (integral to membrane) from the CC ontology: its immediate parent term GO:0031224 (intrinsic to membrane), is positioned in the top right corner of the chart. This suggests that in this case, the computational predictions would have been better if they had been slightly less specific. Overall, these results corroborate the idea that unsupervised computational assignments can provide first approximations or working hypotheses that can be refined or verified in subsequent steps [11, 36].
HOW ARE GO ANNOTATIONS COMPARED QUANTITATIVELY?
One of the main purposes of GO annotations is a quantitative comparison of gene function. Such comparison is based on a measure of function similarity between two genes, defined over the GO terms associated with these genes. In this section, we review the main similarity measures commonly used, with an attempt at motivating intuitively their mathematical formulas. For a more thorough survey of similarity measures and their mathematical properties, we refer the reader to more specialized reviews [28, 37].
We start with the simplest similarity measure, the function similarity between two GO terms. One early idea was to define the similarity as a function of the distance between the two terms in the ontology graph [38] or the length of their common path from the root, i.e. the number of common parents [39]. However, pure graph-based similarities suffer from the fact that the depth of a term within the ontology is not necessarily indicative of its specificity [40]. This motivated the formalization of the notion of specificity with the definition of the information content (IC) of a given term:
A mathematical equation, expression, or formula.
 Object name is bbr002um1.jpg
where p(c) is the probability of term c [40]. Hence, the root term, which is implied by all terms and thus has a probability of 1, has an IC of 0. By contrast, rare terms have a high IC. The term probabilities are commonly estimated from their frequencies in the entire database, i.e. the number of genes associated with c, divided by the total number of genes in the ontology [37].
Resnik [40] combined the notion of IC with the ontology structure to define the similarity of two terms as the IC of the most informative common parent. Formally,
A mathematical equation, expression, or formula.
 Object name is bbr002um2.jpg
where An external file that holds a picture, illustration, etc.
Object name is bbr002i1.jpg is the set of all terms that subsume both An external file that holds a picture, illustration, etc.
Object name is bbr002i2.jpg and An external file that holds a picture, illustration, etc.
Object name is bbr002i3.jpg. A slight variation consists in taking the IC of the lowest common parent [41], which coincides in most cases with the most informative common parent, but is faster to compute.
An inconvenient aspect of this measure is that it is not normalized. To remedy this, Lin normalized the measure between 0 (no similarity) and 1 (identical) [42]:
A mathematical equation, expression, or formula.
 Object name is bbr002um3.jpg
But due to the normalization, Lin’s measure does not convey the specificity of the terms compared. As a result, genes that are annotated to general terms tend to have higher similarities on average than genes annotated to specific terms.
This phenomenon is referred to as the ‘shallow annotation problem’ [43]. This motivated Schlicker et al. [44] to refine the measure by weighting it by a factor accounting for the specificity of the terms:
A mathematical equation, expression, or formula.
 Object name is bbr002um4.jpg
where An external file that holds a picture, illustration, etc.
Object name is bbr002i4.jpg is the probability of the most informative common ancestor of An external file that holds a picture, illustration, etc.
Object name is bbr002i5.jpg and An external file that holds a picture, illustration, etc.
Object name is bbr002i6.jpg.
Though IC-based measures are less influenced by the idiosyncrasies of the ontology structure than their graph-based counterparts, they are still biased, because some terms are used more often and some research areas receive more attention than others [28]. Another caveat is that in principle, different relationships within the ontology should not be treated equally.
In practice this is often not done and often all relationships are treated equally to simplify the analysis [43]. Furthermore, it should be noted that not all relationships are represented equally within the ontology [45]. While ‘is_a’ relationships alone form a complete tree that can be used for comparisons the same is not true for other relationships.
In the previous section, we discussed similarity measures for pairs of GO terms. In most studies, however, the analysis is at the level of genes, each of which can be associated with more than one term. The simplest approach consists in considering all possible pairs of GO terms associated with both genes and to use either the average or the maximum similarity as measures for the two genes [43, 45]:
A mathematical equation, expression, or formula.
 Object name is bbr002um5.jpg
where T(G) is the set of GO terms associated with gene G.
However, both variants have flaws. The main problem of the average is that considering all pairs of GO terms penalizes multifunction proteins: in particular, the similarity between a multifunction gene and itself can be quite low, because the average tends to be dominated by pairs of different GO terms (Consider a gene with n GO terms. Of all the pairs, the number of pairs involving identical GO terms scales linearly in n, but the number of pairs involving different GO terms scales quadratically). The maximum suffers from the opposite problem, namely that genes that differ in all but one functional aspect will still show a high similarity under this measure. To balance between the two, Azuaje et al. [46] suggested computing the average over the reciprocal best matching pairs only.
Instead of reducing gene similarity to the similarity of paired GO terms, other measures consider all implied GO terms at once. One such measure is the Term Overlap (TO), which considers the number of common terms between genes [47]. Note that the set of terms associated with a gene by definition includes the parents of all terms a gene is annotated with. A normalized version of this measure also exists, but was found to suffer from the shallow annotation problem [48]. Yet another measurement converts genes into binary vectors of length equal to the number of terms in the ontology by setting the An external file that holds a picture, illustration, etc.
Object name is bbr002i7.jpg component to 1 if the gene is annotated with the corresponding term and 0 otherwise. The distance between two genes can then be computed using a metric on the vector space, such as the cosine of the angle between them [49]. Lastly, set similarity measures, such as the Jaccard index, can also be used to compare the sets of terms with which two genes are annotated [50].
Various measures reviewed above formalize the notion of function similarity in slightly different ways. Thus, choosing the best measure is a subjective decision. Conceptual arguments can suffice to disqualify a measure if it has an obvious flaw, e.g. a low reported similarity for identical genes or a high reported similarity for completely different ones. Else, several studies have attempted to compare functional similarity measures in terms of how well they correlate with other measures that are assumed a priori to be linearly linked with function, such as sequence similarity (e.g. [45, 48]) or gene co-expression levels (e.g. [43]). But the strong premises of such assessments undermine their usefulness, because one of the main goals of defining a measure of gene function similarity is precisely to investigate the relationship between function and other aspects of genes such as sequence or expression. Ultimately, we believe that the choice of similarity measure should be acknowledged as inherently subjective. Instead of trying to identify the best measure, studies should demonstrate that their conclusions are not sensitive to the choice of similarity measure (as done e.g. in [51]).
The GO can be used as a database to look up genes with similar functionality or location within the cell [29]. In this way a search for interacting genes in one organism or similar genes in two organisms can be narrowed down. If the terms associated with genes are too specific, more general parent terms can be used to give a snapshot of an organism’s gene functions that can more easily be compared with other organisms [5]. Another standard use of the GO is to reason across the relations using an automatic logical inference tool [5]. Inferences can be made by following simple rules, for example, if A ‘is_a’ B and B is ‘part_of” C then A is also ‘part_of” C. In this way relations that are not immediately obvious, but captured in the GO, can be automatically uncovered.
The GO is frequently used to analyse the results of high-throughput experiments. One possibility is to infer the location or function of genes that are over- or under-expressed [8, 12]. In functional profiling the GO is used to determine which processes are different between sets of genes. This is done by using a likelihood-ratio test to determine if GO terms are represented differently between the two gene sets [8]. Both hypothesis-generating and hypothesis-driven queries can be addressed in this way. In hypothesis-generating queries, the goal is to find which terms are significantly different between the sets, whereas in hypothesis-driven queries, it is to test if some set of terms are different. In hypothesis-generating queries a multiple-test correction needs to be applied, but because of the amount of terms in the GO, the power of the test is significantly reduced. Hypothesis-driven queries do not require any multiple-test corrections. To reduce the effect of doing a multiple-test correction the number of tests done in hypothesis-generating queries need to be minimized. This is commonly done by running the query on a GO slim. A GO slim ontology is a reduced subset of general terms [8]. The annotations for a set of genes can then be mapped onto the GO slim. Because of the structure of the GO, an annotation may be mapped to many terms in the GO slim. Another standard use of GO slims is to give a high-level categorization of genes based only on the terms within the GO slim. It should be added that there are two types of GO slims. The first type is a subset of the GO used to facilitate the examination of a particular taxon subdivision. The second type is a set of broad GO terms used to aggregate the GO into large bins used for the representation of annotation data.
Additionally, the GO is used to infer the function of unannotated genes. Genes that behave similarly to an unannotated gene are identified from the experiment and their function is evaluated to be transferred to the unannotated gene. Many of these assigned terms will be false positives, but the correct terms should appear more often than is dictated by chance or indirect effects [5].
The GO is also used to infer protein–protein interactions (PPI) [33]. Shin et al. [32] used both PPI and GO data to show that interacting proteins are colocated within the cell. Another approach is to test the validity of inferred PPI networks by looking at the functional similarity of genes within the GO [30]. In this case, it is important that annotations inferred from previous PPI studies (IPI evidence code) are left out from the analysis.
A wealth of tools has been developed for applying the GO to various tasks. Links to most of the more prominent tools can be found on the GO website (http://geneontology.org). To give broader access to the GO, the GO consortium developed the AmiGO application (http://amigo.geneontology.org) [52]. AmiGO can be used online from the GO website or downloaded and installed. The application contains interfaces for searching, visualizing and downloading data in the GO. AmiGO also features BLAST search, Term Enrichment and GO Slimmer tools. The Term Enrichment tool is used for functional profiling and the GO Slimmer is used to map annotations to the terms within a GO slim. Lastly, AmiGO also makes it possible to directly query the GO database. There are many other tools available for analysing GO data. Because not all the tools use exactly the same methods the results can be very different and it is recommended that researchers try a few different tools before making an interpretation [8].
While it can be a powerful inference tool, researchers using the GO should familiarize themselves with the structure of the ontology and also with the methods behind the tools they use to ensure that their results are valid.
The number of associations in the GO has grown exponentially since its inception. There were 30 654 associations on 1 July 2000 and 7 781 954 associations on 1 July 2003 [6]. This number had grown to more than 16 million in 2007 [8] and more than 55 million in 2010. Due to the inference methods used, most of the growth has been from IEA associations. In contrast, the curated associations component has only grown linearly. The ontology itself has also been steadily growing, from less than 5000 terms in 2000 [6] to more than 30 000 in 2010. The Reference Genome Project has been initiated to focus the annotation efforts of various groups on a number of predetermined homologous genes [10]. This will not only help in seeding the ontology, but through a concentrated effort on certain branches the overall structure of the ontology will also be improved.
One shortcoming of the GO is that annotations only describe the normal, healthy functioning of genes [12]. In addition, data on functional coordination between multi-function genes are not explicitly stored [31]. Another shortcoming is that until recently no relationships between the three ontologies were recorded [7, 12]. Although inter-ontology relationships are now recorded they are only recorded in the full GO, which is not used by all analysis tools, making it necessary to maintain two versions of the GO.
The structure of the GO is predominantly the result of painstaking manual curation over the past 10 years. Through many additions and changes the GO has grown to be quite large and in many cases the structure is not optimal anymore. More specific subsets are available, in the form of a prokaryote subset and GO slims. Although there are quite a large number of GO slims available on the GO website, only seven of them are actively maintained (Of the seven GO slims that are maintained by the GO consortium two are for specific organisms (Schizosaccharomyces pombe and Candida albicans), two are for broader classes of organisms (Yeast and Plant slims) and one is a generic GO slim. In addition there is also the UniProtKB-GOA and whole proteome analysis and the Protein Information Resource slim. These GO slims are included as part of the GO flat file, but can also be downloaded individually from the website). The manual creation of GO slims is a painstaking process as the information loss from both the graph-structure and the gene-product annotation needs to be minimized [53]. A recent paper discusses the automatic creation of GO slims based on an information theoretic approach [53]. The analysis in the paper shows that the terms chosen for inclusion in existing GO slims are not always ideal and often subject to a bias. Recently, researchers have also used techniques from information theory to automatically organize and optimize the structure of the GO [54]. It is likely that in the future such approaches will be used more frequently for the construction and curation of both the full GO and GO slims.
There are a number of other ontologies and schemes for cataloguing genes available to researchers. In order to centralize the data, projects have been initiated to clean up and integrate ontologies [4, 16]. The most important such example is the Open Biomedical Ontologies (OBO) group which, guided by a set of principles similar to the ones the GO was built upon, seeks to standardize bio-ontologies [4]. As part of their efforts the OBO developed the OBO biological ontology file format for specifying ontologies. Their efforts also include the OBO Foundry, a group that is devoted to the integration of ontologies according to the OBO principles. In addition, this group is also concerned with removing redundant ontologies and aligning the development of ontologies by separate communities. An important tool in the standardization of ontologies is the OBO-Edit ontology editor (www.obo-edit.org) which is developed and maintained by the GO consortium.
Linking ontologies will increase their usefulness and power, but will also provide many more pitfalls for inexperienced users. Probably the most challenging aspect will be the integration of associations made from different types of evidence and blending the contents of the different ontologies to give maximal information while still remaining clear and concise. These steps will be necessary to ensure that both inter- and intra-ontology comparisons return meaningful results.
Key Points
  • The GO is a structured and controlled vocabulary of terms and relationships for cataloguing gene function.
  • Annotations in the GO can be experimentally or computationally derived, different classes of annotations have different levels of confidence.
  • The vast majority of annotations in the GO are automatically inferred and not curated.
  • Terms in the GO can be compared based on their information content, which is inversely proportional to the probability of a term.
  • Genes can be compared based on the terms that they are annotated with in the GO.
  • The GO is a powerful tool for data analysis, but its usage is fraught with pitfalls for inexperienced users, which could lead to false conclusions being drawn.
Acknowledgements
The authors thank Pascale Gaudet, Elke Schaper, Fran Supek, as well as the anonymous reviewers for their helpful feedback on the draft. This article started as assignment for the graduate course ‘Reviews in Computational Biology’ (263-5151-00L) at ETH Zurich.
Biographies
Louis du Plessis is studying a Masters degree in Computational Biology and Bioinformatics at the ETH Zurich. He completed his undergraduate studies at the University of the Witwatersrand in South Africa. His research interests include computational biology, machine learning and image processing.
Nives Škunca is a PhD student at the Ruđer Bošković Institute in Zagreb. Her research interests include computational functional annotation and machine learning.
Christophe Dessimoz is post-doc and lecturer in the CBRG group at ETH Zurich. He strives to understand the forces that shape genes, genomes and species, using computational and statistical methods.
1. Bodenreider O, Stevens R. Bio-ontologies: current trends and future directions. Brief Bioinform. 2006;7(3):256–74. [PMC free article] [PubMed]
2. IUBMB. Enzyme Nomenclature. 1992. Academic Press, San Diego.
3. Ashburner M, Ball CA, Blake JA, et al. Gene Ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet. 2000;25(1):25–9. [PMC free article] [PubMed]
4. Smith B, Ashburner M, Rosse C, et al. The OBO foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007;25(11):1251. [PMC free article] [PubMed]
5. Hu JC, Karp PD, Keseler IM, et al. What we can learn about Escherichia coli through application of Gene Ontology. Trends Microbiol. 2009;17(7):269–78. [PMC free article] [PubMed]
6. Harris MA, Clark J, Ireland A, et al. The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res. 2004;32(Database issue):D258–61. [PMC free article] [PubMed]
7. The Gene Ontology Consortium. The Gene Ontology in 2010: extensions and refinements. Nucleic Acids Res. 2010;38:D331–5. [PMC free article] [PubMed]
8. Rhee SY, Wood V, Dolinski K, et al. Use and misuse of the Gene Ontology annotations. Nat Rev Genet. 2008;9(7):509–15. [PubMed]
9. Hill D, Smith B, McAndrews-Hill M, et al. Gene ontology annotations: what they mean and where they come from. BMC Bioinformatics. 2008;9(Suppl. 5):S2. [PMC free article] [PubMed]
10. Reference Genome Group of the Gene Ontology Consortium. The Gene Ontology’s reference genome project: a unified framework for functional annotation across species. PLoS Comput Biol. 2009;5(7):e1000431. [PMC free article] [PubMed]
11. Lovering RC, Camon EB, Blake JA, et al. Access to immunology through the Gene Ontology. Immunology. 2008;125(2):154–60. [PubMed]
12. Lovering RC, Dimmer EC, Talmud PJ. Improvements to cardiovascular Gene Ontology. Atherosclerosis. 2009;205(1):9–14. [PMC free article] [PubMed]
13. Lindeberg M, Collmer A. Gene Ontology for type iii effectors: capturing processes at the host-pathogen interface. Trends Microbiol. 2009;17(7):304–11. [PubMed]
14. Barrell D, Dimmer E, Huntley RP, et al. The GOA database in 2009—an integrated gene ontology annotation resource. Nucleic Acids Res. 2009;37(Database issue):D396. [PMC free article] [PubMed]
15. Hunter S, Apweiler R, Attwood TK, et al. InterPro: the integrative protein signature database. Nucleic Acids Res. 2009;37(Database issue):D211–15. [PMC free article] [PubMed]
16. Rentzsch R, Orengo CA. Protein function prediction – the power of multiplicity. Trends Biotechnol. 2009;27(4):210–19. [PubMed]
17. Juncker A, Jensen L, Pierleoni A, et al. Sequence-based feature prediction and annotation of proteins. Genome Biol. 2009;10(2):206. [PMC free article] [PubMed]
18. Bork P, Koonin EV. Predicting functions from protein sequences–where are the bottlenecks? Nat Genet. 1998;18(4):313–18. [PubMed]
19. Liu Z-P, Wu L-Y, Wang Y, et al. Predicting Gene Ontology functions from protein’s regional surface structures. BMC Bioinformatics. 2007;8:475. [PMC free article] [PubMed]
20. Tatusov RL, Koonin EV, Lipman DJ. A genomic perspective on protein families. Science. 1997;278(5338):631–7. [PubMed]
21. Li L, Stoeckert CJ, Jr, Roos DS. OrthoMCL: identification of ortholog groups for eukaryotic genomes. Genome Res. 2003;13(9):2178–89. [PubMed]
22. Sigrist CJA, Cerutti L, Hulo N, et al. PROSITE: a documented database using patterns and profiles as motif descriptors. Brief Bioinformatics. 2002;3(3):265–74. [PubMed]
23. Bateman A, Coin L, Durbin R, et al. The Pfam protein families database. Nucleic Acids Res. 2004;32(Database issue):D138–41. [PMC free article] [PubMed]
24. Cai CZ, Han LY, Ji ZL, et al. SVM-Prot: Web-based support vector machine software for functional classification of a protein from its primary sequence. Nucleic Acids Res. 2003;31(13):3692–7. [PMC free article] [PubMed]
25. Levy ED, Ouzounis CA, Gilks WR, et al. Probabilistic annotation of protein sequences based on functional classifications. BMC Bioinformatics. 2005;6:302. [PMC free article] [PubMed]
26. Shen H-B, Chou K-C. EzyPred: a top-down approach for predicting enzyme functional classes and subclasses. Biochem Biophys Res Commun. 2007;364(1):53–9. [PubMed]
27. Lobley AE, Nugent T, Orengo CA, et al. FFPred: an integrated feature-based function prediction server for vertebrate proteomes. Nucleic Acids Res. 2008;36(Web Server issue):W297–302. [PMC free article] [PubMed]
28. Pesquita C, Faria D, Falcão AO, et al. Semantic similarity in biomedical ontologies. PLoS Comput Biol. 2009;5(7):e1000443. [PMC free article] [PubMed]
29. Arnaud MB, Costanzo MC, Shah P, et al. Gene Ontology and the annotation of pathogen genomes: the case of Candida albicans. Trends Microbiol. 2009;17(7):295–303. [PubMed]
30. Ramìrez F, Schlicker A, Assenov Y, et al. Computational analysis of human protein interaction networks. Proteomics. 2007;7(15):2541–52. [PubMed]
31. Ma W, Yang D, Gu Y, et al. Finding disease-specific coordinated functions by multi-function genes: insight into the coordination mechanisms in diseases. Genomics. 2009;94(2):94–100. [PubMed]
32. Shin CJ, Wong S, Davis MJ, et al. Protein-protein interaction as a predictor of subcellular location. BMC Syst Biol. 2009;3:28. [PMC free article] [PubMed]
33. de Bodt S, Proost S, Vandepoele K, et al. Predicting protein-protein interactions in Arabidopsis thaliana through integration of orthology, Gene Ontology and co-expression. BMC Genomics. 2009;10:288. [PMC free article] [PubMed]
34. Schnoes AM, Brown SD, Dodevski I, et al. Annotation error in public databases: Misannotation of molecular function in enzyme superfamilies. PLoS Comput Biol. 2009;5(12):e1000605. [PMC free article] [PubMed]
35. Jones C, Brown A, Baumann U. Estimating the annotation error rate of curated GO database sequence annotations. BMC Bioinformatics. 2007;8(1):170. [PMC free article] [PubMed]
36. McCarthy FM, Mahony TJ, Parcells MS, et al. Understanding animal viruses using the Gene Ontology. Trends Microbiol. 2009;17(7):328–35. [PubMed]
37. Pandey J, Koyutürk M, Subramaniam S, et al. Functional coherence in domain interaction networks. Bioinformatics. 2008;24(16):i28–34. [PubMed]
38. Rada R, Mili H, Bicknell E, et al. Development and application of a metric on semantic nets. IEEE Trans Syst Man Cybernetics. 1989;19(1):17–30.
39. Pekar V, Staab S. Taxonomy learning: factoring the structure of a taxonomy into a semantic classification decision. COLING. 2002;2:786–92.
40. Resnik P. In Proceedings of the 14th International Joint Conference on Artificial Intelligence. 1995. Using information content to evaluate semantic similarity in a taxonomy; pp. 448–53.
41. Chen J, Hsu W, Lee ML, et al. IEEE 23rd International Conference on Data Engineering. 2007. Labeling network motifs in protein interactomes for protein function prediction. ICDE 2007, pp. 546–55.
42. Lin D. In ICML ’98: Proceedings of the 15th International Conference on Machine Learning. An information-theoretic definition of similarity. 1998. pp.296–304. Morgan Kaufmann.
43. Sevilla JL, Segura V, Podhorski A, et al. Correlation between gene expression and GO semantic similarity. IEEE/ACM Trans Comput Biol Bioinform. 2005;2(4):330–8. [PubMed]
44. Schlicker A, Domingues FS, Rahnenführer J, et al. A new measure for functional similarity of gene products based on Gene Ontology. BMC Bioinformatics. 2006;7:302. [PMC free article] [PubMed]
45. Lord PW, Stevens RD, Brass A, et al. Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation. Bioinformatics. 2003;19(10):1275–83. [PubMed]
46. Azuaje F, Wang H, Bodenreider O. In Proceedings of the Eighth Annual Bio-Ontologies Meeting. 2005. Ontology-driven similarity approaches to supporting gene functional assessment.
47. Lee HK, Hsu AK, Sajdak J, et al. Coexpression analysis of human genes across many microarray data sets. Genome Res. 2004;14(6):1085–94. [PubMed]
48. Mistry M, Pavlidis P. Gene Ontology term overlap as a measure of gene functional similarity. BMC Bioinformatics. 2008;9:327. [PMC free article] [PubMed]
49. Chabalier J, Mosser J, Burgun A. A transversal approach to predict gene product networks from ontology-based similarity. BMC Bioinformatics. 2007;8:235. [PMC free article] [PubMed]
50. Martin DMA, Berriman M, Barton GJ. GOtcha: a new method for prediction of protein function assessed by the annotation of seven genomes. BMC Bioinformatics. 2004;5:178. [PMC free article] [PubMed]
51. Washington NL, Haendel MA, Mungall CJ, et al. Linking human diseases to animal models using ontology-based phenotype annotation. PLoS Biol. 2009;7(11):e1000247. [PMC free article] [PubMed]
52. Carbon S, Ireland A, Mungall CJ, et al. The AmiGO Hub, and the Web Presence Working Group. AmiGO: online access to ontology and annotation data. Bioinformatics. 2009;25(2):288–9. [PMC free article] [PubMed]
53. Davis M, Sehgal M, Ragan M. Automatic, context-specific generation of gene ontology slims. BMC Bioinformatics. 2010;11(1):498. [PMC free article] [PubMed]
54. Alterovitz G, Xiang M, Hill D, et al. Ontology engineering. Nat Biotech. 2010;28:128–30. [PubMed]
Articles from Briefings in Bioinformatics are provided here courtesy of
Oxford University Press