Email updates

Keep up to date with the latest news and content from Genome Biology and BioMed Central.

Open Access Highly Accessed Software

Anni 2.0: a multipurpose text-mining tool for the life sciences

Rob Jelier1, Martijn J Schuemie1*, Antoine Veldhoven1, Lambert CJ Dorssers2, Guido Jenster3 and Jan A Kors1

Author Affiliations

1 Department of Medical Informatics, Erasmus MC University Medical Center, Dr. Molewaterplein, Rotterdam, 3015 GE, The Netherlands

2 Department of Pathology, Erasmus MC University Medical Center, Dr. Molewaterplein, Rotterdam, 3015 GE, The Netherlands

3 Department of Urology, Erasmus MC University Medical Center, Dr. Molewaterplein, Rotterdam, 3015 GE, The Netherlands

For all author emails, please log on.

Genome Biology 2008, 9:R96  doi:10.1186/gb-2008-9-6-r96

The electronic version of this article is the complete one and can be found online at: http://genomebiology.com/2008/9/6/R96


Received:4 April 2008
Revisions received:7 April 2008
Accepted:12 June 2008
Published:12 June 2008

© 2008 Jelier et al.; licensee BioMed Central Ltd.

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Anni 2.0 is an online tool (http://biosemantics.org/anni/ webcite) to aid the biomedical researcher with a broad range of information needs. Anni provides an ontology-based interface to MEDLINE and retrieves documents and associations for several classes of biomedical concepts, including genes, drugs and diseases, with established text-mining technology. In this article we illustrate Anni's usability by applying the tool to two use cases: interpretation of a set of differentially expressed genes, and literature-based knowledge discovery.

Rationale

The amount of biomedical literature is vast and growing rapidly. It has become impossible for researchers to read all publications in their field of interest, which forces them to make a stringent selection of relevant articles to read. To keep abreast of the available knowledge, a wide range of initiatives has been deployed to mine the literature, from manual encoding of gene relations by the Gene Ontology Consortium [1], to automatic extraction of specific information such as transcript diversity [2], to the use of literature data for the prediction of disease genes [3,4] (see [5,6] for recent reviews). One of the emerging approaches is text-mining, which infers associations between biomedical entities by combining information from multiple papers. Text-mining approaches typically rely on occurrence and co-occurrence statistics of terms and have been successfully applied to a number of problems. The classic application is for literature-based knowledge discovery, which attempts to link disjunct sets of literature in order to derive promising new hypotheses [7-11]. Swanson (see, for example, [12]) was a pioneer in this field and was able to publish several new hypotheses derived with the help of literature mining. His well known first example was the hypothesis that Raynaud's disease could be treated with fish oil [13], which was later corroborated experimentally [14]. Another field to which text-mining has been successfully applied is the analysis of DNA microarray data [15-17]. With microarray experiments, hundreds of genes can be identified that are relevant to the studied phenomenon. The interpretation of such gene lists is challenging as, for a single gene, there can be hundreds or even thousands of articles pertaining to the gene's function. Text-mining can alleviate this complication by revealing the associations between the genes that are apparent from literature. This was the focus of the earlier version of Anni [18].

Here we present Anni 2.0, a tool that provides an ontology-based interface to the literature. The tool is aimed at a broad audience of biomedical researchers and facilitates traversing the huge corpus of biomedical literature efficiently to answer a broad range of information needs, including those for the interpretation of high-throughput datasets. Anni's functionality is based on the use of an ontology, which defines concepts, such as genes, biological processes and diseases, and their relations. Concepts come with a definition, a semantic type, and a list of synonymous terms and can be linked to online databases. We identify references to concepts in texts with our concept recognition software Peregrine [19]. The idea behind Anni is to relate or associate concepts to each other based on their associated sets of texts. Texts can be linked to a concept through automatic concept recognition, but also by using manually curated annotation databases. The texts associated with a concept are characterized by a so-called concept profile [18] (see Figure 1 for an introduction into the technology behind Anni). A concept profile consists of a list of related concepts and each concept in the profile has a weight to signify its importance. Concept profiles have been successfully used to infer functional associations between genes [18,20] and between genes and Gene Ontology (GO) codes [21] to infer novel genes associated with the nucleolus [22], and to identify new uses for drugs and other substances in the treatment of diseases [8].

thumbnailFigure 1. The technology behind Anni at a glance. Yellow balls indicate ontology concepts.

Anni 2.0 provides a generic framework to explore concept profiles and facilitates a broad range of tasks, including literature based knowledge discovery. The tool provides concepts and concept profiles covering the full scope of the Unified Medical Language System (UMLS) [23], a biomedical ontology. The user is given extensive control to query for direct associations (based on co-occurrences), to match concept profiles, and to explore the results in several ways, for instance with hierarchical clustering. Several types of ontological relations can be used in Anni. Semantic type information, which indicates whether a concept is about, for example, a gene or a drug, can be used to group concepts. This allows, for instance, a query as to whether a gene of interest has an association with any of the available diseases. Hierarchical 'parent/child' relations are also available and can be visualized. They can be used to explore the relations in a group of concepts or to expand a query by identifying relevant related concepts in the hierarchy. An important feature of Anni is transparency: all associations can be traced back to the supporting documents. In this way, Anni can also be used to retrieve documents about concepts of interest, thereby exploiting the mapping of synonyms and the resolution of ambiguous terms by our concept recognition software.

Previously, we illustrated the utility of concept profiles to retrieve functional and relevant associations between various types of concepts [18,21,22]. Here, we evaluate our tool through two use cases. First we use Anni to analyze a DNA microarray dataset. Second, we attempt to reproduce and expand a published literature-based knowledge discovery.

Implementation

Information sources

Anni is a Java client-server application and communicates with our server through remote method invocation. It uses three information sources.

One source is an ontology composed of the 2006AC version of the UMLS ontology [23] and a gene thesaurus derived from multiple databases [24]. Following Aronson [25], the UMLS thesaurus was adapted for efficient natural language processing, avoiding overly ambiguous or duplicate terms, and terms that are very unlikely to be found in natural text. The gene thesaurus contains genes from three species: human, mouse and rat. Homologs from these three species were mapped through NCBI's Homologene database [26]. In addition, genes with identical nomenclature were mapped to each other.

A second source is a database with indexed textual references to ontology concepts in MEDLINE abstracts (from 1980 on). For concept recognition, we make use of our Peregrine software [19]. Apart from mapping synonomous terms to one concept as identified by the ontology, Peregrine attempts to disambiguate words or phrases that refer to multiple terms based on contextual information. Participation in the Biocreative 2 competition shows Peregrine can recognize genes and proteins in text with a precision of 75% and recall of 76%, making it comparable to the current state-of-the-art. Abstracts were indexed together with the medical subject headings (MESH) concepts. MESH is a controlled vocabulary and concepts are manually assigned to abstracts to facilitate document retrieval. The registry number field (RN field) contains information on chemicals to which the abstract refers and was also incorporated in the analysis. The recall of the recognition of references to genes in texts was increased by taking common spelling variations into account [27].

A third source is a database with concept profiles based on the MEDLINE indexation. The basis of a concept profile is a set of abstracts associated to a concept. For GO terms we used the papers associated with the term by the GO annotation consortium [1]. For genes the set of abstracts in which the gene occurs was taken, but from a subset of MEDLINE containing documents on mammalian genes, selected by the PubMed query "(gene OR protein) AND mammals". For the other concepts we relied on the complete MEDLINE indexation. The weights in the concept profiles were derived by means of the symmetric uncertainty coefficient [28] (see [21] for a study on weighting schemes for concept profiles). For efficiency, we excluded from the concept profiles concepts with an association score lower than 10-8 and concepts that occurred only once in the MEDLINE indexation.

Design paradigms

Anni is organized through concept sets, which are displayed in a tree view. Upon startup a range of predefined concept sets are loaded: the three branches of the GO [29], the set of genes, and the semantic types as defined by the UMLS, for example, "Disease or Syndrome" or "Biologically Active Substance". Users can manipulate concept sets through basic set operations such as intersection, union and substraction, or they can create a new concept set and add concepts through an input panel. With the input panel the user can provide concept names or identifiers from several databases (Entrez Gene, Swiss-Prot and Gene Ontology identifiers, among others) through typing, pasting or loading a text file, and map them to concepts. To explore hierarchical relations between the concepts in a concept set, the concepts can be shown in a relational tree view.

Wherever in the application concepts are shown, they can be selected and, through a dropdown menu, several options are available: show concept definition and semantic types; transfer concepts to a new concept set; show concept profile (if available).

In Anni, many concepts have a concept profile. Concept profiles can be both queried and matched. A query on concept profiles will retrieve concept association scores based on the concepts' co-occurrences, for example, a query with the concept "prostate cancer" on the set of all genes will retrieve the genes mentioned together with this concept in abstracts, sorted by strength of association as measured by the uncertainty coefficient. Queries are performed with a query concept profile and query concepts can be individually weighted by the user. The table with the query results allows the user to sort on concept profiles that contained all the query concepts. In addition, the co-occurrence rate between concepts as observed in the MEDLINE database can be shown in the query result table. The query result table can be explored through two-dimensional hierarchical clustering and a heatmap.

Concept profiles can be matched to identify similarities between concept profiles, for instance, to identify genes associated with similar biological processes. As a matching score we use a scaled inner product score between concept profiles. The user can use a filter to control which concepts are used for matching. Concept sets can be used as an inclusive filter - only the concepts in the concept set are used for matching - or as an exclusive filter - all concepts are used for matching except the concepts in the filter concept set. The associations between concept profiles within a concept set can be explored through hierarchical clustering or a multi-dimensional scaling (MDS) projection (Figure 2). Additionally, two concept sets can be matched, which will result in a matrix of association values. Similar to the query result table, the direct co-occurrence frequency can be shown. Concepts with a high association score but no MEDLINE co-occurrences could indicate a new discovery: an association between concepts implicit in the literature but not yet explicitly described. The matrix can also be explored through two-dimensional hierarchical clustering and a heatmap.

thumbnailFigure 2. Screenshot of Anni. An MDS projection is shown of a test set of 47 genes, organized in 5 groups through a shared commonality (see legend and [17,18]). In the Explorer tab to the left, concept sets are organized in a tree. The toolbar on top provides concept set options and shows the current filter for matching concept profiles. The shown MDS view on a concept set can be used to get an overview of associations between the concepts, as used, for instance, in [22]. Groups of nodes can be selected and the similarities between their concept profiles analyzed in the annotation view. Nodes are colored based on user-defined features.

To provide transparency, Anni is equipped with an annotation view to evaluate the similarity within a group of concept profiles. The view provides a coherence measure, the average of the inner product scores of all possible pairs within the group. To aid the interpretation of the inner product scores, the probability is given that the same score or higher would be found in a randomly formed group of the same size. In addition, the percentage of the contributions of individual concepts to the coherence score are shown as well as the weights of these concepts in the individual concept profiles. Finally, every association in a concept profile can be traced to the supporting documents.

Results

Use case 1: analysis of a DNA microarray dataset

For this use case we applied Anni 2.0 to analyze a set of genes differentially expressed between localized and metastasized prostate cancer to unravel genes and pathways responsible for the progression of prostate cancer to metastatic disease. The dataset was generated based on three published studies [30-32]. Data from these studies were processed as in the original papers. For inclusion in our set, genes had to be in the top differentially expressed genes in at least two of the three studies. The set contained 69 genes expressed higher in metastasized cancer compared to local prostate cancer and 130 genes with lower expression (Additional data file 2). As a first step we investigated if there were genes known to be associated with prostate cancer. We performed a query for the concept "malignant neoplasm of the prostate". Sixty-eight genes had a direct association through co-occurrence, which is a highly significant over-representation (p = 2.04 × 10-8) given the number of genes associated with this concept in the predefined concept set "Genes".

To identify shared associated concepts between the genes in general, we clustered the up- and down-regulated genes separately. During the matching a broad semantic filter was employed to select for biomedical concepts relevant for gene function [18] (the filter is included as a predefined concept set). Figure 3 shows the clustering for genes more highly expressed in metastatic prostate cancer and Table 1 shows all identified clusters (for the full annotation see Additional data file 2). First, we consider the analysis of genes down-regulated in metastases. Two of the clusters are characterized by concepts apparently pertaining to the prostate stroma, such as "smooth muscle myosins" and "extracellular matrix proteins". This is expected as organ confined tumors contain stroma, whereas metastases, mainly from lymph nodes, are free of prostate stromal cells. Other gene clusters with lower expression in metastases pertain to the level of differentiation of the cancer cells and hence the grade of the cancer. Lower grade prostate tumors contain more differentiated epithelial cells that are involved in the secretion of prostatic fluid, which is reflected by clusters characterized by concepts such as "membrane transport proteins" and "exocytosis" [18].

Table 1. A selection of identified relevant clusters in the set of differentially expressed genes between metastatic and localized prostate cancer

thumbnailFigure 3. Clustering and annotation of differentially expressed genes. (a) The clustering of genes up-regulated in prostate metastases. The clustering is based on the similarity of the concept profiles of the genes. (b) A fragment of the annotation for cluster A. The annotation view displays for a cluster a group cohesion score with a p-value, and a list of concepts with their percentage contribution to the score. In addition, the weights of the concepts in the concept profiles are shown.

The clustering of genes more highly expressed in metastatic prostate cancer is dominated by the large cluster associated with kinetochores, anaphase-promoting complex and mitosis (Figure 3). In this cluster, subclusters associated with "kinetochores", "mitotic checkpoint" and "anaphase promoting complex" indicate the cluster is not just a signature of proliferation, but shows associations with a specific phase in mitosis: the spindle checkpoint. Indeed, the concept "spindle checkpoint activity" was the 13th concept (not counting genes) in the annotation for this cluster. The spindle checkpoint prevents a dividing cell from advancing from metaphase into anaphase before all kinetochores are correctly attached to the mitotic spindles. A kinetochore is the protein structure assembled on the centromere that links the chromosome to the microtubules of the mitotic spindle. The anaphase promoting complex (APC) ubiquitin ligase plays an important role in controlling the progression to anaphase by triggering the appropriately timed, ubiquitin-dependent proteolysis of mitotic regulatory proteins. A perturbation involving the APC is apparent, as a query on "anaphase promoting complex" reveals that 11 of the up-regulated genes have a strong association (>10-5), which is a highly significant overrepresentation (p < 5 × 10-11). Using the links in the application to the underlying literature and the Entrez Gene database, we can easily confirm the associations. For instance, for the genes shown in Figure 3b, CENPE is a kinetochore protein and CENPF is essential for kinetochore attachment [33], BUB1B is a mitotic checkpoint protein interacting with the APC [34], PTTG1 and AURKA are substrates of the APC [35,36] and UBE2C is one of the two ubiquitin-conjugating enzymes used by the APC [37,38]. All retrieved associations discussed above were supported by a set of supporting documents that was partially composed of documents predating the earliest microarray experiment publication, that is, they do not only reflect recent findings.

Deregulation of APC in vitro can result in defects in chromosome segregation, chromosomal instability, aneuploidy and increased sensitivity for tumorigenesis (for a review, see [39]). Also, changed levels of APC regulators and substrates have been found to be correlated with cancer malignancy and, for some cancers, with tumor aggressiveness [40]. A causal relation between deregulation of APC and malignancy or tumor aggressiveness has been suggested to exist through a higher mutation rate. Nevertheless, causality is not established in vivo, and observed APC deregulation could also be a consequence of tumorigenesis and genomic instability. Interestingly, Lehman et al. [40] did not find an APC mitotic cluster in prostate cancer and attributed this observation to the low aggressiveness of prostate cancers. As they studied organ confined prostate cancer, this is in line with our observation here. It appears, therefore, that also in prostate cancer, APC deregulation is correlated with tumor aggressiveness. Deregulation of the APC could have clinical consequences as some anti-neoplastic agents, such as nocodazole and taxol, work by activation of the spindle checkpoint [40]. Deregulation of the APC could, therefore, reduce the effectiveness of these drugs. For instance, overexpression of UBE2C can cause the nocodazole induced mitotic blockade to be bypassed [41].

Concluding, with Anni we were able to functionally annotate a DNA microarray dataset. Genes published as associated with prostate cancer were easily retrieved. We identified clusters with genes with lower expression levels in metastases likely associated with stroma and differentiation features of cancer cells. Among the genes more highly expressed in metastases, we identified a cluster associated with the spindle checkpoint and the APC. This is a previously unknown feature of metastasized prostate cancer and may be an indicator of the aggressiveness of the cancer.

Use case 2: literature-based knowledge discovery

Here, we illustrate Anni's knowledge discovery potential by reproducing a published literature-derived hypothesis. When looking for new therapeutic uses of the drug thalidomide, Weeber et al. [7] suggested, amongst others, that chronic hepatitis C could be treated with thalidomide. We selected this hypothesis as experimental evidence has recently emerged that appears to substantiate the claim [42,43]. Weeber et al. took the following approach: first, from the MEDLINE database concepts of the UMLS semantic type "immunological factors" were automatically retrieved that occurred together in a sentence with thalidomide. At position 7 in their list they found the concept "interleukin-12". Through the association of this concept with thalidomide, they identified an interesting biological process modulated by thalidomide. Second, they queried concepts of the semantic type "Disease or Syndrome" for association with the selected process of interest. Third, from the query results, diseases known to be associated with thalidomide were automatically removed and, after some additional manual curation, a shortlist was analyzed by an expert to identify diseases that could benefit from thalidomide treatment.

For reproducing this experiment we used the set of MEDLINE records published up to the time point given by Weeber et al. (July 2000), and generated concept profiles based on this set of records. In three simple steps, and closely following the considerations mentioned in the original article, we could reproduce Weeber et al.'s query. In the first step, based on the predefined concept sets available in Anni, we can readily select concepts belonging to a semantic type of choice. To reproduce Weeber et al.'s first filtering, we selected the predefined concept sets "Genes" and "Immunological factors", merged them and set the resulting set as an inclusive filter (we include "Genes" because genes in the UMLS thesaurus were removed in favor of our custom made gene thesaurus). With this filter, "interleukin-12" has a high rank in the concept profile of thalidomide - coincidentally, also seventh - which reproduces the first step of their approach.

As the next step, we queried the 8,152 concepts of the predefined concept set "Disease or Syndrome" for which a concept profile is available. Weeber et al. [7] describe the biological process they queried as follows: "Thalidomide has strong inhibitory effects on mononuclear cell production of IL-12 and a stimulatory effect on IL-10 production." Through these effects, thalidomide influences the balance of T-helper 1 versus T-helper 2 cells. Based on this description, we generated the following query: "IL-12", "IL-10", "Th1 cells", "Th2 cells" and "peripheral mononuclear cells". All concepts in the query were given equal weight, and all concepts were required to occur in the disease concept profile.

As we are only interested in diseases not previously associated with thalidomide, in the third step all diseases mentioned with thalidomide in a MEDLINE record (up to July 2000), were removed automatically from the resulting ranking (the query view can show MEDLINE co-occurrence rates). After this, some simple and straightforward additional manual cleanup was performed on the query result to create a shortlist for the expert: diseases closely related to previously filtered diseases that had a known association with thalidomide were removed - for example, "severe combined immunodeficiency" was removed since thalidomide has been used to treat wasting in AIDS; impractically broad disease concepts were removed, such as "parasitic infection"; closely related diseases were mapped to a single disease to reduce redundancy - for example, "cutaneous leishmaniasis", "leishmaniasis" and "visceral leishmaniasis" were mapped to "leishmaniasis"; and animal diseases were removed, for example, "toxoplasmosis, animal". The filtering process is facilitated by viewing the hierarchical relations between the concepts in Anni.

The top ten of our results are shown in Table 2; chronic hepatitis C appears sixth. Interestingly, of the higher scoring diseases, we found that PubMed now contains preliminary studies on the use of thalidomide for the treatment of leishmaniasis [44] and listeriosis [45]. On closer inspection, an association between leishmaniasis could actually have been found before 2000, because the parasite underlying the disease, Leishmania, had been mentioned in connection with thalidomide [46].

Table 2. Final ranking of diseases for use case 2

Discussion

With Anni we make available to the public a text mining methodology that we have successfully applied to several tasks: retrieving associations between genes, the functional annotation of genes, the functional annotation of the nucleolar proteome and the prediction of novel nucleolar proteins [18,21,22]. In this report Anni was applied to two very different use cases with good results: a new hypothesis on the progression of localized prostate cancer to metastatic disease and reproduction and extension of a previously published literature-based discovery. The tool has several innovative and useful features as described below.

Anni uses a concept-based approach. Definitions for the concepts are available in the application, as well as links to external databases and ontological information such as semantic type and 'parent/child' relations. In addition, when references to concepts are identified in texts, synonymous terms are mapped to the same concept. For this process, we pursued a high level of precision through a carefully curated ontology and by applying automatic homonym disambiguation (see [19] for a system description and performance evaluation). This is especially relevant for genes, as gene terminology is rich in synonymous and ambiguous terms [47,48] and is also an important feature of information retrieval tools like iHop [49].

Anni can compare concepts based on similarities in the documents associated with these concepts; therefore, implicit relations between concepts can be found. In addition, the user has complete control over which concepts are taken into account during the comparison. Combined, these features are very useful for knowledge discovery [8]. The approach also allows concepts to be included that are very hard to find in documents, such as GO codes, which are usually described with long, systematic terms.

Anni is a highly interactive application and offers a range of options to interactively explore the implicit and explicit associations between concepts. Query and match results can be viewed in a textual representation or in a graphical form through hierachically clustered heatmap or MDS projection visualizations. In addition, the tool provides a high level of transparency, which further improves its use.

Anni is a multi-purpose text-mining tool and the modular set-up and broad range of biomedical concepts allow many more tasks than the ones presented. The broad applicability of Anni 2.0 contrasts strongly with the majority of the previously published text-mining tools as well as with the earlier version of Anni. Text-mining tools tend to focus on one application, such as knowledge discovery [11,50] or the analysis of DNA microarray data [16,18,20]. Arrowsmith [11], for example, can compare two document sets to each other at a time, which is well suited for knowledge discovery, but impractical when looking for associations between a group of genes. TXTgate [20] is well suited to explore indirect associations between genes, but is not suitable for knowledge discovery purposes, as it cannot compare genes to a set of diseases or drugs. To further illustrate this point, the table in Additional data file 1 provides a comparison of Anni 2.0 to 13 previously published tools.

The Anni system has some limitations. First of all, the system works with co-occurrence based associations. These associations may not always reflect functional relations or facts. In addition, Anni relies on an ontology and automatic concept recognition in texts and neither are error free. For these reasons Anni was built to be transparent and all results can be traced back to the underlying documents. Another limitation is that only genes from mouse, rat and human are covered; support for other species is in development.

In conclusion, Anni provides an innovative ontology-based interface to the literature, and builds on advanced and well evaluated text-mining technology. Anni is a highly versatile tool, applicable to a broad range of tasks. It is freely available online [51].

Abbreviations

APC, anaphase promoting complex; GO, Gene Ontology; MDS, multi-dimensional scaling; MESH, medical subject headings; UMLS, Unified Medical Language System.

Authors' contributions

RJ conceived of the methodology and the evaluation, generated the data, wrote the paper and contributed to programming the application. MS conceived of the user interface and contributed to the programming and the manuscript. AV contributed to the software, especially the internet communication. GJ contributed the first use case, and together with LD provided user feedback and contributed to the manuscript. JK supervised the work and revised the manuscript.

Additional data files

The following additional data are available. Additional data file 1 is a table presenting an overview of published text-mining tools, including Anni 2.0, and their functionality. Additional data file 2 is an Excel format datasheet listing the differentially expressed genes between localized and metastasized prostate cancer as used for use case 1.

Additional data file 1. Overview of published text-mining tools, including Anni 2.0, and their functionality.

Format: PDF Size: 61KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Additional data file 2. Differentially expressed genes between localized and metastasized prostate cancer as used for use case 1.

Format: XLS Size: 109KB Download file

This file can be viewed with: Microsoft Excel ViewerOpen Data

Acknowledgements

We gratefully acknowledge Dr Marc Weeber for help with use case 2. We thank our user group that patiently provided feedback that proved essential for the development of Anni 2.0. RJ was supported by an ErasmusMC Breedtestrategie grant. AV was supported by INFOBIOMED, 6th R&D Framework, EC (IST 2002 507585). MS was supported by the Biorange project sp 4.1.1 of the Netherlands Bioinformatics Centre.

References

  1. Camon E, Magrane M, Barrell D, Lee V, Dimmer E, Maslen J, Binns D, Harte N, Lopez R, Apweiler R: The Gene Ontology Annotation (GOA) Database: sharing knowledge in Uniprot with Gene Ontology.

    Nucleic Acids Res 2004, 32(Database issue):D262-D266. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  2. Shah PK, Jensen LJ, Boué S, Bork P: Extraction of transcript diversity from scientific literature.

    PLoS Comput Biol 2005, 1:e10. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Tiffin N, Kelso JF, Powell AR, Pan H, Bajic VB, Hide WA: Integration of text- and data-mining using ontologies successfully selects disease gene candidates.

    Nucleic Acids Res 2005, 33:1544-1552. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  4. Perez-Iratxeta C, Bork P, Andrade MA: Association of genes to genetically inherited diseases using data mining.

    Nat Genet 2002, 31:316-319. PubMed Abstract | Publisher Full Text OpenURL

  5. Jensen LJ, Saric J, Bork P: Literature mining for the biologist: from information retrieval to biological discovery.

    Nat Rev Genet 2006, 7:119-129. PubMed Abstract | Publisher Full Text OpenURL

  6. Erhardt RAA, Schneider R, Blaschke C: Status of text-mining techniques applied to biomedical text.

    Drug Discov Today 2006, 11:315-325. PubMed Abstract | Publisher Full Text OpenURL

  7. Weeber M, Vos R, Klein H, Berg LTWDJVD, Aronson AR, Molema G: Generating hypotheses by discovering implicit associations in the literature: a case report of a search for new potential therapeutic uses for thalidomide.

    J Am Med Inform Assoc 2003, 10:252-259. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  8. Srinivasan P: Text mining: generating hypotheses from MEDLINE.

    JASIST 2004, 55:396-413. Publisher Full Text OpenURL

  9. Wren JD, Bekeredjian R, Stewart JA, Shohet RV, Garner HR: Knowledge discovery by automated identification and ranking of implicit relationships.

    Bioinformatics 2004, 20:389-398. PubMed Abstract | Publisher Full Text OpenURL

  10. Hristovski D, Peterlin B, Mitchell JA, Humphrey SM: Using literature-based discovery to identify disease candidate genes.

    Int J Med Inform 2005, 74:289-298. PubMed Abstract | Publisher Full Text OpenURL

  11. Smalheiser NR, Torvik VI, Bischoff-Grethe A, Burhans LB, Gabriel M, Homayouni R, Kashef A, Martone ME, Perkins GA, Price DL, Talk AC, West R: Collaborative development of the Arrowsmith two node search interface designed for laboratory investigators.

    J Biomed Discov Collab 2006, 1:8. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  12. Swanson DR: Medical literature as a potential source of new knowledge.

    Bull Med Libr Assoc 1990, 78:29-37. PubMed Abstract | PubMed Central Full Text OpenURL

  13. Swanson DR: Fish oil, Raynaud's syndrome, and undiscovered public knowledge.

    Perspect Biol Med 1986, 30:7-18. PubMed Abstract OpenURL

  14. DiGiacomo RA, Kremer JM, Shah DM: Fish-oil dietary supplementation in patients with Raynaud's phenomenon: a double-blind, controlled, prospective study.

    Am J Med 1989, 86:158-164. PubMed Abstract | Publisher Full Text OpenURL

  15. Chaussabel D, Sher A: Mining microarray expression data by literature profiling.

    Genome Biol 2002, 3:research0055.1-0055.16. BioMed Central Full Text OpenURL

  16. Raychaudhuri S, Chang JT, Imam F, Altman RB: The computational analysis of scientific literature to define and recognize gene expression clusters.

    Nucleic Acids Res 2003, 31:4553-4560. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  17. Jelier R, Jenster G, Dorssers LCJ, van der Eijk CC, van Mulligen EM, Mons B, Kors JA: Co-occurrence based meta-analysis of scientific texts: retrieving biological relationships between genes.

    Bioinformatics 2005, 21:2049-2058. PubMed Abstract | Publisher Full Text OpenURL

  18. Jelier R, Jenster G, Dorssers LCJ, Wouters BJ, Hendriksen PJ, Mons B, Delwel R, Kors JA: Text-derived concept profiles support assessment of DNA microarray data for acute myeloid leukemia and for androgen receptor stimulation.

    BMC Bioinformatics 2007, 8:14. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  19. Schuemie M, Jelier R, Kors J: Peregrine: Lightweight gene name normalization by dictionary lookup. In Proceedings of the Second BioCreative Challenge Evaluation Workshop: 23-25 April 2007; Madrid. Edited by Hirschman L, Krallinger M, Valencia A. Madrid: Centro Nacional de Investigaciones Oncologicas; 2007:131-140. OpenURL

  20. Glenisson P, Coessens B, Van Vooren S, Mathys J, Moreau Y, De Moor B: TXTGate: profiling gene groups with text-based information.

    Genome Biol 2004, 5:R43. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  21. Jelier R, Schuemie MJ, Roes PJ, van Mulligen EM, Kors JA: Literature-based concept profiles for gene annotation: the issue of weighting.

    Int J Med Inform 2008, 77:354-362. PubMed Abstract | Publisher Full Text OpenURL

  22. Schuemie M, Chichester C, Lisacek F, Coute Y, Roes PJ, Sanchez JC, Kors J, Mons B: Assignment of protein function and discovery of novel nucleolar proteins based on automatic analysis of MEDLINE.

    Proteomics 2007, 7:921-931. PubMed Abstract | Publisher Full Text OpenURL

  23. Bodenreider O: The Unified Medical Language System (UMLS): integrating biomedical terminology.

    Nucleic Acids Res 2004, 32(Database issue):D267-D270. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  24. Kors J, Schuemie M, Schijvenaars B, Weeber M, Mons B: Combination of genetic databases for improving identification of genes and proteins in text. [http://research.cs.queensu.ca/biolink05//presentations/Kors.pdf] webcite

    Biolink Conference: 24 June 2005; Detroit. OpenURL

  25. Aronson AR: Filtering the UMLS metathesaurus for MetaMap. [http://skr.nlm.nih.gov/papers/references/filtering06.pdf] webcite

    Technical Report. National Library of Medicine; 2006. OpenURL

  26. Wheeler DL, Barrett T, Benson DA, Bryant SH, Canese K, Chetvernin V, Church DM, DiCuccio M, Edgar R, Federhen S, Geer LY, Kapustin Y, Khovayko O, Landsman D, Lipman DJ, Madden TL, Maglott DR, Ostell J, Miller V, Pruitt KD, Schuler GD, Sequeira E, Sherry ST, Sirotkin K, Souvorov A, Starchenko G, Tatusov RL, Tatusova TA, Wagner L, Yaschenko E: Database resources of the National Center for Biotechnology Information.

    Nucleic Acids Res 2007, 35(Database issue):D5-D12. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  27. Schuemie MJ, Mons B, Weeber M, Kors JA: Evaluation of techniques for increasing recall in a dictionary approach to gene and protein name identification.

    J Biomed Inform 2007, 40:316-324. PubMed Abstract | Publisher Full Text OpenURL

  28. Goodman L, Kruskal W: Measures of Association for Cross Classifications. Springer-Verlag: New York; 1979. OpenURL

  29. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene Ontology: tool for the unification of biology. The Gene Ontology Consortium.

    Nat Genet 2000, 25:25-29. PubMed Abstract | Publisher Full Text OpenURL

  30. Tomlins SA, Mehra R, Rhodes DR, Cao X, Wang L, Dhanasekaran SM, Kalyana-Sundaram S, Wei JT, Rubin MA, Pienta KJ, Shah RB, Chinnaiyan AM: Integrative molecular concept modeling of prostate cancer progression.

    Nat Genet 2007, 39:41-51. PubMed Abstract | Publisher Full Text OpenURL

  31. Lapointe J, Li C, Higgins JP, Rijn M, Bair E, Montgomery K, Ferrari M, Egevad L, Rayford W, Bergerheim U, Ekman P, DeMarzo AM, Tibshirani R, Botstein D, Brown PO, Brooks JD, Pollack JR: Gene expression profiling identifies clinically relevant subtypes of prostate cancer.

    Proc Natl Acad Sci USA 2004, 101:811-816. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Varambally S, Yu J, Laxman B, Rhodes DR, Mehra R, Tomlins SA, Shah RB, Chandran U, Monzon FA, Becich MJ, Wei JT, Pienta KJ, Ghosh D, Rubin MA, Chinnaiyan AM: Integrative genomic and proteomic analysis of prostate cancer reveals signatures of metastatic progression.

    Cancer Cell 2005, 8:393-406. PubMed Abstract | Publisher Full Text OpenURL

  33. Feng J, Huang H, Yen TJ: CENP-F is a novel microtubule-binding protein that is essential for kinetochore attachments and affects the duration of the mitotic checkpoint delay.

    Chromosoma 2006, 115:320-329. PubMed Abstract | Publisher Full Text OpenURL

  34. Jeganathan KB, van Deursen JM: Differential mitotic checkpoint protein requirements in somatic and germ cells.

    Biochem Soc Trans 2006, 34:583-586. PubMed Abstract | Publisher Full Text OpenURL

  35. Zou H, McGarry TJ, Bernal T, Kirschner MW: Identification of a vertebrate sister-chromatid separation inhibitor involved in transformation and tumorigenesis.

    Science 1999, 285:418-422. PubMed Abstract | Publisher Full Text OpenURL

  36. Honda K, Mihara H, Kato Y, Yamaguchi A, Tanaka H, Yasuda H, Furukawa K, Urano T: Degradation of human Aurora2 protein kinase by the anaphase-promoting complex-ubiquitin-proteasome pathway.

    Oncogene 2000, 19:2812-2819. PubMed Abstract | Publisher Full Text OpenURL

  37. Yu H, King RW, Peters JM, Kirschner MW: Identification of a novel ubiquitin-conjugating enzyme involved in mitotic cyclin degradation.

    Curr Biol 1996, 6:455-466. PubMed Abstract | Publisher Full Text OpenURL

  38. Peters JM: The anaphase-promoting complex: proteolysis in mitosis and beyond.

    Mol Cell 2002, 9:931-943. PubMed Abstract | Publisher Full Text OpenURL

  39. Baker DJ, Dawlaty MM, Galardy P, van Deursen JM: Mitotic regulation of the anaphase-promoting complex.

    Cell Mol Life Sci 2007, 64:589-600. PubMed Abstract | Publisher Full Text OpenURL

  40. Lehman NL, Tibshirani R, Hsu JY, Natkunam Y, Harris BT, West RB, Masek MA, Montgomery K, Rijn M, Jackson PK: Oncogenic regulators and substrates of the anaphase promoting complex/cyclosome are frequently overexpressed in malignant tumors.

    Am J Pathol 2007, 170:1793-1805. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  41. Reddy SK, Rape M, Margansky WA, Kirschner MW: Ubiquitination by the anaphase-promoting complex drives spindle checkpoint inactivation.

    Nature 2007, 446:921-925. PubMed Abstract | Publisher Full Text OpenURL

  42. Caseiro MM: Treatment of chronic hepatitis C in non-responsive patients with pegylated interferon associated with ribavirin and thalidomide: report of six cases of total remission.

    Rev Inst Med Trop Sao Paulo 2006, 48:109-112. PubMed Abstract | Publisher Full Text OpenURL

  43. Milazzo L, Biasin M, Gatti N, Piacentini L, Niero F, Poma BZ, Galli M, Moroni M, Clerici M, Riva A: Thalidomide in the treatment of chronic hepatitis C unresponsive to alfa-interferon and ribavirin.

    Am J Gastroenterol 2006, 101:399-402. PubMed Abstract | Publisher Full Text OpenURL

  44. Solgi G, Kariminia A, Abdi K, Darabi M, Ghareghozloo B: Effects of combined therapy with thalidomide and glucantime on leishmaniasis induced by Leishmania major in BALB/c mice.

    Korean J Parasitol 2006, 44:55-61. PubMed Abstract | Publisher Full Text OpenURL

  45. Guo TL, Chi RP, Karrow NA, Zhang LX, Pruett SB, Germolec DR, White KL Jr: Thalidomide enhances both primary and secondary host resistances to Listeria monocytogenes infection by a neutrophil-related mechanism in female B6C3F1 mice.

    Toxicol Appl Pharmacol 2005, 209:244-254. PubMed Abstract | Publisher Full Text OpenURL

  46. Wolday D, Akuffo H, Demissie A, Britton S: Role of Leishmania donovani and its lipophosphoglycan in CD4+ T-cell activation-induced human immunodeficiency virus replication.

    Infect Immun 1999, 67:5258-5264. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Sehgal AK, Srinivasan P: Retrieval with gene queries.

    BMC Bioinformatics 2006, 7:220. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  48. Schijvenaars BJA, Mons B, Weeber M, Schuemie MJ, van Mulligen EM, Wain HM, Kors JA: Thesaurus-based disambiguation of gene symbols.

    BMC Bioinformatics 2005, 6:149. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  49. Hoffmann R, Valencia A: A gene network for navigating the literature.

    Nat Genet 2004, 36:664. PubMed Abstract | Publisher Full Text OpenURL

  50. Koike A, Takagi T: Knowledge discovery based on an implicit and explicit conceptual network.

    JASIST 2007, 58:51-65. Publisher Full Text OpenURL

  51. Biosemantics [http://www.biosemantics.org] webcite