The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Accomplishments and challenges in literature data mining for biology
Open accessAbstract
We review recent results in literature data mining for biology and discuss the need and the steps for a challenge evaluation for this field. Literature data mining has progressed from simple recognition of terms to extraction of interaction relationships from complex sentences, and has broadened from recognition of protein interactions to a range of problems such as improving homology search, identifying cellular location, and so on. To encourage participation and accelerate progress in this expanding field, we propose creating challenge evaluations, and we describe two specific applications in this context. Contact: wuc@georgetown.edutsujii@is.s.u-tokyo.ac.jppark@nlp.kaist.ac.krlynette@mitre.orglimsoon@lit.org.sg * To whom correspondence should be addressed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
The SWISS-PROT protein sequence data bank and its supplement TrEMBL
Bairoch, A., & Apweiler, R. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.1.31 · Cited by 3,587
The SWISS-PROT protein sequence data bank and its supplement TrEMBL in 1998
Bairoch, A. (1998) · Nucleic Acids Research · doi:10.1093/nar/26.1.38 · Cited by 3,280
The SWISS-PROT protein sequence database and its supplement TrEMBL in 2000
Bairoch, A. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.45 · Cited by 3,093
Berman, H. M., Battistuz, T., Bhat, T. N., Bluhm, W. F., Bourne, P. E., Burkhardt, K., Feng, Z., Gilliland, G. L., Iype, L., Jain, S., et al. (2002) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444902003451 · Cited by 2,577
Xenarios, I. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.303 · Cited by 1,741
BIND--The Biomolecular Interaction Network Database
Bader, G. D. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.242 · Cited by 1,560
BIND: the Biomolecular Interaction Network Database
Bader, G. D. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg056 · Cited by 1,114
Creating the Gene Ontology Resource: Design and Implementation
Consortium, T. G. O. (2001) · Genome Research · doi:10.1101/gr.180801 · Cited by 956
RefSeq and LocusLink: NCBI gene-centered resources
Pruitt, K. D. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.137 · Cited by 893
Creating the gene ontology resource: design and implementation.
Blake, J. A., Corradi, J., Eppig, J. T., Hill, D. P., Richardson, J. E., & Ringwald, M. (2001) · The Mouseion at the JAXlibrary (Jackson Laboratory) · Cited by 826
Constructing biological knowledge bases by extracting information from text sources.
Craven, M. W., & Kumlien, J. (1999) · PubMed · Cited by 582
Molecular Interaction Map of the Mammalian Cell Cycle Control and DNA Repair Systems
Kohn, K. W. (1999) · Molecular Biology of the Cell · doi:10.1091/mbc.10.8.2703 · Cited by 560
Friedman, C., Kra, P., Yu, H., Krauthammer, M., & Rzhetsky, A. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.suppl_1.s74 · Cited by 507
PERFORMANCE MEASURES FOR INFORMATION EXTRACTION
Makhoul, J. I., Kubala, F., Schwartz, R. M., & Weischedel, R. (2007) · Cited by 503
Toward information extraction: identifying protein names from biological papers.
Fukuda, K., Tamura, A., Tsunoda, T., & Takagi, T. (1998) · PubMed · Cited by 494
The FlyBase database of the Drosophila genome projects and community literature
(2003) · Nucleic Acids Research · doi:10.1093/nar/gkg094 · Cited by 490
Automatic extraction of biological information from scientific text: protein-protein interactions.
Blaschke, C., Andrade-Navarro, M. A., Ouzounis, C. A., & Valencia, A. (1999) · PubMed · Cited by 448
EDGAR: Extraction of Drugs, Genes And Relations from the Biomedical Literature
Rindflesch, T. C., Tanabe, L., Weinstein, J. N., & Hunter, L. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0049 · Cited by 418
The Protein Data Bank: unifying the archive
Westbrook, J. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.245 · Cited by 309
Mining literature for protein–protein interactions
Marcotte, E. M., Xenarios, I., & Eisenberg, D. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.4.359 · Cited by 284
Information Processing and Management
(1984) · Journal of Information Processing and Management · doi:10.1241/johokanri.27.603 · Cited by 275
STAPLEY, B. J., & BENOIT, G. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0050 · Cited by 273
Automatic Extraction of Protein Interactions from Scientific Abstracts
Thomas, J., Milward, D., Ouzounis, C., Pulman, S., & Carroll, M. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0051 · Cited by 250
Extracting the names of genes and gene products with a hidden Markov model
Collier, N., Nobata, C., & Tsujii, J.-I. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/990820.990850 · Cited by 250
Self-citationMINING MEDLINE: ABSTRACTS, SENTENCES, OR PHRASES?
DING, J., BERLEANT, D., NETTLETON, D., & WURTELE, E. (2001) · Biocomputing 2002 · doi:10.1142/9789812799623_0031 · Cited by 243
EVENT EXTRACTION FROM BIOMEDICAL PAPERS USING A FULL PARSER
Yakushiji, A., Tateisi, Y., Miyao, Y., & Tsujii, J.-I. (2000) · Biocomputing 2001 · doi:10.1142/9789814447362_0040 · Cited by 224
Self-citationAndrade, M. A., & Valencia, A. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.7.600 · Cited by 216
The Protein Information Resource: an integrated public resource of functional annotation of proteins
Wu, C. H. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.35 · Cited by 211
Self-citationHumphreys, K., Demetriou, G., & Gaizauskas, R. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0048 · Cited by 169
Luo, L., Martin-Morris, L. E., & White, K. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-12-03849.1990 · Cited by 146
Park, J. C., Kim, H. S., & Kim, J. (2000) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814447362_0039 · Cited by 142
Self-citationToward Routine Automatic Pathway Discovery from On-line Scientific Text Abstracts.
Ng, S.-K., & Wong (1999) · PubMed · Cited by 134
TEXTQUEST: DOCUMENT CLUSTERING OF MEDLINE ABSTRACTS FOR CONCEPT DISCOVERY IN MOLECULAR BIOLOGY
Iliopoulos, I., Enright, A. J., & Ouzounis, C. (2000) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814447362_0038 · Cited by 115
PREDICTING THE SUB-CELLULAR LOCATION OF PROTEINS FROM TEXT USING SUPPORT VECTOR MACHINES
Stapley, B. J., Kelley, L. A., & Sternberg, M. J. E. (2001) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789812799623_0035 · Cited by 91
The Evolution of evaluation: Lessons from the Message Understanding Conferences
Hirschman, L. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0102 · Cited by 85
Self-citationThe Yeast Protein Database (YPD): a curated proteome database for Saccharomyces cerevisiae
Hodges, P. E. (1998) · Nucleic Acids Research · doi:10.1093/nar/26.1.68 · Cited by 83
PIES, a Protein Interaction Extraction System
Wong, L. (2000) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814447362_0050 · Cited by 72
Self-citationComparing the success of different prediction software in sequence analysis: A review
Bajić, V. B. (2000) · Briefings in Bioinformatics · doi:10.1093/bib/1.3.214 · Cited by 61
Analysis of biomedical text for chemical names: a comparison of three methods.
Wilbur, W. J., HAZARD, G. F. J., Divita, G., Mork, J. G., Aronson, A. R., & Browne, A. C. (1999) · PubMed · Cited by 59
Eisenhaber, F., & Peer Bork, B. (1999) · Bioinformatics · doi:10.1093/bioinformatics/15.7.528 · Cited by 48
iProClass: an integrated, comprehensive and annotated protein classification database
Wu, C. H. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.52 · Cited by 40
Self-citationA THEMATIC ANALYSIS OF THE AIDS LITERATURE
Wilbur, W. J. (2001) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789812799623_0036 · Cited by 32
Cited by
The text mining handbook: advanced approaches in analyzing unstructured data
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5684 · Cited by 1,598
Literature mining for the biologist: from information retrieval to biological discovery
Jensen, L. J., Saric, J., & Bork, P. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1768 · Cited by 631
Overview of BioCreAtIvE: critical assessment of information extraction for biology
Hirschman, L., Yeh, A., Blaschke, C., & Valencia, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s1-s1 · Cited by 530
Self-citationBioInfer: a corpus for information extraction in the biomedical domain
Pyysalo, S., Ginter, F., Heimonen, J., Björne, J., Boberg, J., Järvinen, J., & Salakoski, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-50 · Cited by 485
Corpus annotation for mining biomedical events from literature
Kim, J.-D., Ohta, T., & Tsujii, J. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-10 · Cited by 395
Self-citation
Metadata
- Authors
- Hirschman, L., Park, J. C., Tsujii, J., Wong, L., & Wu, C. H.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-12-01
- Volume
- 18
- Issue
- 12
- Pages
- 1553-1561
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2152183901
- Cited by
- 287
- References
- 43
- FWCI
- 11.77
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.