The DOI matches its Crossref record.
An Assessment of Gene Prediction Accuracy in Large DNA Sequences
Open accessAbstract
One of the first useful products from the human genome will be a set of predicted genes. Besides its intrinsic scientific interest, the accuracy and completeness of this data set is of considerable importance for human health and medicine. Though progress has been made on computational gene identification in terms of both methods and accuracy evaluation measures, most of the sequence sets in which the programs are tested are short genomic sequences, and there is concern that these accuracy measures may not extrapolate well to larger, more challenging data sets. Given the absence of experimentally verified large genomic data sets, we constructed a semiartificial test set comprising a number of short single-gene genomic sequences with randomly generated intergenic regions. This test set, which should still present an easier problem than real human genomic sequence, mimics the ∼200kb long BACs being sequenced. In our experiments with these longer genomic sequences, the accuracy of GENSCAN, one of the most accurate ab initio gene prediction programs, dropped significantly, although its sensitivity remained high. Conversely, the accuracy of similarity-based programs, such as GENEWISE,PROCRUSTES, and BLASTX, was not affected significantly by the presence of random intergenic sequence, but depended on the strength of the similarity to the protein homolog. As expected, the accuracy dropped if the models were built using more distant homologs, and we were able to quantitatively estimate this decline. However, the specificities of these techniques are still rather good even when the similarity is weak, which is a desirable characteristic for driving expensive follow-up experiments. Our experiments suggest that though gene prediction will improve with every new protein that is discovered and through improvements in the current set of tools, we still have a long way to go before we can decipher the precise exonic structure of every gene in the human genome using purely computational methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Initial sequencing and analysis of the human genome
International Human Genome Sequencing Consortium, Whitehead Institute for Biomedical Research, C. F. G. R., Lander, E. S., Linton, L. M., Birren, B., Nusbaum, C., Zody, M. C., Baldwin, J., Devon, K., Dewar, K., et al. (2001) · Nature · doi:10.1038/35057062 · Cited by 24,216
Haas, B. J., Salzberg, S. L., Zhu, W., Pertea, M., Allen, J. E., Orvis, J., White, O., Buell, C. R., & Wortman, J. R. (2008) · Genome Biology · doi:10.1186/gb-2008-9-1-r7 · Cited by 4,079
Birney, E., Clamp, M., & Durbin, R. (2004) · Genome Research · doi:10.1101/gr.1865504 · Cited by 2,542
Blom, N., Sicheritz‐Pontén, T., Gupta, R., Gammeltoft, S., & Brunak, S. (2004) · PROTEOMICS · doi:10.1002/pmic.200300771 · Cited by 2,069
Mobile genetic elements: the agents of open source evolution
Frost, L. S., Leplae, R., Summers, A. O., & Toussaint, A. (2005) · Nature Reviews Microbiology · doi:10.1038/nrmicro1235 · Cited by 1,847
Gene prediction with a hidden Markov model and a new intron submodel
Stanke, M., & Waack, S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg1080 · Cited by 1,439
AUGUSTUS: a web server for gene finding in eukaryotes
Stanke, M., Steinkamp, R., Waack, S., & Morgenstern, B. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh379 · Cited by 1,334
Stanke, M., Schöffmann, O., Morgenstern, B., & Waack, S. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-62 · Cited by 1,304
“Guigó et. al. compiled the test set sag178 [22] which contains real genes and randomly generated intergenic sequence.”
BackgroundResultGenome sequence of the lignocellulose degrading fungus Phanerochaete chrysosporium strain RP78
Martinez, D., Larrondo, L. F., Putnam, N., Gelpke, M. D. S., Huang, K., Chapman, J., Helfenbein, K. G., Ramaiya, P., Detter, J. C., Larimer, F., et al. (2004) · Nature Biotechnology · doi:10.1038/nbt967 · Cited by 939
Using the transcriptome to annotate the genome
Saha, S., Sparks, A. B., Rago, C., Akmaev, V., Wang, C. J., Vogelstein, B., Kinzler, K. W., & Velculescu, V. E. (2002) · Nature Biotechnology · doi:10.1038/nbt0502-508 · Cited by 630
Current methods of gene prediction, their strengths and weaknesses
Mathe, C. (2002) · Nucleic Acids Research · doi:10.1093/nar/gkf543 · Cited by 476
Using geneid to Identify Genes
Blanco, E., Parra, G., & Guigó, R. (2007) · Current Protocols in Bioinformatics · doi:10.1002/0471250953.bi0403s18 · Cited by 473
Self-citationExperimental annotation of the human genome using microarray technology
Shoemaker, D. D., Schadt, E. E., Armour, C. D., He, Y. D., Garrett-Engele, P., McDonagh, P. D., Loerch, P. M., Leonardson, A., Lum, P. Y., Cavet, G., et al. (2001) · Nature · doi:10.1038/35057141 · Cited by 439
Genome annotation: from sequence to biology
Stein, L. (2001) · Nature Reviews Genetics · doi:10.1038/35080529 · Cited by 432
Computational Inference of Homologous Gene Structures in the Human Genome
Yeh, R.-F., Lim, L. P., & Burge, C. B. (2001) · Genome Research · doi:10.1101/gr.175701 · Cited by 404
A comprehensive comparison of comparative RNA structure prediction approaches
Gardner, P. P., & Giegerich, R. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-140 · Cited by 352
Wang, W., Haberer, G., Gundlach, H., Gläßer, C., Nussbaumer, T., Luo, M. C., Lomsadze, A., Borodovsky, M., Kerstetter, R. A., Shanklin, J., et al. (2014) · Nature Communications · doi:10.1038/ncomms4311 · Cited by 350
Stanke, M., Tzvetkova, A., & Morgenstern, B. (2006) · Genome Biology · doi:10.1186/gb-2006-7-s1-s11 · Cited by 317
Evidence of en bloc duplication in vertebrate genomes
Abi-Rached, L., Gilles, A., Shiina, T., Pontarotti, P., & Inoko, H. (2002) · Nature Genetics · doi:10.1038/ng855 · Cited by 260
Computational prediction of eukaryotic protein-coding genes
Zhang, M. Q. (2002) · Nature Reviews Genetics · doi:10.1038/nrg890 · Cited by 252
A benchmark study of ab initio gene prediction methods in diverse eukaryotic organisms
Scalzitti, N., Jeannin-Girardon, A., Collet, P., Poch, O., & Thompson, J. D. (2020) · BMC Genomics · doi:10.1186/s12864-020-6707-9 · Cited by 96
Metadata
- Authors
- Guigó, R., Agarwal, P., Abril, J. F., Burset, M., & Fickett, J. W.
- Venue
- Genome Research
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2000-10-01
- Volume
- 10
- Issue
- 10
- Pages
- 1631-1642
- ISSN
- 1088-9051 (ISSN-L)
- 1549-5469
- OpenAlex
- W1864675704
- Cited by
- 214
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.