Next-generation phylogenomics
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Thanks to advances in next-generation technologies, genome sequences are now being generated at breadth (e.g. across environments) and depth (thousands of closely related strains, individuals or samples) unimaginable only a few years ago. Phylogenomics--the study of evolutionary relationships based on comparative analysis of genome-scale data--has so far been developed as industrial-scale molecular phylogenetics, proceeding in the two classical steps: multiple alignment of homologous sequences, followed by inference of a tree (or multiple trees). However, the algorithms typically employed for these steps scale poorly with number of sequences, such that for an increasing number of problems, high-quality phylogenomic analysis is (or soon will be) computationally infeasible. Moreover, next-generation data are often incomplete and error-prone, and analysis may be further complicated by genome rearrangement, gene fusion and deletion, lateral genetic transfer, and transcript variation. Here we argue that next-generation data require next-generation phylogenomics, including so-called alignment-free approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The neighbor-joining method: a new method for reconstructing phylogenetic trees.
(1987) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a040454 · Cited by 59,715
FastTree 2 – Approximately Maximum-Likelihood Trees for Large Alignments
Price, M. N., Dehal, P. S., & Arkin, A. P. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009490 · Cited by 14,894 · cited 4×
“The prime example is FastTree [41] that, in my experience, has changed the practice of phylogenetic analysis by combining the (nearly) full rigour of maximum likelihood with the speed of methods like neighbour joining.”
MethodInfluentialUltraconserved Elements in the Human Genome
Bejerano, G., Pheasant, M., Makunin, I., Stephen, S., Kent, W. J., Mattick, J. S., & Haussler, D. (2004) · Science · doi:10.1126/science.1098119 · Cited by 1,732 · cited 1×
“…challenges including diverse chromosomal inheritance patterns, partial or whole-genome duplication, expansion and contraction of gene families, alternative splicing and other forms of transcriptional variation, non-protein-coding genes, mobile elements, and epigenetic modifications [14,19,20].”
BackgroundPhylogenomics and the reconstruction of the tree of life
Delsuc, F., Brinkmann, H., & Philippe, H. (2005) · Nature Reviews Genetics · doi:10.1038/nrg1603 · Cited by 1,236 · cited 2×
“These approaches, however, are not without limitations, especially when evolutionary histories are complicated [14,15].”
BackgroundDNA transposons and the evolution of eukaryotic genomes.
Feschotte, C., & Pritham, E. J. (2007) · Annual Review of Genetics · doi:10.1146/annurev.genet.40.110405.090448 · Cited by 1,218 · cited 1×
“…challenges including diverse chromosomal inheritance patterns, partial or whole-genome duplication, expansion and contraction of gene families, alternative splicing and other forms of transcriptional variation, non-protein-coding genes, mobile elements, and epigenetic modifications [14,19,20].”
BackgroundResolving difficult phylogenetic questions: Why more sequences are not enough
Philippe, H., Brinkmann, H., Lavrov, D. V., Littlewood, D. T. J., Manuel, M., Wörheide, G., & Baurain, D. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1000602 · Cited by 1,129 · cited 1×
“These approaches, however, are not without limitations, especially when evolutionary histories are complicated [14,15].”
BackgroundMetagenomics - a guide from sampling to data analysis
Thomas, T., Gilbert, J., & Meyer, F. (2012) · Microbial Informatics and Experimentation · doi:10.1186/2042-5783-2-3 · Cited by 1,029 · cited 1×
“In addition, k-mers have been used to partition and classify metagenomic data based on compositional biases of genome sequences, such that sequences with a particular abundance distribution of k-mers are grouped together (see [40] for review).”
MethodAlignment-free sequence comparison—a review
Vinga, S., & Almeida, J. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg005 · Cited by 804 · cited 1×
“…-mers are extracted and their counts or frequency distributions ( i.e. k -mer spectra) are computed; sequencing errors can appear as unexpected k -mers, while gene-regulatory regions, repetitive elements or laterally transferred regions can exhibit unexpected k -mer spectra (see [31] for a review).”
BackgroundAquaporins Constitute a Large and Highly Divergent Protein Family in Maize
Chaumont, F., Barrieu, F., Wojcik, E., Chrispeels, M. J., & Jung, R. (2001) · Plant Physiology · doi:10.1104/pp.125.3.1206 · Cited by 644 · cited 1×
“proteolipids of ATPase [25] or aquaporins in plants [26], is known to be problematic.”
BackgroundAccurate phylogenetic classification of variable-length DNA fragments
McHardy, A. C., Martín, H. G., Tsirigos, A., Hugenholtz, P., & Rigoutsos, I. (2007) · Nature Methods · doi:10.1038/nmeth976 · Cited by 564 · cited 1×
“, [44-46]).”
Highways of gene sharing in prokaryotes
Beiko, R. G., Harlow, T. J., & Ragan, M. A. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504068102 · Cited by 535 · cited 1×
“Like gene-by-gene phylogenetics, phylogenomics must accommodate (stochastic) substitution-rate variation and biases across sites and lineages, incomplete taxon sampling and, especially for prokaryotes and microbial eukaryotes, lateral genetic transfer [6,10,16-18].”
BackgroundSelf-citationAn information-based sequence distance and its application to whole mitochondrial genome phylogeny
Li, M., Badger, J. H., Chen, X., Kwong, S., Kearney, P., & Zhang, H. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.2.149 · Cited by 527 · cited 1×
“Alternative approaches not based on k-mer distances have also been put forward [32,37,38].”
Genomic footprints of a cryptic plastid endosymbiosis in diatoms
Moustafa, A., Beszteri, B., Maier, U. G., Bowler, C., Valentin, K., & Bhattacharya, D. (2009) · Science · doi:10.1126/science.1172983 · Cited by 422 · cited 1×
“[2,3,9,10]) have yielded unprecedented insight into physiology and evolution, and have generated novel hypotheses for future exploration [11-13].”
BackgroundAlignment Uncertainty and Genomic Analysis
Wong, K. M., Suchard, M. A., & Huelsenbeck, J. P. (2008) · Science · doi:10.1126/science.1151532 · Cited by 411 · cited 2×
“…have maintained their contiguity and relative order through evolutionary history, reconstructing this history requires assumptions about substitution models and uniformity of process across sites and branches, and involves the application of memory-intensive algorithms and heuristics [22,23].”
BackgroundPhylogenomic analyses unravel annelid evolution
Struck, T. H., Paul, C., Hill, N., Hartmann, S., Hösel, C., Kube, M., Lieb, B., Meyer, A., Tiedemann, R., Purschke, G., et al. (2011) · Nature · doi:10.1038/nature09864 · Cited by 406 · cited 1×
“…unavailable ( e.g. too technically challenging due to compositional bias, low complexity, long repeats or polyploidy), it is not uncommon to utilise transcriptome data in phylogenomic analysis [6-8], at some cost of lost information (weakly or differentially expressed genes, partial transcripts).”
Background[39] Unified approach to alignment and phylogenies
Hein, J. (1990) · Methods in Enzymology · doi:10.1016/0076-6879(90)83041-7 · Cited by 382 · cited 1×
“Approaches integrating MSA with phylogenetic reconstruction were proposed back in the 1980s [48] and 1990s [49-51], but these methods are not scalable due to NP-hardness, e.”
MethodCyanophora paradoxa Genome Elucidates Origin of Photosynthesis in Algae and Plants
Price, D. C., Chan, C. X., Yoon, H. S., Yang, E. C., Qiu, H., Weber, A. P. M., Schwacke, R., Gross, J., Blouin, N. A., Lane, C., et al. (2012) · Science · doi:10.1126/science.1213561 · Cited by 380 · cited 1×
“Even so, studies adopting these “ conventional ” phylogenomic approaches ( e.g. [ 2,3,9,10]) have yielded unprecedented insight into physiology and evolution, and have generated novel hypotheses for future exploration [11-13].”
BackgroundSelf-citationLiu, K., Warnow, T. J., Holder, M. T., Nelesen, S. M., Yu, J., Stamatakis, A. P., & Linder, C. R. (2012) · Systematic Biology · doi:10.1093/sysbio/syr095 · Cited by 340 · cited 2×
“Other strategies include a divide-and-conquer approach [28], in which MSA was performed on closely related subsets of sequences, then the information from these aligned”
BackgroundMethodThe alignment of sets of sequences and the construction of phyletic trees: An integrated method
Hogeweg, P., & Hesper, B. (1984) · Journal of Molecular Evolution · doi:10.1007/bf02257378 · Cited by 263 · cited 1×
“Approaches integrating MSA with phylogenetic reconstruction were proposed back in the 1980s [48] and 1990s [49-51] , but these methods are not scalable due to NP-hardness, e.g. [52] , and remain inevitably limited by the MSA framework.”
MethodPhylogenomics of Prokaryotic Ribosomal Proteins
Yutin, N., Puigbò, P., Koonin, E. V., & Wolf, Y. I. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036972 · Cited by 254 · cited 1×
“Relationships among taxa are inferred based on homology (inheritance from a common ancestor, commonly observed as patterns of sequence similarity) across entire genomes, whether in a comparative gene-by-gene [1,2], concatenated multi-gene [3,4] or whole-genome approach [5].”
BackgroundText-mining and information-retrieval services for molecular biology.
Krallinger, M., & Valencia, A. (2005) · Genome biology · doi:10.1186/gb-2005-6-7-224 · Cited by 252 · cited 1×
“…containing mis-or un-assembled contigs, overlapping transcripts, gene fragments or low-quality sequences, there is a great opportunity to draw on experience in fields less familiar to (and less well-mined by) evolutionary biologists, including signal transmission and information retrieval [35].”
BackgroundBaurain, D., Brinkmann, H., Petersen, J., Rodriguez-Ezpeleta, N., Stechmann, A., Demoulin, V., Roger, A. J., Burger, G., Lang, B. F., & Philippe, H. (2010) · Molecular Biology and Evolution · doi:10.1093/molbev/msq059 · Cited by 249 · cited 2×
“Even so, studies adopting these “ conventional ” phylogenomic approaches ( e.g. [ 2,3,9,10]) have yielded unprecedented insight into physiology and evolution, and have generated novel hypotheses for future exploration [11-13].”
BackgroundThe evolutionary history of haptophytes and cryptophytes: phylogenomic evidence for separate origins
Burki, F., Okamoto, N., Pombert, J.-F., & Keeling, P. J. (2012) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2011.2301 · Cited by 240 · cited 2×
“Relationships among taxa are inferred based on homology (inheritance from a common ancestor, commonly observed as patterns of sequence similarity) across entire genomes, whether in a comparative gene-by-gene [1,2], concatenated multi-gene [3,4] or whole-genome approach [5].”
BackgroundSanches, F. H. C., Miyai, C. A., Costa, T. M., Christofoletti, R. A., Volpato, G. L., & Barreto, R. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029746 · Cited by 239
Recent Evolutions of Multiple Sequence Alignment Algorithms
Notredame, C. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030123 · Cited by 224 · cited 2×
“Multiple sequence alignment (MSA) has long been a sine qua non in phylogenetics [21].”
BackgroundAccounting For Alignment Uncertainty in Phylogenomics
Wu, M., Chatterji, S., & Eisen, J. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0030288 · Cited by 205 · cited 1×
“…have maintained their contiguity and relative order through evolutionary history, reconstructing this history requires assumptions about substitution models and uniformity of process across sites and branches, and involves the application of memory-intensive algorithms and heuristics [22,23].”
BackgroundA Survey of Combinatorial Methods for Phylogenetic Networks
Huson, D. H., & Scornavacca, C. (2011) · Genome Biology and Evolution · doi:10.1093/gbe/evq077 · Cited by 200 · cited 1×
“Every attempt should be made to carry over into next-generation phylo-genomics the generally quadratic to cubic time-complexity of phylogenetic distance methods on trees [42] or networks [43].”
BackgroundPhylogenetic Inference Using Whole Genomes
Rannala, B., & Yang, Z. (2008) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev.genom.9.081307.164407 · Cited by 187 · cited 1×
“Relationships among taxa are inferred based on homology (inheritance from a common ancestor, commonly observed as patterns of sequence similarity) across entire genomes, whether in a comparative gene-by-gene [1,2], concatenated multi-gene [3,4] or whole-genome approach [5].”
BackgroundThe Tree and Net Components of Prokaryote Evolution
Puigbò, P., Wolf, Y. I., & Koonin, E. V. (2010) · Genome Biology and Evolution · doi:10.1093/gbe/evq062 · Cited by 181 · cited 2×
“Relationships among taxa are inferred based on homology (inheritance from a common ancestor, commonly observed as patterns of sequence similarity) across entire genomes, whether in a comparative gene-by-gene [1,2], concatenated multi-gene [3,4] or whole-genome approach [5].”
Background(1989) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a040577 · Cited by 174 · cited 1×
“Approaches integrating MSA with phylogenetic reconstruction were proposed back in the 1980s [48] and 1990s [49-51] , but these methods are not scalable due to NP-hardness, e.g. [52] , and remain inevitably limited by the MSA framework.”
MethodFreeing phylogenies from artifacts of alignment.
Thorne, J. L., & Kishino, H. (1992) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a040783 · Cited by 128 · cited 2×
“For example, Thorne and Kishino [27] estimated pairwise evolutionary distance based on insertion-deletion and amino acid replacements, instead of sequence identity.”
BackgroundReevaluating the Green Contribution to Diatom Genomes
Deschamps, P., & Moreira, D. (2012) · Genome Biology and Evolution · doi:10.1093/gbe/evs053 · Cited by 115 · cited 1×
“Even so, studies adopting these “ conventional ” phylogenomic approaches ( e.g. [ 2,3,9,10]) have yielded unprecedented insight into physiology and evolution, and have generated novel hypotheses for future exploration [11-13].”
BackgroundIs Multiple-Sequence Alignment Required for Accurate Inference of Phylogeny?
Höhl, M., & Ragan, M. A. (2007) · Systematic Biology · doi:10.1080/10635150701294741 · Cited by 109 · cited 3×
“If k -mers bearing enough unbiased signal can be extracted, statistically based comparisons of k -mer spectra can be used to infer phylogenetic relationships or map genetic transfer [32,33].”
BackgroundSelf-citationde Oliveira, L. S., Gregoracci, G. B., Silva, G. G. Z., Salgado, L. T., Filho, G. A. R. D. C., Alves‐Ferreira, M., Pereira, R. C., & Thompson, F. L. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-487 · Cited by 106 · cited 1×
“too technically challenging due to compositional bias, low complexity, long repeats or polyploidy), it is not uncommon to utilise transcriptome data in phylogenomic analysis [6-8], at some cost of lost information (weakly or differentially expressed genes, partial transcripts).”
BackgroundBarcodes for genomes and applications
Zhou, F., Olman, V. N., & Xu, Y. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-546 · Cited by 101 · cited 1×
“A more detailed discussion of techniques to detect horizontally transferred genes and to bin sequences from metagenomes based on compositional signals might have provided additional examples for the power of alignment free approaches already in widespread use today ( e.g. , [44-46]).”
BackgroundLateral Transfer of Genes and Gene Fragments in Prokaryotes
Chan, C. X., Beiko, R. G., Darling, A. E., & Ragan, M. A. (2009) · Genome Biology and Evolution · doi:10.1093/gbe/evp044 · Cited by 98 · cited 1×
“genomes, whether in a comparative gene-by-gene [1,2], concatenated multi-gene [3,4] or whole-genome approach [5].”
BackgroundSelf-citationStatistical significance in biological sequence analysis
Mitrophanov, A. Y., & Borodovsky, M. Y. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbk001 · Cited by 90 · cited 1×
“Given the heuristic nature of key steps in standard phylo-genomic workflows, the relevance of alignment scores to homology can be difficult to assess statistically [24].”
BackgroundHilario, E., & Gogarten, J. P. (1998) · Journal of Molecular Evolution · doi:10.1007/pl00006351 · Cited by 84 · cited 2×
“Ever since I attempted to analyse the evolutionary history of ATPase proteolipids [25], I am aware of the problems that multiple sequence alignments can create for phylogenetic analyses of divergent sequences, and I became a big fan of Thorne and Kishino ’ s approach to calculate phylogenies from…”
BackgroundDagan, T. (2011) · Trends in Microbiology · doi:10.1016/j.tim.2011.07.001 · Cited by 82 · cited 1×
“Like gene-by-gene phylogenetics, phylogenomics must accommodate (stochastic) substitution-rate variation and biases across sites and lineages, incomplete taxon sampling and, especially for prokaryotes and microbial eukaryotes, lateral genetic transfer [6,10,16-18].”
BackgroundRe-evaluating the Green versus Red Signal in Eukaryotes with Secondary Plastid of Red Algal Origin
Burki, F., Flegontov, P., Oborník, M., Cihlář, J., Pain, A., Lukeš, J., & Keeling, P. J. (2012) · Genome Biology and Evolution · doi:10.1093/gbe/evs049 · Cited by 75 · cited 1×
“[2,3,9,10]) have yielded unprecedented insight into physiology and evolution, and have generated novel hypotheses for future exploration [11-13].”
BackgroundNeuwald, A. F. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp342 · Cited by 68 · cited 2×
“Although the MSA problem itself may be even more challenging, promising developments are appearing in this area as well, e.g. [30].”
BackgroundMethodDACTAL: divide-and-conquer trees (almost) without alignments
Nelesen, S. M., Liu, K., Wang, L., Linder, C. R., & Warnow, T. J. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts218 · Cited by 63
Alignment-free detection of local similarity among viral and bacterial genomes
Domazet-Lošo, M., & Haubold, B. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr176 · Cited by 59 · cited 2×
“If k -mers bearing enough unbiased signal can be extracted, statistically based comparisons of k -mer spectra can be used to infer phylogenetic relationships or map genetic transfer [32,33].”
BackgroundYang, K., & Zhang, L. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn075 · Cited by 57 · cited 1×
“Studies based on simulated data suggest that trees based on pairwise distances computed from k-mer statistics can, under certain circumstances at least, be more accurate than those based on MSA [34].”
MethodEstimation of pairwise sequence similarity of mammalian enhancers with word neighbourhood counts
Göke, J., Schulz, M. H., Lasserre, J., & Vingron, M. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts028 · Cited by 49 · cited 1×
“This measure can alternatively be normalised by the probability at which corresponding k -mers occur in the sequences, or extended to include imperfect k -mer matches [36].”
BackgroundPattern-Based Phylogenetic Distance Estimation and Tree Reconstruction
Höhl, M., Rigoutsos, I., & Ragan, M. A. (2006) · Evolutionary Bioinformatics · doi:10.1177/117693430600200016 · Cited by 44 · cited 2×
“Alternative approaches not based on k -mer distances have also been put forward [32,37,38].”
BackgroundSelf-citationStiller, J. W. (2011) · BMC Evolutionary Biology · doi:10.1186/1471-2148-11-259 · Cited by 39
Towards more robust methods of alien gene detection
Azad, R. K., & Lawrence, J. G. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr059 · Cited by 33 · cited 1×
“A more detailed discussion of techniques to detect horizontally transferred genes and to bin sequences from metagenomes based on compositional signals might have provided additional examples for the power of alignment free approaches already in widespread use today ( e.g. , [44-46]).”
BackgroundChan, C. X., Soares, M. B., Bonaldo, M. F., Wisecaver, J. H., Hackett, J. D., Anderson, D. M., Erdner, D. L., & Bhattacharya, D. (2012) · Journal of Phycology · doi:10.1111/j.1529-8817.2012.01194.x · Cited by 31 · cited 2×
“Like gene-by-gene phylogenetics, phylogenomics must accommodate (stochastic) substitution-rate variation and biases across sites and lineages, incomplete taxon sampling and, especially for prokaryotes and microbial eukaryotes, lateral genetic transfer [6,10,16-18].”
BackgroundSelf-citationAlignment-free detection of horizontal gene transfer between closely related bacterial genomes
Domazet-Lošo, M., & Haubold, B. (2011) · Mobile Genetic Elements · doi:10.4161/mge.1.3.18065 · Cited by 20
Evolutionary Distances in the Twilight Zone—A Rational Kernel Approach
Schwarz, R. F., Fletcher, W., Förster, F., Merget, B., Wolf, M., Schultz, J., & Markowetz, F. M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015788 · Cited by 18 · cited 1×
“…[28] and Dactal [29], may be able to solve some of the MSA associated problems; however, as pointed out in the manuscript, approaches that are based on pairwise distances between sequences [32,37,47] calculated without a global alignment promise a faster and possibly equally reliable alternative.”
BackgroundSimultaneous phylogeny reconstruction and multiple sequence alignment
Yue, F., Shi, J., & Tang, J. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s1-s11 · Cited by 17 · cited 1×
“[52], and remain inevitably limited by the MSA framework.”
Background
Cited by
Treangen, T. J., Ondov, B., Koren, S., & Phillippy, A. M. (2014) · Genome biology · doi:10.1186/preaccept-2573980311437212 · Cited by 1,654
Fuentes‐Pardo, A. P., & Ruzzante, D. E. (2017) · Molecular Ecology · doi:10.1111/mec.14264 · Cited by 394
Whole-Genome Sequencing in Outbreak Analysis
Gilchrist, C. A., Turner, S. D., Riley, M. F., Petri, W. A., & Hewlett, E. L. (2015) · Clinical Microbiology Reviews · doi:10.1128/cmr.00075-13 · Cited by 288
The Prehistory of Antibiotic Resistance
Perry, J., Waglechner, N., & Wright, G. (2016) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a025197 · Cited by 210
“In a defining study, D’Costa et al. (2011) showed the presence of gene-encoding resistance to blactam, tetracycline, and glycopeptide antibiotics in metagenome samples of 30,000-year-old permafrost, which also contained DNA belonging to woolly mammoths and other animal and plant species unique to the Pleistocene.”
BackgroundProgress towards the Tree of Eukaryotes
Keeling, P. J., & Burki, F. (2019) · Current Biology · doi:10.1016/j.cub.2019.07.031 · Cited by 159
Metadata
- Authors
- Chan, C. X., & Ragan, M. A.
- Venue
- Biology Direct
- Published
- 2013-01-22
- Volume
- 8
- Issue
- 1
- Pages
- 3-3
- ISSN
- 1745-6150 (ISSN-L)
- OpenAlex
- W2100561059
- Cited by
- 172
- References
- 52
- FWCI
- 6.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.