The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Evaluating stably expressed genes in single cells
Open accessPublished version of a preprint
Abstract
Background: Single-cell RNA-seq (scRNA-seq) profiling has revealed remarkable variation in transcription, suggesting that expression of many genes at the single-cell level is intrinsically stochastic and noisy. Yet, on the cell population level, a subset of genes traditionally referred to as housekeeping genes (HKGs) are found to be stably expressed in different cell and tissue types. It is therefore critical to question whether stably expressed genes (SEGs) can be identified on the single-cell level, and if so, how can their expression stability be assessed? We have previously proposed a computational framework for ranking expression stability of genes in single cells for scRNA-seq data normalization and integration. In this study, we perform detailed evaluation and characterization of SEGs derived from this framework. Results: Here, we show that gene expression stability indices derived from the early human and mouse development scRNA-seq datasets and the "Mouse Atlas" dataset are reproducible and conserved across species. We demonstrate that SEGs identified from single cells based on their stability indices are considerably more stable than HKGs defined previously from cell populations across diverse biological systems. Our analyses indicate that SEGs are inherently more stable at the single-cell level and their characteristics reminiscent of HKGs, suggesting their potential role in sustaining essential functions in individual cells. Conclusions: SEGs identified in this study have immediate utility both for understanding variation and stability of single-cell transcriptomes and for practical applications such as scRNA-seq data normalization. Our framework for calculating gene stability index, "scSEGIndex," is incorporated into the scMerge Bioconductor R package (https://sydneybiox.github.io/scMerge/reference/scSEGIndex.html) and can be used for identifying genes with stable expression in scRNA-seq datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3: Comparison of SEGs identified on individual cell level using scRNA-seq with HKGs defined on cell population level using bulk transcriptome data. (A) Scatter plot showing mean expression (x-axis) and variance (y-axis) of each gene (gray circles) across profiled single cells. Open red circles represent SEGs identified from early human development data (hSEG) in this study whereas dark and light blue solid circles represent HKGs defined previously using bulk microarray [15] and RNA-seq data [10]. (B) Same as (A) but for SEGs identified from early mouse development data (mSEG*; light blue points) and the union of these identified from both mouse development and mouse atlas datasets (mSEG; green circles). (C) Venn diagrams showing overlaps of hSEGs and HKGs defined using bulk microarray and RNA-seq. (D) Overlap of all human and mouse gene lists. (E) Expression patterns of example genes that are defined as SEGs using scRNA-seq data but not as HKGs using bulk microarray or RNA-seq data (RPL26 and RPL36) and vice versa (HINT and AGPAT1) across individual cells. (F) Expression patterns for GAPDH and ACTB in human and mouse (Gapdh and Actb) across individual cells.](https://figures.cochat.ai/paper-figures/e50e3944c3e3436fb3a56f1a7b7a5641/evaluating-stably-expressed-genes-in-single-cells-figure-3.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In simulations, we confirmed that the TRADE perturbation impact and response enrichment estimators are approximately unbiased, including for small gene sets (Supplementary Fig. 14), and we performed further validation with positive-control gene sets19,20 (Supplementary Fig. 15).”
From Transcriptome-wide analysis of differential expression in perturbation atlases (2025) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A scaling normalization method for differential expression analysis of RNA-seq data
Robinson, M. D., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-3-r25 · Cited by 7,876
Objective Criteria for the Evaluation of Clustering Methods
Rand, W. M. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482356 · Cited by 6,566
The Reactome pathway Knowledgebase
Fabregat, A., Sidiropoulos, K., Garapati, P., Gillespie, M., Hausmann, K., Haw, R., Jassal, B., Jupe, S., Korninger, F., McKay, S., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1351 · Cited by 5,605
Dissecting the multicellular ecosystem of metastatic melanoma by single-cell RNA-seq
Tirosh, I., Izar, B., Prakadan, S. M., Wadsworth, M. H., Treacy, D., Trombetta, J. J., Rotem, A., Rodman, C., Lian, C., Murphy, G., et al. (2016) · Science · doi:10.1126/science.aad0501 · Cited by 4,944
mRNA-Seq whole-transcriptome analysis of a single cell
Tang, F., Barbacioru, C., Wang, Y., Nordman, E., Lee, C., Xu, N., Wang, X., Bodeau, J., Tuch, B. B., Siddiqui, A., et al. (2009) · Nature Methods · doi:10.1038/nmeth.1315 · Cited by 3,969
Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq
Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., et al. (2015) · Science · doi:10.1126/science.aaa1934 · Cited by 3,124
Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris
The Tabula Muris Consortium, coordination, O., coordination, L., processing, O. C. A., sequencing, L. P. A., analysis, C. D., annotation, C. T., Writing group, Supplemental text writing group, & Principal investigators (2018) · Nature · doi:10.1038/s41586-018-0590-4 · Cited by 2,842
Single-cell RNA-seq reveals new types of human blood dendritic cells, monocytes, and progenitors
Villani, A.-C., Satija, R., Reynolds, G., Sarkizova, S., Shekhar, K., Fletcher, J., Griesbeck, M., Butler, A., Zheng, S., Lazo, S., et al. (2017) · Science · doi:10.1126/science.aah4573 · Cited by 2,413
Stochasticity in gene expression: from theories to phenotypes
Kærn, M., Elston, T. C., Blake, W. J., & Collins, J. J. (2005) · Nature Reviews Genetics · doi:10.1038/nrg1615 · Cited by 2,320
BioMart and Bioconductor: a powerful link between biological databases and microarray data analysis
Durinck, S., Moreau, Y., Kasprzyk, A., Davis, S., De Moor, B., Brazma, A., & Huber, W. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti525 · Cited by 2,315
Normalization of RNA-seq data using factor analysis of control genes or samples
Risso, D., Ngai, J., Speed, T. P., & Dudoit, S. (2014) · Nature Biotechnology · doi:10.1038/nbt.2931 · Cited by 2,052
Self-citationThe Reactome pathway knowledgebase
Croft, D., Mundo, A. F., Haw, R., Milacic, M., Weiser, J., Wu, G., Caudy, M., Garapati, P., Gillespie, M., Kamdar, M. R., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1102 · Cited by 1,889
Expansion of the Gene Ontology knowledgebase and resources
The Gene Ontology Consortium (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw1108 · Cited by 1,850
Massively parallel single-cell RNA-seq for marker-free decomposition of tissues into cell types
Jaitin, D. A., Kenigsberg, E., Keren-Shaul, H., Elefant, N., Paul, F., Zaretsky, I., Mildner, A., Cohen, N., Jung, S., Tanay, A., et al. (2014) · Science · doi:10.1126/science.1247651 · Cited by 1,795
A Method for Comparing Two Hierarchical Clusterings
Fowlkes, E. B., & Mallows, C. L. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10478008 · Cited by 1,614
Housekeeping genes as internal standards: use and limits
Thellin, O., Zorzi, W., Lakaye, B., De Borman, B., Coumans, B., Hennen, G., Grisar, T., Igout, A., & Heinen, E. (1999) · Journal of Biotechnology · doi:10.1016/s0168-1656(99)00163-7 · Cited by 1,544
Baron, M., Veres, A., Wolock, S. L., Faust, A. L., Gaujoux, R., Vetere, A., Ryu, J. H., Wagner, B. K., Shen-Orr, S. S., Klein, A. M., et al. (2016) · Cell Systems · doi:10.1016/j.cels.2016.08.011 · Cited by 1,508
The Technology and Biology of Single-Cell RNA Sequencing
Kolodziejczyk, A. A., Kim, J. K., Svensson, V., Marioni, J. C., & Teichmann, S. A. (2015) · Molecular Cell · doi:10.1016/j.molcel.2015.04.005 · Cited by 1,487
A survey of human brain transcriptome diversity at the single cell level
Darmanis, S., Sloan, S. A., Zhang, Y., Enge, M., Caneda, C., Shuer, L. M., Hayden Gephart, M. G., Barres, B. A., & Quake, S. R. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1507125112 · Cited by 1,401
Bayesian approach to single-cell differential expression analysis
Kharchenko, P. V., Silberstein, L., & Scadden, D. T. (2014) · Nature Methods · doi:10.1038/nmeth.2967 · Cited by 1,348
Single-Cell RNA-Seq Reveals Dynamic, Random Monoallelic Gene Expression in Mammalian Cells
Deng, Q., Ramsköld, D., Reinius, B., & Sandberg, R. (2014) · Science · doi:10.1126/science.1245316 · Cited by 1,345
Reconstructing lineage hierarchies of the distal lung epithelium using single-cell RNA-seq
Treutlein, B., Brownfield, D. G., Wu, A. R., Neff, N. F., Mantalas, G. L., Espinoza, F. H., Desai, T. J., Krasnow, M. A., & Quake, S. R. (2014) · Nature · doi:10.1038/nature13173 · Cited by 1,342
Human housekeeping genes, revisited
Eisenberg, E., & Levanon, E. Y. (2013) · Trends in Genetics · doi:10.1016/j.tig.2013.05.010 · Cited by 1,282
Natural Scales in Geographical Patterns
Menezes, T., & Roth, C. (2017) · Scientific Reports · doi:10.1038/srep45823 · Cited by 1,191
Single-cell transcriptomics reveals bimodality in expression and splicing in immune cells
Shalek, A. K., Satija, R., Adiconis, X., Gertner, R. S., Gaublomme, J. T., Raychowdhury, R., Schwartz, S., Yosef, N., Malboeuf, C., Lu, D., et al. (2013) · Nature · doi:10.1038/nature12172 · Cited by 1,190
Natural Scales in Geographical Patterns
Menezes, T., & Roth, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01036 · Cited by 1,120
Pooling across cells to normalize single-cell RNA sequencing data with many zero counts
L. Lun, A. T., Bach, K., & Marioni, J. C. (2016) · Genome Biology · doi:10.1186/s13059-016-0947-7 · Cited by 1,108
Single-Cell RNA-Seq Reveals Lineage and X Chromosome Dynamics in Human Preimplantation Embryos
Petropoulos, S., Edsgärd, D., Reinius, B., Deng, Q., Panula, S. P., Codeluppi, S., Plaza Reyes, A., Linnarsson, S., Sandberg, R., & Lanner, F. (2016) · Cell · doi:10.1016/j.cell.2016.03.023 · Cited by 1,063
Mammalian genes are transcribed with widely different bursting kinetics
Suter, D. M., Molina, N., Gatfield, D., Schneider, K., Schibler, U., & Naef, F. (2011) · Science · doi:10.1126/science.1198817 · Cited by 927
Essential genes of a minimal bacterium
Glass, J. I., Assad-Garcia, N., Alperovich, N., Yooseph, S., Lewis, M. R., Maruf, M., Hutchison, C. A., Smith, H. O., & Venter, J. C. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0510013103 · Cited by 912
Control Selection for RNA Quantitation
Suzuki, T., Higgins, P. J., & Crawford, D. R. (2000) · BioTechniques · doi:10.2144/00292rv02 · Cited by 875
A comparison of extrinsic clustering evaluation metrics based on formal constraints
Amigó, E., Gonzalo, J., Artiles, J., & Verdejo, F. (2009) · Information Retrieval · doi:10.1007/s10791-008-9066-8 · Cited by 831
An Abundance of Ubiquitously Expressed Genes Revealed by Tissue Transcriptome Sequence Data
Ramsköld, D., Wang, E. T., Burge, C. B., & Sandberg, R. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000598 · Cited by 820
Analysis of human transcriptomes
Velculescu, V. E., Madden, S. L., Zhang, L., Lash, A. E., Yu, J., Rago, C., Lal, A., Wang, C. J., Beaudry, G. A., Ciriello, K. M., et al. (1999) · Nature Genetics · doi:10.1038/70487 · Cited by 774
Evidence Based Selection of Housekeeping Genes
de Jonge, H. J. M., Fehrmann, R. S. N., de Bont, E. S. J. M., Hofstra, R. M. W., Gerbens, F., Kamps, W. A., de Vries, E. G. E., van der Zee, A. G. J., te Meerman, G. J., & ter Elst, A. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000898 · Cited by 748
Enhancer Control of Transcriptional Bursting
Fukaya, T., Lim, B., & Levine, M. (2016) · Cell · doi:10.1016/j.cell.2016.05.025 · Cited by 721
Human housekeeping genes are compact
Eisenberg, E., & Levanon, E. Y. (2003) · Trends in Genetics · doi:10.1016/s0168-9525(03)00140-9 · Cited by 698
Comparative genomics, minimal gene-sets and the last universal common ancestor
Koonin, E. V. (2003) · Nature Reviews Microbiology · doi:10.1038/nrmicro751 · Cited by 661
Determination of the Core of a Minimal Bacterial Gene Set
Gil, R., Silva, F. J., Peretó, J., & Moya, A. (2004) · Microbiology and Molecular Biology Reviews · doi:10.1128/mmbr.68.3.518-537.2004 · Cited by 573
WARRINGTON, J. A., NAIR, A., MAHADEVAPPA, M., & TSYGANSKAYA, M. (2000) · Physiological Genomics · doi:10.1152/physiolgenomics.2000.2.3.143 · Cited by 541
A compendium of gene expression in normal human tissues
HSIAO, L.-L., DANGOND, F., YOSHIDA, T., HONG, R., JENSEN, R. V., MISRA, J., DILLON, W., LEE, K. F., CLARK, K. E., HAVERTY, P., et al. (2001) · Physiological Genomics · doi:10.1152/physiolgenomics.00040.2001 · Cited by 503
A Study of the Comparability of External Criteria for Hierarchical Cluster Analysis
Milligan, G. W., & Cooper, M. C. (1986) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2104_5 · Cited by 482
Chu, L.-F., Leng, N., Zhang, J., Hou, Z., Mamott, D., Vereide, D. T., Choi, J., Kendziorski, C., Stewart, R., & Thomson, J. A. (2016) · Genome Biology · doi:10.1186/s13059-016-1033-x · Cited by 477
From single-cell to cell-pool transcriptomes: Stochasticity in gene expression and RNA splicing
Marinov, G. K., Williams, B. A., McCue, K., Schroth, G. P., Gertz, J., Myers, R. M., & Wold, B. J. (2014) · Genome Research · doi:10.1101/gr.161034.113 · Cited by 468
Using control genes to correct for unwanted variation in microarray data
Gagnon-Bartsch, J. A., & Speed, T. P. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr034 · Cited by 442
Self-citationMaking the blastocyst: lessons from the mouse
Cockburn, K., & Rossant, J. (2010) · Journal of Clinical Investigation · doi:10.1172/jci41229 · Cited by 391
Mammalian Housekeeping Genes Evolve More Slowly than Tissue-Specific Genes
Zhang, L., & Li, W.-H. (2004) · Molecular Biology and Evolution · doi:10.1093/molbev/msh010 · Cited by 354
Aging increases cell-to-cell transcriptional variability upon immune stimulation
Martinez-Jimenez, C. P., Eling, N., Chen, H.-C., Vallejos, C. A., Kolodziejczyk, A. A., Connor, F., Stojic, L., Rayner, T. F., Stubbington, M. J. T., Teichmann, S. A., et al. (2017) · Science · doi:10.1126/science.aah4115 · Cited by 339
Resolving early mesoderm diversification through single-cell expression profiling
Scialdone, A., Tanaka, Y., Jawaid, W., Moignard, V., Wilson, N. K., Macaulay, I. C., Marioni, J. C., & Göttgens, B. (2016) · Nature · doi:10.1038/nature18633 · Cited by 293
On the nature of human housekeeping genes
Zhu, J., He, F., Hu, S., & Yu, J. (2008) · Trends in Genetics · doi:10.1016/j.tig.2008.08.004 · Cited by 286
SCnorm: robust normalization of single-cell RNA-seq data
Bacher, R., Chu, L.-F., Leng, N., Gasch, A. P., Thomson, J. A., Stewart, R. M., Newton, M., & Kendziorski, C. (2017) · Nature Methods · doi:10.1038/nmeth.4263 · Cited by 282
Rubie, C., Kempf, K., Hans, J., Su, T., Tilton, B., Georg, T., Brittner, B., Ludwig, B., & Schilling, M. (2005) · Molecular and Cellular Probes · doi:10.1016/j.mcp.2004.10.001 · Cited by 275
BUTTE, A. J., DZAU, V. J., & GLUECK, S. B. (2001) · Physiological Genomics · doi:10.1152/physiolgenomics.2001.7.2.95 · Cited by 209
Lin, Y., Ghazanfar, S., Wang, K. Y. X., Gagnon-Bartsch, J. A., Lo, K. K., Su, X., Han, Z.-G., Ormerod, J. T., Speed, T. P., Yang, P., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820006116 · Cited by 170
Self-citationHow many human genes can be defined as housekeeping with current expression data?
Zhu, J., He, F., Song, S., Wang, J., & Yu, J. M. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-172 · Cited by 153
Single-cell RNA-seq reveals new types of human blood dendritic cells, monocytes, and progenitors
Villani, A., Satija, R., Reynolds, G., Sarkizova, S., Shekhar, K., Fletcher, J., Griesbeck, M., Butler, A., Zheng, S., Lazo, S., et al. (2016) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 152
Toxicological Housekeeping Genes: Do They Really Keep the House?
Arukwe, A. (2006) · Environmental Science & Technology · doi:10.1021/es0615223 · Cited by 102
Sémon, M., Mouchiroud, D., & Duret, L. (2004) · Human Molecular Genetics · doi:10.1093/hmg/ddi038 · Cited by 99
Orimo, A., Tominaga, N., Yoshimura, K., Yamauchi, Y., Nomura, M., Sato, M., Nogi, Y., Suzuki, M., Suzuki, H., Ikeda, K., et al. (2000) · Genomics · doi:10.1006/geno.2000.6318 · Cited by 92
Technical Variations in Low-Input RNA-seq Methodologies
Bhargava, V., Head, S. R., Ordoukhanian, P. T., Mercola, M. A., & Subramaniam, S. (2014) · Scientific Reports · doi:10.1038/srep03678 · Cited by 86
Differential expression of HINT1 in schizophrenia brain tissue
Varadarajulu, J., Schmitt, A., Falkai, P., Alsaif, M., Turck, C. W., & Martins‐de‐Souza, D. (2011) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-011-0216-4 · Cited by 28
Integrated single cell data analysis reveals cell specific networks and novel coactivation markers
Ghazanfar, S., Bisogni, A. J., Ormerod, J. T., Lin, D. M., & Yang, J. Y. H. (2016) · BMC Systems Biology · doi:10.1186/s12918-016-0370-4 · Cited by 27
Self-citationSupporting data for "Evaluating stably expressed genes in single cells"
Lin, Y., Ghazanfar, S., Strbenac, D., et al. (2019) · GigaDB · doi:10.5524/100637
Self-citation
Cited by
Conserved cell types with divergent features in human versus mouse cortex
Hodge, R. D., Bakken, T. E., Miller, J. A., Smith, K. A., Barkan, E. R., Graybuck, L. T., Close, J. L., Long, B., Johansen, N., Penn, O., et al. (2019) · Nature · doi:10.1038/s41586-019-1506-7 · Cited by 1,775
Qi, T., Wu, Y., Zeng, J., Zhang, F., Xue, A., Jiang, L., Zhu, Z., Kemper, K., Yengo, L., Zheng, Z., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04558-1 · Cited by 427
Self-citationMolecular landscapes of human hippocampal immature neurons across lifespan
Zhou, Y., Su, Y., Li, S., Kennedy, B. C., Zhang, D. Y., Bond, A. M., Sun, Y., Jacob, F., Lu, L., Hu, P., et al. (2022) · Nature · doi:10.1038/s41586-022-04912-w · Cited by 302
Molecular design of hypothalamus development
Romanov, R. A., Tretiakov, E. O., Kastriti, M. E., Zupancic, M., Häring, M., Korchynska, S., Popadin, K., Benevento, M., Rebernik, P., Lallemend, F., et al. (2020) · Nature · doi:10.1038/s41586-020-2266-0 · Cited by 171
Lin, Y., Cao, Y., Kim, H. J., Salim, A., Speed, T. P., Lin, D. M., Yang, P., & Yang, J. Y. H. (2020) · Molecular Systems Biology · doi:10.15252/msb.20199389 · Cited by 174
Self-citation
Metadata
- Authors
- Lin, Y., Ghazanfar, S., Strbenac, D., Wang, A., Patrick, E., Lin, D. M., Speed, T., Yang, J. Y. H., & Yang, P.
- Affiliations
- The University of Sydney (AU)
- Cornell University (US)
- The University of Melbourne (AU)
- Corresponding author
- Yang, Jean Y H
- Yang, Pengyi
- ORCID
- Venue
- GigaScience
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-09-01
- Volume
- 8
- Issue
- 9
- ISSN
- 2047-217X (ISSN-L)
- PMC
- PMC6748759
- OpenAlex
- W2973694021
- Cited by
- 84
- References
- 61
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 13 · 2023: 7 · 2022: 13 · 2021: 7 · 2020: 12 · 2019: 5
- FWCI
- 3.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- GigaScience (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Funders
- Australian Research Council (DE170100759, DP170100654)
- National Health and Medical Research Council (1105271, 1054618)
- National Institutes of Health (DC015107)
- University of Sydney
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Keywords
- housekeeping genes, gene expression stability, single-cell transcriptomics, stochastic gene expression, mouse development, human development
- MeSH terms
- RNA-Seq, Animals, Humans, Gene Expression, Mice, Single-Cell Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.