Cited by 614Single-cell and spatial transcriptomicsGene expression and cancer classificationGenomics and Phylogenetic Studies

Statistics or biology: the zero-inflation controversy about scRNA-seq data

Open access
Jiang, Ruochen, Sun, Tianyi, Song, Dongyuan, Li, Jingyi Jessica·2022·Genome Biology

Published version of a preprint

Abstract

Researchers view vast zeros in single-cell RNA-seq data differently: some regard zeros as biological signals representing no or low gene expression, while others regard zeros as missing data to be corrected. To help address the controversy, here we discuss the sources of biological and non-biological zeros; introduce five mechanisms of adding non-biological zeros in computational benchmarking; evaluate the impacts of non-biological zeros on data analysis; benchmark three input data types: observed counts, imputed counts, and binarized counts; discuss the open questions regarding non-biological zeros; and advocate the importance of transparent analysis.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13059-022-02601-5

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Zero-valued entries in a gene expression matrix have both biological and technical origins.

    “Zero valued entries in a gene expression matrix have both biological and technical origins,75 and it is important to prioritize preserving relevant biological signals while reducing technical noise.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 97

  1. [3]Kiselev VY Andrews TS Hemberg M Challenges in unsupervised clustering of single-cell rna-seq data Nat Rev Genet 2019 20 5 273 82 30617341
  2. [4]Tritschler S Büttner M Fischer DS Lange M Bergen V Lickert H Theis FJ Concepts and limitations for learning developmental trajectories from single cell genomics Development 2019 146 12 dev170506 31249007
  3. [5]Macosko EZ Basu A Satija R Nemesh J Shekhar K Goldman M Tirosh I Bialas AR Kamitaki N Martersteck EM Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets Cell 2015 161 5 1202 14 26000488 PMC4481139
  4. [8]Picelli S Faridani OR Björklund ÅK Winberg G Sagasser S Sandberg R Full-length rna-seq from single cells using smart-seq2 Nat Protoc 2014 9 1 171 81 24385147
  5. [11]Zhang X, Li T, Liu F, Chen Y, Yao J, Li Z, Huang Y, Wang J. Comparative analysis of droplet-based ultra-high-throughput single-cell rna-seq systems. Mol Cell. 2019a; 73(1):130–42. 30472192
  6. [12]Wang F Liang S Kumar T Navin N Chen K Scmarker: ab initio marker selection for single cell transcriptome profiling PLoS Comput Biol 2019 15 10 e1007445 31658262 PMC6837541
  7. [14]Kiselev YV Kirschner K Schaub MT Andrews T Yiu A Chandra T Natarajan KN Reik W Barahona M Green AR Sc3: consensus clustering of single-cell rna-seq data Nat Methods 2017 14 5 483 6 28346451 PMC5410170
  8. [15]Guo M Wang H Potter SS Whitsett JA Yan X Sincera: a pipeline for single-cell rna-seq profiling analysis PLoS Comput Biol 2015 11 11 e1004575 26600239 PMC4658017
  9. [16]Ho Y-J Anaparthy N Molik D Mathew G Aicher T Patel A Hicks J Hammell MG Single-cell rna-seq analysis identifies markers of resistance to targeted braf inhibitors in melanoma cell populations Genome Res 2018 28 9 1353 63 30061114 PMC6120620
  10. [17]Zeisel A Muñoz-Manchado AB Codeluppi S Lönnerberg P La Manno G Juréus A Marques S Munguba H He L Betsholtz C Cell types in the mouse cortex and hippocampus revealed by single-cell rna-seq Science 2015 347 6226 1138 42 25700174
  11. [18]Vento-Tormo R Efremova M Botting RA Turco MY Vento-Tormo M Meyer KB Park J-E Stephenson E Polański K Goncalves A Single-cell reconstruction of the early maternal–fetal interface in humans Nature 2018 563 7731 347 53 30429548 PMC7612850
  12. [20]Lin P Troup M Ho JWK Cidr: Ultrafast and accurate clustering through imputation for single-cell rna-seq data Genome Biol 2017 18 1 59 28351406 PMC5371246
  13. [21]Sun Z Wang T Ke D Wang X-F Lafyatis R Ding Y Ming H Chen W Dimm-sc: a dirichlet mixture model for clustering droplet-based single cell transcriptomic data Bioinformatics 2018 34 1 139 46 29036318 PMC6454475
  14. [22]Yau C pcareduce: hierarchical clustering of single cell transcriptional profiles BMC Bioinformatics 2016 17 1 140 27005807 PMC4802652
  15. [23]Andrews TS Hemberg M M3drop: dropout-based feature selection for scrnaseq Bioinformatics 2019 35 16 2865 7 30590489 PMC6691329
  16. [25]Ji Zhicheng Tscan HongkaiJi. Pseudo-time reconstruction and evaluation in single-cell rna-seq analysis Nucleic Acids Res 2016 44 13 e117—e117 27179027 PMC4994863
  17. [26]Street K Risso D Fletcher RB Das D Ngai J Yosef N Purdom E Dudoit S Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics BMC Genomics 2018 19 1 477 29914354 PMC6007078
  18. [27]Qiu X Qi M Tang Y Li W Chawla R Pliner HA Trapnell C Reversed graph embedding resolves complex single-cell trajectories Nat Methods 2017 14 10 979 28825705 PMC5764547
  19. [28]Cao J Spielmann M Qiu X Huang X Ibrahim DM Hill AJ Zhang F Mundlos S Christiansen L Steemers FJ The single-cell transcriptional landscape of mammalian organogenesis Nature 2019 566 7745 496 502 30787437 PMC6434952
  20. [29]Saelens W Cannoodt R Todorov H Saeys Y A comparison of single-cell trajectory inference methods Nat Biotechnol 2019 37 5 547 54 30936559
  21. [30]Soneson C Robinson MD Bias, robustness and scalability in single-cell differential expression analysis Nat methods 2018 15 4 255 29481549
  22. [31]Robinson MD McCarthy DJ Smyth GK edger: a bioconductor package for differential expression analysis of digital gene expression data Bioinformatics 2010 26 1 139 40 19910308 PMC2796818
  23. [33]Miao Z Ke D Wang X Zhang X Desingle for detecting three types of differential expression in single-cell rna-seq data Bioinformatics 2018 34 18 3223 4 29688277
  24. [34]Suomi T Seyednasrollah F Jaakkola MK Faux T Elo LL Rots: An r package for reproducibility-optimized statistical testing PLoS Comput Biol 2017 13 5 e1005562 28542205 PMC5470739
  25. [36]Finak G McDavid A Yajima M Deng J Gersuk V Shalek AK Slichter CK Miller HW McElrath MJ Prlic M Mast: a flexible statistical framework for assessing transcriptional changes and characterizing heterogeneity in single-cell rna sequencing data Genome Biol 2015 16 1 1 13 26653891 PMC4676162
  26. [38]Kharchenko PV Silberstein L Scadden DT Bayesian approach to single-cell differential expression analysis Nat Methods 2014 11 7 740 2 24836921 PMC4112276
  27. [39]Hicks SC Townes Teng M Irizarry RA Missing data and technical variability in single-cell rna-sequencing experiments Biostatistics 2018 19 4 562 78 29121214 PMC6215955
  28. [40]Van den Berge K Perraudeau F Soneson C Love MI Risso D Vert J-P Robinson MD Dudoit S Clement L Observation weights unlock bulk rna-seq tools for zero inflation and single-cell applications Genome Biol 2018 19 1 1 17 29478411 PMC6251479
  29. [41]Deaton AM Webb S Kerr ARW Illingworth RS Guy J Andrews R Bird A Cell type–specific dna methylation at intragenic cpg islands in the immune system Genome Res 2011 21 7 1074 86 21628449 PMC3129250
  30. [42]Vieth B Ziegenhain C Parekh S Enard W Hellmann I powsimr: power analysis for bulk and single cell rna-seq experiments Bioinformatics 2017 33 21 3486 8 29036287
  31. [43]Ding J Adiconis X Simmons SK Kowalczyk MS Hession CC Marjanovic ND Systematic comparison of single-cell and single-nucleus RNA-sequencing methods Nat Biotechnol 2020 38 6 737 46 32341560 PMC7289686
  32. [44]Van Dijk D Sharma R Nainys J Yim K Kathail P Carr AJ Recovering gene interactions from single-cell data using data diffusion Cell 2018 174 3 716 29 29961576 PMC6771278
  33. [45]Li WV Li JJ An accurate and robust imputation method scimpute for single-cell rna-seq data Nat Commun 2018 9 1 1 9 29520097 PMC5843666
  34. [46]Pierson E Yau C Zifa: Dimensionality reduction for zero-inflated single-cell gene expression analysis Genome Biol 2015 16 1 1 10 26527291 PMC4630968
  35. [47]Gong W Kwak I-Y Pota P Koyano-Nakagawa N Garry DJ Drimpute: imputing dropout events in single cell rna sequencing data BMC Bioinformatics 2018 19 1 1 10 29884114 PMC5994079
  36. [48]Mo H Wang J Torre E Dueck H Shaffer S Bonasio R Murray JI Raj A Li M Zhang NR Saver: gene expression recovery for single-cell rna sequencing Nat Methods 2018 15 7 539 42 29941873 PMC6030502
  37. [49]Talwar D Mongia A Sengupta D Majumdar A Autoimpute: Autoencoder based imputation of single-cell rna-seq data Sci Rep 2018 8 1 1 11 30397240 PMC6218547
  38. [50]Ronen J Akalin A netsmooth: Network-smoothing based imputation for single cell rna-seq F1000Research 2018 7 7 29511531 PMC5814748
  39. [51]Badsha MdB Li R Liu B Li YI Xian M Banovich NE Fu AQ Imputation of single-cell gene expression with an autoencoder neural network Quant Biol 2020 8 1 78 94 32274259 PMC7144625
  40. [52]Eraslan G Simon LM Mircea M Mueller NS Theis FJ Single-cell rna-seq denoising using a deep count autoencoder Nat Commun 2019 10 1 1 14 30674886 PMC6344535
  41. [53]Mongia A Sengupta D Majumdar A Mcimpute: Matrix completion based imputation for single cell rna-seq data Front Genet 2019 10 9 30761179 PMC6361810
  42. [54]Chen C Changjing W Linjie W Wang X Deng M scrmd RX Imputation for single cell rna-seq data via robust matrix decomposition Bioinformatics 2020 36 10 3156 61 32119079
  43. [55]Yang MQ Weissman SM Yang W Zhang J Canaann A Guan R Misc: missing imputation for single-cell rna sequencing data BMC Syst Biol 2018 12 7 114 30547798 PMC6293493
  44. [56]Tang W Bertaux F Thomas P Stefanelli C Saint M Marguerat S Shahrezaei V baynorm: Bayesian gene expression recovery, imputation and normalization for single-cell rna-sequencing data Bioinformatics 2020 36 4 1174 81 31584606 PMC7703772
  45. [57]Elyanow R Dumitrascu B Engelhardt BE Raphael BJ netnmf-sc: leveraging gene–gene interactions for imputation and dimensionality reduction in single-cell expression analysis Genome Res 2020 30 2 195 204 31992614 PMC7050525
  46. [58]Moussa M Măndoiu II Locality sensitive imputation for single cell rna-seq data J Comput Biol 2019 26 8 822 35 30785309 PMC6703247
  47. [59]Peng T Zhu Q Yin P Tan K Scrabble: single-cell rna-seq imputation constrained by bulk rna-seq data Genome Biol 2019 20 1 88 31060596 PMC6501316
  48. [60]Xu Y Zhang Z You L Liu J Fan Z Zhou X scigans: single-cell rna-seq imputation using generative adversarial networks Nucleic Acids Res 2020 48 15 e85—e85 32588900 PMC7470961
  49. [62]Arisdakessian C Poirion O Yunits B Zhu X Garmire LX Deepimpute: an accurate, fast, and scalable deep neural network method to impute single-cell rna-seq data Genome Biol 2019 20 1 1 14 31627739 PMC6798445
  50. [63]Chen M Zhou X Viper: variability-preserving imputation for accurate gene expression recovery in single-cell rna sequencing studies Genome Biol 2018 19 1 1 15 30419955 PMC6233584
  51. [64]Svensson V Droplet scrna-seq is not zero-inflated Nat Biotechnol 2020 38 2 147 50 31937974
  52. [65]Kim TH Zhou X Chen M Demystifying “drop-outs” in single-cell umi data Genome Biol 2020 21 1 1 19 PMC7412673 32762710
  53. [66]Qiu P Embracing the dropouts in single-cell rna-seq analysis Nat Commun 2020 11 1 1 9 32127540 PMC7054558
  54. [67]Silverman JD Roche K Mukherjee S David LA Naught all zeros in sequence count data are the same Comput Struct Biotechnol J 2020 18 2789 33101615 PMC7568192
  55. [68]Zappia L Phipson B Oshlack A Splatter: simulation of single-cell rna sequencing data Genome Biol 2017 18 1 1 15 28899397 PMC5596896
  56. [71]Sanchez A Golding I Genetic determinants and cellular constraints in noisy gene expression Science 2013 342 6163 1188 93 24311680 PMC4045091
  57. [72]Suter DM Molina N Gatfield D Schneider K Schibler U Naef F Mammalian genes are transcribed with widely different bursting kinetics Science 2011 332 6028 472 4 21415320
  58. [73]Spitz F Furlong EEM Transcription factors: from enhancer binding to developmental control Nat Rev Genet 2012 13 9 613 26 22868264
  59. [74]Inukai S Kock KH Bulyk ML Transcription factor–dna binding: beyond binding site motifs Curr Opin Genet Dev 2017 43 110 9 28359978 PMC5447501
  60. [76]Paszek P Modeling stochasticity in gene regulation: characterization in the terms of the underlying distribution function Bull Math Biol 2007 69 5 1567 601 17361363
  61. [78]Kim JK Marioni JC Inferring the kinetics of stochastic gene expression from single-cell rna-sequencing data Genome Biol 2013 14 1 1 12 PMC3663116 23360624
  62. [79]Schwaber J Andersen S Nielsen L Shedding light: the importance of reverse transcription efficiency standards in data interpretation Biomol Detect Quantif 2019 17 100077 30805297 PMC6374950
  63. [80]Bustin S Dhillon HS Kirvell S Greenwood C Parker M Shipley GL Nolan T Variability of the reverse transcription step: practical implications Clin Chem 2015 61 1 202 12 25361949
  64. [81]Kaul A Mandal S Davidov O Peddada SD Analysis of microbiome data in the presence of excess zeros Front Microbiol 2017 8 2114 29163406 PMC5682008
  65. [82]Saiki RK Gelfand DH Stoffel S Scharf SJ Higuchi R Horn GT Mullis KB Erlich HA Primer-directed enzymatic amplification of dna with a thermostable dna polymerase Science 1988 239 4839 487 91 2448875
  66. [83]Eberwine J Yeh H Miyashiro K Cao Y Nair S Finnell R Zettel M Coleman P Analysis of gene expression in single live neurons Proc Natl Acad Sci 1992 89 7 3010 4 1557406 PMC48793
  67. [84]Tang F Lao K Surani MA Development and applications of single-cell transcriptome analysis Nat Methods 2011 8 4 S6—S11 21451510 PMC3408593
  68. [85]Fu Y Wu P-H Beane T Zamore PD Weng Z Elimination of pcr duplicates in rna-seq and small rna-seq using unique molecular identifiers BMC Genom 2018 19 1 531 PMC6044086 30001700
  69. [87]Shiroguchi K Jia TZ Sims PA Xie XS Digital rna sequencing minimizes sequence-dependent bias and amplification noise with optimized single-molecule barcodes Proc Natl Acad Sci 2012 109 4 1347 52 22232676 PMC3268301
  70. [88]Cha RS Thilly WG Specificity, efficiency, and fidelity of pcr PCR Methods Appl 1993 3 3 18 29 8118393
  71. [89]Dohm JC Lottaz C Borodina T Himmelbauer H Substantial biases in ultra-short read data sets from high-throughput dna sequencing Nucleic Acids Res 2008 36 16 e105 18660515 PMC2532726
  72. [90]Smith T Heger A Sudbery I Umi-tools: modeling sequencing errors in unique molecular identifiers to improve quantification accuracy Genome Res 2017 27 3 491 9 28100584 PMC5340976
  73. [91]Aird D Ross MG Chen W-S Danielsson M Fennell T Russ C Jaffe DB Nusbaum C Gnirke A Analyzing and minimizing pcr amplification bias in illumina sequencing libraries Genome Biol 2011 12 2 1 14 PMC3188800 21338519
  74. [92]Dueck HR Ai R Camarena A Ding B Dominguez R Evgrafov OV Fan J-B Fisher SA Herstein JS Kim TK Assessing characteristics of rna amplification methods for single cell rna sequencing BMC Genom 2016 17 1 1 22 PMC5122016 27881084
  75. [94]Sarkar A Stephens M Separating measurement and expression models clarifies confusion in single-cell RNA sequencing analysis Nat Genet 2021 53 6 770 7 34031584 PMC8370014
  76. [95]Zhu L Lei J Devlin B Roeder K A unified statistical framework for single cell and bulk rna sequencing data Ann Appl Stat 2018 12 1 609 30174778 PMC6114100
  77. [96]Zand M Ruan J Network-based single-cell rna-seq data imputation enhances cell type identification Genes 2020 11 4 377 PMC7230610 32244427
  78. [97]Di R Zhang S Lytal N An L scdoc: correcting drop-out events in single-cell rna-seq data Bioinformatics 2020 36 15 4233 9 32365169
  79. [98]Lähnemann D Köster J Szczurek E McCarthy DJ Hicks SC Robinson MD Vallejos CA Campbell KR Beerenwinkel N Mahfouz A Eleven grand challenges in single-cell data science Genome Biol 2020 21 1 1 35 PMC7007675 32033589
  80. [100]Risso D Perraudeau F Gribkova S Dudoit S Vert J-P A general and flexible method for signal extraction from single-cell rna-seq data Nature Commun 2018 9 1 1 17 29348443 PMC5773593
  81. [102]Sun T Song D Li WV Li JJ scdesign2: a transparent simulator that generates high-fidelity single-cell gene expression count data with gene correlations captured Genome Biol 2021 22 1 1 37 34034771 PMC8147071
  82. [103]Zhang X, Chenling X, Yosef N. Simulating multiple faceted variability in single cell rna sequencing. Nat Commun. 2019b; 10(1):1–16. PMC6565723 31197158
  83. [104]Dibaeinia P Sinha S Sergio: a single-cell expression simulator guided by gene regulatory networks Cell Syst 2020 11 3 252 71 32871105 PMC7530147
  84. [105]Ge X Chen YE Song D McDermott M Woyshner K Manousopoulou A Wang N Li W Wang LD Li JJ Clipper: p-value-free FDR control on high-throughput data from two conditions Genome Biol 2021 22 1 1 29 34635147 PMC8504070
  85. [106]Amodio M Van Dijk D Srinivasan K Chen WS Mohsen H Moon KR Campbell A Zhao Y Wang X Venkataswamy M Exploring single-cell data with deep multitasking neural networks Nat Methods 2019 16 11 1139 45 31591579 PMC10164410
  86. [107]Warton DI Why you cannot transform your way out of trouble for small counts Biometrics 2018 74 1 362 8 28504821
  87. [109]Law CW Chen Y Shi W Smyth GK voom: Precision weights unlock linear model analysis tools for rna-seq read counts Genome Biol 2014 15 2 R29 24485249 PMC4053721
  88. [110]Zhang L Zhang S Comparison of computational methods for imputing single-cell rna-sequencing data IEEE/ACM Trans Comput Biol Bioinforma 2018 17 2 376 89 29994128
  89. [111]He Y Yuan H Cheng W Xie Z Disc: a highly scalable and accurate inference of gene expression and structure for single-cell transcriptomes using semi-supervised deep learning Genome Biol 2020 21 1 1 28 PMC7353747 32650816
  90. [112]Li Y, Ge X, Peng F, Li W, Li JJ. A large-sample crisis? exaggerated false positives by popular differential expression methods. bioRxiv. 2021. 10.1101/2021.08.25.457733. · DOI
  91. [113]Li R Quon G scbfa: modeling detection patterns to mitigate technical noise in large-scale single-cell genomics data Genome Biol 2019 20 1 193 31500668 PMC6734238
  92. [115]Chen H Guo J Mishra SK Robson P Niranjan M Zheng J Single-cell transcriptional analysis to uncover regulatory circuits driving cell fate decisions in early mouse development Bioinformatics 2015 31 7 1060 6 25416748
  93. [116]Lim CY Wang H Woodhouse S Piterman N Wernisch L Fisher J Göttgens B Btr: training asynchronous boolean models using single-cell expression data BMC Bioinformatics 2016 17 1 1 18 27600248 PMC5012073
  94. [117]Agrawal A Chiu AM Le M Halperin E Sankararaman S Scalable probabilistic pca for large-scale genetic variation data PLoS Genetics 2020 16 5 e1008773 32469896 PMC7286535
  95. [118]Hou W Ji Z Ji H Hicks SC A systematic evaluation of single-cell rna-sequencing imputation methods bioRxiv 2020 21 1 1 30 PMC7450705 32854757
  96. [121]Andrews TS Kiselev VY McCarthy D Hemberg M Tutorial: guidelines for the computational analysis of single-cell rna sequencing data Nat Protoc 2021 16 1 1 9 33288955
  97. [122]Jiang R, Sun T, Song D, Li JJ. Statistics or biology: the zero-inflation controversy about scRNA-seq data. 2022. 10.5281/zenodo.4393040. PMC8783472 35063006 · DOI

Cited by

Sorted by citations

Authors
Jiang, R., Sun, T., Song, D., & Li, J. J.
Affiliations
University of California, Los Angeles (US)
Corresponding author
Li, Jingyi Jessica
Venue
Genome Biology
Published
2022-01-21
Volume
23
Issue
1
Pages
31-31
ISSN
  • 1465-6906 (ISSN-L)
  • 1474-760X
OpenAlex
W4225981439
Cited by
614
References
23
Citations by year
2026: 92 · 2025: 143 · 2024: 158 · 2023: 150 · 2022: 66 · 2021: 3 · 2020: 1 · 2019: 1
FWCI
13.72
Type
journal article
Language
en
Open access
Locations
  • Genome biology (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
Funders
  • National Institute of General Medical Sciences (R01GM120507, R35GM140888)
  • Directorate for Biological Sciences (1846216)
  • Directorate for Mathematical and Physical Sciences (2113754)
  • Johnson and Johnson (WiSTEM2D Award)
  • Alfred P. Sloan Foundation (Sloan Research Fellowship)
  • W. M. Keck Foundation (UCLA David Geffen School of Medicine W.M. Keck Foundation Junior Faculty Award)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
Keywords
excess zeros, single-cell RNA sequencing, benchmarking
MeSH terms
Exome Sequencing, Biology, Sequence Analysis, RNA, Benchmarking, Single-Cell Analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review