Cited by 119Genetic Associations and EpidemiologyGenetic and phenotypic traits in livestockForensic and Genetic Research

Population-specific causal disease effect sizes in functionally important regions impacted by selection

Open access
Shi, Huwenbo, Gazal, Steven, Kanai, Masahiro, Koch, Evan M., Schoech, Armin P., Siewert, Katherine M., Kim, Samuel S., Luo, Yang +6 more·2021·Nature Communications

Published version of a preprint

Abstract

Many diseases exhibit population-specific causal effect sizes with trans-ethnic genetic correlations significantly less than 1, limiting trans-ethnic polygenic risk prediction. We develop a new method, S-LDXR, for stratifying squared trans-ethnic genetic correlation across genomic annotations, and apply S-LDXR to genome-wide summary statistics for 31 diseases and complex traits in East Asians (average N = 90K) and Europeans (average N = 267K) with an average trans-ethnic genetic correlation of 0.85. We determine that squared trans-ethnic genetic correlation is 0.82× (s.e. 0.01) depleted in the top quintile of background selection statistic, implying more population-specific causal effect sizes. Accordingly, causal effect sizes are more population-specific in functionally important regions, including conserved and regulatory regions. In regions surrounding specifically expressed genes, causal effect sizes are most population-specific for skin and immune genes, and least population-specific for brain genes. Our results could potentially be explained by stronger gene-environment interaction at loci impacted by selection, particularly positive selection.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-021-21286-1

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The cross-ancestral genetic correlation between EAS and EUR populations for EduYears was 0.873 (s.e. 0.042) using S-LDXR.

    “The genetic correlation across the EAS and EUR populations was 0.873 (s.e. 0.042).”

    From Shared genetic architectures of educational attainment in East Asian and European populations (2024) · cites this paper as [31]

    The Results section, “Analysis of baseline-LD-X model annotations across 31 diseases and complex traits” (page unavailable), says the authors used S-LDXR to estimate East Asian–European genetic correlations for 31 traits. Our copy gives the average correlation and some trait-specific estimates, but it does not give 0.873 (s.e. 0.042) for EduYears; searches for EduYears, educational attainment, and the stated numbers found no matching passage. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • The cross-population rg for EduYears closely aligns with the median of EAS-EUR cross-population rg across 31 other traits (median rg = 0.88; range 0.342-1.05).

    “Remarkably, the cross-population rg for EduYears closely aligns with the median of EAS–EUR cross-population rg across the 31 traits (median rg = 0.88; range 0.342–1.05).”

    From Shared genetic architectures of educational attainment in East Asian and European populations (2024) · cites this paper as [31]

    The Results section (‘Analysis of baseline-LD-X model annotations across 31 diseases and complex traits’; page unavailable) reports EAS–EUR genetic correlations for 31 traits, with an average of 0.85 and a lowest estimate of 0.34. Our copy does not report a median of 0.88, an upper endpoint of 1.05, or an EduYears correlation; the Methods trait list does not include EduYears. It therefore does not establish the claimed close alignment. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 112 · Cited by 119

Research works printed but not linked: 85

  1. [1]de Candia TR Additive genetic variation in schizophrenia risk is shared by populations of african and european descent Am. J. Hum. Genet. 2013 93 463 470 10.1016/j.ajhg.2013.07.007 23954163 PMC3845872 · DOI
  2. [2]Brown BC Transethnic genetic-correlation estimates from summary statistics Am. J. Hum. Genet. 2016 99 76 88 10.1016/j.ajhg.2016.05.001 27321947 PMC5005434 · DOI · Paper page
  3. [3]Mancuso N The contribution of rare variation to prostate cancer heritability Nat. Genet. 2016 48 30 10.1038/ng.3446 26569126 PMC7534691 · DOI
  4. [4]Ikeda M Genome-wide association study detected novel susceptibility genes for schizophrenia and shared trans-populations/diseases genetic effect Schizophr. Bull. 2018 45 824 834 10.1093/schbul/sby140 30285260 PMC6581133 · DOI
  5. [5]Galinsky KJ Estimating cross-population genetic correlations of causal effect sizes Genet. Epidemiol. 2019 43 180 188 10.1002/gepi.22173 30474154 PMC6375794 · DOI · Paper page
  6. [7]Carlson CS Generalization and dilution of association results from European GWAS in populations of non-European ancestry: the page study PLoS Biol. 2013 11 e1001661 10.1371/journal.pbio.1001661 24068893 PMC3775722 · DOI
  7. [9]Márquez-Luna C Loh P-R Consortium SATDS Consortium STD Price AL Multiethnic polygenic risk scores improve risk prediction in diverse populations Genet. Epidemiol. 2017 41 811 823 10.1002/gepi.22083 29110330 PMC5726434 · DOI
  8. [10]Wojcik, G. L. et al. Genetic analyses of diverse populations improves discovery for complex traits. Nature570, 514–518 (2019). PMC6785182 31217584
  9. [12]Keys, K. L. et al. On the cross-population portability of gene expression prediction models. bioRxiv10.1101/552042 (2019).
  10. [13]Lee SH Yang J Goddard ME Visscher PM Wray NR Estimation of pleiotropy between complex diseases using single-nucleotide polymorphism-derived genomic relationships and restricted maximum likelihood Bioinformatics 2012 28 2540 2542 10.1093/bioinformatics/bts474 22843982 PMC3463125 · DOI · Paper page
  11. [14]Sirugo G Williams SM Tishkoff SA The missing diversity in human genetic studies Cell 2019 177 26 31 10.1016/j.cell.2019.02.048 30901543 PMC7380073 · DOI · Paper page
  12. [15]Gurdasani, D., Barroso, I., Zeggini, E. & Sandhu, M. S. Genomics of disease risk in globally diverse populations. Nat. Rev. Genet.20, 520–535 (2019). 31235872
  13. [16]Consortium GP A global reference for human genetic variation Nature 2015 526 68 10.1038/nature15393 26432245 PMC4750478 · DOI · Paper page
  14. [18]Cai N Sparse whole-genome sequencing identifies two loci for major depressive disorder Nature 2015 523 588 10.1038/nature14659 26176920 PMC4522619 · DOI · Paper page
  15. [19]Nagai A Overview of the biobank japan project: study design and profile J. Epidemiol. 2017 27 S2 S8 10.1016/j.je.2016.12.005 28189464 PMC5350590 · DOI · Paper page
  16. [20]Kanai M Genetic analysis of quantitative traits in the Japanese population links cell types to complex human diseases Nat. Genet. 2018 50 390 10.1038/s41588-018-0047-6 29403010 · DOI · Paper page
  17. [21]Finucane HK Partitioning heritability by functional annotation using genome-wide association summary statistics Nat. Genet. 2015 47 1228 10.1038/ng.3404 26414678 PMC4626285 · DOI · Paper page
  18. [22]Gazal S Linkage disequilibrium-dependent architecture of human complex traits shows action of negative selection Nat. Genet. 2017 49 1421 10.1038/ng.3954 28892061 PMC6133304 · DOI · Paper page
  19. [23]Gazal S Marquez-Luna C Finucane HK Price AL Reconciling s-LDSC and LDAK functional enrichment estimates Nat. Genet. 2019 51 1202 1204 10.1038/s41588-019-0464-1 31285579 PMC7006477 · DOI
  20. [24]Finucane HK Heritability enrichment of specifically expressed genes identifies disease-relevant tissues and cell types Nat. Genet. 2018 50 621 10.1038/s41588-018-0081-4 29632380 PMC5896795 · DOI · Paper page
  21. [25]Su Z Marchini J Donnelly P Hapgen2: simulation of multiple disease SNPs Bioinformatics 2011 27 2304 2305 10.1093/bioinformatics/btr341 21653516 PMC3150040 · DOI
  22. [27]Gazal S Functional architecture of low-frequency variants highlights strength of negative selection across coding and non-coding annotations Nat. Genet. 2018 50 1600 10.1038/s41588-018-0231-8 30297966 PMC6236676 · DOI · Paper page
  23. [28]Schoech AP Quantification of frequency-dependent genetic architectures in 25 UK biobank traits reveals action of negative selection Nat. Commun. 2019 10 790 10.1038/s41467-019-08424-6 30770844 PMC6377669 · DOI · Paper page
  24. [29]Cai, N., Kendler, K. & Flint, J. Minimal phenotyping yields GWAS hits of low specificity for major depression. BioRxiv10.1101/440735 (2018).
  25. [31]Kichaev G Pasaniuc B Leveraging functional-annotation data in trans-ethnic fine-mapping studies Am. J. Hum. Genet. 2015 97 260 271 10.1016/j.ajhg.2015.06.007 26189819 PMC4573268 · DOI
  26. [32]Consortium G Genetic effects on gene expression across human tissues Nature 2017 550 204 10.1038/nature24277 29022597 PMC5776756 · DOI · Paper page
  27. [34]Sabeti PC Positive natural selection in the human lineage Science 2006 312 1614 1620 10.1126/science.1124309 16778047 · DOI · Paper page
  28. [35]Nielsen R Hellmann I Hubisz M Bustamante C Clark AG Recent and ongoing selection in the human genome Nat. Rev. Genet. 2007 8 857 10.1038/nrg2187 17943193 PMC2933187 · DOI
  29. [36]Novembre J Di Rienzo A Spatial patterns of variation due to natural selection in humans Nat. Rev. Genet. 2009 10 745 10.1038/nrg2632 19823195 PMC3989104 · DOI · Paper page
  30. [37]Laland KN Odling-Smee J Myles S How culture shaped the human genome: bringing genetics and the human sciences together Nat. Rev. Genet. 2010 11 137 10.1038/nrg2734 20084086 · DOI
  31. [38]Wilde S Direct evidence for positive selection of skin, hair, and eye pigmentation in Europeans during the last 5,000 y Proc. Natl Acad. Sci. 2014 111 4832 4837 10.1073/pnas.1316513111 24616518 PMC3977302 · DOI · Paper page
  32. [39]von Boehmer H Positive selection of lymphocytes Cell 1994 76 219 228 10.1016/0092-8674(94)90330-1 8293460 · DOI
  33. [40]Li J Natural selection has differentiated the progesterone receptor among human populations Am. J. Human Genet. 2018 103 45 57 10.1016/j.ajhg.2018.05.009 29937092 PMC6035283 · DOI
  34. [42]Veeramah KR Hammer MF The impact of whole-genome sequencing on the reconstruction of human population history Nat. Rev. Genet. 2014 15 149 10.1038/nrg3625 24492235 · DOI
  35. [43]Voight, B. F., Kudaravalli, S., Wen, X. & Pritchard, J. K. A map of recent positive selection in the human genome. PLoS Biol.4, e72 (2006). PMC1382018 16494531
  36. [44]Johnson KE Voight BF Patterns of shared signatures of recent positive selection across human populations Nat. Ecol. Evol. 2018 2 713 720 10.1038/s41559-018-0478-6 29459708 PMC5866773 · DOI
  37. [45]van Dongen J Boomsma DI The evolutionary paradox and the missing heritability of schizophrenia Am. J. Med. Genet. B: Neuropsychiatric Genet. 2013 162 122 136 10.1002/ajmg.b.32135 23355297 · DOI
  38. [46]Pardiñas AF Common schizophrenia alleles are enriched in mutation-intolerant genes and in regions under strong background selection Nat. Genet. 2018 50 381 389 10.1038/s41588-018-0059-2 29483656 PMC5918692 · DOI · Paper page
  39. [47]Vicennati V Pasquali R Abnormalities of the hypothalamic-pituitary-adrenal axis in nondepressed women with abdominal obesity and relations with insulin resistance: evidence for a central and a peripheral alteration J. Clin. Endocrinol. Metab. 2000 85 4093 4098 10.1210/jcem.85.11.6946 11095438 · DOI
  40. [48]Vgontzas A Hypothalamic-pituitary-adrenal axis activity in obese men with and without sleep apnea: effects of continuous positive airway pressure therapy J. Clin. Endocrinol. Metab. 2007 92 4199 4207 10.1210/jc.2007-0774 17785363 · DOI
  41. [49]Bose M Oliván B Laferrère B Stress and obesity: the role of the hypothalamic–pituitary–adrenal axis in metabolic disease Curr. Opin. Endocrinol. Diabetes Obes. 2009 16 340 10.1097/MED.0b013e32832fa137 19584720 PMC2858344 · DOI
  42. [50]Itoh N Ornitz DM Fibroblast growth factors: from molecular evolution to roles in development, metabolism and disease J. Biochem. 2011 149 121 130 10.1093/jb/mvq121 20940169 PMC3106964 · DOI
  43. [51]Robinson MR Genotype–covariate interaction effects and the heritability of adult body mass index Nat. Genet. 2017 49 1174 10.1038/ng.3912 28692066 · DOI
  44. [52]Hill WG Goddard ME Visscher PM Data and theory point to mainly additive genetic variance for complex traits PLoS Genet. 2008 4 e1000008 10.1371/journal.pgen.1000008 18454194 PMC2265475 · DOI · Paper page
  45. [53]Mäki-Tanila A Hill WG Influence of gene interaction on complex trait variation with multilocus models Genetics 2014 198 355 367 10.1534/genetics.114.165282 24990992 PMC4174947 · DOI
  46. [55]de Jong M Natural variation in arabidopsis shoot branching plasticity in response to nitrate supply affects fitness PLoS Genet. 2019 15 e1008366 10.1371/journal.pgen.1008366 31539368 PMC6774567 · DOI
  47. [56]Lek M Analysis of protein-coding genetic variation in 60,706 humans Nature 2016 536 285 10.1038/nature19057 27535533 PMC5018207 · DOI · Paper page
  48. [57]Eyre-Walker, A. Genetic architecture of a complex trait and its implications for fitness and genome-wide association studies. Proc. Natl Acad. Sci. USA107, 1752–1756 (2010). PMC2868283 20133822
  49. [59]Stahl EA Bayesian inference analyses of the polygenic architecture of rheumatoid arthritis Nat. Genet. 2012 44 483 10.1038/ng.2232 22446960 PMC6560362 · DOI · Paper page
  50. [60]Loh P-R Efficient bayesian mixed-model analysis increases association power in large cohorts Nature genetics 2015 47 284 10.1038/ng.3190 25642633 PMC4342297 · DOI · Paper page
  51. [61]Vilhjálmsson BJ Modeling linkage disequilibrium increases accuracy of polygenic risk scores Am. J. Hum. Genet. 2015 97 576 592 10.1016/j.ajhg.2015.09.001 26430803 PMC4596916 · DOI · Paper page
  52. [62]Hu Y Leveraging functional annotations in genetic risk prediction for human complex diseases PLoS Comput. Biol. 2017 13 e1005589 10.1371/journal.pcbi.1005589 28594818 PMC5481142 · DOI
  53. [65]Lloyd-Jones LR Improved polygenic prediction by bayesian multiple regression on summary statistics Nat. Commun. 2019 10 1 11 10.1038/s41467-019-12653-0 31704910 PMC6841727 · DOI · Paper page
  54. [66]Márquez-Luna, C. et al. LDpred-funct: incorporating functional priors improves polygenic prediction accuracy in UK biobank and 23andme data sets. bioRxiv10.1101/375337 (2020). PMC8523709 34663819
  55. [67]Schaid DJ Chen W Larson NB From genome-wide associations to candidate causal variants by statistical fine-mapping Nat. Rev. Genet. 2018 19 491 504 10.1038/s41576-018-0016-z 29844615 PMC6050137 · DOI
  56. [68]Shi, H. et al. Localizing components of shared transethnic genetic architecture of complex traits from gwas summary data. Am. J. Hum. Genet. 106, 805–817 (2020). PMC7273527 32442408
  57. [69]Morris AP Transethnic meta-analysis of genomewide association studies Genet. Epidemiol. 2011 35 809 822 10.1002/gepi.20630 22125221 PMC3460225 · DOI
  58. [71]Bulik-Sullivan B An atlas of genetic correlations across human diseases and traits Nat. Genet. 2015 47 1236 10.1038/ng.3406 26414676 PMC4797329 · DOI · Paper page
  59. [72]Lu Q A powerful approach to estimating annotation-stratified genetic covariance via gwas summary statistics Am. J. Hum. Genet. 2017 101 939 964 10.1016/j.ajhg.2017.11.001 29220677 PMC5812911 · DOI
  60. [73]Seldin MF Pasaniuc B Price AL New approaches to disease mapping in admixed populations Nat. Rev. Genet. 2011 12 523 10.1038/nrg3002 21709689 PMC3142784 · DOI
  61. [74]Bycroft C The UK Biobank resource with deep phenotyping and genomic data Nature 2018 562 203 10.1038/s41586-018-0579-z 30305743 PMC6786975 · DOI · Paper page
  62. [76]Luo, Y. et al. Estimating heritability and its enrichment in tissue-specific gene sets in admixed populations. bioRxiv10.1101/503144 (2019). PMC8330913 33987664
  63. [77]Martin AR Transcriptome sequencing from diverse human populations reveals differentiated regulatory architecture PLoS Genet. 2014 10 e1004549 10.1371/journal.pgen.1004549 25121757 PMC4133153 · DOI
  64. [78]Mogil LS Genetic architecture of gene expression traits across diverse populations PLoS Genet. 2018 14 e1007586 10.1371/journal.pgen.1007586 30096133 PMC6105030 · DOI
  65. [79]Durvasula, A. & Lohmueller, K. E. Negative selection on complex traits limits genetic risk prediction accuracy between populations. bioRxiv10.1101/721936 (2019). PMC8059340 33691092
  66. [80]Curtiss J On the distribution of the quotient of two chance variables Annal. Math. Statistics 1941 12 409 421 10.1214/aoms/1177731679 · DOI
  67. [81]Consortium EP An integrated encyclopedia of DNA elements in the human genome Nature 2012 489 57 10.1038/nature11247 22955616 PMC3439153 · DOI · Paper page
  68. [85]Myers S Bottolo L Freeman C McVean G Donnelly P A fine-scale map of recombination rates and hotspots across the human genome Science 2005 310 321 324 10.1126/science.1117196 16224025 · DOI · Paper page
  69. [87]Chang CC Second-generation plink: rising to the challenge of larger and richer datasets Gigascience 2015 4 7 10.1186/s13742-015-0047-8 25722852 PMC4342193 · DOI · Paper page
  70. [88]Weir BS Cockerham CC Estimating f-statistics for the analysis of population structure Evolution 1984 38 1358 1370 28563791
  71. [89]McCarthy S A reference panel of 64,976 haplotypes for genotype imputation Nat. Genet. 2016 48 1279 1283 10.1038/ng.3643 27548312 PMC5388176 · DOI · Paper page
  72. [90]consortium U The uk10k project identifies rare variants in health and disease Nature 2015 526 82 90 10.1038/nature14962 26367797 PMC4773891 · DOI · Paper page
  73. [91]Low S-K Identification of six new genetic loci associated with atrial fibrillation in the Japanese population Nat. Genet. 2017 49 953 10.1038/ng.3842 28416822 · DOI
  74. [92]Nielsen JB Biobank-driven genomic discovery yields new insight into atrial fibrillation biology Nature Genet. 2018 50 1234 10.1038/s41588-018-0171-3 30061737 PMC6530775 · DOI · Paper page
  75. [93]Horikoshi M Elucidating the genetic architecture of reproductive ageing in the japanese population Nat. Commun. 2018 9 1977 10.1038/s41467-018-04398-z 29773799 PMC5958096 · DOI
  76. [94]Day FR Large-scale genomic analyses link reproductive aging to hypothalamic signaling, breast cancer susceptibility and brca1-mediated DNA repair Nat. Genet. 2015 47 1294 10.1038/ng.3412 26414677 PMC4661791 · DOI · Paper page
  77. [95]Astle WJ The allelic landscape of human blood cell trait variation and links to common complex disease Cell 2016 167 1415 1429 10.1016/j.cell.2016.10.042 27863252 PMC5300907 · DOI · Paper page
  78. [96]Loh P-R Kichaev G Gazal S Schoech AP Price AL Mixed-model association for biobank-scale datasets Nat. Genet. 2018 50 906 10.1038/s41588-018-0144-6 29892013 PMC6309610 · DOI · Paper page
  79. [97]Pattaro C Genetic associations at 53 loci highlight cell types and biological pathways relevant for kidney function Nat. Commun. 2016 7 10023 10.1038/ncomms10023 26831199 PMC4735748 · DOI
  80. [98]Akiyama M Characterizing rare and low-frequency height-associated variants in the Japanese population Nat. Commun. 2019 10 1 11 10.1038/s41467-019-12276-5 31562340 PMC6764965 · DOI
  81. [99]Wray NR Genome-wide association analyses identify 44 risk variants and refine the genetic architecture of major depression Nat. Genet. 2018 50 668 10.1038/s41588-018-0090-3 29700475 PMC5934326 · DOI · Paper page
  82. [100]Okada Y Genetics of rheumatoid arthritis contributes to biology and drug discovery Nature 2014 506 376 10.1038/nature12873 24390342 PMC3944098 · DOI · Paper page
  83. [102]Suzuki K Identification of 28 new susceptibility loci for type 2 diabetes in the Japanese population Nat. Genet. 2019 51 379 10.1038/s41588-018-0332-4 30718926 · DOI
  84. [103]Scott RA An expanded genome-wide association study of type 2 diabetes in Europeans Diabetes 2017 66 2888 2902 10.2337/db16-1253 28566273 PMC5652602 · DOI
  85. [104]Karolchik D Hinrichs AS Kent WJ The UCSC genome browser Curr. Protocols Bioinformatics 2012 40 1 4 10.1002/0471250953.bi0104s40 23255150 · DOI

Authors
Shi, H., Gazal, S., Kanai, M., Koch, E. M., Schoech, A. P., Siewert, K. M., Kim, S. S., Luo, Y., Amariuta, T., Huang, H., Okada, Y., Raychaudhuri, S., Sunyaev, S. R., & Price, A. L.
Affiliations
  • Broad Institute (US)
  • Brigham and Women's Hospital (US)
  • Immunology Frontier Research Center, The University of Osaka (JP)
Corresponding author
  • Shi, Huwenbo
  • Price, Alkes L.
Venue
Nature Communications
Published
2021-02-17
Volume
12
Issue
1
Pages
1098-1098
ISSN
2041-1723 (ISSN-L)
OpenAlex
W3129840172
Cited by
119
References
112
Citations by year
2026: 18 · 2025: 13 · 2024: 24 · 2023: 24 · 2022: 27 · 2021: 12 · 2020: 1
FWCI
12.29
Type
journal article
Language
en
Open access
Locations
  • Nature Communications (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • U.S. Department of Health & Human Services | NIH | National Institute of General Medical Sciences (R01 HG006399)
  • U.S. Department of Health & Human Services | NIH | Center for Information Technology (U01 HG009379, R01 MH107649, R01 MH101244)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Forensic and Genetic Research
Keywords
background selection, polygenic risk prediction, East Asians, Europeans, regulatory elements, conserved domains, gene-environment interaction, positive selection, complex traits
MeSH terms
Algorithms, Genetics, Population, Haplotypes, Humans, Models, Genetic, Selection, Genetic, Linkage Disequilibrium, Polymorphism, Single Nucleotide, Genomics, White People, Asian People, Genome-Wide Association Study

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review