MAGMA: Generalized Gene-Set Analysis of GWAS Data
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
By aggregating data for complex traits in a biologically meaningful way, gene and gene-set analysis constitute a valuable addition to single-marker analysis. However, although various methods for gene and gene-set analysis currently exist, they generally suffer from a number of issues. Statistical power for most methods is strongly affected by linkage disequilibrium between markers, multi-marker associations are often hard to detect, and the reliance on permutation to compute p-values tends to make the analysis computationally very expensive. To address these issues we have developed MAGMA, a novel tool for gene and gene-set analysis. The gene analysis is based on a multiple regression model, to provide better statistical performance. The gene-set analysis is built as a separate layer around the gene analysis for additional flexibility. This gene-set analysis also uses a regression structure to allow generalization to analysis of continuous properties of genes and simultaneous analysis of multiple gene sets and other gene properties. Simulations and an analysis of Crohn's Disease data are used to evaluate the performance of MAGMA and to compare it to a number of other gene and gene-set analysis tools. The results show that MAGMA has significantly more power than other tools for both the gene and the gene-set analysis, identifying more genes and gene sets associated with Crohn's Disease while maintaining a correct type 1 error rate. Moreover, the MAGMA analysis of the Crohn's Disease data was found to be considerably faster as well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This technique identified a total of 269 putative genes that were associated (P < 2.80 × 10-6) with depression, Supplementary Table 9.”
From Genome-wide meta-analysis of depression identifies 102 independent variants and highlights the importance of the prefrontal brain regions (2019) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It aggregates SNP associations to gene-level associations while correcting for confounding factors such as gene length, minor allele frequency, and gene density2.”
From A computational tool (H-MAGMA) for improved prediction of brain-disorder risk genes by incorporating brain chromatin interaction profiles (2020) · cites this paper as [2]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Gene set enrichment analyses were performed in MAGMA v1.08 (refs. 65,66), with correction for the number of variants in each gene, LD between variants and LD between genes.”
From New insights into the genetic etiology of Alzheimer’s disease and related dementias (2022) · cites this paper as [65]
The cited source says what the claim attributes to it.
In the citing paper
“Competitive gene-set analysis62 also showed that human orthologs of osteocyte transcriptome signature genes had stronger associations with OA than non-osteocyte genes (OA at any site (P = 9.1.6 × 10−3), at the knee (P = 7.2 × 10−3), hip (P = 3.0 × 10−3) and hip and/or knee (P = 6.6 × 10−2).”
From Osteocyte transcriptome mapping identifies a molecular landscape controlling skeletal homeostasis and susceptibility to skeletal disease (2021) · cites this paper as [62]
The cited source says what the claim attributes to it.
In the citing paper
“Gene-level association testing with MAGMA15 did not identify any additional significant genes in EU or AA (Supplementary Table S5, Supplementary Information A12), likely due to lack of power.”
From Transancestral GWAS of alcohol dependence reveals common genetic underpinnings with psychiatric disorders (2018) · cites this paper as [15]
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625 · cited 2×
“The 1,320 Canonical Pathways from the MSigDB database [16] were used for the gene-set analysis.”
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089 · cited 2×
“The CD data set was then analysed using MAGMA and with five commonly used other tools for gene and gene-set analyses, specifically VEGAS [17], PLINK [8], ALIGATOR [9], INRICH [10] and MAGENTA [12].”
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336 · cited 1×
“However, despite growing sample sizes, the genetic variants discovered by GWAS generally account for only a fraction of the total heritability of a phenotype [2,3].”
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Genetics of Food Intake Self-Regulation in Childhood: Literature Review and Research Opportunities
Faith, M. S., Carnell, S., & Kral, T. V. E. (2013) · Human Heredity · doi:10.1159/000353879 · Cited by 7,601
Integrating common and rare genetic variation in diverse human populations
The International HapMap 3 Consortium (2010) · Nature · doi:10.1038/nature09298 · Cited by 3,026
Association analyses of 249,796 individuals reveal 18 new loci associated with body mass index
MAGIC, Speliotes, E. K., on behalf of Procardis Consortium, Willer, C. J., Berndt, S. I., Monda, K. L., Thorleifsson, G., Jackson, A. U., Allen, H. L., Lindgren, C. M., et al. (2010) · Nature Genetics · doi:10.1038/ng.686 · Cited by 2,912
The Wellcome Trust Case Control Consortium, U.K.
Mossman, K. (2008) · Scientific American · doi:10.1038/scientificamerican0108-42a · Cited by 2,684
Franke, A., McGovern, D. P. B., Barrett, J. C., Wang, K., Radford-Smith, G. L., Ahmad, T., Lees, C. W., Balschun, T., Lee, J., Roberts, R., et al. (2010) · Nature Genetics · doi:10.1038/ng.717 · Cited by 2,520
Cited by
Items 1,001–1,042 of 1,042
Pilalis, E., Zisis, D., Andrinopoulou, C., Karamanidou, T., Antonara, M., Stavropoulos, T. G., & Chatziioannou, A. A. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1474026 · Cited by 30
GIGSEA: genotype imputed gene set enrichment analysis using GWAS summary level data
Zhu, S., Qian, T., Hoshida, Y., Shen, Y., Yu, J., & Hao, K. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty529 · Cited by 22
A machine-compiled database of genome-wide association studies
Kuleshov, V., Ding, J., Vo, C., Hancock, B. J., Ratner, A., Li, Y., Ré, C., Batzoglou, S., & Snyder, M. P. (2019) · Nature Communications · doi:10.1038/s41467-019-11026-x · Cited by 34
“A typical association consists of a genetic variant, its associated phenotype, and a p-value indicating the signi fi cance of the association (see Supplementary Note 3).”
MethodInfluentialPolimanti, R. A., Levey, D. F., Pathak, G. A., Wendt, F. R., Nuñez, Y. Z., Ursano, R. J., Kessler, R. C., Kranzler, H. R., Stein, M. B., & Gelernter, J. E. (2021) · Translational Psychiatry · doi:10.1038/s41398-020-01153-1 · Cited by 24
Jung, S., Ye, B. D., Lee, H., Baek, J., Kim, G., Park, D., Park, S. H., Yang, S., Han, B., Liu, J., et al. (2021) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjab060 · Cited by 24
Identifying nootropic drug targets via large-scale cognitive GWAS and transcriptomics
Lam, M., Chen, C., Ge, T., Xia, Y., Hill, D. W., Trampush, J. W., Yu, J., Knowles, E., Davies, G., Stahl, E. A., et al. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01023-4 · Cited by 26
“MAGMA competitive pathway analysis was conducted with results emerging from earlier MAGMA gene-based, S-PrediXcan/S-TissueXcan, and SMR/HEIDI analyses.”
InfluentialOlislagers, M., Rademaker, K., Adan, R. A. H., Lin, B. D., & Luykx, J. J. (2021) · Molecular Psychiatry · doi:10.1038/s41380-021-01324-6 · Cited by 25
ExPheWas: a platform for cis -Mendelian randomization and gene-based association scans
Legault, M., Perreault, L. L., Tardif, J., & Dubé, M. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac289 · Cited by 27
“Different approaches have been proposed to conduct association testing of common variants at a gene locus (11,16,17).”
Fadista, J., Skotte, L., Karjalainen, J. M., Abner, E., Sørensen, E., Ullum, H., Werge, T., iPSYCH Group, Werge, T., HOUGAARD, D. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30921-4 · Cited by 31
Identification of risk genes for Alzheimer’s disease by gene embedding
Lagisetty, Y., Bourquard, T., Al‐Ramahi, I., Mangleburg, C. G., Mota, S., Soleimani, S., Shulman, J. M., Botas, J., Lee, K. D., & Lichtarge, O. (2022) · Cell Genomics · doi:10.1016/j.xgen.2022.100162 · Cited by 26
“68 MAGMA identified 31 AD-associated genes in the Discovery cohort and only seven in the Extension, with no overlap (Table S2).”
BackgroundZhang, L., Liu, T., He, C. H., Russo, A., Coffey, S., Yin, D., Hsu, I.-U., Zhang, C., Ye, Y., Su, C., et al. (2026) · Journal of Alzheimer’s Disease · doi:10.1177/13872877261480719 · Cited by 22
A missense variant in SHARPIN mediates Alzheimer’s disease-specific brain damages
Park, J. Y., Lee, D., Lee, J. J., Gim, J., Gunasekaran, T. I., Choi, K. Y., Kang, S., Do, A. R., Jo, J., Park, J., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01680-5 · Cited by 21
“Gene-based association analyses with rare variants Gene-based analyses for hippocampal volume (HV) and entorhinal thickness were performed using the MAGMA software tool [31] and models that included the same covariates as those described in tests of individual variants.”
MethodAlemany, S., Soler-Artigas, M., Cabana-Domínguez, J., Fakhreddine, D., Llonga, N., Vilar-Ribó, L., Rodríguez-Urrutia, A., Palacio, J., González-Castro, A. M., Lobo, B., et al. (2023) · Journal of Translational Medicine · doi:10.1186/s12967-023-04107-5 · Cited by 20
Social-Science Genomics: Progress, Challenges, and Future Directions
Benjamin, D., Cesarini, D., Turley, P., & Young, A. S. (2024) · doi:10.3386/w32404 · Cited by 20
Dashti, H. S., Jones, S. E., Wood, A. R., Lane, J. M., van Hees, V. T., Wang, H., Rhodes, J. A., Song, Y., Patel, K., Anderson, S. G., et al. (2018) · doi:10.1101/274977 · Cited by 614
Shared genetic architectures of educational attainment in East Asian and European populations
Chen, T.-T., Kim, J., Lam, M., Chuang, Y.-F., Chiu, Y.-L., Lin, S.-C., Jung, S.-H., Kim, B., Kim, S., Cho, C., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-023-01781-9 · Cited by 18
“Gene-based and gene set analyses were performed using MAGMA gene-property analyses 20,21 implemented in FUMA v1.”
Genetic variants predisposing to an increased risk of kidney stone disease
Lovegrove, C. E., Goldsworthy, M., Haley, J., Smelser, D., Gorvin, C., Hannan, F. M., Mahajan, A., Suri, M., Sadeghi-Alavijeh, O., Moochhala, S. H., et al. (2025) · Journal of Clinical Investigation · doi:10.1172/jci186915 · Cited by 18
“Genes and gene sets associated with KSD were identified in the UK Biobank-FinnGen meta-analysis using Multi-marker Analysis of GenoMic Annotation (MAGMA), version 1.10 (58, 59).”
InfluentialRare genetic variants confer a high risk of ADHD and implicate neuronal biology
Demontis, D., Duan, J., Hsu, Y.-H. H., Pintacuda, G., Grove, J., Nielsen, T. T., Thirstrup, J., Martorana, M., Botts, T., Satterstrom, F. K., et al. (2026) · Nature · doi:10.1038/s41586-025-09702-8 · Cited by 17
“Common-variant gene-based associations were calculated using MAGMA 72 and summary statistics from our previous GWAS meta-analysis of ADHD 13 .”
InfluentialGenome-wide determinants of mortality and motor progression in Parkinson’s disease
Tan, M. M. X., Lawton, M. A., Pollard, M. I., Brown, E., Real, R., Carrasco, A. M., Bekadar, S., Jabbari, E., Reynolds, R. H., Iwaki, H., et al. (2024) · npj Parkinson's Disease · doi:10.1038/s41531-024-00729-8 · Cited by 17
Pleiotropic Contribution of MECOM and AVPR1A to Aggression and Subcortical Brain Volumes
van Donkelaar, M. M. J., Hoogman, M., Pappa, I., Tiemeier, H., Buitelaar, J. K., Franke, B., & Bralten, J. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00061 · Cited by 16
“06 (de Leeuw et al., 2015).”
MethodResultInfluentialYang, Y., Bartz, T. M., Brown, M. R., Guo, X., Zilhão, N. R., Trompet, S., Weiss, S., Yao, J., Brody, J. A., Defilippi, C. R., et al. (2021) · Circulation: Genomic and Precision Medicine · doi:10.1161/circgen.121.003460 · Cited by 16
Meta-analysis of ACE inhibitor-induced angioedema identifies novel risk locus.
Mathey, C. M., Maj, C., Eriksson, N., Krebs, K., Westmeier, J., David, F. S., Koromina, M., Scheer, A. B., Szabo, N., Wedi, B., et al. (2024) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2023.11.921 · Cited by 15
Jones, S. E., Hees, V. T. V., Mazzotti, D. R., Marques-Vidal, P., Sabia, S., der Spek, A. V., Dashti, H. S., Engmann, J., Kocevska, D., Tyrrell, J., et al. (2018) · doi:10.1101/303925 · Cited by 14
Liu, R., Shang, X., Fu, Y., Wang, Y., Wang, P., & Yan, S. (2024) · Molecular Immunology · doi:10.1016/j.molimm.2024.02.002 · Cited by 13
Antón-Galindo, E., Cabana-Domínguez, J., Torrico, B., Corominas, R., Cormand, B., & Fernàndez-Castillo, N. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1293663 · Cited by 13
Organization of gene programs revealed by unsupervised analysis of diverse gene–trait associations
Mizikovsky, D., Naval Sanchez, M., Nefzger, C. M., Cuellar Partida, G., & Palpant, N. J. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac413 · Cited by 12
Pybus, A. F., Bitarafan, S., Brothers, R. O., Rohrer, A., Khaitan, A., Moctezuma, F. R., Udeshi, K., Davies, B., Triplett, S., Griffin, M. N., et al. (2024) · Journal of Neuroinflammation · doi:10.1186/s12974-024-03128-1 · Cited by 12
Integrative proteomics and pharmacogenomics analysis of methylphenidate treatment response
da Silva, B. S., Leffa, D. T., Beys-da-Silva, W. O., Torres, I. L. S., Rovaris, D. L., Victor, M. M., Rohde, L. A., Mota, N. R., Oliveira, C. D., Berger, M., et al. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0649-5 · Cited by 12
Organisation of gene programs revealed by unsupervised analysis of diverse gene-trait associations
(2022) · doi:10.1101/2022.04.07.487559 · Cited by 12
EADB, Bellenguez, C., Castillo Morales, A., Amin, N., van der Lee, S. J., Muntaner, M., Parveen, K., Küçükali, F., Grenier-Boley, B., Heikkinen, S., et al. (2026) · Nature Genetics · doi:10.1038/s41588-026-02583-1 · Cited by 36
“08) 41,42 , with correction for the number of variants in each gene, LD between variants and LD between genes.”
Self-citationBrigos-Barril, E., Vasallo, C., Farré, X., Morcillo-Suárez, C., Polo-Alonso, S., Rodríguez-Fernández, B., Valenzuela, A., Sarabia, C., Bosch, E., Laayouni, H., et al. (2026) · Nature Ecology & Evolution · doi:10.1038/s41559-026-03140-z · Cited by 6
“The genetic architecture of fertility showed enrichment for gene expression in brain and ovarian tissues, which is consistent with known biology 33,34 .”
Wootton, O., Shadrin, A. A., Mohn, C., Susser, E., Ramesar, R., Gur, R. C., Andreassen, O. A., Stein, D. J., & Dalvie, S. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02292-9 · Cited by 5
“Gene-based analysis of 19,129 protein coding genes was performed using MAGMA [40] as implemented in FUMA, with an SNP-wise mean model and the 1000 genomes project phase 3 release European reference panel.”
MethodPeter, H. L., Giglberger, M., Frank, J., Streit, F., Zänkert, S., Kreuzpointner, L., Rietschel, M., Kudielka, B. M., & Wüst, S. (2022) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2022.105883 · Cited by 4
Lin, S., & Jia, P. (2024) · GigaScience · doi:10.1093/gigascience/giae108 · Cited by 4
Graham, A. C., Bellou, E., Harwood, J. C., Yaman, U., Celikag, M., Magusali, N., Rambarack, N., Botia, J. A., Frigerio, C. S., Hardy, J., et al. (2023) · doi:10.1101/2023.03.30.23287975 · Cited by 4
The hidden genetic and microbial networks connecting neuropsychiatric and digestive disorders
Xiong, J., Xu, T., Wang, Z., Huang, Y., Zhang, S., Yang, G., Yang, J., Gao, S., Wang, T., Jian, X., et al. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.07.029 · Cited by 4
Dietary cholesterol activates a Ral-dependent pathway driving LDLR turnover
Feng, X., Zhang, S., Wang, Y., Kurlagunda, T., Sit, A., Jaishankar, P., Yang, P., Sakane, S., Park, S. Y., Wisessaowapak, C., et al. (2026) · Nature · doi:10.1038/s41586-026-10697-z · Cited by 2
High false sign rates in transcriptome-wide association studies
Gerlach, P. A., Milind, N., Spence, J. P., & Pritchard, J. K. (2026) · Nature Genetics · doi:10.1038/s41588-026-02796-4 · Cited by 1
Lin, J., Wu, S., Lin, C., Jin, S., Chen, L., Luo, J., Xu, S., Jin, L., Yu, M., Zheng, Y., et al. (2026) · Journal of the American Heart Association · doi:10.1161/jaha.126.050327
scTraitReg: a single-cell multi-omic database of trait-relevant transcription factor eRegulons
Chen, H., Liu, Y., Rui, X., Li, S., Sun, L., Xiao, G., Tang, H., Sun, Y., Guan, X., & Cao, C. (2026) · Nucleic Acids Research · doi:10.1093/nar/gkag1017
Integration of polygenic risk with single cell methylation data using met-scDRS
Li, X., Shi, Z., Hou, K., Eyring, K. W., Liu, C., Heffel, M. G., Luo, C., Geschwind, D. H., & Pasaniuc, B. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag751
“In terms of future directions, one possibility lies in optimizing the methylation aggregation such as using Hi-C data to compute gene scores from MAGMA while matching the aggregation of methylation to gene using the same set of Hi-C results.”
InfluentialAlzheimer’s disease genetics converges on microglial and neuronal dysregulation
Uffelmann, E., Wightman, D. P., Bahrami, S., Shadrin, A. A., Fominykh, V., Ojima, T., Jiang, C., Benner, C., Moreno, E., Campos, A. I., et al. (2026) · Nature · doi:10.1038/s41586-026-11206-y
Self-citation
Metadata
- Authors
- de Leeuw, C. A., Mooij, J. M., Heskes, T., & Posthuma, D.
- Affiliations
- University of Amsterdam (NL)
- Radboud University Nijmegen (NL)
- ORCID
- Heskes, Tom
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-04-17
- Volume
- 11
- Issue
- 4
- Pages
- e1004219
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC4401657
- OpenAlex
- W2051314902
- Cited by
- 3,653
- References
- 29
- Citations by year
- 2026: 508 · 2025: 614 · 2024: 544 · 2023: 426 · 2022: 410 · 2021: 366 · 2020: 279 · 2019: 252 · 2018: 156 · 2017: 70 · 2016: 21 · 2015: 5
- FWCI
- 36.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion, other-oa)
- VU Research Portal (publishedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO 480‐05‐003, 480- 05-003, 645-000-003)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Keywords
- magma, gene set analysis, genetic analysis, genome-wide association study, complex traits, multiple linear regression, linkage disequilibrium, statistical power, Crohn's disease, computational efficiency
- MeSH terms
- Computer Simulation, Crohn Disease, Humans, Models, Genetic, Software, Computational Biology, Databases, Genetic, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.