Cited by 1,212Epigenetics and DNA MethylationGene expression and cancer classificationGenetic Syndromes and Imprinting

A data-driven approach to preprocessing Illumina 450K methylation array data

Open access
Pidsley, Ruth, Y Wong, Chloe C, Volta, Manuela, Lunnon, Katie, Mill, Jonathan, Schalkwyk, Leonard C·2013·BMC Genomics

Abstract

BACKGROUND: As the most stable and experimentally accessible epigenetic mark, DNA methylation is of great interest to the research community. The landscape of DNA methylation across tissues, through development and in disease pathogenesis is not yet well characterized. Thus there is a need for rapid and cost effective methods for assessing genome-wide levels of DNA methylation. The Illumina Infinium HumanMethylation450 (450K) BeadChip is a very useful addition to the available methods for DNA methylation analysis but its complex design, incorporating two different assay methods, requires careful consideration. Accordingly, several normalization schemes have been published. We have taken advantage of known DNA methylation patterns associated with genomic imprinting and X-chromosome inactivation (XCI), in addition to the performance of SNP genotyping assays present on the array, to derive three independent metrics which we use to test alternative schemes of correction and normalization. These metrics also have potential utility as quality scores for datasets. RESULTS: The standard index of DNA methylation at any specific CpG site is β = M/(M + U + 100) where M and U are methylated and unmethylated signal intensities, respectively. Betas (βs) calculated from raw signal intensities (the default GenomeStudio behavior) perform well, but using 11 methylomic datasets we demonstrate that quantile normalization methods produce marked improvement, even in highly consistent data, by all three metrics. The commonly used procedure of normalizing betas is inferior to the separate normalization of M and U, and it is also advantageous to normalize Type I and Type II assays separately. More elaborate manipulation of quantiles proves to be counterproductive. CONCLUSIONS: Careful selection of preprocessing steps can minimize variance and thus improve statistical power, especially for the detection of the small absolute DNA methylation changes likely associated with complex disease phenotypes. For the convenience of the research community we have created a user-friendly R software package called wateRmelon, downloadable from bioConductor, compatible with the existing methylumi, minfi and IMA packages, that allows others to utilize the same normalization methods and data quality tests on 450K data.

AI snapshot

Written from the paper’s full text.

TL;DR

Using 11 Illumina 450K datasets (total n=696), the authors derive three performance metrics from imprinted DMRs, SNP probes, and X-chromosome inactivation and use them to rank 15 preprocessing/normalization methods. They find that dasen—background adjustment plus separate between-array quantile normalization of methylated and unmethylated Type I and Type II intensities—performs best overall.

Key findings

  • Across 11 datasets and 15 methods, dasen had the best average rank (2; Type I 2.5, Type II 1.5), followed by danet (3.5) and daten1 (4); raw averaged 8.75, betaqn 13.5, Fuks 10.75, Tost 13.5, and SWAN 12.5.
  • Normalizing M and U separately outperformed normalizing β (naten vs betaqn), and separate Type I/Type II normalization improved metrics; more elaborate segmented QN schemes (Tost, SWAN) were counterproductive.
  • In Cohort 1Ai, a sex-difference t-test at Bonferroni-corrected p<0.05 yielded 9,796 significant probes, of which 8,969 were X-chromosome loci, recovering 80% of X-chromosome probes; dasen added 296 (3%) sex differences compared with raw.
  • The metrics used 237 iDMR probes expected to have β=0.5, 65 SNP probes, and 11,232 X-chromosome features.

Methods

  • 11 450K datasets (total n=696) from post-mortem brain regions and whole blood; 500 ng genomic DNA was bisulfite-treated, run on Illumina HumanMethylation450 BeadChips, and raw signal intensities were extracted with GenomeStudio without background correction or normalization.
  • Three performance metrics were calculated: DMRSE from 237 imprinted DMR probes expected at β=0.5; GCOSE from 65 SNP probes partitioned by k-means into three genotype clusters; and Seabird = 1−AUC from ROC analysis predicting X-chromosome location using sex-difference p-values.
  • Fifteen preprocessing methods were ranked by mean ranks across metrics and datasets for Type I and Type II probes separately; analyses used R 2.15.0 and Bioconductor 2.12, with functions packaged as wateRmelon, and data deposited in GEO under GSE43414.

Limitations

  • The authors state that the three metrics may miss some aspect of performance; the datasets analyzed were relatively homogeneous brain or whole blood, multi-tissue datasets were not extensively addressed, and more heterogeneous datasets may require different handling.
  • The authors also state that only QN-based methods were tested, and a different approach such as scaling could possibly work better.
  • Evident from the text: less than 1% of individual samples were excluded as technical failures based on atypical raw intensity distribution and poor correlation with other samples, and the ranking relies on array-derived natural controls rather than external spike-in validation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/1471-2164-14-293

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

15 of 21 cited sources checked · 7 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Basic analysis of β values works well for detecting large DNA methylation differences, such as between tissues or tumor-normal pairs.

    “The β values are indeed fairly stable and the basic analysis method works well, particularly for the detection of large differences, for example between tissues or tumor-normal pairs [8].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [8] Carén H, Djos A, Nethander M, Sjöberg RM, Kogner P, Enström C, Nilsson S, Martinsson T: Identification of epigenetically regulated genes that predict patient outcome in neuroblastoma. BMC Cancer. 2011, 11: 66-10.1186/1471-2407-11-66. [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3045360&tool=pmcentrez&rendertype=abstract] source

      The Methods define β values, and the Results (Differential methylation analysis; page unavailable) show that comparing them detected differences between neuroblastoma patient groups. The Discussion describes DNA methylation measurement as robust and stable. The paper does not establish that basic β-value analysis works particularly well for large differences between tissues or tumor–normal pairs. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • Premisecitation

    Autosomal sex-specifically methylated loci are very few in number.

    “True, autosomal sex-specifically methylated loci are very small in number”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [17] Chen Ya, Choufani S, Ferreira JC, Grafodatskaya D, Butcher DT, Weksberg R: Sequence overlap between autosomal and sex-linked probes on the Illumina HumanMethylation27 microarray. Genomics. 2011, 97 (4): 214-222. 10.1016/j.ygeno.2010.12.004. [http://www.ncbi.nlm.nih.gov/pubmed/21211562] source

      Section 2.1 reports that, among 26,486 autosomal CpGs tested in blood lymphocytes, only seven of the 19 apparent sex-specific findings were not considered technical artifacts. That supports the claim that such loci were very few in this study, but not an unqualified claim about all autosomal loci or tissues. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Interpretationcitation

    Tests of distribution similarity between technical replicates, such as the Kolmogorov-Smirnov test, are potentially misleading because samples can be identically distributed but uncorrelated.

    “tests of distribution similarity between technical replicates(for example the Kolmogorov-Smirnov test used by Maksimovic et al[6]) are also potentially misleading because samples can be identically distributed but uncorrelated.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [6] Maksimovic J, Gordon L, Oshlack A: SWAN: Subset quantile within-array normalization for Illumina Infinium HumanMethylation450 BeadChips. Genome Biol. 2012, 13 (6): R44-10.1186/gb-2012-13-6-r44. [http://www.ncbi.nlm.nih.gov/pubmed/22703947] source
  • Interpretationcitation

    Disappearance of batch effects is a useful but insufficient indicator of normalization performance because it does not show whether true differences can still be detected.

    “the disappearance of batch effects is a useful indicator [12], but not sufficient as a performance indicator because it does not indicate whether true differences can”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [12] Sun Z, Chai HS, Wu Y, White WM, Donkena KV, Klein CJ, Garovic VD, Therneau TM, Kocher JPa: Batch effect correction for genome-wide methylation data with Illumina Infinium platform. BMC Med Genomics. 2011, 4: 84-10.1186/1755-8794-4-84. [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3265417&tool=pmcentrez&rendertype=abstract] source
  • Premisecitation

    Autosomal sex-specifically methylated loci may represent autosomal probes mapping to sex-chromosome sequences.

    “and potentially represent autosomal probes mapping to sequences on the sex-chromosome [17].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [17] Chen Ya, Choufani S, Ferreira JC, Grafodatskaya D, Butcher DT, Weksberg R: Sequence overlap between autosomal and sex-linked probes on the Illumina HumanMethylation27 microarray. Genomics. 2011, 97 (4): 214-222. 10.1016/j.ygeno.2010.12.004. [http://www.ncbi.nlm.nih.gov/pubmed/21211562] source
  • Classified as probably not a substantial claim. 14
  • May combine two claims. 6
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Dedeurwaerder et al. found that the difference between Type I and Type II distributions reflected a difference in performance between the two probe types and devised a custom transformation of Type II β values to accommodate it.

    “Dedeurwaerder et al[5] found that this reflected a difference in performance between the two probe types and devised a custom transformation of the Type II β values to accommodate it”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [5] Dedeurwaerder S, Defrance M, Calonne E, Sotiriou C, Fuks F: Evaluation of the Infinium Methylation 450K technology. Epigenetics. 2011, 3 (6): 771-784. source
  • May combine two claims.

    Premisecitation

    The majority of CpG sites assayed are fully methylated or fully unmethylated and would change little after normalization.

    “the majority of CpG sites assayed are in a fully methylated or fully unmethylated state and would change little after normalization”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [14] Roessler J, Ammerpohl O, Gutwein J, Hasemeier B, Anwar SL, Kreipe H, Lehmann U: Quantitative cross-validation and content analysis of the 450k DNA methylation array from Illumina, Inc. BMC Res Notes. 2012, 5: 210-10.1186/1756-0500-5-210. [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3420245&tool=pmcentrez&rendertype=abstract] source

      The Conclusion says that β-values are a good measure of methylation status for most CpG sites, but it does not say most sites are fully methylated or fully unmethylated. The Findings discuss agreement with pyrosequencing, not changes after normalization. Searches for extreme methylation states and normalization found no passage addressing the claim. (LLM, conf=0.72)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The DNA methylation field is technology-limited and characterized by small sample sizes, diverse techniques and variable statistical standards.

    “Currently the DNA methylation field resembles gene expression studies of a decade ago: it is technology-limited and characterized by small sample sizes, diverse techniques and variable statistical standards [22].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [22] Heijmans BT, Mill J: Commentary: The seven plagues of epigenetic epidemiology. Int J Epidemiol. 2012, 41: 74-78. 10.1093/ije/dyr225. [http://www.ncbi.nlm.nih.gov/pubmed/22269254] source
  • May combine two claims.

    Premisecitation

    The minority of intermediate methylation values are susceptible to greater changes after normalization but are overlooked by a correlation test.

    “the minority of intermediate methylation values would be susceptible to far greater changes after normalization but would be overlooked by a correlation test [14]”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [14] Roessler J, Ammerpohl O, Gutwein J, Hasemeier B, Anwar SL, Kreipe H, Lehmann U: Quantitative cross-validation and content analysis of the 450k DNA methylation array from Illumina, Inc. BMC Res Notes. 2012, 5: 210-10.1186/1756-0500-5-210. [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3420245&tool=pmcentrez&rendertype=abstract] source

      In Findings > Cross-validation of 450k methylation array and pyrosequencing (page not specified), the paper says correlation coefficients can be misleading because values near 0% and 100% dominate, masking poorer agreement at intermediate methylation levels. It compares array measurements with pyrosequencing; it does not say that intermediate values undergo greater changes after normalization. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The effect of background adjustment on Type I probes is clearly visible.

    “While the difference in peak width is not readily visible at this scale, the effect of background adjustment on Type I probes is clearly visible.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    A higher background in Type II assays would explain the compressed distribution of β values because it inflates both M and U.

    “Our insight is that a higher background in the Type II assays would explain such a difference in distribution of β values, because it inflates both M and U”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Quantile normalization may introduce considerable changes in parts of the distribution with few values.

    “A potential weakness of QN is that in parts of the distribution with few values (and therefore relatively large interquantile differences), it may introduce considerable changes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Quantile normalization is a well-established technique in gene expression analysis that has been shown to perform well.

    “Quantile normalization (QN) is a well established technique in gene expression analysis, where it has been shown to perform well [13].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Irizarry Ra, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics (Oxford, England). 2003, 4 (2): 249-264. 10.1093/biostatistics/4.2.249. [http://www.ncbi.nlm.nih.gov/pubmed/12925520] source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The SNP control probes can provide an indication of the degree of technical variance between samples.

    “Although these are not DNA methylation signals, they could be used to provide an indication of the degree of technical variance between samples.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The 450K BeadChip contains 65 control probes that assay highly polymorphic SNPs rather than DNA methylation.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Initial quality control checks assessed concordance between reported and genotyped gender.

    “Initial quality control checks were performed using functions in the methylumi package to assess concordance between reported and genotyped gender.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Non-CpG SNP probes were used to confirm that multiple tissues were sourced from the same individual where expected.

    “Non-CpG SNP probes on the array were also used to confirm that multiple tissues were sourced from the same individual where expected.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Those large changes could increase between-sample variance for individual features rather than reducing it.

    “The danger is that these large changes could increase the variance across samples for individual features, rather than reducing it as desired.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    DMRSE should directly predict sensitivity to detect true differences between groups.

    “and it should directly predict sensitivity to detect true differences between groups.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    DMRSE is reasonably independent of the size of the dataset.

    “This measure was chosen because it is reasonably independent of the size of the dataset”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Effects on β values may be complicated by interaction between M and U.

    “where effects may be complicated by their interaction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The signal from the 65 SNP control probes is expected to cluster into three distinct groups representing the heterozygous and two homozygous genotypes.

    “The signal from these probes is expected to cluster into three distinct groups (representing the heterozygous and two homozygous groups).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The 450K BeadChip contains 65 control probes that assay highly polymorphic SNPs rather than DNA methylation.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The study only tested normalization methods based on quantile normalization.

    “Finally we have only tested methods based on QN.”
    Quote in the paperNot a substantial claim
17 of 17
  • The paper relies on this without support.

    Small absolute DNA methylation changes are likely associated with complex disease phenotypes.

    “especially for the detection of the small absolute DNA methylation changes likely associated with complex disease phenotypes”
  • The paper relies on this without support.

    Attempts to correct background by subtracting estimates derived from control probes introduce another source of variance.

    “attempts to correct them, for example by subtraction of estimates derived from control probes, are undesirable because they introduce another source of variance”
  • The paper relies on this without support.

    The suitability of quantile normalization for DNA methylation data has been assumed from gene expression experience, but there has been little systematic testing.

    “The suitability of QN for DNA methylation data has been assumed based on experience in the analysis of gene expression data, but there has been little systematic testing.”
  • The paper relies on this without support.

    The 450K BeadChip contains 65 control probes that assay highly polymorphic SNPs rather than DNA methylation.

    “The 450K BeadChip also features 65 control probes which assay highly-polymorphic single nucleotide polymorphisms (SNPs) rather than DNA methylation.”
  • The paper relies on this without support.

    GenomeStudio default settings perform no normalization.

    “the manufacturer’s GenomeStudio software calculates βs from raw intensities and under default settings performs no normalization”
  • The paper relies on this without support.

    In females, one copy of the X chromosome is predominantly inactivated and largely methylated.

    “In females, one copy of the X-chromosome is predominantly inactivated and largely methylated.”
  • The paper relies on this without support.

    65 probes on the 450K BeadChip assay highly polymorphic SNPs rather than CpG sites.

    “There are 65 probes on the 450K BeadChip which assay highly polymorphic SNPs rather than CpG sites.”
  • The paper relies on this without support.

    QN has the potential to impose large changes in parts of a distribution with few members.

    “the known potential of QN to impose large changes in those parts of a distribution with few members”
  • The paper relies on this without support.

    M and U distributions differ.

    “M and U distributions differ”
  • The paper relies on this without support.

    Dye bias variation is a potential problem with Type II assays.

    “which is a potential problem with Type II assays”
  • The paper relies on this without support.

    The inactive X-chromosome in females is hypermethylated.

    “The inactive X-chromosome in females is hypermethylated”
  • The paper relies on this without support.

    The 11,232 X-chromosome features annotated for the array show a distinctive β distribution centred on approximately 0.5, compared with the biphasic distribution of autosomal probes.

    “the 11,232 X-chromosome features annotated for the array show a distinctive β value distribution, once again centred on approximately 0.5, compared to the biphasic distribution of autosomal probes.”
  • The paper relies on this without support.

    The three performance metrics (DMRSE, GCOSE, Seabird) are valid indicators of preprocessing method performance.

    “The test metrics were subsequently used to quantitatively determine the best performing preprocessing method”
  • The paper relies on this without support.

    Type II probes represent 72% of the probes on the array.

    “which represent 72% of the probes on the array”
  • The paper relies on this without support.

    The array features that assay known sites of differential methylation or genotype are valid indicators of normalization performance.

    “We then evaluated each method using features on the array that assay known sites of differential methylation or genotype.”
  • The paper relies on this without support.

    Quantile normalization is strongly favoured by consensus in the field.

    “Although there is a strong consensus in favour of this method, it is possible that a different approach based, for example, on scaling, could possibly work better.”
16 of 16

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • SWAN normalisation removed technical differences between MINFI package Infinium I and Infinium II probes.

    “SWAN normalisation removed technical differences between MINFI package Infinium I and Infinium II probes (Maksimovic, Gordon & Oshlack, 2012;Pidsley et al., 2013).”

    From DNA methylation of NR3C1 and FKBP5 is associated with posttraumatic stress disorder, posttraumatic growth, and resilience. (2020) · cites this paper as Pidsley et al., 2013

    In Results and discussion, “Qualitative observations on preprocessing and normalization” (page unavailable), the paper describes SWAN’s segmented quantile-normalization scheme as counterproductive relative to dasen. Its “Preprocessing and normalization method design” section attributes reduction of Type I/II background differences to other methods, not SWAN. The paper therefore does not report that SWAN removed those technical differences. (LLM, conf=0.76)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • One cohort is said to supply seven datasets but eight are listed

    Minor

    The Methods section labels the cohort as the source of seven datasets, then names eight: 1Ai, 1Aii, 1B, 1C, 1D, 1E, 1BC and 1AD.

1 of 1

Cites

Flagged first, then by citations

1 of the 24 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. Davis S, Du P, Bilke S, Triche JrT, Bootwalla M: Methylumi: Handle Illumina Methylation Data. 2012, R package version 2.2.0, .

Cited by

Sorted by citations

Authors
Pidsley, R., Y Wong, C. C., Volta, M., Lunnon, K., Mill, J., & Schalkwyk, L. C.
Affiliations
King's College London (GB)
Corresponding author
Schalkwyk, Leonard C
Venue
BMC Genomics
Published
2013-05-01
Volume
14
Issue
1
Pages
293-293
ISSN
1471-2164 (ISSN-L)
OpenAlex
W2119883345
Cited by
1,143
References
24
Citations by year
2026: 74 · 2025: 97 · 2024: 102 · 2023: 109 · 2022: 112 · 2021: 141 · 2020: 94 · 2019: 70 · 2018: 76 · 2017: 94 · 2016: 71 · 2015: 60 · 2014: 33 · 2013: 7
FWCI
22.99
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • BMC Genomics (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Open Access at Essex (University of Essex) (acceptedVersion, cc-by)
  • Europe PMC (PubMed Central) (submittedVersion, cc-by)
  • PubMed Central (submittedVersion, cc-by)
  • Figshare (submittedVersion)
  • Research Portal (King's College London) (submittedVersion, other-oa)
  • Open Research Exeter (University of Exeter) (submittedVersion, cc-by)
Funders
  • American Asthma Foundation
  • National Institutes of Health
  • Medical Research Council
  • National Institute on Aging (R01AG036039)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Epigenetics and DNA Methylation
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Syndromes and Imprinting
Keywords
DNA methylation, quantile normalization, genomic imprinting, X chromosome inactivation, data quality metrics, watermelon, R package, statistical power
MeSH terms
Humans, Statistics as Topic, Genomic Imprinting, DNA Methylation, Computational Biology, Oligonucleotide Array Sequence Analysis, Polymorphism, Single Nucleotide, Chromosomes, Human, X

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-18.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-18.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review