Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index; 22 of the 27 sources its claims cite were checked for support.
Abstract
This retrospective study evaluated multiplex PCR panels for meningitis and encephalitis in a tertiary care hospital over five years. Out of 1,491 CSF samples, 122 (8.2%) were positive; viral agents predominated, with HHV-6 most common.
Overview
CoChat Summary
TL;DR
This five-year retrospective study of 1,491 CSF samples found that multiplex meningitis/encephalitis PCR panels detected a pathogen in only 8.2% of samples, and just 41% of those positive results led to a documented change in diagnosis or treatment. The authors conclude the panels are analytically useful but clinically under-leveraged because of inappropriate test ordering and limited clinician follow-up.
Key findings
- Of 1,491 CSF samples, 122 (8.2%) were positive for at least one pathogen; viruses predominated, led by HHV-6 (n=34, 27.9%), enterovirus (n=14, 11.5%) and HSV-1 (n=10, 8.2%), with *Streptococcus pneumoniae* (n=13, 10.6%) the leading bacterium.
- Positivity was significantly higher in children (14.6%, 71/486) than adults (5.1%, 51/1,005; P<0.001).
- Only 41% (n=50) of positive results were clinically relevant; *N. meningitidis*, *E. coli* and *S. pyogenes* were 100% clinically relevant, whereas HHV-6 was lowest at 17%.
- Co-detections occurred in 18/122 positives (14.7%), 16 of which (88.9%) occurred in 2019 when the FastTrack Diagnostics panel was used; repeat testing after an initial negative had low yield (n=7, 7.2%; 97 patients retested, 7.1%).
Methods
- Retrospective observational study at the Molecular Microbiology division, Ankara University Faculty of Medicine, İbn-i Sina Hospital, Turkey, covering all multiplex M&E panel requests from January 2019 to December 2023; only the first positive CSF sample per patient was included, and cases with missing clinical/demographic data were excluded.
- Three commercial platforms were used across the period: FastTrack Diagnostics panels (2019), BioFire® FilmArray® M&E Panel (2020–2021), and QIAstat-Dx® M&E Panel (2022–2023); ~200 µL uncentrifuged CSF per assay.
- Clinical relevance was defined as initiation/change of targeted antimicrobial or antiviral therapy, additional diagnostic investigations prompted by the result, or a confirmed clinical diagnosis consistent with the detected pathogen; analysis in SPSS v22.0 with chi-square/Fisher's exact tests, Cramer's V or odds ratios with 95% CI, P<0.05 significant.
Limitations
- Stated by the authors: use of three different multiplex platforms may have introduced variability in target detection and analytical sensitivity; single-centre retrospective design limits generalisability; lack of outcome measures such as antimicrobial use or length of stay (incomplete retrospective documentation); limited positive cases precluded reliable multivariable regression.
- Evident from the text: Ct values were not consistently recorded and were excluded from quantitative analysis; the co-detection repeat-test analysis reflects clinical evolution rather than analytical reproducibility, as the authors themselves note.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
11 Valid · 0 Not valid · 1 Not checked · 66 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For example, the detection of human herpesvirus-6 (HHV-6) may reflect chromosomally integrated viral DNA rather than active infection, particularly in immunocompetent individuals.”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Abstract > Interpretation and conclusions
What the sources say
- Partly supportedcites [1] Dien Bard J McElvania E Panels and syndromic testing in clinical microbiology Clin Lab Med. 2020 40 393 420 10.1016/j.cll.2020.08.001 33121611 PMC7528880 sourceExperimental — accuracy not yet measured
The Meningitis/encephalitis syndromic panel section (page not provided) says HHV-6 detection may represent chromosomally integrated virus rather than true infection. It does not say this explanation is particularly likely in immunocompetent individuals; it notes that most patients with reported HHV-6 central nervous system infections in one pediatric study were immunocompetent. (LLM, conf=0.85)
- Supportedcites [5] Vetter P Schibler M Herrmann JL Boutolleau D Diagnostic challenges of central nervous system infection: Extensive multiplex panels versus stepwise guided approach Clin Microbiol Infect. 2020 26 706 12 10.1016/j.cmi.2019.12.013 31899336 source
The Additional considerations section says an HHV-6-positive result in immunocompetent patients may reflect inherited chromosomal integration rather than a pathogenic role for the virus. The Qualitative versus quantitative assays section also distinguishes active HHV-6 infection from inherited chromosomally integrated HHV-6. (LLM, conf=0.94)
- Supportedcites [6] Ngo Nsoga MT Pérez-Rodriguez FJ Mamin A L’Huillier AG Cherkaoui A Kaiser L et al Rational use of microbiological tests in the diagnosis of central nervous system infections using restrictive criteria: A retrospective study Microbiol Spectr. 2023 11 e0317922 10.1128/spectrum.03179-22 36971564 PMC10100671 source
The Introduction (page unavailable) identifies inherited chromosomally integrated HHV-6 genomes as a cause of clinically insignificant detection and says HHV-6 is not a relevant pathogen to search for in immunocompetent adults. The Results (page unavailable) also describe positive HHV-6 tests attributed to confirmed or probable chromosomal integration rather than CNS infection. (LLM, conf=0.90)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Co-detections were more common in our data than in most previous reports from the United States and India,10,18 particularly during the period when the FastTrack Diagnostics® panel was in use.”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Discussion
What the sources say
- Supportedcites [10] Leber AL Everhart K Balada-Llasat JM Cullison J Daly J Holt S et al Multicenter evaluation of biofire filmarray meningitis/encephalitis panel for detection of bacteria, viruses, and yeast in cerebrospinal fluid specimens J Clin Microbiol. 2016 54 2251 61 10.1128/JCM.00730-16 27335149 PMC5005480 source
The Results report five codetections among 1,560 specimens (0.3%; 3.7% of positive specimens) in this earlier U.S. multicenter study. The citation supports its use as a U.S. comparison report; the citing authors’ own cohort rate and FastTrack period are not findings attributed to Leber et al. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [18] Tarai B Das P FilmArray® meningitis/encephalitis (ME) panel, a rapid molecular platform for diagnosis of CNS infections in a tertiary care hospital in North India: One-and-half-year review Neurol Sci. 2019 40 81 8 10.1007/s10072-018-3584-y 30255486 source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, Epstein-Barr virus (EBV) positivity in CSF may indicate latent infection without CNS involvement.1,5,6”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Abstract > Interpretation and conclusions
What the sources say
- Could not verifycites [1] Dien Bard J McElvania E Panels and syndromic testing in clinical microbiology Clin Lab Med. 2020 40 393 420 10.1016/j.cll.2020.08.001 33121611 PMC7528880 sourceExperimental — accuracy not yet measured
The Meningitis/encephalitis syndromic panel section discusses whether a positive HHV-6 result reflects a true CNS infection, but it does not make this point about Epstein–Barr virus. Searches for EBV positivity, latency, and CSF returned no passage addressing the claim; page numbers were unavailable in our copy. (LLM, conf=0.76)
- Partly supportedcites [5] Vetter P Schibler M Herrmann JL Boutolleau D Diagnostic challenges of central nervous system infection: Extensive multiplex panels versus stepwise guided approach Clin Microbiol Infect. 2020 26 706 12 10.1016/j.cmi.2019.12.013 31899336 sourceExperimental — accuracy not yet measured
The Additional considerations section says Epstein–Barr virus is more likely to cause lymphoma than CNS infection, supporting caution about interpreting EBV as a cause of CNS infection. It does not say that EBV positivity in CSF indicates latent infection or discuss that specific interpretation; the nearby example of an incidental positive result concerns HHV-6, not EBV. No page number is available in our copy. (LLM, conf=0.78)
- Supportedcites [6] Ngo Nsoga MT Pérez-Rodriguez FJ Mamin A L’Huillier AG Cherkaoui A Kaiser L et al Rational use of microbiological tests in the diagnosis of central nervous system infections using restrictive criteria: A retrospective study Microbiol Spectr. 2023 11 e0317922 10.1128/spectrum.03179-22 36971564 PMC10100671 source
The Introduction says that detecting latent EBV episomes in memory B cells present in CSF can be clinically insignificant. It gives this as an example in the context of adult immunocompetent patients whose CSF white blood cell count and protein content are normal, supporting the claim that EBV positivity may occur without CNS involvement. (LLM, conf=0.91)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“This finding supports previous observations that analytical design and target range may affect co-detection frequency.19”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Discussion
What the sources say
- Supportedcites [19] Bierbaum S Forster J Berner R Rücker G Rohde G Neumann-Haefelin D et al Detection of respiratory viruses using a multiplex real-time PCR assay in Germany, 2009/10 Arch Virol. 2014 159 669 76 10.1007/s00705-013-1876-3 24126621 PMC7086993 source
The Results (FTD assay; Reference assays) report different multiple-pathogen detection counts for the multiplex assay and reference PCRs. The Results (Comparison of the FTD assay with reference assays) also report concordance in only 16 of 33 samples with multiple detections and note that the assays differ in which targets they distinguish. These observations support the cautious claim that analytical design and target range may affect co-detection frequency; page numbers are unavailable in our copy. (LLM, conf=0.87)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This finding is consistent with previous studies and can be explained by the detection of latent or chromosomally integrated HHV-6 DNA rather than active CNS infection, particularly in immunocompetent individuals.”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Discussion
What the sources say
- Supportedcites [5] Vetter P Schibler M Herrmann JL Boutolleau D Diagnostic challenges of central nervous system infection: Extensive multiplex panels versus stepwise guided approach Clin Microbiol Infect. 2020 26 706 12 10.1016/j.cmi.2019.12.013 31899336 source
In “Additional considerations” (page unavailable), the paper says a fortuitous HHV-6-positive result in an immunocompetent patient more likely reflects inherited chromosomal integration than a pathogenic role for the virus. “Qualitative versus quantitative assays” (page unavailable) likewise distinguishes active HHV-6 infection from inherited chromosomally integrated HHV-6. (LLM, conf=0.91)
- Partly supportedcites [6] Ngo Nsoga MT Pérez-Rodriguez FJ Mamin A L’Huillier AG Cherkaoui A Kaiser L et al Rational use of microbiological tests in the diagnosis of central nervous system infections using restrictive criteria: A retrospective study Microbiol Spectr. 2023 11 e0317922 10.1128/spectrum.03179-22 36971564 PMC10100671 sourceExperimental — accuracy not yet measured
The Results report HHV-6-positive CSF findings attributed to chromosomal integration or reactivation of unclear clinical significance rather than CNS infection. The Introduction says HHV-6 is not a relevant pathogen to search for in immunocompetent adults. It does not describe latent HHV-6 DNA as an explanation; its example of latent viral DNA concerns EBV. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
31 more claims
Create a free account to see all 78 claims and every source verdict.
- It may state two separate claims as one. 30
- Probably not a substantial claim. 20
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Methods > Statistical analysis
“All P-values were reported exactly (to three decimal places)”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Results > Study cohort and demographics
“The positivity rate was significantly higher in the paediatric population (14.6%, 71/486) compared to adults (5.1%, 51/1,005; P<0.001).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Results > Pathogen detection profile
“The proportion of clinically relevant results did not differ significantly between paediatric and adult groups (43.7% vs. 38.9%, P=0.32).”
§ Utility and clinical relevance of multiplex PCR panels for diagnosis of central nervous system infections > Results > Clinical relevance of positive results
“Only 41% (n=50) of positive panel results were considered clinically relevant”
Citations
Cites
Leber, A. L., Everhart, K., Balada-Llasat, J.-M., Cullison, J., Daly, J., Holt, S., Lephart, P., Salimnia, H., Schreckenberger, P. C., DesJarlais, S., et al. (2016) · Journal of Clinical Microbiology · doi:10.1128/jcm.00730-16 · Cited by 609 · cited 5×
“The overall positivity rate of multiplex panels in our cohort was comparable to that reported in previous BioFire ® FilmArray ® studies, 10,14-16 and positivity was notably higher in paediatric patients, confirming their higher diagnostic yield in children.”
InfluentialSyndromic Panel-Based Testing in Clinical Microbiology
Ramanan, P., Bryson, A. L., Binnicker, M. J., Pritt, B. S., & Patel, R. (2018) · Clinical Microbiology Reviews · doi:10.1128/cmr.00024-17 · Cited by 308
Radmard, S., Reid, S., Ciryam, P., Boubour, A., Ho, N., Zucker, J., Sayre, D., Greendyke, W. G., Miko, B. A., Pereira, M. R., et al. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00281 · Cited by 127 · cited 3×
“Streptococcus pneumoniae was the most frequently detected bacterial pathogen, consistent with previous international studies, 10,13,14,17,18 reinforcing its clinical importance despite vaccination programmes.”
Panels and syndromic testing in clinical microbiology
Dien Bard, J., & McElvania, E. (2020) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2020.08.001 · Cited by 92 · cited 1×
“1,5,6 Currently, two FDA-approved multiplex panels are widely used for the diagnosis of meningitis and encephalitis: the FilmArray Meningitis/Encephalitis (M&E) Panel (BioMérieux, France) and the QIAstat-Dx Meningitis/Encephalitis Panel (Qiagen, USA).”
Vetter, P., Schibler, M., Herrmann, J. L., & Boutolleau, D. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2019.12.013 · Cited by 64 · cited 3×
“1,5,6 Currently, two FDA-approved multiplex panels are widely used for the diagnosis of meningitis and encephalitis: the FilmArray Meningitis/Encephalitis (M&E) Panel (BioMérieux, France) and the QIAstat-Dx Meningitis/Encephalitis Panel (Qiagen, USA).”
Dumkow, L. E., Worden, L. J., & Rao, S. N. (2021) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkab245 · Cited by 57 · cited 1×
“3,4 Despite their benefits, multiplex panels are not without limitations.”
Detection of respiratory viruses using a multiplex real-time PCR assay in Germany, 2009/10
Bierbaum, S., Forster, J., Berner, R., Rücker, G., Rohde, G., Neumann-Haefelin, D., Panning, M., & CAPNETZ study group (2014) · Archives of Virology · doi:10.1007/s00705-013-1876-3 · Cited by 42 · cited 1×
“19 These variations highlight the need for critical clinical correlation, especially when low-yield or latent viral targets such as HHV-6, EBV, or parvovirus B19 are detected.”
Tarai, B., & Das, P. (2019) · Neurological Sciences · doi:10.1007/s10072-018-3584-y · Cited by 41 · cited 2×
“Streptococcus pneumoniae was the most frequently detected bacterial pathogen, consistent with previous international studies, 10,13,14,17,18 reinforcing its clinical importance despite vaccination programmes.”
Cailleaux, M., Pilmis, B., Mizrahi, A., Lourtet-Hascoet, J., Nguyen Van, J.-C., Alix, L., Couzigou, C., Vidal, B., Tattevin, P., & Le Monnier, A. (2020) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-019-03724-7 · Cited by 36
Chang, D., Okulicz, J. F., Nielsen, L. E., & White, B. K. (2018) · Military Medicine · doi:10.1093/milmed/usx025 · Cited by 30
Waldrop, G., Zucker, J., Boubour, A., Radmard, S., Green, D. A., & Thakur, K. T. (2022) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2020-0380-oa · Cited by 22 · cited 1×
“Streptococcus pneumoniae was the most frequently detected bacterial pathogen, consistent with previous international studies, 10,13,14,17,18 reinforcing its clinical importance despite vaccination programmes.”
Effective approaches to diagnostic stewardship of syndromic molecular panels
Hitchcock, M. M., Gomez, C. A., Pozdol, J., & Banaei, N. (2024) · The Journal of Applied Laboratory Medicine · doi:10.1093/jalm/jfad063 · Cited by 20 · cited 1×
“2 Compared to conventional methods, they provide several advantages: faster turnaround time, broader coverage, and reliable performance even in patients who have already received empirical antimicrobial treatment, which often reduces culture sensitivity.”
Erba, A., Franzeck, F. C., Hinic, V., Egli, A., & Osthoff, M. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1351903 · Cited by 15 · cited 3×
“13 This variation suggests that institutional practices and department-specific workflows strongly influence test utilisation.”
Abbott, A. N., & Fang, F. C. (2017) · Clinical Microbiology Newsletter · doi:10.1016/j.clinmicnews.2017.08.004 · Cited by 13 · cited 1×
“3,4 Despite their benefits, multiplex panels are not without limitations.”
Rafiei, N., Subedi, S., Harris, P. N., & Paterson, D. L. (2025) · Diagnostic Microbiology and Infectious Disease · doi:10.1016/j.diagmicrobio.2025.116823 · Cited by 13 · cited 1×
“20 These parameters could not be consistently retrieved due to incomplete retrospective documentation; however, the proportion of clinically relevant results provides an indirect measure of test impact on patient management.”
Boers, S. A., van Houdt, R., van Sorge, N. M., Groot, J., van Aarle, Y., van Bussel, M. J. A. W. M., Smit, L. F. E., Wessels, E., & Claas, E. C. J. (2024) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-024-04751-9 · Cited by 12
Ngo Nsoga, M. T., Pérez-Rodriguez, F. J., Mamin, A., L’Huillier, A. G., Cherkaoui, A., Kaiser, L., & Schibler, M. (2023) · Microbiology Spectrum · doi:10.1128/spectrum.03179-22 · Cited by 11 · cited 3×
“1,5,6 Currently, two FDA-approved multiplex panels are widely used for the diagnosis of meningitis and encephalitis: the FilmArray Meningitis/Encephalitis (M&E) Panel (BioMérieux, France) and the QIAstat-Dx Meningitis/Encephalitis Panel (Qiagen, USA).”
MERDAN, O., SAĞLIK, İ., AKSOY, F. D., ÖNAL, U., ÖZAKIN, C., HACIMUSTAFAOĞLU, M. K., ÇELEBİ, S., AĞCA, H., TEKİNSOY, M., & ENER, B. (2024) · Mikrobiyoloji Bulteni · doi:10.5578/mb.202497189 · Cited by 2 · cited 1×
“The observed trends in test utilisation reflected institutional practices, with most requests originating from paediatric and neurology departments, in line with earlier reports from Türkiye, 12 but differing from international data, where use is highest in emergency settings.”
Côrtes, L. G. F., Maldonado, M. M., Koga, P. C. M., Santiago, K. A. D. S., Fernandes, G. B. P., Maluf, M. M., & Martino, M. D. V. (2024) · Arquivos de Neuro-Psiquiatria · doi:10.1055/s-0044-1779035 · Cited by 2
Lee, Y. J., Yang, E. H., Jo, Y. H., Choi, S. H., Yoo, H. W., Cho, H. Y., Kwak, M. J., Park, S. J., Park, K. H., & Kim, Y. M. (2023) · Annals of Child Neurology · doi:10.26815/acn.2022.00388 · Cited by 1 · cited 1×
“10,15 Fluctuations observed across individual years may be partly explained by variations in hospital admission patterns and diagnostic practices during the COVID-19 pandemic, as well as inter-platform differences in analytical sensitivity, which should be considered when interpreting temporal…”
Metadata
- Authors
- Gürler, M., Karaoğlu, Ç., Yurtcu, E. E., Us, E., & Karahan, Z. C.
- Affiliations
- Ankara University (TR)
- Corresponding author
- Karahan, Zeynep Ceren
- Venue
- The Indian Journal of Medical Research
- Publisher
- Scientific Scholar
- Published
- 2026-05-16
- Volume
- 163
- Issue
- 5
- Pages
- 577-584
- ISSN
- 0971-5916 (ISSN-L)
- PMC
- PMC13235567
- OpenAlex
- W7161482248
- Semantic Scholar
- db97217e58e63244a83c0f46c90a23f513eb31e2
- Cited by
- 0
- References
- 18
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- The Indian Journal of Medical Research (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- Topics
- Health Sciences › Medicine › Infectious Diseases › Infectious Encephalopathies and Encephalitis
- Life Sciences › Immunology and Microbiology › Microbiology › Bacterial Infections and Vaccines
- Health Sciences › Medicine › Microbiology (medical) › Bacterial Identification and Susceptibility Testing
- Keywords
- multiplex PCR panels, meningitis, encephalitis, central nervous system infection, cerebrospinal fluid, diagnostic yield, clinical relevance, human herpesvirus 6, enterovirus, herpes simplex virus type 1, Streptococcus pneumoniae, CO detection, retesting, molecular diagnosis
- MeSH terms
- Adolescent, Adult, Central Nervous System Infections, Child, Child, Preschool, Encephalitis, Enterovirus, Female, Humans, Infant, Male, Meningitis, Middle Aged, Retrospective Studies, Streptococcus pneumoniae, Herpesvirus 1, Human, Multiplex Polymerase Chain Reaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.