Cited by 48Reading and Literacy DevelopmentInfant Development and Preterm CareLanguage Development and Disorders

Validation of a Developmental Neuropsychological Assessment (NEPSY) through comparison of neurological, scholastic concerns, and control groups

Open access
SCHMITT, A·2004·Archives of Clinical Neuropsychology

Abstract

Validity of the standard, 13 subtest A Developmental Neuropsychological Assessment (NEPSY) was investigated by comparing scores for 30 children with neurological conditions, 35 children with scholastic concerns, and 39 controls. Overall differences were found among the groups with and without controlling for IQ (Lambda = .60, Lambda = .001; Lambda = .70, P < .001). Four of five NEPSY domain scores differed among the three groups. Language and Sensorimotor domain score differences were found even when IQ was controlled, and group status accounted for substantial variance in these domain scores. Regarding specific tasks, Phonological Processing and Fingertip Tapping were among the subtests that varied the most between groups, especially when children with scholastic concerns were compared with controls. Findings offer preliminary support for the validity of several NEPSY indexes.

Integrity signals

Registry

Crossref · 10.1016/j.acn.2004.02.002

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

47 tests recomputed · 0 with the reported and recomputed p on opposite sides of .05

Claims the paper makes

0 of 28 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Overall NEPSY domain scores differed among the three groups (neurological, scholastic concerns, and controls) in a one-way MANOVA, Wilks' Λ = .60, F(10, 194) = 5.69, P < .001.

    “A significant group effect was indicated at the .05level (Wilks' Λ = .60,F(10, 194) = 5.69, P < .001)documenting overall NEPSY differences among the groups”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • Findingown data

    In post hoc analyses, the neurological group performed poorer than controls on the Language domain (P = .005).

    “With respect to the Language domain, the neurological group performed poorer than the controls, P = .005”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • Findingown data

    In post hoc analyses, the neurological group performed poorer than controls on the Attention/Executive Function domain (P = .01).

    “Regarding the Attention/Executive Function domain, only the neurological group performed poorer than the controls, P = .01.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • Findingown data

    Four of five NEPSY domain scores differed among the three groups: Attention/Executive Function, Language, Memory and Learning, and Sensorimotor.

    “Four of five NEPSY domain scores differed among the three groups.”
    • Also stated in: § 2. Results · plain
      “The following four domain scores were found to contribute to the significant multivariate result: Attention/Executive Function, F(2, 101) = 4.59, P = .01;Language, F(2, 101) = 11.95,P < .001;Memory and Learning, F(2, 101) = 4.72, P = .01;and Sensorimotor, F(2, 101) = 19.44,P < .001.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • Findingown data

    In post hoc analyses, the scholastic concerns group performed poorer than controls on the Language domain (P < .001).

    “and the scholastic concerns group performed poorer than controls, P < .001.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • May combine two claims. 9
  • The quote only partly states this claim. 1
  • Classified as probably not a substantial claim. 15
  • May combine two claims.

    Findingown data

    Memory and Learning domain composite scores differed between children from the scholastic concerns and control groups only, and these differences were no longer found when IQ was controlled.

    “Memory and Learning domain composite scores differed between children from the scholastic concerns and control groups only, and these differences were no longer found when IQ was controlled.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Large differences were found on the Language domain and on the Phonological Processing and Speeded Naming subtests in control versus scholastic concerns group comparisons.

    “Most striking, however, were the large differences found on the Language domain and on the Phonological Processing and Speeded Naming subtests in control versus scholastic concerns group comparisons.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    29% of the variance in Phonological Processing subtest scores was explained by group membership when IQ was not considered and 19% when IQ was considered.

    “For example, 29% of the variance in the Phonological Processing subtest scores was explained by group membership when IQ was not considered and 19% when IQ was considered.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Both Phonological Processing and Speeded Naming proved harder for the scholastic concerns group than the neurological group.

    “Both tasks proved harder for the scholastic concerns than the neurological group.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    For the Attention/Executive domain, differences were found only between children with neurological conditions and controls, and these disappeared if IQ was covaried.

    “For the Attention/Executive domain, differences were found only between children with neurological conditions and controls, and these disappeared if IQ was covaried.”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    When controlling for FSIQ, the neurological group performed poorer than controls on Fingertip Tapping and Imitating Hand Positions subtests.

    “The following Sensorimotor subtests were found to significantly contribute to the multivariate result via follow-up ANCOVAs: Fingertip Tapping, F(1, 66) = 5.29, P = .03and Imitating Hand Positions, F(1, 66) = 5.46, P = .02.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEPSY standardization sample control group is free of neurological and scholastic concerns.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    A literature search concerning the English language NEPSY revealed only five studies.

    “A literature search concerning the English language NEPSY revealed only five studies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The NEPSY is promoted as both a neuropsychological and a developmental instrument.

    “Because the NEPSY is promoted as both a neuropsychological and a developmental instrument (Korkman, Kirk, et al., 1998), it was deemed essential that this study use both criterion groups of children with documented neurological and developmental (school failure) conditions, as contrasted with control subjects.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Korkman, Kirk, et al., 1998

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    When associations between academic skills and sensorimotor deficits have been established, they appear to relate to motor timing control rather than to NEPSY-related variables of motor speed and dexterity.

    “When associations between academic skills and sensorimotor deficits have been established, they appear to relate to motor timing control rather than to NEPSY-related variables of motor speed and dexterity (Waber et al.).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Waber et al.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Developmental linguistic deficits, including general verbal delays and specific phonological deficits, are linked to classroom failure, especially in reading.

    “the findings concur with the extensive literature linking developmental linguistic deficits (including general verbal delays and specific phonological deficits) to classroom failure, especially in reading”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Catts, 1993

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Catts, 1996 source
    • cites Joanisse, Manis, Keating, & Seidenberg, 2000 source
  • Classified as probably not a substantial claim.

    Premisecitation

    The literature links memory deficits and diverse pediatric conditions.

    “the abundant literature linking memory deficits and diverse pediatric conditions (e.g., traumatic brain injury, Woodward & Donders, 1998;Yeates, Blumenstein, Patterson, & Dellis, 1995; sickle cell disease, Kral, Brown, & Hynd, 2001;epilepsy, Cohen, 1992;Seidenberg et al., 1997;acute lymphoblastic leukemia, Waber & Mullenix, 2000).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Woodward & Donders, 1998 source
    • cites Kral, Brown, & Hynd, 2001 source
    • cites Cohen, 1992 source
  • Classified as probably not a substantial claim.

    Premisecitation

    The NEPSY authors explicitly state that their instrument is suitable to assess children who present with either scholastic or neurological problems.

    “The scholastic concerns group was deemed an important source of comparison in that the NEPSY's authors explicitly state that their instrument is suitable to assess children who present with either scholastic or neurological problems.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The multivariate normality assumption was established via Box's Test of Equality of Covariance Matrices in all multivariate analyses.

    “The multivariate normality assumption was established via Box's Test of Equality of Covariance Matrices in all multivariate analyses discussed in this section.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Standard neuropsychological batteries almost universally afford prominent roles to motor tasks.

    “standard neuropsychological batteries almost universally afford prominent roles to motor tasks (e.g., Halstead Reitan Neuropsychological Battery for Older Children, Reitan & Wolfson, 1992; Luria-Nebraska Neuropsychological Battery: Children's Revision, Golden, 1987).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Reitan & Wolfson, 1992

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Golden, 1987

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The finding of group differences is arguably a necessary, but not sufficient, criterion for the NEPSY's validation in clinical use.

    “This finding is arguably a necessary, but not sufficient, criterion for the NEPSY's validation in clinical use.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The children in the neurological and scholastic concerns groups are representative of children with those conditions in the broader clinical population.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There is limited literature concerning tests of manual dexterity and school learning difficulties.

    “There is limited literature concerning tests of manual dexterity and school learning difficulties (see Rosselli, Ardila, Bateman, & Guzman, 2001;Waber et al., 2000).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Rosselli, Ardila, Bateman, & Guzman, 2001 source
    • cites Waber et al., 2000 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The practice of using a heterogeneous neurological group for test validation has been used elsewhere.

    “The practice of using a heterogeneous neurological group for test validation has been used elsewhere (e.g., Reitan & Wolfson, 2002).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reitan & Wolfson, 2002 source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    NEPSY Sensorimotor tasks rely upon a portable kit only and do not necessitate laboratory equipment.

    “Additionally, NEPSY Sensorimotor tasks rely upon a portable kit only and do not necessitate laboratory equipment, such as is needed for the Finger Tapping Test (Reitan & Wolfson, 1992) or the Grooved Pegboard Test (Matthews & Kløve, 1964).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Reitan & Wolfson, 1992

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Matthews & Kløve, 1964

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The NEPSY Design Copying subtest is analogous to the Bender Gestalt and the Visual-Motor Integration Test.

    “the NEPSY Design Copying subtest is analogous to the Bender Gestalt (Bender, 1946) and the Visual-Motor Integration Test (Beery, 1982)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Bender, 1946

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Beery, 1982

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationown data

    The large variance in NEPSY Sensorimotor domain scores explained by membership in either the scholastic concerns versus control group speaks to the test's potential validity and the prospective importance of this class of skills in understanding children's development.

    “The fact that so much variance in NEPSY Sensorimotor domain scores was explained by membership in either the scholastic concerns versus control group (especially in light of the fact that the former group was relatively heterogeneous), speaks both to the test's potential validity and the prospective importance of this class of skills in understanding children's development.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    This basic NEPSY validity study comparing two clinical groups with randomly selected children from a control group implies promise.

    “This basic NEPSY validity study comparing two clinical groups with randomly selected children from a control group implies promise.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    At the content level, language and motor tasks of the NEPSY are missing from the WISC-III and some have direct educational implications.

    “At the content level, these types of language and motor tasks are missing from the WISC-III and some of them have direct educational implications (see Berninger & Richards, 2002;Flanagan, 2000).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Berninger & Richards, 2002

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Flanagan, 2000 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Surveys have suggested that only Wechsler IQ scales are more commonly used than the Bender Gestalt in school-based evaluations.

    “Surveys have suggested that only Wechsler IQ scales are more commonly used than the Bender Gestalt in school-based evaluations (Wilson & Reschly, 1996).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wilson & Reschly, 1996 source
23 of 23
  • The paper relies on this without support.

    The children in the neurological and scholastic concerns groups are representative of children with those conditions in the broader clinical population.

    “We thus studied consecutive clinic referrals from neurology and neurosurgery clinics, each of whom had an established neurological diagnosis.”
  • The paper relies on this without support.

    The NEPSY standardization sample control group is free of neurological and scholastic concerns.

    “Normal controls consisted of randomly selected individuals from the standardization sample of the NEPSY.”
  • The authors state this as an assumption.

    Group IQ differences in this study include verbal ability differences.

    “Once group IQ differences were accounted for in our study, which presumably includes verbal ability differences,”
  • The paper relies on this without support.

    Diagnosticians are likely to supplement, rather than replace, Wechsler IQ tests with other tests.

    “Clinical experience suggests that diagnosticians are likely to supplement, rather than replace, the Wechsler IQ tests; the current study offers at least some empirical backing for this practice.”
4 of 4

Statistics that don’t add up

Each reported p-value recomputed from its test statistic and degrees of freedom.

  • Inconsistent p-value: F(1, 66) = 5.29, p = .03

    Minor

    The paper reports p = .03 here; recomputing from the test statistic and its degrees of freedom gives p = .025. The check cannot tell whether the statistic or the p-value is the misprint.

    Reported p = .03 · recomputed p = .025

1 of 1

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Doesn’t add upF(1, 66) = 5.29reported p = .03 · recomputed p = .025

    “F(1, 66) = 5.29, p = .03”

  • ConsistentF(10, 194) = 5.69reported p < .001 · recomputed p < .001

    “F(10, 194) = 5.69, p < .001”

  • ConsistentF(2, 101) = 4.59reported p = .01 · recomputed p = .012

    “F(2, 101) = 4.59, p = .01”

  • ConsistentF(2, 101) = 11.95reported p < .001 · recomputed p < .001

    “F(2, 101) = 11.95,p < .001”

  • ConsistentF(2, 101) = 4.72reported p = .01 · recomputed p = .011

    “F(2, 101) = 4.72, p = .01”

  • ConsistentF(2, 101) = 19.44reported p < .001 · recomputed p < .001

    “F(2, 101) = 19.44,p < .001”

  • ConsistentF(3, 65) = 2.72reported p = .05 · recomputed p = .052

    “F(3, 65) = 2.72, p = .05”

  • ConsistentF(1, 67) = 4.5reported p = .04 · recomputed p = .038

    “F(1, 67) = 4.50, p = .04”

  • ConsistentF(1, 67) = 5.33reported p = .02 · recomputed p = .024

    “F(1, 67) = 5.33, p = .02”

  • ConsistentF(3, 65) = 4.5reported p = .006 · recomputed p = .006

    “F(3, 65) = 4.50, p = .006”

  • ConsistentF(1, 67) = 4.28reported p = .04 · recomputed p = .042

    “F(1, 67) = 4.28, p = .04”

  • ConsistentF(1, 67) = 13.3reported p = .001 · recomputed p < .001

    “F(1, 67) = 13.30,p = .001”

  • ConsistentF(1, 67) = 6.37reported p = .01 · recomputed p = .014

    “F(1, 67) = 6.37,p = .01”

  • ConsistentF(3, 70) = 10.54reported p < .001 · recomputed p < .001

    “F(3, 70) = 10.54,p < .001”

  • ConsistentF(1, 72) = 8.13reported p = .006 · recomputed p = .006

    “F(1, 72) = 8.13, p = .006”

  • ConsistentF(1, 72) = 29.94reported p < .001 · recomputed p < .001

    “F(1, 72) = 29.94,p < .001”

  • ConsistentF(1, 72) = 13.73reported p < .001 · recomputed p < .001

    “F(1, 72) = 13.73,p < .001”

  • ConsistentF(3, 70) = 6.35reported p = .001 · recomputed p < .001

    “F(3, 70) = 6.35,p = .001”

  • ConsistentF(1, 72) = 15.89reported p < .001 · recomputed p < .001

    “F(1, 72) = 15.89,p < .001”

  • ConsistentF(1, 72) = 6.88reported p = .01 · recomputed p = .011

    “F(1, 72) = 6.88,p = .01”

  • ConsistentF(3, 65) = 8.05reported p < .001 · recomputed p < .001

    “F(3, 65) = 8.05, p < .001”

  • ConsistentF(3, 70) = 10.01reported p < .001 · recomputed p < .001

    “F(3, 70) = 10.01,p < .001”

  • ConsistentF(1, 67) = 12.2reported p = .001 · recomputed p < .001

    “F(1, 67) = 12.20, p = .001”

  • ConsistentF(1, 67) = 12.52reported p = .001 · recomputed p < .001

    “F(1, 67) = 12.52, p = .001”

  • ConsistentF(1, 67) = 12.66reported p = .001 · recomputed p < .001

    “F(1, 67) = 12.66, p = .001”

  • ConsistentF(1, 72) = 18.64reported p < .001 · recomputed p < .001

    “F(1, 72) = 18.64,p < .001”

  • ConsistentF(1, 72) = 14.82reported p < .001 · recomputed p < .001

    “F(1, 72) = 14.82,p < .001”

  • ConsistentF(1, 72) = 11.23reported p = .001 · recomputed p = .001

    “F(1, 72) = 11.23,p = .001”

  • ConsistentF(10, 192) = 3.82reported p < .001 · recomputed p < .001

    “F(10, 192) = 3.82, p < .001”

  • ConsistentF(2, 100) = 6.56reported p = .002 · recomputed p = .002

    “F(2, 100) = 6.56,p = .002”

  • ConsistentF(2, 100) = 11.05reported p < .001 · recomputed p < .001

    “F(2, 100) = 11.05,p < .001”

  • ConsistentF(1, 100) = 8.66reported p = .004 · recomputed p = .004

    “F(1, 100) = 8.66, p = .004”

  • ConsistentF(1, 100) = 10.03reported p = .002 · recomputed p = .002

    “F(1, 100) = 10.03,p = .002”

  • ConsistentF(1, 100) = 12.75reported p = .001 · recomputed p < .001

    “F(1, 100) = 12.75, p = .001”

  • ConsistentF(1, 100) = 19.94reported p < .001 · recomputed p < .001

    “F(1, 100) = 19.94,p < .001”

  • ConsistentF(3, 60) = 2.84reported p = .05 · recomputed p = .045

    “F(3, 60) = 2.84, p = .05”

  • ConsistentF(1, 62) = 6.89reported p = .01 · recomputed p = .011

    “F(1, 62) = 6.89,p = .01”

  • ConsistentF(1, 62) = 3.86reported p = .05 · recomputed p = .054

    “F(1, 62) = 3.86, p = .05”

  • ConsistentF(3, 69) = 5.77reported p = .001 · recomputed p = .001

    “F(3, 69) = 5.77, p = .001”

  • ConsistentF(1, 71) = 16.53reported p < .001 · recomputed p < .001

    “F(1, 71) = 16.53,p < .001”

  • ConsistentF(1, 71) = 4.56reported p = .04 · recomputed p = .036

    “F(1, 71) = 4.56, p = .04”

  • ConsistentF(3, 64) = 3.23reported p = .03 · recomputed p = .028

    “F(3, 64) = 3.23, p = .03”

  • ConsistentF(1, 66) = 5.46reported p = .02 · recomputed p = .023

    “F(1, 66) = 5.46, p = .02”

  • ConsistentF(3, 69) = 6.36reported p = .001 · recomputed p < .001

    “F(3, 69) = 6.36,p = .001”

  • ConsistentF(1, 71) = 10.64reported p = .002 · recomputed p = .002

    “F(1, 71) = 10.64,p = .002”

  • ConsistentF(1, 71) = 9.94reported p = .002 · recomputed p = .002

    “F(1, 71) = 9.94, p = .002”

  • ConsistentF(1, 71) = 6.37reported p = .01 · recomputed p = .014

    “F(1, 71) = 6.37,p = .01”

47 of 47

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Standard-battery subtest count conflicts

    Minor

    The abstract calls the standard battery a 13-subtest assessment, but the Methods section says it includes 14 subtests. The subtests listed there also total 14.

1 of 1

Cites

Flagged first, then by citations

4 of the 59 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

  1. [5]5. Beery, K. E. (1982). Revised administration, scoring, and teaching manual for the Developmental Test of Visual-Motor Integration. Cleveland, OH: Modern Curriculum Press.
  2. [49]49. Wechsler, D. (1991). Wechsler Intelligence Scales for Children (3rd ed.). San Antonio: The Psychological Corpo- ration.
  3. [50]50. Wechsler, D. (2003). Wechsler Intelligence Scales for Children (4th ed.). San Antonio: The Psychological Corpo- ration.

Cited by

Sorted by citations

Authors
SCHMITT, A.
Affiliations
Phoenix Children's Hospital (US)
Corresponding author
SCHMITT, A
Venue
Archives of Clinical Neuropsychology
Published
2004-12
Volume
19
Issue
8
Pages
1077-1093
ISSN
0887-6177 (ISSN-L)
OpenAlex
W2119829662
Cited by
48
References
59
Citations by year
2026: 1 · 2025: 2 · 2024: 5 · 2023: 1 · 2022: 3 · 2021: 4 · 2017: 3 · 2016: 1 · 2015: 1 · 2014: 5 · 2013: 1 · 2012: 3
FWCI
2.21
Type
journal article
Language
en
Open access
Locations
  • Archives of Clinical Neuropsychology (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
  • Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Infant Development and Preterm Care
  • Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
Keywords
NEPSY, test validity, neurologically impaired children, language domains, phonological processing, neuropsychological assessment
MeSH terms
Achievement, Child, Female, Humans, Language Disorders, Male, Neuropsychological Tests

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review