Analysis of covariance as a remedy for demographic mismatch of research subject groups: Some sobering simulations
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Analysis of Covariance (ANCOVA) is often used in neuropsychological studies to effect ex-post-facto adjustment of performance variables amongst groups of subjects mismatched on some relevant demographic variable. This paper reviews some of the statistical assumptions underlying this usage. In an attempt to illustrate the complexities of this statistical technique, three sham studies using actual patient data are presented. These staged simulations have varying relationships between group test performance differences and levels of covariate discrepancy. The results were robust and consistent in their nature, and were held to support the wisdom of previous cautions by statisticians concerning the employment of ANCOVA to justify comparisons between incomparable groups. ANCOVA should not be used in neuropsychological research to equate groups unequal on variables such as age and education or to exert statistical control whose objective is to eliminate consideration of the covariate as an explanation for results. Finally, the report advocates by example the use of simulation to further our understanding of neuropsychological variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A paradox in the interpretation of group comparisons.
Lord, F. M. (1967) · Psychological Bulletin · doi:10.1037/h0025105 · Cited by 627
Cited by
Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders
DENNIS, M., FRANCIS, D. J., CIRINO, P. T., SCHACHAR, R., BARNES, M. A., & FLETCHER, J. M. (2009) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617709090481 · Cited by 875
“…it becomes meaningless to “adjust” the treatment effects for differences in the covariate, and ANCOVA cannot be used to control treatment assignment independent of the covariate (Adams et al., 1985 ; Evans & Anastasio, 1968 ; Lord, 1967 , 1969 ; Miller & Chapman, 2001 ; Tupper & Rosenblood, 1984 ).”
BackgroundMethodIndividual change after epilepsy surgery: Practice effects and base-rate information.
Chelune, G. J., Naugle, R. I., Lüders, H., & Sedlak, J. (1993) · Neuropsychology · doi:10.1037//0894-4105.7.1.41 · Cited by 597
Prior, A., & Gollan, T. H. (2011) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617711000580 · Cited by 509
Insensitivity of the analysis of variance to heredity-environment interaction
Wahlsten, D. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077797 · Cited by 468
Methamphetamine dependence increases risk of neuropsychological impairment in HIV infected persons
RIPPETH, J. D., HEATON, R. K., CAREY, C. L., MARCOTTE, T. D., MOORE, D. J., GONZALEZ, R., WOLFSON, T., GRANT, I., & GROUP, T. H. (2004) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617704101021 · Cited by 435
Self-citation
Metadata
- Authors
- Adams, K. M., Brown, G. G., & Grant, I.
- Venue
- Journal of Clinical and Experimental Neuropsychology
- Publisher
- Informa UK Limited
- Published
- 1985-08
- Volume
- 7
- Issue
- 4
- Pages
- 445-462
- ISSN
- 0165-0475 (ISSN-L)
- 0168-8634
- OpenAlex
- W1975491922
- Cited by
- 135
- References
- 1
- FWCI
- 3.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis of covariance as a remedy for demographic mismatch of research subject groups: Some sobering simulations. https://app.cochat.ai/papers/10.1080/01688638508401276
- The paper
- Adams, K. M., Brown, G. G., & Grant, I. (1985). Analysis of covariance as a remedy for demographic mismatch of research subject groups: Some sobering simulations. Journal of Clinical and Experimental Neuropsychology. https://doi.org/10.1080/01688638508401276
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.