Deriving Reliable Change Statistics from Test-Retest Normative Data: Comparison of Models and Mathematical Expressions
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The use of reliable change (RC) statistics to determine whether an individual has significantly improved or deteriorated on retesting is growing rapidly in clinical neuropsychology. This paper demonstrates how with only basic test-retest data and a series of simple expressions, the clinician/researcher can implement the majority of contemporary RC model(s). Though sharing a fundamental structure, RC models vary in how they derive predicted retest scores and standard error terms. Published test-retest normative data and a simple case study are presented to demonstrate how to calculate several well-known RC scores. The paper highlights the circumstances under which models will diverge in the estimation of RC. Most importantly variations in individual's performance relative to controls at initial testing, practice effects, inequality of control variability from test to retest, and degree of reliability will see systematic and predictable disagreement among models. More generally, the limitations and opportunities of RC methodology were discussed. Although a consensus on preferred model continues to be debated, the comparison of RC models in clinical samples is encouraged.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294
Pepe, M. S. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh101 · Cited by 1,276
MAASSEN, G. H. (2004) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617704106097 · Cited by 130
Cited by
Duff, K. (2012) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acr120 · Cited by 452
The robust reliability of neuropsychological measures: meta-analyses of test-retest correlations
Calamia, M., Markon, K., & Tranel, D. (2013) · The Clinical Neuropsychologist · doi:10.1080/13854046.2013.809795 · Cited by 207
Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. R., Henry, G. K., & Hart, R. P. (2010) · The Clinical Neuropsychologist · doi:10.1080/13854046.2010.526785 · Cited by 199
“These normative SRB equations can then be used to determine whether the patient's observed rate of change deviates significantly from expectation based on the change predicted from the model (see Hinton-Bayre, 2010 , for a systematic explication of the calculations and implications of using different SRB models).”
MethodBHA-CS: A novel cognitive composite for Alzheimer's disease and related disorders
Tsoy, E., Erlhoff, S. J., Goode, C. A., Dorsman, K. A., Kanjanapong, S., Lindbergh, C. A., La Joie, R., Strom, A., Rabinovici, G. D., Lanata, S. C., et al. (2020) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12042 · Cited by 38
Hammers, D. B., Suhrie, K. R., Dixon, A., Porter, S., & Duff, K. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acz076 · Cited by 12
Metadata
- Authors
- Hinton-Bayre, A. D.
- Venue
- Archives of Clinical Neuropsychology
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-03-02
- Volume
- 25
- Issue
- 3
- Pages
- 244-256
- ISSN
- 0887-6177 (ISSN-L)
- 1873-5843
- OpenAlex
- W2164375333
- Cited by
- 101
- References
- 4
- FWCI
- 7.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.