CoChat
Sign Up
Cited by 12Dementia and Cognitive Impairment ResearchPsychological Testing and AssessmentHistorical and Modern Theater Studies

Reliable change in cognition over 1 week in community-dwelling older adults: a validation and extension study

Open access
Hammers, Dustin B, Suhrie, Kayla R, Dixon, Ava, Porter, Sariah, Duff, Kevin·2021·Archives of Clinical Neuropsychology
DOI 10.1093/arclin/acz076PMC PMC8245079
Open this paper in CoChat — free accountOpen PDF

Abstract

Objective: Reliable change methods can aid neuropsychologists in understanding if performance differences over time represent clinically meaningful change or reflect benefit from practice. The current study sought to externally validate the previously published standardized regression-based (SRB) prediction equations developed by Duff for commonly administered cognitive measures. Method: This study applied Duff’s SRB prediction equations to an independent sample of community-dwelling participants with amnestic mild cognitive impairment (MCI) assessed twice over a 1-week period. A comparison of MCI subgroups (e.g., single v. multi domain) on the amount of change observed over 1 week was also examined. Results: Using pairwise t-tests, large and statistically significant improvements were observed on most measures across 1 week. However, the observed follow-up scores were consistently below expectation compared with predictions based on Duff’s SRB algorithms. In individual analyses, a greater percentage of MCI participants showed smaller-than-expected practice effects based on normal distributions. In secondary analyses, smaller-than-expected practice effects were observed in participants with worse baseline memory impairment and a greater number of impaired cognitive domains, particularly for measures of executive functioning/speeded processing. Conclusions: These findings help to further support the validity of Duff’s 1-week SRB prediction equations in MCI samples and extend previous research by showing incrementally smaller-than-expected benefit from practice for increasingly impaired amnestic MCI subtypes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/arclin/acz076

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 39

  1. Attix, D. K., Story, T. J., Chelune, G. J., Ball, J. D., Stutts, M. L., Hart, R. P., et al. (2009). The prediction of change: Normative neuropsychological trajectories. The Clinical Neuropsychologist, 23(1), 21-38. doi: 10.1080/13854040801945078. · DOI
  2. van Britt, W. G.,. 3rd, Hansen, A. M., Bhaskerrao, S., Larsen, J. P., Petersen, F., Dickson, A., et al. (2011). Mild cognitive impairment: Prodromal Alzheimer's disease or something else? Journal of Alzheimer's Disease, 27(3), 543-551. doi: 10.3233/JAD-2011-110740. · DOI
  3. Calamia, M., Markon, K., & Tranel, D. (2012). Scoring higher the second time around: Meta-analyses of practice effects in neuropsychological assessment. The Clinical Neuropsychologist, 26(4), 543-570.
  4. Chelune, G. (2003). Assessing reliable neuropsychological change. In Franklin, R. (Ed.), Prediction in forensic and neuropsychology: New approaches to psychometrically sound assessment. Nahwah, NJ: Erlbaum.
  5. Cooper, D. B., Lacritz, L. H., Weiner, M. F., Rosenberg, R. N., & Cullum, C. M. (2004). Category fluency in mild cognitive impairment: Reduced effect of practice in test-retest conditions. Alzheimer Disease and Associated Disorders, 18(3), 120-122.
  6. Crockford, C., Newton, J., Lonergan, K., Madden, C., Mays, I., O'Sullivan, M., et al. (2018). Measuring reliable change in cognition using the Edinburgh cognitive and behavioural ALS screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener, 19(1-2), 65-73. doi: 10.1080/21678421.2017.1407794. · DOI
  7. Darby, D., Maruff, P., Collie, A., & McStephen, M. (2002). Mild cognitive impairment can be detected by multiple assessments in a single day. Neurology, 59(7), 1042-1046.
  8. Duff, K. (2014). One-week practice effects in older adults: Tools for assessing cognitive change. The Clinical Neuropsychologist, 28(5), 714-725. doi: 10.1080/13854046.2014.920923. · DOI
  9. Duff, K., Anderson, J. S., Mallik, A. K., Suhrie, K. R., Atkinson, T. J., Dalley, B. C. A., et al. (2018). Short-term repeat cognitive testing and its relationship to hippocampal volumes in older adults. Journal of Clinical Neuroscience, 57, 121-125. doi: 10.1016/j.jocn.2018.08.015. · DOI
  10. Duff, K., Atkinson, T. J., Suhrie, K. R., Dalley, B. C., Schaefer, S. Y., & Hammers, D. B. (2017). Short-term practice effects in mild cognitive impairment: Evaluating different methods of change. Journal of Clinical and Experimental Neuropsychology, 39(4), 396-407. doi: 10.1080/13803395.2016.1230596. · DOI
  11. Duff, K., Beglinger, L. J., Moser, D. J., & Paulsen, J. S. (2010a). Predicting cognitive change within domains. The Clinical Neuropsychologist, 24(5), 779-792. doi: 10.1080/13854041003627795. · DOI
  12. Duff, K., Beglinger, L. J., Moser, D. J., Schultz, S. K., & Paulsen, J. S. (2010b). Practice effects and outcome of cognitive training: Preliminary evidence from a memory training course. The American Journal of Geriatric Psychiatry, 18(1), 91.
  13. Duff, K., Beglinger, L. J., Schultz, S. K., Moser, D. J., McCaffrey, R. J., & Haase, R. F. (2007). Huntington's Study Group, Practice effects in the prediction of long-term cognitive outcome in three patient samples: A novel prognostic index. Archives of Clinical Neuropsychology, 22(1), 15-24. doi: 10.1016/j.acn.2006.08.013. · DOI
  14. Duff, K., Beglinger, L. J., Van Der, S., Moser, D. J., Arndt, S., Schultz, S. K., et al. (2008). Short-term practice effects in amnestic mild cognitive impairment: Implications for diagnosis and treatment. International Psychogeriatrics, 20(5), 986-999. doi: 10.1017/S1041610208007254. · DOI
  15. Duff, K., Foster, N. L., & Hoffman, J. M. (2014). Practice effects and amyloid deposition: Preliminary data on a method for enriching samples in clinical trials. Alzheimer Disease and Associated Disorders, 28(3), 247-252. doi: 10.1097/WAD.0000000000000021. · DOI
  16. Duff, K., Horn, K. P., Foster, N. L., & Hoffman, J. M. (2015). Short-term practice effects and brain hypometabolism: Preliminary data from an FDG PET study. Archives of Clinical Neuropsychology, 30(3), 264-270. doi: 10.1093/arclin/acv018. · DOI
  17. Duff, K., Schoenberg, M. R., Patton, D., Mold, J., Scott, J. G., & Adams, R. L. (2004). Predicting change with the RBANS in a community dwelling elderly sample. Journal of the International Neuropsychological Society, 10(6), 828-834.
  18. Duff, K., Schoenberg, M. R., Patton, D., Paulsen, J. S., Bayless, J. D., Mold, J., et al. (2005). Regression-based formulas for predicting change in RBANS subtests with older adults. Archives of Clinical Neuropsychology, 20(3), 281-290. doi: 10.1016/j.acn.2004.07.007. · DOI
  19. Duff, K., Suhrie, K. R., Dalley, B. C. A., Anderson, J. S., & Hoffman, J. M. (2019). External validation of change formulae in neuropsychology with neuroimaging biomarkers: A methodological recommendation and preliminary clinical data. The Clinical Neuropsychologist, 33(3), 478-489. doi: 10.1080/13854046.2018.1484518. · DOI
  20. Faber, J., & Fonseca, L. M. (2014). How sample size influences research outcomes. Dental Press Journal of Orthodontics, 19(4), 27-29.
  21. Galvin, J. E., Powlishta, K. K., Wilkins, K., McKeel, D. W., Jr., Xiong, C., Grant, E., et al. (2005). Predictors of preclinical Alzheimer disease and dementia: A clinicopathologic study. Archives of Neurology, 62(5), 758-765. doi: 10.1001/archneur.62.5.758. · DOI · Paper page
  22. Gavett, B. E., Ashendorf, L., & Gurnani, A. S. (2015). Reliable change on neuropsychological tests in the uniform data set. Journal of the International Neuropsychological Society, 21(7), 558-567. doi: 10.1017/S1355617715000582. · DOI
  23. Gavett, B. E., Gurnani, A. S., Saurman, J. L., Chapman, K. R., Steinberg, E. G., Martin, B., et al. (2016). Practice effects on story memory and list learning tests in the neuropsychological assessment of older adults. PLoS One, 11(10), e0164492. doi: 10.1371/journal.pone.0164492. · DOI
  24. Hammers, D., Duff, K., & Chelune, G. (2015). Assessing change of cognitive trajectories over time in later life. In Pachana, N. A., & Laidlaw, K. (Eds.), Oxford handbook of clinical geropsychology. Oxford, England: Oxford University Press.
  25. Hassenstab, J., Ruvolo, D., Jasielec, M., Xiong, C., Grant, E., & Morris, J. C. (2015). Absence of practice effects in preclinical Alzheimer's disease. Neuropsychology, 29(6), 940-948. doi: 10.1037/neu0000208. · DOI
  26. Hinton-Bayre, A. D. (2010). Deriving reliable change statistics from test-retest normative data: Comparison of models and mathematical expressions. Archives of Clinical Neuropsychology, 25(3), 244-256. doi: 10.1093/arclin/acq008. · DOI
  27. Lezak, M., Howieson, D., Bigler, E., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). New York: Oxford University Press.
  28. Machulda, M. M., Pankratz, V. S., Christianson, T. J., Ivnik, R. J., Mielke, M. M., Roberts, R. O., et al. (2013). Practice effects and longitudinal cognitive change in normal aging vs. incident mild cognitive impairment and dementia in the Mayo clinic study of aging. The Clinical Neuropsychologist, 27(8), 1247-1264. doi: 10.1080/13854046.2013.836567. · DOI
  29. Mathews, M., Abner, E., Kryscio, R., Jicha, G., Cooper, G., Smith, C., et al. (2014). Diagnostic accuracy and practice effects in the national Alzheimer's coordinating center uniform data set neuropsychological battery. Alzheimers Dement, 10(6), 675-683. doi: 10.1016/j.jalz.2013.11.007. · DOI
  30. Mormino, E. C., Betensky, R. A., Hedden, T., Schultz, A. P., Amariglio, R. E., Rentz, D. M., et al. (2014). Synergistic effect of beta-amyloid and neurodegeneration on cognitive decline in clinically normal individuals. JAMA Neurology, 71(11), 1379-1385. doi: 10.1001/jamaneurol.2014.2031. · DOI · Paper page
  31. Rapport, L. J., Axelrod, B. N., Theisen, M. E., Brines, D. B., Kalechstein, A. D., & Ricker, J. H. (1997a). Relationship of IQ to verbal learning and memory: Test and retest. Journal of Clinical and Experimental Neuropsychology, 19(5), 655-666. doi: 10.1080/01688639708403751. · DOI
  32. Rapport, L. J., Brines, D., Axelrod, B., & Theisen, M. E. (1997b). Full scale IQ as mediator of practice effects: The rich get richer. The Clinical Neuropsychologist, 11(4), 375-380.
  33. Rinehardt, E., Duff, K., Schoenberg, M., Mattingly, M., Bharucha, K., & Scott, J. (2010). Cognitive change on the repeatable battery of neuropsychological status (RBANS) in Parkinson's disease with and without bilateral subthalamic nucleus deep brain stimulation surgery. The Clinical Neuropsychologist, 24(8), 1339-1354. doi: 10.1080/13854046.2010.521770. · DOI
  34. Sanchez-Benavides, G., Pena-Casanova, J., Casals-Coll, M., Gramunt, N., Manero, R. M., Puig-Pijoan, A., et al. (2016). One-year reference norms of cognitive change in Spanish old adults: Data from the NEURONORMA sample. Archives of Clinical Neuropsychology, 31(4), 378-388. doi: 10.1093/arclin/acw018. · DOI
  35. Schrijnemaekers, A. M., de Jager, C. A., Hogervorst, E., & Budge, M. M. (2006). Cases with mild cognitive impairment and Alzheimer's disease fail to benefit from repeated exposure to episodic memory tests as compared with controls. Journal of Clinical and Experimental Neuropsychology, 28(3), 438-455. doi: 10.1080/13803390590935462. · DOI
  36. Stein, J., Luppa, M., Brahler, E., Konig, H. H., & Riedel-Heller, S. G. (2010). The assessment of changes in cognitive functioning: Reliable change indices for neuropsychological instruments in the elderly -a systematic review. Dementia and Geriatric Cognitive Disorders, 29(3), 275-286. doi: 10.1159/000289779. · DOI · Paper page
  37. Suchy, Y., Kraybill, M. L., & Franchow, E. (2011). Practice effect and beyond: Reaction to novelty as an independent predictor of cognitive decline among older adults. Journal of the International Neuropsychological Society, 17(1), 101-111. doi: 10.1017/S135561771000130X. · DOI
  38. Thorgusen, S. R., Suchy, Y., Chelune, G. J., & Baucom, B. R. (2016). Neuropsychological practice effects in the context of cognitive decline: Contributions from learning and task novelty. Journal of the International Neuropsychological Society, 22(4), 453-466. doi: 10.1017/S1355617715001332. · DOI
  39. Yan, J. H., & Dick, M. B. (2006). Practice effects on motor control in healthy seniors and patients with mild cognitive impairment and Alzheimer's disease. Neuropsychology, Development, and Cognition. Section B, Aging, Neuropsychology and Cognition, 13(3-4), 385-410. doi: 10.1080/138255890969609. · DOI

Cited by

Sorted by citations

Authors
Hammers, D. B., Suhrie, K. R., Dixon, A., Porter, S., & Duff, K.
Affiliations
University of Utah (US)
Corresponding author
Hammers, Dustin B
ORCID
Venue
Archives of Clinical Neuropsychology
Publisher
Oxford University Press (OUP)
Published
2020-02-06
Volume
36
Issue
3
Pages
347-358
ISSN
  • 0887-6177 (ISSN-L)
  • 1873-5843
DOI
10.1093/arclin/acz076
PMC
PMC8245079
OpenAlex
W3005370886
Cited by
12
References
1
Citations by year
2026: 1 · 2024: 3 · 2023: 1 · 2022: 2 · 2021: 1 · 2020: 4
FWCI
1.39
Type
journal article
Language
en
Open access
Licence
public-domain
Locations
  • Archives of Clinical Neuropsychology (publishedVersion, public-domain)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • IUScholarWorks (Indiana University) (submittedVersion, public-domain)
Funders
National Institute on Aging (5R01AG045163)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
  • Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords
reliable change, practice effects, amnestic mild cognitive impairment, memory impairment, executive function, processing speed, community-dwelling older adults
MeSH terms
Aged, Cognition, Humans, Neuropsychological Tests, Executive Function, Independent Living, Cognitive Dysfunction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review