Minimal Clinically Important Difference of Executive Function Performance in Older Adults Who Fall: A Secondary Analysis of a Randomized Controlled Trial
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Introduction: Executive function is responsive to exercise and predictive of subsequent falls. Minimal clinically important differences (MCIDs) are critical for understanding whether observed changes are meaningful. However, MCIDs of many cognitive measures are not established. We aimed to determine MCIDs of the Digit Symbol Substitution Test ([DSST] processing speed measure), Stroop (inhibition measure), and Trail Making Test B-A (TMT; set-shifting measure), using anchor- and distribution-based approaches in older adults who have fallen and received the Otago Exercise Program (OEP) relative to usual care only (CON). Our secondary aim was to establish construct (convergent and divergent) validity of these measures. Methods: Complete case analyses of cognitive outcomes (DSST, Stroop, TMT, and Montreal Cognitive Assessment [MoCA]) were acquired at baseline and 1 year (NCT01029171; NCT003235960); participants were randomized to the OEP (n = 114/172; Age: 80.6 ± 6.1 years; 64.9% Female) or CON (n = 128/172; Age: 82.3 ± 5.8 years; 71.9% Female)]. The MoCA was used as the anchor. We estimated MCIDs using anchor- and distribution-based approaches. Anchor-based executive function change differences ([CD] 1 year minus baseline) observed in participants with meaningful changes in the MoCA (≥3 or ≤ −3 points) receiving the OEP were subtracted from the CON. An anchor-based receiver operator characteristic (ROC) curve was employed to identify optimal cut-off scores of the 3 executive function measures. The distribution-based approach (DA) accounted for variability in baseline and follow-up data. MCID ranges were estimated using these approaches. We used Spearman’s correlations to explore convergent validity between executive function measures and other measures involving the same construct (DSST, Stroop, TMT, MoCA, and Mini-Mental State Examination), and divergent validity between executive function measures and variables reflecting different constructs (Geriatric Depression Scale, Instrumental Activities of Daily Living, sex, and body mass index). Results: Based on the 3 approaches, MCID improvement ranges were 3–5 symbols for the DSST (CD = 5; ROC = 2.5; DA = 3.3 symbols), and −11.5 to −26.0 s for the Stroop (CD = −26.0; ROC = −11.5; DA = −20.6 s). MCID decline ranges were −3 to −6 symbols for the DSST (CD = −5.2; ROC = −2.5; DA = −3.3 symbols) and 5.4–30.6 s for the Stroop (CD = 30.6; ROC = 5.4; DA = 20.6 s). MCIDs for the TMT were not meaningful due to high variability (Improvement: CD = −106.6; ROC = −18.4; DA = −69.1 s; Decline: CD = 69.1; ROC = 14.5; DA = 69.1 s). The executive function measures exhibited good convergent (r = −0.22 to r = 0.42) and divergent (r < −0.01 to r = 0.16) validity. Conclusions: These established MCIDs will allow clinicians to interpret meaningful changes in executive function following exercise amongst older adults who have fallen. The DSST, Stroop, and TMT demonstrated good construct validity, supporting their use in comprehensive fall-risk assessments in older adults who fall.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although a 2-point increase in MoCA scores is considered clinically meaningful,51 other studies have suggested that larger changes may be required for clinically meaningful outcomes.52”
From A pilot study of senolytics to improve cognition and mobility in older adults at risk for Alzheimer's disease (2025) · cites this paper as [52]
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment
Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53221.x · Cited by 25,553
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Gauthier, S., Reisberg, B., Zaudig, M., Petersen, R. C., Ritchie, K., Broich, K., Belleville, S., Brodaty, H., Bennett, D., Chertkow, H., et al. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68542-5 · Cited by 3,850
STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660
Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.012 · Cited by 2,362
Research works printed but not linked: 1
- 10.1177/1073191115602552 · DOI · Paper page
Cited by
Yang, Y., Wang, K., Liu, H., Qu, J., Wang, Y., Chen, P., Zhang, T.-R., & Luo, J. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.953593 · Cited by 119
Millar, C. L., Iloputaife, I., Baldyga, K., Norling, A. M., Boulougoura, A., Vichos, T., Tchkonia, T., Deisinger, A., Pirtskhalava, T., Kirkland, J. L., et al. (2025) · EBioMedicine · doi:10.1016/j.ebiom.2025.105612 · Cited by 88
“52 Additionally, we cannot exclude the possibility that the changes in MoCA scores or TMT are simply a regression to the mean.”
Buyle, M., Jung, Y., Pavlou, M., Costafreda, S. G., & Bamiou, D. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.903673 · Cited by 53
Cognitive functioning and falls in older people: A systematic review and meta-analysis
Sturnieks, D. L., Chan, L. L. Y., Cerda, M. T. E., Arbona, C. H., Pinilla, B. H., Martinez, P. S., Seng, N. W., Smith, N., Menant, J. C., & Lord, S. R. (2024) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2024.105638 · Cited by 45
Cioffi, R., & Lubetzky, A. V. (2023) · Games for Health Journal · doi:10.1089/g4h.2022.0202 · Cited by 32
“48 The fact that all three groups improved significantly on the TMT A and only the BOXVR group improved signifi-cantly on the TMT B suggests that the TMT A is still sus-pectable to learning effects, even after 3 weeks.”
Jehu, D. A., Davis, J. C., Madden, K. M., Parmar, N., & Liu-Ambrose, T. Y. L. (2022) · Quality of Life Research · doi:10.1007/s11136-022-03231-x · Cited by 14
“It is also the first study to establish the MCID of the EQ-5D-3L using data acquired from a randomized controlled trial of exercise plus usual care provided by a geriatrician as well as usual care only, which is important because the MCID should be considered with respect to the intervention received [51].”
BackgroundSelf-citationDiscordant Biological and Chronological Age: Implications for Cognitive Decline and Frailty
Shaaban, C. E., Rosano, C., Zhu, X., Rutherford, B. R., Witonsky, K. R., Rosso, A. L., Yaffe, K. S., & Brown, P. J. (2023) · The Journals of Gerontology Series A · doi:10.1093/gerona/glad174 · Cited by 15
Association of cardiovascular diseases with cognitive performance in older adults
Park, D. Y., Jamil, Y., Babapour, G., Kim, J., Campbell, G., Akman, Z., Kochar, A., Sen, S., Samsky, M. D., Sikand, N. V., et al. (2024) · American Heart Journal · doi:10.1016/j.ahj.2024.03.016 · Cited by 12
Hood, A., Crosby, L. E., Stotesbury, H., Kölbel, M., & Kirkham, F. J. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.835823 · Cited by 11
Snigdha, A., Majumdar, V., Manjunath, N. K., & Jose, A. (2024) · GeroScience · doi:10.1007/s11357-024-01149-5 · Cited by 16
“Similarly, there was an improvement by approximately four symbols in DSST (AMD = 4.26, 95% CI = 3.39 to 5.12) which were in the range of the recently proposed minimal clinically significant difference (MCID) of 3–5 symbols (though the MCID has been set for older adults who have fallen [40]).”
InfluentialJehu, D. A., Dong, Y., Zhu, H., Huang, Y., Soares, A., Patel, C., Aden, Z., Hergott, C., Ange, B., Waller, J. L., et al. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107220 · Cited by 10
Self-citationBadu-Prempeh, N. B. A., Carboo, A. K., Amoa, A., Awuku-Aboagye, E., Amoah, A. A., & PEKYI-BOATENG, P. K. (2024) · Neurological Sciences · doi:10.1007/s10072-024-07825-w · Cited by 9
Jeyakodi, S., Krishnakumar, A., Dalal, M., & Shetty, B. S. (2024) · Cureus · doi:10.7759/cureus.65751 · Cited by 6
Snijders, B. M. G., Pierey, L., Peters, M. J. L., de Lange, S. V., van der Star, S., Allaerts, N., Emmelot‐Vonk, M. H., de Jong, P. A., & Koek, H. L. (2025) · Clinical Neuroradiology · doi:10.1007/s00062-025-01595-4 · Cited by 3
Müller, K., Poppele, I., Ottiger, M., Weber, R.-C., Stegbauer, M., & Schlesinger, T. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1460097 · Cited by 3
Iktilat, K., Isaacson, M., Tzemah-Shahar, R., & Agmon, M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321450 · Cited by 2
“There are three parts to this test, but only scores from part C (here referred to as Stroop C) were included in models because it is the most cognitively challenging (higher level of selective attention and response inhibition) [37].”
Wang, C. Y., Tao, K., An, X., Gu, J., Chen, J., Sun, J., Li, X., & Lü, B. (2025) · Scientific Reports · doi:10.1038/s41598-025-10198-5 · Cited by 2
Jehu, D. A., Patel, C., Soares, A., Waller, J. L., Carrick, R. M., Hergott, C., Young, L., Hall, W. J., Robinson‐Johnson, D., Allen, C., et al. (2025) · Journal of Alzheimer s Disease · doi:10.1177/13872877251378670 · Cited by 2
“10 14 Considerably less focus has been directed at treatment through lifestyle interventions, as PWD have been historically systematically excluded from intervention studies due to researchers ’ eligibility criteria.”
Self-citationMatsuda, E., Crowe, M. G., Howard, V. J., Brown, C. J., Sterling, M. R., & Levitan, E. B. (2024) · Journal of the American Geriatrics Society · doi:10.1111/jgs.18923 · Cited by 2
GenomicSEM Modelling of Diverse Executive Function GWAS Improves Gene Discovery
Perry, L. C., Chevalier, N., & Luciano, M. (2025) · Behavior Genetics · doi:10.1007/s10519-025-10214-4 · Cited by 2
“…literature, some studies have also supported a relationship between substitution tasks and set shifting, including when measured through Trails B (Jehu et al. 2021; Knowles et al. 2015; Lessov-Schlaggar et al. 2007 ), which may reflect the need to switch between mental sets of symbol-digit…”
Exploring the relationship between dietary index for gut microbiota and cognitive function
Sun, C., Tan, T., & Chen, Z. (2025) · Frontiers in Nutrition · doi:10.3389/fnut.2025.1618220 · Cited by 1
van Reekum, E. A., Stogios, N., Burton, L., Spivak, H., Hahn, M., & Agarwal, S. M. (2023) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.230052 · Cited by 1
Adapted Home-Based Exercises in Dementia: An Exploratory Pre-post Pilot and Feasibility Study
Carrard, S., Eyer, S., Hilfiker, R., & Hager, A.-G. M. (2024) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/15333175241263741 · Cited by 2
Suttanon, P., Khanphed, W., Saadprai, S., & Apibantaweesakul, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314357
Veldi, V. D. K., Mehta, R., & Sah, R. (2025) · Geriatrics and gerontology international/Geriatrics & gerontology international · doi:10.1111/ggi.70054
How weather affects cognitive and physical outcomes in older adults
Shourick, J., Lauwers‐Cancès, V., Vellas, B. J., Coley, N., Andrieu, S., & and for the MAPT/IHU HealthAge Open Science study group (2025) · PLoS ONE · doi:10.1371/journal.pone.0335866
Bianchini, E., Garramone, F., Rinaldi, D., Alborghetti, M., Carolis, L. D., Galli, S., Suppa, A., Salvetti, M., Hansen, C., & Vuillerme, N. (2026) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-025-01873-9 · Cited by 1
“Notably, this value falls within the reported MCID range for WCST interference in older adults at risk of falls (11.5 to 26.0 s) [55], which provides additional clinical relevance to our findings.”
InfluentialGrande, I., Schmidt, S. N., Reines, E. H., & Christensen, M. C. (2026) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s549106
Cui, L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1725791
Meng, H., Tu, S., Zhou, Y., Shen, R., Chen, X., Cheng, Z., Wang, L., Wu, Y., Lu, J., Wang, S., et al. (2026) · Neuroprotection/Neuroprotection (Chichester, England. Print) · doi:10.1002/nep3.70063
Metadata
- Authors
- Jehu, D. A., Davis, J. C., Madden, K., Parmar, N., & Liu-Ambrose, T.
- Affiliations
- Augusta University (US)
- Vancouver Coastal Health Research Institute (CA)
- University of British Columbia (CA)
- Venue
- Gerontology
- Publisher
- S. Karger AG
- Published
- 2021-10-15
- Volume
- 68
- Issue
- 7
- Pages
- 771-779
- ISSN
- 0304-324X (ISSN-L)
- 1423-0003
- OpenAlex
- W3207909719
- Cited by
- 30
- References
- 51
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 8 · 2023: 4 · 2022: 4
- FWCI
- 7.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Gerontology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (110954_1, MAT_92025)
- Topics
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- minimal clinically important difference, executive function, older adults, falls, Otago exercise program, Digit Symbol Substitution Test, Stroop task, Trail Making Test, Montreal Cognitive Assessment, processing speed, inhibition, set-shifting, construct validity, discriminant validity, exercise intervention, fall prevention, cognitive decline, anchor-based estimation, distribution-based estimation
- MeSH terms
- Minimal Clinically Important Difference, Activities of Daily Living, Aged, Aged, 80 and over, Female, Humans, Male, Trail Making Test, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.