Minimal Clinically Important Difference of Executive Function Performance in Older Adults Who Fall: A Secondary Analysis of a Randomized Controlled Trial
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Introduction: Executive function is responsive to exercise and predictive of subsequent falls. Minimal clinically important differences (MCIDs) are critical for understanding whether observed changes are meaningful. However, MCIDs of many cognitive measures are not established. We aimed to determine MCIDs of the Digit Symbol Substitution Test ([DSST] processing speed measure), Stroop (inhibition measure), and Trail Making Test B-A (TMT; set-shifting measure), using anchor- and distribution-based approaches in older adults who have fallen and received the Otago Exercise Program (OEP) relative to usual care only (CON). Our secondary aim was to establish construct (convergent and divergent) validity of these measures. Methods: Complete case analyses of cognitive outcomes (DSST, Stroop, TMT, and Montreal Cognitive Assessment [MoCA]) were acquired at baseline and 1 year (NCT01029171; NCT003235960); participants were randomized to the OEP (n = 114/172; Age: 80.6 ± 6.1 years; 64.9% Female) or CON (n = 128/172; Age: 82.3 ± 5.8 years; 71.9% Female)]. The MoCA was used as the anchor. We estimated MCIDs using anchor- and distribution-based approaches. Anchor-based executive function change differences ([CD] 1 year minus baseline) observed in participants with meaningful changes in the MoCA (≥3 or ≤ −3 points) receiving the OEP were subtracted from the CON. An anchor-based receiver operator characteristic (ROC) curve was employed to identify optimal cut-off scores of the 3 executive function measures. The distribution-based approach (DA) accounted for variability in baseline and follow-up data. MCID ranges were estimated using these approaches. We used Spearman’s correlations to explore convergent validity between executive function measures and other measures involving the same construct (DSST, Stroop, TMT, MoCA, and Mini-Mental State Examination), and divergent validity between executive function measures and variables reflecting different constructs (Geriatric Depression Scale, Instrumental Activities of Daily Living, sex, and body mass index). Results: Based on the 3 approaches, MCID improvement ranges were 3–5 symbols for the DSST (CD = 5; ROC = 2.5; DA = 3.3 symbols), and −11.5 to −26.0 s for the Stroop (CD = −26.0; ROC = −11.5; DA = −20.6 s). MCID decline ranges were −3 to −6 symbols for the DSST (CD = −5.2; ROC = −2.5; DA = −3.3 symbols) and 5.4–30.6 s for the Stroop (CD = 30.6; ROC = 5.4; DA = 20.6 s). MCIDs for the TMT were not meaningful due to high variability (Improvement: CD = −106.6; ROC = −18.4; DA = −69.1 s; Decline: CD = 69.1; ROC = 14.5; DA = 69.1 s). The executive function measures exhibited good convergent (r = −0.22 to r = 0.42) and divergent (r < −0.01 to r = 0.16) validity. Conclusions: These established MCIDs will allow clinicians to interpret meaningful changes in executive function following exercise amongst older adults who have fallen. The DSST, Stroop, and TMT demonstrated good construct validity, supporting their use in comprehensive fall-risk assessments in older adults who fall.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although a 2-point increase in MoCA scores is considered clinically meaningful,51 other studies have suggested that larger changes may be required for clinically meaningful outcomes.52”
From A pilot study of senolytics to improve cognition and mobility in older adults at risk for Alzheimer's disease (2025) · cites this paper as [52]
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment
Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53221.x · Cited by 25,553
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Gauthier, S., Reisberg, B., Zaudig, M., Petersen, R. C., Ritchie, K., Broich, K., Belleville, S., Brodaty, H., Bennett, D., Chertkow, H., et al. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68542-5 · Cited by 3,850
STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660
Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.012 · Cited by 2,362
Guideline for the Prevention of Falls in Older Persons
Society, A. G., Society, G., Of, A. A., & On Falls Prevention, O. S. P. (2001) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2001.49115.x · Cited by 2,242
Methods to Explain the Clinical Significance of Health Status Measures
Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., & Norman, G. R. (2002) · Mayo Clinic Proceedings · doi:10.4065/77.4.371 · Cited by 1,500
Campbell, A. J., Robertson, M. C., Gardner, M. M., Norton, R. N., Tilyard, M. W., & Buchner, D. M. (1997) · BMJ · doi:10.1136/bmj.315.7115.1065 · Cited by 1,199
Fried, L. P. (1998) · JAMA · doi:10.1001/jama.279.8.585 · Cited by 1,107
A Physiological Profile Approach to Falls Risk Assessment and Prevention
Lord, S. R., Menz, H. B., & Tiedemann, A. (2003) · Physical Therapy · doi:10.1093/ptj/83.3.237 · Cited by 916
Benedict, R. H., DeLuca, J., Phillips, G., LaRocca, N., Hudson, L. D., Rudick, R., & Multiple Sclerosis Outcome Assessments Consortium (2017) · Multiple Sclerosis Journal · doi:10.1177/1352458517690821 · Cited by 839
Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS)
BENEDICT, R. H. B., COOKFAIR, D., GAVETT, R., GUNTHER, M., MUNSCHAUER, F., GARG, N., & WEINSTOCK-GUTTMAN, B. (2006) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617706060723 · Cited by 798
ROC-ing along: Evaluation and interpretation of receiver operating characteristic curves
Carter, J. V., Pan, J., Rai, S. N., & Galandiuk, S. (2016) · Surgery · doi:10.1016/j.surg.2015.12.029 · Cited by 754
Clinimetrics corner: a closer look at the minimal clinically important difference (MCID)
Wright, A., Hannon, J., Hegedus, E. J., & Kavchak, A. E. (2012) · Journal of Manual & Manipulative Therapy · doi:10.1179/2042618612y.0000000001 · Cited by 539
Interpretation of quality of life changes
Lydick, E., & Epstein, R. S. (1993) · Quality of Life Research · doi:10.1007/bf00435226 · Cited by 527
Llinàs-Reglà, J., Vilalta-Franch, J., López-Pousa, S., Calvó-Perxas, L., Torrents Rodas, D., & Garre-Olmo, J. (2017) · Assessment · doi:10.1177/1073191115602552 · Cited by 425
Executive Functioning: Overview, Assessment, and Research Issues for Non-Neuropsychologists
Suchy, Y. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9097-4 · Cited by 408
Yost, K. J., & Eton, D. T. (2005) · Evaluation & the Health Professions · doi:10.1177/0163278705275340 · Cited by 382
The minimum clinically important difference for EQ-5D index: a critical review
Coretti, S., Ruggeri, M., & McNamee, P. (2014) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.2014.894462 · Cited by 342
Practical implementation of an exercise-based falls prevention programme
Gardner, M. M. (2001) · Age and Ageing · doi:10.1093/ageing/30.1.77 · Cited by 326
Liu-Ambrose, T., Davis, J. C., Best, J. R., Dian, L., Madden, K., Cook, W., Hsu, C. L., & Khan, K. M. (2019) · JAMA · doi:10.1001/jama.2019.5795 · Cited by 291
Self-citationOsoba, D., Bezjak, A., Brundage, M., Zee, B., Tu, D., & Pater, J. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.017 · Cited by 288
Kearney, F. C., Harwood, R. H., Gladman, J. R. F., Lincoln, N., & Masud, T. (2013) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000350031 · Cited by 286
Risk factors for recurrent falls in older adults: A systematic review with meta-analysis
Jehu, D. A., Davis, J. C., Falck, R. S., Bennett, K. J., Tai, D., Souza, M. F., Cavalcante, B. R., Zhao, M., & Liu-Ambrose, T. (2021) · Maturitas · doi:10.1016/j.maturitas.2020.10.021 · Cited by 248
Self-citationPeriáñez, J. A., Lubrini, G., García-Gutiérrez, A., & Ríos-Lago, M. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa034 · Cited by 217
Lin, K.-C., Hsieh, Y.-W., Wu, C.-Y., Chen, C.-L., Jang, Y., & Liu, J.-S. (2009) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968308331144 · Cited by 207
Whitney, J. C., Lord, S. R., & Close, J. C. T. (2005) · Age and Ageing · doi:10.1093/ageing/afi178 · Cited by 191
Wu, C.-Y., Hung, S.-J., Lin, K.-C., Chen, K.-H., Chen, P., & Tsay, P.-K. (2019) · Occupational Therapy International · doi:10.1155/2019/2517658 · Cited by 117
Interpreting and Reporting Results Based on Patient-Reported Outcomes
Revicki, D. A., Erickson, P., Sloan, J. A., Dueck, A. C., Guess, H. A., & Santanello, N. C. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00274.x · Cited by 114
Kon, S. S. C., Dilaver, D., Mittal, M., Nolan, C. M., Clark, A. L., Canavan, J. L., Jones, S. E., Polkey, M. I., & Man, W. D. (2013) · Thorax · doi:10.1136/thoraxjnl-2013-204119 · Cited by 114
Davis, J. C., Best, J. R., Khan, K. M., Dian, L., Lord, S. R., Delbaere, K., Hsu, C. L., Cheung, W., Chan, W., & Liu-Ambrose, T. Y. L. (2017) · Journal of the American Geriatrics Society · doi:10.1111/jgs.14830 · Cited by 58
Self-citationFu, C., Jin, X., Chen, B., Xue, F., Niu, H., Guo, R., Chen, Z., Zheng, H., Wang, L., & Zhang, Y. (2017) · Geriatrics and gerontology international/Geriatrics & gerontology international · doi:10.1111/ggi.13069 · Cited by 58
Kadar, M., Ibrahim, S., Razaob, N. A., Chai, S. C., & Harun, D. (2018) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12441 · Cited by 49
Khaligh‐Razavi, S., Habibi, S., Sadeghi, M., Marefat, H., Khanbagi, M., Nabavi, S. M., Sadeghi, E., & Kalafatis, C. (2019) · Scientific Reports · doi:10.1038/s41598-018-37709-x · Cited by 44
Diversity of approaches in assessment of executive functions in stroke: Limited evidence?
Conti, J., Sterr, A., Brucki, S. M. D., & Conforto, A. B. (2015) · eNeurologicalSci · doi:10.1016/j.ensci.2015.08.002 · Cited by 43
Gupta, M., Gupta, V., Buckshee, R. N., & Sharma, V. (2019) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2019.09.022 · Cited by 40
Liu-Ambrose, T. Y. L., Davis, J. C., Hsu, C. L., Gomez, C., Vertes, K. A., Marra, C. A., Brasher, P. M. A., Dao, E. A., Khan, K. M., Cook, W. L., et al. (2015) · Trials · doi:10.1186/s13063-015-0648-7 · Cited by 38
Self-citationMai, L. M., Sposato, L. A., Rothwell, P. M., Hachinski, V., & Pendlebury, S. T. (2016) · International Journal of Stroke · doi:10.1177/1747493016632238 · Cited by 37
Chan, A. C. M., Pang, M. Y. C., Ouyang, H., & Jehu, D. A. (2019) · PM&R · doi:10.1002/pmrj.12226 · Cited by 29
Self-citationDavis, J. C., Dian, L., Parmar, N., Madden, K. M., Khan, K. M., Chan, W., Cheung, W., Rogers, J., & Liu-Ambrose, T. Y. L. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020576 · Cited by 25
Self-citationLiu-Ambrose, T. Y. L., Davis, J. C., Falck, R. S., Best, J. R., Dao, E. A., Vesely, K., Ghag, C., Rosano, C., Hsu, C. L., Dian, L., et al. (2020) · The Journals of Gerontology Series A · doi:10.1093/gerona/glaa239 · Cited by 21
Self-citationLim, P. A., McLean, A. M., Kilpatrick, C., DeForge, D., Iverson, G. L., & Silverberg, N. D. (2015) · Brain Injury · doi:10.3109/02699052.2015.1079732 · Cited by 20
Davis, J. C., Bryan, S., Marra, C. A., Hsiung, G.-Y. R., & Liu-Ambrose, T. (2015) · British Journal of Sports Medicine · doi:10.1136/bjsports-2013-092743 · Cited by 17
Self-citationHwang, S., Woo, Y., Kim, K., & Ki, K.-I. (2012) · International Journal of Rehabilitation Research · doi:10.1097/mrr.0b013e32835b667e · Cited by 15
Watts, A. K. S., Ahern, D. C., Jones, J. D., Farrer, T. J., & Correia, S. (2018) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acy025 · Cited by 15
Handing, E. P., Chen, H., Rejeski, W. J., Rosso, A. L., Balachandran, A. T., King, A. C., & Kritchevsky, S. B. (2019) · PubMed Central · doi:10.1093/geroni/igz010 · Cited by 12
Research works printed but not linked: 1
- 10.1177/1073191115602552 · DOI · Paper page
Cited by
Yang, Y., Wang, K., Liu, H., Qu, J., Wang, Y., Chen, P., Zhang, T.-R., & Luo, J. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.953593 · Cited by 119
Millar, C. L., Iloputaife, I., Baldyga, K., Norling, A. M., Boulougoura, A., Vichos, T., Tchkonia, T., Deisinger, A., Pirtskhalava, T., Kirkland, J. L., et al. (2025) · EBioMedicine · doi:10.1016/j.ebiom.2025.105612 · Cited by 88
“52 Additionally, we cannot exclude the possibility that the changes in MoCA scores or TMT are simply a regression to the mean.”
Buyle, M., Jung, Y., Pavlou, M., Costafreda, S. G., & Bamiou, D. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.903673 · Cited by 53
Cognitive functioning and falls in older people: A systematic review and meta-analysis
Sturnieks, D. L., Chan, L. L. Y., Cerda, M. T. E., Arbona, C. H., Pinilla, B. H., Martinez, P. S., Seng, N. W., Smith, N., Menant, J. C., & Lord, S. R. (2024) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2024.105638 · Cited by 45
Cioffi, R., & Lubetzky, A. V. (2023) · Games for Health Journal · doi:10.1089/g4h.2022.0202 · Cited by 32
“48 The fact that all three groups improved significantly on the TMT A and only the BOXVR group improved signifi-cantly on the TMT B suggests that the TMT A is still sus-pectable to learning effects, even after 3 weeks.”
Metadata
- Authors
- Jehu, D. A., Davis, J. C., Madden, K., Parmar, N., & Liu-Ambrose, T.
- Affiliations
- Augusta University (US)
- Vancouver Coastal Health Research Institute (CA)
- University of British Columbia (CA)
- Venue
- Gerontology
- Publisher
- S. Karger AG
- Published
- 2021-10-15
- Volume
- 68
- Issue
- 7
- Pages
- 771-779
- ISSN
- 0304-324X (ISSN-L)
- 1423-0003
- OpenAlex
- W3207909719
- Cited by
- 30
- References
- 51
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 8 · 2023: 4 · 2022: 4
- FWCI
- 7.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Gerontology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (110954_1, MAT_92025)
- Topics
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- minimal clinically important difference, executive function, older adults, falls, Otago exercise program, Digit Symbol Substitution Test, Stroop task, Trail Making Test, Montreal Cognitive Assessment, processing speed, inhibition, set-shifting, construct validity, discriminant validity, exercise intervention, fall prevention, cognitive decline, anchor-based estimation, distribution-based estimation
- MeSH terms
- Minimal Clinically Important Difference, Activities of Daily Living, Aged, Aged, 80 and over, Female, Humans, Male, Trail Making Test, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.