Bi-factor analyses of the brief test of adult cognition by telephone
Open accessAbstract
BACKGROUND: Telephone cognitive batteries are useful for large-scale screening and epidemiological studies, but their brevity and lack of content depth may cause psychometric limitations that hinder their utility. OBJECTIVE: The current study addressed some of these limitations by rescaling the Brief Test of Adult Cognition by Telephone (BTACT; Tun & Lachman, 2006) using modern psychometric methods. METHODS: Archival data were obtained from a national sample of 4,212 28 to 84-year-old volunteers in the National Survey of Midlife Development in the United States (Ryff et al., 2007) Cognitive Project (Ryff & Lachman, 2007). We fit a bi-factor model to a combination of item-level, subscale-level, and scale-level data. RESULTS: The best fitting model contained a general factor and secondary factors capturing test-specific method effects or residual correlations for Number Series, Red/Green Test, and the Rey Auditory Verbal Learning Test. Factor scores generated from this model were compared with conventional BTACT scores. Important score differences (i.e., >0.3 standard deviation units) were found in 28% of the sample. The bi-factor scores demonstrated slightly superior validity than conventional BTACT scores when judged against a number of clinical and demographic criterion variables. CONCLUSIONS: Modern psychometric approaches to scoring the BTACT have the benefit of linear scaling and a modest criterion validity advantage.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The primary and secondary outcome measures were chosen based on prior evidence for having been administered remotely, either by videoconference or by phone.
“All the above measures were chosen based on prior evidence for having been administered remotely, either by videoconference or by phone (33, 35, 38, 39).”
From A Virtual, Randomized, Control Trial of a Digital Therapeutic for Speech, Language, and Cognitive Intervention in Post-stroke Persons With Aphasia (2021) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266 · see citing works
A NEW MEASURE OF RANK CORRELATION
Kendall, M. G. (1938) · Biometrika · doi:10.1093/biomet/30.1-2.81 · Cited by 7,299 · see citing works
(2000) · Cited by 4,106 · see citing works
Fundamentals of item response theory
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4185 · Cited by 3,417 · see citing works
L’examen Clinique en Psychologie
Rubé, P. (1959) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1959.13.4.989 · Cited by 3,299 · see citing works
Insights into the ageing mind: a view from cognitive neuroscience
Hedden, T., & Gabrieli, J. D. E. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1323 · Cited by 2,223 · see citing works
Item Response Theory: Principles and Applications
Hambleton, R. K., & Swaminathan, H. (1984) · Medical Entomology and Zoology · Cited by 1,779 · see citing works
Psychometric Evaluation and Calibration of Health-Related Quality of Life Item Banks
Reeve, B. B., Hays, R. D., Bjørner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., et al. (2007) · Medical Care · doi:10.1097/01.mlr.0000250483.85507.04 · Cited by 1,491 · see citing works
Self-citationHow healthy are we?: a national study of well-being at midlife
Brim, O. G., Ryff, C. D., & Kessler, R. C. (2004) · Choice Reviews Online · doi:10.5860/choice.41-6842 · Cited by 1,028 · see citing works
The role of the bifactor model in resolving dimensionality issues in health outcomes measures
Reise, S. P., Morizot, J., & Hays, R. D. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9183-7 · Cited by 747 · see citing works
Full-Information Item Bi-Factor Analysis
Gibbons, R. D., & Hedeker, D. (1992) · Psychometrika · doi:10.1007/bf02295430 · Cited by 599 · see citing works
Psychological Appraisal of Children with Cerebral Defects
TAYLOR, E. M. (1959) · Harvard University Press eBooks · doi:10.4159/harvard.9780674367494 · Cited by 425 · see citing works
Telephone Survey Methods: Sampling, Selection and Supervision
Fowler, F. J., & Lavrakas, P. J. (1988) · Journal of the American Statistical Association · doi:10.2307/2290176 · Cited by 397 · see citing works
Knopman, D. S., Roberts, R. O., Geda, Y. E., Pankratz, V. S., Christianson, T. J. H., Petersen, R. C., & Rocca, W. A. (2009) · Neuroepidemiology · doi:10.1159/000255464 · Cited by 323 · see citing works
New Challenges for Telephone Survey Research in the Twenty-First Century
Kempf, A. M., & Remington, P. (2006) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144059 · Cited by 296 · see citing works
Full-Information Item Bifactor Analysis of Graded Response Data
Gibbons, R. D., Bock, R. D., Hedeker, D., Weiss, D. J., Segawa, E., Bhaumik, D. K., Kupfer, D. J., Frank, E., Grochocinski, V. J., & Stover, A. M. (2006) · Applied Psychological Measurement · doi:10.1177/0146621606289485 · Cited by 271 · see citing works
Tun, P. A., & Lachman, M. E. (2006) · Age and Ageing · doi:10.1093/ageing/afl095 · Cited by 249 · see citing works
Tun, P. A., & Lachman, M. E. (2008) · Developmental Psychology · doi:10.1037/a0012845 · Cited by 181 · see citing works
Heterogeneity of cognitive trajectories in diverse older persons.
Mungas, D., Beckett, L. A., Harvey, D. J., Farias, S. T., Reed, B., Carmichael, O. T., Olichney, J., Miller, J. W., & DeCarli, C. S. (2010) · Psychology and Aging · doi:10.1037/a0019502 · Cited by 165 · see citing works
Attrition and bias in the MRC cognitive function and ageing study: an epidemiological investigation
Matthews, F. E., Chatfield, M. D., Freeman, C. J., McCracken, C., Brayne, C., & CFAS, M. (2004) · BMC Public Health · doi:10.1186/1471-2458-4-12 · Cited by 162 · see citing works
Gallos, J. J., & Breitner, J. C. S. (1995) · Psychological Medicine · doi:10.1017/s0033291700033183 · Cited by 159 · see citing works
Application of the Bi‐Factor Multidimensional Item Response Theory Model to Testlet‐Based Tests
DeMars, C. E. (2006) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2006.00010.x · Cited by 155 · see citing works
Hereditary Influences on Cognitive Functioning in Older Men: A Study of 4000 Twin Pairs
Brandt, J. (1993) · Archives of Neurology · doi:10.1001/archneur.1993.00540060039014 · Cited by 131 · see citing works
Crane, P. K., Narasimhalu, K., Gibbons, L. E., Mungas, D., Haneuse, S., Larson, E. B., Kuller, L. H., Hall, K. S., & van Belle, G. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.011 · Cited by 126 · see citing works
Self-citationFactor analysis techniques for assessing sufficient unidimensionality of cancer related fatigue
Lai, J., Crane, P. K., & Cella, D. F. (2006) · Quality of Life Research · doi:10.1007/s11136-006-0060-6 · Cited by 115 · see citing works
Self-citationSample Bias in Caregiving Research
Dura, J. R., & Kiecolt‐Glaser, J. K. (1990) · Journal of Gerontology · doi:10.1093/geronj/45.5.p200 · Cited by 89 · see citing works
Validation of multi-stage telephone-based identification of cognitive impairment and dementia
Crooks, V. C., Clark, L. J., Petitti, D. B., Chui, H. C., & Chiu, V. Y. (2005) · BMC Neurology · doi:10.1186/1471-2377-5-8 · Cited by 83 · see citing works
Cognitive Testing in Large-Scale Surveys: Assessment by Telephone
Lachman, M. E., & Tun, P. A. (2008) · Sage eBooks · doi:10.4135/9781412976589.n30 · Cited by 79 · see citing works
Assessment of Cognitive Decline in Old Age with Brief Tests Amenable to Telephone Administration
Wilson, R. S., & Bennett, D. A. (2005) · Neuroepidemiology · doi:10.1159/000085309 · Cited by 65 · see citing works
Relations between Subjective Evaluations of Memory and Objective Memory Performance
Schmidt, I. W., Berg, I. J., & Deelman, B. G. (2001) · Perceptual and Motor Skills · doi:10.2466/pms.2001.93.3.761 · Cited by 62 · see citing works
Register-based data indicated nonparticipation bias in a health study among aging people
Nummela, O. P., Sulander, T. T., Helakorpi, S., Haapola, I., Uutela, A. K., Heinonen, H. S., Valve, R., & Fogelholm, M. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.003 · Cited by 61 · see citing works
Gavett, B. E., & Horwitz, J. E. (2011) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acr104 · Cited by 61 · see citing works
Self-citationCost-benefits associated with social outcome from neurobehavioural rehabilitation
Worthington, A. D., Matthews, S., Melia, Y., & Oddy, M. (2006) · Brain Injury · doi:10.1080/02699050600888314 · Cited by 57 · see citing works
When the Third Party Observer of a Neuropsychological Evaluation is an Audio-Recorder
Constantinou, M., Ashendorf, L., & McCaffrey, R. J. (2002) · The Clinical Neuropsychologist · doi:10.1076/clin.16.3.407.13853 · Cited by 49 · see citing works
Evaluation of Rehabilitation Outcomes in Older Patients with Hip Fractures
Jones, G. R., Miller, T. A., & Petrella, R. J. (2002) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/00002060-200207000-00004 · Cited by 45 · see citing works
Gillen, R. W., Tennen, H. A., & McKee, T. E. (2007) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e31804a7e2f · Cited by 40 · see citing works
Recovery and rehabilitation following subarachnoid haemorrhage: part II long term follow up
DOMBOVY, J. D.-C. M. L. (1998) · Brain Injury · doi:10.1080/026990598122106 · Cited by 38 · see citing works
Duff, K. M., Beglinger, L. J., & Adams, W. (2009) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e3181802c54 · Cited by 35 · see citing works
Crooks, V. C., Petitti, D. B., Robins, S. B., & Buckwalter, J. G. (2006) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/153331750602100104 · Cited by 30 · see citing works
National Survey of Midlife Development in the United States (MIDUS II): Cognitive Project, 2004-2006
Ryff, C. D., & Lachman, M. E. (2009) · ICPSR Data Holdings · doi:10.3886/icpsr25281 · Cited by 24 · see citing works
Wolfson, C. M., Kirkland, S., Raina, P. S., Uniat, J., Roberts, K. C., Bergman, H., Furlini, L., Pelletier, A., Strople, G., Angus, C. L., et al. (2009) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.1017/s0714980809990092 · Cited by 20 · see citing works
Guerini, F., Frisoni, G. B., Marrè, A., Turco, R., Bellelli, G., & Trabucchi, M. (2008) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2008.01.018 · Cited by 15 · see citing works
After Rehabilitation: An 18-Month Follow-Up of Elderly Inner-City Women
Lysack, C. L., Neufeld, S. W., Mast, B. T., MacNeill, S. E., & Lichtenberg, P. A. (2003) · American Journal of Occupational Therapy · doi:10.5014/ajot.57.3.298 · Cited by 11 · see citing works
(1999)
Flagged first, then by citations
Research works printed but not linked: 1
- Muthén LK Muthén BO Mplus User’s Guide 1998-2010 Muthén & Muthén Los Angeles, CA Sixth Edition
Cited by
Sorted by citations
Montenigro, P., Alosco, M., Martin, B. M., Daneshvar, D., Mez, J., Chaisson, C. E., Nowinski, C., Au, R., Mckee, A., Cantu, R., et al. (2017) · Journal of Neurotrauma · doi:10.1089/neu.2016.4413 · Cited by 535 · see citing works
Anomalous results in G-factor models: Explanations and alternatives.
Eid, M., Geiser, C., Koch, T., & Heene, M. (2016) · Psychological Methods · doi:10.1037/met0000083 · Cited by 441 · see citing works
Age of first exposure to American football and long-term neuropsychiatric and cognitive outcomes
Alosco, M. L., Kasimis, A. B., Stamm, J. M., Chua, A. S., Baugh, C. M., Daneshvar, D. H., Robbins, C. A., Mariani, M. L., Hayden, J., Conneely, S. E., et al. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.197 · Cited by 202 · see citing works
Cognitive Assessment via Telephone: A Scoping Review of Instruments
Carlew, A. R., Fatima, H., Livingstone, J. R., Reese, C., Lacritz, L. H., Pendergrass, C., Bailey, K. C., Presley, C., Mokhtari, B. K., & Cullum, C. M. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa096 · Cited by 105 · see citing works
Braley, M., Pierce, J. S., Saxena, S., De Oliveira, E., Taraboanta, L., Anantha, V., Lakhan, S. E., & Kiran, S. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.626780 · Cited by 80 · see citing works
Bodien, Y. G., McCrea, M., DIKMEN, S. S., Temkin, N. R., Boase, K., Machamer, J., Taylor, S. R., Sherer, M., Levin, H. S., Kramer, J. H., et al. (2018) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000367 · Cited by 48 · see citing works
Nelson, L. D., Barber, J. K., Temkin, N. R., Dams-O’Connor, K., DIKMEN, S. S., Giacino, J. T., Kramer, M. D., Levin, H. S., McCrea, M., Whyte, J., et al. (2020) · Journal of Neurotrauma · doi:10.1089/neu.2020.7295 · Cited by 36 · see citing works
Self-citationEpisodic memory impairment in Addison’s disease: results from a telephonic cognitive assessment
Henry, M., & Thomas, K. G. F. (2014) · Metabolic Brain Disease · doi:10.1007/s11011-014-9511-x · Cited by 30 · see citing works
Assessing Cognition after Stroke. Who Misses Out? A Systematic Review
Wall, K. J., Isaacs, M. L., Copland, D. A., & Cumming, T. B. (2015) · International Journal of Stroke · doi:10.1111/ijs.12506 · Cited by 25 · see citing works
Matchanova, A., Babicz, M. A., Medina, L. D., Rahman, S., Johnson, B., Thompson, J. L., Beltran‐Najera, I., Brooks, J. R., Sullivan, K. L., Walker, R. L., et al. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa111 · Cited by 25 · see citing works
Failla, M. D., Juengst, S. B., Graham, K. M., Arenth, P. M., & Wagner, A. K. (2016) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000214 · Cited by 22 · see citing works
Gurnani, A. S., John, S. E., & Gavett, B. E. (2015) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acv005 · Cited by 15 · see citing works
Self-citationTorrence, N. D., John, S. E., Gavett, B. E., & O’Bryant, S. E. (2015) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acv057 · Cited by 14 · see citing works
Self-citationValidation of a Novel Telehealth Administration Protocol for the NIH Toolbox-Cognition Battery
Rebchuk, A. D., Deptuck, H. M., O'Neill, Z. R., Fawcett, D., Silverberg, N. D., & Field, T. S. (2018) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2018.0023 · Cited by 14 · see citing works
Reporting Valid and Reliable Overall Scores and Domain Scores Using Bi-Factor Model
Liu, Y., Li, Z., & Liu, H. (2018) · Applied Psychological Measurement · doi:10.1177/0146621618813093 · Cited by 14 · see citing works
Chronic Traumatic Encephalopathy
Mez, J. B., Stern, R. A., & McKee, A. C. (2020) · Seminars in Neurology · doi:10.1055/s-0040-1715824 · Cited by 14 · see citing works
Thompson, J. L., Matchanova, A., Beltran‐Najera, I., Ridgely, N. C., Mustafa, A. I., Babicz, M. A., Hasbun, R., Giordano, T. P., & Woods, S. P. (2022) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac104 · Cited by 8 · see citing works
Cairncross, M., Gindwani, H., Egbert, A. R., Torres, I. J., Hutchison, J. S., Dams-O’Connor, K., Panenka, W. J., Brubacher, J. R., Meddings, L., Kwan, L., et al. (2022) · Brain Injury · doi:10.1080/02699052.2022.2109744 · Cited by 6 · see citing works
Self-citationGilmore, N. M., Bergquist, T. F., Bogner, J. A., Corrigan, J. D., Dams-O’Connor, K., Dreer, L. E., Healy, B. C., Juengst, S. B., Kumar, R. G., O’Neil-Pirozzi, T. M., et al. (2024) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000997 · Cited by 4 · see citing works
Self-citationSleep and cognition in South African patients with non-functioning pituitary adenomas
de Villiers, O., Elliot-Wilson, C., Thomas, K. G. F., Semple, P., Naiker, T., Henry, M., & Ross, I. L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296387 · Cited by 3 · see citing works
Burke, M. J., Ahmed, Y. E., Li, Z., Sanchez, K., Winston, A., Broadhurst, P., Haas, B., Steinberg, R. J., Wasilewski, M. B., Silverberg, N. D., et al. (2025) · Brain Injury · doi:10.1080/02699052.2024.2443771 · Cited by 2 · see citing works
Chronic Traumatic Encephalopathy
Stern, R. A., & Alosco, M. L. (2017) · Elsevier eBooks · doi:10.1016/b978-0-323-54425-2.00003-5
Boring, B. L., & Gunstad, J. (2026) · Journal of Health Psychology · doi:10.1177/13591053261424714
- Authors
- Gavett, B. E., Crane, P. K., & Dams-O'Connor, K.
- Affiliations
- University of Colorado Colorado Springs (US)
- University of Washington (US)
- Department of Rehabilitation Medicine, Mount Sinai School of Medicine, New York, NY, USA
- Venue
- NeuroRehabilitation
- Publisher
- SAGE Publications
- Published
- 2013-04-11
- Volume
- 32
- Issue
- 2
- Pages
- 253-265
- ISSN
- 1053-8135 (ISSN-L)
- 1878-6448
- PMC
- PMC4489934
- OpenAlex
- W2125377781
- Cited by
- 23
- References
- 48
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2022: 2 · 2021: 1 · 2020: 4 · 2018: 3 · 2017: 2 · 2016: 3 · 2015: 3 · 2014: 1
- FWCI
- 3.18
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Neurorehabilitation (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Aging (R13AG030995, R01AG029672, P01AG020166)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- bifactor model, cognitive screening, test scoring, factor structure, criterion validity, older adults, cognitive aging
- MeSH terms
- Adult, Aged, Aged, 80 and over, Cognition, Female, Health Surveys, Humans, Male, Mathematics, Middle Aged, Neuropsychological Tests, Psychometrics, Retrospective Studies, Telephone, United States, Verbal Learning, Reproducibility of Results, Models, Statistical, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
