Psychometric Evaluation of Lexical Diversity Indices: Assessing Length Effects
Open accessAbstract
Purpose: Several novel techniques have been developed recently to assess the breadth of a speaker's vocabulary exhibited in a language sample. The specific aim of this study was to increase our understanding of the validity of the scores generated by different lexical diversity (LD) estimation techniques. Four techniques were explored: D , Maas, measure of textual lexical diversity, and moving-average type–token ratio. Method: Four LD indices were estimated for language samples on 4 discourse tasks (procedures, eventcasts, story retell, and recounts) from 442 adults who are neurologically intact. The resulting data were analyzed using structural equation modeling. Results: The scores for measure of textual lexical diversity and moving-average type–token ratio were stronger indicators of the LD of the language samples. The results for the other 2 techniques were consistent with the presence of method factors representing construct-irrelevant sources. Conclusion: These findings offer a deeper understanding of the relative validity of the 4 estimation techniques and should assist clinicians and researchers in the selection of LD measures of language samples that minimize construct-irrelevant sources.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
MATTR has been described as one of the most reliable measures for calculating lexical diversity.
“MATTR has been described as one of the most reliable measures for calculating lexical diversity.”
From Automatic classification of AD pathology in FTD phenotypes using natural speech (2024) · cites this paper as [42]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Kok, J. S., Berg, I. J., & Scherder, E. J. A. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353441 · Cited by 20,589 · see citing works
McCarthy, P. M., & Jarvis, S. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.381 · Cited by 905 · see citing works
Flagged first, then by citations
Research works printed but not linked: 30
- Bentler PM 1990 Comparative fit indexes in structural models Psychological Bulletin 107 238 246 2320703
- Bollen KA 1989 Structural equation modeling with latent variables New York Wiley
- Campbell DT Fiske DW 1959 Convergent and discriminant validation by the multitraitmultimethod matrix Psychological Bulletin 56 81 105 13634291
- Covington MA McFall JD 2010 Cutting the Gordian Knot: The Moving-Average Type–Token Ratio (MATTR) Journal of Quantitative Linguistics 17 94 100
- Durán P Malvern D Richards B Chipere N 2004 Developmental trends in lexical diversity Applied Linguistics 25 2 220 242 10.1093/applin/25.2.220 · DOI
- Enders CK 2010 Applied missing data analysis New York, NY Guilford Press
- Ertmer DJ Strong LM Sadagopan N 2002 Beginning to communicate after cochlear implantation: oral language development in a young child Journal of Speech, Language, and Hearing Research 46 328 40 14700375
- Fergadiotis G Wright HH 2011 Lexical diversity for adults with and without aphasia across discourse elicitation tasks Aphasiology 25 11 1414 1430 23125474 PMC3486429
- Fergadiotis G Wright hH West TM 2013 Measuring Lexical Diversity in Narrative Discourse of People With Aphasia American Journal of Speech-Language Pathology 22 S397 S408 23695912 PMC3813439
- Folstein MF Folstein SE McHugh PR 1975 Mini-mental state: A practical method for grading the cognitive state of patients for the clinician Journal of Psychiatric Research 12 3 189 198 10.1016/0022-3956(75)90026-6 1202204 · DOI · Paper page
- Geiser C 2008 Structural Equation Modeling of Multitrait-Multimethod-Multioccasion Data Doctoral Dissertation 18778153
- Goodglass H Kaplan E Barresi B 2001 The Boston diagnostic aphasia examination; the assessment of aphasia and related disorders 3 Baltimore Lippincott Williams & Wilkins
- Gordon JK 2008 Measuring the lexical semantics of picture description in aphasia Aphasiology 22 7–8 839 852 10.1080/02687030701820063 22399832 PMC3293396 · DOI
- Heap HS 1978 Information retrieval – computational and theoretical aspects New York Academic Press
- Kenny DA Kashy DA 1992 Analysis of the multitrait–multimethod matrix by confirmatory factor analysis Psychological Bulletin 112 165 172
- Kline RB 2005 Principles and practice of structural equation modeling 2 New York, NY Guilford Press
- Krahn F 1978 The great ape; being the true version of the famous saga of friendship and adventure New York Viking Press
- Lance CE Noble CL Scullen SE 2002 A Critique of the Correlated Trait–Correlated Method and Correlated Uniqueness Models for Multitrait-Multimethod Data Psychological Methods 7 2 228 244 12090412
- Lind M Kristoffersen KE Moen I Simonsen HG 2009 Semi-spontaneous oral text production: Measurements in clinical practice Clinical Linguistics & Phonetics 23 12 872 886 10.3109/02699200903040051 20001304 · DOI
- Lopez MN Charter RA Mostafavi B Nibut LP Smith WE 2005 Psychometric properties of the Folstein Mini-Mental State Examination Assessement 12 2 137 144 15914716
- McCarthy PM 2005 An assessment of the range and usefulness of lexical diversity measures and the potential of the measure of textual lexical diversity Doctoral Dissertation ProQuest Nursing & Allied Health Source database
- McCarthy PM Jarvis S 2007 Vocd: A theoretical and empirical evaluation Language Testing 24 4 459 488 10.1177/0265532207080767 · DOI
- McCarthy P Watanabe S Lamkin TA in press The Gramulator: A Tool to Identify Differential Linguistic Features of Correlative Text Types
- Nicholas LE Brookshire RH 1993 A system for quantifying the informativeness and efficiency of the connected speech of adults with aphasia Journal of Speech & Hearing Research 36 2 338 350 8487525
- Owen AJ Leonard LB 2002 Lexical diversity in the spontaneous speech of children with specific language impairment: Application of D Journal of Speech, Language & Hearing Research 45 5 927 12381050
- Rider JD Wright HH Marshall RC Page JL 2008 Using semantic feature analysis to improve contextual discourse in adults with aphasia American Journal of Speech-Language Pathology 17 2 161 172 10.1044/1058-0360(2008/016) 18448603 · DOI
- Satorra A Bentler PM 2001 A scaled difference chi-square test statistic for moment structure analysis Psychometrika 66 507 514 PMC2905175 20640194
- Templin M 1957 Certain language skills in children Minneapolis University of Minneapolis Press
- Thordardottir ET Namazi M 2007 Specific language impairment in French-speaking children: Beyond grammatical morphology Journal of Speech, Language, and Hearing Research 50 3 698 714 17538110
- Yule GU 1944 The statistical study of literary vocabulary New York, NY, US Cambridge University Press
Cited by
Sorted by citations
Automatic classification of AD pathology in FTD phenotypes using natural speech
Cho, S., Olm, C. A., Ash, S., Shellikeri, S., Agmon, G., Cousins, K. A. Q., Irwin, D. J., Grossman, M., Liberman, M., & Nevler, N. (2024) · Alzheimer's & Dementia · doi:10.1002/alz.13748 · Cited by 13 · see citing works
“42 The calculated average lexical scores, POS counts per 100 words, and lexical diversity scores were used for model training.”
Method
- Authors
- Fergadiotis, G., Wright, H. H., & Green, S. B.
- Affiliations
- Portland State University (US)
- East Carolina University (US)
- Arizona State University (US)
- Venue
- Journal of Speech, Language, and Hearing Research
- Published
- 2015-06
- Volume
- 58
- Issue
- 3
- Pages
- 840-852
- ISSN
- 1092-4388 (ISSN-L)
- 1558-9102
- PMC
- PMC4490052
- OpenAlex
- W2099145205
- Cited by
- 93
- References
- 2
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 19 · 2023: 12 · 2022: 11 · 2021: 11 · 2020: 11 · 2019: 5 · 2018: 4 · 2017: 2 · 2016: 3 · 2015: 2
- FWCI
- 9.27
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Speech Language and Hearing Research (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- PDXScholar (Portland State University) (submittedVersion)
- Funders
- Portland State University
- National Institute on Aging (R01AG029476)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Health Sciences › Medicine › Physiology › Voice and Speech Disorders
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Keywords
- lexical diversity, type-token ratio, D-index, language samples, vocabulary breadth, psychometric validity, methodological factors
- MeSH terms
- Adult, Aged, Aged, 80 and over, Female, Humans, Language Tests, Male, Middle Aged, Psychometrics, Vocabulary, Models, Statistical, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
