The Effects of Complexity, Accuracy, and Fluency on Communicative Adequacy in Oral Task Performance
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Communicative adequacy is a key construct in second language research, as the primary goal of most language learners is to communicate successfully in real-world situations. Nevertheless, little is known about what linguistic features contribute to communicatively adequate speech. This study fills this gap by investigating the extent to which complexity, accuracy, and fluency (CAF) predict adequacy, and whether proficiency and task type moderate these relationships. In all, 20 native speakers and 80 second language users from four proficiency levels performed five tasks. Speech samples were rated for adequacy and coded for a range of CAF indices. Filled pause frequency, a feature of breakdown fluency, emerged as the strongest predictor of adequacy. Predictors with significant but smaller effects included indices of all three CAF dimensions: linguistic complexity (lexical diversity, overall syntactic complexity, syntactic complexity by subordination, and frequency of conjoined clauses), accuracy (general accuracy and accuracy of connectors), and fluency (silent pause frequency and speed fluency). For advanced speakers, incidence of false starts also emerged as predicting communicatively adequate speech. Task type did not influence the link between linguistic features and adequacy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Praat: Doing Phonetics by Computer
(2011) · Ear & Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 7,863
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
A First Language: The Early Stages
Gardner, R. A., Gardner, B. T., & Brown, R. (1974) · The American Journal of Psychology · doi:10.2307/1421982 · Cited by 4,172
A Cognitive Approach to Language Learning
Garcia, P., & Skehan, P. (1999) · TESOL Quarterly · doi:10.2307/3587891 · Cited by 3,507 · cited 2×
“Motivated by these practical concerns and insights from second language acquisition (SLA) research, tasks and their role in language learning have also become the subject of much theorizing (Skehan 1998; Robinson 2001) and empirical inquiry in instructed SLA.”
BackgroundCoxhead, A. (2000) · TESOL Quarterly · doi:10.2307/3587951 · Cited by 2,780 · cited 2×
“The program also computed the percentage of words belonging to The Academic Word List (Coxhead 2000), and the percentage of words that did not appear in any of these lists.”
MethodOptimizing rating scale category effectiveness.
Linacre, J. M. (2002) · PubMed · Cited by 1,689
Robinson, P. (2001) · Applied Linguistics · doi:10.1093/applin/22.1.27 · Cited by 1,273 · cited 2×
“Robinson (2001) refers to this practice as indirect testing.”
BackgroundTowards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity
Norris, J. M., & Ortega, L. (2009) · Applied Linguistics · doi:10.1093/applin/amp044 · Cited by 1,250 · cited 1×
“We used three types of general indices: subordination, phrasal, and overall complexity (Norris and Ortega 2009).”
MethodPsycholinguistics: Experiments in spontaneous speech
Goldman-Eisler, F. (1968) · MPG.PuRe (Max Planck Society) · Cited by 1,215
Ortega, L. (2003) · Applied Linguistics · doi:10.1093/applin/24.4.492 · Cited by 1,018 · cited 1×
“Ortega (2003) also observes that “progress in a learner’s language ability for use may include syntactic complexification, but it also entails the development of discourse and sociolinguistics repertoires that the language user can adapt appropriately to particular communication demands” (493).”
BackgroundMeasuring spoken language: a unit for all reasons
Foster, P. (2000) · Applied Linguistics · doi:10.1093/applin/21.3.354 · Cited by 976 · cited 1×
“Complexity by subordination was expressed as the proportion of clauses to analysis of speech units (AS-units, Foster et al. 2000).”
MethodMcCarthy, P. M., & Jarvis, S. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.381 · Cited by 905 · cited 2×
“It was also not possible to supplement D with the measure of textual lexical diversity (MTLD) as recommended by McCarthy and Jarvis (2010). The MTLD tool requires a minimum of 100 tokens, and 43.”
MethodSkehan, P. (2003) · Language Teaching · doi:10.1017/s026144480200188x · Cited by 889
CAF: Defining, Refining and Differentiating Constructs
Pallotti, G. (2009) · Applied Linguistics · doi:10.1093/applin/amp045 · Cited by 462 · cited 5×
“4 The overwhelming focus on learners’ lexico-grammar appears a shortcoming (Pallotti 2009),”
BackgroundMethodInfluentialAssessed Levels of Second Language Speaking Proficiency: How Distinct?
Iwashita, N., Brown, A., McNamara, T., & O'Hagan, S. (2007) · Applied Linguistics · doi:10.1093/applin/amm017 · Cited by 409
What makes speech sound fluent? The contributions of pauses, speed and repairs
Bosker, H. R., Pinget, A.-F., Quené, H., Sanders, T., & de Jong, N. H. (2013) · Language Testing · doi:10.1177/0265532212455394 · Cited by 301 · cited 1×
“The fact that filled pause frequency, a breakdown fluency measure, had the strongest effect on adequacy is in line with the findings of fluency research, where perceived fluency judged by raters is consistently found to have strong associations with breakdown fluency (see Bosker et al. 2013).”
ResultFACETS OF SPEAKING PROFICIENCY
de Jong, N. H., Steinel, M. P., Florijn, A. F., Schoonen, R., & Hulstijn, J. H. (2012) · Studies in Second Language Acquisition · doi:10.1017/s0272263111000489 · Cited by 265
Linguistic skills and speaking fluency in a second language
DE JONG, N. H., STEINEL, M. P., FLORIJN, A., SCHOONEN, R., & HULSTIJN, J. H. (2013) · Applied Psycholinguistics · doi:10.1017/s0142716412000069 · Cited by 215 · cited 1×
“Following De Jong et al. (2013), speed fluency was operationalized as inverse articulation rate or mean duration of syllables, which we obtained by dividing speaking time (excluding pauses) with the number of syllables.”
MethodGinther, A., Dimova, S., & Yang, R. (2010) · Language Testing · doi:10.1177/0265532210364407 · Cited by 158 · cited 2×
“22 those of Ginther et al. (2010), who identified significant relationships between speaking”
BackgroundDeriving oral assessment scales across different tests and rater groups
Chalhoub-Deville, M. B. (1995) · Language Testing · doi:10.1177/026553229501200102 · Cited by 150 · cited 1×
“Our rationale for selecting both linguistically aware and naïve raters was to control for the impact of rater background on rater severity and orientation (e.g., Chalhoub-Deville 1995).”
BackgroundMethods of Morpheme Quantification: Their Effect on the Interpretation of Second Language Data
Pica, T. (1983) · Studies in Second Language Acquisition · doi:10.1017/s0272263100000309 · Cited by 134 · cited 1×
“Except for subject-verb agreement, scores of target-like use (TLU, Pica 1983) were also computed to capture instances of over-suppliance.”
MethodCalibrating graded assessments: Rasch partial credit analysis of performance in writing
Pollitt, A., & Hutchinson, C. (1987) · Language Testing · doi:10.1177/026553228700400107 · Cited by 98
Hulstijn, J. H., Schoonen, R., de Jong, N. H., Steinel, M. P., & Florijn, A. F. (2011) · Language Testing · doi:10.1177/0265532211419826 · Cited by 87 · cited 2×
“Using the same dataset, Hulstijn et al. (2012) examined the association between communicative”
BackgroundAn investigation of second language task-based performance assessments
Brown, J. D. (2002) · Medical Entomology and Zoology · Cited by 83
Providing Validity Evidence for a Speaking Test Using FACETS
Kim, H.-J. (2006) · Studies in Applied Linguistics and TESOL · doi:10.7916/d8jw8sdw · Cited by 8
Cited by
Task-Based Language Teaching: Theory and Practice
Ellis, R., Skehan, P., Li, S., Shintani, N., & Lambert, C. (2019) · doi:10.1017/9781108643689 · Cited by 407
Fluency in Second Language Testing: Insights From Different Disciplines
De Jong, N. H. (2018) · Language Assessment Quarterly · doi:10.1080/15434303.2018.1477780 · Cited by 139
Aspects of Fluency Across Assessed Levels of Speaking Proficiency
TAVAKOLI, P., NAKATSUHARA, F., & HUNTER, A. (2020) · The Modern Language Journal · doi:10.1111/modl.12620 · Cited by 98
Tavakoli, P., & Hunter, A.-M. (2018) · Language Teaching Research · doi:10.1177/1362168817708462 · Cited by 96
Saito, K. (2020) · Language Learning · doi:10.1111/lang.12387 · Cited by 74
Metadata
- Authors
- Revesz, A., Ekiert, M., & Torgersen, E. N.
- Venue
- Applied Linguistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-12-03
- ISSN
- 0142-6001 (ISSN-L)
- 1477-450X
- OpenAlex
- W2036198900
- Cited by
- 161
- References
- 25
- FWCI
- 19.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.