The Relationship Between Utterance and Perceived Fluency: A Meta‐Analysis of Correlational Studies
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Listener‐based judgements of fluency play an important role in second language (L2) communication contexts and in L2 assessment. Accordingly, our meta‐analysis examined the relationship between different aspects of utterance fluency and listener‐based judgements of perceived fluency by analyzing primary studies reporting correlation coefficients between objective measures of temporal features and subjective ratings of fluency. We analyzed 263 effect sizes from 22 studies (N = 335–746) to calculate the mean effect sizes of the links between utterance and perceived fluency. We also investigated the moderator effects of 11 methodological factors—such as speech stimuli, listeners’ background, rating procedure, and computation of utterance fluency measures—on the relationship between utterance and perceived fluency. Perceived fluency was strongly associated with speed and pause frequency, r = |.59–.62|; moderately with pause duration, r = |.46|; and weakly with repair fluency, r = |.20|; while composite measures showed the strongest effect sizes, r = |.72–.76|. Moderator analyses revealed that the utterance–perceived fluency link is influenced by methodological variables related to how speech samples are prepared for listeners’ judgements and how listeners’ attention is directed in evaluations of fluency. These findings suggest future directions for L2 fluency research and implications for language assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328 · cited 2×
“Mixed-effects modelling allows for multiple observations for the same item (here, ratings from multiple raters to one speech sample), as opposed to multiple regression (Barr et al., 2013).”
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1×
“We decided to exclude influential cases for the sake of robust estimates of aggregated effect sizes (Viechtbauer & Cheung, 2010).”
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
Doing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021) · doi:10.1201/9781003107347 · Cited by 1,850
Using uh and um in spontaneous speaking
Clark, H. (2002) · Cognition · doi:10.1016/s0010-0277(02)00017-3 · Cited by 1,235
Cognitive Bases of Second Language Fluency
Segalowitz, N. (2010) · doi:10.4324/9780203851357 · Cited by 881
Exploring measures and perceptions of fluency in the speech of second language learners
Kormos, J., & Dénes (2004) · System · doi:10.1016/j.system.2004.01.001 · Cited by 679 · cited 8×
“Previous research findings suggest that even while having received instructions to focus on temporal features, raters’ perceptions of fluency tend to be influenced by nontemporal features as well (e.g., grammatical errors; Kormos & Dénes, 2004; Rossiter, 2009; Suzuki & Kormos, 2020).”
InfluentialSelf-citationMethodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568 · cited 1×
“…of publication bias (i.e., the tendency of published studies to report larger or significant effect sizes and, subsequently, the potential suppression of small or nonsignificant effect sizes in published articles; Pigott & Polanin, 2019), we included dissertations and conference proceedings.”
THE RELATIONSHIP BETWEEN L1 FLUENCY AND L2 FLUENCY DEVELOPMENT
Derwing, T. M., Munro, M. J., Thomson, R. I., & Rossiter, M. J. (2009) · Studies in Second Language Acquisition · doi:10.1017/s0272263109990015 · Cited by 289 · cited 4×
“, initial 30 seconds) are sufficient to elicit listener perception data in research contexts (Derwing, Thomson, & Munro, 2006; Derwing et al., 2009), whereas some studies have presented entire speech as stimuli, emphasizing the ecological validity of findings for language assessment contexts (e.”
InfluentialTASK REPETITION AND SECOND LANGUAGE SPEECH PROCESSING
Lambert, C., Kormos, J., & Minn, D. (2017) · Studies in Second Language Acquisition · doi:10.1017/s0272263116000085 · Cited by 281 · cited 1×
“In addition, repeated task performance has also been shown to result in gains in speed fluency and decrease of mid-clause pause frequency (Lambert et al., 2017).”
Self-citation
Cited by
How does learners’ L2 utterance fluency relate to their L1? A meta‐analysis
Gao, J., & Sun, P. P. (2024) · International Journal of Applied Linguistics · doi:10.1111/ijal.12493 · Cited by 18
Yan, X., Lei, Y., & Pan, Y. (2025) · Language Learning · doi:10.1111/lang.12701 · Cited by 13
“On the other hand, similarly to Suzuki et al. (2021), we also adopt a fine-grained classification of ut-terance fluency features, to examine how the fluency–proficiency relationship might differ across fluency dimensions and individual features.”
InfluentialThe moderating role of L2 proficiency in the predictive power of L1 fluency on L2 utterance fluency
Suzuki, S., & Kormos, J. (2025) · Language Testing · doi:10.1177/02655322241241851 · Cited by 10
“Following prior research (e.g., Bosker et al., 2013), the threshold for silent pauses was defined as 250 ms (see also Suzuki et al., 2021).”
Self-citationSuzuki, S., Takatsu, H., Matsuura, R., Koyama, M., Saeki, M., & Matsuyama, Y. (2025) · Language Testing · doi:10.1177/02655322251348725 · Cited by 6
Self-citationComparative judgement for advancing research in applied linguistics
Thwaites, P., & Paquot, M. (2024) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2024.100142 · Cited by 3
Metadata
- Authors
- SUZUKI, S., KORMOS, J., & UCHIHARA, T.
- Venue
- The Modern Language Journal
- Publisher
- Wiley
- Published
- 2021-05-04
- Volume
- 105
- Issue
- 2
- Pages
- 435-463
- ISSN
- 0026-7902 (ISSN-L)
- 1540-4781
- OpenAlex
- W3137244216
- Cited by
- 92
- References
- 17
- FWCI
- 57.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.