The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
A Meta‐Analysis of Reliability Coefficients in Second Language Research
Abstract
Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates, this article meta‐analyzes reliability coefficients (internal consistency, interrater, and intrarater) as reported in published L2 research. We recorded 2,244 reliability estimates in 537 individual articles along with study (e.g., sample size) and instrument features (e.g., item formats) proposed to influence reliability. We also coded for the indices employed (e.g., alpha, KR20). The coefficients were then aggregated (i.e., meta‐analyzed). The three types of reliability varied, with internal consistency as the lowest: median = .82. Interrater and intrarater estimates were substantially higher (.92 and .95, respectively). Overall estimates were also found to vary according to study and instrument features such as proficiency (low = .79, intermediate = .84, advanced = .89) and target skill (e.g., writing = .88 vs. listening = .77). We use our results to inform and encourage interpretations of reliability estimates relative to the larger field as well as to the substantive and methodological features particular to individual studies and subdomains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis
Norris, J. M., & Ortega, L. (2000) · Language Learning · doi:10.1111/0023-8333.00136 · Cited by 2,569
A systematic review and meta-analysis of the cognitive correlates of bilingualism
Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010) · Review of Educational Research · doi:10.3102/0034654310368803 · Cited by 1,132
MEASURING IMPLICIT AND EXPLICIT KNOWLEDGE OF A SECOND LANGUAGE: A Psychometric Study
Ellis, R. (2005) · Studies in Second Language Acquisition · doi:10.1017/s0272263105050096 · Cited by 1,032
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737
Plonsky (2013) · doi:10.1017/s0272263113000399 · Cited by 347
Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research
Plonsky, L., & Gass, S. (2011) · Language Learning · doi:10.1111/j.1467-9922.2011.00640.x · Cited by 267
Self-citation
Cited by
SECOND LANGUAGE ANXIETY AND ACHIEVEMENT: A META-ANALYSIS
Teimouri, Y., Goetze, J., & Plonsky, L. (2019) · Studies in Second Language Acquisition · doi:10.1017/s0272263118000311 · Cited by 611
Self-citationL2 grit: passion and perseverance for second-language learning
Teimouri, Y., Plonsky, L., & Tabandeh, F. (2022) · Language Teaching Research · doi:10.1177/1362168820921895 · Cited by 503
Self-citationMultiple Regression in L2 Research: A Methodological Synthesis and Guide to Interpreting R2Values
PLONSKY, L., & GHANBAR, H. (2018) · The Modern Language Journal · doi:10.1111/modl.12509 · Cited by 321
Self-citationSaito, K., & Plonsky, L. (2019) · Language Learning · doi:10.1111/lang.12345 · Cited by 282
Self-citationZhang, S., & Zhang, X. (2022) · Language Teaching Research · doi:10.1177/1362168820913998 · Cited by 273
Metadata
- Authors
- PLONSKY, L., & DERRICK, D. J.
- Venue
- The Modern Language Journal
- Publisher
- Wiley
- Published
- 2016-04-28
- Volume
- 100
- Issue
- 2
- Pages
- 538-553
- ISSN
- 0026-7902 (ISSN-L)
- 1540-4781
- OpenAlex
- W2344634402
- Cited by
- 183
- References
- 7
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Meta‐Analysis of Reliability Coefficients in Second Language Research. https://app.cochat.ai/papers/10.1111/modl.12335
- The paper
- PLONSKY, L., & DERRICK, D. J. (2016). A Meta‐Analysis of Reliability Coefficients in Second Language Research. The Modern Language Journal. https://doi.org/10.1111/modl.12335
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.