The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Corpus Use in Language Learning: A Meta‐Analysis
Open accessAbstract
This study applied systematic meta‐analytic procedures to summarize findings from experimental and quasi‐experimental investigations into the effectiveness of using the tools and techniques of corpus linguistics for second language learning or use, here referred to as data‐driven learning (DDL). Analysis of 64 separate studies representing 88 unique samples reporting sufficient data indicated that DDL approaches result in large overall effects for both control/experimental group comparisons (d = 0.95) and for pre/posttest designs (d = 1.50). Further investigation of moderator variables revealed that small effect sizes were generally tied to small sample sizes. Research has barely begun in some key areas, and durability/transfer of learning through delayed posttesting remains an area in need of further investigation. Although DDL research demonstrably improved over the period investigated, further changes in practice and reporting are recommended. Open Practices: This article has been awarded Open Materials and Open Data badges. All materials and data are publicly accessible via the Open Science Framework at https://osf.io/jkktw. Learn more about the Open Practices badges from the Center for Open Science: https://osf.io/tvyxz/wiki.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“Nonetheless, publication bias is still likely insofar as studies which do not produce significant differences or other desired outcomes are more likely to remain unpublished altogether (N. Ellis, 2006), the famous file-drawer problem (Rosenthal, 1979).”
BackgroundDistribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
The Role of Consciousness in Second Language Learning1
SCHMIDT, R. W. (1990) · Applied Linguistics · doi:10.1093/applin/11.2.129 · Cited by 5,435 · cited 1×
“DDL also provides access to the massive amounts of authentic language needed (input flood) but, crucially, it organizes it to make patterns salient, as is necessary for noticing (Schmidt, 1990).”
BackgroundVisible learning: a synthesis of over 800 meta‐analyses relating to achievement
Carter, M. (2009) · Educational Psychology · doi:10.1080/01443410903415150 · Cited by 4,581
Constructing a language: a usage-based theory of language acquisition
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1385 · Cited by 4,458
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Corpus, Concordance, Collocation
Green, P. N. (1992) · Cited by 3,465
(1998) · Cited by 2,572
Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis
Norris, J. M., & Ortega, L. (2000) · Language Learning · doi:10.1111/0023-8333.00136 · Cited by 2,569 · cited 6×
“Following Norris and Ortega (2000), where two control or comparison groups were involved, the one closest to the experimental design was chosen (e.g., traditional treatment rather than no treatment, dictionaries rather than no reference tools).”
BackgroundMethodResultInfluential(2011) · Cited by 2,025
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
Corpora in Applied Linguistics
Hunston, S. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9781139524773 · Cited by 1,616
Introduction to the Special Issue on the Web as Corpus
Kilgarriff, A., & Grefenstette, G. (2003) · Computational Linguistics · doi:10.1162/089120103322711569 · Cited by 929
Introduction: Investigating Form‐Focused Instruction
Ellis, R. (2001) · Language Learning · doi:10.1111/j.1467-1770.2001.tb00013.x · Cited by 826
Some empirical evidence for the involvement load hypothesis in vocabulary acquisition
Hulstijn, J. H., & Laufer, B. (2001) · Language Learning · doi:10.1111/0023-8333.00164 · Cited by 819 · cited 1×
“…Ayers, & Kalyuga, 2011), freeing up resources for the still considerable effort of meaning construction required on the part of the learner—effort being the often missing component in instructed language learning and a reliable predictor of both depth and retention (Hulstijn & Laufer, 2001).”
BackgroundLarsen-Freeman, D. (2006) · Applied Linguistics · doi:10.1093/applin/aml029 · Cited by 805
Interactions between type of instruction and type of language feature: A meta-analysis
Spada, N., & Tomita, Y. (2010) · Language Learning · doi:10.1111/j.1467-9922.2010.00562.x · Cited by 746
Synthesizing Research on Language Learning and Teaching
(2006) · Language Learning & Language Teaching · doi:10.1075/lllt.13 · Cited by 608
Goldschneider, J. M., & DeKeyser, R. M. (2001) · Language Learning · doi:10.1111/1467-9922.00147 · Cited by 554
Barrett, L., Dunbar, R., & Lycett, J. (2001) · Bloomsbury Academic eBooks · doi:10.1007/978-1-137-23550-3 · Cited by 502
From printout to handout: Grammar and vocabulary teaching in the context of Data-driven Learning
Johns, T. (1994) · Perspectives on Pedagogical Grammar · doi:10.1017/cbo9781139524605.014 · Cited by 489
An exercise in mega-silliness.
Eysenck, H. J. (1978) · American Psychologist · doi:10.1037//0003-066x.33.5.517.a · Cited by 466
The Effectiveness of Second Language Pronunciation Instruction: A Meta-Analysis
Lee, J., Jang, J., & Plonsky, L. (2015) · Applied Linguistics · doi:10.1093/applin/amu040 · Cited by 431
Lexical Priming: A New Theory of Words and Language
Hoey, M. (2012) · Routledge eBooks · doi:10.4324/9780203327630 · Cited by 411
The Effectiveness of Second Language Strategy Instruction: A Meta‐analysis
Plonsky, L. (2011) · Language Learning · doi:10.1111/j.1467-9922.2011.00663.x · Cited by 379
Twenty years of MALL project implementation: A meta-analysis of learning outcomes
Burston, J. (2015) · ReCALL · doi:10.1017/s0958344014000159 · Cited by 379
Lexical Analysis: Norms and Exploitations
Hanks, P. (2013) · doi:10.7551/mitpress/9780262018579.001.0001 · Cited by 358
A meta-analysis of effectiveness studies on computer technology-supported language learning
Grgurović, M., Chapelle, C. A., & Shelley, M. C. (2013) · ReCALL · doi:10.1017/s0958344013000013 · Cited by 301
Does Type of Instruction Make a Difference? Substantive Findings From a Meta‐analytic Review
Norris, J. M., & Ortega, L. (2001) · Language Learning · doi:10.1111/j.1467-1770.2001.tb00017.x · Cited by 248
Meta-analysis in Second Language Research: Choices and Challenges
Oswald, F. L., & Plonsky, L. (2010) · Annual Review of Applied Linguistics · doi:10.1017/s0267190510000115 · Cited by 237
Larson‐Hall, J., & Plonsky, L. (2015) · Language Learning · doi:10.1111/lang.12115 · Cited by 206
The Processing of Malformed Formulaic Language
Millar, N. (2011) · Applied Linguistics · doi:10.1093/applin/amq035 · Cited by 189
Plonsky, L. (2014) · The Modern Language Journal · doi:10.1111/j.1540-4781.2014.12058.x · Cited by 182
The CALL-SLA interface: Insights from a second-order synthesis
Plonsky, L., & Ziegler, N. (2016) · Language Learning & Technology · doi:10.64152/10125/44459 · Cited by 174
Data-driven Learning: The Perpetual Challenge
Johns, T. (2002) · Teaching and Learning by Doing Corpus Analysis · doi:10.1163/9789004334236_010 · Cited by 168
Classroom applicationsof corpus analysis
Cobb, T., & Boulton, A. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781139764377.027 · Cited by 151
Self-citation5. Effects of L2 instruction on interlanguage pragmatic development: A meta-analysis
Jeon, E. H., & Kaya, T. (2006) · Language Learning & Language Teaching · doi:10.1075/lllt.13.10jeo · Cited by 147
Corpus technology and language pedagogy : new resources, new tools, new methods
Braun, S., Kohn, K. W., & Mukherjee, J. (2006) · Cited by 136
The effects of hypertext glosses on L2 vocabulary acquisition: a meta-analysis
Yun, J. H. (2011) · Computer Assisted Language Learning · doi:10.1080/09588221.2010.523285 · Cited by 129
Applying constructivism: A test for the learner-as-scientist
Cobb, T. (1999) · Educational Technology Research and Development · doi:10.1007/bf02299631 · Cited by 121
Self-citationShintani, N., Li, S., & Ellis, R. (2013) · Language Learning · doi:10.1111/lang.12001 · Cited by 117
Plonsky, L., & Brown, D. (2014) · Second language Research · doi:10.1177/0267658314536436 · Cited by 116
Lin, H. (2014) · Language learning & technology · doi:10.64152/10125/44387 · Cited by 109
Popularising corpus consultation by language learners and teachers
Chambers, A. (2007) · BRILL eBooks · doi:10.1163/9789401203906_002 · Cited by 101
Bootstrapping in Applied Linguistics: Assessing its Potential Using Shared Data
Plonsky, L., Egbert, J., & LaFlair, G. T. (2014) · Applied Linguistics · doi:10.1093/applin/amu001 · Cited by 96
The unreasonable effectivness of CALL: What have we learned in two decades of research?
Felix, U. (2008) · ReCALL · doi:10.1017/s0958344008000323 · Cited by 90
Grammar and vocabulary: showing the connections
Hunston, S., Francis, G., & Manning, E. (1997) · ELT Journal · doi:10.1093/elt/51.3.208 · Cited by 88
The Future of Research Synthesis in Applied Linguistics: Beyond Art or Science
Norris, J. M., & Ortega, L. (2007) · TESOL Quarterly · doi:10.1002/j.1545-7249.2007.tb00105.x · Cited by 83
Online synonym materials and concordancing for EFL college writing
Yeh, Y., Liou, H., & Li, Y.-H. (2007) · Computer Assisted Language Learning · doi:10.1080/09588220701331451 · Cited by 69
Boulton, A. (2012) · Studies in corpus linguistics · doi:10.1075/scl.52.11bou · Cited by 49
Self-citationApplying data-driven learning to the web
Boulton, A. (2015) · Studies in corpus linguistics · doi:10.1075/scl.69.13bou · Cited by 48
Self-citationA meta-analysis of data-driven learning approach in the Japanese EFL classroom
Mizumoto, A., & Chujo, K. (2015) · Institutional Repositories DataBase (IRDB) · Cited by 44
9. Meta-analysis, human cognition, and language learning
Ellis, N. C. (2006) · Language Learning & Language Teaching · doi:10.1075/lllt.13.16ell · Cited by 36
Introduction: Complementarity in Research Syntheses
Ellis, R. (2015) · Applied Linguistics · doi:10.1093/applin/amv015 · Cited by 28
An Effective Way to Use Corpus Exercises to Learn Grammar Basics in English
Oghigian, K., & Chujo, K. (2010) · Language Education in Asia · doi:10.5746/leia/10/v1/a17/oghigian_chujo · Cited by 20
Cited by
Technology and the future of language teaching
Kessler, G. (2018) · Foreign Language Annals · doi:10.1111/flan.12318 · Cited by 529
Uchihara, T., Webb, S., & Yanagisawa, A. (2019) · Language Learning · doi:10.1111/lang.12343 · Cited by 300
The Effects of Corpus Use on Second Language Vocabulary Learning: A Multilevel Meta-analysis
Lee, H., Warschauer, M., & Lee, J. H. (2019) · Applied Linguistics · doi:10.1093/applin/amy012 · Cited by 256
Elgort, I. (2018) · CALICO Journal · doi:10.1558/cj.34554 · Cited by 37
Bennett, C., & Dhonnchadha, E. U. (2023) · Applied Corpus Linguistics · doi:10.1016/j.acorp.2023.100048 · Cited by 19
Metadata
- Authors
- Boulton, A., & Cobb, T.
- Venue
- Language Learning
- Publisher
- Wiley
- Published
- 2017-02-15
- Volume
- 67
- Issue
- 2
- Pages
- 348-393
- ISSN
- 0023-8333 (ISSN-L)
- 1467-9922
- OpenAlex
- W2587922133
- Cited by
- 580
- References
- 59
- FWCI
- 72.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.