Open Science and Transparency in Applied Linguistics Research
Abstract
The Open Science (OS) movement embodies major shifts in research practices, from initial design, through peer review, to dissemination of findings. The ultimate aim of the movement is to improve transparency of research by making the entire research process accessible to all. OS encompasses a wide range of practices on a continuum of openness that are being adopted to different extents across different areas and subdomains within applied linguistics. This entry describes these practices and their driving forces, examines the extent to which OS practices are established in the field of applied linguistics, and considers some of the (potential) benefits and challenges of OS.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Quality in qualitative research can be discerned both from authors' descriptions of how the study was designed and conducted as well as their explicit accounts of how quality was attended to, typically in the methodology section.
“Consequently, quality in qualitative research can be discerned both from authors ' descriptions of how the study was designed and conducted as well as their explicit accounts of how quality was attended to, typically in the methodology section of research articles (Marsden, 2019; Stenfors et al., 2020).”
From How do language education researchers attend to quality in qualitative studies? (2025) · cites this paper as Marsden, 2019
Assessments of study quality determine whether manuscripts submitted to academic journals are put forward for review and are central to the peer review process.
“Assessments of study quality determine whether manuscripts submitted to academic journals are put forward for review (Mahboob et al., 2016) and are central to the peer review process itself (Marsden, 2019).”
From How do language education researchers attend to quality in qualitative studies? (2025) · cites this paper as Marsden, 2019
In research reporting, there is an expectation that authors both implicitly and explicitly attend to study quality, albeit research articles in language education are subject to publication word limits.
“On this basis, in research reporting, there is an expectation that authors both implicitly and explicitly attend to study quality, albeit research articles in language education, as elsewhere, are subject to (often restrictive) publication word limits (Marsden, 2019).”
From How do language education researchers attend to quality in qualitative studies? (2025) · cites this paper as Marsden, 2019
Cites
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397 · see citing works
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · see citing works
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989 · see citing works
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798 · see citing works
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700 · see citing works
Registered reports: a new publishing initiative at Cortex.
Chambers, C. (2013) · Cortex; a journal devoted to the study of the nervous system and behavior · doi:10.1016/j.cortex.2012.12.016 · Cited by 666 · see citing works
Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration
Mellers, B., Hertwig, R., & Kahneman, D. (2001) · Psychological Science · doi:10.1111/1467-9280.00350 · Cited by 448 · see citing works
What Drives Academic Data Sharing?
Fecher, B., Friesike, S., & Hebing, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0118053 · Cited by 351 · see citing works
The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
Morey, R. D., Chambers, C., Etchells, P. J., Harris, C. R., Hoekstra, R., Lakens, D., Lewandowsky, S., Morey, C. C., Newman, D. P., Schönbrodt, F. D., et al. (2016) · Royal Society Open Science · doi:10.1098/rsos.150547 · Cited by 278 · see citing works
Marsden, E. J., Morgan‐Short, K., Thompson‐Lee, S., & Abugaber, D. (2018) · Language Learning · doi:10.1111/lang.12286 · Cited by 270 · see citing works
Self-citationMackey, A., & Marsden, E. J. (2015) · Cited by 241 · see citing works
Self-citationLarson‐Hall, J., & Plonsky, L. (2015) · Language Learning · doi:10.1111/lang.12115 · Cited by 207 · see citing works
A Meta‐Analysis of Reliability Coefficients in Second Language Research
Plonsky, L., & Derrick, D. J. (2016) · Modern Language Journal · doi:10.1111/modl.12335 · Cited by 187 · see citing works
A methodological synthesis of self-paced reading in second language research
Marsden, E. J., Thompson‐Lee, S., & Plonsky, L. (2018) · Applied Psycholinguistics · doi:10.1017/s0142716418000036 · Cited by 181 · see citing works
Self-citationBerez-Kroeker, A. L., Gawne, L., Kung, S. S., Kelly, B. F., Heston, T., Holton, G., Pulsifer, P., Beaver, D. I., Chelliah, S. L., Dubinsky, S., et al. (2017) · Linguistics · doi:10.1515/ling-2017-0032 · Cited by 169 · see citing works
The Seven Deadly Sins of Psychology
Chambers, C. (2017) · Princeton University Press eBooks · doi:10.1515/9781400884940 · Cited by 143 · see citing works
Marsden, E. J., & Kasprowicz, R. (2017) · Modern Language Journal · doi:10.1111/modl.12426 · Cited by 140 · see citing works
Self-citationA methodological synthesis and meta-analysis of judgment tasks in second language research
Plonsky, L., Marsden, E. J., Crowther, D., Gass, S. M., & Spinner, P. (2019) · Second language Research · doi:10.1177/0267658319828413 · Cited by 101 · see citing works
Self-citationGiofrè, D., Cumming, G., Fresc, L., Boedker, I., & Tressoldi, P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175583 · Cited by 98 · see citing works
Instrument Reporting Practices in Second Language Research
Derrick, D. J. (2015) · TESOL Quarterly · doi:10.1002/tesq.217 · Cited by 82 · see citing works
Qualitative Secondary Analysis and Social Explanation
Irwin, S., & Winterton, M. (2012) · Sociological Research Online · doi:10.5153/sro.2626 · Cited by 69 · see citing works
Morgan‐Short, K., Marsden, E. J., Heil, J., Issa, B. I., Leow, R. P., Mikhaylova, A., Mikołajczak, S., Moreno, N., Slabakova, R., & Szudarski, P. (2018) · Language Learning · doi:10.1111/lang.12292 · Cited by 68 · see citing works
Self-citationMarsden, E. J., Morgan‐Short, K., Trofimovich, P., & Ellis, N. C. (2018) · Language Learning · doi:10.1111/lang.12284 · Cited by 67 · see citing works
Self-citationSharing Data and Materials in Psychological Science
Lindsay, D. S. (2017) · Psychological Science · doi:10.1177/0956797617704015 · Cited by 62 · see citing works
Transparency and Openness Promotion (TOP) GuidelinesPreprint
Nosek, B. A., Alter, G. C., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S., Buck, S., Chambers, C., Chin, G. J., Christensen, G., et al. (2016) · doi:10.31219/osf.io/vj54c · Cited by 60 · see citing works
Pre-Analysis Plans for Qualitative Research
Rodríguez, R. P., & Rosenblatt, F. (2016) · Revista de ciencia política · doi:10.4067/s0718-090x2016000300009 · Cited by 53 · see citing works
SPLLOC: A new database for Spanish second language acquisition research
Mitchell, R., Domínguez, L., Arche, M. J., Myles, F., & Marsden, E. J. (2008) · EUROSLA Yearbook · doi:10.1075/eurosla.8.15smit · Cited by 49 · see citing works
Self-citationMapping the Universe of Registered ReportsPreprint
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · doi:10.31222/osf.io/fzpcy · Cited by 21 · see citing works
Trofimovich, P., & Ellis, N. C. (2015) · Language Learning · doi:10.1111/lang.12134 · Cited by 10 · see citing works
DEKEYSER, R. M., & Schoonen, R. (2007) · Language Learning · doi:10.1111/j.1467-9922.2007.00396_2.x · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
(Why) Are Open Research Practices the Future for the Study of Language Learning?
Marsden, E. J., & Morgan‐Short, K. (2023) · Language Learning · doi:10.1111/lang.12568 · Cited by 49 · see citing works
Self-citationReplication and Open Science in Applied Linguistics ResearchPreprint
McManus, K. (2021) · doi:10.31219/osf.io/bqr9w · Cited by 35 · see citing works
The future of replication in applied linguistics: Toward a standard for replication studies
McManus, K. (2024) · Annual Review of Applied Linguistics · doi:10.1017/s0267190524000011 · Cited by 19 · see citing works
“…efforts like these are also in lockstep with significant and growing interest in Open Science initiatives that aim to make scholarship more open, inclusive, and transparent (e.g., Open Science badges, study preregistration, preprints, postprints; see Liu, 2023; Marsden, 2019; Plonsky, 2024).”
How do language education researchers attend to quality in qualitative studies?
Mirhosseini, S.-A., & Pearson, W. S. (2025) · Language Teaching · doi:10.1017/s0261444824000053 · Cited by 17 · see citing works
“…quality in qualitative research can be discerned both from authors ’ descriptions of how the study was designed and conducted as well as their explicit accounts of how quality was attended to, typically in the methodology section of research articles (Marsden, 2019; Stenfors et al., 2020).”
InfluentialWolfer, S., Koplenig, A., Kupietz, M., & Müller-Spitzer, C. (2023) · Data · doi:10.3390/data8110170 · Cited by 3 · see citing works
“This not only complicates things considerably when compiling corpora but is also an obstacle for efforts regarding standards of open science [2].”
BackgroundCho, T. (2021) · Journal of Phonetics · doi:10.1016/j.wocn.2021.101113 · Cited by 2 · see citing works
Kyle, K. D. (2022) · Vocabulary Learning and Instruction · doi:10.7820/vli.v11.2kyle · Cited by 1 · see citing works
“While a brief overview of OS practices are provided below, the readers are referred to in-depth treatments of OS in applied linguistic research such as Marsden (2012, 2018, 2019), In’Nami et al. (2022), and Marsden and Mackey (2014), among others.”
- Authors
- Marsden, E.
- Corresponding author
- Marsden, Emma
- ORCID
- Marsden, Emma
- Venue
- The Encyclopedia of Applied Linguistics
- Publisher
- Wiley
- Published
- 2019-06-21
- Pages
- 1-10
- OpenAlex
- W3020723420
- Cited by
- 6
- References
- 30
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 1 · 2021: 2
- Type
- reference entry
- Language
- en
- Open access
- closed
- Locations
- The Encyclopedia of Applied Linguistics (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Physical Sciences › Computer Science › Computer Science Applications › Open Education and E-Learning
- Keywords
- open science, research transparency, applied linguistics, research practices, peer review, research dissemination, open science movement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
