Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index; 5 of the 47 sources its claims cite were checked for support.

How do language education researchers attend to quality in qualitative studies?

Open access

Abstract

Abstract The steady expansion in qualitative research in the area of language education over the last two decades indicates the growing recognition of its importance to investigating issues of language teaching and learning. Along with this recognition, understanding and assessing the quality of qualitative studies in this area has gained increasing significance. Addressing this concern, in this research synthesis, we qualitatively explore how 236 qualitative language education studies published in seven leading journals explicitly foreground the issue of ‘research quality’. We conducted a qualitative content analysis of how authors of these studies addressed the main quality concepts proposed by well-known frameworks of qualitative research quality. Our findings, presented as ten major themes, show that qualitative researchers' overt treatment of research quality is realised based on three distinct orientations: no explicit quality criteria, positivist views of quality, and interpretive quality conceptions. We discuss aspects of these orientations and their implications for qualitative research in language education.

Overview

CoChat Summary

TL;DR

This research synthesis qualitatively analyzed how 236 qualitative language education studies published in seven leading journals (1999–2021) explicitly addressed research quality. It identified ten major quality themes and three orientations—no explicit quality criteria, positivist views of quality, and interpretive quality conceptions—with positivist terms such as validity and reliability still prevalent.

Key findings

  • Across 236 studies, the most frequent quality term was triangulation (105 mentions across 78 articles), followed by reliability (73/42), validity (63/46), trustworthiness (30/24), member checking (27/16), credibility (17/15), corroboration (15/12), rigor (14/12), thick description (9/8), transparency (8/8), reflexivity (8/4), transferability (7/7), dependability (3/3), and confirmability (1/1).
  • The authors grouped findings into three orientations: no explicit quality criteria; positivist views of quality, including inter-coder/inter-rater reliability, Cohen’s kappa, and Cronbach’s alpha; and interpretive quality conceptions, especially trustworthiness, credibility, member checking, and triangulation.
  • Triangulation was often described as merely collecting multiple data types, while validity and reliability were frequently used vaguely or in positivist senses; just one study made complete use of Lincoln and Guba’s componential trustworthiness model, and no studies formally adhered to other well-known frameworks such as Richardson, Spencer et al., Stewart, or Tracy.
  • The sample included 236 articles from Applied Linguistics (17), Foreign Language Annals (37), Language Learning (1), Language Teaching Research (29), Modern Language Journal (28), System (74), and TESOL Quarterly (50); 56% were single-author, 35% two-author, and 8% three-author works.

Methods

  • Research synthesis using qualitative content analysis of manifest content in 236 qualitative language education articles published in seven journals from 1999 to 2021.
  • Scopus searches generated 741 records; alternate records were excluded, 134 studies were eliminated, and full texts of the final 236 studies were imported into NVivo 12.
  • The authors searched lemma forms of quality concepts, exported 801 mentions, cleaned them to 380 relevant instances, coded them, and constellated codes into ten themes.

Limitations

  • Stated in the paper: the analysis was limited to manifest content rather than latent meaning; search terms depended on authors explicitly positioning studies as qualitative or ethnographic; cross-paradigmatic approaches such as feminist and participatory action research were excluded; specialist journals, non-primary-research journals, and book chapters were excluded; concepts with diverse linguistic operationalizations (e.g., prolonged engagement, evocative representation, contextual detail) were not feasible to include; member reflection and multivocality generated no hits; publication word limits constrained authors and the authors’ own reporting; and the researchers could not query authors directly about their use of terms.
  • Evident from the text: the sample was restricted to seven English-language journals indexed in Scopus, to articles labelled as “articles” and “final” versions, and to 1999–2021; distribution was uneven across journals and time (e.g., Language Learning contributed only 1 study); and the manifest-content approach may miss implicit quality work.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1017/s0261444824000053

Cites

80 of 80 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 0 Not valid · 48 Not checked · 79 Own results and interpretations

58 more claims

Create a free account to see all 132 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 50
  • It may state two separate claims as one. 35

Create a free account to see these claims.

Citations

Cites

Show all 72 references

Research works printed but not linked: 2

  1. Mayring, 2019, Qualitative content analysis: Demarcation, varieties, developments, Forum: Qualitative Social Research, 20, Art. 16
  2. Lincoln, 2011, Sage qualitative research methods, 399

Metadata

Authors
Mirhosseini, S.-A., & Pearson, W. S.
Affiliations
  • University of Hong Kong (HK)
  • University of Exeter (GB)
Corresponding author
Mirhosseini, Seyyed-Abdolhamid
Venue
Language Teaching
Published
2024-04-09
Volume
58
Issue
1
Pages
99-115
ISSN
  • 0261-4448 (ISSN-L)
  • 1475-3049
OpenAlex
W4394605836
Cited by
17
References
72
Citations by year
2026: 9 · 2025: 5 · 2024: 3
FWCI
21.49
Type
journal article
Language
en
Open access
Locations
  • Language Teaching (publishedVersion, cc-by)
  • The HKU Scholars Hub (University of Hong Kong) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Education › Qualitative Research Methods and Applications
  • Social Sciences › Education › Educational Research and Methods
  • Social Sciences › Sociology and Political Science › Qualitative Research Methods and Ethics
Keywords
research quality, qualitative research quality, language teaching research, quality standards, research reporting practices, quality framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How do language education researchers attend to quality in qualitative studies? https://app.cochat.ai/papers/10.1017/s0261444824000053
The paper
Mirhosseini, S.-A., & Pearson, W. S. (2025). How do language education researchers attend to quality in qualitative studies? Language Teaching. https://doi.org/10.1017/s0261444824000053

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.