The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
Lessons Learned from PISA: A Systematic Review of Peer-Reviewed Articles on the Programme for International Student Assessment
Open accessAbstract
International large-scale assessments are on the rise, with the Programme for International Student Assessment (PISA) seen by many as having strategic prominence in education policy debates. The present article reviews PISA-related English-language peer-reviewed articles from the programme’s first cycle in 2000 to its most current in 2015. Five literature bases were searched, and results were analysed with SPSS. Results map the frequency of publications according to journal, country, and scientific discipline. They also summarise major themes within three identified categories: secondary analysis, policy impact, and critiques. Findings indicated that studies based on the PISA dataset has led to progress in educational research while simultaneously pointing to the need for caution when using this research to inform educational policy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research
Sirin, S. R. (2005) · Review of Educational Research · doi:10.3102/00346543075003417 · Cited by 4,687 · cited 1×
“The choice seems justified as the theme represents one of the major concerns in educational research (Sirin, 2005) and receives substantial attention in PISA’s design (see economic, social and cultural status [ESCS] construct) and reporting of findings.”
BackgroundJournal for Research in Mathematics Education
(2023) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc · Cited by 2,764
(2021) · Teachers College Record The Voice of Scholarship in Education · doi:10.1111/(issn)1467-9620 · Cited by 2,370
Adapting Educational and Psychological Tests for Cross-Cultural Assessment
(2004) · Psychology Press eBooks · doi:10.4324/9781410611758 · Cited by 1,627
English Teaching, Practice and Critique
Burn, A., & Nixon, H. (2005) · Cited by 1,329
An Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Measurement reliability and agreement in psychiatry
Shrout, P. E. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700306 · Cited by 1,216
Governing by numbers: the PISA ‘effect’ in Europe
Grek, S. (2009) · Journal of Education Policy · doi:10.1080/02680930802412669 · Cited by 1,148
European Journal of Personality
(2006) · European Journal of Personality · doi:10.1002/(issn)1099-0984 · Cited by 565
Cited by
Inadequacies in the SES–Achievement model: Evidence from PISA and other studies
Marks, G. N., & O'Connell, M. (2021) · Review of Education · doi:10.1002/rev3.3293 · Cited by 47
Myoung, E., & Liou, P.-Y. (2025) · Sage Open · doi:10.1177/21582440251323560 · Cited by 13
Metadata
- Authors
- Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A.
- Venue
- Scandinavian Journal of Educational Research
- Publisher
- Informa UK Limited
- Published
- 2017-01-30
- Volume
- 62
- Issue
- 3
- Pages
- 333-353
- ISSN
- 0031-3831 (ISSN-L)
- 1470-1170
- OpenAlex
- W2583419491
- Cited by
- 283
- References
- 95
- FWCI
- 34.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Lessons Learned from PISA: A Systematic Review of Peer-Reviewed Articles on the Programme for International Student Assessment. https://app.cochat.ai/papers/10.1080/00313831.2016.1258726
- The paper
- Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons Learned from PISA: A Systematic Review of Peer-Reviewed Articles on the Programme for International Student Assessment. Scandinavian Journal of Educational Research. https://doi.org/10.1080/00313831.2016.1258726
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
