The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index; none of the 81 sources its claims cite is checked for support yet.
A systematic-narrative review of performance-based assessments of critical thinking in higher education
Open accessAbstract
Critical thinking encompasses a complex interplay of cognitive skills, knowledge, and dispositions. In this systematic-narrative review, we analyze performance-based assessments of critical thinking in higher education. The aim is to explore how prior peer-reviewed empirical studies conceptualize and assess critical thinking, the methods and frameworks employed, and the specific aspects measured. A total of 28 articles from 2013 to 2023 were included in the analysis. The findings indicate that the majority of studies utilized open-ended performance tasks to measure critical thinking, while selected-response tasks were less common. There was no consistent theoretical framework referenced across the studies. Most studies defined critical thinking as a skill or a set of skills, with some also emphasizing the importance of disposition. The skill-based perspective was also emphasized in the measured aspects, with evaluation and inference as the most frequently assessed skills. None of the reviewed studies explicitly expressed dispositions in their targets of assessment. The results revealed misalignment between the definition of critical thinking and performance-based assessments of critical thinking. Future directions for these assessments are discussed.
Overview
CoChat Summary
TL;DR
This systematic-narrative review analyzes 28 peer-reviewed empirical studies (2013–2023) of performance-based assessments of critical thinking in higher education, finding that open-ended performance tasks dominate and that CLA-based tasks are heavily relied upon. The authors report a misalignment between how critical thinking is defined (often as skills only) and what is actually assessed, with dispositions never explicitly targeted.
Key findings
- Of the 28 articles, 18 used open-ended performance tasks or written assignments, 6 used selected-response questions or Likert-type items, and 4 combined both; 11 studies used CLA tasks or CLA-based adaptations, 4 used iPAL tasks, 3 used GEFSA, 1 used CAT, and 3 used researcher-developed assignments.
- No consistent theoretical framework was referenced; the most cited were Halpern (n = 9), Ennis (n = 8) and Facione/Delphi (n = 7). Seventeen studies defined critical thinking as a skill or set of skills, 11 also emphasized disposition, and 3 did not define it at all.
- Evaluation (21 articles) and inference (17) were the most frequently measured skills, followed by explanation (14), interpretation (11), analysis (7) and self-regulation (2). No article focused on all six Facione skills, and none explicitly assessed dispositions.
- Twelve articles measured skills outside Facione's framework: writing mechanics (5), group skills (3), language skills (3), statistical skills (2) and ethical skills (2).
Methods
- Systematic-narrative review: the identification, screening and data-extraction phases followed PRISMA where applicable, followed by a narrative qualitative content analysis (Elo et al. 2014) with investigator triangulation.
- Searches in EBSCOhost, Scopus and Social Science Database (spring 2024) yielded 188 articles (53, 40 and 95 respectively); after removing 20 duplicates, 51 remained after title/abstract screening, 20 more were removed, and 28 articles were included in the final analysis.
- Inclusion required peer-reviewed empirical research on higher education students' critical thinking using performance-based assessment; self-reports, reviews, policy, curriculum and theoretical articles and teacher/employer perspectives were excluded. Measured aspects were categorized using Facione's (1990) framework.
Limitations
- Stated: analyzing the measured aspects required interpretation because concepts in the reviewed articles were not always clearly defined, and terms such as "analysis" were used inconsistently with Facione's definition; excluding self-report studies may explain why dispositions were not prominent, since dispositions may be easier to capture via self-report; findings are constrained by the studies available at the time of review.
- Evident from the text: the review is limited to English-language, peer-reviewed articles published 2013–2023, and the authors note the field is narrow with a high concentration of CLA-based studies, which may limit generalizability of the synthesis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 47 Not checked · 89 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the reviewed studies (see ), in total, ten studies administered selected-response questions in measuring critical thinking.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“In certain studies, critical thinking was determined as one of the generic skills or transferable skills without providing a more detailed definition of critical thinking or what critical thinking includes (Rhodes et al. Citation2016; Rhodes, Danaher, and Kranov Citation2017; Rhodes, Danaher, and Kranov Citation2018; Van Damme et al. Citation2023).”
What the sources say
- Not matchedcites Rhodes et al. Citation2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Rhodes, Danaher, and Kranov Citation2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Rhodes, Danaher, and Kranov Citation2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, none of the articles focused on all six skills, and none of the skills were present in all articles.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Almost all of the studies defined which dimensions or skills of critical thinking were measured.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In twelve articles, other skills than the ones listed in Facione’s (Citation1990) framework were measured.”
What the sources say
- Not matchedcites Facione Citation1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
63 more claims
Create a free account to see all 137 claims and every source verdict.
- Probably not a substantial claim. 59
- It may state two separate claims as one. 18
- The quote only partly states this claim. 2
- Borderline: one of the tests for a substantial claim is unclear. 1
Citations
Cites
Qualitative Content Analysis: A Focus on Trustworthiness
Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014) · Sage Open · doi:10.1177/2158244014522633 · Cited by 4,395
Thought and Knowledge: An Introduction to Critical Thinking
Halpern, D. F. (1989) · Cited by 1,636
Denzin, N. K. (2012) · Journal of Mixed Methods Research · doi:10.1177/1558689812437186 · Cited by 1,444
Strategies for Teaching Students to Think Critically: A Meta-Analysis
Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015) · Review of Educational Research · doi:10.3102/0034654314551063 · Cited by 932
Liu, O. L., Frankel, L., & Roohr, K. C. (2014) · ETS Research Report Series · doi:10.1002/ets2.12009 · Cited by 340
Tiruneh, D. T., Verburgh, A., & Elen, J. (2014) · Higher Education Studies · doi:10.5539/hes.v4n1p1 · Cited by 255
The international state of research on measurement of competency in higher education
Zlatkin-Troitschanskaia, O., Shavelson, R. J., & Kuhn, C. (2015) · Studies in Higher Education · doi:10.1080/03075079.2015.1004241 · Cited by 186
El Soufi, N., & See, B. H. (2019) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2018.12.006 · Cited by 183
Assessment of University Students’ Critical Thinking: Next Generation Performance Assessment
Shavelson, R. J., Zlatkin‐Troitschanskaia, O., Beck, K., Schmidt, S., & Mariño, J. P. (2019) · International Journal of Testing · doi:10.1080/15305058.2018.1543309 · Cited by 166
Turnbull, D., Chugh, R., & Luck, J. (2023) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100381 · Cited by 164 · cited 1×
“The aim of this systematic-narrative literature review (Turnbull, Chugh, and Luck 2023) is to report how prior peer-reviewed empirical studies on performance-based assessments of critical thinking view and conceptualize critical thinking, what methods and frameworks are used, and what aspects of…”
Research works printed but not linked: 3
- Facione, P. A. 1990. “Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction.” In The Delphi Report. Millbrae, CA: California Academic Press.
- ∗Rhodes, A., M. M. Danaher, and A. A. Kranov. 2017. “Assessing Students’ Foundation Skills Prior to the STEM Majors.” Global Journal of Engineering Education 19 (3): 194–199.
- ∗Rhodes, A., M. M. Danaher, A. A. Kranov, and L. Isaacson. 2016. “Measuring Attainment of Foundation Skills in General Education at a Public University in the United Arab Emirates.” World Transactions on Engineering and Technology Education 14 (4): 506–512.
Cited by
Massara, G. V., Ryan, C. B., & Mallia, M. E. (2026) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-02-2025-0116 · Cited by 1
Juma, A. A. (2026) · International Journal of Educational Reform · doi:10.1177/10567879261448915
Павлович, Т. Д., & Tarasova, K. V. (2026) · Высшее образование в России · doi:10.31992/0869-3617-2026-35-4-85-104
Yin, S., Wu, R., Liu, X., & Li, R. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1896963
Metadata
- Authors
- Hyytinen, H., Jämsä, M., Tuononen, T., & Kleemola, K.
- Affiliations
- University of Eastern Finland (FI)
- University of Helsinki (FI)
- Corresponding author
- Hyytinen, Heidi
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2025-09-07
- Volume
- 50
- Issue
- 8
- Pages
- 1293-1310
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W4414043352
- Semantic Scholar
- d2a9da0d786edb024b785d6d28137e7c59a6f1b3
- Cited by
- 9
- References
- 44
- Citations by year
- 2026: 9
- FWCI
- 3.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Assessment & Evaluation in Higher Education (publishedVersion, cc-by)
- Työväentutkimus Vuosikirja (submittedVersion)
- Funders
- Ministry of Education and Culture, Finland (VN/22786/2022-OKM-2)
- Topics
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- critical thinking, performance-based assessment, higher education, critical thinking disposition, critical thinking skills, evaluation framework, definition of critical thinking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic-narrative review of performance-based assessments of critical thinking in higher education. https://app.cochat.ai/papers/10.1080/02602938.2025.2553341
- The paper
- Hyytinen, H., Jämsä, M., Tuononen, T., & Kleemola, K. (2025). A systematic-narrative review of performance-based assessments of critical thinking in higher education. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2025.2553341
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.