Rubrics to assess critical thinking and information processing in undergraduate STEM courses
Open accessAbstract
Background: Process skills such as critical thinking and information processing are commonly stated outcomes for STEM undergraduate degree programs, but instructors often do not explicitly assess these skills in their courses. Students are more likely to develop these crucial skills if there is constructive alignment between an instructor’s intended learning outcomes, the tasks that the instructor and students perform, and the assessment tools that the instructor uses. Rubrics for each process skill can enhance this alignment by creating a shared understanding of process skills between instructors and students. Rubrics can also enable instructors to reflect on their teaching practices with regard to developing their students’ process skills and facilitating feedback to students to identify areas for improvement. Results: Here, we provide rubrics that can be used to assess critical thinking and information processing in STEM undergraduate classrooms and to provide students with formative feedback. As part of the Enhancing Learning by Improving Process Skills in STEM (ELIPSS) Project, rubrics were developed to assess these two skills in STEM undergraduate students’ written work. The rubrics were implemented in multiple STEM disciplines, class sizes, course levels, and institution types to ensure they were practical for everyday classroom use. Instructors reported via surveys that the rubrics supported assessment of students’ written work in multiple STEM learning environments. Graduate teaching assistants also indicated that they could effectively use the rubrics to assess student work and that the rubrics clarified the instructor’s expectations for how they should assess students. Students reported that they understood the content of the rubrics and could use the feedback provided by the rubric to change their future performance. Conclusion: The ELIPSS rubrics allowed instructors to explicitly assess the critical thinking and information processing skills that they wanted their students to develop in their courses. The instructors were able to clarify their expectations for both their teaching assistants and students and provide consistent feedback to students about their performance. Supporting the adoption of active-learning pedagogies should also include changes to assessment strategies to measure the skills that are developed as students engage in more meaningful learning experiences. Tools such as the ELIPSS rubrics provide a resource for instructors to better align assessments with intended learning outcomes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There are separate instruments focusing specifically on STEM students' critical thinking, information processing, scientific reasoning, and motivation and self-efficacy when reading PSL.
“there are separate instruments focusing specifically on STEM students’ critical thinking (e.g., White et al., 2011), information processing (Reynders et al., 2020), scientific reasoning (e.g., Moore and Rubbo, 2012), and motivation and self-efficacy when reading PSL (Chatzikyriakidou and McCartney, 2022).”
From Reading Primary Scientific Literature: Approaches for Teaching Students in the Undergraduate STEM Classroom (2023) · cites this paper as Reynders et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787 · see citing works
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1× · see citing works
“…need consistent feedback from an instructor and/or self-assessment throughout a course to provide a benchmark for their current performance and identify what they can do to improve their process skills (Black & Wiliam, 1998; Butler & Winne, 1995; Hattie & Gan, 2011; Nicol & Macfarlane-Dick, 2006).”
BackgroundBecoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 7,305 · cited 2× · see citing works
“Zimmerman’s theory of selfregulated learning (Zimmerman, 2002) provides a rationale for tailoring assessments to provide feedback to both students and instructors.”
BackgroundMethodNicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846 · see citing works
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084 · see citing works
Feedback and Self-Regulated Learning: A Theoretical Synthesis
Butler, D. L., & Winne, P. H. (1995) · Review of Educational Research · doi:10.3102/00346543065003245 · Cited by 3,334 · see citing works
Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century
Pellegrino, J. W., & Hilton, M. L. (2012) · Cited by 2,038 · see citing works
(1993) · Cited by 1,939 · see citing works
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · see citing works
Psychology of learning for instruction
Lohr, L., & Chang, S. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504860 · Cited by 1,165 · see citing works
Constructivism: A theory of knowledge
Bodner, G. M. (1986) · Journal of Chemical Education · doi:10.1021/ed063p873 · Cited by 1,027 · see citing works
Singer, S. R., & Smith, K. A. (2013) · Journal of Engineering Education · doi:10.1002/jee.20030 · Cited by 840 · see citing works
The use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839 · see citing works
Defining higher order thinking
Lewis, A., & Smith, D. (1993) · Theory Into Practice · doi:10.1080/00405849309543588 · Cited by 772 · see citing works
Why some students don't learn chemistry: Chemical misconceptions
Nakhleh, M. B. (1992) · Journal of Chemical Education · doi:10.1021/ed069p191 · Cited by 726 · see citing works
Purposely Teaching for the Promotion of Higher-order Thinking Skills: A Case of Critical Thinking
Barak, M., Ben‐Chaim, D., & Uri, Z. (2007) · Research in Science Education · doi:10.1007/s11165-006-9029-2 · Cited by 697 · see citing works
Assessment in Education: Principles, Policy & Practice
Wiliam, D. (2008) · Cited by 696 · see citing works
Critical Thinking: A Literature Review
Lai, E. (2011) · Cited by 693 · see citing works
Scoring Rubric Development: Validity and Reliability
Moskal, B., & Leydens, J. A. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/q7rm-gg74 · Cited by 502 · see citing works
Constructive alignment in university teaching
Kandlbinder, P. (2014) · Cited by 479 · see citing works
Critical Thinking and Science Education
Bailin, S. (2002) · Science & Education · doi:10.1023/a:1016042608621 · Cited by 404 · see citing works
Scoring Rubrics: What, When and How?
Moskal, B. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/a5vq-7q66 · Cited by 333 · see citing works
Process Oriented Guided Inquiry Learning (POGIL)
Moog, R. S., & Spencer, J. N. (2008) · ACS symposium series · doi:10.1021/bk-2008-0994 · Cited by 294 · see citing works
Assessing 21st Century Skills: Summary of a Workshop
Koenig, J. A. (2011) · ATE Central (National Science Foundation) · Cited by 279 · see citing works
The quality and effectiveness of descriptive rubrics
Brookhart, S., & Chen, F. (2015) · Educational Review · doi:10.1080/00131911.2014.929565 · Cited by 254 · see citing works
Schmidt, H. G., de Volder, M. L., de Grave, W. S., Moust, J. H. C., & Patel, V. L. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.4.610 · Cited by 212 · see citing works
Critical thinking and the disciplines reconsidered
Davies, M. (2013) · Higher Education Research & Development · doi:10.1080/07294360.2012.697878 · Cited by 205 · see citing works
An Information Processing Analysis of Expert and Novice Teachers' Problem Solving
Swanson, H. L., O’Connor, J. E., & Cooney, J. B. (1990) · American Educational Research Journal · doi:10.3102/00028312027003533 · Cited by 182 · see citing works
Hattie, J., & Gan, M. J. S. (2011) · Routledge eBooks · doi:10.4324/9780203839089-22 · Cited by 172 · see citing works
The Extent to Which Critical Thinking Is Subject-Specific: Further Clarification
Ennis, R. H. (1990) · Educational Researcher · doi:10.3102/0013189x019004013 · Cited by 118 · see citing works
Gafney, L., & Varma‐Nelson, P. (2008) · Springer eBooks · doi:10.1007/978-1-4020-6186-8 · Cited by 109 · see citing works
The effect of the biology critical thinking project on the development of critical thinking
Zohar, A. E., Weinberger, Y., & Tamir, P. (1994) · Journal of Research in Science Teaching · doi:10.1002/tea.3660310208 · Cited by 107 · see citing works
Rau, M. A., Kennedy, K. J., Oxtoby, L. J., Bollom, M. A., & Moore, J. W. (2017) · Journal of Chemical Education · doi:10.1021/acs.jchemed.7b00240 · Cited by 88 · see citing works
What stands and develops between creative and critical thinking? Argumentation?
Glassner, A., & Schwarz, B. B. (2006) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2006.10.001 · Cited by 83 · see citing works
Facione, P. A. (1990) · Cited by 82 · see citing works
Saxton, E. A., Belanger, S., & Becker, W. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.07.002 · Cited by 75 · see citing works
Simonson, S. R. (2019) · ScholarWorks (Boise State University) · Cited by 71 · see citing works
Developing Student Process Skills in a General Chemistry Laboratory
Reynders, G. J., Suh, E. H., Cole, R. S., & Sansom, R. L. (2019) · Journal of Chemical Education · doi:10.1021/acs.jchemed.9b00441 · Cited by 70 · see citing works
Self-citationDanczak, S., Thompson, C. D., & Overton, T. (2017) · Chemistry Education Research and Practice · doi:10.1039/c6rp00249h · Cited by 68 · see citing works
Smit, R., & Birri, T. (2014) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2014.02.002 · Cited by 49 · see citing works
Toward a Theory of Critical Thinking.
Facione, P. A. (1984) · Liberal education · Cited by 48 · see citing works
Kumi, B. C., Olimpo, J. T., Bartlett, F., & Dixon, B. (2013) · Chemistry Education Research and Practice · doi:10.1039/c3rp20166j · Cited by 46 · see citing works
Facione, P. A. (1990) · Cited by 40 · see citing works
Stein, B., & Haynes, A. (2011) · Change The Magazine of Higher Learning · doi:10.1080/00091383.2011.550254 · Cited by 40 · see citing works
Towards a Definition of Representational Competence
Daniel, K. L., Bucklin, C. J., Leone, E. A., & Idema, J. L. (2018) · Models and modeling in science education · doi:10.1007/978-3-319-89945-9_1 · Cited by 40 · see citing works
Thinking about critical thinking: An industry perspective
Pearl, A. O., Rayner, G. M., Larson, I. C., & Orlando, L. (2018) · Industry and Higher Education · doi:10.1177/0950422218796099 · Cited by 28 · see citing works
Cole, R. S., Reynders, G. J., Ruder, S. M., Stanford, C., & Lantz, J. M. (2019) · Springer eBooks · doi:10.1007/978-981-13-6998-8_13 · Cited by 19 · see citing works
Self-citationFacilitating Strategies for Solving Work-Energy Problems in Graphical and Equational Representations
Nguyen, D.-H., Gire, E., Rebello, N. S., Singh, C., Sabella, M. S., & Rebello, N. S. (2010) · AIP conference proceedings · doi:10.1063/1.3515211 · Cited by 8 · see citing works
Hanson, D. M. (2008) · ACS symposium series · doi:10.1021/bk-2008-0994.ch002 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 51 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- American Chemical Society Committee on Professional Training. (2015). Unergraduate Professional Education in Chemistry: ACS Guidelines and Evaluation Procedures for Bachelor's Degree Programs . Retrieved from https://www.acs.org/content/dam/acsorg/about/governance/committees/ training/2015-acs-guidelines-for-bachelors-degree-programs.pdf
- Gosser, D. K., Cracolice, M. S., Kampmeier, J. A., Roth, V., Strozak, V. S., & VarmaNelson, P. (2001). Peer-led team learning: A guidebook: Prentice Hall Upper Saddle River, NJ .
- Gray, K., & Koncz, A. (2018). The key attributes employers seek on students' resumes. Retrieved from http://www.naceweb.org/about-us/press/2017/thekey-attributes-employers-seek-on-students-resumes/.
- Simonson, S. R. (Ed.). (2019). POGIL: An Introduction to Process Oriented Guided Inquiry Learning for Those Who Wish to Empower Learners . Sterling, VA: Stylus Publishing, LLC.
Cited by
Sorted by citations
Purwaningsih, E., Sari, S. P., Sari, A. M., & Suryadi, A. (2020) · Jurnal Pendidikan IPA Indonesia · doi:10.15294/jpii.v9i4.26432 · Cited by 124 · see citing works
Hebebci, M. T., & Usta, E. (2022) · Participatory Educational Research · doi:10.17275/per.22.143.9.6 · Cited by 81 · see citing works
10 Guiding principles for learning in the laboratory
Seery, M. K., Agustian, H. Y., Christiansen, F. V., Gammelgaard, B., & Malm, R. H. (2023) · Chemistry Education Research and Practice · doi:10.1039/d3rp00245d · Cited by 72 · see citing works
Which professional skills do students learn in engineering team-based projects?
Picard, C., Hardebolle, C., Tormey, R., & Schiffmann, J. (2021) · European Journal of Engineering Education · doi:10.1080/03043797.2021.1920890 · Cited by 71 · see citing works
Chusni, M. M., Saputro, S., Rahardjo, S. B., & Suranto, S. (2021) · European Journal of Educational Research · doi:10.12973/eu-jer.10.3.1123 · Cited by 46 · see citing works
Lestari, H., Sopandi, W., Sa’ud, U. S., Musthafa, B., Budimansyah, D., & Sukardi, R. R. (2021) · Jurnal Pendidikan IPA Indonesia · doi:10.15294/jpii.v10i3.28655 · Cited by 42 · see citing works
Enhancing Students’ Critical Thinking Through Mathematics in Higher Education: A Systemic Review
Wang, Q., & Abdullah, A. H. (2024) · SAGE Open · doi:10.1177/21582440241275651 · Cited by 76 · see citing works
Rizki, I. A., & Suprapto, N. (2024) · Journal of Science Education and Technology · doi:10.1007/s10956-024-10102-2 · Cited by 32 · see citing works
Clemmons, A. W., Donovan, D. A., Theobald, E. J., & Crowe, A. J. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.21-02-0054 · Cited by 30 · see citing works
Nsabayezu, E., Mukiza, J., Iyamuremye, A., Mukamanzi, O. U., & Mbonyiryivuze, A. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11113-5 · Cited by 30 · see citing works
Alternative Assessment of Active Learning
Hunter, R. A., Pompano, R. R., & Tuchler, M. F. (2022) · ACS symposium series · doi:10.1021/bk-2022-1409.ch015 · Cited by 27 · see citing works
Goudsouzian, L. K., & Hsu, J. L. (2023) · CBE - Life Sciences Education · doi:10.1187/cbe.22-10-0211 · Cited by 26 · see citing works
Zeng, X., & Ravindran, L. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101691 · Cited by 49 · see citing works
Saphıra, H. V., Rizki, I. A., Alfarizy, Y., Saputri, A. D., Ramadani, R., & Suprapto, N. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2377/1/012088 · Cited by 25 · see citing works
eComplexity: validation of a complex thinking instrument from a structural equation model
Parra, J. C. V., Henao-Rodriguez, L. C., Lis-Gutiérrez, J.-P., Castillo-Martínez, I. M., & Suárez-Brito, P. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1334834 · Cited by 24 · see citing works
Gencer, A. S., & Doğan, H. (2020) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.744640 · Cited by 32 · see citing works
Crogman, H. T., Eshun, K. O., Jackson, M., TrebeauCrogman, M. A., Joseph, E. E., Warner, L. C., & Erenso, D. B. (2023) · Education Sciences · doi:10.3390/educsci13111091 · Cited by 29 · see citing works
Moving a Large-Lecture Organic POGIL Classroom to an Online Setting
Reynders, G. J., & Ruder, S. M. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00615 · Cited by 21 · see citing works
Self-citationZhan, X., Sun, D., Song, R., Yang, Y., & Zhan, Y. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101364 · Cited by 22 · see citing works
Rizki, I. A., Suprapto, N., Saphıra, H. V., Alfarizy, Y., Ramadani, R., Saputri, A. D., & Suryani, D. (2024) · Journal of Pedagogical Research · doi:10.33902/jpr.202423825 · Cited by 21 · see citing works
Presenting STEM ways of a thinking framework for engineering design-based physics problems
Subramaniam, R., Morphew, J., Rebello, C. M., & Rebello, N. (2024) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010122 · Cited by 20 · see citing works
A Novel Rubric Format for Providing Feedback on Process Skills to STEM Undergraduate Students
Czajka, C. D., Reynders, G. J., Stanford, C., Cole, R. S., Lantz, J. M., & Ruder, S. M. (2021) · The journal of college science teaching · doi:10.1080/0047231x.2021.12290533 · Cited by 20 · see citing works
Self-citationThinking and Learning in Nested Systems: The Classroom Level
Talanquer, V., Cole, R. S., & Rushton, G. T. (2024) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00839 · Cited by 19 · see citing works
Self-citationTED talk comments to enhance critical thinking skills in an undergraduate reading and writing course
Allagui, B. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10388-w · Cited by 19 · see citing works
A capability maturity model for assessment of active learning in higher education
Garbin, F. G. D. B., ten Caten, C. S., & Pacheco, D. A. D. J. (2021) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-08-2020-0263 · Cited by 20 · see citing works
Abd‐El‐Khalick, F., Summers, R., Brunner, J. L., Belarmino, J. J., & Myers, J. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21916 · Cited by 18 · see citing works
Nsabayezu, E., Iyamuremye, A., Nahimana, J. P., Mukiza, J., Kampire, E., & Nsengimana, T. (2022) · Discover Education · doi:10.1007/s44217-022-00005-y · Cited by 16 · see citing works
Aziz, M., & Rawian, R. M. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.991015 · Cited by 15 · see citing works
States, N. E., Stone, E. A., & Cole, R. S. (2023) · Education Sciences · doi:10.3390/educsci13020192 · Cited by 15 · see citing works
Self-citationSharab, L., Butul, B., & Guha, U. (2024) · The Saudi Dental Journal · doi:10.1016/j.sdentj.2024.11.004 · Cited by 19 · see citing works
Trikoili, A., Georgiou, D., Pappa, C. I., & Pittich, D. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2499164 · Cited by 14 · see citing works
Learning against the machine: the double edged sword of (Gen)AI in STEM education
Wulff, P., & Kubsch, M. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00588-6 · Cited by 17 · see citing works
Christodoulou, P., & Papanikolaou, A. (2023) · Education Sciences · doi:10.3390/educsci13121187 · Cited by 14 · see citing works
Hunter, R. A., & Kovarik, M. L. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.1c00920 · Cited by 16 · see citing works
Masikisiki, B., Marivate, V., & Hlophe, Y. (2023) · Proceedings of the 4th African Human Computer Interaction Conference · doi:10.1145/3628096.3628747 · Cited by 13 · see citing works
ANALISIS BERPIKIR KRITIS MAHASISWA DALAM MENYELESAIKAN MASALAH KONTROVERSIAL MATEMATIKA
Rosyadi, A. A. P. (2021) · EDU-MAT Jurnal Pendidikan Matematika · doi:10.20527/edumat.v9i1.9988 · Cited by 12 · see citing works
What influences students’ abilities to critically evaluate scientific investigations?
Heim, A. B., Walsh, C., Esparza, D., Smith, M. K., & Holmes, N. G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0273337 · Cited by 12 · see citing works
A Systematic Review on Instruments to Assess Critical Thinking & Problem-Solving Skills
Alias, A., Mohtar, L. E., Ayop, S. K., & Rahim, F. R. (2022) · EDUCATUM Journal of Science Mathematics and Technology · doi:10.37134/ejsmt.vol9.sp.5.2022 · Cited by 11 · see citing works
Rizki, I. A., Hariyono, E., Suprapto, N., Dawana, I. R., & Shobah, N. (2024) · TEM Journal · doi:10.18421/tem132-59 · Cited by 11 · see citing works
Beldad, A. D., & Miedema, H. A. T. (2025) · European Journal of Engineering Education · doi:10.1080/03043797.2025.2507243 · Cited by 11 · see citing works
Unlocking students’ creative potential in designing technological-enriched design solutions
Huang, B., Jong, M. S., Tsai, C., & Shang, J. (2024) · Journal of Research on Technology in Education · doi:10.1080/15391523.2024.2342915 · Cited by 14 · see citing works
LUPDA: a comprehensive rubrics-based assessment model for STEAM education
Cheng, Y., & Huang, Y. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00570-2 · Cited by 15 · see citing works
Yuliarti, Y., Suwandi, S., Andayani, A., & Sumarwati, S. (2023) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.22.5.27 · Cited by 10 · see citing works
How Should Apples Be Prepared for a Fruit Salad? A Guided Inquiry Physical Chemistry Experiment
Cole, R. S., Muñiz, M. N., Harvey, E. L., Sweeney, R., & Hunnicutt, S. S. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00517 · Cited by 10 · see citing works
Self-citationUsing the Problem-Based Learning in STEM Teaching About Bamboo Toothpick Houses
Nguyen, N.-G. (2020) · International Education Studies · doi:10.5539/ies.v13n12p70 · Cited by 10 · see citing works
Herridge, M., & Talanquer, V. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00944 · Cited by 10 · see citing works
Developing a rubric for assessing students’ competencies in entrepreneurial-STEM learning context
Eltanahy, M., & Mansour, N. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2311701 · Cited by 9 · see citing works
Nkomo, S., & Bly, A. (2024) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c00236 · Cited by 9 · see citing works
Herridge, M., Tashiro, J., & Talanquer, V. (2021) · Chemistry Education Research and Practice · doi:10.1039/d1rp00061f · Cited by 9 · see citing works
Ramesh, V. B., Seery, M. K., & Cole, R. S. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5c00988 · Cited by 8 · see citing works
Self-citationWinfield, C., Hughes, K., & Huffman, J. (2023) · Journal of Human Services · doi:10.52678/001c.91200 · Cited by 8 · see citing works
Suprapto, N., Rizki, I. A., & Cheng, T.-H. (2024) · Journal of Educational and Social Research · doi:10.36941/jesr-2024-0062 · Cited by 25 · see citing works
Utami, I. S., Vitasari, M., Langitasari, I., & Muliyati, D. (2021) · AIP conference proceedings · doi:10.1063/5.0041991 · Cited by 8 · see citing works
Wyk, A. L. V., Hunter, R. A., Ott, L. S., Cole, R. S., & Frederick, K. A. (2022) · ACS symposium series · doi:10.1021/bk-2022-1409.ch010 · Cited by 8 · see citing works
Self-citationMiddleton, R., Lewer, K., Antoniou, C., Pratt, H., Bowdler, S., Jans, C., & Rolls, K. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106106 · Cited by 7 · see citing works
Iqbal, M. Z., Ivan, R., Robb, C., & Derby, J. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2024.1525156 · Cited by 7 · see citing works
Martínez-Martínez, V., Ortiz-Revilla, J., & Greca, I. M. (2025) · Science & Education · doi:10.1007/s11191-025-00643-2 · Cited by 9 · see citing works
A reflective learning conversation debriefing model for interprofessional simulation based education
Almomani, E. A. H., Tobin, J., Fernandes, S., Sullivan, J., Saadeh, O., Mustafa, E., Pattison, N. A., & Alinier, G. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07765-9 · Cited by 7 · see citing works
Moreno, A. S., & González, E. M. (2023) · Revista de Estilos de Aprendizaje · doi:10.55777/rea.v16i32.5990 · Cited by 7 · see citing works
CC Thinker: Mobile-based Assessment to Train Creative and Critical Thinking in Students
Ridhoni, W., Setyosarı, P., Kuswandi, D., Ulfa, S. U., & Janan, D. (2022) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v16i15.29991 · Cited by 7 · see citing works
The Literature Discussion: A Signature Pedagogy for Chemistry
Reisner, B. A., & Stewart, J. L. (2020) · ACS symposium series · doi:10.1021/bk-2020-1370.ch002 · Cited by 7 · see citing works
Fostering Critical Thinking in STEM Education
Straser, O., Bašić, M., Doorman, M., Weinberg, L., Kapelari, S., & Maaß, K. (2026) · Education Sciences · doi:10.3390/educsci16030461 · Cited by 10 · see citing works
Students’ metacognitive judgments in online search: a calibration study
Zhou, M. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11217-y · Cited by 8 · see citing works
Mohammed, A. B., Sabahath, A., & Naim, A. (2024) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-1698-6.ch003 · Cited by 6 · see citing works
Non-Native English Teachers Interpretation of Rubrics Used for Assessing Students’ Writing
Universitas Negeri Jakarta, I., & Sitorus, M. L. (2020) · The international conference on future of education · doi:10.17501/26307413.2020.3202 · Cited by 6 · see citing works
Cahyaningrum, R., Lestari, W., & Supriyadi, S. (2022) · Journal of English Language Teaching and Linguistics · doi:10.21462/jeltl.v7i1.686 · Cited by 6 · see citing works
How a Rubric Score Application Empowers Teachers’ Attitudes over Computational Thinking Leverage
Dimos, I., Velaora, C., Louvaris, K., Kakarountas, A. P., & Antonarakou, A. (2023) · Information · doi:10.3390/info14020118 · Cited by 6 · see citing works
STEM Productive Learning of Lower Secondary School in Southern Zone, Malaysia
Nasir, M. A., Talib, R., Latif, A. B. A., Hanid, M. F. A., & Harmeni, H. A. (2023) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.22.2.16 · Cited by 6 · see citing works
Biology-Critical Thinking Skills of High School Students in Terms of Gender and School Location
Ramadhani, S., Karyanto, P., & Sugiharto, B. (2023) · Jurnal Pendidikan Sains Indonesia · doi:10.24815/jpsi.v11i4.31760 · Cited by 6 · see citing works
Effects of grading rubrics on EFL learners’ writing in an EMI setting
Alghizzi, T. M., & Alshahrani, T. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36394 · Cited by 5 · see citing works
Hu, Y.-H., Yu, H.-Y., & Hsieh, C.-L. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13784-2 · Cited by 9 · see citing works
Zeng, X., Ravindran, L., & Amini, M. (2023) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v12i3.24699 · Cited by 5 · see citing works
Liu, M. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.101789 · Cited by 5 · see citing works
Parra, J. C. V., Castillo-Martínez, I. M., Soledad, M., Zamora, J. A. A., & Cruz-Sandoval, M. A. (2023) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-11-2022-0355 · Cited by 5 · see citing works
Khotimah, R. P., Adnan, M., Ahmad, C. N. C., & Murtiyasa, B. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2220233 · Cited by 5 · see citing works
Juandi, T., Kaniawati, I., Samsudin, A., & Riza, L. S. (2023) · Momentum Physics Education Journal · doi:10.21067/mpej.v7i2.8252 · Cited by 5 · see citing works
Male Chauvinism and Complex Thinking: A Study of Mexican University Students
Carlos-Arroyo, M., Parra, J. C. V., Cruz-Sandoval, M. A., & Barrondo, A. E. (2023) · Societies · doi:10.3390/soc13050104 · Cited by 5 · see citing works
Harianja, R., Tampubolon, T., & Manalu, L. (2023) · Formatif Jurnal Ilmiah Pendidikan MIPA · doi:10.30998/formatif.v13i1.17251 · Cited by 11 · see citing works
Alotaibi, S. S. R., & Ismail, S. M. (2024) · Research Journal in Advanced Humanities · doi:10.58256/akd93421 · Cited by 4 · see citing works
Palermo, T. B., Cappellari, L. D. R., Chiappero, J., Meneguzzi, R. D. V., Gil, S. S., Giordano, W. F., & Banchio, E. (2022) · Journal of Biological Education · doi:10.1080/00219266.2022.2108105 · Cited by 4 · see citing works
Focusing on Students and Their Experiences in and Through Integrated STEM Education
Li, Y., & Anderson, J. (2020) · Advances in STEM education · doi:10.1007/978-3-030-52229-2_10 · Cited by 4 · see citing works
Socio-scientific issues in physics learning to improve students’ critical thinking skills
Febriani, F., Jumadi, J., & Dwandaru, W. S. B. (2023) · Revista Mexicana de Física E · doi:10.31349/revmexfise.20.010202 · Cited by 4 · see citing works
Pasek Suryawan, I. P., Jana, P., Pujawan, I. G. N., Yudi Hartawan, I. G. N., & Widyantini Putri, P. E. (2023) · Pegem Journal of Education and Instruction · doi:10.47750/pegegog.13.03.33 · Cited by 3 · see citing works
Promoting Higher-Order Thinking Skills Through Experiential e-Learning for School Chemistry Topics
Senapati, S., & Selvam, A. A. A. (2024) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.1080/00098655.2024.2448808 · Cited by 4 · see citing works
Chand, S. P. (2025) · SAGE Open · doi:10.1177/21582440251365751 · Cited by 4 · see citing works
Takács, R., Takács, S., Kárász, J. T., Oláh, A., & Horváth, Z. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02794-z · Cited by 3 · see citing works
Peñas‐Garzón, M., Moreno-Medina, I., Bedia, J., & Belver, C. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c01377 · Cited by 3 · see citing works
Kreps, A., Dailey, K., & Cole, R. S. (2025) · Chemistry Education Research and Practice · doi:10.1039/d5rp00225g · Cited by 3 · see citing works
Self-citationStudy of computer attitudes in STEM problem‐solving for students with disabilities
Du, X., & Lyublinskaya, I. E. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22574 · Cited by 3 · see citing works
Influence of Using Rubrics in Higher Education on Students’ Performance and Academic Motivation
Barmuta, K. A. (2023) · Innovative science psychology pedagogy defectology · doi:10.23947/2658-7165-2023-6-1-43-52 · Cited by 3 · see citing works
Biology learning model to improve critical thinking skills of ten grade students: A meta-analysis
Fuadiyah, M., Norra, B. I., & Astutik, F. (2022) · Assimilation Indonesian Journal of Biology Education · doi:10.17509/aijbe.v5i2.46084 · Cited by 3 · see citing works
Morancho, M. V. (2024) · Retos · doi:10.47197/retos.v52.101302 · Cited by 3 · see citing works
Kunicina, N., Brūzgienė, R., Narbutaitė, L., Rassõlkin, A., Ibrahim, M., & Balandin, S. (2024) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct61870.2024.10516359 · Cited by 3 · see citing works
Sudirman, S., Hardianti, B. D., & Safitri, T. A. (2024) · Jurnal Ilmiah Profesi Pendidikan · doi:10.29303/jipp.v9i3.2422 · Cited by 3 · see citing works
Liu, S., Cai, C. Y. L., Liu, C., Samarapungavan, A., Gardner, S. M., Clase, K. L., & Pelaez, N. J. (2022) · Contributions from biology education research · doi:10.1007/978-3-030-98592-9_17 · Cited by 3 · see citing works
Mitchell, S. A. (2022) · HETS Online Journal · doi:10.55420/2693.9193.v10.n2.19 · Cited by 3 · see citing works
Public exams decrease anxiety and facilitate deeper conceptual thinkingPreprint
Wiggins, B. L., Lily, L. S., Busch, C. A., Landys, M. M., Shlichta, J. G., Shi, T., & Ngwenyama, T. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.04.15.488479 · Cited by 3 · see citing works
Flipped Classroom Model Combined with Problem-Based Learning: Increase Thinking Ability
Rahayu, M., Mariono, A., & Syaiputra, W. D. (2025) · Akademika · doi:10.34005/ak.v13i02.4300 · Cited by 2 · see citing works
Kopacz, D., & Handlos, Z. (2021) · International Journal for the Scholarship of Teaching and Learning · doi:10.20429/ijsotl.2021.150212 · Cited by 2 · see citing works
Student Evaluation Using an Intellectual Standards Rubric for Critical Thinking
Johnson, D., Kakar, R. M., Zahrndt, R., & Walton, P. (2022) · Pedagogy in Health Promotion · doi:10.1177/23733799211070544 · Cited by 2 · see citing works
- Authors
- Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S.
- Affiliations
- University of Iowa (US)
- Drew University (US)
- Virginia Commonwealth University (US)
- Ball State University (US)
- Corresponding author
- Cole, Renée S.
- Venue
- International Journal of STEM Education
- Published
- 2020-03-09
- Volume
- 7
- Issue
- 1
- ISSN
- 2196-7822 (ISSN-L)
- OpenAlex
- W3031490426
- Cited by
- 174
- References
- 51
- Citations by year
- 2026: 21 · 2025: 29 · 2024: 31 · 2023: 41 · 2022: 26 · 2021: 13 · 2020: 13
- FWCI
- 35.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- International Journal of STEM Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (1524399, 1524936, 1524965)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- rubrics, critical thinking, information processing, process skills, undergraduate STEM education, formative feedback, constructive alignment, learning outcomes, written assessment, teaching assistants, active learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
