Assessment of Collaborative Problem Solving in Education Environments
Abstract
The Assessment and Teaching of 21st Century Skills (ATC21STM) project undertook a research and development plan that included conceptualization of 21st century skills and assessment task development. Conceptualization focused on the definition of 21st century skills. This article outlines the particular case of one of these skills, collaborative problem solving, from its definition and identification of subskills, to development of a method for its assessment. The theories contributing to construct definition are described. These have implications for the particular clusters of subskills that are of interest for educational assessment. An approach to assessment task creation is illustrated through the deconstruction of a well-known reasoning task, and its re-development to sample both the cognitive and social aspects of collaborative problem solving. The assessment tasks are designed to generate formative feedback for teachers in order to identify levels of ability within and between their students and support tailoring of instruction differentially for improvement.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In an educational assessment of collaborative problem solving, two main underpinning skills are the social skill of audience awareness and the cognitive skill of planning and executing.
“two main underpinning skills were described for the assessment: the social skill of audience awareness (“how to adapt one’s own behavior to suit the needs of the task and the partner’s requirements”, Care et al. 2016, p. 258) and the cognitive skill of planning and executing”
From Creativity, Critical Thinking, Communication, and Collaboration: Assessment, Certification, and Promotion of 21st Century Skills for the Future of Work and Education (2023) · cites this paper as Care et al. 2016
Cites
Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,883 · see citing works
21st century skills: learning for life in our times
(2010) · Choice Reviews Online · doi:10.5860/choice.47-5788 · Cited by 2,990 · see citing works
Work group diversity and group performance: an integrative model and research agenda.
van Knippenberg, D., De Dreu, C. K. W., & Homan, A. C. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1008 · Cited by 2,911 · see citing works
Metacognitive Aspects of Problem Solving
Flavell, J. H. (2024) · Routledge eBooks · doi:10.4324/9781032646527-16 · Cited by 2,809 · see citing works
Transactive Memory: A Contemporary Analysis of the Group Mind
Wegner, D. M. (1987) · Theories of Group Behavior · doi:10.1007/978-1-4612-4634-3_9 · Cited by 2,700 · cited 1× · see citing works
“Social regulation skills require both knowledge about one’s own strengths and weaknesses (Flavell, 1976) and knowledge about the strengths and weaknesses of collaboration partners (Wegner, 1986).”
BackgroundRestructuring the Classroom: Conditions for Productive Small Groups
Cohen, E. G. (1994) · Review of Educational Research · doi:10.3102/00346543064001001 · Cited by 2,120 · see citing works
Defining Twenty-First Century Skills
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-007-2324-5_2 · Cited by 1,809 · see citing works
Collective cognitive responsibility for the advancement of knowledge
Scardamalia (2002) · Medical Entomology and Zoology · Cited by 939 · see citing works
International Handbook of Information Technology in Primary and Secondary Education
Voogt, J. M., & Knezek, G. (2008) · Springer eBooks · doi:10.1007/978-0-387-73315-9 · Cited by 699 · see citing works
Liberal education in a knowledge society
Bereiter, C. (2003) · Choice Reviews Online · doi:10.5860/choice.40-3551 · Cited by 629 · see citing works
A Framework for Teachable Collaborative Problem Solving Skills
Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-017-9395-7_2 · Cited by 507 · see citing works
Self-citationRummel, N., & Spada, H. (2005) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1402_2 · Cited by 454 · see citing works
Hidden Profiles: A Brief History
Stasser, G. L., & Titus, W. (2003) · Psychological Inquiry · doi:10.1080/1047840x.2003.9682897 · Cited by 434 · see citing works
Assessment and Teaching of 21st Century Skills
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7 · Cited by 401 · see citing works
Self-citationThompson, L., Wang, J., & Gunia, B. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100458 · Cited by 245 · see citing works
The Process of Solving Complex Problems
Fischer, A., Greiff, S., & Funke, J. (2012) · The Journal of Problem Solving · doi:10.7771/1932-6246.1118 · Cited by 242 · see citing works
The Structure of Discourse in Collaborative Learning
Chinn, C. A., O’Donnell, A. M., & Jinks, T. S. (2000) · The Journal of Experimental Education · doi:10.1080/00220970009600650 · Cited by 217 · see citing works
Computer simulation as a research tool: The DISCUSS model of group decision making
Stasser, G. L. (1988) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(88)90028-5 · Cited by 210 · see citing works
The future of testing: A research agenda for cognitive psychology and psychometrics.
Glaser, R. A. (1981) · American Psychologist · doi:10.1037/0003-066x.36.9.923 · Cited by 189 · see citing works
Trötschel, R., Hüffmeier, J., Loschelder, D. D., Schwartz, K., & Gollwitzer, P. M. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0023801 · Cited by 168 · see citing works
Dynamics of Peer Education in Cooperative Learning Workgroups
Haller, C. R., Gallagher, V. J., Weldon, T. L., & Felder, R. M. (2000) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2000.tb00527.x · Cited by 146 · see citing works
Issues in the Computer-based Assessment of Collaborative Problem Solving
O’Neil, H. F., Chuang, S.-H., & Chung, G. K. W. K. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000148190 · Cited by 117 · see citing works
THE COMFORT OF COMPETENCE AND THE UNCERTAINTY OF ASSESSMENT
Griffin, P. (2007) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2007.01.007 · Cited by 102 · see citing works
Self-citationBrodbeck, F. C., & Greitemeyer, T. (2000) · Journal of Experimental Social Psychology · doi:10.1006/jesp.2000.1423 · Cited by 95 · see citing works
COLLABORATIVE PROBLEM SOLVING AND THE ASSESSMENT OF COGNITIVE SKILLS: PSYCHOMETRIC CONSIDERATIONS
von Davier, A. A., & Halpin, P. F. (2013) · ETS Research Report Series · doi:10.1002/j.2333-8504.2013.tb02348.x · Cited by 93 · see citing works
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_1 · Cited by 79 · see citing works
Self-citationCollaborative Problem Solving Tasks
Care, E., Griffin, P., Scoular, C., Awwal, N., & Zoanetti, N. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_4 · Cited by 72 · see citing works
Self-citationUse of networked simulations as a context to measure team competencies
O’Neil, H. F. (1997) · Cited by 66 · see citing works
Perspectives on computer-based performance assessment of problem solving
O’Neil, H. F. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00022-9 · Cited by 57 · see citing works
The Effects of Frontal Lobe Lesions on Goal Achievement in the Water Jug Task
Colvin, M. K., Dunbar, K. N., & Grafman, J. H. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901753294419 · Cited by 53 · see citing works
Review of workforce readiness theoretical frameworks
O’Neil, H. F. (1997) · Cited by 48 · see citing works
Coordinating computer-supported cooperative work: A review of research issues and strategies
Kies, J. K., Williges, R. C., & Rosson, M. B. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199807)49:9 · Cited by 44 · see citing works
Pazos, P., Micari, M., & Light, G. J. (2009) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930802691572 · Cited by 42 · see citing works
Perspectives on Methodological Issues
Wilson, M. R., Bejar, I. I., Scalise, K., Templin, J. L., Wiliam, D., & Irribarra, D. T. (2011) · Springer eBooks · doi:10.1007/978-94-007-2324-5_3 · Cited by 39 · see citing works
Famous Puzzles of Great Mathematicians
Petković, M. S. (2009) · American Mathematical Society eBooks · doi:10.1090/mbk/063 · Cited by 38 · see citing works
Arts, J. A. R., Gijselaers, W., & Segers, M. S. R. (2006) · European Journal of Psychology of Education · doi:10.1007/bf03173570 · Cited by 37 · see citing works
Famous puzzles of great mathematicians
(2010) · Choice Reviews Online · doi:10.5860/choice.47-5072 · Cited by 30 · see citing works
Liao, S.-H., & Ho, Y.-P. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.020 · Cited by 19 · see citing works
Counterintuitive and alternative moves choice in the Water Jug task
Carder, H. P., Handley, S. J., & Perfect, T. J. (2007) · Brain and Cognition · doi:10.1016/j.bandc.2007.04.006 · Cited by 19 · see citing works
von Davier, A. A., & Halpin, P. F. (2013) · ETS Research Report Series · Cited by 18 · see citing works
Models of Participation During Face-to-Face Unstructured Discussion
Vaughan, G. S. A. S. (2014) · doi:10.4324/9781315806372-16 · Cited by 17 · see citing works
How Technology Changes Demands for Human Skills. OECD Education Working Papers, No. 45.
Levy, F. (2010) · OECD Publishing (NJ1) · Cited by 14 · see citing works
McDiarmid, C., & Alfonsín, J. L. R. (1994) · Discrete Mathematics · doi:10.1016/0012-365x(94)90169-4 · Cited by 13 · see citing works
Solving the water jugs problem by an integer sequence approach
Man, Y. K. (2011) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2011.562323 · Cited by 7 · see citing works
An Alternative Arithmetic Approach to the Water Jugs Problem
Mary, R. S. (2014) · National Conference Computational Intelligence · Cited by 2 · see citing works
Flagged first, then by citations
2 of the 47 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
The relation between 21st-century skills and digital skills: A systematic literature review
van Laar, E., van Deursen, A. J. A. M., van Dijk, J. A. G. M., & de Haan, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.010 · Cited by 2,006 · see citing works
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., et al. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11030054 · Cited by 768 · see citing works
Developing student 21st Century skills in selected exemplary inclusive STEM high schools
Stehle, S. M., & Peters‐Burton, E. E. (2019) · International Journal of STEM Education · doi:10.1186/s40594-019-0192-1 · Cited by 514 · see citing works
Advancing the Science of Collaborative Problem Solving
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018) · Psychological Science in the Public Interest · doi:10.1177/1529100618808244 · Cited by 390 · see citing works
Teaching for the 21st century: A case for dialogic pedagogy
Teo, P. (2019) · Learning Culture and Social Interaction · doi:10.1016/j.lcsi.2019.03.009 · Cited by 282 · see citing works
Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.05.002 · Cited by 269 · see citing works
Towards a generalized competency model of collaborative problem solving
Sun, C., Shute, V. J., Stewart, A., Yonehiro, J., Duran, N., & D'Mello, S. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103672 · Cited by 189 · see citing works
Andrews‐Todd, J., & Forsyth, C. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.10.025 · Cited by 158 · see citing works
Zhang, S., Gao, Q., Sun, M., Cai, Z., Li, H., Tang, Y., & Liu, Q. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104485 · Cited by 145 · see citing works
Chai, C. S., Koh, J. H. L., & Teo, Y. H. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633117752453 · Cited by 126 · see citing works
Nixon, N., Nixon, T. M., & Graesser, A. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1102-z · Cited by 120 · see citing works
An empirical study on gender, video game play, academic success and complex problem solving skills
Dindar, M. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.05.018 · Cited by 101 · see citing works
Carvalho, A. R., & Santos, C. (2021) · Computers and Education Open · doi:10.1016/j.caeo.2021.100070 · Cited by 116 · see citing works
Sun, C., Shute, V. J., Stewart, A. E. B., Beck-White, Q., Reinhardt, C. R., Zhou, G., Duran, N., & D'Mello, S. K. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107120 · Cited by 100 · see citing works
Assessment of Twenty-First Century Skills: The Issue of Authenticity
Care, E., & Kim, H. (2017) · Educational assessment in an information age · doi:10.1007/978-3-319-65368-6_2 · Cited by 82 · see citing works
Self-citationDowell, N., Lin, Y., Godfrey, A., & Brooks, C. A. (2020) · Journal of Learning Analytics · doi:10.18608/jla.2020.71.4 · Cited by 75 · see citing works
The assessment of collaborative problem solving in PISA 2015: Can computer agents replace humans?
Herborn, K., Stadler, M. J., Mustafić, M., & Greiff, S. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.035 · Cited by 72 · see citing works
Chang, D., Hwang, G., Chang, S., & Wang, S. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-10062-z · Cited by 78 · see citing works
Complex Problem Solving in Assessments of Collaborative Problem Solving
Graesser, A. C., Kuo, B., & Liao, C.-H. (2017) · Journal of Intelligence · doi:10.3390/jintelligence5020010 · Cited by 66 · see citing works
Direction of collaborative problem solving-based STEM learning by learning analytics approach
Chen, L., Yoshimatsu, N., Goda, Y., Okubo, F., Taniguchi, Y., Oi, M., Konomi, S., Shimada, A., Ogata, H., & Yamada, M. (2019) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-019-0119-y · Cited by 72 · see citing works
Interplay of metacognitive experiences and performance in collaborative problem solving
Dindar, M., Järvelä, S., & Järvenoja, H. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103922 · Cited by 65 · see citing works
Assessment with computer agents that engage in conversational dialogues and trialogues with learners
Graesser, A. C., Cai, Z., Morgan, B., & Wang, L. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.041 · Cited by 63 · see citing works
Zhou, Y., Gan, L., Chen, J., Wijaya, T. T., & Li, Y. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101272 · Cited by 78 · see citing works
Siiman, L., Rannastu-Avalos, M., Pöysä-Tarhonen, J., Häkkinen, P., & Pedaste, M. (2023) · International Conference on Innovative Technologies and Learning · doi:10.1007/978-3-031-40113-8_9 · Cited by 49 · see citing works
Designs for Operationalizing Collaborative Problem Solving for Automated Assessment
Scoular, C., Care, E., & Hesse, F. W. (2017) · Journal of Educational Measurement · doi:10.1111/jedm.12130 · Cited by 53 · see citing works
Self-citationChallenges for IT-Enabled Formative Assessment of Complex 21st Century Skills
Webb, M., Prasse, D., Phillips, M., Kadijevich, D. M., Angeli, C., Strijker, A., Carvalho, A. A. A., Andresen, B. B., Dobozy, E., & Laugesen, H. (2018) · Technology Knowledge and Learning · doi:10.1007/s10758-018-9379-7 · Cited by 53 · see citing works
Ercikan, K., & Oliveri, M. E. (2016) · Applied Measurement in Education · doi:10.1080/08957347.2016.1209210 · Cited by 52 · see citing works
The role of achievement emotions in the collaborative problem-solving performance of adolescents
Camacho-Morles, J., Slemp, G. R., Oades, L. G., Morrish, L., & Scoular, C. (2019) · Learning and Individual Differences · doi:10.1016/j.lindif.2019.02.005 · Cited by 54 · see citing works
Self-citationMultiple Agent Designs in Conversational Intelligent Tutoring Systems
Lippert, A., Shubeck, K. T., Morgan, B., Hampton, A. J., & Graesser, A. C. (2019) · Technology Knowledge and Learning · doi:10.1007/s10758-019-09431-8 · Cited by 46 · see citing works
Application of Ontologies for Assessing Collaborative Problem Solving Skills
Andrews-Todd, J., & Kerr, D. (2019) · International Journal of Testing · doi:10.1080/15305058.2019.1573823 · Cited by 46 · see citing works
Khasawneh, E., Hodge-Zickerman, A., York, C. S., Smith, T. J., & Mayall, H. J. (2022) · International Electronic Journal of Mathematics Education · doi:10.29333/iejme/12715 · Cited by 64 · see citing works
Exploring Factors that Influence Collaborative Problem Solving Awareness in Science Education
Chen, L., Inoue, K., Goda, Y., Okubo, F., Taniguchi, Y., Oi, M., Konomi, S., Ogata, H., & Yamada, M. (2020) · Technology Knowledge and Learning · doi:10.1007/s10758-020-09436-8 · Cited by 42 · see citing works
Assessing collaborative problem-solving skills among elementary school students
Rojas, M., Nussbaum, M., Chiuminatto, P., Guerrero, O., Greiff, S., Krieger, F., & van der Westhuizen, L. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104313 · Cited by 42 · see citing works
iVisit-Collaborate: Collaborative problem-solving in multiuser 360-degree panoramic site visits
Eiris, R., Wen, J., & Gheisari, M. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104365 · Cited by 44 · see citing works
Chang, C., Chang, M. ‐., Liu, C., Chiu, B., Chiang, S. F., Wen, C., Hwang, F.-K., Chao, P.-Y., Chen, Y. ‐., & Chai, C. S. (2017) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12208 · Cited by 44 · see citing works
Du, X., Dai, M., Tang, H., Hung, J.-L., Li, H., & Zheng, J. (2022) · Journal of Computing in Higher Education · doi:10.1007/s12528-022-09311-8 · Cited by 41 · see citing works
Yılmaz, E., Yel, S., & Griffiths, M. D. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104548 · Cited by 44 · see citing works
Siddiq, F., & Scherer, R. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.08.007 · Cited by 40 · see citing works
Zhang, D., & Hwang, G. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221094250 · Cited by 49 · see citing works
Yılmaz, E., & Griffiths, M. D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11663-2 · Cited by 51 · see citing works
Gunadi, G., Haryono, H., & Purwanti, E. (2022) · Innovative Journal of Curriculum and Educational Technology · doi:10.15294/ijcet.v11i1.44847 · Cited by 29 · see citing works
Li, Y., Hu, W., Li, Y., & Zheng, Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2239295 · Cited by 28 · see citing works
He, S., Shi, X., Choi, T.-H., & Zhai, J. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101423 · Cited by 28 · see citing works
Patterns of action transitions in online collaborative problem solving: A network analysis approach
Li, S., Pöysä‐Tarhonen, J., & Häkkinen, P. (2022) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-022-09369-7 · Cited by 26 · see citing works
Herde, C. N., Lievens, F., Solberg, E. G., Harbaugh, J. L., Strong, M. H., & Burkholder, G. J. (2019) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2019a8 · Cited by 25 · see citing works
Factors Predicting Collaborative Problem Solving: Based on the Data From PISA 2015
Tang, P., Liu, H., & Wen, H. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.619450 · Cited by 25 · see citing works
Habilidades del siglo XXI y entornos de aprendizaje STEAM: una revisión
Mariano, W. K., & Chiappe, A. (2021) · Revista de Educación a Distancia (RED) · doi:10.6018/red.470461 · Cited by 35 · see citing works
Zheng, Y., Bao, H., Shen, J., & Zhai, X. (2020) · Sustainability · doi:10.3390/su12208522 · Cited by 23 · see citing works
Collaborative Skills Training Using Digital Tools: A Systematic Literature Review
Cherbonnier, A., Hémon, B., Michinov, N., Jamet, É., & Michinov, E. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2348227 · Cited by 23 · see citing works
Medová, J., Bulková, K. O., & Čeretková, S. (2020) · Mathematics · doi:10.3390/math8122257 · Cited by 22 · see citing works
Li, S., Pöysä‐Tarhonen, J., & Häkkinen, P. (2023) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2023.100312 · Cited by 30 · see citing works
Pair interactions in online assessments of collaborative problem solving: case-based portraits
Pöysä‐Tarhonen, J., Care, E., Awwal, N., & Häkkinen, P. (2018) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-018-0079-7 · Cited by 22 · see citing works
Self-citationBoshrabadi, A. M., & Hosseini, M. R. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1836122 · Cited by 23 · see citing works
(2021) · Educational Data Mining · Cited by 21 · see citing works
Pöysä‐Tarhonen, J., Awwal, N., Häkkinen, P., & Otieno, S. (2021) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-021-00160-0 · Cited by 19 · see citing works
Feng, Q., Luo, H., Li, Z., Liang, J., Li, G., & Yi, Y. (2024) · Applied Sciences · doi:10.3390/app14052167 · Cited by 19 · see citing works
Andrews‐Todd, J., Steinberg, J., Flor, M., & Forsyth, C. M. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10030039 · Cited by 18 · see citing works
Chopade, P., Edwards, D., Khan, S. M., Andrade, A., & Pu, S. (2019) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/hst47167.2019.9032906 · Cited by 18 · see citing works
Piotrowska, I., Cichoń, M., Sypniewski, J., & Abramowicz, D. (2022) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-7998-9598-5.ch002 · Cited by 17 · see citing works
Jiang, Y., Martín‐Raugh, M. P., Yang, Z., Hao, J., Liu, L., & Kyllonen, P. C. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107608 · Cited by 17 · see citing works
Graesser, A. C., Dowell, N., Hampton, A. J., Lippert, A. M., Li, H., & Shaffer, D. W. (2018) · Research on managing groups and teams · doi:10.1108/s1534-085620180000019012 · Cited by 17 · see citing works
Exploring graduate students’ collaborative problem-solving in engineering design tasks
Herro, D. C., McNeese, N. J., O’Hara, R., Frady, K. K., & Switzer, D. (2021) · Journal of Engineering Design · doi:10.1080/09544828.2021.1922616 · Cited by 17 · see citing works
Designing a visualization tool for children to reflect on their collaborative dialogue
Celepkolu, M., Wiggins, J. B., Galdo, A. C., & Boyer, K. E. (2020) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2020.100232 · Cited by 17 · see citing works
D’Angelo, C. M., & Rajarathinam, R. J. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13449 · Cited by 14 · see citing works
Graesser, A. C., Lippert, A. M., & Hampton, A. J. (2017) · Springer eBooks · doi:10.1007/978-3-319-64274-1_12 · Cited by 14 · see citing works
Conversion of extrinsic into intrinsic motivation and computer based testing (CBT)
Hariri-Akbari, M., Shokrvash, B., Mahmoodi, F., Aminabad, F. J., Yousefi, B., & Azabdaftari, F. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1249-4 · Cited by 13 · see citing works
Liu, Y., Hu, X., Ng, J. T.-D., Ma, Z., & Lai, X. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12842-5 · Cited by 12 · see citing works
Pöysä‐Tarhonen, J., Häkkinen, P., Tarhonen, P., Näykki, P., & Järvelä, S. (2021) · Instructional Science · doi:10.1007/s11251-021-09562-5 · Cited by 12 · see citing works
The cops model for collaborative problem-solving in mathematics
Fitzsimons, A., & Fhloinn, E. N. (2023) · Irish Educational Studies · doi:10.1080/03323315.2023.2189137 · Cited by 11 · see citing works
A Generalized Scoring Process to Measure Collaborative Problem Solving in Online Environments
Scoular, C., & Care, E. (2019) · Educational Assessment · doi:10.1080/10627197.2019.1615372 · Cited by 11 · see citing works
Self-citationDesarrollo de habilidades intelectuales en docentes de educación básica de Machala, Ecuador
Freire, E. E. E., & Echevarría, M. L. R. (2019) · Educación · doi:10.18800/educacion.201902.003 · Cited by 11 · see citing works
Kesalahan siswa SMA dalam memecahkan masalah pada materi Hukum Newton
Januarifin, D., Parno, P., & Hidayat, A. (2018) · Momentum Physics Education Journal · doi:10.21067/mpej.v1i1.2292 · Cited by 11 · see citing works
Estimation of individuals’ collaborative problem solving ability in computer-based assessment
Li, M., Liu, H., Cai, M., & Yuan, J. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12271-w · Cited by 10 · see citing works
Curricular, interactional, and structural diversity: identifying factors affecting learning outcomes
Chu, J., & Huang, A. D. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2308710 · Cited by 10 · see citing works
Comparative analysis of student performance in collaborative problem solving: What does it tell us?
Scoular, C., Eleftheriadou, S., Ramalingam, D., & Cloney, D. (2020) · Australian Journal of Education · doi:10.1177/0004944120957390 · Cited by 10 · see citing works
Self-citationHuman-Agent Assessment: Interaction and Sub-skills Scoring for Collaborative Problem Solving
Chopade, P., Stoeffler, K., Khan, S. M., Rosen, Y., Swartz, S., & von Davier, A. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_10 · Cited by 10 · see citing works
Undersøgelse af De Nationale Tests måleegenskaber
Bundsgaard, J., & Kreiner, S. (2019) · doi:10.7146/aul.319.217 · Cited by 10 · see citing works
Samadi, M. A., Jaquay, S., Lin, Y., Tajik, E., Park, S., & Nixon, N. (2024) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3636555.3636922 · Cited by 9 · see citing works
Chen, L., Taniguchi, Y., Shimada, A., & Yamada, M. (2024) · SAGE Open · doi:10.1177/21582440241251641 · Cited by 17 · see citing works
Hong, Y., Chen, L.-G., Huang, J.-H., Tsai, Y.-Y., & Chang, T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.866863 · Cited by 9 · see citing works
García-Hernández, A., & Ramírez, T. G. (2017) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/3144826.3145443 · Cited by 9 · see citing works
The Contextualisation of 21st Century Skills
Care, E., Giacomazzi, M., & Mugo, J. K. (2024) · The enabling power of assessment · doi:10.1007/978-3-031-51490-6 · Cited by 8 · see citing works
Self-citationCollaboration in East Africa: A Contextualised Approach to Defining the Construct
Scoular, C., & Otieno, D. A. (2024) · The enabling power of assessment · doi:10.1007/978-3-031-51490-6_6 · Cited by 8 · see citing works
Self-citationKim, H., Hartleb, T., Bello, K., Aqlan, F., Zhao, R., & Yang, H. Y. (2023) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4063089 · Cited by 8 · see citing works
Lyndgaard, S. F., & Kanfer, R. (2024) · Journal of the Learning Sciences · doi:10.1080/10508406.2024.2303777 · Cited by 8 · see citing works
Mao, Z., Li, X., & Li, Y. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101642 · Cited by 8 · see citing works
Functions of Participants in the Collaborative Solution of Thinking Problems
Belousova, A. (2020) · International Journal of Cognitive Research in Science Engineering and Education · doi:10.23947/2334-8496-2020-8-si-29-36 · Cited by 8 · see citing works
Review of problem-solving measurement: an assessment developed in the Indonesian context
Wicaksono, A. G. C., & Korom, E. (2021) · Participatory Educational Research · doi:10.17275/per.22.7.9.1 · Cited by 8 · see citing works
Giabbanelli, P. J., Tawfik, A. A., & Wang, B. (2022) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2119449 · Cited by 8 · see citing works
Collaboration in East Africa: A Contextual Definition
Abad, M. F., Peverelli, F., & Giacomazzi, M. (2022) · Education Sciences · doi:10.3390/educsci12100706 · Cited by 8 · see citing works
Menzel, L., Gombert, S., Weidlich, J., Fink, A., Frey, A., & Drachsler, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42682-7_14 · Cited by 8 · see citing works
Perception and Possibilities of ICT Tools in the Education from the Teachers' Perspective
Klement, M., Dostál, J., & Bártek, K. (2017) · doi:10.5507/pdf.17.24450933 · Cited by 8 · see citing works
Kompleks Problem Çözme Üzerine R Programı ile Bir Bibliyometrik Analiz
AŞKUN, V., & ÇİZEL, R. (2019) · Mediterranean Journal of Humanities · doi:10.13114/mjh.2019.445 · Cited by 8 · see citing works
Tang, X., Liu, Y., & Milner‐Bolotin, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295611 · Cited by 7 · see citing works
Liu, C., Lin, T., Cheng, C., Wen, C., Chang, M., Chiang, S. F., Tsai, M., Lin, H., & Hwang, F.-K. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12625 · Cited by 7 · see citing works
Sum, P. E., & Bădescu, G. (2023) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102843 · Cited by 7 · see citing works
Visualizing the Commognitive Processes of Collaborative Problem Solving in Mathematics Classrooms
Lu, J., Wu, S., Wang, Y., & Zhang, Y. (2022) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-022-00681-2 · Cited by 7 · see citing works
Technology-Enhanced Learning: An Optimal CPS Learning Application
Chien, Y. (2019) · Sustainability · doi:10.3390/su11164415 · Cited by 7 · see citing works
Yang, S., Du, X., Tang, H., Hung, J.-L., & Tang, Y. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12373-5 · Cited by 6 · see citing works
- Authors
- Care, E., Scoular, C., & Griffin, P.
- Affiliations
- Brookings Institution (US)
- The University of Melbourne (AU)
- Corresponding author
- Care, Esther
- Venue
- Applied Measurement in Education
- Publisher
- Informa UK Limited
- Published
- 2016-07-06
- Volume
- 29
- Issue
- 4
- Pages
- 250-264
- ISSN
- 0895-7347 (ISSN-L)
- 1532-4818
- OpenAlex
- W2473303224
- Cited by
- 198
- References
- 47
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 35 · 2023: 29 · 2022: 28 · 2021: 21 · 2020: 16 · 2019: 15 · 2018: 15 · 2017: 14 · 2016: 1
- FWCI
- 35.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Applied Measurement in Education (publishedVersion)
- Funders
- Cisco Systems
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- collaborative problem solving, 21st century skills, reasoning tasks, formative feedback, differentiated instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
