The DOI matches its Crossref record; 45 of the 47 references it cites were found in a registry or an index.
Assessment of Collaborative Problem Solving in Education Environments
Abstract
The Assessment and Teaching of 21st Century Skills (ATC21STM) project undertook a research and development plan that included conceptualization of 21st century skills and assessment task development. Conceptualization focused on the definition of 21st century skills. This article outlines the particular case of one of these skills, collaborative problem solving, from its definition and identification of subskills, to development of a method for its assessment. The theories contributing to construct definition are described. These have implications for the particular clusters of subskills that are of interest for educational assessment. An approach to assessment task creation is illustrated through the deconstruction of a well-known reasoning task, and its re-development to sample both the cognitive and social aspects of collaborative problem solving. The assessment tasks are designed to generate formative feedback for teachers in order to identify levels of ability within and between their students and support tailoring of instruction differentially for improvement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“two main underpinning skills were described for the assessment: the social skill of audience awareness (“how to adapt one’s own behavior to suit the needs of the task and the partner’s requirements”, Care et al. 2016, p. 258) and the cognitive skill of planning and executing”
From Creativity, Critical Thinking, Communication, and Collaboration: Assessment, Certification, and Promotion of 21st Century Skills for the Future of Work and Education (2023) · cites this paper as Care et al. 2016
Citations
Cites
Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,886
21st century skills: learning for life in our times
(2010) · Choice Reviews Online · doi:10.5860/choice.47-5788 · Cited by 3,004
Work group diversity and group performance: an integrative model and research agenda.
van Knippenberg, D., De Dreu, C. K. W., & Homan, A. C. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1008 · Cited by 2,911
Metacognitive Aspects of Problem Solving
Flavell, J. H. (2024) · Routledge eBooks · doi:10.4324/9781032646527-16 · Cited by 2,809
Transactive Memory: A Contemporary Analysis of the Group Mind
Wegner, D. M. (1987) · Theories of Group Behavior · doi:10.1007/978-1-4612-4634-3_9 · Cited by 2,700 · cited 1×
“Social regulation skills require both knowledge about one’s own strengths and weaknesses (Flavell, 1976) and knowledge about the strengths and weaknesses of collaboration partners (Wegner, 1986).”
BackgroundRestructuring the Classroom: Conditions for Productive Small Groups
Cohen, E. G. (1994) · Review of Educational Research · doi:10.3102/00346543064001001 · Cited by 2,120
Defining Twenty-First Century Skills
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-007-2324-5_2 · Cited by 1,809
Collective cognitive responsibility for the advancement of knowledge
Scardamalia (2002) · Medical Entomology and Zoology · Cited by 939
International Handbook of Information Technology in Primary and Secondary Education
Voogt, J. M., & Knezek, G. (2008) · Springer eBooks · doi:10.1007/978-0-387-73315-9 · Cited by 719
Liberal education in a knowledge society
Bereiter, C. (2003) · Choice Reviews Online · doi:10.5860/choice.40-3551 · Cited by 629
A Framework for Teachable Collaborative Problem Solving Skills
Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-017-9395-7_2 · Cited by 507
Self-citationAssessment and Teaching of 21st Century Skills
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7 · Cited by 499
Self-citationRummel, N., & Spada, H. (2005) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1402_2 · Cited by 470
Hidden Profiles: A Brief History
Stasser, G. L., & Titus, W. (2003) · Psychological Inquiry · doi:10.1080/1047840x.2003.9682897 · Cited by 434
Children's internet searching on complex problems: Performance and process analyses
Schacter, J., Chung, G. K. W. K., & Dorr, A. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199807)49:9 · Cited by 286
Thompson, L., Wang, J., & Gunia, B. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100458 · Cited by 263
The Process of Solving Complex Problems
Fischer, A., Greiff, S., & Funke, J. (2012) · The Journal of Problem Solving · doi:10.7771/1932-6246.1118 · Cited by 242
The Structure of Discourse in Collaborative Learning
Chinn, C. A., O’Donnell, A. M., & Jinks, T. S. (2000) · The Journal of Experimental Education · doi:10.1080/00220970009600650 · Cited by 217
Computer simulation as a research tool: The DISCUSS model of group decision making
Stasser, G. L. (1988) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(88)90028-5 · Cited by 210
The future of testing: A research agenda for cognitive psychology and psychometrics.
Glaser, R. A. (1981) · American Psychologist · doi:10.1037/0003-066x.36.9.923 · Cited by 189
Trötschel, R., Hüffmeier, J., Loschelder, D. D., Schwartz, K., & Gollwitzer, P. M. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0023801 · Cited by 168
Dynamics of Peer Education in Cooperative Learning Workgroups
Haller, C. R., Gallagher, V. J., Weldon, T. L., & Felder, R. M. (2000) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2000.tb00527.x · Cited by 146
Issues in the Computer-based Assessment of Collaborative Problem Solving
O’Neil, H. F., Chuang, S.-H., & Chung, G. K. W. K. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000148190 · Cited by 117
COLLABORATIVE PROBLEM SOLVING AND THE ASSESSMENT OF COGNITIVE SKILLS: PSYCHOMETRIC CONSIDERATIONS
von Davier, A. A., & Halpin, P. F. (2013) · ETS Research Report Series · doi:10.1002/j.2333-8504.2013.tb02348.x · Cited by 113
THE COMFORT OF COMPETENCE AND THE UNCERTAINTY OF ASSESSMENT
Griffin, P. (2007) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2007.01.007 · Cited by 102
Self-citationBrodbeck, F. C., & Greitemeyer, T. (2000) · Journal of Experimental Social Psychology · doi:10.1006/jesp.2000.1423 · Cited by 95
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_1 · Cited by 79
Self-citationCollaborative Problem Solving Tasks
Care, E., Griffin, P., Scoular, C., Awwal, N., & Zoanetti, N. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_4 · Cited by 72
Self-citationUse of networked simulations as a context to measure team competencies
O’Neil, H. F. (1997) · Cited by 66
Perspectives on computer-based performance assessment of problem solving
O’Neil, H. F. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00022-9 · Cited by 57
The Effects of Frontal Lobe Lesions on Goal Achievement in the Water Jug Task
Colvin, M. K., Dunbar, K. N., & Grafman, J. H. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901753294419 · Cited by 53
Review of workforce readiness theoretical frameworks
O’Neil, H. F. (1997) · Cited by 48
Pazos, P., Micari, M., & Light, G. J. (2009) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930802691572 · Cited by 42
Perspectives on Methodological Issues
Wilson, M. R., Bejar, I. I., Scalise, K., Templin, J. L., Wiliam, D., & Irribarra, D. T. (2011) · Springer eBooks · doi:10.1007/978-94-007-2324-5_3 · Cited by 39
Famous Puzzles of Great Mathematicians
Petković, M. S. (2009) · American Mathematical Society eBooks · doi:10.1090/mbk/063 · Cited by 38
Arts, J. A. R., Gijselaers, W., & Segers, M. S. R. (2006) · European Journal of Psychology of Education · doi:10.1007/bf03173570 · Cited by 37
Famous puzzles of great mathematicians
(2010) · Choice Reviews Online · doi:10.5860/choice.47-5072 · Cited by 30
Counterintuitive and alternative moves choice in the Water Jug task
Carder, H. P., Handley, S. J., & Perfect, T. J. (2007) · Brain and Cognition · doi:10.1016/j.bandc.2007.04.006 · Cited by 20
Liao, S.-H., & Ho, Y.-P. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.020 · Cited by 19
von Davier, A. A., & Halpin, P. F. (2013) · ETS Research Report Series · Cited by 18
Models of Participation During Face-to-Face Unstructured Discussion
Vaughan, G. S. A. S. (2014) · doi:10.4324/9781315806372-16 · Cited by 17
How Technology Changes Demands for Human Skills. OECD Education Working Papers, No. 45.
Levy, F. (2010) · OECD Publishing (NJ1) · Cited by 14
McDiarmid, C., & Alfonsín, J. L. R. (1994) · Discrete Mathematics · doi:10.1016/0012-365x(94)90169-4 · Cited by 13
Solving the water jugs problem by an integer sequence approach
Man, Y. K. (2011) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2011.562323 · Cited by 7
An Alternative Arithmetic Approach to the Water Jugs Problem
Mary, R. S. (2014) · National Conference Computational Intelligence · Cited by 2
Research works printed but not linked: 10
- Flavell J. H., 1976, The nature of intelligence
- Glaser B. G., 1992, Basics of grounded theory analysis
- 10.1002/jee.2000.89.issue-3 · DOI
- O’Neil H. F., 1997, Workforce Readiness: Competencies and assessment
- O’Neil H. F., 1997, Workforce readiness: Competencies and assessment
- Smeeta M., 2014, IJCA Proceedings on National Conference on Computational Intelligence for Engineering Quality Software, 1, 10
- Stasser G., 1996, Understanding group behavior: Consensual action by small groups, 1
- Wegner D. M., 1986, Theories of group behavior (pp. 185–208)
- Weinstein E. A., 1969, Handbook of socialization theory and research (pp. 289–312)
- 10.1111/jopy.1983.51.issue-4 · DOI
Cited by
Sorted by citations
The relation between 21st-century skills and digital skills: A systematic literature review
van Laar, E., van Deursen, A. J. A. M., van Dijk, J. A. G. M., & de Haan, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.010 · Cited by 2,006
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., et al. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11030054 · Cited by 768
Developing student 21st Century skills in selected exemplary inclusive STEM high schools
Stehle, S. M., & Peters‐Burton, E. E. (2019) · International Journal of STEM Education · doi:10.1186/s40594-019-0192-1 · Cited by 514
Advancing the Science of Collaborative Problem Solving
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018) · Psychological Science in the Public Interest · doi:10.1177/1529100618808244 · Cited by 390
Teaching for the 21st century: A case for dialogic pedagogy
Teo, P. (2019) · Learning Culture and Social Interaction · doi:10.1016/j.lcsi.2019.03.009 · Cited by 282
Metadata
- Authors
- Care, E., Scoular, C., & Griffin, P.
- Affiliations
- Brookings Institution (US)
- The University of Melbourne (AU)
- Corresponding author
- Care, Esther
- Venue
- Applied Measurement in Education
- Publisher
- Informa UK Limited
- Published
- 2016-07-06
- Volume
- 29
- Issue
- 4
- Pages
- 250-264
- ISSN
- 0895-7347 (ISSN-L)
- 1532-4818
- OpenAlex
- W2473303224
- Cited by
- 198
- References
- 47
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 35 · 2023: 29 · 2022: 28 · 2021: 21 · 2020: 16 · 2019: 15 · 2018: 15 · 2017: 14 · 2016: 1
- FWCI
- 35.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Applied Measurement in Education (publishedVersion)
- Funders
- Cisco Systems
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- collaborative problem solving, 21st century skills, reasoning tasks, formative feedback, differentiated instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
