Cited by 390Innovative Teaching and Learning MethodsProblem and Project Based LearningProblem Solving Skills Development

The DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.

Advancing the Science of Collaborative Problem Solving

Open access

Graesser, Arthur C., Fiore, Stephen M., Greiff, Samuel, Andrews-Todd, Jessica, Foltz, Peter W., Hesse, Friedrich W.·2018·Psychological Science in the Public Interest

DOI 10.1177/1529100618808244

Open this paper in CoChat — free account

Abstract

Collaborative problem solving (CPS) has been receiving increasing international attention because much of the complex work in the modern world is performed by teams. However, systematic education and training on CPS is lacking for those entering and participating in the workforce. In 2015, the Programme for International Student Assessment (PISA), a global test of educational progress, documented the low levels of proficiency in CPS. This result not only underscores a significant societal need but also presents an important opportunity for psychological scientists to develop, adopt, and implement theory and empirical research on CPS and to work with educators and policy experts to improve training in CPS. This article offers some directions for psychological science to participate in the growing attention to CPS throughout the world. First, it identifies the existing theoretical frameworks and empirical research that focus on CPS. Second, it provides examples of how recent technologies can automate analyses of CPS processes and assessments so that substantially larger data sets can be analyzed and so students can receive immediate feedback on their CPS performance. Third, it identifies some challenges, debates, and uncertainties in creating an infrastructure for research, education, and training in CPS. CPS education and assessment are expected to improve when supported by larger data sets and theoretical frameworks that are informed by psychological science. This will require interdisciplinary efforts that include expertise in psychological science, education, assessment, intelligent digital technologies, and policy.

Integrity signals

Registry

Crossref · 10.1177/1529100618808244

Cites

161 of 161 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Cognition in the Wild
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Problem-Based Learning: What and How Do Students Learn?
Hmelo‐Silver, C. E. (2004) · Educational Psychology Review · doi:10.1023/b:edpr.0000034022.16470.f3 · Cited by 5,552
Using Language
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Self-citation
Handbook of educational psychology
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3084 · Cited by 4,850
Speech and language processing
Politt, R., Pollock, J., & Waller, E. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203461891_chapter_3 · Cited by 3,594
Work group diversity and group performance: an integrative model and research agenda.
van Knippenberg, D., De Dreu, C. K. W., & Homan, A. C. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1008 · Cited by 2,911
Using language: Communicative acts
Clark, H. H. (1996) · Cited by 2,721
Using language: Index of names
Clark, H. H. (1996) · Cited by 2,720
Context and consciousness: activity theory and human-computer interaction
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5756 · Cited by 2,511
Many Hands Make Light the Work: The Causes and Consequences of Social Loafing
Latané, B., Williams, K., & Harkins, S. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.6.822 · Cited by 2,216
Work Group Diversity
van Knippenberg, D., & Schippers, M. C. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085546 · Cited by 2,200
Social loafing: a meta-analytic review and theoretical integration.
Karau, S. J., & Williams, K. D. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.4.681 · Cited by 2,196
Effects of problem-based learning: a meta-analysis
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003) · Learning and Instruction · doi:10.1016/s0959-4752(02)00025-7 · Cited by 1,713
Handbook of Latent Semantic Analysis
Landauer, T. K. (2007) · Psychology Press eBooks · doi:10.4324/9780203936399 · Cited by 1,603
Relating member ability and personality to work-team processes and team effectiveness.
Barrick, M. R., Stewart, G. L., Neubert, M. J., & Mount, M. K. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.3.377 · Cited by 1,557
Does problem-based learning work? A meta-analysis of evaluative research
Vernon, D. T., & Blake, R. L. (1993) · Academic Medicine · doi:10.1097/00001888-199307000-00015 · Cited by 1,456
The relation between group cohesiveness and performance: An integration.
Mullen, B., & Copper, C. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.2.210 · Cited by 1,398
Cohesion and Performance in Groups: A Meta-Analytic Clarification of Construct Relations.
Beal, D. J., Cohen, R. R., Burke, M. J., & McLendon, C. L. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.6.989 · Cited by 1,321
On Teams, Teamwork, and Team Performance: Discoveries and Developments
Salas, E., Cooke, N. J., & Rosen, M. A. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288457 · Cited by 1,278
Information sharing and team performance: A meta-analysis
Mesmer-Magnus, J. R., & DeChurch, L. A. (2009) · Journal of Applied Psychology · doi:10.1037/a0013773 · Cited by 1,273 · cited 1×
“…research on teams has typically focused on learning in groups (Slavin, 2017), group decision making (Gigone & Hastie, 1997; Hastie & Kameda, 2005; Mesmer-Magnus & DeChurch, 2009), or team training (Mathieu, Hollenbeck, van Knippenberg, & Ilgen, 2017), rather than group problem solving per se.”
Background
Deep-level composition variables as predictors of team performance: A meta-analysis.
Bell, S. T. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.3.595 · Cited by 1,225
Aviation, Space, and Environmental Medicine
(2011) · Wilderness and Environmental Medicine · doi:10.1016/j.wem.2010.11.006 · Cited by 1,200
Facilitating Interdisciplinary Research
National Academy of Sciences, N. A. O. E. (2004) · National Academies Press eBooks · doi:10.17226/11153 · Cited by 1,024
A META‐ANALYSIS OF TEAMWORK PROCESSES: TESTS OF A MULTIDIMENSIONAL MODEL AND RELATIONSHIPS WITH TEAM EFFECTIVENESS CRITERIA
LePine, J. A., Piccolo, R. F., JACKSON, C. L., Mathieu, J. E., & Saul, J. R. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00114.x · Cited by 1,017
Learning by Collaborating: Convergent Conceptual Change
Roschelle, J. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0203_1 · Cited by 1,015
Theories of Group Behavior
Mullen, B. R., & Goethals, G. R. (1987) · Springer eBooks · doi:10.1007/978-1-4612-4634-3 · Cited by 985
The Knowledge, Skill, and Ability Requirements for Teamwork: Implications for Human Resource Management
Stevens, M. J., & Campion, M. A. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90025-6 · Cited by 887
Reflections on shared cognition
Cannon‐Bowers, J. A., & Salas, E. (2001) · Journal of Organizational Behavior · doi:10.1002/job.82 · Cited by 855
Congruence and friction between learning and teaching
Vermunt, J. D. H. M., & Verloop, N. (1999) · Learning and Instruction · doi:10.1016/s0959-4752(98)00028-0 · Cited by 844
Focus Article: On the Structure of Educational Assessments
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003) · Measurement Interdisciplinary Research and Perspectives · doi:10.1207/s15366359mea0101_02 · Cited by 841
Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration
Mullen, B. R., Johnson, C., & Salas, E. (1991) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp1201_1 · Cited by 828
How People Learn: Brain, Mind, Experience, and School: Expanded Edition
(2000) · doi:10.17226/9853 · Cited by 772
Effectiveness of problem‐based learning curricula: theory, practice and paper darts
Norman, G. R., & Schmidt, H. G. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00749.x · Cited by 712
Enhancing the Effectiveness of Team Science
National Research Council (2015) · National Academies Press eBooks · doi:10.17226/19007 · Cited by 704
Understanding by addressees and overhearers
Schober, M. F., & Clark, H. H. (1989) · Cognitive Psychology · doi:10.1016/0010-0285(89)90008-x · Cited by 693
Assessment and Teaching of 21st Century Skills
(2017) · Educational assessment in an information age · doi:10.1007/978-3-319-65368-6 · Cited by 671
Motivation losses in small groups: A social dilemma analysis.
Kerr, N. L. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.4.819 · Cited by 669
PISA 2015 Assessment and Analytical Framework
OECD (2017) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/9789264281820-en · Cited by 623
A century of work teams in the Journal of Applied Psychology.
Mathieu, J. E., Hollenbeck, J. R., van Knippenberg, D., & Ilgen, D. R. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000128 · Cited by 593
The science of team science: A review of the empirical evidence and research gaps on collaboration in science.
Hall, K. L., Vogel, A. L., Huang, G. C., Serrano, K. J., Rice, E. L., Tsakraklides, S. P., & Fiore, S. M. (2018) · American Psychologist · doi:10.1037/amp0000319 · Cited by 553
Self-citation
Identifiability as a deterrant to social loafing: Two cheering experiments.
Williams, K. D., Harkins, S. G., & Latané, B. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.40.2.303 · Cited by 539
The Knowledge, Skill, and Ability Requirements for Teamwork: Implications for Human Resource Management
Stevens, M. J., & Campion, M. A. (1994) · Journal of Management · doi:10.1177/014920639402000210 · Cited by 538
Group Cohesion and Performance: A Meta-Analysis
Evans, C. R., & Dion, K. L. (1991) · Small Group Research · doi:10.1177/1046496491222002 · Cited by 535 · cited 1×
“…in teams is extensive, and the consensus is that team cohesion is positively related to team effectiveness (Beal, Cohen, Burke, & McLendon, 2003; Evans & Dion, 1991; Gully, Devine, & Whitney, 1995; Mathieu, Kukenberger, D’innocenzo, & Reilly, 2015; Mullen & Copper, 1994; Oliver, Harman, Hoover,…”
A Meta-Analysis of Cohesion and Performance
Gully, S. M., Devine, D. J., & Whitney, D. J. (1995) · Small Group Research · doi:10.1177/1046496495264003 · Cited by 527
A Framework for Teachable Collaborative Problem Solving Skills
Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-017-9395-7_2 · Cited by 507
Self-citation
APPLICANT REACTIONS TO SELECTION PROCEDURES
Smither, J. W., REILLY, R. R., Millsap, R. E., T, K. P. A., & Stoffey, R. W. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00867.x · Cited by 507
Collective memory: Collaborative and individual processes in remembering.
Weldon, M. S., & Bellinger, K. D. (1997) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.23.5.1160 · Cited by 498 · cited 1×
“The superior memory performance of nominal groups relative to collaborating groups has been termed collaborative inhibition (Andersson, Hitch, & Meudell, 2006; Weldon & Bellinger, 1997).”
Background
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 474
Social Loafing: A Field Investigation
Liden, R. C., Wayne, S. J., Jaworski, R. A., & Bennett, N. (2003) · Journal of Management · doi:10.1016/j.jm.2003.02.002 · Cited by 456
Does Team Building Work?
Klein, C. R., DiazGranados, D., Salas, E., Le, H., Burke, C. S., Lyons, R., & Goodwin, G. F. (2009) · Small Group Research · doi:10.1177/1046496408328821 · Cited by 447
AutoTutor and affective autotutor
D’Mello, S. K., & Graesser, A. C. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2395123.2395128 · Cited by 440
Self-citation
Social contagion of memory
Roediger, H. L., III, Meade, M. L., & Bergman, E. T. (2001) · Psychonomic Bulletin & Review · doi:10.3758/bf03196174 · Cited by 423
The Relationship between Work-Team Personality Composition and the Job Performance of Teams
Neuman, G. A., Wagner, S. H., & Christiansen, N. D. (1999) · Group & Organization Management · doi:10.1177/1059601199241003 · Cited by 418
Complex Problem Solving: The European Perspective
Frensch, P., & Funke, J. (1995) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00008262 · Cited by 418
The Jigsaw Classroom: Building Cooperation in the Classroom
Aronson, E., & Patnoe, S. (1997) · Medical Entomology and Zoology · Cited by 410
Complex problem solving: a case for complex cognition?
Funke, J. (2009) · Cognitive Processing · doi:10.1007/s10339-009-0345-0 · Cited by 380
A rating scheme for assessing the quality of computer-supported collaboration processes
Deiglmayr, A., Spada, H., & Rummel, N. (2007) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-006-9005-x · Cited by 366
Promoting reflective interactions in a CSCL environment
Baker, M. J., & Lund, K. (1997) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1997.00019.x · Cited by 359
Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century
(2012) · The National Academies Press · doi:10.17226/13398 · Cited by 337
Interdisciplinarity as Teamwork
Fiore, S. M. (2008) · Small Group Research · doi:10.1177/1046496408317797 · Cited by 330
Self-citation
Modeling reciprocal team cohesion–performance relationships, as impacted by shared leadership and members' competence
Mathieu, J. E., Kukenberger, M. R., D'Innocenzo, L., & Reilly, G. (2015) · Journal of Applied Psychology · doi:10.1037/a0038898 · Cited by 316 · cited 1×
“Cohesion is also associated with leadership in teams (Mathieu et al., 2015) and can mediate diversity differences in teams (Liang, Shih, & Chiang, 2015).”
Background
Connecting problem‐based practices with educational theory
Gijselaers, W. (1996) · New Directions for Teaching and Learning · doi:10.1002/tl.37219966805 · Cited by 296
Situational Judgment Tests: A Review of Practice and Constructs Assessed
Cabrera, M. A. M., & Nguyen, N. T. H. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00167 · Cited by 294
Handbook of Research on Learning and Instruction
(2016) · Routledge eBooks · doi:10.4324/9781315736419 · Cited by 289
PISA 2015 Results (Volume V)
OECD (2017) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/9789264285521-en · Cited by 285
Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017) · Educational Psychology Review · doi:10.1007/s10648-016-9361-7 · Cited by 278
Sharing Solutions: Persistence and Grounding in Multimodal Collaborative Problem Solving
Dillenbourg, P., & Traum, D. (2006) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1501_9 · Cited by 273
An Analysis of Team Evolution and Maturation
Morgan, B., Salas, E., & Glickman, A. S. (1993) · The Journal of General Psychology · doi:10.1080/00221309.1993.9711148 · Cited by 266
Negotiation
Thompson, L., Wang, J., & Gunia, B. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100458 · Cited by 263
Toward an Understanding of Macrocognition in Teams: Predicting Processes in Complex Collaborative Contexts
Fiore, S. M., Rosen, M. A., Smith‐Jentsch, K. A., Salas, E., Letsky, M., & Warner, N. (2010) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810369807 · Cited by 261
Self-citation
The Social Development of the Intellect
(1984) · Elsevier eBooks · doi:10.1016/c2009-0-11024-3 · Cited by 259
Face-to-Face Interaction with Pedagogical Agents, Twenty Years Later
Johnson, W. L., & Lester, J. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0065-9 · Cited by 255
Silence Is Not Golden
Cuc, A., Koppel, J., & Hirst, W. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01967.x · Cited by 244
Training Undergraduates to Work in Organizational Teams
Chen, G., Donahue, L. M., & Klimoski, R. J. (2004) · Academy of Management Learning and Education · doi:10.5465/amle.2004.12436817 · Cited by 244
The Process of Solving Complex Problems
Fischer, A., Greiff, S., & Funke, J. (2012) · The Journal of Problem Solving · doi:10.7771/1932-6246.1118 · Cited by 242
Self-citation
Rising Above the Gathering Storm
National Academy of Sciences, N. A. O. E. (2007) · National Academies Press eBooks · doi:10.17226/11463 · Cited by 235
Recognizing group cognition
Theiner, G., Allen, C., & Goldstone, R. L. (2010) · Cognitive Systems Research · doi:10.1016/j.cogsys.2010.07.002 · Cited by 231
AN EVALUATION OF GENERIC TEAMWORK SKILLS TRAINING WITH ACTION TEAMS: EFFECTS ON COGNITIVE AND SKILL‐BASED OUTCOMES
Ellis, A. P. J., Bell, B. S., Ployhart, R. E., Hollenbeck, J. R., & Ilgen, D. R. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00617.x · Cited by 229
The Nature of Problem Solving
OECD (2017) · Educational research and innovation · doi:10.1787/9789264273955-en · Cited by 221
Proper analysis of the accuracy of group judgments.
Gigone, D., & Hastie, R. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.1.149 · Cited by 215
Computers and the Future of Skill Demand
Elliott, S. W. (2017) · Educational research and innovation · doi:10.1787/9789264284395-en · Cited by 214
Personality Heterogeneity in Teams
Mohammed, S., & Angell, L. C. (2003) · Small Group Research · doi:10.1177/1046496403257228 · Cited by 210
The dynamics of team cognition: A process-oriented theory of knowledge emergence in teams.
Grand, J. A., Braun, M. T., Kuljanin, G., Kozlowski, S. W. J., & Chao, G. T. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000136 · Cited by 210
Team-Based Learning for Health Professions Education: A Guide to Using Small Groups for Improving Learning.
Johnson, C. D. (2009) · PubMed Central · Cited by 204
Conversations with AutoTutor Help Students Learn
Graesser, A. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0086-4 · Cited by 202
Self-citation
Collaborative Learning: Cognitive and Computational Approaches. Advances in Learning and Instruction Series.
Dillenbourg, P. (1999) · Cited by 201
Assessment of Collaborative Problem Solving in Education Environments
Care, E., Scoular, C., & Griffin, P. (2016) · Applied Measurement in Education · doi:10.1080/08957347.2016.1209204 · Cited by 198
Domain-general problem solving skills and education in the 21st century
Greiff, S., Wüstenberg, S., Csapó, B., Δημητρίου, Α., Hautamäki, J., Graesser, A. C., & Martin, R. (2014) · Educational Research Review · doi:10.1016/j.edurev.2014.10.002 · Cited by 188
Self-citation
A Quantitative Integration of the Military Cohesion Literature
Oliver, L. W., Harman, J., Hoover, E., Hayes, S. M., & Pandhi, N. A. (1999) · Military Psychology · doi:10.1207/s15327876mp1101_4 · Cited by 177
Exploring social and cognitive dimensions of collaborative problem solving in an open online simulation-based task
Andrews‐Todd, J., & Forsyth, C. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.10.025 · Cited by 158
Self-citation
Technology as Teammate: Examining the Role of External Cognition in Support of Team Cognitive Processes
Fiore, S. M., & Wiltshire, T. J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01531 · Cited by 153
Self-citation
Antecedents and Consequences of Group-Based Guilt: The Effects of Ingroup Identification
Doosje, B., Branscombe, N. R., Spears, R., & Manstead, A. S. R. (2006) · Group Processes & Intergroup Relations · doi:10.1177/1368430206064637 · Cited by 149
Constructive Controversy: The Educative Power of Intellectual Conflict
Johnson, D. W., Johnson, R. T., & Smith, K. A. (2000) · Change The Magazine of Higher Learning · doi:10.1080/00091380009602706 · Cited by 142
Adjusting medical school admission: assessing interpersonal skills using situational judgement tests
Lievens, F. (2013) · Medical Education · doi:10.1111/medu.12089 · Cited by 142
Guiding knowledge communication in CSCL via group knowledge awareness
Dehler, J., Bodemer, D., Buder, J., & Hesse, F. W. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.05.018 · Cited by 141
Self-citation
Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams
Baghaei, N., Mitrović, A., & Irwin, W. (2007) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-007-9018-0 · Cited by 135
Building consensus about the past: Schema consistency and convergence in socially shared retrieval-induced forgetting
Stone, C. B., Barnier, A. J., Sutton, J. D., & Hirst, W. C. (2009) · Memory · doi:10.1080/09658210903159003 · Cited by 135
Group communication analysis: A computational linguistics approach for detecting sociocognitive roles in multiparty interactions
Nixon, N., Nixon, T. M., & Graesser, A. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1102-z · Cited by 134
Self-citation
Research Article Science Assessments for All: Integrating Science Simulations Into Balanced State Science Assessment Systems
Quellmalz, E., Timms, M., Silberglitt, M., & Buckley, B. C. (2012) · Journal of Research in Science Teaching · doi:10.1002/tea.21005 · Cited by 132
The role of social categorization and perceived source credibility in minority influence
Clark, R. D., & Maass, A. (1988) · European Journal of Social Psychology · doi:10.1002/ejsp.2420180502 · Cited by 130
The Effects of Cooperative Learning on Junior High School Students' Behaviours, Discourse and Learning During a Science-Based Learning Activity
Gillies, R. M. (2008) · School Psychology International · doi:10.1177/0143034308093673 · Cited by 127
Collaboration Both Hurts and Helps Memory
Rajaram, S. (2011) · Current Directions in Psychological Science · doi:10.1177/0963721411403251 · Cited by 119
SEMILAR: The Semantic Similarity Toolkit
Rus, V., Lintean, M. C., Banjade, R., Niraula, N. B., & Stefanescu, D. C. (2013) · Cited by 118
Issues in the Computer-based Assessment of Collaborative Problem Solving
O’Neil, H. F., Chuang, S.-H., & Chung, G. K. W. K. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000148190 · Cited by 117
Collaborative Problem-Solving Education for the Twenty-First-Century Workforce
Fiore, S. M., Graesser, A., & Greiff, S. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0363-y · Cited by 113
Self-citation
Team diversity and team helping behavior: The mediating roles of team cooperation and team cohesion
Liang, H.-Y., Shih, H., & Chiang, Y. (2014) · European Management Journal · doi:10.1016/j.emj.2014.07.002 · Cited by 108
Macrocognition in Teams: Theories and Methodologies
Weil, S. A., Foster, P., Freeman, J., Carley, K. M., Diesner, J., Franz, T., Cooke, N. J., Shope, S., & Gorman, J. C. (2012) · Cited by 107
Assessing 21st Century Skills
National Research Council (2011) · National Academies Press eBooks · doi:10.17226/13215 · Cited by 106
Assessment of Twenty-First Century Skills: The Issue of Authenticity
Care, E., & Kim, H. (2017) · Educational assessment in an information age · doi:10.1007/978-3-319-65368-6_2 · Cited by 102
Designing Adaptive Instruction for Teams: a Meta-Analysis
Sottilare, R. A., Burke, C. S., Eduardo Salas, A., Sinatra, A. M., Johnston, J. H., & Gilbert, S. B. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0146-z · Cited by 101
Problem‐Solving Phase Transitions During Team Collaboration
Wiltshire, T. J., Butner, J., & Fiore, S. M. (2017) · Cognitive Science · doi:10.1111/cogs.12482 · Cited by 99
Self-citation
Towards an understanding of macrocognition in teams: developing and defining complex collaborative processes and products
Fiore, S. M., Smith‐Jentsch, K. A., Eduardo Salas, A., Warner, N., & Letsky, M. (2010) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639221003729128 · Cited by 96
Self-citation
Innovative Assessment of Collaboration
Kyllonen, P. C., Zhu, M., & von Davier, A. A. (2017) · Methodology of educational measurement and assessment · doi:10.1007/978-3-319-33261-1 · Cited by 95
Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams
Patterson, E. S., & Miller, J. E. (2018) · Cited by 94
Improving teamwork using real-time language feedback
Tausczik, Y., & Pennebaker, J. W. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470720 · Cited by 89
Benefits, costs, and challenges of collaboration for learning and memory.
Andrews‐Todd, J., & Rapp, D. N. (2015) · Translational Issues in Psychological Science · doi:10.1037/tps0000025 · Cited by 85
Self-citation
Challenges of Assessing Collaborative Problem Solving
Graesser, A. C., Foltz, P. W., Rosen, Y., Shaffer, D. W., Forsyth, C. M., & Germany, M.-L. (2017) · Educational assessment in an information age · doi:10.1007/978-3-319-65368-6_5 · Cited by 83
Self-citation
The ATC21S Method
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_1 · Cited by 79
The Effects of Team Training on Team Outcomes: A Meta-Analysis
Delise, L., Gorman, C. A., Brooks, A., Rentsch, J., & Steele-Johnson, D. (2010) · Performance Improvement Quarterly · doi:10.1002/piq.20068 · Cited by 79
The ACODEA framework: Developing segmentation and classification schemes for fully automatic analysis of online discussions
Mu, J., Stegmann, K., Mayfield, E., Rosé, C. P., & Fischer, F. (2012) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-012-9147-y · Cited by 78
Collaborative Problem Solving: Considerations for the National Assessment of Educational Progress
Fiore, S. M., Graesser, A. C., Greiff, S., Griffin, P., Gong, B., Kyllonen, P. C., Massey, C. M., O’Neil, H. F., Pellegrino, J., Rothman, R., et al. (2017) · Open Repository and Bibliography (University of Luxembourg) · Cited by 77
Self-citation
Does studio-based instruction work in CS 1?
Hundhausen, C. D., Agrawal, A., Fairbrother, D., & Trevisan, M. S. (2010) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1734263.1734432 · Cited by 72
The assessment of collaborative problem solving in PISA 2015: Can computer agents replace humans?
Herborn, K., Stadler, M. J., Mustafić, M., & Greiff, S. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.035 · Cited by 72
Self-citation
Language and Discourse Analysis with Coh-Metrix: Applications from Educational Material to Learning Environments at Scale
Dowell, N. M. M., Graesser, A., & Cai, Z.-Q. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.33.5 · Cited by 66
Self-citation
Assessment with computer agents that engage in conversational dialogues and trialogues with learners
Graesser, A. C., Cai, Z., Morgan, B., & Wang, L. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.041 · Cited by 63
Self-citation
Skills for Today: What We Know about Teaching and Assessing Collaboration.
Lai, E., DiCerbo, K. E., & Foltz, P. W. (2017) · Cited by 61
Self-citation
Emergent Processes in Group Behavior
Goldstone, R. L., Roberts, M. E., & Gureckis, T. M. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00539.x · Cited by 60
DEVELOPMENT AND VALIDITY EVIDENCE SUPPORTING A TEAMWORK AND COLLABORATION ASSESSMENT FOR HIGH SCHOOL STUDENTS
Zhuang, X., MacCann, C., Wang, L., Liu, L., & Roberts, R. D. (2008) · ETS Research Report Series · doi:10.1002/j.2333-8504.2008.tb02136.x · Cited by 54
Sports at Work
Kniffin, K. M., Wansink, B. C., & Shimizu, M. (2014) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051814538099 · Cited by 54
Designs for Operationalizing Collaborative Problem Solving for Automated Assessment
Scoular, C., Care, E., & Hesse, F. W. (2017) · Journal of Educational Measurement · doi:10.1111/jedm.12130 · Cited by 53
Self-citation
The computer-based assessment of complex problem solving and how it is influenced by students’ information and communication technology literacy
Greiff, S., Kretzschmar, A., Müller, J. C., Spinath, B., & Martin, R. (2014) · Journal of Educational Psychology · doi:10.1037/a0035426 · Cited by 49
Self-citation
Rising Above the Gathering Storm, Revisited
National Academy of Sciences, N. A. O. E. (2010) · National Academies Press eBooks · doi:10.17226/12999 · Cited by 47
A Meta-Analysis of Group Side Effects in Electronic Brainstorming
Dennis, A. R., & Williams, M. L. (2005) · International Journal of e-Collaboration · doi:10.4018/jec.2005010102 · Cited by 46
Measuring Collaborative Problem Solving Using Mathematics-Based Tasks
Harding, S.-M. E., Griffin, P., Awwal, N., Alom, B. M. M., & Scoular, C. (2017) · AERA Open · doi:10.1177/2332858417728046 · Cited by 43
THE BLACK-BOX DECIPHERED: A META-ANALYSIS OF TEAM DIVERSITY, CONFLICT, AND TEAM PERFORMANCE.
de Wit, F., & Greer, L. L. (2008) · Academy of Management Proceedings · doi:10.5465/ambpp.2008.33716526 · Cited by 42
Partner Characteristics and Social Contagion: Does Group Composition Matter?
Andrews, J. J., & Rapp, D. N. (2014) · Applied Cognitive Psychology · doi:10.1002/acp.3024 · Cited by 39
Comparability of Conflict Opportunities in Human-to-Human and Human-to-Agent Online Collaborative Problem Solving
Rosen, Y. (2014) · Technology Knowledge and Learning · doi:10.1007/s10758-014-9229-1 · Cited by 37
Developing a National STEM Workforce Strategy
Board on Higher Education and Workforce, Affairs, P. A. G., & National Academies of Sciences, E. (2016) · National Academies Press eBooks · doi:10.17226/21900 · Cited by 37
Memory conformity for confidently recognized items: The power of social influence on memory reports
Horry, R., Palmer, M. A., Sexton, M. L., & Brewer, N. (2011) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2011.12.010 · Cited by 36
Both young and older adults discount suggestions from older adults on a social memory test
Davis, S. D., & Meade, M. L. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0392-5 · Cited by 35
Effects of the timing and identity of retrieval cues in individual recall: An attempt to mimic cross-cueing in collaborative recall
Andersson, J., Hitch, G. J., & Meudell, P. R. (2005) · Memory · doi:10.1080/09658210444000557 · Cited by 33
The multiple, interacting levels of cognitive systems (MILCS) perspective on group cognition
Goldstone, R. L., & Theiner, G. (2017) · Philosophical Psychology · doi:10.1080/09515089.2017.1295635 · Cited by 31
Creating a Team Tutor Using GIFT
Gilbert, S. B., Slavina, A., Dorneich, M. C., Sinatra, A. M., Bonner, D., Johnston, J. H., Holub, J., MacAllister, A., & Winer, E. H. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0151-2 · Cited by 30
Conversational Argumentation in Decision Making: Chinese and U.S. Participants in Face-to-Face and Instant-Messaging Interactions
Stewart, C. O., Setlock, L. D., & Fussell, S. R. (2007) · Discourse Processes · doi:10.1080/01638530701498994 · Cited by 28
Assessing Collaborative Problem Solving Skills in Technology-Enhanced Learning Environments – The PISA Framework and Modes of Communication
Nouri, J., Åkerfeldt, A., Fors, U., & Selander, S. (2017) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v12i04.6737 · Cited by 22
Pair interactions in online assessments of collaborative problem solving: case-based portraits
Pöysä‐Tarhonen, J., Care, E., Awwal, N., & Häkkinen, P. (2018) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-018-0079-7 · Cited by 22
The In-Task Assessment Framework for Behavioral Data
Kerr, D., Andrews‐Todd, J., & Mislevy, R. J. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch20 · Cited by 21
Self-citation
Macrocognition in Collaboration: Analyzing Processes of Team Knowledge Building with CoPrA
Seeber, I., Maier, R. K., & Weber, B. (2013) · Group Decision and Negotiation · doi:10.1007/s10726-012-9337-z · Cited by 19
An Analysis of Communication and Use of Military Terms in Navy Team Training
Achille, L. B., Schulze, K. G., & Schimdt-Nielsen, A. (1995) · Military Psychology · doi:10.1207/s15327876mp0702_4 · Cited by 19
Complex Collaborative Problem-Solving Processes in Mission Control
Fiore, S. M., Wiltshire, T. J., Oglesby, J. M., O’Keefe, W. S., & Eduardo Salas, A. (2014) · Aviation Space and Environmental Medicine · doi:10.3357/asem.3819.2014 · Cited by 19
Self-citation
Building Intelligent Conversational Tutors and Mentors for Team Collaborative Problem Solving: Guidance from the 2015 Program for International Student Assessment
Graesser, A. C., Dowell, N., Hampton, A. J., Lippert, A. M., Li, H., & Shaffer, D. W. (2018) · Research on managing groups and teams · doi:10.1108/s1534-085620180000019012 · Cited by 19
Self-citation
Analysis of Semantic Content and Its Relation to Team Neurophysiology during Submarine Crew Training
Gorman, J. C., Martin, M. J., Dunbar, T. A., Stevens, R. H., & Galloway, T. L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39454-6_15 · Cited by 15
Teaching Twenty-First Century Skills: Implications at System Levels in Australia
Scoular, C., & Care, E. (2017) · Educational assessment in an information age · doi:10.1007/978-3-319-65368-6_9 · Cited by 15
Identifying Profiles of Collaborative Problem Solvers in an Online Electronics Environment.
Andrews‐Todd, J., Forsyth, C. M., Steinberg, J., & Rupp, A. (2018) · Educational Data Mining · Cited by 13
Self-citation
Assessing conversation quality, reasoning, and problem solving with computer agents
Graesser, A. C., Forsyth, C. M., & Foltz, P. W. (2017) · Educational research and innovation · doi:10.1787/9789264273955-17-en · Cited by 10
Self-citation
What can Training Researchers Gain from Examination of Methods for Active-Learning (PBL, TBL, and SBL)
Gabelica, C., & Fiore, S. M. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571100 · Cited by 9
Self-citation
The impact of own and others’ alcohol consumption on social contagion following a collaborative memory task
Thorley, C., & Christiansen, P. (2017) · Memory · doi:10.1080/09658211.2017.1404110 · Cited by 9
Automated Team Discourse Annotation and Performance Prediction Using LSA
Martin, M. J., & Foltz, P. W. (2004) · doi:10.21236/ada460701 · Cited by 9
Self-citation

Research works printed but not linked: 19

Baker R. S. J. D., 2009, Journal of Educational Data Mining, 1, 3
Bayer H., 1975, Bauhaus 1919-1928
Costa P. T., 1992, Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO-FFI): Professional manual
Crowston K., 2006, Human-computer interaction in management information systems, 120
Flavell J. H., 1976, The nature of intelligence, 231
Foltz P. W., 2008, Team effectiveness in complex organizations and systems: Cross-disciplinary perspectives and approaches, 411
Graesser A. C., 2017, Design recommendations for intelligent tutoring systems. Volume 5: Assessment methods, 275
Hart Research Associates, 2015, Falling short? College learning and career success
Herborn K. (2018). The assessment of collaborative problem solving in PISA 2015: An investigation of the validity (Doctoral thesis, University of Luxembourg, Luxembourg). Retrieved from http://hdl.handle.net/10993/35890
Hutchins S. G., 2010, Informed by knowledge: Expert performance in complex situations, 69
Janis I. L., 1982, Groupthink
Letsky M. P., 2008, Macrocognition in teams: Theories and methodologies
Liu L., 2015, Handbook of research on computational tools for real-world skill development, 344
Newell A., 1972, Human problem solving
Rosen Y., 2014, Journal of Research and Practice in Technology Enhanced Learning, 9, 389, 10.58459/rptel.2014.9389-410 · DOI
Rotherham A. J., 2010, American Educator, 34, 17
Salomon G., 1993, Distributed cognitions
Shaffer D. W., 2017, Quantitative ethnography
Sottilare R., 2018, Design recommendations for intelligent tutoring systems: Team science, 6

Sorted by citations

Creativity, Critical Thinking, Communication, and Collaboration: Assessment, Certification, and Promotion of 21st Century Skills for the Future of Work and Education
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., et al. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11030054 · Cited by 768
Artificial intelligence (AI) -integrated educational applications and college students’ creativity and academic emotions: students and teachers’ perceptions and attitudes
Lin, H., & Chen, Q. (2024) · BMC Psychology · doi:10.1186/s40359-024-01979-0 · Cited by 472
“This collaborative environment aligns with findings from Graesser et al. [64], who emphasized the role of technology in enhancing collaborative learning and creativity.”
A meta-analysis of teaching and learning computer programming: Effective instructional approaches and conditions
Scherer, R., Siddiq, F., & Viveros, B. S. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106349 · Cited by 203
“The latter finding aligns with the tendency of collaborative instruction to be especially effective for skill acquisition in computer-based learning environments as compared to knowledge acquisition (Graesser et al., 2018).”
Background
Towards a generalized competency model of collaborative problem solving
Sun, C., Shute, V. J., Stewart, A., Yonehiro, J., Duran, N., & D'Mello, S. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103672 · Cited by 189
Learning in embodied activity framework: a sociocultural framework for embodied cognition
Danish, J. A., Enyedy, N., Saleh, A., & Humburg, M. (2020) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-020-09317-3 · Cited by 132

See all 390

Authors: Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W.
Affiliations: University of Memphis (US)
University of Central Florida (US)
University of Luxembourg (LU)
Educational Testing Service, Princeton, New Jersey
University of Colorado Boulder (US)
Leibniz-Institut für Wissensmedien (DE)
Corresponding author: Graesser, Arthur C.
ORCID: Graesser, Arthur C.
Fiore, Stephen M.
Greiff, Samuel
Foltz, Peter W.
Hesse, Friedrich W.
Venue: Psychological Science in the Public Interest
Publisher: SAGE Publications
Published: 2018-11
Volume: 19
Issue: 2
Pages: 59-92
ISSN: 1539-6053 (ISSN-L)
1529-1006
DOI: 10.1177/1529100618808244
OpenAlex: W2902754622
Semantic Scholar: 6b5206e860f258dc3d228eb498005371c19e809c
Cited by: 390
References: 160
Citations by year: 2026: 53 · 2025: 71 · 2024: 71 · 2023: 67 · 2022: 42 · 2021: 42 · 2020: 22 · 2019: 21 · 2018: 1
FWCI: 42.20
Type: journal article
Language: en
Open access: green
stars.library.ucf.edu
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Gothic.net (publishedVersion)
PubMed (publishedVersion)
Journal of International Crisis and Risk Communication Research (submittedVersion)
Open Repository and Bibliography (University of Luxembourg) (submittedVersion, cc-by-nc-sa)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Social Sciences › Education › Problem and Project Based Learning
Social Sciences › Psychology › Applied Psychology › Problem Solving Skills Development
Keywords: collaborative problem solving, teamwork, PISA, interdisciplinary research, employee training
MeSH terms: Cooperative Behavior, Education, Group Processes, Humans, Models, Psychological, Problem Solving

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Advancing the Science of Collaborative Problem Solving

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks