Cited by 180Innovative Teaching and Learning MethodsVisual and Cognitive Learning ProcessesOnline and Blended Learning

Making the Black Box of Collaborative Learning Transparent: Combining Process-Oriented and Cognitive Load Approaches

Open access
Janssen, Jeroen, Kirschner, Femke, Erkens, Gijsbert, Kirschner, Paul A., Paas, Fred·2010·Educational Psychology Review

Abstract

Traditional research on collaborative learning employs a “black box” approach that makes it difficult to gain a deeper understanding of the differential effects of collaborative learning. To make the black box transparent, researchers have studied the process of collaboration, in order to establish which interaction features are likely to make learning more effective and efficient for group members. Although cognitive load theory has been developed in the context of individual learning situations, it may provide a promising new way of looking inside the black box, assuming that students working in groups have more processing capacity than students working individually. The aim of this article is to provide an overview of the process-oriented and cognitive-load approaches to conducting collaborative learning research, to highlight their respective advantages and disadvantages, and to suggest how they can be combined in order to address new research questions.

AI snapshot

Written from the paper’s full text.

TL;DR

This conceptual article argues that collaborative learning research should combine process-oriented analysis of peer interaction with cognitive load theory (CLT) to make the “black box” of collaboration more transparent. It proposes that groups can be viewed as information-processing systems with expanded capacity, but that communication and coordination impose transaction costs that may be germane or extraneous for learning.

Key findings

  • Effect-oriented collaborative learning research has a strong tradition—Johnson and Johnson (2009) identified over 1,200 studies comparing collaborative learning with other conditions—but it is criticized for not explaining why collaboration sometimes fails or why interaction quality varies.
  • Process-oriented research shows that giving elaborate explanations correlates positively with achievement, whereas giving explanations without elaboration does not; receiving elaborate explanations is effective only when the receiver can apply the explanation in a related task.
  • Barron (2003) found that more successful groups responded more appropriately or with higher engagement to proposals and better maintained joint attention, and members of successful groups outperformed members of less successful groups on individual mastery and transfer tests.
  • CLT suggests collaborating learners can divide information processing across multiple working memories, but interindividual communication and coordination create transaction costs; F. Kirschner et al. found collaborating learners on cognitively challenging tasks learned more effectively and efficiently than individual learners, while group work became disadvantageous for cognitively unchallenging tasks.

Methods

  • Design: Conceptual/review article, not an empirical study; it provides an overview of process-oriented and cognitive-load approaches to collaborative learning and suggests how to combine them.
  • Data or sample: Not stated in the paper; no empirical sample or dataset is reported.
  • Main analysis: Narrative synthesis of prior research and illustrative examples, including Webb’s work on explanations, Barron’s group-process findings, and F. Kirschner et al.’s CLT-based studies, to propose future research directions.

Limitations

  • The paper states that CLT-based collaborative learning research is based on hypotheses about transaction costs that were not monitored or analyzed, and that cognitive load measurement is often an overall score, so conclusions about intrinsic, germane, and extraneous load can only be based on instruction rather than specific processes.
  • The paper states that process-oriented research tends to zoom in on interaction features without systematically considering how those patterns came about or how they affect group performance and individual learning gains.
  • The paper states challenges for combining approaches: measuring cognitive load in collaborative situations, possibly measuring group cognitive load, handling the complex interplay of task/learner/group characteristics, and the difficulty, time, reliability, and validity demands of coding communication protocols. Evident from the text: the proposed combination is not empirically tested in this article.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10648-010-9131-x

Cites

118 of 118 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 62 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Collaborative learning can be an effective strategy for promoting retention and problem solving.

    “Several meta-analyses have thus been carried out showing that collaborative learning can be an effective strategy for promoting retention and problem solving (e.g., Lou et al. 2001;Roseth et al. 2008;Slavin 1980;Springer et al. 1999).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Lou et al. 2001 source

      Not checked in the free run.

    • cites Roseth et al. 2008 source

      Not checked in the free run.

    • cites Slavin 1980 source

      Not checked in the free run.

  • Premisecitation

    Effect-oriented research has a strong research tradition in collaborative learning, with over 1,200 studies comparing the relative effects of collaborative learning to individual learning.

    “In their review, Johnson and Johnson (2009) identified over 1,200 studies comparing the relative effects of collaborative learning to, for example, individual learning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Johnson and Johnson 2009 source

      Not checked in the free run.

  • Premisecitation

    Successful groups differ from less successful groups in how group members responded to proposals and maintained joint attention.

    “She found marked differences between these groups with respect to how group members responded to proposals by group members and how well they were able to maintain joint attention.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Barron 2003 source

      Not checked in the free run.

  • Premisecitation

    Group members of successful groups outperformed members of less successful groups on individual mastery and transfer tests.

    “Barron also showed that the group members of successful groups outperformed members of less successful groups on individual mastery and transfer tests.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Barron 2003 source

      Not checked in the free run.

  • Interpretationreasoning

    Collaborative learning environments are an ideal example of the borrowing and reorganizing principle at work.

    “Collaborative learning environments are therefore an ideal example of the principle at work.”
    Quote in the paperSubstantial claim
  • May combine two claims. 12
  • Classified as probably not a substantial claim. 16
  • The quote only partly states this claim. 1
  • May combine two claims.

    Interpretationreasoning

    A process-oriented approach can give rich and detailed descriptions about the mechanisms of collaboration or generate testable hypotheses, but it does not explain how these mechanisms developed within the group nor give insight into how they affected group performance and student learning.

    “Such an approach can give rich and detailed descriptions about the mechanisms of collaboration or can be used to generate testable hypotheses.It does not explain, however, how these mechanisms developed within the group, nor does it give insight into how they affected group performance and student learning.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    A performance score can only be meaningfully interpreted in the context of the level of cognitive load that it induces and vice versa.

    “Paas and Van Merriënboer (1993; see also Paas et al. 2003b) have shown that a performance score can only be meaningfully interpreted in the context of the level of cognitive load that it induces and vice versa.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Paas and Van Merriënboer 1993 source

      Not checked in the free run.

    • cites Paas et al. 2003b

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The distribution advantage causes collaborating individuals to invest less cognitive effort when carrying out the learning task as compared with individuals learning alone, meaning collaborating learners experience less intrinsic cognitive load.

    “On the one hand, this distribution advantage causes collaborating individuals to invest less cognitive effort when carrying out the learning task as compared with individuals learning alone (i.e., collaborating learners experience less intrinsic cognitive load).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Because the cognitive distribution benefit proved to be higher than the additional costs of interindividual integration and coordination of information, collaborating learners learned more effectively and efficiently than did individual learners.

    “Because this cognitive distribution benefit proved to be higher than the additional costs of interindividual integration and coordination of information, collaborating learners learned more effectively and efficiently than did individual learners.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites F. Kirschner et al. 2009a, b, c

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The limited processing capacity of a learner's working memory is considered a bottleneck; for new information, its processing capacity is limited to only 4±1 elements.

    “In this context, the limited processing capacity of a learner's working memory (WM) is considered a bottleneck (Baddeley 1986;Miller 1956); for new, yet to be learned information, its processing capacity is limited to only 4±1 elements (Cowan 2010)”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Baddeley 1986

      Not checked in the free run.

    • cites Miller 1956 source

      Not checked in the free run.

    • cites Cowan 2010 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Not all studies have found positive effects for collaboration.

    “It must be noted, however, that not all studies have found positive effects for collaboration (e.g., Andersson and Rönnberg 1995;Kirschner et al. 2009c;Meudell et al. 1992).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Andersson and Rönnberg 1995 source

      Not checked in the free run.

    • cites Kirschner et al. 2009c

      Not checked in the free run.

    • cites Meudell et al. 1992 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Giving elaborate explanations correlates positively with student achievement.

    “This line of research demonstrated that giving elaborate explanations (i.e., an explanation that contains a reason why the problem should be solved in a certain way) correlates positively with student achievement, whereas giving explanations without an elaboration (i.e., telling someone the answer without giving a clarification) does not (Webb 1991).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Webb 1991 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    The borrowing and reorganizing principle states that long-term memory is built primarily by imitating other people, through the borrowing of information from other people's long-term memory.

    “This led to the borrowing and reorganizing principle (Sweller 2004;Sweller and Sweller 2006), which states that LTM is built primarily by imitating other people, through the borrowing of information from other people's LTM.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Sweller 2004 source

      Not checked in the free run.

    • cites Sweller and Sweller 2006

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Transaction costs can be effective (imposing germane cognitive load) or ineffective (imposing extraneous cognitive load) for learning.

    “These so-called transaction costs (Ciborra and Olson 1988;Yamane 1996) can be effective (i.e., imposing a germane cognitive load) or ineffective (i.e., imposing an extraneous cognitive load) for learning.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Ciborra and Olson 1988

      Not checked in the free run.

    • cites Yamane 1996 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    When a learner needs other learners for the collaborative task to be carried out successfully, the communication and coordination processes are necessary for learning and can facilitate learning, imposing effective (germane) cognitive load.

    “In contrast, when a learner in that same group needs other learners for the collaborative task to be carried out successfully, the communication and coordination processes are necessary for learning and can facilitate learning (i.e., giving elaborate explanations; Webb 1991), imposing effective (i.e., germane) cognitive load.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Webb 1991 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Metacognitive activities that regulate task performance are considered important to successful performance during collaboration.

    “Metacognitive activities that regulate task performance (e.g., making plans, monitoring task progress, and evaluating plans or ideas) are, for example, considered important to successful performance during collaboration (Artzt and Armour-Thomas 1997;De Jong et al. 2005;Janssen et al. 2007;Slof et al. in press).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Artzt and Armour-Thomas 1997 source

      Not checked in the free run.

    • cites De Jong et al. 2005 source

      Not checked in the free run.

    • cites Janssen et al. 2007 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    For a group to carry out a learning task, not all group members need to possess all necessary knowledge, or process all available information alone and at the same time.

    “For a group to carry out a learning task, not all group members need to possess all necessary knowledge, or process all available information alone and at the same time (Johnson et al. 1989;Langfred 2000;Ortiz et al. 1996;Wegner 1987Wegner , 1995)).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Johnson et al. 1989 source

      Not checked in the free run.

    • cites Langfred 2000 source

      Not checked in the free run.

    • cites Ortiz et al. 1996 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    When the two research traditions are combined, it is possible to gain a better understanding of the coordinative and communicative processes that contribute to the transaction costs of collaborative learning.

    “For example, when these research traditions are combined, it is possible to gain a better understanding of the coordinative and communicative processes that contribute to the transaction costs of collaborative learning.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Collaborative learning imposes transaction costs (communication and coordination demands) that consume learners' cognitive resources.
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Combining the traditions provides additional insight into the specific processes that contribute to student learning during collaborative learning (those generating germane cognitive load) and the processes that are detrimental for learning (those generating extraneous cognitive load).

    “It will provide additional insight to the specific processes that contribute to student learning during collaborative learning (i.e., processes that generate germane cognitive load) and processes that are detrimental for learning (i.e., processes that generate extraneous cognitive load).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The germane/extraneous cognitive load distinction is applicable to the processes of collaborative learning.
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Combining process-oriented research and cognitive load approaches cancels out the disadvantages of both approaches, yielding a deeper and more detailed insight into learning through collaboration and making it possible to determine which specific aspects of the collaborative process impose germane or extraneous cognitive load.

    “In our opinion, the combination of approaches cancels out the disadvantages of both approaches leading to a deeper and more detailed insight into the learning through collaboration, making it possible to determine which specific aspects of the collaborative process impose either germane or extraneous cognitive load.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Collaborative learning imposes transaction costs (communication and coordination demands) that consume learners' cognitive resources.
    • Rests on an assumption: The germane/extraneous cognitive load distinction is applicable to the processes of collaborative learning.
  • May combine two claims.

    Interpretationreasoning

    CLT research provides valuable insight into the load imposed upon group members during collaboration and, by combining this with performance measures, insight into its effect on learning and schema construction.

    “CLT research, on the other hand, provides valuable insight into the load imposed upon group members during collaboration and by combining this with performance measures, insight into its effect on learning, and schema construction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Recent developments to automate the coding of the collaborative process may extensively decrease the time needed to code a large number of protocols.

    “although recent developments to automate the coding of the collaborative process may extensively decrease the time needed to code a large number of protocols (Erkens and Janssen 2008;Rosé et al. 2008).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Erkens and Janssen 2008 source

      Not checked in the free run.

    • cites Rosé et al. 2008 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Research combining process-oriented research and cognitive load theory constitutes a promising new approach to research on collaborative learning.

    “We argue that research combining process-oriented research and CLT constitutes a promising, new approach to research on collaborative learning.”
    • Also stated in: § Studying the Relationships Between Antecedents, Collaboration, and Consequences · plain
      “Combining the analysis of group processes with existing measures of cognitive load to better understand and identify conditions under which collaborative learning is most effective and efficient is a new promising research direction for collaborative learning.”
    • Also stated in: § Conclusion and Discussion · plain
      “In spite of these challenges, we feel that the possibility to combine process-oriented research with CLT constitutes a promising, new way of researching collaborative learning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The complex interplay between task characteristics, learner characteristics, and group characteristics constitutes a challenge for this new line of research.

    “The complex interplay between task characteristics, learner characteristics, and group characteristics constitutes another challenge for this new line of research.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    If studies such as Denessen et al.'s also incorporated cognitive load measures, it would become possible to determine how the antecedents of collaborative learning affect cognitive load and how cognitive load in turn affects the outcome of the collaborative process.

    “When studies like the one conducted by Denessen et al. (2008) would also incorporate cognitive load measures (e.g., the unidimensional nine-point symmetrical mental effort rating scale [Paas 1992], heart-rate variability [Paas and Van Merriënboer 1994], taskevoked pupillary responses [Van Gerven et al. 2002], or responses to secondary tasks [Marcus et al. 1996]), it would become possible to”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Paas 1992 source

      Not checked in the free run.

    • cites Paas and Van Merriënboer 1994 source

      Not checked in the free run.

    • cites Van Gerven et al. 2002 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Process-oriented research on collaborative learning provides valuable insight into the mechanisms involved in collaboration.

    “Process-oriented research on collaborative learning provides valuable insight into the mechanisms involved in collaboration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). The quote only partly states this claim.

    Interpretationreasoning

    Combining process-oriented and cognitive load research makes it possible to gain a deeper understanding of the relationships between the antecedents of collaboration, the collaborative process itself, and the consequences of collaborative learning.

    “By combining process-oriented and cognitive load research, it is also possible to gain a deeper understanding of the relationships between the antecedents of collaboration (e.g., task complexity, group member composition, and prior knowledge), the collaborative process itself (e.g., carrying out the task, solving the problem, maintaining common ground, sharing information, and giving explanations)”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In high-load conditions, speech pauses are significantly longer and the use of singular pronouns is significantly less than in low-load conditions.

    “In high-load conditions, Khawaja et al. noted significantly longer speech pauses and significantly less use of singular pronouns (e.g.,”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Khawaja et al. 2009

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Effect-oriented research focuses on the direct relationship between group composition and students' individual posttest performance, whereas process-oriented research also takes the collaborative process into account.

    “Effect-oriented research that investigates these relationships focuses on the direct relationship between, for example, group composition and students' individual performance on a posttest (see, for example, Andersson and Rönnberg 1995;Buchs and Butera 2009), whereas process-oriented research also takes the collaborative process into account (for example, Denessen et al. 2008;Webb et al. 1998).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Andersson and Rönnberg 1995 source

      Not checked in the free run.

    • cites Buchs and Butera 2009 source

      Not checked in the free run.

    • cites Denessen et al. 2008 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Analyzing a great number of communication protocols can be time consuming.

    “Furthermore, the process of analyzing a great number of protocols can be time consuming (Rosé et al. 2008).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rosé et al. 2008 source

      Not checked in the free run.

25 of 25
  • The authors state this as an assumption.

    Students working in groups have more processing capacity than students working individually.

    “assuming that students working in groups have more processing capacity than students working individually”
  • The paper relies on this without support.

    Collaborative learning imposes transaction costs (communication and coordination demands) that consume learners' cognitive resources.

    “In this way, it is possible to determine which transaction costs are germane to learning and which are not.”
  • The paper relies on this without support.

    The germane/extraneous cognitive load distinction is applicable to the processes of collaborative learning.

    “It will provide additional insight to the specific processes that contribute to student learning during collaborative learning (i.e., processes that generate germane cognitive load) and processes that are detrimental for learning (i.e., processes that generate extraneous cognitive load).”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Blanket claim about process-oriented research conflicts with the paper's examples

    Minor

    The paper says the process-oriented approach does not consider the conditions producing interaction patterns or their effects on performance. Earlier, it explicitly describes process-oriented research examining both of those relationships.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. Baddeley, A. D. (1986). Working memory. Oxford: Clarendon Press.
  2. Khawaja, M. A., Chen, F., & Marcus, N. (2009). Analysis of collaborative speech for grammatical cues of cognitive load. Paper presented at the Third International Cognitive Load Theory Conference, Heerlen, The Netherlands.
  3. Van der Linden, J. L., Erkens, G., Schmidt, H., & Renshaw, P. (2000). Collaborative learning. In P. R. J. Simons, J. L. Van der Linden, & T. Duffy (Eds.), New learning (pp. 1–19). Dordrecht: Kluwer Academic Publishers.

Cited by

Sorted by citations

Authors
Janssen, J., Kirschner, F., Erkens, G., Kirschner, P. A., & Paas, F.
Affiliations
  • Utrecht University (NL)
  • Erasmus University Rotterdam (NL)
  • Open University of the Netherlands (NL)
Corresponding author
  • Janssen, Jeroen
  • Kirschner, Femke
  • Erkens, Gijsbert
  • Paas, Fred
Venue
Educational Psychology Review
Published
2010-05-04
Volume
22
Issue
2
Pages
139-154
ISSN
  • 1040-726X (ISSN-L)
  • 1573-336X
OpenAlex
W2004617232
Cited by
180
References
118
Citations by year
2026: 11 · 2025: 15 · 2024: 9 · 2023: 6 · 2022: 15 · 2021: 15 · 2020: 12 · 2019: 17 · 2018: 14 · 2017: 6 · 2016: 8 · 2015: 7 · 2014: 15 · 2013: 12 · 2012: 8
FWCI
18.42
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • Educational Psychology Review (publishedVersion, cc-by-nc)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
  • Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
  • DSpace (Open University in the Netherlands) (submittedVersion)
  • DSpace (Open University in the Netherlands) (submittedVersion, cc-by-sa)
  • DSpace (Open University in the Netherlands) (submittedVersion, other-oa)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
  • Social Sciences › Education › Online and Blended Learning
Keywords
cooperative learning, black box approach, cognitive load theory, process-oriented research, group interaction, group work, individual vs group learning, research methodology integration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review