Cited by 37Innovative Teaching and Learning MethodsEducational Strategies and EpistemologiesVisual and Cognitive Learning Processes

Learning paths in synthesis writing: Which learning path contributes most to which learning outcome?

Open access
Mateos, Mar, Rijlaarsdam, Gert, Martín, Elena, Cuevas, Isabel, Van den Bergh, Huub, Solari, Mariana·2020·Instructional Science

AI snapshot

Written from the paper’s full text.

TL;DR

This secondary analysis of an intervention with 114 undergraduate psychology students tested whether explicit strategy instruction and collaborative practice affect two qualities of argumentative synthesis texts. Explicit instruction improved both argument coverage and integration, but collaborative practice added an indirect path only for argument coverage, not integration.

Key findings

  • Explicit instruction outperformed self-study on the posttest for both outcomes: multivariate condition effect \(V(2,103)=6.178, p=.003, \eta^2=.120\); argument coverage \(F(1,103)=10.052, p=.002, \eta^2=.088\); integration \(F(1,103)=7.510, p=.007, \eta^2=.067\).
  • For argument coverage, collaborative practice provided an additional indirect path: T2→T3 estimate .26 (.10), T3→T4 .35 (.09); instruction effects were .20 (.10) at T2, .06 (.10) at T3, and .30 (.09) at T4. Practice accounted for 16% of the variance in coverage.
  • For integration, collaborative practice did not contribute: T2→T3 .10 (.10), T3→T4 .09 (.09); instruction had direct effects at T3 .23 (.10) and T4 .24 (.10), while T2 .18 (.10) was not significant. Practice accounted for 1% of integration variance.
  • The correlation between coverage and integration weakened from pretest \(r=.41\) to posttest \(r=.21\) and was nonsignificant during practice (T2 \(r=.09\); T3 \(r=-.07\)).

Methods

  • Secondary analysis of a pretest/posttest randomized control intervention (Mateos et al. 2018) with 114 third- and fourth-year Psychology of Education undergraduates in Spain; mean age 21.3 years, 77.2% female; participants randomly assigned to explicit instruction or self-study.
  • Both groups used the same four-phase strategy guide and two collaborative pair practice sessions; individual pre- and posttests were written without the guide. Texts were scored for argumentation coverage (proportion of source arguments represented) and integration level (0–6 scale), with interrater ICCs from .81 to .91.
  • Structural equation modeling with observed scores (LISREL 9.3), using multigroup analysis that randomly split pair members to address non-independence; models tested pretest, instruction, and practice paths for each outcome.

Limitations

  • Stated: the collaboration process remained unobserved because no data were collected on how pairs collaborated or used the strategy guide; worksheet completion varied, and it is unknown whether guide work was collaborative or individual; practice time per pair was not recorded.
  • Stated: causal conclusions require experimental designs, and the authors note the theoretical perspective must be tested further.
  • Evident: as a secondary analysis, the study cannot verify the mechanisms behind the different learning paths; the authors suggest integration may need more practice or a different collaborative task design, but the available data do not test this.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s11251-020-09508-3

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

4 of 25 cited sources checked · 1 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    Van Steendam et al. (2010, 2014) found that collaborative revision strategy instruction via modelling was more effective than practising with guiding questions.

    “The results showed that the collaborative revision strategy instruction via modelling was more effective for improving undergraduates' revision skills than practising the instructed strategy following guiding questions presented in a handout.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Van Steendam et al. 2010 source

      The Discussion (section 4; page unavailable) explicitly says the hypothesis that observation would outperform practising was falsified: its effectiveness depended on the subsequent emulation setting. Observation helped when followed by collaborative emulation, but practising followed by individual emulation was as effective or better on the posttest revision score. The paper therefore does not support the sentence’s unqualified claim that modelling was more effective than guided practice. (LLM, conf=0.90)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
    • cites Van Steendam et al. 2014 source

      In “Revision instruction: modelling or learning-by-observation” (page unavailable), the paper reports that Van Steendam et al. (2010) found undergraduate pairs benefited more from observation than practice for L2 revision quality. Its “Instruction” section describes the modelling and handout-guided practice conditions. However, the 2014 study’s “Discussion” describes observation as effective across pair types without establishing the claimed overall superiority over practice in its own results. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Premisecitation

    In higher education, most writing across disciplines relies on reading and integrating external sources.

    “At the college level, most writing-whatever the discipline-is based on reading and integrating external documents (Klein et al. 2016;Klein and Yu 2013;Perin 2013).”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites Klein et al. 2016 source

      Section 4.5 (Discourse Synthesis; page unavailable) describes writing from sources as reading and integrating multiple texts. Section 4.3 discusses college writing across disciplines, but the paper does not establish that most college writing, regardless of discipline, is based on external documents. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites Klein and Yu 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Perin 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Findingown data

    Instruction did not influence argumentation coverage scores on the two practice sessions (Δχ2(2)=3.89, p=0.143).

    “The instruction did not appear to influence the scores on the two practice sessions for argumentation coverage, Δχ 2 (2) = 3.89, p = 0.143, but significantly did for integration, Δχ 2 (2) = 7.75, p = 0.021.”
    Quote in the paperSubstantial claim
  • Findingown data

    The instruction component influenced integration at T4 (Δχ2=5.35, df=1, p=0.020).

    “The instruction component influenced argumentation coverage at T4, Δχ 2 = 5.07, df = 1, p = 0.024, as well as integration, Δχ 2 = 5.35, df = 1, p = 0.020.”
    Quote in the paperSubstantial claim
  • Findingown data

    Collaborative practice and instruction together explained 8% of the variance in argumentation coverage at T3 and 21% at T4.

    “Collaborative practice and instruction together explained 8% of the variance in argumentation coverage at T3 and 21% of the variance at T4.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 35
  • May combine two claims. 27
  • The quote only partly states this claim. 1
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    In Kuhn et al. (2016), students in the dialogic argumentation group improved in addressing both sides of an issue but needed more practice to develop towards an integrative stance.

    “In a study by Kuhn et al. (2016), at the end of the first year of the intervention, although the students in the dialogic argumentation group improved their essay writing in terms of addressing both sides of an issue, they needed more practice for further development towards an integrative stance (which includes the negatives of their preferred position or positives of the opposing position).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Kuhn et al. (2016) source
  • May combine two claims.

    Findingown data

    Instruction and practice together explained 7% of the variance in T3 integration scores and 8% at T4.

    “The instruction component and practice together explained 7% of the variance in T3 integration scores and 8% of the variance at T4 in integration scores.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Collaborative practice contributed to argumentation coverage at T4 via T2 scores influencing T3 scores (p=0.006) and via T3 scores influencing T4 scores (p<0.001).

    “The parameter estimates show that the collaborative practice component contributed to argumentation coverage at T4 via T2-scores at T2 influenced scores at T3 (p = 0.006)-and via T3-scores at T3 influenced scores at T4 (p < 0.001).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    For integration, the effect of instruction was not significant at T2 (p=0.066) but was significant at T3 (p=0.009) and T4 (p=0.006).

    “For integration, the effect of this instruction was not significant at T2 (p = 0.066) but appeared to be significant at T3 (p = 0.009) and T4 (p = 0.006).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Explicit instruction with collaborative practice was more effective than self-study instruction with subsequent collaborative practice for both argument coverage and integration.

    “The primary study compared the individually written pre-and posttest syntheses and found statistically significant differences favouring explicit instruction in both dependent variables: the argumentation coverage and the level of integration.”
    • Also stated in: § 1 3 · boosted
      “The results of our prior study indeed confirmed that explicit strategy instruction with collaborative practice was more effective than the self-study instruction with subsequent collaborative practice.”
    • Also stated in: § 1 3 · plain
      “Explicit instruction was more effective for both dependent variables, namely the coverage of arguments from sources and the quality of integration of information.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mateos et al. 2018 source
  • May combine two claims.

    Findingown data

    At pretest both outcome variables were correlated (r=0.41), the correlation weakened at posttest (r=0.21), and no correlation was observed in the two texts produced during collaborative practice.

    “At the pretest, both outcome variables were correlated in both intervention conditions (r = 0.41).However, the correlation became weaker during the posttest (r = 0.21), and no correlations were observed in the two texts produced during the collaborative practice-the coverage of arguments and the level of integration were not related.”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    At posttest, the condition effect was statistically significant for both argument coverage and integration, favoring explicit instruction.

    “while the condition effect was statistically significant in the posttest, V (2, 103) = 6.178, p = 0.003, η 2 = 0.120, for both dependent variables, argumentation coverage, F (1, 103) = 10.052,p = 0.002, η 2 = 0.088; integration level, F (1, 103) = 7.510, p = 0.007, η 2 = 0.067.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The effects of collaborative practice accounted for 16% of the variance for argumentation coverage and 1% for integration.

    “The difference between the explained variance for T2 and T4 points to the effects of collaborative practice, which were 16% for argumentation coverage and 1% for integration.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Collaborative practice had an additional indirect effect only on argument coverage, not on integration.

    “The results suggested two different learning paths for both dependent variables: explicit instruction is effective for both variables, while collaborative practice only has an additional indirect effect on argument coverage.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Explicit instruction had a positive effect on collaborative practices for argumentation coverage at T2 (p=0.036) and T4 (p=0.001) but not at T3 (p=0.226).

    “Table 7 shows a positive effect of explicit instruction on collaborative practices for argumentation coverage at T2 (p = 0.036) and T4 (p = 0.001) but not at T3 (p = 0.226).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Three independent coders were trained during four training sessions to fine-tune coding and score criteria.

    “Three independent coders were trained to fine-tune the coding and score criteria during the four training sessions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Identifying arguments is easier than integrating, and moving from identifying to integration requires a shift in task representation.

    “A possible interpretation of these results is that identifying arguments is easier than integrating, and that moving from identifying to integration requires a shift in task representation.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Nussbaum (2008a) distinguished persuasive writing (goal to convince) from reflective writing (goal to explore and integrate sides).

    “Nussbaum (2008a) proposed a distinction between persuasive writing, where the goal is to convince another and to "win" an argument (which would be the object in a debate), and reflective writing, in which writers focus on exploring and integrating an issue's various sides to reach a reasoned conclusion.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Nussbaum 2008a source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The sources were similar in length (585-816 words) and in number of arguments (6-9 per source).

    “The sources were similar in terms of their length, which was between 585 and 816 words, and in the number of arguments either for or against a position, between six and nine per source.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Ferreti and Lewis (2013) concluded that dialogic interactions, representational tools, and explicit strategy instruction are complementary approaches.

    “In their analysis of best practices in teaching argumentative writing, Ferreti and Lewis (2013) concluded that dialogic interactions, with the support of some representational tools and explicit strategy instruction, are complementary approaches in teaching effective argumentative thinking and writing.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ferreti and Lewis 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Coders were unaware of intervention conditions when coding a random 50% of syntheses.

    “Once the criteria were refined, the coders coded a random set of 50% of the syntheses, while unaware of the intervention conditions.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The randomisation was successful and no differences existed between conditions or groups of pair members due to flaws in the randomisation procedures.

    “Therefore, we can conclude that the randomisation was successful and that no differences existed between the conditions and/or groups of pair members due to flaws in the randomisation procedures.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The time spent in practice sessions varied by pair (90-120 min) and was not recorded.

    “The time taken in the practice sessions varied by pair and ranged from 90 to 120 min, although the specific time each pair spent was not recorded.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Kimmerle et al. (2017) found different stages of collaborative writing and suggested different stages might require specific instructional support.

    “The results showed different stages of collaborative writing (sharing knowledge, contrasting and restructuring arguments/counterarguments, and reaching a shared conclusion) and suggested that the different stages of collaboration might require specific instructional support.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Kimmerle et al. 2017 source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Synthesis writing is regarded as the most demanding and elaborate form of source-based writing.

    “Synthesis writing is seen as the most 1 3 demanding and elaborate approach to writing based on sources (Mateos et al. 2007(Mateos et al. , 2014;;Shanahan 2013).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Mateos et al. 2007 source
    • cites Mateos et al. 2014 source
    • cites Shanahan 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Song and Ferreti (2013) found that students receiving explicit strategy instruction wrote better essays with more counterarguments, alternative positions, and refutations.

    “Students who received the explicit strategy instruction wrote 1 3 better essays with more counterarguments, alternative positions, and refutations than the students in the other groups.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Song and Ferreti 2013 source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Two final models controlled for whether randomisation of students and of pair members influenced results.

    “We added two final models to control for whether the randomisation of students influenced the results (M9) and whether the randomisation of pair members to each of the samples influenced the results (M10).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Integration of information may have received less attention in the collaborative sessions and/or may have been less transferable from pair work to individual practice.

    “Integration of information may have received less attention in the collaborative sessions and/or might have been less transferable from pair work to individual practice.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    Participants were randomly assigned to conditions.

    “The participants were randomly assigned to conditions.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Such a representation requires the content to be transformed and entails greater complexity and cognitive effort.

    “Such a representation requires the content to be transformed and entails greater complexity and cognitive effort (Bereiter and Scardamalia 1987).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Bereiter and Scardamalia 1987
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Moving from identifying to integration implies a change in the task's representation, from a relatively simple persuasive objective to constructing a conclusion that none of the sources provides.

    “Moving from identifying to integration implies a change in the task's representation-that is, its representation from a relatively simple persuasive objective to the construction of a conclusion that none of the sources provides.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    SEM models were specified in advance based on the theoretical model.

    “However, guided by our theoretical model, we specified the models to be tested in advance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Two-sided reasoning involves strategies of weighing and synthesizing arguments and counterarguments.

    “However, according to these authors, weighing arguments and counterarguments and synthesising them are strategies clearly involved in two-sided reasoning (Nussbaum and Schraw 2007).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nussbaum and Schraw 2007 source
  • May combine two claims.

    Interpretationown data

    The collaborative practice sessions affected the learning outcomes differently among both groups for both outcome variables, most probably as a result of the preceding instruction variable.

    “Secondly, the collaborative practice sessions affected the learning outcomes among both groups for both outcome variables differently, most probably as a result of the preceding instruction variable.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Explicit instruction, compared with self-study, resulted in more arguments covered from the source texts and higher integration scores.

    “explicit instruction, compared with self-study, resulted in more arguments being covered from the source texts and higher scores on integration of information.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Mateos et al. 2018 source
    • cites Song and Ferreti 2013 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Integration requires reflective argumentative writing.

    “Integration requires reflective argumentative writing, as proposed by Nussbaum (2008a) and Nussbaum and Kardash (2005).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Nussbaum (2008a) source
    • cites Nussbaum and Kardash (2005) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Integration needs more practice than argumentation coverage does.

    “Another tentative explanation is that integration needs more practice than argumentation coverage does.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Good integration might also require support in language skills and vocabulary.

    “In addition, good integration might also require some support, in terms of language skills and vocabulary, because two-sided argumentation and writing an integrative conclusion are quite difficult for students.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    During the first practice session (T2), students who received explicit instruction were more focused on identifying the arguments of both positions, while in the second practice session (T3) they were more able to focus on contrasting positions and constructing an integrated conclusion.

    “During the first practice session (T2), students who received explicit instruction were more focused on identifying the arguments of both positions, but in the second practice session (T3), the students were more able to focus on contrasting the positions and constructing an integrated conclusion.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Collaborative practice only facilitates some phases of the synthesis writing process.

    “A tentative explanation for this result is that collaborative practice only facilitates some phases of the process.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    For the collaborative practice papers, some pairs invested more in one variable while other pairs did the opposite.

    “For the collaborative practice papers, this might imply that some pairs were invested more in one variable, while other pairs did the opposite.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Teaching students to go beyond standing for one position and refuting the opposite requires explaining and modelling of the strategies involved in the overall process.

    “Teaching students to go beyond standing for one of the positions and limiting themselves to refuting the opposite, requires explaining and modelling of the strategies involved in the overall process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Kuhn and Crowell (2011) observed that teenage students involved in dialogic argumentation wrote essays containing significantly more arguments addressing both sides of the controversy than a comparison group following a more traditional discussion format.

    “This result is consistent with Kuhn and Crowell (2011), who observed that teenage students involved in dialogic argumentation wrote essays containing significantly more arguments which addressed both sides of the controversy than a comparison group that followed a more traditional discussion format.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kuhn and Crowell (2011) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Previous research shows an effect of explicit instruction via modelling in collaborative writing settings on students' writing skills.

    “The results are also consistent with those of previous research that shows the effect of explicit instruction via modeling in collaborative writing settings on students' writing skills (Van Steendam et al. 2010, 2014).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Van Steendam et al. 2010, 2014

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Pair work could lead to difficulties in constructing an integrative conclusion and in textualisation.

    “However, pair work could lead to difficulties in (c) constructing an integrative conclusion and (d) the textualisation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In the authors' previous study, the explicit instruction condition affected both the coverage of arguments and integration.

    “The present study was inspired by our previous study, in which we found that the explicit instruction condition affected both the coverage of arguments and the integration (Mateos et al. 2018).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mateos et al. 2018 source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Explicit instruction might be necessary, by modelling the writing phases and explaining the processes involved in the practice sessions.

    “Explicit instruction might be necessary, by modelling the different writing phases and unravelling the processes involved by explaining and fostering strategic learning, which is not merely technical, in the practice sessions.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationown data

    The sociocultural perspective on argumentative synthesis text writing supports the generative aspect of the process, while the cognitive perspective supports its integrative aspect.

    “We generally found that the sociocultural perspective on argumentative synthesis text writing would support the generative aspect of the process, while the cognitive perspective would support its integrative aspect.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    The quality of integration depends on the integration of both sides, which goes beyond the source text information.

    “However, the quality of integration depends on the next phase of synthesis writing: the integration of both sides, which goes beyond the source text information.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The data could indicate that instruction first affected argumentation coverage at T2 and then integration at T3.

    “These data could indicate that instruction first affected argumentation coverage (in T2) and then integration (in T3).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    To write an argumentative synthesis, one must understand that covering the arguments from the sources is a necessary preliminary step.

    “To write an argumentative synthesis, one must understand that covering the arguments from the sources is a necessary preliminary step.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    The graphical format of the table in the guide, with a double column and sections with different arguments, probably allowed participants to identify the reasons put forward in each text.

    “The graphical format of the table in the guide, with the double column and the sections with different arguments in each, probably allowed the participants to identify the reasons 1 3 put forward in each text.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The critical questions in the guide aimed at promoting integration processes might not have been very helpful for triggering those processes.

    “Conversely, the critical questions in the guide aimed at promoting integration processes might not have been very helpful for triggering these processes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    The students could have changed their task representation and set other goals, prioritizing integration and being more selective in identifying arguments.

    “The students could have changed their task representation and set other goals, while prioritizing integration and being more selective in identifying the arguments.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Identifying the arguments in the second practice session (T3) might have required fewer cognitive resources, which could be dedicated to integration.

    “Identifying the arguments in the second practice session (T3) might have required less cognitive resources, which could be dedicated to integration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    It cannot be ruled out that some pairs used the questions in the guide without writing their answers in it.

    “We cannot rule out the possibility that some pairs used the questions posed in the guide but did not show their answers by writing in the guide.”
    Quote in the paperNot a substantial claim
51 of 51
  • The authors state this as an assumption.

    When teaching argumentative synthesis writing, collaborative practice works better if it follows explicit instruction in the strategy.

    “We assumed, following Ferreti and Lewis (2013), that for improving argumentative synthesis writing, collaborative practice is more effective when preceded by explicit instruction about the strategy involved.”
  • The paper relies on this without support.

    The topics covered were so unfamiliar that students could not have clear individual stances on the issues.

    “The topics covered were so unfamiliar for the students that they could not have clear individual stances on the issues at stake.”
  • The authors state this as an assumption.

    Explicit instruction directly and indirectly affects both argumentation coverage and integration via the collaborative practice component.

    “The theoretical model assumed that the explicit instruction directly and indirectly affected both dependent variables via the practice component.”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • There are two different learning paths for the two elements of argumentative synthesis writing: argument identification and integration level of arguments and counterarguments.

    “On the other hand, and based on the evidence found that there are two different learning paths for the two elements of argumentative synthesis writing: argument identification and integration level of arguments and counterarguments (Mateos et al., 2020).”
  • In Mateos et al. (2020), for argument identification, practice in pairs provided an additional learning pathway that positively affected the results from the preceding explicit instruction.

    “This study showed that in the case of argument identification, the practice in pairs sessions provided an additional learning pathway that positively affected the results from the preceding explicit instruction.”
  • For integrating arguments from various sources, a direct effect of explicit instruction was found, indicating that practice in pairs did not contribute to the final scores.

    “By contrast, for the other learning outcome (i.e., integrating arguments from various sources), a direct effect of explicit instruction was found, indicating that practice in pairs did not contribute to the final scores.”
  • Findings suggested that explicit instruction was the key to improving argumentative synthesis writing, but the learning path was not the same for argument identification and integration level of arguments and counterarguments.

    “These findings suggested that explicit instruction was the key to improving argumentative synthesis writing; however it was shown that the learning path was not the same for the different processes involved in the task: argument identification and integration level of arguments and counterarguments (Mateos et al., 2020).”
  • The findings are similar to those obtained in the previous study by Mateos et al. (2020), where two learning paths were found based on argument identification and level of integration.

    “These findings are similar to those obtained in the previous study by Mateos et al., (2020), where it was found two learning paths based on the two variables analysed: argument identification and level of integration.”

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(1, 103) = 10.052reported p = .002 · recomputed p = .002

    “F (1, 103) = 10.052,p = .002”

  • ConsistentF(1, 103) = 7.51reported p = .007 · recomputed p = .007

    “F (1, 103) = 7.510, p = .007”

  • ConsistentF(2, 101) = 0.835reported p = .437 · recomputed p = .437

    “F (2,101) = 0.835, p = .437”

  • ConsistentF(2, 103) = 1.638reported p = .199 · recomputed p = .199

    “F (2, 103) = 1.638, p = .199”

  • Consistentχ²(84) = 112.7reported p = .02 · recomputed p = .020

    “χ 2 (84) = 112.70,p = .020”

5 of 5

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Discussion denies an instruction effect during integration practice

    Minor

    The discussion says integration had no contribution to or from practice, but the results report that instruction significantly affected integration scores in the practice sessions. This does not establish an indirect effect on the posttest, but it contradicts the unqualified claim about practice.

  • Figure caption gives the wrong model-fit p-value

    Minor

    The figure caption reports p = .089 for the model with χ2 = 52.13 and 66 degrees of freedom, while Table 5 reports p = .893 for that same model.

    Reported 0.089 · recomputed 0.893

  • Model-comparison label does not match its chi-square change

    Minor

    The comparison labelled as M7u versus M8i reports a change of 5.35, but the displayed chi-square values for M7i and M8i differ by 7.75. The 5.35 change instead matches M6i versus M7i.

    Reported 5.35 · recomputed 7.75

  • Practice sessions are described as fixed-length despite variable durations

    Minor

    The discussion calls them two 90-minute sessions, whereas the method says their durations varied by pair from 90 to 120 minutes.

4 of 4

Cites

Flagged first, then by citations

2 of the 51 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. Ferreti, R. P., & Fan, Y. (2016). Argumentative writing. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 301–315). New York: The Guilford Press.
  2. Klein, P., Arcon, N., & Baker, S. (2016). Writing to learn. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 243–256). New York: The Guilford Press.
  3. Perin, D. (2013). Best practices in teaching writing for college. In S. Graham, C. A. MacArthur, & J. Fitzgerald (Eds.), Best practices in writing instruction (pp. 48–70). New York: The Gilford Press.
  4. Shanahan, T. (2013). Best practices in writing about text. In S. Graham, C. A. MacArthur, & J. Fitzgerald (Eds.), Best practices in writing instruction (pp. 334–350). New York: The Gilford Press.

Cited by

Sorted by citations

Authors
Mateos, M., Rijlaarsdam, G., Martín, E., Cuevas, I., Van den Bergh, H., & Solari, M.
Affiliations
  • Universidad Autónoma de Madrid (ES)
  • University of Amsterdam (NL)
  • Universidad de Extremadura (ES)
Corresponding author
Mateos, Mar
Venue
Instructional Science
Published
2020-03-21
Volume
48
Issue
2
Pages
137-157
ISSN
  • 0020-4277 (ISSN-L)
  • 1573-1952
OpenAlex
W3012688642
Cited by
37
References
51
Citations by year
2026: 4 · 2025: 1 · 2024: 4 · 2023: 5 · 2022: 16 · 2021: 6 · 2020: 1
FWCI
10.34
Type
journal article
Language
en
Open access
Locations
  • Instructional Science (publishedVersion)
  • UvA-DARE (University of Amsterdam) (submittedVersion, other-oa)
  • Biblos-e Archivo (Universidad Autónoma de Madrid) (submittedVersion, public-domain)
  • Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
  • Hispana (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Funders
  • Secretaría de Estado de Investigación, Desarrollo e Innovación (EDU2013-46606-C2-1)
  • Ministerio de Educación, Cultura y Deporte (PRX15/00042)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
Keywords
synthesis writing, explicit strategy instruction, controversial issues, writing instruction, learning trajectories, argumentation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-29.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review