Discourse synthesis in integrated second language writing assessment
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
As integrated tasks become more common in assessing writing for academic purposes, it is necessary to investigate how test takers approach these tasks. The present study explores the processes of test takers undertaking reading-to-write tasks developed for a university English placement exam. Think-aloud protocols and interviews of university-level non-native writers of English were collected to capture the writers’ composing processes. These data were analysed to determine if the tasks elicited an academic writing process of discourse synthesis and to identify what language issues were present. The results revealed some writers use discourse synthesis subprocesses in composing responses to the reading-to-write tasks, with apparent d ifferences across writers. Language difficulties that emerged for writers were vocabulary knowledge and use, as well as stylistic concerns. The implications of the study suggest that reading-to-write tasks may elicit a discourse synthesis process that could be used for validity evidence in some contexts and lead to more appropriate placement into academic writing courses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Protocol Analysis: Verbal Reports as Data
Venkatesan, M., Ericsson, K. A., & Simon, H. A. (1986) · Journal of Marketing Research · doi:10.2307/3151491 · Cited by 4,347
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Kenyon, D. M., Bachman, L. F., & Palmer, A. S. (1998) · The Modern Language Journal · doi:10.2307/328718 · Cited by 2,323
A cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025 · cited 1×
“Think-aloud protocols have been used to determine test-taker strategies, to study validity/reliability (Cohen, 1998; Green, 1998), and to uncover the composing processes of writers (Flower, 1994; Flower & Hayes, 1981).”
MethodToward an Understanding of the Distinct Nature of L2 Writing: The ESL Research and Its Implications
Silva, T. (1993) · TESOL Quarterly · doi:10.2307/3587400 · Cited by 860 · cited 1×
“Secondly, although discourse synthesis has been developed and studied largely in the context of L1 reading and writing, scholars in L2 writing (Silva, 1993) argue that L2 writing should not be seen as a simple derivative of L1 writing.”
BackgroundWeigle, S. C. (2002) · doi:10.1017/cbo9780511732997 · Cited by 779
Borrowing Others' Words: Text, Ownership, Memory, and Plagiarism
Pennycook, A. (1996) · TESOL Quarterly · doi:10.2307/3588141 · Cited by 735 · cited 1×
“…of source use when writing in Chinese, which researchers have suggested differs from that of English (Scollon, 1994; Shi, 2004), may be impacting her process; however, Pennycook (1996) has warned this issue is very complex and requires close, contextual, and culturally sensitive handling.”
BackgroundThe Composing Processes of Advanced ESL Students: Six Case Studies
Zamel, V. (1983) · TESOL Quarterly · doi:10.2307/3586647 · Cited by 712 · cited 1×
“In the field of second language writing, reading-to-write tasks have appeared in studies of composing processes (Bosher, 1998; Cumming, 1989; Zamel, 1983), but these studies have largely focused on the impact of writers’ individual characteristics on their writing processes.”
BackgroundWriting Expertise and Second‐Language Proficiency*
Cumming, A. (1989) · Language Learning · doi:10.1111/j.1467-1770.1989.tb00592.x · Cited by 641 · cited 2×
“A number of studies of writing process have found that writers’ experience impacts their process, when reading is included (Cumming, 1989) and when it is not (Sasaki, 2000).”
BackgroundStatistical Analyses for Language Assessment
Bachman, L. F. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511667350 · Cited by 568 · cited 1×
“Thus, processes that test takers use to approach various test tasks are a validity-related concern (Bachman, 2002, 2004; Cohen, 2007).”
BackgroundThe validity of verbal protocols
Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989) · Memory & Cognition · doi:10.3758/bf03202637 · Cited by 543 · cited 1×
“…been found to provide sound insight into writers’ processes (Swarts, Flower, & Hayes, 1984; Witte & Cherry, 1994); however, it can be distracting for writers (Cooper & Holzman, 1983; Russo et al., 1989; Stratman & Hamp-Lyons, 1994) and may vary depending on participants’ verbosity (Sasaki, 2000).”
BackgroundContrastive Rhetoric: Cross-Cultural Aspects of Second Language Writing
Connor, U. M. (1996) · doi:10.1017/cbo9781139524599 · Cited by 510
The Construction of Negotiated Meaning: A Social Cognitive Theory of Writing
Flower, L. (1995) · College Composition and Communication · doi:10.2307/358881 · Cited by 412 · cited 1×
“Think-aloud protocols have been used to determine test-taker strategies, to study validity/reliability (Cohen, 1998; Green, 1998), and to uncover the composing processes of writers (Flower, 1994; Flower & Hayes, 1981).”
MethodWhat Professors Actually Require: Academic Tasks for the ESL Classroom
Horowitz, D. M. (1986) · TESOL Quarterly · doi:10.2307/3586294 · Cited by 363 · cited 2×
“Currently, the writing section contains an independent writing-only task; however, the ESL program has considered changing to an integrated readingwriting task because the ESL writing courses include instruction on synthesizing reading and writing, and research has shown that such synthesis is a common assignment in a…”
BackgroundMethodCumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M. (2005) · Assessing Writing · doi:10.1016/j.asw.2005.02.001 · Cited by 344 · cited 5×
“Using these topics, argumentative tasks were developed because of their common occurrence in academic assignments (Cumming et al., 2005).”
BackgroundMethodInfluentialThe Constructivist Metaphor: Reading, Writing, and the Making of Meaning
Spivey, N. N. (1997) · College Composition and Communication · doi:10.2307/358470 · Cited by 338 · cited 4×
“Based on Spivey (1997) and Ascención (2005), the categories of organizing, selecting, and connecting were used to categorize participants’ discourse synthesis into the following subprocesses (with examples from think aloud protocols): (1) Organizing occurs when writers think about the overall…”
BackgroundMethodInfluentialTextual Borrowing in Second-Language Writing
Shi, L. (2004) · Written Communication · doi:10.1177/0741088303262846 · Cited by 320 · cited 3×
“In her case, the conventions of source use when writing in Chinese, which researchers have suggested differs from that of English (Scollon, 1994; Shi, 2004), may be impacting her process; however, Pennycook (1996) has warned this issue is very complex and requires close, contextual, and culturally sensitive handling.”
BackgroundToward an Empirical Model of EFL Writing Processes: An Exploratory Study
Sasaki, M. (2000) · Journal of Second Language Writing · doi:10.1016/s1060-3743(00)00028-x · Cited by 320 · cited 3×
“…been found to provide sound insight into writers’ processes (Swarts, Flower, & Hayes, 1984; Witte & Cherry, 1994); however, it can be distracting for writers (Cooper & Holzman, 1983; Russo et al., 1989; Stratman & Hamp-Lyons, 1994) and may vary depending on participants’ verbosity (Sasaki, 2000).”
BackgroundSome reflections on task-based language performance assessment
Bachman, L. F. (2002) · Language Testing · doi:10.1191/0265532202lt240oa · Cited by 318 · cited 1×
“Thus, processes that test takers use to approach various test tasks are a validity-related concern (Bachman, 2002, 2004; Cohen, 2007).”
BackgroundVerbal Protocol Analysis in Language Testing Research: A Handbook
Green, A. J. K. (1998) · Cited by 296
Readers as Writers Composing From Sources
Spivey, N. N., & King, J. R. (1989) · Reading Research Quarterly · doi:10.1598/rrq.24.1.1 · Cited by 276
Rupp, A. A., Ferne, T., & Choi, H. (2006) · Language Testing · doi:10.1191/0265532206lt337oa · Cited by 242
Transforming Texts: Constructive Processes in Reading and Writing
SPIVEY, N. N. (1990) · Written Communication · doi:10.1177/0741088390007002004 · Cited by 234
Comparing composing processes in writing-only and reading-to-write test tasks
Plakans, L. (2008) · Assessing Writing · doi:10.1016/j.asw.2008.07.001 · Cited by 218 · cited 3×
“…testing process and strategy studies aim to ascertain if test takers complete the designated task in a way that relates to the construct or processes in the target language use situation (Ascensión, 2005; Cohen, 1984, 1998, 2007; Cohen & Upton, 2007; Plakans, 2008, 2009; Rupp, Ferne, & Choi, 2006).”
BackgroundResultSelf-citationOn taking language tests: what the students report
Cohen, A. D. (1984) · Language Testing · doi:10.1177/026553228400100106 · Cited by 203 · cited 1×
“…testing process and strategy studies aim to ascertain if test takers complete the designated task in a way that relates to the construct or processes in the target language use situation (Ascensión, 2005; Cohen, 1984, 1998, 2007; Cohen & Upton, 2007; Plakans, 2008, 2009; Rupp, Ferne, & Choi, 2006).”
BackgroundInvestigating the reading-to-write construct
Asención Delaney, Y. (2008) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2008.04.001 · Cited by 188
The role of reading strategies in integrated L2 writing tasks
Plakans, L. (2009) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2009.05.001 · Cited by 185 · cited 1×
“…testing process and strategy studies aim to ascertain if test takers complete the designated task in a way that relates to the construct or processes in the target language use situation (Ascensión, 2005; Cohen, 1984, 1998, 2007; Cohen & Upton, 2007; Plakans, 2008, 2009; Rupp, Ferne, & Choi, 2006).”
BackgroundSelf-citationConnecting Reading & Writing in Second Language Writing Instruction
Hirvela, A. (2004) · University of Michigan Press eBooks · doi:10.3998/mpub.23736 · Cited by 177
de Larios, J. R., Murphy, L., & Manchón, R. M. (1999) · Journal of Second Language Writing · doi:10.1016/s1060-3743(99)80111-8 · Cited by 169
Integrating reading and writing in a competency test for non-native speakers of English
Weigle, S. C. (2004) · Assessing Writing · doi:10.1016/j.asw.2004.01.002 · Cited by 165 · cited 3×
“In assessing academic writing, the integration of modalities such as listening and reading is increasing as a means to improve validity, enhance authenticity, and provide test takers with content on which to write (Feak & Dobson, 1996; Read, 1990; Weigle, 2004).”
BackgroundMethodScience research students' composing processes
Shaw, P. M. (1991) · English for Specific Purposes · doi:10.1016/0889-4906(91)90024-q · Cited by 141 · cited 1×
“Secondly, the many variants of academic writing tasks, from research papers to essay exams to lab reports (for example, see Parkhurst, 1990 or Shaw, 1991), defy generalizing about a single academic writing process.”
BackgroundEsmaeili, H. (2002) · Canadian Modern Language Review/ La Revue canadienne des langues vivantes · doi:10.3138/cmlr.58.4.599 · Cited by 125 · cited 3×
“The analysis of language difficulties revealed that vocabulary in both reading and writing required substantial attention from these writers suggesting that L2 proficiency may inform a construct for integrated tasks (Esmaeili, 2002).”
BackgroundMethodAs a matter of fact: The changing ideology of authorship and responsibility in discourse
Scollon, R. (1994) · World Englishes · doi:10.1111/j.1467-971x.1994.tb00281.x · Cited by 115 · cited 2×
“In her case, the conventions of source use when writing in Chinese, which researchers have suggested differs from that of English (Scollon, 1994; Shi, 2004), may be impacting her process; however, Pennycook (1996) has warned this issue is very complex and requires close, contextual, and culturally sensitive handling.”
BackgroundWriting in science and technology: An analysis of assignments from ten undergraduate courses
Braine, G. (1989) · English for Specific Purposes · doi:10.1016/0889-4906(89)90003-3 · Cited by 114 · cited 2×
“Currently, the writing section contains an independent writing-only task; however, the ESL program has considered changing to an integrated readingwriting task because the ESL writing courses include instruction on synthesizing reading and writing, and research has shown that such synthesis is a common assignment in a…”
BackgroundMethodBosher, S. (1998) · Journal of Second Language Writing · doi:10.1016/s1060-3743(98)90013-3 · Cited by 112 · cited 1×
“In the field of second language writing, reading-to-write tasks have appeared in studies of composing processes (Bosher, 1998; Cumming, 1989; Zamel, 1983), but these studies have largely focused on the impact of writers’ individual characteristics on their writing processes.”
BackgroundCooper, M. M., & Holzman, M. (1983) · College Composition and Communication · doi:10.2307/358259 · Cited by 103 · cited 1×
“…been found to provide sound insight into writers’ processes (Swarts, Flower, & Hayes, 1984; Witte & Cherry, 1994); however, it can be distracting for writers (Cooper & Holzman, 1983; Russo et al., 1989; Stratman & Hamp-Lyons, 1994) and may vary depending on participants’ verbosity (Sasaki, 2000).”
Background`I want to go back to the text': Response strategies on the reading subtest of the new TOEFL®
Cohen, A. D., & Upton, T. A. (2007) · Language Testing · doi:10.1177/0265532207076364 · Cited by 93 · cited 1×
“…testing process and strategy studies aim to ascertain if test takers complete the designated task in a way that relates to the construct or processes in the target language use situation (Ascensión, 2005; Cohen, 1984, 1998, 2007; Cohen & Upton, 2007; Plakans, 2008, 2009; Rupp, Ferne, & Choi, 2006).”
BackgroundReading, Writing, and Knowing: The Role of Disciplinary Knowledge in Comprehension and Composing
Ackerman, J. M. (1991) · Research in the Teaching of English · doi:10.58680/rte199115468 · Cited by 91 · cited 1×
“L1 academic writing has been conceptualized and researched as a constructive meaning-making process of reading for writing called discourse synthesis (Ackerman, 1991; Greene, 1993, Lenski, 1998; Marsella, Hilgers, & McLaren, 1992).”
BackgroundProviding relevant content in an EAP writing test
Read, J. (1990) · English for Specific Purposes · doi:10.1016/0889-4906(90)90002-t · Cited by 90 · cited 2×
“In assessing academic writing, the integration of modalities such as listening and reading is increasing as a means to improve validity, enhance authenticity, and provide test takers with content on which to write (Feak & Dobson, 1996; Read, 1990; Weigle, 2004).”
BackgroundGreene, S. (1993) · Research in the Teaching of English · doi:10.58680/rte199315421 · Cited by 77 · cited 1×
“L1 academic writing has been conceptualized and researched as a constructive meaning-making process of reading for writing called discourse synthesis (Ackerman, 1991; Greene, 1993, Lenski, 1998; Marsella, Hilgers, & McLaren, 1992).”
BackgroundThe test-takers' choice: an investigation of the effect of topic on language-test performance
Jennings, M., Fox, J. D., Graves, B., & Shohamy, E. (1999) · Language Testing · doi:10.1177/026553229901600402 · Cited by 76
Issues in ESL Writing Assessment: An Overview.
Hamp‐Lyons, L., & Kroll, B. (1996) · PolyU Institutional Research Archive (Hong Kong Polytechnic University) · Cited by 70
Building on the Impromptu: A Source-Based Academic Writing Assessment.
Feak, C. B., & Dobson, B. (1996) · College ESL · Cited by 48
The Testing of Writing in a Second Language
Cumming, A. H. (1997) · Springer eBooks · doi:10.1007/978-1-4020-4489-2_6 · Cited by 44
The composition process of science writers
Parkhurst, C. (1990) · English for Specific Purposes · doi:10.1016/0889-4906(90)90006-x · Cited by 39 · cited 1×
“Secondly, the many variants of academic writing tasks, from research papers to essay exams to lab reports (for example, see Parkhurst, 1990 or Shaw, 1991), defy generalizing about a single academic writing process.”
BackgroundSTRATEGIC KNOWLEDGE WHEN READING IN ORDER TO WRITE
Lenski, S. D. (1998) · Reading Psychology · doi:10.1080/0270271980190303 · Cited by 16 · cited 1×
“L1 academic writing has been conceptualized and researched as a constructive meaning-making process of reading for writing called discourse synthesis (Ackerman, 1991; Greene, 1993, Lenski, 1998; Marsella, Hilgers, & McLaren, 1992).”
Background
Cited by
A close investigation into source use in integrated second language writing tasks
Plakans, L., & Gebril, A. (2012) · Assessing Writing · doi:10.1016/j.asw.2011.09.002 · Cited by 196
Self-citationDiscourse synthesis: Textual transformations in writing from sources
Nelson, N., & King, J. R. (2023) · Reading and Writing · doi:10.1007/s11145-021-10243-5 · Cited by 61
Understanding the keystroke log: the effect of writing task on keystroke features
Conijn, R., Roeser, J., & van Zaanen, M. (2019) · Reading and Writing · doi:10.1007/s11145-019-09953-8 · Cited by 55
“Writing processes have been measured in different ways, both during and after the writing process, using observations, video analysis, thinking-aloud methods, and retrospective interviews (e.g., Lei, 2008; Plakans, 2009; Xu & Ding, 2014).”
MethodLinguistic complexity as the predictor of EFL independent and integrated writing quality
Zhang, Y., & Ouyang, J. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100727 · Cited by 28
Metadata
- Authors
- Plakans, L.
- Venue
- Language Testing
- Publisher
- SAGE Publications
- Published
- 2009-10
- Volume
- 26
- Issue
- 4
- Pages
- 561-587
- ISSN
- 0265-5322 (ISSN-L)
- 1477-0946
- OpenAlex
- W2123186708
- Cited by
- 159
- References
- 46
- FWCI
- 28.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.