Characterizing Stage-aware Writing Assistance for Collaborative Document Authoring
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Writing is a complex non-linear process that begins with a mental model of intent, and progresses through an outline of ideas, to words on paper (and their subsequent refinement). Despite past research in understanding writing, Web-scale consumer and enterprise collaborative digital writing environments are yet to greatly benefit from intelligent systems that understand the stages of document evolution, providing opportune assistance based on authors' situated actions and context. In this paper, we present three studies that explore temporal stages of document authoring. We first survey information workers at a large technology company about their writing habits and preferences, concluding that writers do in fact conceptually progress through several distinct phases while authoring documents. We also explore, qualitatively, how writing stages are linked to document lifespan. We supplement these qualitative findings with an analysis of the longitudinal user interaction logs of a popular digital writing platform over several million documents. Finally, as a first step towards facilitating an intelligent digital writing assistant, we conduct a preliminary investigation into the utility of user interaction log data for predicting the temporal stage of a document. Our results support the benefit of tools tailored to writing stages, identify primary tasks associated with these stages, and show that it is possible to predict stages from anonymous interaction logs. Together, these results argue for the benefit and feasibility of more tailored digital writing assistance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grounded theory research: Procedures, canons, and evaluative criteria
Corbin, J. M., & Strauss, A. (1990) · Qualitative Sociology · doi:10.1007/bf00988593 · Cited by 11,133
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 2×
“ng stage and provide varied assistance based on this inference? Or should users pre-specify writing stage? Intelligent adaptation of an interface is something that researchers have extensively probed [9, 31], and the reluctance to automatically trust adaptive tools [9] was echoed in our initial survey, where over one…”
Faigley, L., & Witte, S. (1981) · College Composition & Communication · doi:10.2307/356602 · Cited by 481
Alamargot, D., & Chanquoy, L. (2001) · Studies in Writing · doi:10.1007/978-94-010-0804-4 · Cited by 378
A Social-Interactive Model of Writing
NYSTRAND, M. (1989) · Written Communication · doi:10.1177/0741088389006001005 · Cited by 225
Understanding the keystroke log: the effect of writing task on keystroke features
Conijn, R., Roeser, J., & van Zaanen, M. (2019) · Reading and Writing · doi:10.1007/s11145-019-09953-8 · Cited by 55 · cited 3×
“ng keystroke logs and used the time intervals between different keystrokes to infer changes in the users’ cognitive load and correlate them with phases of writing they are transitioning through (e.g. [11]). Given issues of data privacy, our goal was to leverage interaction logs that are devoid of any text and keystrok…”
Influential
Research works printed but not linked: 58
- Gediminas Adomavicius and Alexander Tuzhilin . 2011. Context-aware recommender systems . In Recommender systems handbook . Springer , 217--253. Gediminas Adomavicius and Alexander Tuzhilin. 2011. Context-aware recommender systems. In Recommender systems handbook. Springer, 217--253.
- 10.1145/1871437.1871519 · DOI · Paper page
- Denis Alamargot and Michel Fayol . 2009. Modelling the development of written composition. The SAGE handbook of writing development ( 2009 ), 23--47. Denis Alamargot and Michel Fayol. 2009. Modelling the development of written composition. The SAGE handbook of writing development (2009), 23--47.
- Ronald M Baecker , Dimitrios Nastos , Ilona R Posner , and Kelly L Mawby . 1995. The user-centred iterative design of collaborative writing software . In Readings in Human--Computer Interaction . Elsevier , 775--782. Ronald M Baecker, Dimitrios Nastos, Ilona R Posner, and Kelly L Mawby. 1995. The user-centred iterative design of collaborative writing software. In Readings in Human--Computer Interaction. Elsevier, 775--782.
- 10.1145/2145204.2145325 · DOI · Paper page
- 10.1145/2470654.2466123 · DOI · Paper page
- 10.1016/j.eswa.2014.06.007 · DOI · Paper page
- 10.1145/1216295.1216317 · DOI · Paper page
- 10.1177/0049124113500475 · DOI · Paper page
- John W Creswell . 2013. Research design: Qualitative, quantitative, and mixed methods approaches . Sage publications. John W Creswell. 2013. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
- Gabriele d' Angelo , Angelo Di Iorio , and Stefano Zacchiroli . 2018 . Spacetime Characterization of Real-Time Collaborative Editing . Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--19. Gabriele d'Angelo, Angelo Di Iorio, and Stefano Zacchiroli. 2018. Spacetime Characterization of Real-Time Collaborative Editing. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--19.
- 10.1080/00223980.1969.10543491 · DOI · Paper page
- 10.1145/99977.99987 · DOI · Paper page
- Mica R Endsley . 2017. Toward a theory of situation awareness in dynamic systems . In Situational Awareness . Routledge , 9--42. Mica R Endsley. 2017. Toward a theory of situation awareness in dynamic systems. In Situational Awareness. Routledge, 9--42.
- Jill Fitzgerald. 1992. Towards knowledge in writing: Illustrations from revision studies. (1992). Jill Fitzgerald. 1992. Towards knowledge in writing: Illustrations from revision studies. (1992). · doi:10.1007/978-1-4612-2796-0
- 10.2307/356600 · doi:10.2307/356600 · Paper page
- Linda Flower and John R Hayes . 1984. Images , plans, and prose: The representation of meaning in writing. Written communication 1, 1 ( 1984 ), 120--160. Linda Flower and John R Hayes. 1984. Images, plans, and prose: The representation of meaning in writing. Written communication 1, 1 (1984), 120--160.
- Sarah Warshauer Freedman 1987 . Research in Writing: Past, Present, and Future. (1987). Sarah Warshauer Freedman et al. 1987. Research in Writing: Past, Present, and Future. (1987).
- 10.1214/aos/1013203451 · DOI · Paper page
- Jolene Galegher and Robert E Kraut . 1994. Computer-mediated communication for intellectual teamwork: An experiment in group writing. Information systems research 5, 2 ( 1994 ), 110--138. Jolene Galegher and Robert E Kraut. 1994. Computer-mediated communication for intellectual teamwork: An experiment in group writing. Information systems research 5, 2 (1994), 110--138.
- Stephen Graham and Karen Harris . 2012. The role of strategies, knowledge, will, and skills in a 30-year program of writing research (with Homage to Hayes, Fayol, and Boscolo) . In Past, present, and future contributions of cognitive writing research to cognitive psychology . Taylor and Francis , 177--196. Stephen Graham and Karen Harris. 2012. The role of strategies, knowledge, will, and skills in a 30-year program of writing research (with Homage to Hayes, Fayol, and Boscolo). In Past, present, and future contributions of cognitive writing research to cognitive psychology. Taylor and Francis, 177--196.
- 10.1023/A:1021271517844 · DOI · Paper page
- 10.1145/2702123.2702561 · DOI · Paper page
- 10.1145/2507157.2507187 · DOI
- Karen Holtzblatt and Hugh Beyer . 1997. Contextual design: defining customer-centered systems . Elsevier . Karen Holtzblatt and Hugh Beyer. 1997. Contextual design: defining customer-centered systems. Elsevier.
- Eric Horvitz , Jack Breese , David Heckerman , David Hovel , and Koos Rommelse . 1998 . The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users . In Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., 256--265 . Eric Horvitz, Jack Breese, David Heckerman, David Hovel, and Koos Rommelse. 1998. The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users. In Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., 256--265.
- Claudia-Lavinia Ignat and Moira C Norrie . 2008 . Multi-level editing of hierarchical documents . Computer Supported Cooperative Work (CSCW) 17 , 5 -- 6 (2008), 423--468. Claudia-Lavinia Ignat and Moira C Norrie. 2008. Multi-level editing of hierarchical documents. Computer Supported Cooperative Work (CSCW) 17, 5--6 (2008), 423--468.
- 10.1037/0278-7393.14.2.355 · doi:10.1037/0278-7393.14.2.355 · Paper page
- 10.1016/j.cedpsych.2013.07.004 · DOI
- Paul Benjamin Lowry , Aaron Curtis , and Michelle René Lowry . 2004. Building a taxonomy and nomenclature of collaborative writing to improve interdisciplinary research and practice. The Journal of Business Communication (1973) 41, 1 ( 2004 ), 66--99. Paul Benjamin Lowry, Aaron Curtis, and Michelle René Lowry. 2004. Building a taxonomy and nomenclature of collaborative writing to improve interdisciplinary research and practice. The Journal of Business Communication (1973) 41, 1 (2004), 66--99.
- Aurélien Max and Guillaume Wisniewski. 2010. Mining Naturally-occurring Corrections and Paraphrases from Wikipedia?s Revision History.. In LREC. Aurélien Max and Guillaume Wisniewski. 2010. Mining Naturally-occurring Corrections and Paraphrases from Wikipedia?s Revision History.. In LREC.
- Alex Mitchell . 1996. Communication and shared understanding in collaborative writing . University of Toronto Toronto . Alex Mitchell. 1996. Communication and shared understanding in collaborative writing. University of Toronto Toronto.
- 10.1023/B:COSU.0000014876.96003.be · DOI · Paper page
- 10.1145/159764.159763 · DOI · Paper page
- 10.1145/3038919 · DOI · Paper page
- Adrian Pace , Louis Baligand , Stian Haklev , Jennifer Kaitlyn Olsen , Nore de Grez , and Bram De Wever . 2018 . Quantifying Collaboration in Synchronous Document Editing . In Proceedings of the 3rd Swiss Text Analytics Conference (Swiss-Text 2018). Adrian Pace, Louis Baligand, Stian Haklev, Jennifer Kaitlyn Olsen, Nore de Grez, and Bram De Wever. 2018. Quantifying Collaboration in Synchronous Document Editing. In Proceedings of the 3rd Swiss Text Analytics Conference (Swiss-Text 2018).
- 10.1109/HICSS.1992.183420 · DOI · Paper page
- 10.1145/3020165.3020183 · DOI · Paper page
- Marta Recasens , Cristian Danescu-Niculescu-Mizil , and Dan Jurafsky . 2013 . Linguistic models for analyzing and detecting biased language . In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1650--1659 . Marta Recasens, Cristian Danescu-Niculescu-Mizil, and Dan Jurafsky. 2013. Linguistic models for analyzing and detecting biased language. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1650--1659.
- 10.2307/354885 · DOI · Paper page
- 10.1145/3289600.3291028 · DOI
- 10.1145/2661829.2662070 · DOI
- Nancy Sommers . 1994. Revision strategies of student writers and experienced adult writers. Landmark essays on writing process ( 1994 ), 75--84. Nancy Sommers. 1994. Revision strategies of student writers and experienced adult writers. Landmark essays on writing process (1994), 75--84.
- Lucy A Suchman . 1987. Plans and situated actions: The problem of human-machine communication . Cambridge university press . Lucy A Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.
- 10.1023/A:1008636321493 · DOI
- 10.1145/2858036.2858108 · DOI · Paper page
- 10.1007/s11409-011-9072-x · DOI
- 10.1145/3359141 · DOI · Paper page
- 10.1145/3134742 · DOI · Paper page
- Cuiqin Xu and Yanren Ding . 2014 . An exploratory study of pauses in computer-assisted EFL writing . Language Learning & Technology 18 , 3 (2014), 80 -- 96 . Cuiqin Xu and Yanren Ding. 2014. An exploratory study of pauses in computer-assisted EFL writing. Language Learning & Technology 18, 3 (2014), 80--96.
- 10.5555/1557690.1557726 · doi:10.5555/1557690.1557726
- 10.18653/v1/D17-1213 · DOI · Paper page
- Mark Yatskar , Bo Pang , Cristian Danescu-Niculescu-Mizil , and Lillian Lee . 2010 . For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia . In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 365--368 . Mark Yatskar, Bo Pang, Cristian Danescu-Niculescu-Mizil, and Lillian Lee. 2010. For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 365--368.
- 10.1145/2998181.2998356 · DOI · Paper page
- Vivian Zamel . 1982 . Writing: The process of discovering meaning. TESOL quarterly 16, 2 (1982), 195--209. Vivian Zamel. 1982. Writing: The process of discovering meaning. TESOL quarterly 16, 2 (1982), 195--209.
- Fabio Massimo Zanzotto and Marco Pennacchiotti . 2010 . Expanding textual entailment corpora fromwikipedia using co-training . In Proceedings of the 2nd Workshop on The People?s Web Meets NLP: Collaboratively Constructed Semantic Resources. 28--36 . Fabio Massimo Zanzotto and Marco Pennacchiotti. 2010. Expanding textual entailment corpora fromwikipedia using co-training. In Proceedings of the 2nd Workshop on The People?s Web Meets NLP: Collaboratively Constructed Semantic Resources. 28--36.
- 10.5555/2380816.2380880 · doi:10.5555/2380816.2380880
- 10.1145/3209978.3210001 · doi:10.1145/3209978.3210001
Cited by
Beyond the Chat: Executable and Verifiable Text-Editing with LLMs
Laban, P., Vig, J., Hearst, M., Xiong, C., & Wu, C.-S. (2024) · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3654777.3676419 · Cited by 31
“Some prior work has explored the different stages of document editing, either through a design space of [23] for writing support tools, or through the survey of authors on the lifespan of their documents [61].”
BackgroundCo-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
The Invisible Labor of Access in Academic Writing Practices: A Case Analysis with Dyslexic Adults
Wang, E. Q., & Piper, A. M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512967 · Cited by 33
Chen, Y., Xiao, Y., Zinat, K. T., Yamashita, N., Gao, G., & Liu, Z. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713693 · Cited by 2
“Researchers also explored various aspects of collaboration, such as impression management [7], reluctance to write closely [98], preference over edits with explanations [72], differences of tasks across writing stages [81], and territorial behaviors [50].”
Metadata
- Authors
- Sarrafzadeh, B., Jauhar, S. K., Gamon, M., Lank, E., & White, R. W.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-01-05
- Volume
- 4
- Issue
- CSCW3
- Pages
- 1-29
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3069328762
- Cited by
- 12
- References
- 6
- FWCI
- 1.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.