CoChat

Characterizing Stage-aware Writing Assistance for Collaborative Document Authoring

Open access
Sarrafzadeh, Bahareh, Jauhar, Sujay Kumar, Gamon, Michael, Lank, Edward, White, Ryen W. · 2021 · Proceedings of the ACM on Human-Computer Interaction
Cited by 12

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

Writing is a complex non-linear process that begins with a mental model of intent, and progresses through an outline of ideas, to words on paper (and their subsequent refinement). Despite past research in understanding writing, Web-scale consumer and enterprise collaborative digital writing environments are yet to greatly benefit from intelligent systems that understand the stages of document evolution, providing opportune assistance based on authors' situated actions and context. In this paper, we present three studies that explore temporal stages of document authoring. We first survey information workers at a large technology company about their writing habits and preferences, concluding that writers do in fact conceptually progress through several distinct phases while authoring documents. We also explore, qualitatively, how writing stages are linked to document lifespan. We supplement these qualitative findings with an analysis of the longitudinal user interaction logs of a popular digital writing platform over several million documents. Finally, as a first step towards facilitating an intelligent digital writing assistant, we conduct a preliminary investigation into the utility of user interaction log data for predicting the temporal stage of a document. Our results support the benefit of tools tailored to writing stages, identify primary tasks associated with these stages, and show that it is possible to predict stages from anonymous interaction logs. Together, these results argue for the benefit and feasibility of more tailored digital writing assistance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3434180

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 58

  1. Gediminas Adomavicius and Alexander Tuzhilin . 2011. Context-aware recommender systems . In Recommender systems handbook . Springer , 217--253. Gediminas Adomavicius and Alexander Tuzhilin. 2011. Context-aware recommender systems. In Recommender systems handbook. Springer, 217--253.
  2. 10.1145/1871437.1871519 · DOI · Paper page
  3. Denis Alamargot and Michel Fayol . 2009. Modelling the development of written composition. The SAGE handbook of writing development ( 2009 ), 23--47. Denis Alamargot and Michel Fayol. 2009. Modelling the development of written composition. The SAGE handbook of writing development (2009), 23--47.
  4. Ronald M Baecker , Dimitrios Nastos , Ilona R Posner , and Kelly L Mawby . 1995. The user-centred iterative design of collaborative writing software . In Readings in Human--Computer Interaction . Elsevier , 775--782. Ronald M Baecker, Dimitrios Nastos, Ilona R Posner, and Kelly L Mawby. 1995. The user-centred iterative design of collaborative writing software. In Readings in Human--Computer Interaction. Elsevier, 775--782.
  5. 10.1145/2145204.2145325 · DOI · Paper page
  6. 10.1145/2470654.2466123 · DOI · Paper page
  7. 10.1016/j.eswa.2014.06.007 · DOI · Paper page
  8. 10.1145/1216295.1216317 · DOI · Paper page
  9. 10.1177/0049124113500475 · DOI · Paper page
  10. John W Creswell . 2013. Research design: Qualitative, quantitative, and mixed methods approaches . Sage publications. John W Creswell. 2013. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
  11. Gabriele d' Angelo , Angelo Di Iorio , and Stefano Zacchiroli . 2018 . Spacetime Characterization of Real-Time Collaborative Editing . Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--19. Gabriele d'Angelo, Angelo Di Iorio, and Stefano Zacchiroli. 2018. Spacetime Characterization of Real-Time Collaborative Editing. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--19.
  12. 10.1080/00223980.1969.10543491 · DOI · Paper page
  13. 10.1145/99977.99987 · DOI · Paper page
  14. Mica R Endsley . 2017. Toward a theory of situation awareness in dynamic systems . In Situational Awareness . Routledge , 9--42. Mica R Endsley. 2017. Toward a theory of situation awareness in dynamic systems. In Situational Awareness. Routledge, 9--42.
  15. Jill Fitzgerald. 1992. Towards knowledge in writing: Illustrations from revision studies. (1992). Jill Fitzgerald. 1992. Towards knowledge in writing: Illustrations from revision studies. (1992). · doi:10.1007/978-1-4612-2796-0
  16. 10.2307/356600 · doi:10.2307/356600 · Paper page
  17. Linda Flower and John R Hayes . 1984. Images , plans, and prose: The representation of meaning in writing. Written communication 1, 1 ( 1984 ), 120--160. Linda Flower and John R Hayes. 1984. Images, plans, and prose: The representation of meaning in writing. Written communication 1, 1 (1984), 120--160.
  18. Sarah Warshauer Freedman 1987 . Research in Writing: Past, Present, and Future. (1987). Sarah Warshauer Freedman et al. 1987. Research in Writing: Past, Present, and Future. (1987).
  19. 10.1214/aos/1013203451 · DOI · Paper page
  20. Jolene Galegher and Robert E Kraut . 1994. Computer-mediated communication for intellectual teamwork: An experiment in group writing. Information systems research 5, 2 ( 1994 ), 110--138. Jolene Galegher and Robert E Kraut. 1994. Computer-mediated communication for intellectual teamwork: An experiment in group writing. Information systems research 5, 2 (1994), 110--138.
  21. Stephen Graham and Karen Harris . 2012. The role of strategies, knowledge, will, and skills in a 30-year program of writing research (with Homage to Hayes, Fayol, and Boscolo) . In Past, present, and future contributions of cognitive writing research to cognitive psychology . Taylor and Francis , 177--196. Stephen Graham and Karen Harris. 2012. The role of strategies, knowledge, will, and skills in a 30-year program of writing research (with Homage to Hayes, Fayol, and Boscolo). In Past, present, and future contributions of cognitive writing research to cognitive psychology. Taylor and Francis, 177--196.
  22. 10.1023/A:1021271517844 · DOI · Paper page
  23. 10.1145/2702123.2702561 · DOI · Paper page
  24. 10.1145/2507157.2507187 · DOI
  25. Karen Holtzblatt and Hugh Beyer . 1997. Contextual design: defining customer-centered systems . Elsevier . Karen Holtzblatt and Hugh Beyer. 1997. Contextual design: defining customer-centered systems. Elsevier.
  26. Eric Horvitz , Jack Breese , David Heckerman , David Hovel , and Koos Rommelse . 1998 . The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users . In Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., 256--265 . Eric Horvitz, Jack Breese, David Heckerman, David Hovel, and Koos Rommelse. 1998. The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users. In Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., 256--265.
  27. Claudia-Lavinia Ignat and Moira C Norrie . 2008 . Multi-level editing of hierarchical documents . Computer Supported Cooperative Work (CSCW) 17 , 5 -- 6 (2008), 423--468. Claudia-Lavinia Ignat and Moira C Norrie. 2008. Multi-level editing of hierarchical documents. Computer Supported Cooperative Work (CSCW) 17, 5--6 (2008), 423--468.
  28. 10.1037/0278-7393.14.2.355 · doi:10.1037/0278-7393.14.2.355 · Paper page
  29. 10.1016/j.cedpsych.2013.07.004 · DOI
  30. Paul Benjamin Lowry , Aaron Curtis , and Michelle René Lowry . 2004. Building a taxonomy and nomenclature of collaborative writing to improve interdisciplinary research and practice. The Journal of Business Communication (1973) 41, 1 ( 2004 ), 66--99. Paul Benjamin Lowry, Aaron Curtis, and Michelle René Lowry. 2004. Building a taxonomy and nomenclature of collaborative writing to improve interdisciplinary research and practice. The Journal of Business Communication (1973) 41, 1 (2004), 66--99.
  31. Aurélien Max and Guillaume Wisniewski. 2010. Mining Naturally-occurring Corrections and Paraphrases from Wikipedia?s Revision History.. In LREC. Aurélien Max and Guillaume Wisniewski. 2010. Mining Naturally-occurring Corrections and Paraphrases from Wikipedia?s Revision History.. In LREC.
  32. Alex Mitchell . 1996. Communication and shared understanding in collaborative writing . University of Toronto Toronto . Alex Mitchell. 1996. Communication and shared understanding in collaborative writing. University of Toronto Toronto.
  33. 10.1023/B:COSU.0000014876.96003.be · DOI · Paper page
  34. 10.1145/159764.159763 · DOI · Paper page
  35. 10.1145/3038919 · DOI · Paper page
  36. Adrian Pace , Louis Baligand , Stian Haklev , Jennifer Kaitlyn Olsen , Nore de Grez , and Bram De Wever . 2018 . Quantifying Collaboration in Synchronous Document Editing . In Proceedings of the 3rd Swiss Text Analytics Conference (Swiss-Text 2018). Adrian Pace, Louis Baligand, Stian Haklev, Jennifer Kaitlyn Olsen, Nore de Grez, and Bram De Wever. 2018. Quantifying Collaboration in Synchronous Document Editing. In Proceedings of the 3rd Swiss Text Analytics Conference (Swiss-Text 2018).
  37. 10.1109/HICSS.1992.183420 · DOI · Paper page
  38. 10.1145/3020165.3020183 · DOI · Paper page
  39. Marta Recasens , Cristian Danescu-Niculescu-Mizil , and Dan Jurafsky . 2013 . Linguistic models for analyzing and detecting biased language . In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1650--1659 . Marta Recasens, Cristian Danescu-Niculescu-Mizil, and Dan Jurafsky. 2013. Linguistic models for analyzing and detecting biased language. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1650--1659.
  40. 10.2307/354885 · DOI · Paper page
  41. 10.1145/3289600.3291028 · DOI
  42. 10.1145/2661829.2662070 · DOI
  43. Nancy Sommers . 1994. Revision strategies of student writers and experienced adult writers. Landmark essays on writing process ( 1994 ), 75--84. Nancy Sommers. 1994. Revision strategies of student writers and experienced adult writers. Landmark essays on writing process (1994), 75--84.
  44. Lucy A Suchman . 1987. Plans and situated actions: The problem of human-machine communication . Cambridge university press . Lucy A Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.
  45. 10.1023/A:1008636321493 · DOI
  46. 10.1145/2858036.2858108 · DOI · Paper page
  47. 10.1007/s11409-011-9072-x · DOI
  48. 10.1145/3359141 · DOI · Paper page
  49. 10.1145/3134742 · DOI · Paper page
  50. Cuiqin Xu and Yanren Ding . 2014 . An exploratory study of pauses in computer-assisted EFL writing . Language Learning & Technology 18 , 3 (2014), 80 -- 96 . Cuiqin Xu and Yanren Ding. 2014. An exploratory study of pauses in computer-assisted EFL writing. Language Learning & Technology 18, 3 (2014), 80--96.
  51. 10.5555/1557690.1557726 · doi:10.5555/1557690.1557726
  52. 10.18653/v1/D17-1213 · DOI · Paper page
  53. Mark Yatskar , Bo Pang , Cristian Danescu-Niculescu-Mizil , and Lillian Lee . 2010 . For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia . In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 365--368 . Mark Yatskar, Bo Pang, Cristian Danescu-Niculescu-Mizil, and Lillian Lee. 2010. For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 365--368.
  54. 10.1145/2998181.2998356 · DOI · Paper page
  55. Vivian Zamel . 1982 . Writing: The process of discovering meaning. TESOL quarterly 16, 2 (1982), 195--209. Vivian Zamel. 1982. Writing: The process of discovering meaning. TESOL quarterly 16, 2 (1982), 195--209.
  56. Fabio Massimo Zanzotto and Marco Pennacchiotti . 2010 . Expanding textual entailment corpora fromwikipedia using co-training . In Proceedings of the 2nd Workshop on The People?s Web Meets NLP: Collaboratively Constructed Semantic Resources. 28--36 . Fabio Massimo Zanzotto and Marco Pennacchiotti. 2010. Expanding textual entailment corpora fromwikipedia using co-training. In Proceedings of the 2nd Workshop on The People?s Web Meets NLP: Collaboratively Constructed Semantic Resources. 28--36.
  57. 10.5555/2380816.2380880 · doi:10.5555/2380816.2380880
  58. 10.1145/3209978.3210001 · doi:10.1145/3209978.3210001

Cited by

See all 12

Metadata

Authors
Sarrafzadeh, B., Jauhar, S. K., Gamon, M., Lank, E., & White, R. W.
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2021-01-05
Volume
4
Issue
CSCW3
Pages
1-29
ISSN
2573-0142 (ISSN-L)
OpenAlex
W3069328762
Cited by
12
References
6
FWCI
1.20
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.