Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
We propose a text editor to help users plan, structure and reflect on their writing process. It provides continuously updated paragraph-wise summaries as margin annotations, using automatic text summarization. Summary levels range from full text, to selected (central) sentences, down to a collection of keywords. To understand how users interact with this system during writing, we conducted two user studies (N=4 and N=8) in which people wrote analytic essays about a given topic and article. As a key finding, the summaries gave users an external perspective on their writing and helped them to revise the content and scope of their drafted paragraphs. People further used the tool to quickly gain an overview of the text and developed strategies to integrate insights from the automated summaries. More broadly, this work explores and highlights the value of designing AI tools for writers, with Natural Language Processing (NLP) capabilities that go beyond direct text generation and correction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Get To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775
A cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025
Wordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342
Neural Text Summarization: A Critical Evaluation
Kryscinski, W., Keskar, N. S., McCann, B., Xiong, C., & Socher, R. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1051 · Cited by 335
Digital support for academic writing: A review of technologies and pedagogies
Strobl, C., Ailhaud, E., Benetos, K., Devitt, A., Kruse, O., Proske, A., & Rapp, C. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.12.005 · Cited by 298 · cited 1×
“[43] provide a recent survey of 44 academic writing tools.”
BackgroundCreative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172983 · Cited by 257
TaleBrush: Sketching Stories with Generative Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501819 · Cited by 206 · cited 1×
“Further work explored controllable generation of plots with AI [7, 46], or addressed writing poetry [14], metaphors [13], slogans [8], fictional characters [40], and emails [4, 18].”
Background
Research works printed but not linked: 34
- 10.1145/2858036.2858407 · DOI
- Kenneth C Arnold , April M Volzer , and Noah G Madrid . 2021 . Generative Models can Help Writers without Writing for Them . 2nd Workshop on Human-AI Co-Creation with Generative Models - HAI-GEN 2021 (2021), 8. Kenneth C Arnold, April M Volzer, and Noah G Madrid. 2021. Generative Models can Help Writers without Writing for Them. 2nd Workshop on Human-AI Co-Creation with Generative Models - HAI-GEN 2021 (2021), 8.
- 10.1145/3468505 · DOI · Paper page
- Hakan Ceylan and Rada Mihalcea . 2009. The Decomposition of Human-Written Book Summaries . In Computational Linguistics and Intelligent Text Processing, Alexander Gelbukh (Ed.). Vol. 5449. Springer Berlin Heidelberg , Berlin, Heidelberg, 582–593. https://doi.org/10.1007/978-3-642-00382-0_47 Series Title : Lecture Notes in Computer Science. 10.1007/978-3-642-00382-0_47 Hakan Ceylan and Rada Mihalcea. 2009. The Decomposition of Human-Written Book Summaries. In Computational Linguistics and Intelligent Text Processing, Alexander Gelbukh (Ed.). Vol. 5449. Springer Berlin Heidelberg, Berlin, Heidelberg, 582–593. https://doi.org/10.1007/978-3-642-00382-0_47 Series Title: Lecture Notes in Computer Science. · doi:10.1007/978-3-642-00382-0_47
- Juliet M Corbin . 1990. Basics of qualitative research: Grounded theory procedures and techniques . Sage . Juliet M Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques. Sage.
- 10.1093/elt/54.3.235 · DOI · Paper page
- 10.2307/356600 · doi:10.2307/356600 · Paper page
- 10.18653/v1/P17-4008 · DOI · Paper page
- Han L. Han , Miguel A. Renom , Wendy E. Mackay , and Michel Beaudouin-Lafon . 2020 . Textlets: Supporting Constraints and Consistency in Text Documents . Association for Computing Machinery , New York, NY, USA , 1–13. https://doi.org/10.1145/3313831.3376804 10.1145/3313831.3376804 Han L. Han, Miguel A. Renom, Wendy E. Mackay, and Michel Beaudouin-Lafon. 2020. Textlets: Supporting Constraints and Consistency in Text Documents. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376804 · DOI · Paper page
- 10.1145/3377325.3377485 · DOI
- 10.1145/2939672.2939801 · DOI · Paper page
- 10.1109/TPC.2012.2207838 · DOI
- 10.1016/j.ipl.2017.10.007 · doi:10.1016/j.ipl.2017.10.007
- Karen Sheriff LeVan and Marissa E King . 2017 . Self-Annotation as a Course Practice . Teaching English in the Two Year College 44 , 3 (2017), 289 . Karen Sheriff LeVan and Marissa E King. 2017. Self-Annotation as a Course Practice. Teaching English in the Two Year College 44, 3 (2017), 289. · doi:10.58680/tetyc201729004
- Daniel Li , Thomas Chen , Albert Tung , and Lydia B Chilton . 2021 . Hierarchical Summarization for Longform Spoken Dialog. In The 34th Annual ACM Symposium on User Interface Software and Technology ( Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 582–597. https://doi.org/10.1145/3472749.3474771 10.1145/3472749.3474771 Daniel Li, Thomas Chen, Albert Tung, and Lydia B Chilton. 2021. Hierarchical Summarization for Longform Spoken Dialog. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 582–597. https://doi.org/10.1145/3472749.3474771 · DOI
- Yang Li , Sayan Sarcar , Sunjun Kim , and Xiangshi Ren . 2020 . Swap: A Replacement-Based Text Revision Technique for Mobile Devices . Association for Computing Machinery , New York, NY, USA , 1–12. https://doi.org/10.1145/3313831.3376217 10.1145/3313831.3376217 Yang Li, Sayan Sarcar, Sunjun Kim, and Xiangshi Ren. 2020. Swap: A Replacement-Based Text Revision Technique for Mobile Devices. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376217 · DOI
- 10.1109/TCOM.1982.1095380 · DOI · Paper page
- Kristin Messuri . 2016 . Revision Strategies . The Southwest Respiratory and Critical Care Chronicles 4 , 14 (April 2016), 46–48. https://pulmonarychronicles.com/index.php/pulmonarychronicles/article/view/263 Number: 14. Kristin Messuri. 2016. Revision Strategies. The Southwest Respiratory and Critical Care Chronicles 4, 14 (April 2016), 46–48. https://pulmonarychronicles.com/index.php/pulmonarychronicles/article/view/263 Number: 14.
- 10.12746/swrccc.v4i15.290 · doi:10.12746/swrccc.v4i15.290
- Rada Mihalcea and Paul Tarau . 2004 . Textrank: Bringing order into text . In Proceedings of the 2004 conference on empirical methods in natural language processing. 404–411 . Rada Mihalcea and Paul Tarau. 2004. Textrank: Bringing order into text. In Proceedings of the 2004 conference on empirical methods in natural language processing. 404–411.
- Michael J. Muller and Sandra Kogan . 2012 . Grounded Theory Method in Human-Computer Interaction and Computer-Supported Cooperative Work. In The Human–Computer Interaction Handbook (3 ed.). CRC Press . Num Pages: 21. Michael J. Muller and Sandra Kogan. 2012. Grounded Theory Method in Human-Computer Interaction and Computer-Supported Cooperative Work. In The Human–Computer Interaction Handbook (3 ed.). CRC Press. Num Pages: 21.
- 10.1162/089120102762671927 · DOI · Paper page
- Hariharan Subramonyam , Colleen Seifert , Priti Shah , and Eytan Adar . 2020. TexSketch: Active Diagramming through Pen-and-Ink Annotations . Association for Computing Machinery , New York, NY, USA , 1–13. https://doi.org/10.1145/3313831.3376155 10.1145/3313831.3376155 Hariharan Subramonyam, Colleen Seifert, Priti Shah, and Eytan Adar. 2020. TexSketch: Active Diagramming through Pen-and-Ink Annotations. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376155 · DOI · Paper page
- 10.1007/978-3-540-89454-4_5 · DOI
- Pradyumna Tambwekar Murtaza Dhuliawala Lara J. Martin Animesh Mehta Brent Harrison and Mark O. Riedl. 2018. Controllable Neural Story Plot Generation via Reinforcement Learning. arxiv:1809.10736 [cs.CL] Pradyumna Tambwekar Murtaza Dhuliawala Lara J. Martin Animesh Mehta Brent Harrison and Mark O. Riedl. 2018. Controllable Neural Story Plot Generation via Reinforcement Learning. arxiv:1809.10736 [cs.CL] · DOI · Paper page
- 10.1145/3343413.3377971 · DOI · Paper page
- L. Danielle Tully . 2019 . Reverse Outlines: Fueling Revision & Preparing for Writing Conferences . The Second Draft 32 , 2 (2019), 6 . https://ssrn.com/abstract=3465807 L. Danielle Tully. 2019. Reverse Outlines: Fueling Revision & Preparing for Writing Conferences. The Second Draft 32, 2 (2019), 6. https://ssrn.com/abstract=3465807
- 10.1145/2851581.2856472 · DOI
- 10.1145/3027063.3027066 · DOI
- 10.1145/3472749.3474765 · DOI · Paper page
- Harriet Salatas Waters and Wolfgang Schneider. 2009. Metacognition Strategy Use and Instruction. Guilford Press. Harriet Salatas Waters and Wolfgang Schneider. 2009. Metacognition Strategy Use and Instruction. Guilford Press.
- Daijin Yang , Yanpeng Zhou , Zhiyuan Zhang , and Toby Jia-Jun Li . 2022 . AI as an Active Writer: Interaction strategies with generated text in human-AI collaborative fiction writing . In IUI 2022 Workshop on Human-AI Co-Creation with Generative Models (HAI-GEN 2022). 10. Daijin Yang, Yanpeng Zhou, Zhiyuan Zhang, and Toby Jia-Jun Li. 2022. AI as an Active Writer: Interaction strategies with generated text in human-AI collaborative fiction writing. In IUI 2022 Workshop on Human-AI Co-Creation with Generative Models (HAI-GEN 2022). 10.
- Demet Yaylı . 2012 . Tracing the benefits of self annotation in genre-based writing . The Journal of Language Learning and Teaching 2 , 1 (2012), 45 – 58 . Demet Yaylı. 2012. Tracing the benefits of self annotation in genre-based writing. The Journal of Language Learning and Teaching 2, 1 (2012), 45–58.
- 10.1145/3332165.3347924 · DOI · Paper page
Cited by
AI literacy and its implications for prompt engineering strategies
Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100225 · Cited by 368
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2023) · arXiv · doi:10.48550/arxiv.2303.03283 · Cited by 284
Self-citationCo-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265
Self-citationDraxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3637875 · Cited by 186
Self-citationSuh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
A Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
“Understanding age is important when tailoring systems to accommodate the developmental and cognitive characteristics of users across a wide age spectrum, ranging from young, pre-literate children [270] to adolescents [89, 216].”
InfluentialSelf-citationGenerative Echo Chamber? Effect of LLM-Powered Search Systems on Diverse Information Seeking
Sharma, N., Liao, Q. V., & Xiao, Z. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642459 · Cited by 132
“…applications of LMs include code generation as programming assistance [55, 57, 65], various forms of writing assistance such as next sentence generation [25, 31], summarization of documents [10], rewriting [69], and metaphor generation [20], as well as chatbots [44, 66] and social agents [47].”
BackgroundZhang, Z., Gao, J., Dhaliwal, R. S., & Li, T. J.-J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606800 · Cited by 108
Wan, Q., Hu, S., Zhang, Y., Wang, P., Wen, B., & Lu, Z. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637361 · Cited by 88
Writer-Defined AI Personas for On-Demand Feedback Generation
Benharrak, K., Zindulka, T., Lehmann, F., Heuer, H., & Buschek, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642406 · Cited by 63
Self-citationA Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
Gao, J., Gebreegziabher, S. A., Choo, K. T. W., Li, T. J.-J., Perrault, S. T., & Malone, T. W. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650786 · Cited by 57
DATATALES: Investigating the use of Large Language Models for Authoring Data-Driven Articles
Sultanum, N., & Srinivasan, A. (2023) · 2023 IEEE Visualization and Visual Analytics (VIS) · doi:10.1109/vis54172.2023.00055 · Cited by 52
“Beyond data analysis overview, these summaries could also allow for quicker inspection of new stories, faster recall of past stories, and support revisions of a master draft via reverse outlining [4,11].”
BackgroundSarkar, A. (2023) · Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work · doi:10.1145/3596671.3597650 · Cited by 50
Hoque, M. N., Mashiat, T., Ghai, B., Shelton, C. D., Chevalier, F., Kraus, K., & Elmqvist, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641895 · Cited by 48
“One example is DramatVis Personae (DVP) [32], a visualization system for mitigating nuanced social biases in creative writing.”
BackgroundFigurA11y: AI Assistance for Writing Scientific Alt Text
Singh, N., Wang, L. L., & Bragg, J. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645212 · Cited by 42
“Large language models (LLMs) have recently shown promise in providing contextual suggestions for diverse writing and revision tasks [8, 10, 23].”
BackgroundRambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
Lin, S., Warner, J., Zamfirescu-Pereira, J. D., Lee, M. G., Jain, S., Cai, S., Lertvittayakumjorn, P., Huang, M. X., Zhai, S., Hartmann, B., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642217 · Cited by 39
'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models
Hwang, A. H.-C., Liao, Q. V., Blodgett, S. L., Olteanu, A., & Trischler, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711020 · Cited by 42
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
Arakawa, R., Yakura, H., & Goto, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581133 · Cited by 29
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
“These processes operate within a task environment that includes the rhetorical problem and the emerging text, drawing upon the writer’s long-term memory for topic knowledge and audience awareness.”
Tang, L., Shen, K., Le, H., Shen, Y., Tan, S., Zhao, Y., Juelich, T., Li, X., Gašević, D., & Fan, Y. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13036 · Cited by 25
Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
Kim, T., Han, H., Adar, E., Kay, M., & Chung, J. J. Y. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642529 · Cited by 20
“For example, generating a summarization of the user’s writing to provide an ex-ternal viewpoint can be one approach [24].”
BackgroundCao, Y., Huang, Y., Truong, A., Shin, H. V., & Xia, H. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713401 · Cited by 16
Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks
Ding, Z., & Chan, J. (2023) · arXiv · doi:10.48550/arxiv.2303.06430 · Cited by 9
“Previous research has indicated that Large language models (LLMs) can effectively handle well-defined, content curation tasks such as text summarization [9, 15], content refinement [17], and code explanation [18, 19].”
BackgroundCoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents
Wan, R., Gebreegziabher, S. A., Li, T. J.-J., & Badillo-Urquiola, K. (2024) · Creativity and Cognition · doi:10.1145/3635636.3664260 · Cited by 9
Chen, Y., Xiao, Y., Zinat, K. T., Yamashita, N., Gao, G., & Liu, Z. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713693 · Cited by 2
Rambler in the Wild: A Diary Study of LLM-Assisted Writing With Speech
Yang, X., Li, W., Lee, M. G., Li, Z., Zamfirescu-Pereira, J. D., & Liu, C. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3706676 · Cited by 1
Metadata
- Authors
- Dang, H., Benharrak, K., Lehmann, F., & Buschek, D.
- Venue
- Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2022-10-28
- Pages
- 1-13
- OpenAlex
- W4292760860
- Cited by
- 84
- References
- 18
- FWCI
- 15.44
- Type
- conference paper
- Language
- en
- Open access
- green
- Funders
- Bavarian State Ministry of Science and the Arts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.