The DOI matches its Crossref record; 238 of the 240 references it cites were found in a registry or an index, and 1 are not checked yet.
A Design Space for Intelligent and Interactive Writing Assistants
Open accessAbstract
In our era of rapid technological advancement, the research landscape for writing assistants has become increasingly fragmented across various research communities. We seek to address this challenge by proposing a design space as a structured way to examine and explore the multidimensional space of intelligent and interactive writing assistants. Through community collaboration, we explore five aspects of writing assistants: task, user, technology, interaction, and ecosystem. Within each aspect, we define dimensions and codes by systematically reviewing 115 papers, while leveraging the expertise of researchers in various disciplines. Our design space aims to offer researchers and designers a practical tool to navigate, comprehend, and compare the various possibilities of writing assistants, and aid in the design of new writing assistants.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Based on this review and prior literature [35], we identified three interface metaphor archetypes that were the most prevalent: tool-like, agentic, and magic.”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Lee et al. [74] identified a direct correlation between self-reported ownership and the proportion of user-written versus AI-generated text.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [74]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Support for planning takes the form of generative ideation, usually presented as suggestions [74,135], although some systems have a more equal and collaborative storytelling focus that weaves the AI ideas into the story text [70,92].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [74]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Previous work has identified agency and ownership as key factors in how writers experience AI co-writing [35]”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Based on a review of prior literature, Lee et al. described three interaction metaphors for AI co-writing systems.”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“In the domain of AI co-writing systems, interface metaphors have also been found to impact the types of interactions that users expect to encounter.”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Magic-like interfaces , present in nine systems, did not fall along the Tool-Hybrid-Agent spectrum described by Lee et al. [35].”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Lee et al. (2024) emphasized that the effectiveness of a writing assistant often depends on how well it aligns with a user's specific needs.”
From Ink and algorithm: Exploring temporal dynamics in generative AI ‐assisted writing (2026) · cites this paper as Lee et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Lee et al. (2024) categorized the outputs of writing assistants into three types: analysis, generation and proposal.”
From Ink and algorithm: Exploring temporal dynamics in generative AI ‐assisted writing (2026) · cites this paper as Lee et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“However, how writers' relationships to systems evolve through extended use (Lee et al., 2024), especially in the context of interactions with GAI tools, remains underexplored.”
From Ink and algorithm: Exploring temporal dynamics in generative AI ‐assisted writing (2026) · cites this paper as Lee et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 1×
“To highlight a few notable trends, we see audience is under-represented compared to the other task dimensions, suggesting future work may want to more explicitly consider who is the audience of a piece of writing. overall, as well as relative to other technology dimensions, suggesting that there…”
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 1×
“To highlight a few notable trends, we see audience is under-represented compared to the other task dimensions, suggesting future work may want to more explicitly consider who is the audience of a piece of writing. overall, as well as relative to other technology dimensions, suggesting that there…”
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Self-citationBERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
The design space of wireless sensor networks
Römer, K., & Mattern, F. (2004) · IEEE Wireless Communications · doi:10.1109/mwc.2004.1368897 · Cited by 1,514 · cited 1×
“Design spaces are taxonomies that present critical aspects of a design [32, 33, 166, 178, 214] with three main uses.”
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
MIS problems and failures: A socio- technical perspective
Bostrom, R. P., & Heinen, J. S. (1977) · MIS Quarterly · doi:10.2307/248710 · Cited by 1,329 · cited 1×
“The sociotechnical systems perspective is an interdisciplinary approach [19, 145, 217], widely used in various research fields like HCI [140, 151] and IS [39, 259] to analyze complex interactions involving technology, workflow design, and organizational changes.”
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274 · cited 1×
“Some work studied how writers leverage different prompting strategies for LMs [58, 269] and introduced novel interaction paradigms to steer LM outputs, such as visual sketching [45].”
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219
On the Properties of Neural Machine Translation: Encoder-Decoder ApproachesPreprint
Cho, K., van Merriënboer, B., Bahdanau, D., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.1259 · Cited by 1,112 · cited 1×
“…consider who is the audience of a piece of writing. overall, as well as relative to other technology dimensions, suggesting that there may currently not be enough consideration of the economic and computational costs of training and using recent large models in the context of writing assistants.”
A cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025 · cited 4×
“For example, 3 Note that our writing stages differ from the cognitive processes of writing proposed by Flower and Hayes [73], despite the similarity in terminology (they use “planning,” “translating,” and “reviewing” to describe writing subprocesses).”
InfluentialBLEURT: Learning Robust Metrics for Text Generation
Sellam, T., Das, D., & Parikh, A. P. (2020) · arXiv · doi:10.48550/arxiv.2004.04696 · Cited by 1,005 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
BLEURT: Learning Robust Metrics for Text Generation
Sellam, T., Das, D., & Parikh, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.704 · Cited by 1,005
Brynjolfsson, E., Li, D., & Raymond, L. (2023) · National Bureau of Economic Research · doi:10.3386/w31161 · Cited by 995
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839 · cited 1×
“System is meant to evoke a sense of another agent acting on the interface or data Tool System is presented as tools, where there is not a sense of interacting with another agent Hybrid System draws from both “agent” and “tool” metaphors”
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
ChatGPT and large language models in academia: opportunities and challenges
Meyer, J. G., Urbanowicz, R. J., Martin, P. C. N., O’Connor, K., Li, R., Peng, P.-C., Bright, T. J., Tatonetti, N., Won, K. J., Gonzalez-Hernandez, G., et al. (2023) · BioData Mining · doi:10.1186/s13040-023-00339-9 · Cited by 569
Writing research and the writer.
Hayes, J. R., & Flower, L. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.10.1106 · Cited by 550 · cited 1×
“These systems further evolved to support the writer’s cognitive process , or the distinctive thought processes the writers go through when composing writings [73, 101].”
Regulating ChatGPT and other Large Generative AI Models
Hacker, P., Engel, A., & Mauer, M. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594067 · Cited by 466
Agreement and Information in the Reliability of Coding
Krippendorff, K. (2011) · Communication Methods and Measures · doi:10.1080/19312458.2011.568376 · Cited by 451
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“Outside of writing assistants, researchers studied various aspects of creativity support tools with the goal of comprehensive understanding of the space [44, 79].”
Writing Technology: Studies in the Materiality of Literacy
Haas, C. (1997) · College Composition and Communication · doi:10.2307/358463 · Cited by 403
HCI Theory: Classical, Modern, and Contemporary
Rogers, Y. (2012) · HCI Theory · doi:10.2200/s00418ed1v01y201205hci014 · Cited by 387 · cited 1×
“This is especially important in sensitive contexts, such as education, counseling, or healthcare.”
Wordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374
The Meteor metric for automatic evaluation of machine translation
Lavie, A., & Denkowski, M. (2009) · Machine Translation · doi:10.1007/s10590-009-9059-4 · Cited by 351 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345 · cited 3×
“Outputs that are coherent in terms of grammar, content, and tone”
Self-citationHuman heuristics for AI-generated language are flawed
Jakesch, M., Hancock, J. T., & Naaman, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2208839120 · Cited by 342 · cited 1×
“Alternatively, the output may be generated from user input in a deterministic way, in writing systems that do not use AI and/or prefer rule-based automation [12, 138, 216].”
A morphological analysis of the design space of input devices
Card, S. K., Mackinlay, J. D., & Robertson, G. G. (1991) · ACM Transactions on Information Systems · doi:10.1145/123078.128726 · Cited by 337 · cited 1×
“Design spaces are taxonomies that present critical aspects of a design [32, 33, 166, 178, 214] with three main uses.”
The Computer as a Tool for Learning Through Reflection
Collins, A., & Brown, J. S. (1988) · Springer eBooks · doi:10.1007/978-1-4684-6350-7_1 · Cited by 298
All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text
Clark, E., August, T., Serrano, S., Haduong, N., Gururangan, S., & Smith, N. A. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.565 · Cited by 290 · cited 1×
“The most common mechanism is to use text formatting such”
Self-citationCo-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265 · cited 9×
“…new writing assistants are being introduced at an increasingly fast pace, there are growing concerns that we lack a comprehensive understanding of when and in what ways it is desirable to use these writing assistants in order to avoid potential unforeseen consequences or ethical issues [121, 171].”
InfluentialSelf-citationCreative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172983 · Cited by 257 · cited 3×
“Writing assistants can play supportive roles in this process by assisting with science writing [133] and generating suggestions based on keywords [47].”
Mirowski, P., Mathewson, K. W., Pittman, J., & Evans, R. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581225 · Cited by 240 · cited 5×
“The most common mechanism is to use text formatting such”
InfluentialThe design space of input devices
Card, S. K., Mackinlay, J. D., & Robertson, G. G. (1990) · doi:10.1145/97243.97263 · Cited by 238 · cited 1×
“Design spaces are taxonomies that present critical aspects of a design [32, 33, 166, 178, 214] with three main uses.”
Pre-Writing the Stage of Discovery in the Writing Process
Rohman, D. G. (1965) · College Composition and Communication · doi:10.2307/354885 · Cited by 210 · cited 1×
“Rather, our writing stages resemble (yet are not the same as) the stage models of writing, such as Britton et al. [21], Rohman [213], that model the growth of the written artifact rather than the inner workings of the writer.”
AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap
Liao, Q. V., & Wortman Vaughan, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.8036d03b · Cited by 210
AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap
Liao, Q. V., & Vaughan, J. W. (2023) · arXiv · doi:10.48550/arxiv.2306.01941 · Cited by 209
TaleBrush: Sketching Stories with Generative Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501819 · Cited by 206
Self-citationText summarization in the biomedical domain: A systematic review of recent research
Mishra, R., Bian, J., Marcelo Fiszman, B., Weir, C. R., Jonnalagadda, S., Mostafa, J., & Fiol, G. D. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.06.009 · Cited by 201 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G. S., Lukacs, L., Ganea, M., Young, P., et al. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939801 · Cited by 200 · cited 1×
“Beyond traits inherent to users, such as primary language and culture, such accommodations should consider user preferences or capabilities like writing expertise and technical proficiency, which may widely vary across educational, socioeconomic and neurocognitive backgrounds.”
Jakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190 · cited 2×
“The most common mechanism is to use text formatting such”
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188 · cited 1×
“The most common mechanism is to use text formatting such”
Self-citationEnabling Language Models to Fill in the Blanks
Donahue, C., Lee, M., & Liang, P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.225 · Cited by 173 · cited 1×
“For example, for a writing assistant that provides suggestions on filling in between already written story events [62, 86], the system would need to grasp what happened in the preceding and subsequent events in order to coherently connect them.”
Self-citationGmail Smart Compose: Real-Time Assisted Writing
Chen, M. X., Lee, B. N., Bansal, G., Cao, Y., Zhang, S., Lu, J., Tsay, J., Wang, Y., Dai, A. M., Chen, Z., et al. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330723 · Cited by 169 · cited 2×
“This is especially important in sensitive contexts, such as education, counseling, or healthcare.”
Encode, Tag, Realize: High-Precision Text Editing
Malmi, E., Krause, S., Rothe, S., Mirylenka, D., & Severyn, A. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1510 · Cited by 164 · cited 2×
“…210, 211, 216, 220, 229, 247, 252, 255, 257, 262, 268] • NLP : [3, 9, 11, 26, 29, 35, 37, 38, 43, 48, 54, 56, 68, 77, 77, 88, 93, 96–98, 105, 111, 112, 118, 124, 138, 146, 157, 160–162, 173, 179, 188, 199, 207, 221, 223, 228, 230–232, 238, 241, 246, 250, 251, 254, 258, 264, 267, 271, 272, 275–277]”
Sparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161
Self-citationAcaWriter: A learning analytics tool for formative feedback on academic writing
Knight, S., Shibani, A., Abel, S., Gibson, A., & Ryan, P. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.06 · Cited by 151
Self-citationThe Curse of Recursion: Training on Generated Data Makes Models Forget
Shumailov, I., Shumaylov, Z., Zhao, Y., Gal, Y., Papernot, N., & Anderson, R. (2023) · arXiv · doi:10.48550/arxiv.2305.17493 · Cited by 151 · cited 1×
“The most common mechanism is to use text formatting such”
WatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding
Gordon, M., Ouyang, T., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858242 · Cited by 150 · cited 1×
“Another ethical consideration is accommodating the needs and preferences of diverse users, including those from differently-abled, under-represented, and marginalized communities [1, 14, 103].”
Metaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · cited 7×
“An intelligent writing assistant within this context can provide support for diverse creative endeavors, including writing lyrics [257], crafting metaphors [84], and offering inspiration and assistance for storytelling [187, 220].”
InfluentialSelf-citationArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation Skills
Wambsganss, T., Kueng, T., Soellner, M., & Leimeister, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445781 · Cited by 138 · cited 1×
“Outputs that are coherent in terms of grammar, content, and tone”
Vertanen, K., Memmi, H., Emge, J., Reyal, S., & Kristensson, P. O. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702135 · Cited by 134 · cited 1×
“Beyond traits inherent to users, such as primary language and culture, such accommodations should consider user preferences or capabilities like writing expertise and technical proficiency, which may widely vary across educational, socioeconomic and neurocognitive backgrounds.”
Social Dynamics of AI Support in Creative Writing
Gero, K. I., Long, T., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580782 · Cited by 129 · cited 2×
“However, such a study has not yet been conducted specifically on writing assistants.”
Self-citationEffects of Language Modeling and its Personalization on Touchscreen Typing Performance
Fowler, A., Partridge, K., Chelba, C., Bi, X., Ouyang, T., & Zhai, S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702503 · Cited by 127 · cited 2×
“Additionally, uses of writing assistants have begun to affect labor markets [24, 69, 182, 183], signifying substantial societal consequences and evidencing the need for monitoring such effects.”
The Writing Pal Intelligent Tutoring System: Usability Testing and Development
Roscoe, R. D., Allen, L. K., Weston, J. L., Crossley, S. A., & McNamara, D. S. (2014) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2014.09.002 · Cited by 123 · cited 1×
“What is the interaction metaphor for the system?”
Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119 · cited 3×
“The most common mechanism is to use text formatting such”
Biermann, O. C., Ma, N. F., & Yoon, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533506 · Cited by 116 · cited 2×
“The demographic profile of users reflects a broad spectrum of their characteristics, highlighting the diversity inherent across various groups of users.”
Compositional Sequence Labeling Models for Error Detection in Learner Writing
Rei, M., & Yannakoudakis, H. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1112 · Cited by 111 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Gender-Inclusiveness Personas vs. Stereotyping
Hill, C. G., Haag, M., Oleson, A., Mendez, C., Marsden, N., Sarma, A., & Burnett, M. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025609 · Cited by 110 · cited 1×
“System is meant to evoke a sense of another agent acting on the interface or data Tool System is presented as tools, where there is not a sense of interacting with another agent Hybrid System draws from both “agent” and “tool” metaphors”
Accessibility in Software Practice: A Practitioner’s Perspective
Bi, T., Xia, X., Lo, D., Grundy, J., Zimmermann, T., & Ford, D. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3503508 · Cited by 109
Buschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108 · cited 7×
“• Technology : Vipul Raheja (team lead), Subhashini Venu-gopalan (team lead), Seyed Parsa Neshaei (team member), Disha Shrivastava (team member), Antoine Bosselut (advisor), Sherol Chen (advisor), Joonsuk Park (advisor) • Interaction : Hua Shen (team lead), Thiemo Wambsganss (team lead), Sarah Sterman (team member), T…”
InfluentialSelf-citationBixler, R., & D'Mello, S. K. (2013) · International Conference on Intelligent User Interfaces · doi:10.1145/2449396.2449426 · Cited by 106 · cited 2×
“Emotion referstotheuser’semotionalstatebefore,during,andafterinter-actingwiththewritingassistant[16,191,255].”
RewriteLM: An Instruction-Tuned Large Language Model for Text RewritingPreprint
Shu, L., Luo, L., Hoskere, J., et al. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2305.15685 · Cited by 106 · cited 2×
“For future work, we hope to continue to refine our dimensions and codes and code commercial writing assistants to further understand the gaps and opportunities in the current research landscape and suggest possible directions for future research and development.”
A Cost-Benefit Study of Text Entry Suggestion Interaction
Quinn, P., & Zhai, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858305 · Cited by 105 · cited 1×
“Another ethical consideration is accommodating the needs and preferences of diverse users, including those from differently-abled, under-represented, and marginalized communities [1, 14, 103].”
Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
Dang, H., Benharrak, K., Lehmann, F., & Buschek, D. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545672 · Cited by 103 · cited 6×
“Understanding age is important when tailoring systems to accommodate the developmental and cognitive characteristics of users across a wide age spectrum, ranging from young, pre-literate children [270] to adolescents [89, 216].”
InfluentialSelf-citationSociotechnical Approaches to the Study of Information Systems
Sawyer, S., & Jarrahi, M. (2014) · Computing Handbook, Third Edition · doi:10.1201/b16768-7 · Cited by 103 · cited 1×
“The sociotechnical systems perspective is an interdisciplinary approach [19, 145, 217], widely used in various research fields like HCI [140, 151] and IS [39, 259] to analyze complex interactions involving technology, workflow design, and organizational changes.”
STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation
Akoury, N., Wang, S., Whiting, J., Hood, S., Peng, N., & Iyyer, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.525 · Cited by 102 · cited 1×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Self-citationThe Intersection of Users, Roles, Interactions, and Technologies in Creativity Support Tools
Chung, J. J. Y., He, S., & Adar, E. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462050 · Cited by 102 · cited 1×
“However, such a study has not yet been conducted specifically on writing assistants.”
Self-citationDunlop, M., & Levine, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208659 · Cited by 99 · cited 1×
“Lastly, there are many under-represented or under-explored dimensions in the design space (Section 5.2).”
InfluentialCoEdIT: Text Editing by Task-Specific Instruction TuningPreprint
Raheja, V., Kumar, D., Koo, R., & Kang, D. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2305.09857 · Cited by 97
Self-citationPea, R. D. (2018) · Psychology Press eBooks · doi:10.4324/9780203764411-6 · Cited by 95
Self-citationWill AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
Liu, Y., Mittal, A., Yang, D., & Bruckman, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517731 · Cited by 92 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Thiruvathukal, G. K., Lu, Y.-H., Kim, J., Chen, Y., & Chen, B. (2022) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003162810 · Cited by 91
Predictive text encourages predictable writing
Arnold, K. C., Chauncey, K., & Gajos, K. Z. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377523 · Cited by 87 · cited 8×
“The most common mechanism is to use text formatting such”
InfluentialHelp me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing
Chakrabarty, T., Padmakumar, V., & He, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.460 · Cited by 86
Educator perspectives on learning analytics in classroom practice
Shibani, A., Knight, S., & Buckingham Shum, S. (2020) · The Internet and Higher Education · doi:10.1016/j.iheduc.2020.100730 · Cited by 86 · cited 1×
“What is the interaction metaphor for the system?”
Evaluation of keystroke savings across five assistive communication technologies
Higginbotham, D. J. (1992) · Augmentative and Alternative Communication · doi:10.1080/07434619212331276303 · Cited by 84 · cited 1×
“Additionally, uses of writing assistants have begun to affect labor markets [24, 69, 182, 183], signifying substantial societal consequences and evidencing the need for monitoring such effects.”
Dang, H., Goller, S., Lehmann, F., & Buschek, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580969 · Cited by 83 · cited 8×
“Finally, most ecosystem dimensions are, as previously noted, under-represented, representing a rich area of future study as writing assistants become more widely adopted and the circumstance and context of their adoption becomes increasingly important.”
InfluentialSelf-citationSeq2Edits: Sequence Transduction Using Span-level Edit Operations
Stahlberg, F., & Kumar, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.418 · Cited by 83 · cited 2×
“…210, 211, 216, 220, 229, 247, 252, 255, 257, 262, 268] • NLP : [3, 9, 11, 26, 29, 35, 37, 38, 43, 48, 54, 56, 68, 77, 77, 88, 93, 96–98, 105, 111, 112, 118, 124, 138, 146, 157, 160–162, 173, 179, 188, 199, 207, 221, 223, 228, 230–232, 238, 241, 246, 250, 251, 254, 258, 264, 267, 271, 272, 275–277]”
Peng, Z., Guo, Q., Tsang, K. W., & Ma, X. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376695 · Cited by 81 · cited 6×
“Understanding age is important when tailoring systems to accommodate the developmental and cognitive characteristics of users across a wide age spectrum, ranging from young, pre-literate children [270] to adolescents [89, 216].”
InfluentialRecognizing syntactic errors in the writing of second language learners
Schneider, D., & McCoy, K. F. (1998) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/980691.980765 · Cited by 79 · cited 3×
“A number of works on writing assistants in the early 2000s [26, 157, 192, 221] used purely human-labeled data to develop rule-based methods [26] or train statistical models [10, 192], which were often used to detect errors [26, 192] or suggest corrections.”
InfluentialCotos, E., Huffman, S. R., & Link, S. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.07 · Cited by 79 · cited 1×
“While there were no corpus papers documenting the embedding of writing assistants into established work practices and conventions, we see this beginning to happen in K-12 [215] and higher education [52, 139].”
IntroAssist: A Tool to Support Writing Introductory Help Requests
Hui, J. S., Gergle, D., & Gerber, E. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173596 · Cited by 76 · cited 4×
“Meanwhile, persuasive writing aims to convince or influence the audience through text [2, 121], requiring high readability [129] and conciseness [115].”
InfluentialLouis, A. P., & Nenkova, A. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00232 · Cited by 76
FELIX: Flexible Text Editing Through Tagging and Insertion
Mallinson, J., Severyn, A., Malmi, E., & Garrido, G. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.111 · Cited by 76
Osone, H., Lu, J.-L., & Ochiai, Y. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3450391 · Cited by 74 · cited 2×
“An intelligent writing assistant within this context can provide support for diverse creative endeavors, including writing lyrics [257], crafting metaphors [84], and offering inspiration and assistance for storytelling [187, 220].”
Park, S., Thieme, A., Han, J., Lee, S., Rhee, W., & Suh, B. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462143 · Cited by 72 · cited 6×
“We choose this approach because we find it more during the idea generation stage, writers brainstorm and develop concepts.”
InfluentialOn Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69 · cited 1×
“Lastly, there are many under-represented or under-explored dimensions in the design space (Section 5.2).”
InfluentialIdentifying Semantic Edit Intentions from Revisions in Wikipedia
Yang, D., Halfaker, A., Kraut, R. E., & Hovy, E. H. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1213 · Cited by 68 · cited 2×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
A socio-technical perspective of mobile work
Chen, L., & Nath, R. (2008) · Information Knowledge Systems Management · doi:10.3233/iks-2008-00118 · Cited by 64 · cited 1×
“The sociotechnical systems perspective is an interdisciplinary approach [19, 145, 217], widely used in various research fields like HCI [140, 151] and IS [39, 259] to analyze complex interactions involving technology, workflow design, and organizational changes.”
Plan, Write, and Revise: an Interactive System for Open-Domain Story Generation
Goldfarb-Tarrant, S., Feng, H., & Peng, N. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4016 · Cited by 63 · cited 3×
“Another common purpose is telling a story; narrative applies to tasks whose goal is to convey an account of real [90] and imagined experiences [88, 109, 211].”
CoEdIT: Text Editing by Task-Specific Instruction Tuning
Raheja, V., Kumar, D., Koo, R., & Kang, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.350 · Cited by 62
Self-citationKim, J., Suh, S., Chilton, L. B., & Xia, H. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595996 · Cited by 61 · cited 7×
“Interaction metaphors shape how the user relates to the system.”
InfluentialEvaluating Human-Language Model Interaction
Lee, M., Srivastava, M., Hardy, A., Thickstun, J., Durmus, E., Paranjape, A., Gerard-Ursin, I., Li, X. L., Ladhak, F., Rong, F., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.09746 · Cited by 61
Self-citationAutomated Evaluation of Writing – 50 Years and Counting
Klebanov, B. B., & Madnani, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.697 · Cited by 60
Story Centaur: Large Language Model Few Shot Learning as a Creative Writing Tool
Swanson, B., Mathewson, K. W., Pietrzak, B., Chen, S., & Dinalescu, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-demos.29 · Cited by 59 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Self-citationBeyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity SystemsPreprint
Lin, Z., Ehsan, U., Agarwal, R., Dani, S., Vashishth, V., & Riedl, M. O. (2023) · ICCC · doi:10.48550/arxiv.2305.07465 · Cited by 57 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Automated Assistance for Creative Writing with an RNN Language Model
Roemmele, M., & Gordon, A. S. (2018) · Companion Proceedings of the 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3180308.3180329 · Cited by 55 · cited 4×
“Another common purpose is telling a story; narrative applies to tasks whose goal is to convey an account of real [90] and imagined experiences [88, 109, 211].”
InfluentialEmpowering Expression for Users with Aphasia through Constrained Creativity
Neate, T., Roper, A., Wilson, S., & Marshall, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300615 · Cited by 53 · cited 1×
“The most common mechanism is to use text formatting such”
A writer's collaborative assistant
Babaian, T., Grosz, B. J., & Shieber, S. M. (2002) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/502716.502722 · Cited by 53 · cited 5×
“The most common mechanism is to use text formatting such”
InfluentialChapter 7: Cognitive Technologies for Writing
Pea, R. D., & Kurland, D. M. (1987) · Review of Research in Education · doi:10.2307/1167314 · Cited by 53 · cited 2×
“Some technologies long precede the appearance of computers, such as clay tablets known as cuneiform writing [184, 219], and in the 19th and 20th century, typewriter technologies [194], each of which dramatically changed the way we produce written artifacts.”
Self-citationCreative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers
Ippolito, D., Yuan, A., Coenen, A., & Burnam, S. (2022) · arXiv · doi:10.48550/arxiv.2211.05030 · Cited by 52
Do Language Models Plagiarize?
Lee, J., Le, T., Chen, J., & Lee, D. (2023) · Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543507.3583199 · Cited by 51
PEER: A Collaborative Language Model
Schick, T., Dwivedi-Yu, J., Jiang, Z., Petroni, F., Lewis, P., Izacard, G., You, Q., Nalmpantis, C., Grave, E., & Riedel, S. (2022) · arXiv · doi:10.48550/arxiv.2208.11663 · Cited by 49
Bhat, A., Agashe, S., Oberoi, P., Mohile, N., Jangir, R., & Joshi, A. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584060 · Cited by 47 · cited 5×
“The most common mechanism is to use text formatting such”
InfluentialSelf-citationDesign and Evaluation of a Social Media Writing Support Tool for People with Dyslexia
Wu, S., Reynolds, L., Li, X., & Guzmán, F. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300746 · Cited by 47 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Effective Interfaces for Student-Driven Revision Sessions for Argumentative Writing
Afrin, T., Kashefi, O., Olshefski, C. A., Litman, D., Hwa, R., & Godley, A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445683 · Cited by 44 · cited 3×
“Meanwhile, persuasive writing aims to convince or influence the audience through text [2, 121], requiring high readability [129] and conciseness [115].”
“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions
Robertson, R. E., Olteanu, A., Diaz, F., Shokouhi, M., & Bailey, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445557 · Cited by 43
WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse
Faruqui, M., Pavlick, E., Tenney, I., & Das, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1028 · Cited by 43 · cited 2×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Automated Japanese essay scoring system based on articles written by experts
Ishioka, T., & Kameda, M. (2006) · International Conference on Computational Linguistics · doi:10.3115/1220175.1220205 · Cited by 42
Schmitt, O., & Buschek, D. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465253 · Cited by 41 · cited 7×
“An intelligent writing assistant within this context can provide support for diverse creative endeavors, including writing lyrics [257], crafting metaphors [84], and offering inspiration and assistance for storytelling [187, 220].”
InfluentialSelf-citationEdiT5: Semi-Autoregressive Text Editing with T5 Warm-Start
Mallinson, J., Adamek, J., Malmi, E., & Severyn, A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.156 · Cited by 41
The inviscid text entry rate and its application as a grand goal for mobile text entry
Kristensson, P. O., & Vertanen, K. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628405 · Cited by 39 · cited 1×
“We believe it is important to recognize the interconnection of dimensions and codes across the five aspects and their trade-offs, and utilize them as a reference when designing writing assistants.”
Chollampatt, S., Hoang, D. T., & Ng, H. T. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1195 · Cited by 39 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Human Factors and Behavioral Science: TheUNIX™ Writer's Workbench Software: Rationale And Design
Macdonald, N. H. (1983) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1983.tb03520.x · Cited by 36 · cited 1×
“Examples of such support include providing text analysis [78, 164] and text-planning support [50] (see Appendix C for more examples).”
Visualize Before You Write: Imagination-Guided Open-Ended Text Generation
Zhu, W., Yan, A., Lu, Y., Xu, W., Wang, X. E., Eckstein, M. P., & Wang, W. Y. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.5 · Cited by 35
LyriSys: An Interactive Support System for Writing Lyrics Based on Topic Transition
Watanabe, K., Matsubayashi, Y., Inui, K., Nakano, T., Fukayama, S., & Goto, M. (2017) · Proceedings of the 22nd International Conference on Intelligent User Interfaces · doi:10.1145/3025171.3025194 · Cited by 34 · cited 5×
“An intelligent writing assistant within this context can provide support for diverse creative endeavors, including writing lyrics [257], crafting metaphors [84], and offering inspiration and assistance for storytelling [187, 220].”
InfluentialClaiming success, charting the future
Shneiderman, B. (2011) · interactions · doi:10.1145/2008176.2008180 · Cited by 34 · cited 1×
“We encourage researchers and designers to venture into these overlooked dimensions and offer their innovative ideas and unique insights, contributing to the holistic development of better writing assistants.”
The Design Space of Generative ModelsPreprint
Morris, M. R., Cai, C. J., Holbrook, J., Kulkarni, C. E., & Terry, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.10547 · Cited by 33 · cited 1×
“Design spaces are taxonomies that present critical aspects of a design [32, 33, 166, 178, 214] with three main uses.”
Faltings, F., Galley, M., Hintz, G., Brockett, C., Quirk, C., Gao, J., & Dolan, B. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.414 · Cited by 33 · cited 2×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
How a Stylistic, Machine-Generated Thesaurus Impacts a Writer's Process
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 on Creativity and Cognition · doi:10.1145/3325480.3326573 · Cited by 32 · cited 2×
“Some texts are written to be descriptive in order to convey emotion [255] and provide expressive details, particularly with evocative language [83, 84, 160].”
Self-citationVisual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequences
Hong, X., Sayeed, A., Mehra, K., Demberg, V., & Schiele, B. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00553 · Cited by 32
Understanding Iterative Revision from Human-Written Text
Du, W., Raheja, V., Kumar, D., Kim, Z. M., Lopez, M., & Kang, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.250 · Cited by 32 · cited 2×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Self-citationToward evaluation of writing style
Burstein, J. C., & Wolska, M. A. (2003) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1067807.1067814 · Cited by 31
Lewicki, K., Lee, M. S. A., Cobbe, J., & Singh, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581463 · Cited by 30 · cited 1×
“The sociotechnical systems perspective is an interdisciplinary approach [19, 145, 217], widely used in various research fields like HCI [140, 151] and IS [39, 259] to analyze complex interactions involving technology, workflow design, and organizational changes.”
Self-citationAI Writing Assistants Influence Topic Choice in Self-Presentation
Poddar, R., Sinha, R., Naaman, M., & Jakesch, M. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585893 · Cited by 30 · cited 2×
“Lastly, the personalization of system outputs, which involves adapting to and reflecting an individual’s unique writing style [80], may enhance the user’s writing experience.”
Learning to Model Editing Processes
Reid, M., & Neubig, G. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.280 · Cited by 30
Zarei, N., Chu, S. L., Quek, F., Rao, N. '., & Brown, S. A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376331 · Cited by 30 · cited 1×
“Understanding age is important when tailoring systems to accommodate the developmental and cognitive characteristics of users across a wide age spectrum, ranging from young, pre-literate children [270] to adolescents [89, 216].”
Towards Evaluating Narrative Quality In Student Writing
Somasundaran, S., Flor, M., Chodorow, M., Molloy, H., Gyawali, B., & McCulla, L. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00007 · Cited by 29
The role of centering theory's rough-shift in the teaching and evaluation of writing skills
Miltsakaki, E., & Kukich, K. (2000) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075218.1075270 · Cited by 29
Is the sky pure today? AwkChecker
Park, T., Lank, E., Poupart, P., & Terry, M. A. (2008) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1449715.1449736 · Cited by 27 · cited 4×
“It is this increase that spurred our interest in creating a design space to support the increasing number of researchers and designers working in this space.”
InfluentialChang, Y., Chen, C.-C., Hsieh, Y., Chen, C. C., & Hsu, W. (2015) · doi:10.3115/v1/p15-2127 · Cited by 26
wikiHowToImprove: A Resource and Analyses on Edits in Instructional Texts
Anthonio, T., Bhat, I. A., & Roth, M. (2020) · Language Resources and Evaluation · Cited by 26
A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing
Gero, K., Calderwood, A., Li, C., & Chilton, L. (2022) · Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) · doi:10.18653/v1/2022.in2writing-1.2 · Cited by 25 · cited 1×
“However, such a study has not yet been conducted specifically on writing assistants.”
Self-citation(2019) · doi:10.1145/3359138 · Cited by 25 · cited 1×
“The sociotechnical systems perspective is an interdisciplinary approach [19, 145, 217], widely used in various research fields like HCI [140, 151] and IS [39, 259] to analyze complex interactions involving technology, workflow design, and organizational changes.”
Love in Lyrics: An Exploration of Supporting Textual Manifestation of Affection in Social Messaging
Kim, T., Lee, J. S., Peng, Z., & Ma, X. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359181 · Cited by 24
Adaptive Empathy Learning Support in Peer Review Scenarios
Wambsganss, T., Soellner, M., Koedinger, K. R., & Leimeister, J. M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517740 · Cited by 24 · cited 5×
“Writing assistants at this stage might be used to provide feedback on various aspects of the written text [2, 252].”
InfluentialArgRewrite: A Web-based Revision Assistant for Argumentative Writings
Zhang, F., Hwa, R., Litman, D. J., & Hashemi, H. B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-3008 · Cited by 24 · cited 2×
“BecausepapersonACLAnthology do not have associated keywords, we retrieved any paper that has at least one of the keywords in its title.”
DramatVis Personae: Visual Text Analytics for Identifying Social Biases in Creative Writing
Hoque, M. N., Ghai, B., & Elmqvist, N. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533526 · Cited by 24 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Self-citationHowe, D. C. (2009) · Creativity and Cognition · doi:10.1145/1640233.1640265 · Cited by 24 · cited 2×
“The most common mechanism is to use text formatting such”
Clark, E., & Smith, N. A. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.279 · Cited by 23 · cited 2×
“Writing expertise captures the user’s writingproficiencyorexpertise(e.g.,amateurvs.professionalwriter) intermsofwritingquality[187,188]orgenrespecializations(e.g.,sci-encewritingvs.emailwriting)[85,115].”
Writing Strategies for Science Communication: Data and Computational Analysis
August, T., Kim, L., Reinecke, K., & Smith, N. A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.429 · Cited by 23 · cited 2×
“…of trust in the writing assistant’s ability or perception of its suitability for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s…”
Self-citationToward a Task of Feedback Comment Generation for Writing Learning
Nagata, R. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1316 · Cited by 23 · cited 1×
“…in the writing assistant’s ability or perception of its suitability for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s…”
Reviewriter: AI-Generated Instructions For Peer Review Writing
Su, X., Wambsganß, T., Rietsche, R., Neshaei, S. P., & Kser, T. (2023) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2023.bea-1.5 · Cited by 22 · cited 1×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Self-citationLettersmith: Scaffolding Written Professional Communication Among College Students
Hui, J. S., & Sprouse, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581029 · Cited by 22 · cited 8×
“The text editor is the prevalent interface for AI-assisted writing [58, 223], providing writers with a traditional blank canvas while incorporating a variety of system-driven functionalities such as feedback [114], automated checklists [80], or completion suggestions [121].”
InfluentialRead, Revise, Repeat: A System Demonstration for Human-in-the-loop Iterative Text Revision
Du, W., Kim, Z. M., Raheja, V., Kumar, D., & Kang, D. (2022) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.18653/v1/2022.in2writing-1.14 · Cited by 22 · cited 1×
“Finally, most ecosystem dimensions are, as previously noted, under-represented, representing a rich area of future study as writing assistants become more widely adopted and the circumstance and context of their adoption becomes increasingly important.”
Self-citationThe arText prototype: An automatic system for writing specialized texts
da Cunha, I., March, M. A. M., & Hysa, L. (2017) · Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-3015 · Cited by 22 · cited 1×
“For example, while a general direction might be a target writing format, specific objectives may suggest the inclusion of certain subsections [54, 115] or information [188] that contribute to that overall goal.”
Poetry Machines: Eliciting Designs for Interactive Writing Tools from Poets
Booten, K., & Gero, K. I. (2021) · Creativity and Cognition · doi:10.1145/3450741.3466813 · Cited by 21
Self-citationGonçalves, F., Campos, P., Hanna, J., & Ashby, S. (2015) · Creativity and Cognition · doi:10.1145/2757226.2757236 · Cited by 21 · cited 1×
“The most common mechanism is to use text formatting such”
IGA: An Intent-Guided Authoring Assistant
Sun, S., Zhao, W., Manjunatha, V., Jain, R., Morariu, V. I., Dernoncourt, F., Srinivasan, B. V., & Iyyer, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.483 · Cited by 21 · cited 1×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Liu, T., Zhou, M. Q., Gao, J., Xun, E., & Huang, C. (2000) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075218.1075285 · Cited by 21 · cited 2×
“Likewise, second language writing can be difficult due to unfamiliar spelling and grammar rules [157] as well as vocabulary [112], and writing assistants can help by aiding in translation to ease the difficulty of writing in an unfamiliar language [112, 112, 157, 277].”
Breaking Writer’s Block: Low-cost Fine-tuning of Natural Language Generation Models
Duval, A., Lamson, T., de Kérouara, G. D. L., & Gallé, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-demos.33 · Cited by 20 · cited 2×
“Finally, there are custom designs: for example, a tangible UI that triggers the system by lifting a coffee cup [12], or an exploratory visualization for referencing information which has no user text input [131].”
SonAmi: A Tangible Creativity Support Tool for Productive Procrastination
Belakova, J., & Mackay, W. E. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465250 · Cited by 20 · cited 4×
“Similarly, education level and background of users, whether they are high school students [216] or university graduates [2, 251], indicates varying cognitive and learning competencies, which in turn may influence how users interact with and critically engage in systems.”
InfluentialTowards an intelligent reviewer's assistant
Dong, R., McCarthy, K., O’Mahony, M. P., Schaal, M., & Smyth, B. (2012) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2166966.2166995 · Cited by 20 · cited 2×
“These tasks may suggest the direction of an outcome through writing conventions [192], writing reflection variations [80, 134], or writing format [47, 64], but will not define how the desired outcome should be realized.”
B., C., & March, J. G. (1967) · Revue Française de Sociologie · doi:10.2307/3319872 · Cited by 20
FRUIT: Faithfully Reflecting Updated Information in Text
Iv, R., Passos, A., Singh, S., & Chang, M.-W. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.269 · Cited by 19 · cited 1×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Langsmith: An Interactive Academic Text Revision System
Ito, T., Kuribayashi, T., Hidaka, M., Suzuki, J., & Inui, K. (2020) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2020.emnlp-demos.28 · Cited by 19 · cited 1×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Supporting Novices Author Audio Descriptions via Automatic Feedback
Natalie, R., Tseng, J., Kacorri, H., & Hara, K. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581023 · Cited by 19 · cited 3×
“During the drafting stage, writers may require assistance with thought facilitation or initial drafts [180, 191].”
Using Context to Predict the Purpose of Argumentative Writing Revisions
Zhang, F., & Litman, D. J. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1168 · Cited by 19 · cited 2×
“BecausepapersonACLAnthology do not have associated keywords, we retrieved any paper that has at least one of the keywords in its title.”
Supporting Cognitive and Emotional Empathic Writing of Students
Wambsganß, T., Niklaus, C., Söllner, M., Handschuh, S., & Leimeister, J. M. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.314 · Cited by 18
arXivEdits: Understanding the Human Revision Process in Scientific Writing
Jiang, C., Xu, W., & Stevens, S. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.641 · Cited by 18
Gabriel, R. P., Chen, J., & Nichols, J. W. (2015) · Creativity and Cognition · doi:10.1145/2757226.2757229 · Cited by 18 · cited 4×
“With entertainment as its purpose, a writing task can aim to engage and amuse readers through text, requiring coherent storytelling [133, 174] to engage the audience and may use the structure of the writing itself to convey surprise [80] and pleasure [146, 257].”
InfluentialFan, M., Fan, J., Antle, A. N., Jin, S., Yin, D., & Pasquier, P. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312756 · Cited by 18
Neural-based Chinese Idiom Recommendation for Enhancing Elegance in Essay Writing
Liu, Y., Pang, B., & Liu, B. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1552 · Cited by 18 · cited 3×
“Finally, most ecosystem dimensions are, as previously noted, under-represented, representing a rich area of future study as writing assistants become more widely adopted and the circumstance and context of their adoption becomes increasingly important.”
Persistent Anti-Muslim Bias in Large Language ModelsPreprint
Abid, A., Farooqi, M., & Zou, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05783 · Cited by 17 · cited 1×
“System is meant to evoke a sense of another agent acting on the interface or data Tool System is presented as tools, where there is not a sense of interacting with another agent Hybrid System draws from both “agent” and “tool” metaphors”
iComposer: An Automatic Songwriting System for Chinese Popular Music
Lee, H.-P., Fang, J.-S., & Ma, W.-Y. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4015 · Cited by 17 · cited 2×
“With entertainment as its purpose, a writing task can aim to engage and amuse readers through text, requiring coherent storytelling [133, 174] to engage the audience and may use the structure of the writing itself to convey surprise [80] and pleasure [146, 257].”
Examining Agency, Expertise, and Roles of AI Systems in AI-Mediated Communication
Mieczkowski, H., & Hancock, J. (2022) · doi:10.31219/osf.io/asnv4 · Cited by 16
Watch Me Write: Exploring the Effects of Revealing Creative Writing Process through Writing Replay
Carrera, D., & Lee, S. W. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532806 · Cited by 16
QuoteR: A Benchmark of Quote Recommendation for Writing
Qi, F., Yang, Y., Yi, J., Cheng, Z., Liu, Z., & Sun, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.27 · Cited by 16 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
LinggleWrite: a Coaching System for Essay Writing
Tsai, C.-T., Chen, J.-J., Yang, C.-Y. H., & Chang, J. S. (2020) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2020.acl-demos.17 · Cited by 16 · cited 2×
“Severalstudieshaveutilizedmetricssuch aswordcount,time,andeffortexpendedbytheusertoquantify improvementsintheuser’swritingefficiencybefore,during,and afterusingawritingassistant[7,27].”
Self-citationOn How Users Edit Computer-Generated Visual Stories
Hsu, T.-Y., Hsu, Y.-C., & Huang, T.-H. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312965 · Cited by 15 · cited 1×
“Another common purpose is telling a story; narrative applies to tasks whose goal is to convey an account of real [90] and imagined experiences [88, 109, 211].”
Kim, C., Hinrichs, U., Mohammad, S. M., & Collins, C. M. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395503 · Cited by 15 · cited 3×
“Some systems ensure equal representation of minority and marginalized groups by incorporating gender and race into their design [106].”
Türkay, S., Seaton, D. T., & Ang, A. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188474 · Cited by 14 · cited 1×
“The most common mechanism is to use text formatting such”
Sadauskas, J., Byrne, D., & Atkinson, R. K. (2015) · doi:10.1145/2702123.2702383 · Cited by 14 · cited 3×
“Some systems ensure equal representation of minority and marginalized groups by incorporating gender and race into their design [106].”
WriteAhead2: Mining Lexical Grammar Patterns for Assisted Writing
Chang, J., & Chang, J. S. (2015) · doi:10.3115/v1/n15-3022 · Cited by 14 · cited 4×
“Finally, there are custom designs: for example, a tangible UI that triggers the system by lifting a coffee cup [12], or an exploratory visualization for referencing information which has no user text input [131].”
InfluentialSelf-citationHuman Factors and Behavioral Science: TheUNIX™ Writer's Workbench Software: Philosophy
Frase, L. T. (1983) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1983.tb03519.x · Cited by 14 · cited 1×
“Examples of such support include providing text analysis [78, 164] and text-planning support [50] (see Appendix C for more examples).”
Wang, L., Fan, X., Tian, F., Deng, L., Ma, S., Huang, J., & Wang, H. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188517 · Cited by 13 · cited 8×
“Some texts are written to be descriptive in order to convey emotion [255] and provide expressive details, particularly with evocative language [83, 84, 160].”
InfluentialExploring Methods for Generating Feedback Comments for Writing Learning
Hanawa, K., Nagata, R., & Inui, K. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.766 · Cited by 13 · cited 1×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Mixed-Initiative Interaction with Computational Generative Systems
Lehmann, F. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3577061 · Cited by 12
Modeling Persuasive Discourse to Adaptively Support Students’ Argumentative Writing
Wambsganß, T., & Niklaus, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.599 · Cited by 11 · cited 4×
“The most common mechanism is to use text formatting such”
InfluentialWeber, F., Wambsganß, T., Neshaei, S. P., & Söllner, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.145 · Cited by 11 · cited 6×
“…plagiarism and sense of integrity when using the writing assistant Trust User’s sense of trust in the writing assistant’s ability or perception of its suitability for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s…”
InfluentialSelf-citationRapp, C., Kruse, O., Erlemann, J., & Ott, J. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2685553.2702687 · Cited by 11 · cited 4×
“One fundamental goal is to explain; expository applies to writing tasks whose purpose is to convey relevant facts and knowledge [138, 206].”
InfluentialTowards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond
Mita, M., Sakaguchi, K., Hagiwara, M., Mizumoto, T., Suzuki, J., & Inui, K. (2022) · arXiv · doi:10.48550/arxiv.2205.11484 · Cited by 11 · cited 2×
“…(team member), Pao Siangliu-lue (advisor), Joseph Chee Chang (advisor), Max Kreminski (advisor), Shannon Zejiang Shen (advisor), Daniel Buschek (advisor) • Ecosystem : Simon Buckingham Shum (team lead), Madiha Zahrah Choksi (team member), Antonette Shibani (team member), Simon Knight (team member)”
Zomer, G., & Frankenberg‐Garcia, A. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.216 · Cited by 10 · cited 2×
“Likewise, second language writing can be difficult due to unfamiliar spelling and grammar rules [157] as well as vocabulary [112], and writing assistants can help by aiding in translation to ease the difficulty of writing in an unfamiliar language [112, 112, 157, 277].”
User or Labor: An Interaction Framework for Human-Machine Relationships in NLP
Wan, R., Etori, N., Badillo-Urquiola, K. A., & Kang, D. (2022) · DASH · doi:10.48550/arxiv.2211.01553 · Cited by 10 · cited 1×
“However, such a study has not yet been conducted specifically on writing assistants.”
WINGS:Writing with Intelligent Guidance and Suggestions
Dai, X., Liu, Y., Wang, X., & Liu, B. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5005 · Cited by 9 · cited 2×
“…for a task Availability User’s expectation of the writing assistant being at hand when one needs or wants to use it Privacy User’s concerns about how their data is handled by the writing assistant Transparency User’s understanding of the writing assistant’s mechanism, capabilities, and limitations”
Karolus, J., Feger, S. S., Schmidt, A., & Woźniak, P. W. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596052 · Cited by 9 · cited 4×
“Meanwhile, persuasive writing aims to convince or influence the audience through text [2, 121], requiring high readability [129] and conciseness [115].”
InfluentialText Revision by On-the-Fly Representation Optimization
Li, J., Li, Z., Ge, T., King, I., & Lyu, M. R.-T. (2022) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.18653/v1/2022.in2writing-1.7 · Cited by 9
Research works printed but not linked: 86
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv preprint arXiv:2005.14165 (2020). · arXiv
- Daniel Buschek, Martin Zürn, and Malin Eiband. 2021. The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers. In Conference on Human Factors in Computing Systems (CHI).
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.3115/v1 · DOI
- 10.3115/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Susan D’Agostino. 2023. ChatGPT Advice Academics Can Use Now. https://www.insidehighered.com/news/2023/01/12/academic-experts-offer-advice-chatgpt Accessed: Jan 26, 2024.
- 10.3115/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Michael Gamon. 2010. Using Mostly Native Data to Correct Errors in Learners’ Writing. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Los Angeles, California, 163–171. https://aclanthology.org/N10-1019
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Tobias Moritz Guggenberger, Frederik Möller, Tim Haarhaus, Inan Gür, and Boris Otto. 2020. Ecosystem Types in Information Systems. In Twenty-Eighth European Conference on Information Systems (ECIS2020). https://aisel.aisnet.org/ecis2020_rp/45
- Harry Halpin, Johanna D. Moore, and Judy Robertson. 2004. Automatic Analysis of Plot for Story Rewriting. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Barcelona, Spain, 127–133. https://aclanthology.org/W04-3217
- 10.18653/v1 · DOI
- J.R. Hayes. 1996. A new framework for understanding cognition and affect in writing. In The Science of Writing: Theories, Methods, Individual Differences, and Applications, C.M. Levy and S. Randall (Eds.). Lawrence Erlbaum Associates, Mahwah, NJ, 6–44.
- Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean. 2015. Distilling the Knowledge in a Neural Network. In NIPS Deep Learning and Representation Learning Workshop.
- Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations (ICLR).
- Chung-chi Huang, Ping-che Yang, Keh-jiann Chen, and Jason S. Chang. 2012. TransAhead: A Computer-Assisted Translation and Writing Tool. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Montréal, Canada, 352–356. https://aclanthology.org/N12-1036
- Chung-chi Huang, Ping-che Yang, Mei-hua Chen, Hung-ting Hsieh, Ting-hui Kao, and Jason S. Chang. 2012. TransAhead: A Writing Assistant for CAT and CALL. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Avignon, France, 16–19. https://aclanthology.org/E12-2004
- Justin Hutchens. 2023. The Language of Deception: Weaponizing Next Generation AI. John Wiley & Sons.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Juho Kim. 2022. Interaction-Centric AI (NeurIPS 2022 Keynote). https://slideslive.com/38996064/interactioncentric-ai Accessed: Jan 26, 2024.
- 10.18653/v1 · DOI
- Tomi Kinnunen, Henri Leisma, Monika Machunik, Tuomo Kakkonen, and Jean-Luc LeBrun. 2012. SWAN - Scientific Writing AssistaNt. A Tool for Helping Scholars to Write Reader-Friendly Manuscripts. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Avignon, France, 20–24. https://aclanthology.org/E12-2005
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Alexander Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew Arad Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue WANG, Keshav Santhanam, Laurel Orr, Lucia Zheng, Mert Yuksekgonul, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Andrew Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, and Yuta Koreeda. 2023. Holistic Evaluation of Language Models. Transactions on Machine Learning Research (2023). https://openreview.net/forum?id=iO4LZibEqW Featured Certification, Expert Certification.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Charles A MacArthur. 2006. The effects of new technologies on writing and writing processes. Handbook of writing research (2006), 248–262.
- 10.1080/07370024.1991.9667168 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Writers Guild of America. 2023. What We Won. https://www.wgacontract2023.org/the-campaign/what-we-won Accessed: Dec. 12, 2023.
- David R Olson. 2002. What writing does to the mind. Language, literacy, and cognitive development: The development and consequences of symbolic communication (2002), 153–166.
- 10.18653/v1 · DOI
- Vishakh Padmakumar and He He. 2024. Does Writing with Language Models Reduce Content Diversity?. In The Twelfth International Conference on Learning Representations. https://openreview.net/forum?id=Feiz5HtCD0
- 10.3102/0091732X014001277 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Denise Schmandt-Besserat. 1992. Before writing, vol. I: from counting to cuneiform. Vol. 1. University of Texas press.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.3115/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Elizabeth Sulzby, William H Teale, and George Kamberelis. 1989. Emergent writing in the classroom: Home and school connections. Emerging literacy: Young children learn to read and write (1989), 63–79.
- 10.18653/v1 · DOI
- Ilya Sutskever Oriol Vinyals and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (NeurIPS). 3104–3112.
- 10.18653/v1 · DOI
- Rohan Taori and Tatsunori Hashimoto. 2023. Data feedback loops: Model-driven amplification of dataset biases. In International Conference on Machine Learning. PMLR, 33883–33920.
- Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. arXiv (2023).
- Eric L Trist. 1981. The evolution of socio-technical systems. Vol. 2. Ontario Quality of Working Life Centre Toronto.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Florian Weber, Thiemo Wambsganss, Dominic Rüttimann, and Matthias Söllner. 2021. Pedagogical agents for interactive learning: A taxonomy of conversational agents in education. In Forty-Second International Conference on Information Systems. Austin, Texas.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Chin yew Lin and Marina Rey. 2004. Looking for a Few Good Metrics: ROUGE and its Evaluation. In NTCIR Workshop.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
Cited by
Sorted by citations
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
Self-citationBuilding machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi‐Xuan, T., Ho, M. K., Mansinghka, V. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 125
“This sociotechnical ecosystem may be dictated by external regulations, organizational practices, or other principles 73,212–215 Article 14 of the EU AI Act requires users of high-risk AI systems “to correctly interpret the high-risk AI system’s output” and “to remain aware of the possible tendency…”
Self-citationHalkiopoulos, C., Gkintoni, E., Aroutzidis, A., & Antonopoulou, H. (2025) · Diagnostics · doi:10.3390/diagnostics15040456 · Cited by 109
Quantifying large language model usage in scientific papers
Liang, W., Zhang, Y., Wu, Z., Lepp, H., Ji, W., Zhao, X., Cao, H., Liu, S., He, S., Huang, Z., et al. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02273-8 · Cited by 80
“A technology that can generate dominant varieties of scholarly English could hypo-thetically lower barriers to entry 14,15 .”
Writer-Defined AI Personas for On-Demand Feedback Generation
Benharrak, K., Zindulka, T., Lehmann, F., Heuer, H., & Buschek, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642406 · Cited by 63
Self-citation
Metadata
- Authors
- Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., August, T., Bhat, A., Choksi, M. Z., Dutta, S., Guo, J. L. C., Hoque, M. N., Kim, Y., Knight, S., Neshaei, S. P., Shibani, A., Shrivastava, D., Shroff, L., Sergeyuk, A., Stark, J., Sterman, S., Wang, S., Bosselut, A., Buschek, D., Chang, J. C., Chen, S., Kreminski, M., Park, J., Pea, R., Rho, E. H. R., Shen, Z., & Siangliulue, P.
- Affiliations
- Microsoft (United States) (US)
- Harvard University (US)
- Midjourney, United States
- University of Technology Sydney (AU)
- Grammarly, United States
- University of Michigan (US)
- Google (United States) (US)
- Bern University of Applied Sciences (CH)
- University of Illinois Urbana-Champaign (US)
- King Abdulaziz University (SA)
- University of Washington (US)
- McGill University (CA)
- Cornell Tech (US)
- University of Tennessee at Knoxville (US)
- University of Maryland, College Park (US)
- Korea Advanced Institute of Science and Technology (KR)
- École Polytechnique Fédérale de Lausanne (CH)
- Google DeepMind (United Kingdom) (GB)
- Stanford University (US)
- JetBrains Research, Serbia and Montenegro
- University of Toronto (CA)
- Columbia University (US)
- University of Bayreuth (DE)
- Allen Institute for Artificial Intelligence (US)
- Department of Computer Science, University of Richmond, United States
- Virginia Tech (US)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- B12, United States
- ORCID
- Lee, Mina
- Gero, Katy Ilonka
- Chung, John Joon Young
- Shum, Simon Buckingham
- Raheja, Vipul
- Shen, Hua
- Venugopalan, Subhashini
- Wambsganss, Thiemo
- Zhou, David
- Alghamdi, Emad A.
- August, Tal
- Bhat, Avinash
- Choksi, Madiha Zahrah
- Dutta, Senjuti
- Guo, Jin L.C.
- Hoque, Md Naimul
- Kim, Yewon
- Knight, Simon
- Neshaei, Seyed Parsa
- Shibani, Antonette
- Shrivastava, Disha
- Shroff, Lila
- Sergeyuk, Agnia
- Stark, Jessi
- Sterman, Sarah
- Wang, Sitong
- Bosselut, Antoine
- Buschek, Daniel
- Chang, Joseph Chee
- Chen, Sherol
- Kreminski, Max
- Park, Joonsuk
- Pea, Roy
- Rho, Eugenia Ha Rim
- Shen, Zejiang
- Siangliulue, Pao
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-35
- OpenAlex
- W4393118307
- Cited by
- 136
- References
- 129
- Citations by year
- 2026: 47 · 2025: 71 · 2024: 18
- FWCI
- 43.82
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- ARBOR - Bern University of Applied Sciences Repository (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- University of Technology Sydney
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- writing assistants, design space, interactive writing, writing support systems, task dimensions, technology dimension
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
