Sparks: Inspiration for Science Writing using Language Models
The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
Large-scale language models are rapidly improving, performing well on a wide variety of tasks with little to no customization. In this work we investigate how language models can support science writing, a challenging writing task that is both open-ended and highly constrained. We present a system for generating “sparks”, sentences related to a scientific concept intended to inspire writers. We find that our sparks are more coherent and diverse than a competitive language model baseline, and approach a human-written gold standard. We run a user study with 13 STEM graduate students writing on topics of their own selection and find three main use cases of sparks—inspiration, translation, and perspective—each of which correlates with a unique interaction pattern. We also find that while participants were more likely to select higher quality sparks, the average quality of sparks seen by a given participant did not correlate with their satisfaction with the tool. We end with a discussion about what impacts human satisfaction with AI support tools, considering participant attitudes towards influence, their openness to technology, as well as issues of plagiarism, trustworthiness, and bias in AI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Gero et al.'s research [39] revealed that the idea generation phase can particularly threaten ownership, with some writers considering the struggle with writer's block as integral to their writerly identity.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [39]
In the citing paper
“A focus of researchers in this area is conducting empirical studies with writers to discover their writing strategies and requirements for support [9,39,53,63,77,133].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [39]
In the citing paper
“Researchers in HCI have worked extensively to investigate these dimensions, producing studies characterizing user values, social dynamics, and professional contexts [9,39,53,63,77,105] that influence ownership preferences and how they shape users' attitudes toward AI assistance.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [39]
In the citing paper
“Gero et al. [39] found that while authenticity and ownership are related, they are not directly correlated-users may not perceive a system that mimics their style as inauthentic.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as Gero et al. [39]
In the citing paper
“Advanced Large Language Models (LLMs) such as ChatGPT [68], GPT-4 [69], PaLM 2 [32], LLaMA 2 [90], and Gemini [73] can enable writers to generate multiple variations of text via natural language prompting [8,15,26,66], potentially reducing the workload of generating text variations.”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [26]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 5×
“GPT-3 [11] or Megatron-LM [45], we wanted to limit the size of the model we used as larger models are more expensive to run and take more time to generate text.”
BackgroundMethodInfluentialSentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 1×
“We measure diversity with sentence embeddings [40], in particular we report the average distance between outputs within a given prompt.”
MethodBraun, V., & Clarke, V. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-004 · Cited by 10,299
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 4×
“There have been several calls to be more careful and explicit with the data that these pre-trained models are trained on [7, 8, 14].”
BackgroundMethodInfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 4×
“Anecdotally, we found that DistilGPT2, a ‘distilled’, smaller version of GPT-2 [48], was not able to produce coherent responses to our prompts.”
BackgroundInfluentialSpeech and language processing
(2010) · Day-to-Day Dyslexia in the Classroom · doi:10.4324/9780203461891_chapter_3 · Cited by 3,544 · cited 1×
“Language models are trained on a dataset of text that does not need to be annotated in any way, as the model can simply be trained on what the next word in a sentence will be [29].”
BackgroundConstructing inferences during narrative text comprehension.
Graesser, A. C., Singer, M., & Trabasso, T. (1994) · Psychological Review · doi:10.1037//0033-295x.101.3.371 · Cited by 2,560
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473 · cited 2×
“These results however are highly dependent upon many factors1 [35].”
BackgroundMaking Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380 · cited 4×
“Designing prompts for language models has become an active area of research, with many automatic methods being proposed [19, 34].”
BackgroundMethodInfluentialThe Curious Case of Neural Text Degeneration
Holtzman, A., Buys, J., Du, L., Forbes, M., & Choi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09751 · Cited by 1,304 · cited 3×
“language models: greedy search, beam search, top-k sampling [26], and top-n sampling [18], to name a few.”
BackgroundHierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1082 · Cited by 1,266 · cited 2×
“This is sometimes called top-k sampling, as only the top 𝑘 tokens are used [18].”
MethodHierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.04833 · Cited by 1,242 · cited 2×
“This is sometimes called top-k sampling, as only the top 𝑘 tokens are used [18].”
MethodPEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Zhang, J., Zhao, Y., Saleh, M., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1912.08777 · Cited by 1,206 · cited 1×
“For instance, although there is much work on automatic summarization [25, 57],”
BackgroundTransformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., et al. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5347031 · Cited by 1,152
Hart, P. S., & Nisbet, E. C. (2012) · Communication Research · doi:10.1177/0093650211416646 · Cited by 1,123
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., D., M., Châtel, G., Chaumond, J., Rault, T., Voss, C., Wang, F., et al. (2019) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3385997 · Cited by 1,037
A cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025 · cited 2×
“Imagining your reader is an important and difcult part of writing [19].”
BackgroundPrompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 4×
“Prefix prompts have been shown to greatly improve performance by providing the language model with appropriate context [45].”
BackgroundMethodInfluentialLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
TruthfulQA: Measuring How Models Mimic Human Falsehoods
Lin, S., Hilton, J., & Evans, O. (2021) · arXiv · doi:10.48550/arxiv.2109.07958 · Cited by 899
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Shoeybi, M., Patwary, M., Puri, R., LeGresley, P., Casper, J., & Catanzaro, B. (2019) · arXiv · doi:10.48550/arxiv.1909.08053 · Cited by 893 · cited 1×
“GPT-3 [11] or Megatron-LM [45], we wanted to limit the size of the model we used as larger models are more expensive to run and take more time to generate text.”
MethodCTRL: A Conditional Transformer Language Model for Controllable Generation
Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., & Socher, R. (2019) · arXiv · doi:10.48550/arxiv.1909.05858 · Cited by 751 · cited 1×
“Much recent work has been on how to make the best use of these large language models, which have shown to be much more general purpose than previous ones [31], even showing promise in generating code [6].”
BackgroundTowards a Human-like Open-Domain Chatbot
Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2001.09977 · Cited by 614 · cited 2×
“Language models are getting larger: they are being trained on more text and the models have more parameters [3, 11, 39].”
BackgroundQuantifying the Creativity Support of Digital Tools through the Creativity Support Index
Cherry, E., & Latulipe, C. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2617588 · Cited by 498 · cited 2×
“After this, the participant flled out a short survey, which included the Creativity Support Index [13], and partook in a semistructured interview with the facilitator.”
MethodProgram Synthesis with Large Language Models
Austin, J., Odena, A., Nye, M., Bosma, M., Michalewski, H., Dohan, D., Jiang, E., Cai, C., Terry, M., Le, Q., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07732 · Cited by 388 · cited 1×
“Much recent work has been on how to make the best use of these large language models, which have shown to be much more general purpose than previous ones [31], even showing promise in generating code [6].”
BackgroundRed Teaming Language Models with Language Models
Perez, E., Huang, S., Song, F., Cai, T., Ring, R., Aslanides, J., Glaese, A., McAleese, N., & Irving, G. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.225 · Cited by 363
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Zhang, J., Zhao, Y., Saleh, M., & Liu, P. X. (2020) · International Conference on Machine Learning · Cited by 325
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301
Plagiarism in the age of massive generative pre-trained transformers (GPT-3)
Dehouche, N. (2021) · Ethics in Science and Environmental Politics · doi:10.3354/esep00195 · Cited by 296
Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172983 · Cited by 257
Shelby, A., & Ernst, K. (2013) · Human Vaccines & Immunotherapeutics · doi:10.4161/hv.24828 · Cited by 232
If beam search is the answer, what was the question?
Meister, C., Cotterell, R., & Vieira, T. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.170 · Cited by 203
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G., Lukacs, L., Ganea, M., Young, P., et al. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939801 · Cited by 183 · cited 1×
“A good example is Gmail’s smart reply function, which aims to suggest only text that the writer would have written in anyway [30], although it has been shown that even these suggestions can change what people write [4].”
BackgroundQuality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00447 · Cited by 179 · cited 1×
“There have been several calls to be more careful and explicit with the data that these pre-trained models are trained on [7, 8, 14].”
BackgroundQuality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.12028 · Cited by 179 · cited 1×
“There have been several calls to be more careful and explicit with the data that these pre-trained models are trained on [7, 8, 14].”
BackgroundInvestigating the querying and browsing behavior of advanced search engine users
White, R. W., & Morris, D. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277787 · Cited by 171 · cited 1×
“For instance, advanced users query less frequently in a session, compose longer queries, and click on results further down on the list [53].”
BackgroundGmail Smart Compose: Real-Time Assisted Writing
Chen, M. X., Lee, B. N., Bansal, G., Cao, Y., Zhang, S., Lu, J., Tsay, J., Wang, Y., Dai, A. M., Chen, Z., et al. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330723 · Cited by 169
Commonsense Knowledge Base Completion
Li, X., Taheri, A., Tu, L., & Gimpel, K. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1137 · Cited by 166 · cited 1×
“For this reason we recruited 10 domain experts to annotate outputs for coherence on a 0 - 4 scale, in line with knowledge graph evaluations [33].”
MethodMetaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146
Self-citationStructure strategy interventions: Increasing reading comprehension of expository text
Meyer, B. J. F., & Ray, M. (2011) · lnternational Electronic Journal of Elementary Education · Cited by 144
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G. S., Lukacs, L., Ganea, M., Young, P., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04870 · Cited by 134 · cited 1×
“A good example is Gmail’s smart reply function, which aims to suggest only text that the writer would have written in anyway [30], although it has been shown that even these suggestions can change what people write [4].”
BackgroundMaking Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2020) · arXiv · doi:10.48550/arxiv.2012.15723 · Cited by 124 · cited 4×
“Designing prompts for language models has become an active area of research, with many automatic methods being proposed [19, 34].”
BackgroundMethodInfluentialMental Models of AI Agents in a Cooperative Game Setting
Gero, K. I., Ashktorab, Z., Dugan, C., Pan, Q., Johnson, J., Geyer, W., Ruiz, M., Miller, S., Millen, D. R., Campbell, M., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376316 · Cited by 121 · cited 1×
“Work on how users develop mental models of AI systems has shown that some people are more likely to blame the system when something goes wrong, and others are more likely to blame themselves [20].”
BackgroundSelf-citationWhere to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119
Post-normal science communication: exploring the blurring boundaries of science and journalism
Brüggemann, M., Lörcher, I., & Walter, S. (2020) · Journal of Science Communication · doi:10.22323/2.19030202 · Cited by 118
How Novelists Use Generative Language Models: An Exploratory User Study.
Calderwood, A., Qiu, V., Gero, K. I., & Chilton, L. B. (2020) · Cited by 111
Self-citationCTRLsum: Towards Generic Controllable Text Summarization
He, J., Kryscinski, W., McCann, B., Rajani, N., & Xiong, C. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.396 · Cited by 100
Comparison of Diverse Decoding Methods from Conditional Language Models
Ippolito, D., Kriz, R., Sedoc, J., Kustikova, M., & Callison-Burch, C. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1365 · Cited by 92 · cited 2×
“Despite their successes, language models continue to exhibit known problems, such as generic outputs [26], lack of diversity in their outputs [28], and factually false or contradictory information [35].”
BackgroundPeng, Z., Guo, Q., Tsang, K. W., & Ma, X. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376695 · Cited by 81 · cited 2×
“6Additionally, this encourages the writer to feel more ownership over their fnal product, which has shown to be a concern in past work [41].”
BackgroundGilbert, S. A. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392822 · Cited by 80 · cited 2×
“Now any scientist can conduct science communication by posting about their work online [53], engaging in the ‘Ask’ communities on Reddit [22] or explaining a topic on Youtube [57].”
SAGA: Collaborative Storytelling with GPT-3
Shakeri, H., Neustaedter, C., & DiPaola, S. (2021) · Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3462204.3481771 · Cited by 66 · cited 1×
“And the proliferation of writing tools that make use of generated text [15, 45, 50] is likely due to the increased quality of generated text, and its correspondingly increased usefulness.”
BackgroundBreu, A. C. (2020) · Seminars in Nephrology · doi:10.1016/j.semnephrol.2020.04.005 · Cited by 64
Writing Stories with Help from Recurrent Neural Networks
Roemmele, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9810 · Cited by 59 · cited 1×
“Early work on language models for creative writing focused on activities such as storytelling [42] and metaphor writing [15].”
BackgroundDiverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
Vijayakumar, A. K., Cogswell, M., Selvaraju, R. R., Sun, Q., Lee, S., Crandall, D., & Batra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02424 · Cited by 58 · cited 2×
“[51]), in testing we found none were as effective as simply enforcing the first token to be unique.”
BackgroundMethodDomain Agnostic Real-Valued Specificity Prediction
Ko, W.-J., Durrett, G., & Li, J. J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016610 · Cited by 44
MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding
Chakrabarty, T., Zhang, X., Muresan, S., & Peng, N. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.336 · Cited by 43
Schmitt, O., & Buschek, D. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465253 · Cited by 41
Bandy, J., & Vincent, N. (2021) · arXiv · doi:10.48550/arxiv.2105.05241 · Cited by 36 · cited 1×
“There have been several calls to be more careful and explicit with the data that these pre-trained models are trained on [7, 8, 14].”
BackgroundWordcraft: a Human-AI Collaborative Editor for Story Writing
Coenen, A., Davis, L., Ippolito, D., Reif, E., & Yuan, A. (2021) · arXiv · doi:10.48550/arxiv.2107.07430 · Cited by 35 · cited 3×
“More recent work on writing support for creative tasks has varied the ways in which technology can support the writer, for instance by providing description, plot points, or even asking questions, depending on the desires of the writer [5, 17].”
BackgroundInfluentialTversky, B., & Chou, J. Y. (2010) · Springer eBooks · doi:10.1007/978-0-85729-224-7_27 · Cited by 34 · cited 1×
“Creativity requires both convergent and divergent thinking [49].”
BackgroundHowell, E. L., Nepper, J. F., Brossard, D., Xenos, M. A., & Scheufele, D. A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216274 · Cited by 32 · cited 1×
“We use graduate students as they are eager to participate in science writing [27] and many tweetorials are already”
MethodSoragni, A., & Maitra, A. (2019) · Nature reviews. Cancer · doi:10.1038/s41568-019-0170-4 · Cited by 25 · cited 2×
“Now any scientist can conduct science communication online by posting about their work online [47], engaging in the ‘Ask’ communities on Reddit [22] or explaining something on Youtube [52].”
BackgroundSadeghi, R. (2016) · Research Ethics · doi:10.1177/1747016116654065 · Cited by 15 · cited 1×
“Historically plagiarism has assumed there is another scholar from which to steal words or ideas [47], but since authorship of text generated from language models is unclear, the issues of plagiarizing from them are unclear as well.”
BackgroundExploring People's Attitudes and Behaviors Toward Careful Information Seeking in Web Search
Yamamoto, T., Yamamoto, Y., & Fujita, S. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271799 · Cited by 15 · cited 1×
“How users craft web search queries, and how they overall use web search engines for information retrieval, is a long and active area of study [46, 55].”
BackgroundDiscourse and cohension in expository text
Tucker, A. B., Nirenburg, S., & Raskin, V. (1986) · doi:10.3115/991365.991419 · Cited by 11 · cited 1×
“One framework for expository text introduced a taxonomy of methods (evaluation, explanation, occasion, and expansion) to enumerate diferent ways a writer can "infuence the inference process of the reader" [54].”
MethodThe COVID-19 Infodemic: Twitter versus FacebookPreprint
Yang, K.-C., Pierri, F., Hui, P.-M., Axelrod, D., Torres-Lugo, C., Bryden, J., & Menczer, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09353 · Cited by 8 · cited 1×
“Science communication helps the public understand scientific contributions – consider how it has been applied to tackle vaccine misinformation [44], the COVID-19 pandemic [56], and climate change [24].”
BackgroundDomain‐independent search expertise: Gaining knowledge in query formulation through guided practice
Smith, C. L. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23776 · Cited by 7 · cited 1×
“How users craft web search queries, and how they overall use web search engines for information retrieval, is a long and active area of study [46, 55].”
BackgroundGenerative Models can Help Writers without Writing for Them.
Arnold, K. C., Volzer, A. M., & Madrid, N. G. (2021) · IUI Workshops · Cited by 5
Research works printed but not linked: 6
- Yao Dou , Maxwell Forbes , Rik Koncel-Kedziorski , Noah A. Smith , and Yejin Choi . 2021 . Scarecrow: A Framework for Scrutinizing Machine Text. arXiv:2107.01294 [cs] (July 2021). http://arxiv.org/abs/2107.01294 arXiv:2107.01294. Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A. Smith, and Yejin Choi. 2021. Scarecrow: A Framework for Scrutinizing Machine Text. arXiv:2107.01294 [cs] (July 2021). http://arxiv.org/abs/2107.01294 arXiv:2107.01294. · arXiv
- 10.2307/356600 · doi:10.2307/356600 · Paper page
- Katy Ilonka Gero Chris Kedzie Savvas Petridis and Lydia Chilton. 2021. Lightweight Decoding Strategies for Increasing Specificity. arXiv preprint arXiv:2110.11850(2021). Katy Ilonka Gero Chris Kedzie Savvas Petridis and Lydia Chilton. 2021. Lightweight Decoding Strategies for Increasing Specificity. arXiv preprint arXiv:2110.11850(2021). · arXiv
- Mina Lee Percy Liang and Qian Yang. 2022. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. CoRR abs/2201.06796(2022). arXiv:2201.06796https://arxiv.org/abs/2201.06796 Mina Lee Percy Liang and Qian Yang. 2022. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. CoRR abs/2201.06796(2022). arXiv:2201.06796https://arxiv.org/abs/2201.06796 · arXiv
- Oliver Schmitt and Daniel Buschek. 2021. CharacterChat: Supporting the Creation of Fictional Characters through Conversation and Progressive Manifestation with a Chatbot. In Creativity and Cognition. ACM Virtual Event Italy 1-10. https://doi.org/10.1145/3450741.3465253 · DOI · Paper page
- Tongshuang Wu , Michael Terry , and Carrie J. Cai . 2021. AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts. arXiv:2110.01691 [cs] (Oct . 2021 ). http://arxiv.org/abs/2110.01691 arXiv:2110.01691. Tongshuang Wu, Michael Terry, and Carrie J. Cai. 2021. AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts. arXiv:2110.01691 [cs] (Oct. 2021). http://arxiv.org/abs/2110.01691 arXiv:2110.01691. · arXiv
Cited by
Prompt Engineering with ChatGPT: A Guide for Academic Writers
Giray, L. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03272-4 · Cited by 776
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
“…between expressed empathy and positive For AI-assisted writing, for instance, we must build AI models that generate actionable writing suggestions and simultaneously design human-facing systems that help people see, understand and act on those suggestions in a just-in-time fashion 17–23 .”
BackgroundMirowski, P., Mathewson, K. W., Pittman, J., & Evans, R. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581225 · Cited by 240
“Some studies consulted with expert linguists [31], university students in the sciences [42] or humanities [123], and amateur writers [2, 21, 62, 100, 125].”
BackgroundLarge-scale Text-to-Image Generation Models for Visual Artists’ Creative Works
Ko, H.-K., Park, G., Jeon, H., Jo, J., Kim, J., & Seo, J. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584078 · Cited by 189
“The vast majority of the publications targeted general public or they simply unspecified the user (45.8%, 33 publications).”
BackgroundInfluentialSuh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
Metadata
- Authors
- Gero, K. I., Liu, V., & Chilton, L.
- Affiliations
- Columbia University (US)
- Venue
- Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2022-06-13
- Pages
- 1002-1019
- OpenAlex
- W3206079177
- Cited by
- 161
- References
- 62
- Citations by year
- 2026: 24 · 2025: 52 · 2024: 54 · 2023: 28 · 2022: 3
- FWCI
- 30.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Designing Interactive Systems Conference (publishedVersion)
- Funders
- Brown Institute for Media Innovation (Magic Grant)
- NSF (DGE - 1644869)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- scientific writing, large language models, AI-assisted writing, Spark, scientific concepts, writing inspiration, STEM graduate students, user study, plagiarism, trust in AI, algorithmic bias, writing support tools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.