The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization
Open accessThe DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
The use of Large Language Models (LLMs) for writing has sparked controversy both among readers and writers. On one hand, writers are concerned that LLMs will deprive them of agency and ownership, and readers are concerned about spending their time on text generated by soulless machines. On the other hand, AI-assistance can improve writing as long as writers can conform to publisher policies, and as long as readers can be assured that a text has been verified by a human. We argue that a system that captures the provenance of interaction with an LLM can help writers retain their agency, conform to policies, and communicate their use of AI to publishers and readers transparently. Thus we propose HaLLMark, a tool for visualizing the writer’s interaction with the LLM. We evaluated HaLLMark with 13 creative writers, and found that it helped them retain a sense of control and ownership of the text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Agency dynamics in news curation typically involve semi-proactive and reactive mechanisms.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [70]
Experimental — accuracy not yet measuredIn the citing paper
“Transparency and explainability regarding AI actions [70, 187, 209] are crucial for enabling humans to appropriately trust and engage with AI contributions [191, 201].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [70]
In the citing paper
“Critical control mechanisms supporting this pathway include iterative feedback loops and transparency/explainability features [70, 124] to manage the joint effort.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [70]
In the citing paper
“Effective management relies heavily on integrated control mechanisms, including guided input, action coordination frameworks, and robust feedback loops [70, 124, 207].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [70]
In the citing paper
“This complexity is further underscored by the fact that conceptualizing AI as persons obscures distinct legal, safety, security, trust, and reliability issues inherent in human-AI relationships [70].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [70]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y., Chen, D., Dai, W., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.03629 · Cited by 4,981
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471 · cited 3×
“Here we describe each of these topics.”
BackgroundInfluentialAssociation for Computational Linguistics
Hirst, G. (2006) · Encyclopedia of Language & Linguistics · doi:10.1016/b0-08-044854-2/05234-2 · Cited by 1,140
Vega-Lite: A Grammar of Interactive Graphics
Satyanarayan, A., Moritz, D., Wongsuphasawat, K., & Heer, J. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2599030 · Cited by 883
Art and the science of generative AI
Epstein, Z., Hertzmann, A., the Investigators of Human Creativity, Akten, M., Farid, H., Fjeld, J., Frank, M. R., Groh, M., Herman, L., Leach, N., et al. (2023) · Science · doi:10.1126/science.adh4451 · Cited by 788
Studying cooperation and conflict between authors with history flow visualizations
Viégas, F. B., Wattenberg, M., & Dave, K. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985765 · Cited by 768 · cited 1×
“While specific instructions vary between policies, all encourage authors to be transparent and disclose the use of AI.”
BackgroundAI bot ChatGPT writes smart essays — should professors worry?
Stokel-Walker, C. (2022) · Nature · doi:10.1038/d41586-022-04397-7 · Cited by 543
(2017) · Lexikon des gesamten Buchwesens Online · doi:10.1163/9789004337862_lgbo_com_150392 · Cited by 503
Wu, T., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517582 · Cited by 483 · cited 1×
“Wu et al. [73] showed that decomposing an LLM task into multiple sub-tasks, chaining them, and then allowing users to investigate how a previous task influences the subsequent task improved users’ task quality, sense of control, and system transparency.”
BackgroundEthical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477 · cited 1×
“ModelTracker is an interactive visualization that summarizes traditional summary statistics and graphs while displaying example-level performance to enable direct error examination and debugging.”
BackgroundTermite: visualization techniques for assessing textual topic models
Chuang, J., Manning, C. D., & Heer, J. (2012) · Proceedings of the International Working Conference on Advanced Visual Interfaces · doi:10.1145/2254556.2254572 · Cited by 420 · cited 1×
“After that, the authors open-coded the policies again by following the codebook.”
BackgroundParticipatory Visualization with Wordle
Viegas, F. B., Wattenberg, M., & Feinberg, J. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.171 · Cited by 409 · cited 1×
“A tool supporting awareness and deeper understanding of these dimensions will help authors effectively and responsibly leverage powerful aids.”
Hierarchical Aggregation for Information Visualization: Overview, Techniques, and Design Guidelines
Elmqvist, N., & Fekete, J.-D. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.84 · Cited by 381
Self-citationWordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374 · cited 3×
“We found evidence of the impact of HaLLMark in the percentage of AI-written text in the final stories.”
BackgroundTextFlow: Towards Better Understanding of Evolving Topics in Text
Cui, W., Liu, S., Tan, L., Shi, C., Song, Y., Gao, Z., Qu, H., & Tong, X. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.239 · Cited by 349 · cited 1×
“As a starting point, we reviewed existing guidelines for using generative AI models from the U.S. Copyright Office [53], The Author’s Guild [28], educational organizations such as the Modern Language Association [3], several creative writing publishers (e.g., [55]), and academic venues and…”
MethodLee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345 · cited 1×
“Visualization has long been used to provide explainable machine learning [73] and NLP models [11, 45], and these ideas have also recently begun to be applied to LLMs. Recently, Jiang et al. [39] proposed Graphologue, that converts responses from LLMs to interactive graphs for fast and non-linear…”
BackgroundThe ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts
Hosseini, M., Resnik, D. B., & Holmes, K. (2023) · Research Ethics · doi:10.1177/17470161231180449 · Cited by 341 · cited 1×
“Similarly, as policies evolve, we will likely see more constraints and dimensions, which could be encoded in the timeline by adding new rows in the timeline.”
BackgroundVisualizing Dataflow Graphs of Deep Learning Models in TensorFlow
Wongsuphasawat, K., Smilkov, D., Wexler, J., Wilson, J., Mane, D., Fritz, D., Krishnan, D., Viegas, F. B., & Wattenberg, M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744878 · Cited by 331 · cited 1×
“Visualizationhaslongbeenusedtoexplainmachinelearning[72] and NLP models [10, 43], and these ideas have also recently begun to be applied to LLMs. Recently, Jiang et al. [37] proposed Grapho-logue, that converts responses from LLMs to interactive graphs for fast and non-linear sensemaking.”
BackgroundFair Statistical Communication in HCI
Dragicevic, P. (2016) · Human–Computer Interaction Series · doi:10.1007/978-3-319-26633-6_13 · Cited by 325 · cited 1×
“Nevertheless, we believe that, in the future, organizations and authorities will likely benefit by focusing on devising policies for ethical and responsible content generation, rather than limiting writers to the use of LLMs for editorial purposes.”
BackgroundThe Word Tree, an Interactive Visual Concordance
Wattenberg, M., & Viegas, F. B. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.172 · Cited by 319 · cited 1×
“A tool supporting awareness and deeper understanding of these dimensions will help authors effectively and responsibly leverage powerful aids.”
ModelTracker: Redesigning Performance Analysis Tools for Machine Learning
Amershi, S., Chickering, M., Drucker, S. M., Lee, B., Simard, P., & Suh, J. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702509 · Cited by 262 · cited 1×
“For instance, policies from creative writing are more concerned about copyright issues and preventing LLMs from training on books without writers’ permission than providing guidelines on how writers should use LLMs [28].”
BackgroundPatents and intellectual property assets as non-fungible tokens; key technologies and challenges
Bamakan, S. M. H., Nezhadsistani, N., Bodaghi, O., & Qu, Q. (2022) · Scientific Reports · doi:10.1038/s41598-022-05920-6 · Cited by 261
On Close and Distant Reading in Digital Humanities: A Survey and Future Challenges
Jänicke, S., Franzini, G., Cheema, M. F., & Scheuermann, G. (2015) · Eurographics · doi:10.2312/eurovisstar.20151113 · Cited by 248 · cited 1×
“As a starting point, we reviewed existing guidelines for using generative AI models from the U.S. Copyright Office [53], The Author’s Guild [28], educational organizations such as the Modern Language Association [3], several creative writing publishers (e.g., [55]), and academic venues and…”
MethodRagan, E. D., Endert, A., Sanyal, J., & Chen, J. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467551 · Cited by 240 · cited 1×
“Another shared sentiment across policies and domains is that AI cannot be granted authorship; rather, authors should be responsible for content generated by the AI and should acknowledge that they have themselves verified all AI-generated content.”
BackgroundMirowski, P., Mathewson, K. W., Pittman, J., & Evans, R. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581225 · Cited by 240
AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap
Liao, Q. V., & Wortman Vaughan, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.8036d03b · Cited by 210
AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap
Liao, Q. V., & Vaughan, J. W. (2023) · arXiv · doi:10.48550/arxiv.2306.01941 · Cited by 209
TIMELINESTag clouds and the case for vernacular visualization
Viégas, F. B., & Wattenberg, M. (2008) · Interactions · doi:10.1145/1374489.1374501 · Cited by 207 · cited 1×
“A tool supporting awareness and deeper understanding of these dimensions will help authors effectively and responsibly leverage powerful aids.”
TaleBrush: Sketching Stories with Generative Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501819 · Cited by 206
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
Sparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606756 · Cited by 151
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · arXiv · doi:10.48550/arxiv.2305.11483 · Cited by 151
Metaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · cited 1×
“One example is DramatVis Personae (DVP) [32], a visualization system for mitigating nuanced social biases in creative writing.”
Backgroundvan Ham, F., WATTENBERG, M. P., & Viégas, F. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.165 · Cited by 144 · cited 1×
“As a starting point, we reviewed existing guidelines for using generative AI models from the U.S. Copyright Office [53], The Author’s Guild [28], educational organizations such as the Modern Language Association [3], several creative writing publishers (e.g., [55]), and academic venues and…”
MethodGraphologue: Exploring Large Language Model Responses with Interactive Diagrams
Jiang, P., Rayan, J., Dow, S. P., & Xia, H. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606737 · Cited by 135 · cited 1×
“The inter-rater reliability between the coders was 0.91 (Jaccard’s similarity).”
InfluentialSocial Dynamics of AI Support in Creative Writing
Gero, K. I., Long, T., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580782 · Cited by 129
The Conference on College Composition and Communication
Gerber, J. C. (1950) · College Composition and Communication · doi:10.58680/ccc195023270 · Cited by 118
Understanding and Visualizing Data Iteration in Machine Learning
Hohman, F., Wongsuphasawat, K., Kery, M. B., & Patel, K. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376177 · Cited by 110 · cited 1×
“In comparison, policies from academic venues provide explicit guides for using and reporting LLMs [21, 22].”
BackgroundThe human touch: How non-expert users perceive, interpret, and fix topic models
Lee, T. Y., Smith, A., Seppi, K., Elmqvist, N., Boyd-Graber, J., & Findlater, L. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.03.007 · Cited by 92 · cited 1×
“After that, the authors open-coded the policies again by following the codebook.”
BackgroundSelf-citationDocuViz: Visualizing Collaborative Writing
Wang, D., Olson, J. S., Zhang, J., Nguyen, T., & Olson, G. M. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702517 · Cited by 86 · cited 1×
“Table 1 contains our consolidated typology of current types of information that are important to be aware of during AI-assisted writing, per our findings.”
ResultLiao, Q. V., Subramonyam, H., Wang, J., & Wortman Vaughan, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580652 · Cited by 86
Seeing beyond reading: a survey on visual text analytics
Alencar, A. B., de Oliveira, M. C. F., & Paulovich, F. V. (2012) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1071 · Cited by 84 · cited 1×
“History Flow [68] and DocuViz [70] are examples of visualization techniques for studying co-authorship patterns (cooperation and conflicts) in collaborative writing.”
Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
Dang, H., Benharrak, K., Lehmann, F., & Buschek, D. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545672 · Cited by 84 · cited 1×
“One example is DramatVis Personae (DVP) [32], a visualization system for mitigating nuanced social biases in creative writing.”
BackgroundPoemage: Visualizing the Sonic Topology of a Poem
McCurdy, N., Lein, J. G., Coles, K., & Meyer, M. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467811 · Cited by 78 · cited 1×
“Two authors of this paper individually reviewed the policies and open-coded the recommendations from the policies.”
BackgroundTracking changes in collaborative writing: edits, visibility and group maintenance
Birnholtz, J., & Ibara, S. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145325 · Cited by 78 · cited 1×
“While specific instructions vary between policies, all encourage authors to be transparent and disclose the use of AI.”
BackgroundThemeDelta: Dynamic Segmentations over Temporal Topic Models
Gad, S., Javed, W., Ghani, S., Elmqvist, N., Ewing, T., Hampton, K. N., & Ramakrishnan, N. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2388208 · Cited by 63 · cited 1×
“As a starting point, we reviewed existing guidelines for using generative AI models from the U.S. Copyright Office [53], The Author’s Guild [28], educational organizations such as the Modern Language Association [3], several creative writing publishers (e.g., [55]), and academic venues and…”
MethodSelf-citationUsing text animated transitions to support navigation in document histories
Chevalier, F., Dragicevic, P., Bezerianos, A., & Fekete, J. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753427 · Cited by 62 · cited 1×
“While specific instructions vary between policies, all encourage authors to be transparent and disclose the use of AI.”
BackgroundSelf-citationEvaluating Human-Language Model Interaction
Lee, M., Srivastava, M., Hardy, A., Thickstun, J., Durmus, E., Paranjape, A., Gerard-Ursin, I., Li, X. L., Ladhak, F., Rong, F., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.09746 · Cited by 61
Kim, J., Suh, S., Chilton, L. B., & Xia, H. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595996 · Cited by 61 · cited 1×
“Examples of such works include support for metaphor creation [23, 38], automatic text summarization [13], interaction with literary styles [59], and support for the iterative revising process [16, 17].”
BackgroundYim, S., Wang, D., Olson, J., Vu, V., & Warschauer, M. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998356 · Cited by 59 · cited 1×
“This included aspects such as when, how, and to what extent LLMs can be used in the creative authoring process.”
BackgroundAnthropomorphization of AI: Opportunities and Risks
Deshpande, A., Rajpurohit, T., Narasimhan, K., & Kalyan, A. (2023) · Proceedings of the Natural Legal Language Processing Workshop 2023 · doi:10.18653/v1/2023.nllp-1.1 · Cited by 57
Kim, T. S., Lee, Y., Chang, M., & Kim, J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606833 · Cited by 56
Portrayal: Leveraging NLP and Visualization for Analyzing Fictional Characters
Hoque, M. N., Ghai, B., Kraus, K., & Elmqvist, N. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596000 · Cited by 37 · cited 4×
“Prompting LLMs is a relatively new activity for writers.”
BackgroundInfluentialSelf-citationDramatVis Personae: Visual Text Analytics for Identifying Social Biases in Creative Writing
Hoque, M. N., Ghai, B., & Elmqvist, N. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533526 · Cited by 28 · cited 3×
“Prompting LLMs is a relatively new activity for writers.”
BackgroundSelf-citationTracing and Visualizing Human-ML/AI Collaborative Processes through Artifacts of Data Work
Rogers, J., & Crisan, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580819 · Cited by 25 · cited 1×
“Finally, there is ambiguity in the description of what needs to be reported and how writers should do that.”
BackgroundSupporting Reference Imagery for Digital Drawing
Holinaty, J., Jacobson, A., & Chevalier, F. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00276 · Cited by 15
Self-citationInteracting with Literary Style through Computational Tools
Sterman, S., Huang, E., Liu, V., & Paulos, E. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376730 · Cited by 14 · cited 1×
“Writer concerns for LLMs include agency and ownership [51, 72], ethics and plagia-rism [72], and lackluster, stereotyped text [25, 51].”
BackgroundAnthropomorphization of AI: Opportunities and RisksPreprint
Deshpande, A., Rajpurohit, T., Narasimhan, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.14784 · Cited by 14
Visualizing authorship and contribution of collaborative writing in e-learning environments
Torres, J., García, S., & Peláez, E. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3301275.3302328 · Cited by 9 · cited 1×
“This included aspects such as when, how, and to what extent LLMs can be used in the creative authoring process.”
BackgroundCrowdTrace: Visualizing Provenance in Distributed Sensemaking
Li, T., Belghith, Y., North, C. L., & Luther, K. (2020) · Visualization · doi:10.1109/vis47514.2020.00045 · Cited by 7 · cited 1×
“There was a consensus among policies and guidelines, irrespective of their domain (government, creative, academic, and education), on the need to report the extent of contribution from AI in the creation of content.”
BackgroundVisualization Tools for Collaborative Systems: A Systematic Review
Vásquez-Bermúdez, M., Sanz, C. V., Zangara, M. A., & Hidalgo, J. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-88262-4_8 · Cited by 6 · cited 1×
“There was a consensus among policies and guidelines, irrespective of their domain (government, creative, academic, and education), on the need to report the extent of contribution from AI in the creation of content.”
BackgroundDataopsy: Scalable and Fluid Visual Exploration using Aggregate Query Sculpting
Hoque, M. N., & Elmqvist, N. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326594 · Cited by 4
Self-citationAddressing Linguistic Disadvantage in Writing Articles for International English Medium Journals
Abdelhadi, A. (2021) · SunText Review of Economics & Business · doi:10.51737/2766-4775.2021.050 · Cited by 3
Research works printed but not linked: 6
- Richard Brath. 2021. Visualizing with Text. CRC Press, Boca Raton, FL, USA.
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- Association for Computing Machinery. 2023. ACM Policy on Authorship. https://www.acm.org/publications/policies/new-acm-policy-on-authorship Accessed: 2023-08-04.
- Springer Nature. 2023. Nature Portfolio. https://www.nature.com/nature-portfolio/editorial-policies/ai
- QuillJS. 2021. QuillJS: a Rich Text Editor. https://quilljs.com Accessed: 2022-02-04.
Cited by
Pang, R. Y., Schroeder, H., Smith, K. S., Barocas, S., Xiao, Z., Tseng, E., & Bragg, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713726 · Cited by 146
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
“Examples include specifying distinct human-AI cooperative roles [102], implementing predetermined control levels through interface design [148], or structuring interaction based on distinct task phases [164].”
InfluentialCo-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
Friction: Deciphering Writing Feedback into Writing Revisions through LLM-Assisted Reflection
Zhang, C., Ju, K., Bidoshi, P., Yen, Y.-C. G., & Rzeszotarski, J. M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714316 · Cited by 48
Weng, L., Wang, X., Lu, J., Feng, Y., Liu, Y., Feng, H., Huang, D., & Chen, W. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3567131 · Cited by 82
“Therefore, numerous visual interfaces have been introduced to facilitate LLM response exploration [27,41].”
Metadata
- Authors
- Hoque, M. N., Mashiat, T., Ghai, B., Shelton, C. D., Chevalier, F., Kraus, K., & Elmqvist, N.
- Affiliations
- University of Maryland, College Park (US)
- George Mason University (US)
- Amazon (United States) (US)
- Department of English, University of Maryland, United States
- University of Toronto (CA)
- Aarhus University (DK)
- ORCID
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-15
- OpenAlex
- W4396827151
- Cited by
- 48
- References
- 61
- Citations by year
- 2026: 22 · 2025: 24 · 2024: 2
- FWCI
- 21.90
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- Scopus (Elsevier) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- NSF (IIS-2211628)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Keywords
- large language models, AI-assisted writing, interactive visualization, writer agency, publisher policies, hallmarks, creative writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.