CoChat

Is Your Prompt Detailed Enough? Exploring the Effects of Prompt Coaching on Users' Perceptions, Engagement, and Trust in Text-to-Image Generative AI Tools

Open access
Chen, Cheng, Lee, Sangwook, Jang, Eunchae, Sundar, S. Shyam · 2024 · Proceedings of the Second International Symposium on Trustworthy Autonomous Systems

The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.

Abstract

Prompts are the primary medium for interacting with generative AI tools. However, users often lack sufficient prompt literacy and motivation to fully benefit from these tools. To address this, we explore whether introducing prompt coaching into a chatbot-based generative AI interface can influence users’ perceptions and engagement of prompting, and further affect their trust in the system. In a user study (N = 132), we found that prompt coaching encourages users to specify more details in their prompts, even though over half initially believed their prompts were sufficient. Furthermore, the coach increased users’ cognitive elaboration, which was associated with higher perceived trust calibration. However, prompt coaching did not significantly enhance UX, although users in the coaching absent condition expressed a strong need for prompt assistance for better user experience. These findings have practical implications for the design of trustworthy and responsible generative AI interfaces.

Overview

Integrity signals

Registry

Crossref · 10.1145/3686038.3686060

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 53 references

Research works printed but not linked: 12

  1. 10.1207/S15327663JCP13-1&2_12 · doi:10.1207/s15327663jcp13-1&2_12 · Paper page
  2. Tiago Bianchi. 2024. Interest in generative AI on Google searches from February 2022 to June 2024 worldwide. statista. Retrieved from https://www.statista.com/statistics/1367868/generative-ai-google-searches-worldwide/
  3. Hai Dang, Lukas Mecke, Florian Lehmann, Sven Goller, and Daniel Buschek. 2022. How to prompt? Opportunities and challenges of zero- and few-shot learning for human-AI interaction in creative applications of generative models. Retrieved June 6, 2024 from http://arxiv.org/abs/2209.01390 · arXiv
  4. Sangwook Lee. 2024. Prompting in Generative AI: The effects of providing user control over display of advertisements in generative AI response. Pennsylvania State University, State College, PA, USA.
  5. Mengqi Liao. 2024. Does conversationality and verifiability affect trust in content generated by ChatGPT? Pennsylvania State University, State College, PA, USA.
  6. Robert W. Maloy and Sai Gattupalli. 2024. Prompt literacy. EdTechnica (2024), 209–215.
  7. Ethan Mollick. 2024. Co-intelligence: Living and working with AI. Portfolio.
  8. Heather O'Brien. 2016. Theoretical perspectives on user engagement. Why engagement matters: Cross-disciplinary perspectives of user engagement in digital media (2016), 1–26.
  9. Joe O'Connor and Jacob Andreas. 2021. What context features can transformer language models use? arXiv preprint arXiv:2106.08367 (2021). · arXiv
  10. Gordon Pennycook and David G. Rand. 2021. The psychology of fake news. Trends in cognitive sciences 25, 5 (2021), 388–402.
  11. Sheizf Rafaeli. 1988. From new media to communication. Sage annual review of communication research: Advancing communication science 16, 1 (1988), 110–134.
  12. 10.1093/jcmc · doi:10.1093/jcmc

Cited by

See all 23

Metadata

Authors
Chen, C., Lee, S., Jang, E., & Sundar, S. S.
Affiliations
  • Elon University (US)
  • University of Colorado Boulder (US)
  • Pennsylvania State University (US)
Venue
Proceedings of the Second International Symposium on Trustworthy Autonomous Systems
Publisher
ACM
Published
2024-09-16
Pages
1-12
OpenAlex
W4402659120
Cited by
21
References
50
Citations by year
2026: 10 · 2025: 11
FWCI
6.75
Type
conference paper
Language
en
Open access
Locations
International Symposium on Trustworthy Autonomous Systems (TAS) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
Keywords
prompt literacy, text-to-image generative AI, chatbot interface, user trust, user engagement, cognitive elaboration, user experience

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Is Your Prompt Detailed Enough? Exploring the Effects of Prompt Coaching on Users' Perceptions, Engagement, and Trust in Text-to-Image Generative AI Tools. https://app.cochat.ai/papers/10.1145/3686038.3686060
The paper
Chen, C., Lee, S., Jang, E., & Sundar, S. S. (2024). Is Your Prompt Detailed Enough? Exploring the Effects of Prompt Coaching on Users' Perceptions, Engagement, and Trust in Text-to-Image Generative AI Tools. Proceedings of the Second International Symposium on Trustworthy Autonomous Systems. https://doi.org/10.1145/3686038.3686060

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.