Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Advances in AI, particularly large language models (LLMs), can transform creative work. When developing a new idea, LLMs can help designers gather information, find competitors, and generate alternatives. However, LLM responses tend to be long-winded or contain inaccuracies, placing a burden on users to carefully synthesize information. In our formative studies with 52 students and five instructors, we find that novice designers typically lack guidance on how to compose prompts, reflect critically on LLM responses, and extract key information to help shape an idea. Building on these insights, we explore an alternative approach for interacting with LLMs, not via chat, but rather through structured templates. Collaborative design templates are a well-established strategy for helping novices think, organize information, and reflect on creative work. Developed as a digital whiteboard plugin, Jamplate integrates LLM capabilities into design templates, streamlining the collection and organization of user-generated content and LLM responses within the template structure. In a preliminary study with 8 novice designers, participants expressed that Jamplate’s reflective questions and in-situ guidance improved their ability to think critically and improve ideas more effectively. We discuss the potential of designing LLM-enhanced templates to instigate critical reflection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274 · cited 1×
“Writing effective LLM prompts can require significant trial-and-error and expert strategies, such as creating a chain of prompts that work together [69, 70, 72].”
BackgroundNasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
Using Affinity Diagrams to Evaluate Interactive Prototypes
Lucero, A. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22668-2_19 · Cited by 376
Reflecting on reflection: framing a design landscape
Fleck, R., & Fitzpatrick, G. (2010) · Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction · doi:10.1145/1952222.1952269 · Cited by 319
An empirical evaluation of GitHub copilot's code suggestions
Nguyen, N., & Nadi, S. (2022) · Proceedings of the 19th International Conference on Mining Software Repositories · doi:10.1145/3524842.3528470 · Cited by 313 · cited 1×
“One strategy has been to integrate LLMs directly into users’ existing workspaces to provide in-situ assistance, such as within text editors [26, 42], coding IDEs [52, 62], and digital canvases [22, 51], to name a few.”
BackgroundDuffy, M. C., & Azevedo, R. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.05.041 · Cited by 283
PromptChainer: Chaining Large Language Model Prompts through Visual Programming
Wu, T., Jiang, E., Donsbach, A., Gray, J., Molina, A., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519729 · Cited by 198 · cited 2×
“Writing effective LLM prompts can require significant trial-and-error and expert strategies, such as creating a chain of prompts that work together [69, 70, 72].”
BackgroundPromptMaker: Prompt-based Prototyping with Large Language Models
Jiang, E., Olson, K., Toh, E., Molina, A., Donsbach, A., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503564 · Cited by 157
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606756 · Cited by 151
Research works printed but not linked: 48
- Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023). · arXiv
- Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction 24, 6 (2008), 574–594.
- 10.1145/2702123.2702234 · DOI · Paper page
- Virginia Braun and Victoria Clarke. 2012. Thematic analysis.American Psychological Association.
- 10.1080/00220970209602054 · DOI · Paper page
- Robert G Cooper and Elko J Kleinschmidt. 1987. New products: what separates winners from losers?Journal of product innovation management 4, 3 (1987), 169–184.
- 10.1080/10400419.2016.1195614 · DOI
- Ton de Jong. 2006. Scaffolds for Scientific Discovery. In Handling complexity in learning environments: Theory and research, Jan Elen and Richard E Clark (Eds.). Emerald Group Publishing, Chapter 6, 107–128.
- 10.1145/3527927.3535197 · DOI · Paper page
- Robert Duron, Barbara Limbach, and Wendy Waugh. 2006. Critical thinking framework for any discipline. International Journal of teaching and learning in higher education 17, 2 (2006), 160–166.
- 10.1111/caim.12225 · DOI
- 10.1145/3536221.3556578 · DOI
- Catherine D Ennis, Juanita Ross, and Ang Chen. 1992. The role of value orientations in curricular decision making: A rationale for teachers’ goals and expectations. Research quarterly for exercise and sport 63, 1 (1992), 38–47.
- Robert Ennis. 2011. Critical thinking: Reflection and perspective Part II. Inquiry: Critical thinking across the Disciplines 26, 2 (2011), 5–19.
- Figma. 2023. Figma template gallery. https://www.figma.com/templates/ "[Online; accessed 9-October-2023]".
- Figma. 2023. Jambot. https://www.figma.com/community/widget/1274481464484630971 "[Online; accessed 9-October-2023]".
- Katy Ilonka Gero, Vivian Liu, and Lydia Chilton. 2022. Sparks: Inspiration for science writing using language models. In Designing interactive systems conference. 1002–1019.
- Jerry Hausman, Gregory Leonard, and J Douglas Zona. 1994. Competitive analysis with differenciated products. Annales d’Economie et de Statistique (1994), 159–180.
- 10.1108/JHTI-01-2021-0021 · DOI · Paper page
- William Huitt. 1998. Critical thinking: An overview. Educational psychology interactive 3, 6 (1998), 34–50.
- 10.1145/3469096.3469869 · DOI
- Peiling Jiang, Jude Rayan, Steven P Dow, and Haijun Xia. 2023. Graphologue: Exploring Large Language Model Responses with Interactive Diagrams. arXiv preprint arXiv:2305.11473 (2023). · arXiv
- David Kember, Doris YP Leung, Alice Jones, Alice Yuen Loke, Jan McKay, Kit Sinclair, Harrison Tse, Celia Webb, Frances Kam Yuet Wong, Marian Wong, 2000. Development of a questionnaire to measure the level of reflective thinking. Assessment & evaluation in higher education 25, 4 (2000), 381–395.
- 10.1145/3491102.3501931 · DOI · Paper page
- David R Krathwohl. 2002. A revision of Bloom’s taxonomy: An overview. Theory into practice 41, 4 (2002), 212–218.
- Susanne P Lajoie and Sharon J Derry. 2013. Computers as cognitive tools. Routledge.
- Joe YF Lau. 2011. An introduction to critical thinking and creativity: Think more, think better. John Wiley & Sons.
- Susan Lin, Jeremy Warner, JD Zamfirescu-Pereira, Matthew G Lee, Sauhard Jain, Michael Xuelin Huang, Piyawat Lertvittayakumjorn, Shanqing Cai, Shumin Zhai, Björn Hartmann, 2024. Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation. arXiv preprint arXiv:2401.10838 (2024). · arXiv
- Ken Liu. 2023. Sudowrite. https://www.sudowrite.com/ "[Online; accessed 9-October-2023]".
- Jennifer A Livingston. 2003. Metacognition: An Overview. (2003).
- 10.1145/3325480.3325483 · DOI
- Stephen MacNeil Zijian Ding Kexin Quan Thomas j Parashos Yajie Sun and Steven P Dow. 2021. Framing Creative Work: Helping Novices Frame Better Problems through Interactive Scaffolding. In Creativity and Cognition. 1–10. · DOI
- 10.1145/3591196.3593337 · DOI
- Miro. [n. d.]. Miro Templates Library. https://miro.com/templates/ "[Online; accessed 9-October-2023]".
- Miro. 2023. Miro AI. https://miro.com/ai/ "[Online; accessed 9-October-2023]".
- Notion. 2024. Notion Templates. https://www.notion.so/templates "[Online; accessed 27-January-2024]".
- Fred Paas, Alexander Renkl, and John Sweller. 2004. Cognitive load theory: Instructional implications of the interaction between information structures and cognitive architecture. Instructional science 32, 1/2 (2004), 1–8.
- Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In International Conference on Machine Learning. PMLR, 8821–8831.
- Barry L Shoop and Eugene K Ressler. 2011. Developing the critical thinking, creativity and innovation of undergraduate engineering students. International Journal of Engineering Education 27, 5 (2011), 1072.
- Ira Shor. 1980. Critical teaching and everyday life. Black Rose Books Limited.
- 10.1145/2984511.2984578 · DOI · Paper page
- 10.1145/3512290.3528700 · DOI · Paper page
- 10.3390/jintelligence7040023 · DOI · Paper page
- Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023). · arXiv
- Wouter Van Joolingen. 1998. Cognitive tools for discovery learning. International journal of artificial intelligence in education 10 (1998), 385–397.
- 10.1145/1718918.1718938 · DOI · Paper page
- 10.1145/3491102.3517582 · DOI · Paper page
- Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI ’22). Association for Computing Machinery, New York, NY, USA, 841–852.
Cited by
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
Tao, S., Liang, I., Peng, C., Wang, Z., Palani, S., & Dow, S. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714211 · Cited by 21
Self-citationInk and Individuality: Crafting a Personalised Narrative in the Age of LLMs
Wasi, A. T., Islam, R., & Islam, M. R. (2024) · Proceedings of the Third Workshop on Intelligent and Interactive Writing Assistants · doi:10.1145/3690712.3690724 · Cited by 2
Metadata
- Authors
- Xu, X. (., Yin, J., Gu, C., Mar, J., Zhang, S., E, J. L., & Dow, S. P.
- Venue
- Proceedings of the 29th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2024-03-18
- Pages
- 907-921
- OpenAlex
- W4393970811
- Cited by
- 48
- References
- 15
- FWCI
- 63.82
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection. https://app.cochat.ai/papers/10.1145/3640543.3645196
- The paper
- Xu, X. (., Yin, J., Gu, C., Mar, J., Zhang, S., E, J. L., & Dow, S. P. (2024). Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection. Proceedings of the 29th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3640543.3645196
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.