CoChat

Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection

Open access
Xu, Xiaotong (Tone), Yin, Jiayu, Gu, Catherine, Mar, Jenny, Zhang, Sydney, E, Jane L., Dow, Steven P. · 2024 · Proceedings of the 29th International Conference on Intelligent User Interfaces
Cited by 48

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

Advances in AI, particularly large language models (LLMs), can transform creative work. When developing a new idea, LLMs can help designers gather information, find competitors, and generate alternatives. However, LLM responses tend to be long-winded or contain inaccuracies, placing a burden on users to carefully synthesize information. In our formative studies with 52 students and five instructors, we find that novice designers typically lack guidance on how to compose prompts, reflect critically on LLM responses, and extract key information to help shape an idea. Building on these insights, we explore an alternative approach for interacting with LLMs, not via chat, but rather through structured templates. Collaborative design templates are a well-established strategy for helping novices think, organize information, and reflect on creative work. Developed as a digital whiteboard plugin, Jamplate integrates LLM capabilities into design templates, streamlining the collection and organization of user-generated content and LLM responses within the template structure. In a preliminary study with 8 novice designers, participants expressed that Jamplate’s reflective questions and in-situ guidance improved their ability to think critically and improve ideas more effectively. We discuss the potential of designing LLM-enhanced templates to instigate critical reflection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3640543.3645196

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 48

  1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023). · arXiv
  2. Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction 24, 6 (2008), 574–594.
  3. 10.1145/2702123.2702234 · DOI · Paper page
  4. Virginia Braun and Victoria Clarke. 2012. Thematic analysis.American Psychological Association.
  5. 10.1080/00220970209602054 · DOI · Paper page
  6. Robert G Cooper and Elko J Kleinschmidt. 1987. New products: what separates winners from losers?Journal of product innovation management 4, 3 (1987), 169–184.
  7. 10.1080/10400419.2016.1195614 · DOI
  8. Ton de Jong. 2006. Scaffolds for Scientific Discovery. In Handling complexity in learning environments: Theory and research, Jan Elen and Richard E Clark (Eds.). Emerald Group Publishing, Chapter 6, 107–128.
  9. 10.1145/3527927.3535197 · DOI · Paper page
  10. Robert Duron, Barbara Limbach, and Wendy Waugh. 2006. Critical thinking framework for any discipline. International Journal of teaching and learning in higher education 17, 2 (2006), 160–166.
  11. 10.1111/caim.12225 · DOI
  12. 10.1145/3536221.3556578 · DOI
  13. Catherine D Ennis, Juanita Ross, and Ang Chen. 1992. The role of value orientations in curricular decision making: A rationale for teachers’ goals and expectations. Research quarterly for exercise and sport 63, 1 (1992), 38–47.
  14. Robert Ennis. 2011. Critical thinking: Reflection and perspective Part II. Inquiry: Critical thinking across the Disciplines 26, 2 (2011), 5–19.
  15. Figma. 2023. Figma template gallery. https://www.figma.com/templates/ "[Online; accessed 9-October-2023]".
  16. Figma. 2023. Jambot. https://www.figma.com/community/widget/1274481464484630971 "[Online; accessed 9-October-2023]".
  17. Katy Ilonka Gero, Vivian Liu, and Lydia Chilton. 2022. Sparks: Inspiration for science writing using language models. In Designing interactive systems conference. 1002–1019.
  18. Jerry Hausman, Gregory Leonard, and J Douglas Zona. 1994. Competitive analysis with differenciated products. Annales d’Economie et de Statistique (1994), 159–180.
  19. 10.1108/JHTI-01-2021-0021 · DOI · Paper page
  20. William Huitt. 1998. Critical thinking: An overview. Educational psychology interactive 3, 6 (1998), 34–50.
  21. 10.1145/3469096.3469869 · DOI
  22. Peiling Jiang, Jude Rayan, Steven P Dow, and Haijun Xia. 2023. Graphologue: Exploring Large Language Model Responses with Interactive Diagrams. arXiv preprint arXiv:2305.11473 (2023). · arXiv
  23. David Kember, Doris YP Leung, Alice Jones, Alice Yuen Loke, Jan McKay, Kit Sinclair, Harrison Tse, Celia Webb, Frances Kam Yuet Wong, Marian Wong, 2000. Development of a questionnaire to measure the level of reflective thinking. Assessment & evaluation in higher education 25, 4 (2000), 381–395.
  24. 10.1145/3491102.3501931 · DOI · Paper page
  25. David R Krathwohl. 2002. A revision of Bloom’s taxonomy: An overview. Theory into practice 41, 4 (2002), 212–218.
  26. Susanne P Lajoie and Sharon J Derry. 2013. Computers as cognitive tools. Routledge.
  27. Joe YF Lau. 2011. An introduction to critical thinking and creativity: Think more, think better. John Wiley & Sons.
  28. Susan Lin, Jeremy Warner, JD Zamfirescu-Pereira, Matthew G Lee, Sauhard Jain, Michael Xuelin Huang, Piyawat Lertvittayakumjorn, Shanqing Cai, Shumin Zhai, Björn Hartmann, 2024. Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation. arXiv preprint arXiv:2401.10838 (2024). · arXiv
  29. Ken Liu. 2023. Sudowrite. https://www.sudowrite.com/ "[Online; accessed 9-October-2023]".
  30. Jennifer A Livingston. 2003. Metacognition: An Overview. (2003).
  31. 10.1145/3325480.3325483 · DOI
  32. Stephen MacNeil Zijian Ding Kexin Quan Thomas j Parashos Yajie Sun and Steven P Dow. 2021. Framing Creative Work: Helping Novices Frame Better Problems through Interactive Scaffolding. In Creativity and Cognition. 1–10. · DOI
  33. 10.1145/3591196.3593337 · DOI
  34. Miro. [n. d.]. Miro Templates Library. https://miro.com/templates/ "[Online; accessed 9-October-2023]".
  35. Miro. 2023. Miro AI. https://miro.com/ai/ "[Online; accessed 9-October-2023]".
  36. Notion. 2024. Notion Templates. https://www.notion.so/templates "[Online; accessed 27-January-2024]".
  37. Fred Paas, Alexander Renkl, and John Sweller. 2004. Cognitive load theory: Instructional implications of the interaction between information structures and cognitive architecture. Instructional science 32, 1/2 (2004), 1–8.
  38. Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In International Conference on Machine Learning. PMLR, 8821–8831.
  39. Barry L Shoop and Eugene K Ressler. 2011. Developing the critical thinking, creativity and innovation of undergraduate engineering students. International Journal of Engineering Education 27, 5 (2011), 1072.
  40. Ira Shor. 1980. Critical teaching and everyday life. Black Rose Books Limited.
  41. 10.1145/2984511.2984578 · DOI · Paper page
  42. 10.1145/3512290.3528700 · DOI · Paper page
  43. 10.3390/jintelligence7040023 · DOI · Paper page
  44. Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023). · arXiv
  45. Wouter Van Joolingen. 1998. Cognitive tools for discovery learning. International journal of artificial intelligence in education 10 (1998), 385–397.
  46. 10.1145/1718918.1718938 · DOI · Paper page
  47. 10.1145/3491102.3517582 · DOI · Paper page
  48. Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI ’22). Association for Computing Machinery, New York, NY, USA, 841–852.

Cited by

See all 48

Metadata

Authors
Xu, X. (., Yin, J., Gu, C., Mar, J., Zhang, S., E, J. L., & Dow, S. P.
Venue
Proceedings of the 29th International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2024-03-18
Pages
907-921
OpenAlex
W4393970811
Cited by
48
References
15
FWCI
63.82
Type
conference paper
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection. https://app.cochat.ai/papers/10.1145/3640543.3645196
The paper
Xu, X. (., Yin, J., Gu, C., Mar, J., Zhang, S., E, J. L., & Dow, S. P. (2024). Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection. Proceedings of the 29th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3640543.3645196

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.