IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation
The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.
Abstract
Due to the remarkable content generation capabilities, large language models (LLMs) have demonstrated potential in supporting early-stage conceptual design. However, current interaction paradigms often struggle to effectively facilitate multi-round idea exploration and selection, leading to random outputs, unclear iterations, and cognitive overload. To address these challenges, we propose a human-AI co-ideation framework aimed at tracking the evolution of design ideas. This framework leverages a structured idea representation, an analogy-based reasoning mechanism and interactive visualization techniques. It guides both designers and AI to systematically explore design spaces. We also develop a prototype system, IdeationWeb, which integrates an intuitive, mind map-like visual interface and interactive methods to support co-ideation. Our user study validates the framework’s feasibility, demonstrating enhanced collaboration and creativity between humans and AI. Furthermore, we identified collaborative design patterns from user behaviors, providing valuable insights for future human-AI interaction design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This view is consistent with prior work showing that reflection is central to human-AI creative collaboration [17, 20, 56].”
From How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters (2026) · cites this paper as [56]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709 · cited 1×
“High inter-rater reliability was confrmed via intraclass correlation coefcient (ICC) analysis [59]: novelty (ICC = 0.800, p .001**), completeness (ICC = 0.821, p .001**), and quality (ICC = 0.798, p .001**).”
InfluentialAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“Early studies predominantly relied on retrieving analogies from pre-collected design knowledge bases [46, 75, 93, 101].”
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Likert Scale: Explored and Explained
Joshi, A., Kale, S., Chandel, S., & Pal, D. (2015) · British Journal of Applied Science & Technology · doi:10.9734/bjast/2015/14975 · Cited by 3,870 · cited 1×
“Last, participants were asked to complete self-reported ratings using a 7-point Likert scale [54] in 5 minutes to assess their design processes with AI, including the Creativity Support Index (CSI) questionnaire [21], the assessment of overall human-AI interaction experience (controllable,…”
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
Explainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317 · cited 1×
“Limited controllability and interpretability can erode human trust in AI systems [64, 84, 98].”
Research works printed but not linked: 6
- Ahmed M Abuzuraiq and Philippe Pasquier. 2024. Towards Personalizing Generative AI with Small Data for Co-Creation in the Visual Arts.. In IUI Workshops.
- Jonathan Hey Julie Linsey Alice M Agogino and Kristin L Wood. 2008. Analogies and metaphors in creative design. International Journal of Engineering Education 24 2 (2008) 283.
- Jeff Wai Tak Kan, John S Gero, et al. 2009. A generic tool to study human design activities. In DS 58-9: Proceedings of ICED 09, the 17th International Conference on Engineering Design, Vol. 9, Human Behavior in Design, Palo Alto, CA, USA, 24.-27.08. 2009. 123–134.
- Jingoog Kim, Mary Lou Maher, and Safat Siddiqui. 2021. Studying the Impact of AI-based Inspiration on Human Ideation in a Co-Creative Design System.. In Iui workshops.
- Max Kreminski and Michael Mateas. 2021. Reflective Creators.. In ICCC. 309–318.
- Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Fei Xia Ed Chi Quoc V Le Denny Zhou et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35 (2022) 24824–24837.
Cited by
Wang, P., Khinvasara, Y., Creijghton, G. J., Scholing, T., Wang, Y., Zhou, Z., Childs, P., & Yin, Y. (2025) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060425100127 · Cited by 31
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790300 · Cited by 5
“This view is consistent with prior work showing that reflection is central to human–AI creative collaboration [17, 20, 56].”
Santos, S. D. O., Alves, R. D. M., Oliveira, F., & Araujo, F. I. S. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.16160 · Cited by 4
“LLMs have also been employed to encourage creativity and productivity in design processes, particularly among students [89], as well as to track the evolution of design ideas and guide designers in more effective solution exploration [81].”
Cai, R., Guo, M., Yang, S., Li, R., Wu, X., & Li, J. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3771654 · Cited by 3
“This stems from users over relying on GenAI’s high probability outputs, which act as new cognitive anchors, shifting creative dependency from traditional paradigms to AI generated content in a “fixation displacement" [33, 40, 54, 58, 73].”
DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAI
Peng, X., Haldar, D., Mackay, W. E., & Koch, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791036 · Cited by 10
Metadata
- Authors
- Shen, H., Shen, L., Wu, W., & Zhang, K.
- Affiliations
- Zhejiang University (CN)
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-19
- OpenAlex
- W4409748878
- Cited by
- 24
- References
- 112
- Citations by year
- 2026: 21 · 2025: 3
- FWCI
- 89.29
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Innovative Approaches in Technology and Social Development
- Keywords
- human-AI co-creation, design ideation, AI-assisted design, design process
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation. https://app.cochat.ai/papers/10.1145/3706598.3713375
- The paper
- Shen, H., Shen, L., Wu, W., & Zhang, K. (2025). IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706598.3713375
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.