IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation
The DOI matches its Crossref record; 117 of the 117 references it cites were found in a registry or an index.
Abstract
Due to the remarkable content generation capabilities, large language models (LLMs) have demonstrated potential in supporting early-stage conceptual design. However, current interaction paradigms often struggle to effectively facilitate multi-round idea exploration and selection, leading to random outputs, unclear iterations, and cognitive overload. To address these challenges, we propose a human-AI co-ideation framework aimed at tracking the evolution of design ideas. This framework leverages a structured idea representation, an analogy-based reasoning mechanism and interactive visualization techniques. It guides both designers and AI to systematically explore design spaces. We also develop a prototype system, IdeationWeb, which integrates an intuitive, mind map-like visual interface and interactive methods to support co-ideation. Our user study validates the framework’s feasibility, demonstrating enhanced collaboration and creativity between humans and AI. Furthermore, we identified collaborative design patterns from user behaviors, providing valuable insights for future human-AI interaction design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This view is consistent with prior work showing that reflection is central to human-AI creative collaboration [17, 20, 56].”
From How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters (2026) · cites this paper as [56]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709 · cited 1×
“High inter-rater reliability was confrmed via intraclass correlation coefcient (ICC) analysis [59]: novelty (ICC = 0.800, p .001**), completeness (ICC = 0.821, p .001**), and quality (ICC = 0.798, p .001**).”
InfluentialAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“Early studies predominantly relied on retrieving analogies from pre-collected design knowledge bases [46, 75, 93, 101].”
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Likert Scale: Explored and Explained
Joshi, A., Kale, S., Chandel, S., & Pal, D. (2015) · British Journal of Applied Science & Technology · doi:10.9734/bjast/2015/14975 · Cited by 3,870 · cited 1×
“Last, participants were asked to complete self-reported ratings using a 7-point Likert scale [54] in 5 minutes to assess their design processes with AI, including the Creativity Support Index (CSI) questionnaire [21], the assessment of overall human-AI interaction experience (controllable,…”
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
Explainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317 · cited 1×
“Limited controllability and interpretability can erode human trust in AI systems [64, 84, 98].”
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274 · cited 1×
“During this process, the complexity of prompt iteration should be minimized [116], allowing designers to focus more on creative thinking.”
The situated function–behaviour–structure framework
Gero, J. S., & Kannengiesser, U. (2004) · Design Studies · doi:10.1016/j.destud.2003.10.010 · Cited by 1,192 · cited 1×
“…through three interrelated basic constructs: function (F), describing the teleology of an object; behavior (B), describing what the object does, either derived from or expected from its structure; and structure (S), describing components of the object and their compositional relationships [32].”
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Metrics for measuring ideation effectiveness
Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003) · Design Studies · doi:10.1016/s0142-694x(02)00034-0 · Cited by 1,095 · cited 2×
“…processes with AI, including the Creativity Support Index (CSI) questionnaire [21], the assessment of overall human-AI interaction experience (controllable, transparent, cognitive load, collaboration, trust), and the evaluation for AI ideas (novelty, variety, value, relevance, surprise) [92].”
Jansson, D. G., & Smith, S. M. (1991) · Design Studies · doi:10.1016/0142-694x(91)90003-f · Cited by 1,087
The Anchoring-and-Adjustment Heuristic: Why the Adjustments Are Insufficient
Epley, N., & Gilovich, T. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01704.x · Cited by 920
Art and the science of generative AI
Epstein, Z., Hertzmann, A., the Investigators of Human Creativity, Akten, M., Farid, H., Fjeld, J., Frank, M. R., Groh, M., Herman, L., Leach, N., et al. (2023) · Science · doi:10.1126/science.adh4451 · Cited by 788
Haleem, A., Javaid, M., & Singh, R. P. (2022) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100089 · Cited by 694 · cited 1×
“Currently, generative artifcial intelligence (GenAI), powered by LLMs, has been widely applied in multiple felds [26, 43], particularly showcasing signifcant potential in enhancing conceptual design [61, 73, 120].”
Explainability for Large Language Models: A Survey
Zhao, H., Chen, H., Yang, F., Liu, N., Deng, H., Cai, H., Wang, S., Yin, D., & Du, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3639372 · Cited by 681 · cited 1×
“The inherent limitations of LLMs in controllability and interpretability [117] compel designers to refne prompts to obtain desirable responses [68], diverting their attention from deeper design thinking.”
The evolution, challenges, and future of knowledge representation in product design systems
Chandrasegaran, S. K., Ramani, K., Sriram, R. D., Horváth, I., Bernard, A., Harik, R. F., & Gao, W. (2013) · Computer-Aided Design · doi:10.1016/j.cad.2012.08.006 · Cited by 667 · cited 1×
“Design representation plays a vital role in creative processes [10, 17, 66].”
Design Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501825 · Cited by 639 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
Design Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
Quantifying the Creativity Support of Digital Tools through the Creativity Support Index
Cherry, E., & Latulipe, C. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2617588 · Cited by 498 · cited 1×
“…using a 7-point Likert scale [54] in 5 minutes to assess their design processes with AI, including the Creativity Support Index (CSI) questionnaire [21], the assessment of overall human-AI interaction experience (controllable, transparent, cognitive load, collaboration, trust), and the evaluation…”
Wu, T., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517582 · Cited by 483 · cited 1×
“By integrating chain-of-thought [109] and few-shot learning [14] into LLMs, we allow designers to generate new ideas through specifying source ideas and analogical distances.”
Gangemi, A., & Presutti, V. (2009) · Handbook on Ontologies · doi:10.1007/978-3-540-92673-3_10 · Cited by 472
Pollatsek, A., & Well, A. D. (1995) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.21.3.785 · Cited by 399 · cited 1×
“We employed a counterbalanced design [82], randomly pairing LLM tools (IdeationWeb or Chat-GPT) with task themes (Task A or Task B) and distributing them equally among participants to ensure fairness.”
Parallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367 · cited 2×
“First, designers should be able to rapidly generate, retrieve and investigate alternative design possibilities in parallel, avoiding premature convergence [24, 102].”
Design, analogy, and creativity
Gael, A. K. (1997) · IEEE Expert · doi:10.1109/64.590078 · Cited by 355 · cited 1×
“Design-by-Analogy (DbA) [37, 78] is a widely adopted method that leverages analogical reasoning to draw inspiration from the source domain and generate new design opportunities within the target domain [77].”
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342 · cited 3×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
The Effects of Generative AI on Design Fixation and Divergent Thinking
Wadinambiarachchi, S., Kelly, R. M., Pareek, S., Zhou, Q., & Velloso, E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642919 · Cited by 320 · cited 1×
“These generative systems hybridize diferent concepts to produce diverse and unpredictable ideas, thereby mitigating cognitive biases and expanding imaginative exploration [94, 103].”
Process models in design and development
Wynn, D. C., & Clarkson, P. J. (2018) · Research in Engineering Design · doi:10.1007/s00163-017-0262-7 · Cited by 319 · cited 1×
“…logical pathways within individual design entities, leveraging attribution and iterative cycles to drive the designer’s cognitive process [111]; (3) covering multiple domains and facilitating the generation of mapping relationships between diferent entities for comparison, analogy, and…”
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Chan, J., Fu, K., Schunn, C., Cagan, J., Wood, K., & Kotovsky, K. (2011) · Journal of Mechanical Design · doi:10.1115/1.4004396 · Cited by 288 · cited 1×
“Far distances enhance the novelty and variability of ideas, while near distances improve their feasibility and usefulness [16, 39, 95].”
Function–behavior–structure paths and their role in analogy-based design
Qian, L., & Gero, J. S. (1996) · Artificial Intelligence for Engineering Design, Analysis and Manufacturing · doi:10.1017/s0890060400001633 · Cited by 283 · cited 1×
“The Function-Behavior-Structure (FBS) model is a widely adopted structured design representation in conceptual design [83].”
Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376739 · Cited by 271 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Reviewing reflection: on the use of reflection in interactive system design
Baumer, E. P. S., Khovanskaya, V., Matthews, M., Reynolds, L., Schwanda Sosik, V., & Gay, G. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598598 · Cited by 266 · cited 1×
“Previous studies have highlighted that interactive system design should facilitate experiential learning from process histories to improve future behaviors [7, 36].”
García Peñalvo, F. J., & Vázquez Ingelmo, A. (2023) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2023.07.006 · Cited by 235 · cited 1×
“With their extensive knowledge and instant generation capabilities, LLMs enable rapid access and organization of relevant information, developing it into various new concepts [31].”
Design Principles for Generative AI Applications
Weisz, J. D., He, J., Muller, M., Hoefer, G., Miles, R., & Geyer, W. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642466 · Cited by 232 · cited 2×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making
Rastogi, C., Zhang, Y., Wei, D., Varshney, K. R., Dhurandhar, A., & Tomsett, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512930 · Cited by 216 · cited 2×
“A disparity always persists between the rapid generation of AI and the slower pace of human cognition, exacerbating anchoring bias and insufcient adjustments [85], where designers pre-maturely accept a relatively reasonable yet suboptimal initial idea and make superfcial modifcations [25].”
Humans as Creativity Gatekeepers: Are We Biased Against AI Creativity?
Magni, F., Park, J., & Chao, M. M. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-023-09910-x · Cited by 201 · cited 1×
“Our study showed that participants with more domain expertise experienced poorer control, aligning with previous fndings on cognitive biases in human-AI interactions [11, 74, 85].”
How good are good ideas? Correlates of design creativity
Goldschmidt, G., & Tatsa, D. (2005) · Design Studies · doi:10.1016/j.destud.2005.02.004 · Cited by 189 · cited 1×
“High-quality conceptual solutions are widely recognized as foundational sources of creativity [38], supporting the creation of innovative and efective work [88, 96].”
AI Creativity and the Human-AI Co-creation Model
Wu, Z., Ji, D., Yu, K., Zeng, X., Wu, D., & Shidujaman, M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-78462-1_13 · Cited by 186 · cited 2×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
The role of memory in creative ideation
Benedek, M., Beaty, R. E., Schacter, D. L., & Kenett, Y. N. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00158-z · Cited by 173 · cited 1×
“The formation of creative ideas is grounded in memory processes [8].”
An automatic method for constructing machining process knowledge base from knowledge graph
Guo, L., Yan, F., Li, T., Tao, Y., & Lu, Y. (2021) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102222 · Cited by 172 · cited 1×
“…FBS model in design activities, including: (1) establishing a consistent structure that lays the foundation for unifed coding of design protocols [41]; (2) abstracting logical pathways within individual design entities, leveraging attribution and iterative cycles to drive the designer’s…”
An artificial intelligence based data-driven approach for design ideation
Chen, L., Wang, P., Dong, H., Shi, F., Han, J., Guo, Y., Childs, P. R. N., Xiao, J., & Wu, C. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.02.009 · Cited by 170 · cited 1×
“Chen et al. [20] employed a semantic ideation network and synthesized images to provide inspirational stimuli.”
A framework for studying design thinking through measuring designers’ minds, bodies and brains
Gero, J. S., & Milovanovic, J. (2020) · Design Science · doi:10.1017/dsj.2020.15 · Cited by 170 · cited 1×
“…designer’s cognitive process [111]; (3) covering multiple domains and facilitating the generation of mapping relationships between diferent entities for comparison, analogy, and coordination [33, 72]; and (4) reducing solution space ambiguity while improving both de-sign efciency and quality [29].”
Moreno, D. P., Hernández, A. A., Yang, M. C., Otto, K., Hölttä‐Otto, K., Linsey, J., Wood, K. L., & Linden, A. (2013) · Design Studies · doi:10.1016/j.destud.2013.11.002 · Cited by 165 · cited 1×
“Design-by-Analogy (DbA) [37, 78] is a widely adopted method that leverages analogical reasoning to draw inspiration from the source domain and generate new design opportunities within the target domain [77].”
DANE: Fostering Creativity in and through Biologically Inspired Design
Vattam, S., Wiltgen, B., Helms, M., Goel, A. K., & Yen, J. (2011) · Design Creativity 2010 · doi:10.1007/978-0-85729-224-7_16 · Cited by 164 · cited 1×
“Early studies predominantly relied on retrieving analogies from pre-collected design knowledge bases [46, 75, 93, 101].”
Sparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Understanding Representation in Design
Bødker, S. (1998) · Human-Computer Interaction · doi:10.1207/s15327051hci1302_1 · Cited by 159 · cited 1×
“Design representation plays a vital role in creative processes [10, 17, 66].”
Suh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148 · cited 1×
“Lu-minate [97] utilizes scatter plots to visualize AI responses based on key dimensions, assisting users to navigate design spaces and articulate preferences.”
FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design
Jeon, Y., Jin, S., Shih, P. C., & Han, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445093 · Cited by 145 · cited 1×
“This collaboration has demonstrated surprising creativity [22, 51], with particularly notable advantages in conceptual design.”
Crowdsourcing inspiration: Using crowd generated inspirational stimuli to support designer ideation
Goucher-Lambert, K., & Cagan, J. (2019) · Design Studies · doi:10.1016/j.destud.2019.01.001 · Cited by 132 · cited 1×
“Far distances enhance the novelty and variability of ideas, while near distances improve their feasibility and usefulness [16, 39, 95].”
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Shaer, O., Cooper, A., Mokryn, O., Kun, A. L., & Ben Shoshan, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642414 · Cited by 130 · cited 1×
“Previous studies have substantiated AI’s capability to elevate productivity and design quality [53, 58, 90].”
An Enactive Model of Creativity for Computational Collaboration and Co-creation
Davis, N. M., Hsiao, C.-P., Popova, Y. B., & Magerko, B. S. (2015) · Springer series on cultural computing · doi:10.1007/978-1-4471-6681-8_7 · Cited by 127
Comparing the Ideation Quality of Humans With Generative Artificial Intelligence
Joosten, J., Bilgram, V., Hahn, A., & Totzek, D. (2024) · IEEE Engineering Management Review · doi:10.1109/emr.2024.3353338 · Cited by 126
Abstraction and analogy‐making in artificial intelligence
Mitchell, M. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14619 · Cited by 125 · cited 1×
“To achieve this goal, we also draw inspiration from prior work on structured forms [19, 67], analogical reasoning [52, 76], and information visualization [23, 87, 114].”
Creative sketching partner: an analysis of human-AI co-creativity
Karimi, P., Rezwana, J., Siddiqui, S., Maher, M. L., & Dehbozorgi, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377522 · Cited by 122 · cited 1×
“For example, Karimi et al. [57] developed a creative sketching partner that recognized hand-drawn sketches and presented AI-generated variants with varying visual and conceptual similarity.”
Andreasen, M. M., Hansen, C. T., & Cash, P. J. (2015) · Springer eBooks · doi:10.1007/978-3-319-19839-2 · Cited by 121 · cited 1×
“Conceptual design is a critical stage in creative activities [5].”
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions
Wang, Y., Shen, S., & Lim, B. Y. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581402 · Cited by 120 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
Ontology-based design information extraction and retrieval
LI, Z., & RAMANI, K. (2007) · Artificial Intelligence for Engineering Design, Analysis and Manufacturing · doi:10.1017/s0890060407070199 · Cited by 115 · cited 1×
“By formalizing hierarchical structures of information (e.g., attributes, relationships, etc.), designers can efciently identify, evaluate, and retrieve knowledge [12, 62] to systematically map and navigate the design space [9].”
PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
Wang, Z., Huang, Y., Song, D., Ma, L., & Zhang, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642803 · Cited by 115
Guiding data-driven design ideation by knowledge distance
Luo, J., Sarica, S., & Wood, K. L. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106873 · Cited by 104 · cited 1×
“For example, Luo et al. [71] developed a knowledge-based expert system that guides stimulus retrieval and combination by altering knowledge distances.”
Generative Pre-Trained Transformer for Design Concept Generation: An Exploration
Zhu, Q., & Luo, J. (2022) · Proceedings of the Design Society · doi:10.1017/pds.2022.185 · Cited by 101 · cited 1×
“Currently, generative artifcial intelligence (GenAI), powered by LLMs, has been widely applied in multiple felds [26, 43], particularly showcasing signifcant potential in enhancing conceptual design [61, 73, 120].”
Conceptual Design Generation Using Large Language Models
Ma, K., Grandi, D., McComb, C., & Goucher-Lambert, K. (2023) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2023-116838 · Cited by 99
A framework of artificial intelligence augmented design support
Liao, J., Hansen, P., & Chai, C. (2020) · Human–Computer Interaction · doi:10.1080/07370024.2020.1733576 · Cited by 94 · cited 1×
“AI contributes to design ideation through three primary mechanisms: creation, empathy triggering, and engagement [63].”
AI Song Contest: Human-AI Co-Creation in Songwriting
Huang, C.-Z. A., Koops, H. V., Newton-Rex, E., Dinculescu, M., & Cai, C. J. (2020) · arXiv · doi:10.48550/arxiv.2010.05388 · Cited by 90 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Hu, X., Fu, H., Wang, J., Wang, Y., Li, Z., Xu, R., Lu, Y., Jin, Y., Pan, L., & Lan, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.14255 · Cited by 89 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
Liao, Q. V., Subramonyam, H., Wang, J., & Wortman Vaughan, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580652 · Cited by 86 · cited 1×
“Limited controllability and interpretability can erode human trust in AI systems [64, 84, 98].”
Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI
Verheijden, M. P., & Funk, M. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585680 · Cited by 83 · cited 1×
“First, designers should be able to rapidly generate, retrieve and investigate alternative design possibilities in parallel, avoiding premature convergence [24, 102].”
(1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807916 · Cited by 81
MetaMap: Supporting Visual Metaphor Ideation through Multi-dimensional Example-based Exploration
Kang, Y., Sun, Z., Wang, S., Huang, Z., Wu, Z., & Ma, X. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445325 · Cited by 78 · cited 1×
“Additionally, mind-map-like designs have been shown to facilitate conceptual development [56].”
MYCRUNCHGPT: A LLM ASSISTED FRAMEWORK FOR SCIENTIFIC MACHINE LEARNING
Kumar, V., Gleyzer, L., Kahana, A., Shukla, K., & Karniadakis, G. E. (2023) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2023049518 · Cited by 78
AI in design idea development: A workshop on creativity and human-AI collaboration
Figoli, F. A., Rampino, L., & Mattioli, F. (2022) · Proceedings of DRS · doi:10.21606/drs.2022.414 · Cited by 77
Osone, H., Lu, J.-L., & Ochiai, Y. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3450391 · Cited by 74 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
A constraint-based understanding of design spaces
Biskjaer, M. M., Dalsgaard, P., & Halskov, K. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598533 · Cited by 73 · cited 1×
“By formalizing hierarchical structures of information (e.g., attributes, relationships, etc.), designers can efciently identify, evaluate, and retrieve knowledge [12, 62] to systematically map and navigate the design space [9].”
"We Need Structured Output": Towards User-centered Constraints on Large Language Model Output
Liu, M. X., Liu, F., Fiannaca, A. J., Koo, T., Dixon, L., Terry, M., & Cai, C. J. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650756 · Cited by 73
Trustworthy AI Development Guidelines for Human System Interaction
Wickramasinghe, C. S., Marino, D. L., Grandio, J., & Manic, M. (2020) · 2020 13th International Conference on Human System Interaction (HSI) · doi:10.1109/hsi49210.2020.9142644 · Cited by 71 · cited 1×
“Recently, scholars have introduced several design guidelines for human-AI co-creation systems [4, 86, 107, 108, 110], emphasizing their concerns about the complexities of collaborative design processes.”
Envisioning Information Access Systems: What Makes for Good Tools and a Healthy Web?
Shah, C., & Bender, E. M. (2024) · ACM Transactions on the Web · doi:10.1145/3649468 · Cited by 66 · cited 1×
“There is insufcient evidence to confrm that they possess genuine “reasoning” or cognitive abilities [91].”
Evaluating the impact of Idea-Inspire 4.0 on analogical transfer of concepts
Siddharth, L., & Chakrabarti, A. (2018) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060418000136 · Cited by 59 · cited 1×
“Early studies predominantly relied on retrieving analogies from pre-collected design knowledge bases [46, 75, 93, 101].”
Why the standard definition of creativity fails to capture the creative act
Abraham, A. (2024) · Theory & Psychology · doi:10.1177/09593543241290232 · Cited by 57
Zhou, Z., Li, J., Zhang, Z., Yu, J., & Duh, H. B. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2370635 · Cited by 55
Does Analogical Distance Affect Performance of Ideation?
Srinivasan, V., Song, B., Luo, J., Subburaj, K., Elara, M. R., Blessing, L., & Wood, K. (2018) · Journal of Mechanical Design · doi:10.1115/1.4040165 · Cited by 54 · cited 1×
“Far distances enhance the novelty and variability of ideas, while near distances improve their feasibility and usefulness [16, 39, 95].”
Goucher-Lambert, K., Gyory, J. T., Kotovsky, K., & Cagan, J. (2020) · Journal of Mechanical Design · doi:10.1115/1.4046077 · Cited by 54 · cited 1×
“However, during iterative design processes, such limited static datasets struggle to quickly respond to real-time shifts in context and user intent [40].”
Systematic synthesis of design prompts for large language models in conceptual design
Tian, Y., Liu, A., Dai, Y., Nagato, K., & Nakao, M. (2024) · CIRP Annals · doi:10.1016/j.cirp.2024.04.062 · Cited by 54 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
A Step Beyond to Overcome Design Fixation: A Design-by-Analogy Approach
Moreno, D. P., Yang, M. C., Hernández, A. A., Linsey, J. S., & Wood, K. L. (2015) · Design Computing and Cognition '14 · doi:10.1007/978-3-319-14956-1_34 · Cited by 52 · cited 1×
“Design-by-Analogy (DbA) [37, 78] is a widely adopted method that leverages analogical reasoning to draw inspiration from the source domain and generate new design opportunities within the target domain [77].”
Supporting Sensemaking of Large Language Model Outputs at Scale
Gero, K. I., Swoopes, C., Gu, Z., Kummerfeld, J. K., & Glassman, E. L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642139 · Cited by 52 · cited 1×
“Moreover, users may become overwhelmed by the accumulation of prompts and AI-generated outputs during extended exploration [35].”
An ontology-based support for product conceptual design
Chang, X., Sahin, A., & Terpenny, J. P. (2008) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2008.03.004 · Cited by 48 · cited 1×
“In distributed and collaborative work environments, a unifed representation provides a shared cognitive foundation for design teams [18].”
Hoque, M. N., Mashiat, T., Ghai, B., Shelton, C. D., Chevalier, F., Kraus, K., & Elmqvist, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641895 · Cited by 48 · cited 1×
“For instance, Hoque et al. [47] developed the HallMark system, which externalized the contributions of both humans and AI through bar and pie charts, alongside a time-line of interaction history.”
Decision Making Strategies and Team Efficacy in Human-AI Teams
Munyaka, I., Ashktorab, Z., Dugan, C., Johnson, J., & Pan, Q. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579476 · Cited by 42
Boonprakong, N., Chen, X., Davey, C. E., Tag, B., & Dingler, T. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580917 · Cited by 41
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
Lin, D. C.-E., & Martelaro, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641920 · Cited by 39 · cited 1×
“[65, 121].”
Filtering and informing the design space: Towards design-space thinking
Halskov, K., & Lundqvist, C. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3434462 · Cited by 38 · cited 1×
“Innovative design processes critically depend on the generation and selective refnement of ideas [44].”
PrompTHis: Visualizing the Process and Influence of Prompt Editing During Text-to-Image Creation
Guo, Y., Shao, H., Liu, C., Xu, K., & Yuan, X. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3408255 · Cited by 38 · cited 1×
“Guo et al. [42] proposed the Image Variant Graph to visualize prompt-editing histories and corresponding image variants in text-to-image tasks, guiding users in optimizing prompts and planning creative workfows.”
Umwelt: Accessible Structured Editing of Multi-Modal Data Representations
Zong, J., Pineros, I. P., Chen, M. (., Hajas, D., & Satyanarayan, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641996 · Cited by 37
TypeDance: Creating Semantic Typographic Logos from Image through Personalized Generation
Xiao, S., Wang, L., Ma, X., & Zeng, W. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642185 · Cited by 35 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Generative AI Tools in Design Fields: Opportunities and Challenges in the Ideation Process
Akverdi, C., & Baykal, G. E. (2024) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3677045.3685445 · Cited by 35 · cited 1×
“It aligns with the prior research positioning AI’s role in accelerating ideation and broadening creative perspectives [3].”
A Function-Behaviour-Structure design methodology for adaptive production systems
Sanderson, D., Chaplin, J., & Ratchev, S. (2019) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-019-03823-x · Cited by 31 · cited 1×
“It generates structured responses (DG1) based on the FBS model, which is widely adopted in product and engineering design [55, 89], and facilitates rapid idea iterations through analogical reasoning (DG2).”
Magical Brush: A Symbol-Based Modern Chinese Painting System for Novices
Xu, H., Chen, S., & Zhang, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581429 · Cited by 31 · cited 1×
“Co-creation with AI is increasingly being applied in various creative felds, such as writing [34, 81], music composition [49, 70, 115], and visual art [45, 80, 113].”
Spinneret: Aiding Creative Ideation through Non-Obvious Concept Associations
Bae, S. S., Kwon, O.-H., Chandrasegaran, S., & Ma, K.-L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376746 · Cited by 30 · cited 1×
“Spinneret [6] delivers contextual suggestions to users through knowledge graphs located around conceptual nodes.”
Fu, X., Zhang, H., Jing, L., Fan, X., Lu, C., & Jiang, S. (2024) · Computers & Industrial Engineering · doi:10.1016/j.cie.2024.109994 · Cited by 29 · cited 1×
“…designer’s cognitive process [111]; (3) covering multiple domains and facilitating the generation of mapping relationships between diferent entities for comparison, analogy, and coordination [33, 72]; and (4) reducing solution space ambiguity while improving both de-sign efciency and quality [29].”
Interpreting Idea Maps: Pairwise Comparisons Reveal What Makes Ideas Novel
Ahmed, F., Ramachandran, S. K., Fuge, M., Hunter, S. T., & Miller, S. R. (2018) · Journal of Mechanical Design · doi:10.1115/1.4041856 · Cited by 28 · cited 1×
“They rated on a 7-point Likert scale across three dimensions: nov-elty, completeness, and quality [2, 92].”
Thinking with Interactive Artifacts: Reflection as a Concept in Design Outcomes
Ghajargar, M., & Wiberg, M. (2018) · Design Issues · doi:10.1162/desi_a_00485 · Cited by 27 · cited 1×
“Previous studies have highlighted that interactive system design should facilitate experiential learning from process histories to improve future behaviors [7, 36].”
TRENDS: A Content-Based Information Retrieval System for Designers
Bouchard, C., Omhover, J.-F., Mougenot, C., Aoussat, A., & Westerman, S. J. (2008) · Springer eBooks · doi:10.1007/978-1-4020-8728-8_31 · Cited by 27
Fu, K. K., Chan, J., Cagan, J., Kotovsky, K., Schunn, C. D., & Wood, K. L. (2012) · doi:10.1115/detc2012-70420 · Cited by 27
Suno: potential, prospects, and trends
Yu, J., Wu, S., Lu, G., Li, Z., Zhou, L., & Zhang, K. (2024) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400299 · Cited by 27
Self-citationTracing and Visualizing Human-ML/AI Collaborative Processes through Artifacts of Data Work
Rogers, J., & Crisan, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580819 · Cited by 25 · cited 1×
“To achieve this goal, we also draw inspiration from prior work on structured forms [19, 67], analogical reasoning [52, 76], and information visualization [23, 87, 114].”
IdeateRelate: An Examples Gallery That Helps Creators Explore Ideas in Relation to Their Own
Xu, X. (., Xiong, R., Wang, B., Min, D., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479496 · Cited by 21 · cited 2×
“IdeateRelate [114] constructs afnity matrices based on conceptual distance, ofering similarity cues to support inspiration discovery.”
Interactive AI Alignment: Specification, Process, and Evaluation Alignment
Terry, M., Kulkarni, C., Wattenberg, M., Dixon, L., & Morris, M. R. (2023) · arXiv · doi:10.48550/arxiv.2311.00710 · Cited by 20
Ding, Z. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640544.3645241 · Cited by 18 · cited 1×
“To achieve this goal, we also draw inspiration from prior work on structured forms [19, 67], analogical reasoning [52, 76], and information visualization [23, 87, 114].”
Why the Standard Definition of Creativity Fails to Capture the Creative ActPreprint
Abraham, A. (2023) · Qeios · doi:10.32388/ls88g9 · Cited by 15
Constraint management for concept ideation in conceptual design
Liu, A., Wang, Y., Teo, I., & Lu, S. C.-Y. (2018) · CIRP journal of manufacturing science and technology · doi:10.1016/j.cirpj.2018.11.006 · Cited by 13 · cited 1×
“Design representation plays a vital role in creative processes [10, 17, 66].”
PatternGPT :A Pattern-Driven Framework for Large Language Model Text Generation
Xiao, L., Shan, X., & Chen, X. (2023) · International Conference on Computing and Pattern Recognition (ICCPR) · doi:10.1145/3633637.3633648 · Cited by 13 · cited 1×
“Recent research primarily focuses on model optimization [48, 112] and prompt refnement strategies [69, 99, 104, 105] to help users converge on more satisfactory responses, but often neglects to encourage broad early-stage exploration.”
Constrained FBS knowledge cell model, representation, and applications for conceptual design
Ma, J., Hu, J., Feng, J.-F., Qi, J., & Peng, Y. (2015) · Proceedings of the Institution of Mechanical Engineers Part C Journal of Mechanical Engineering Science · doi:10.1177/0954406215585366 · Cited by 12 · cited 1×
“…designer’s cognitive process [111]; (3) covering multiple domains and facilitating the generation of mapping relationships between diferent entities for comparison, analogy, and coordination [33, 72]; and (4) reducing solution space ambiguity while improving both de-sign efciency and quality [29].”
Camera Obscurer: Generative Art for Design Inspiration
Singh, D., Rajcic, N., Colton, S., & McCormack, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16667-0_4 · Cited by 11
A KNOWLEDGE-BASED IDEATION APPROACH FOR BIO-INSPIRED DESIGN
Chen, L., Cai, Z., Jiang, Z., Long, Q., Sun, L., Childs, P., & Zuo, H. (2023) · Proceedings of the Design Society · doi:10.1017/pds.2023.24 · Cited by 11 · cited 1×
“To achieve this goal, we also draw inspiration from prior work on structured forms [19, 67], analogical reasoning [52, 76], and information visualization [23, 87, 114].”
Data-Driven Design-by-Analogy: State of the Art
Jiang, S., Hu, J., & Luo, J. (2021) · ASME International Computers in Engineering Conference and Engineering Database Symposium · doi:10.1115/detc2021-68669 · Cited by 6
Research works printed but not linked: 6
- Ahmed M Abuzuraiq and Philippe Pasquier. 2024. Towards Personalizing Generative AI with Small Data for Co-Creation in the Visual Arts.. In IUI Workshops.
- Jonathan Hey Julie Linsey Alice M Agogino and Kristin L Wood. 2008. Analogies and metaphors in creative design. International Journal of Engineering Education 24 2 (2008) 283.
- Jeff Wai Tak Kan, John S Gero, et al. 2009. A generic tool to study human design activities. In DS 58-9: Proceedings of ICED 09, the 17th International Conference on Engineering Design, Vol. 9, Human Behavior in Design, Palo Alto, CA, USA, 24.-27.08. 2009. 123–134.
- Jingoog Kim, Mary Lou Maher, and Safat Siddiqui. 2021. Studying the Impact of AI-based Inspiration on Human Ideation in a Co-Creative Design System.. In Iui workshops.
- Max Kreminski and Michael Mateas. 2021. Reflective Creators.. In ICCC. 309–318.
- Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Fei Xia Ed Chi Quoc V Le Denny Zhou et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35 (2022) 24824–24837.
Cited by
Wang, P., Khinvasara, Y., Creijghton, G. J., Scholing, T., Wang, Y., Zhou, Z., Childs, P., & Yin, Y. (2025) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060425100127 · Cited by 31
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790300 · Cited by 5
“This view is consistent with prior work showing that reflection is central to human–AI creative collaboration [17, 20, 56].”
Santos, S. D. O., Alves, R. D. M., Oliveira, F., & Araujo, F. I. S. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.16160 · Cited by 4
“LLMs have also been employed to encourage creativity and productivity in design processes, particularly among students [89], as well as to track the evolution of design ideas and guide designers in more effective solution exploration [81].”
Cai, R., Guo, M., Yang, S., Li, R., Wu, X., & Li, J. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3771654 · Cited by 3
“This stems from users over relying on GenAI’s high probability outputs, which act as new cognitive anchors, shifting creative dependency from traditional paradigms to AI generated content in a “fixation displacement" [33, 40, 54, 58, 73].”
DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAI
Peng, X., Haldar, D., Mackay, W. E., & Koch, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791036 · Cited by 13
Metadata
- Authors
- Shen, H., Shen, L., Wu, W., & Zhang, K.
- Affiliations
- Zhejiang University (CN)
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-19
- OpenAlex
- W4409748878
- Cited by
- 24
- References
- 112
- Citations by year
- 2026: 21 · 2025: 3
- FWCI
- 89.29
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Innovative Approaches in Technology and Social Development
- Keywords
- human-AI co-creation, design ideation, AI-assisted design, design process
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.