Fluid Transformers and Creative Analogies: Exploring Large Language Models’ Capacity for Augmenting Cross-Domain Analogical Creativity
Open accessAbstract
Cross-domain analogical reasoning is a core creative ability that can be challenging for humans. Recent work has shown some proofs-of-concept of Large language Models’ (LLMs) ability to generate cross-domain analogies. However, the reliability and potential usefulness of this capacity for augmenting human creative work has received little systematic exploration. In this paper, we systematically explore LLMs capacity to augment cross-domain analogical reasoning. Across three studies, we found: 1) LLM-generated cross-domain analogies were frequently judged as helpful in the context of a problem reformulation task (median 4 out of 5 helpfulness rating), and frequently (∼ 80% of cases) led to observable changes in problem formulations, and 2) there was an upper bound of ∼ 25% of outputs being rated as potentially harmful, with a majority due to potentially upsetting content, rather than biased or toxic content. These results demonstrate the potential utility — and risks — of LLMs for augmenting cross-domain analogical creativity.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Draxler et al.'s work showed that increased AI support corresponded with decreases in users' perceived control.
“This finding aligns with Draxler et al. 's work [33], which showed that increased AI support corresponded with decreases in users' perceived control.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [33]
The cited paper’s Results (§4.2.3; page unavailable) examine ratings of LLM-generated analogies, not users’ perceived control. Searches for “Draxler,” “perceived control,” and AI support found no passage reporting that increased support corresponded with decreased control. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Dilemmas in a general theory of planning
Rittel, H. W. J., & Webber, M. M. (1973) · Policy Sciences · doi:10.1007/bf01405730 · Cited by 16,338 · cited 1× · see citing works
“However, note that our screeners were emphasizing minimizing false negatives, and many problematic situations may inherently contain content that may be upsetting to some (since they, by definition, describe situations that people want to transform to “better" states [20, 59, 65]).”
BackgroundOn the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 5× · see citing works
“…previous analyses of the ethics of LLMs based not just on direct harm to the user but also participation in harmful and oppressive systems of power [2, 6], we consider the following primary categories of harm: 1) perpetuating hegemonic systems of oppression via uncritical incorporation of harmful…”
BackgroundMethodInfluentialLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2× · see citing works
“To develop analogies for this study, we followed a prompt-based learning paradigm [52] (also called in-context learning in machine learning research [8]): rather than fine-tuning GPT-3 for analogy generation (e.”
MethodSchema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 2,955 · cited 4× · see citing works
“…to stimulate memory retrieval of diverse domains — to assist with fixation [62, 63] and surface similarity bias in analogical retrieval [36, 37, 41, 50] — and then subsequent integration of LLM-assisted “deep dives" via explanations of potential mappings, generating variations of ideas within…”
BackgroundResultInfluentialDuncker, K. (1945) · Psychological Monographs · doi:10.1037/h0093599 · Cited by 2,938 · see citing works
Technology Brokering and Innovation in a Product Development Firm
Hargadon, A. B., & Sutton, R. I. (1997) · Administrative Science Quarterly · doi:10.2307/2393655 · Cited by 2,900 · see citing works
Gick, M. L., & Holyoak, K. J. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90013-4 · Cited by 2,552 · cited 1× · see citing works
“Similarly, Webb et al [90] replicated the classic analogical problem solving paradigm from Gick and Holyoak [40] with the text-davinci-003 version of GPT-3, showing that the model was able to generate a convergence solution for Duncker’s radiation problem when prompted with the analogous generals…”
MethodCreativity in the design process: co-evolution of problem–solution
Dorst, K., & Cross, N. (2001) · Design Studies · doi:10.1016/s0142-694x(01)00009-6 · Cited by 2,357 · see citing works
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daum'e, H., & Wallach, H. (2020) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2005.14050 · Cited by 1,975
Proceedings of the 29th Annual Conference of the Cognitive Science Society
Rohde, H., Kehler, A., & Elman, J. L. (2007) · Cognitive Science · Cited by 1,782 · see citing works
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · cited 1× · see citing works
“and oppressive systems of power [2, 6], we consider the following primary categories of harm: 1) perpetuating hegemonic systems of oppression via uncritical incorporation of harmful stereotypes and biases in LLM outputs, 2) unknowingly framing problems in a way that leads to solutions that violate laws, and 3) experie…”
BackgroundPrompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 1× · see citing works
“We iteratively improved our prompt through prompt engineering [79], which involves crafting a prompt for a LLM, issuing the prompt, and evaluating the response from an LLM.”
MethodSynectics: The Development of Creative Capacity
Gordon, W. J. J. (1961) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 862 · see citing works
Structure-mapping: A theoretical framework for analogy
GENTNER, D. (1983) · Cognitive Science · doi:10.1016/s0364-0213(83)80009-3 · Cited by 816 · see citing works
The Influence and Value of Analogical Thinking during New Product Ideation
Dahl, D. W., & Moreau, P. (2002) · Journal of Marketing Research · doi:10.1509/jmkr.39.1.47.18930 · Cited by 630 · see citing works
Constraint relaxation and chunk decomposition in insight problem solving.
Knoblich, G., Ohlsson, S., Haider, H., & Rhenius, D. (1999) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.25.6.1534 · Cited by 607 · see citing works
The structure of Design Problem Spaces
Goel, V., & Pirolli, P. L. T. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_3 · Cited by 560 · see citing works
Kaplan, C. A., & Simon, H. A. (1990) · Cognitive Psychology · doi:10.1016/0010-0285(90)90008-r · Cited by 530 · see citing works
How scientists think: On-line creativity and conceptual change in science.
Dunbar, K. N. (2004) · American Psychological Association eBooks · doi:10.1037/10227-017 · Cited by 482 · see citing works
Engineering of Creativity: Introduction to TRIZ Methodology of Inventive Problem Solving
Savransky, S. D. (2000) · Thammasat University Digital Collections · Cited by 473 · see citing works
Christensen, B. T., & Schunn, C. D. (2007) · Memory & Cognition · doi:10.3758/bf03195939 · Cited by 438 · see citing works
The Woman Worked as a Babysitter: On Biases in Language Generation
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1339 · Cited by 431 · cited 1× · see citing works
“Analyzing the bias and stereotype-based categories of harm typically involves consideration of specific social categories at risk of harm from biases, such as gender [84], or disability [52].”
BackgroundDorst, K. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/10096.001.0001 · Cited by 415 · see citing works
Wordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374 · see citing works
Parallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367 · see citing works
Chan, J., Fu, K. K., Schunn, C. D., Cagan, J., Wood, K. L., & Kotovsky, K. (2011) · Journal of Mechanical Design · doi:10.1115/1.4004396 · Cited by 289 · see citing works
Self-citationSocial Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.487 · Cited by 274 · see citing works
Fu, K. K., Chan, J., Cagan, J., Kotovsky, K., Schunn, C. D., & Wood, K. L. (2013) · Journal of Mechanical Design · doi:10.1115/1.4023158 · Cited by 259 · see citing works
Self-citationCreative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172983 · Cited by 257 · see citing works
Proceedings of the 25th Annual Meeting of the Cognitive Science Society, 2003
Fay, N., Garrod, S., Lee, J., & Oberlander, J. (2003) · Cited by 227 · see citing works
Modality and representation in analogy
Linsey, J., Wood, K. L., & Markman, A. B. (2008) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060408000061 · Cited by 186 · see citing works
Expertise in engineering design
Cross, N., & Cross, A. C. (1998) · Research in Engineering Design · doi:10.1007/bf01607156 · Cited by 173 · see citing works
DANE: Fostering Creativity in and through Biologically Inspired Design
Vattam, S. S., Wiltgen, B., Helms, M. E., Goel, A. K., & Yen, J. (2010) · Springer eBooks · doi:10.1007/978-0-85729-224-7_16 · Cited by 170 · see citing works
Exploring Uncharted Territory: Knowledge Search Processes in the Origination of Outlier Innovation
Kneeland, M. K., Schilling, M. A., & Aharonson, B. S. (2019) · Organization Science · doi:10.1287/orsc.2019.1328 · Cited by 166 · see citing works
Sparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161 · see citing works
Do the best design ideas (really) come from conceptually distant sources of inspiration?
Chan, J., Dow, S. P., & Schunn, C. D. (2014) · Design Studies · doi:10.1016/j.destud.2014.08.001 · Cited by 148 · see citing works
Self-citationMetaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · see citing works
Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119 · see citing works
Language Models are Few-shot Multilingual Learners
Winata, G. I., Madotto, A., Lin, Z., Liu, R., Yosinski, J., & Fung, P. (2021) · Workshop on Multilingual Representation Learning (MRL) · doi:10.18653/v1/2021.mrl-1.1 · Cited by 115 · see citing works
Vendetti, M. S., Wu, A., & Holyoak, K. J. (2014) · Psychological Science · doi:10.1177/0956797613518079 · Cited by 104 · see citing works
Providing Timely Examples Improves the Quantity and Quality of Generated Ideas
Siangliulue, P., Chan, J., Gajos, K. Z., & Dow, S. P. (2015) · Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition · doi:10.1145/2757226.2757230 · Cited by 99 · see citing works
Self-citationGenerative Pre-Trained Transformer for Design Concept Generation: An Exploration
Zhu, Q., & Luo, J. (2022) · Proceedings of the Design Society · doi:10.1017/pds.2022.185 · Cited by 94 · see citing works
Analogy in Scientific Discovery: The Case of Johannes Kepler
Gentner, D. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0605-8_2 · Cited by 93 · see citing works
Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers
Zhu, Q., Zhang, X., & Luo, J. (2023) · Journal of Mechanical Design · doi:10.1115/1.4056598 · Cited by 89 · see citing works
Improving Crowd Innovation with Expert Facilitation
Chan, J., Dang, S., & Dow, S. P. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2820023 · Cited by 86 · see citing works
Self-citationInnovation in Analogical Design: A Model-Based Approach
Bhatta, S. R., Goel, A. K., & Prabhakar, S. (1994) · Springer eBooks · doi:10.1007/978-94-011-0928-4_4 · Cited by 84 · see citing works
Dissociating language and thought in large language models
Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2023) · arXiv · doi:10.48550/arxiv.2301.06627 · Cited by 80 · see citing works
Comparison promotes learning and transfer of relational categories.
Kurtz, K. J., Boukrina, O. V., & Gentner, D. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0031847 · Cited by 78 · see citing works
The importance of iteration in creative conceptual combination
Chan, J., & Schunn, C. D. (2015) · Cognition · doi:10.1016/j.cognition.2015.08.008 · Cited by 78 · see citing works
Self-citationOsone, H., Lu, J.-L., & Ochiai, Y. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3450391 · Cited by 74 · cited 1× · see citing works
“For example, researchers have explored the potential of LLMs to replicate or assist creative writing tasks such as metaphor generation [9, 31], science writing [32] and storytelling [3, 18, 25, 62, 66, 69, 75].”
BackgroundAccelerating Innovation Through Analogy Mining
Hope, T., Chan, J., Kittur, A., & Shahaf, D. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098038 · Cited by 64 · see citing works
Self-citationDistributed analogical idea generation: inventing with crowds
Yu, L., Kittur, A., & Kraut, R. E. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557371 · Cited by 60 · see citing works
Writing Stories with Help from Recurrent Neural Networks
Roemmele, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9810 · Cited by 59 · see citing works
MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding
Chakrabarty, T., Zhang, X., Muresan, S., & Peng, N. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.336 · Cited by 51 · see citing works
Semantically Far Inspirations Considered Harmful?
Chan, J., Siangliulue, P., McDonald, D. Q., Liu, R., Moradinezhad, R., Aman, S., Solovey, E., Gajos, K. Z., & Dow, S. P. (2017) · Creativity and Cognition · doi:10.1145/3059454.3059455 · Cited by 48 · see citing works
Self-citationAugmenting Scientific Creativity with an Analogical Search Engine
Kang, H. B., Qian, X., Hope, T., Shahaf, D., Chan, J., & Kittur, A. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3530013 · Cited by 43 · see citing works
Self-citationAnalogy Generation by Prompting Large Language Models: A Case Study of InstructGPT
Bhavya, B., Xiong, J., & Zhai, C. (2022) · Proceedings of the 15th International Conference on Natural Language Generation · doi:10.18653/v1/2022.inlg-main.25 · Cited by 40 · see citing works
Creativity on Paid Crowdsourcing Platforms
Oppenlaender, J., Milland, K., Visuri, A., Ipeirotis, P. G., & Hosio, S. J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376677 · Cited by 37 · see citing works
CoNotate: Suggesting Queries Based on Notes Promotes Knowledge Discovery
Palani, S., Ding, Z., Nguyen, A., Chuang, A., MacNeil, S., & Dow, S. P. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445618 · Cited by 36 · see citing works
Self-citationWordtrees: A Method For Design By Analogy
Linsey, J., Wood, K. L., & Markman, A. B. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--3974 · Cited by 35 · see citing works
Analogical modification in the creation of contemporary art
Okada, T., Yokochi, S., Ishibashi, K., & Ueda, K. (2009) · Cognitive Systems Research · doi:10.1016/j.cogsys.2008.09.007 · Cited by 31 · see citing works
Procedural Generation of Interactive Stories using Language Models
Freiknecht, J., & Effelsberg, W. (2020) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3402942.3409599 · Cited by 29 · see citing works
The "Active Search" Hypothesis
Palani, S., Ding, Z., MacNeil, S., & Dow, S. P. (2021) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446046 · Cited by 27 · see citing works
Self-citationFraming Creative Work: Helping Novices Frame Better Problems through Interactive Scaffolding
MacNeil, S., Ding, Z., Quan, K., Parashos, T. J., Sun, Y., & Dow, S. P. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465261 · Cited by 24 · see citing works
Self-citationScaffolding CS1 Courses with a Large Language Model-Powered Intelligent Tutoring System
Cao, C. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581754.3584111 · Cited by 21 · see citing works
Can a relational mindset boost analogical retrieval?
Goldwater, M. B., & Jamrozik, A. (2019) · Cognitive Research Principles and Implications · doi:10.1186/s41235-019-0198-8 · Cited by 15 · see citing works
Finding Place in a Design Space: Challenges for Supporting Community Design Efforts at Scale
MacNeil, S., Ding, Z., Boone, A., Grubbs, A. B., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449246 · Cited by 11 · see citing works
Self-citationGrace, K. S., Gero, J. S., & Saunders, R. (2015) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060415000062 · Cited by 8 · see citing works
A Preliminary Approach to Select an Origami Source Pattern for Deployable Space Arrays
Bolanos, D. S., Ynchausti, C. R., & Magleby, S. P. (2022) · doi:10.1115/detc2022-90033 · Cited by 3 · see citing works
Designing with and for the Crowd: A Cognitive Study of Design Processes in NatureNet
MacNeil, S., Abdellahi, S., Maher, M. L., Kim, J. G., Mahzoon, M. J., & Grace, K. S. (2019) · Springer eBooks · doi:10.1007/978-3-030-05363-5_4 · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 18
- Shlomo Berkovsky, Yoshinori Hijikata, Jun Rekimoto, Margaret Burnett, Mark Billinghurst, and Aaron Quigley. 2018. How Novelists Use Generative Language Models: An Exploratory User Study. In 23rd International Conference on Intelligent User Interfaces. ACM, Tokyo Japan.
- Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Dem- szky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christo- pher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2021. On the Opportunities and Risks of Founda- tion Models. arXiv:2108.07258 [cs] (Aug. 2021). http://arxiv.org/abs/2108.07258 00021 arXiv: 2108.07258. · arXiv
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs] (June 2020). http://arxiv.org/abs/2005.14165 00030 arXiv: 2005.14165. · arXiv
- Louis L. Bucciarelli. 1994. Designing engineers. MIT Press, Cambridge, MA.
- Joel Chan, Joseph Chee Chang, Tom Hope, Dafna Shahaf, and Aniket Kittur. 2018. SOLVENT: A Mixed Initiative System for Finding Analogies between Research Papers. Proceedings of ACM Human-Computer Interaction: CSCW 2, CSCW (2018), 31.
- Dawn Chen, Joshua C. Peterson, and Thomas L. Griffiths. 2017. Evaluating vector-space models of analogy. arXiv:1705.04416 [cs] (May 2017). http://arxiv. org/abs/1705.04416 arXiv: 1705.04416. · arXiv
- Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, and Noah A. Smith. 2021. All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text. arXiv:2107.00061 [cs] (July 2021). http://arxiv.org/ abs/2107.00061 00008 arXiv: 2107.00061. · arXiv
- Zijian Ding and Joel Chan. 2023. Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks. arXiv e-prints (2023), arXiv-2303.
- Dedre Gentner and Russell Landers. 1985. Analogical reminding: A good match is hard to find. In Proceedings of the international conference on systems, man and cybernetics.
- D. Gentner, M. J. Rattermann, and K. D. Forbus. 1993. The roles of similar- ity in transfer: separating retrievability from inferential soundness. Cognitive Psychology 25, 4 (1993), 524-75.
- Keith J. Holyoak and Paul Thagard. 1996. Mental leaps: Analogy in creative thought. MIT Press, Cambridge, MA. 02398.
- Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ash- win Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael Bernstein, and Percy Liang. 2022. Evaluating Human- Language Model Interaction. http://arxiv.org/abs/2212.09746 arXiv:2212.09746 [cs] version: 2. · arXiv
- J. S. Linsey, J. T. Murphy, A. B. Markman, K. L. Wood, and T. Kurtoglu. 2006. Representing analogies: Increasing the probability of innovation. In Proceedings of IDETC/CIE 2006 ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference.
- J. Loewenstein. 2010. How One's Hook Is Baited Matters for Catching an Analogy. In Psychology of Learning and Motivation, B. H. Ross (Ed.). Vol. 53. San Diego, CA, 149-182.
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs] (Jan. 2013). http://arxiv.org/abs/1301.3781 00000 arXiv: 1301.3781. · arXiv
- Lior Noy, Yuval Hart, Natalie Andrew, Omer Ramote, Avi Mayo, and Uri Alon. 2012. A quantitative study of creative leaps, Mary Maher, Kristian Ham- mond, Alison Pease, {Rafael Pérez, Dan Ventura, and Geraint Wiggins (Eds.). 72-76. http://computationalcreativity.net/iccc2012/wp-content/uploads/2012/ 05/072-Noy.pdf
- Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Train- ing language models to follow instructions with human feedback. http: //arxiv.org/abs/2203.02155 arXiv:2203.02155 [cs]. · arXiv
- Taylor Webb, Keith J. Holyoak, and Hongjing Lu. 2022. Emergent Analogi- cal Reasoning in Large Language Models. http://arxiv.org/abs/2212.09196 arXiv:2212.09196 [cs]. · arXiv
Cited by
Sorted by citations
AutoTRIZ: Automating engineering innovation with TRIZ and large language models
Jiang, S., Li, W., Qian, Y., Zhang, Y., & Luo, J. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103312 · Cited by 81 · see citing works
The Silicon Ceiling: Auditing GPT’s Race and Gender Biases in Hiring
Armstrong, L., Liu, A., MacNeil, S., & Metaxa, D. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694699 · Cited by 59 · see citing works
Self-citationHow can patent-based prospective life cycle assessment be used for eco-design?
Spreafico, C. (2025) · Research in Engineering Design · doi:10.1007/s00163-025-00447-z · Cited by 43 · see citing works
Opportunities for large language models and discourse in engineering design
Göpfert, J., Weinand, J. M., Kuckertz, P., & Stolten, D. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100383 · Cited by 41 · see citing works
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37 · see citing works
“The Formal writing context represents professional, standardized modes of writing, characterized by structured forms, limited use of personal or emotional expression, and purpose-driven tasks that entail specific communicative goals.”
Bernstein, S., Denny, P. C., Leinonen, J., Kan, L., Hellas, A., Littlefield, M., Sarsa, S., & MacNeil, S. (2024) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3649217.3653533 · Cited by 24 · see citing works
Self-citationIntegrating LLMs into Database Systems Education
Prakash, K., Rao, S. V. N., Hamza, R., Lukich, J., Chaudhari, V., & Nandi, A. (2024) · International Workshop on Data Systems Education (DataEd) · doi:10.1145/3663649.3664371 · Cited by 22 · see citing works
Qin, P., Yang, C.-L., Li, J., Wen, J., & Lee, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713146 · Cited by 26 · see citing works
Generative AI in Computer Science Education: Challenges and Opportunities
Franklin, D., Denny, P., Gonzalez-Maldonado, D. A., & Tran, M. (2025) · doi:10.1017/9781009581738 · Cited by 20 · see citing works
Ding, Z., Smith, A., Zhang, W., Tetreault, J., & Jaimes, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.217 · Cited by 20 · see citing works
Self-citationShao, Z., Yuan, S., Gao, L., He, Y., Yang, D., & Chen, S. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714313 · Cited by 13 · see citing works
Jiayang, C., Qiu, L., Chan, T., Fang, T., Wang, W., Chan, C., Ru, D., Guo, Q., Zhang, H., Song, Y., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.706 · Cited by 18 · see citing works
Supermind Ideator: How scaffolding Human-AI collaboration can increase creativity
Heyman, J. L., Rick, S., Giacomelli, G., Wen, H., Laubacher, R., Taubenslag, N., Knicker, M. S., Jeddi, Y., Ragupathy, P., Curhan, J. R., et al. (2024) · Collective Intelligence · doi:10.1177/26339137241305117 · Cited by 11 · see citing works
Yuan, S., Chen, J., Ge, X., Xiao, Y., & Yang, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.160 · Cited by 8 · see citing works
Zastudil, C., Holyfield, C., Kapp, C., Crosland, X., Lorah, E. R., Zimmerman, T., & MacNeil, S. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3688502 · Cited by 8 · see citing works
Self-citationMaier, S., Schneider, M., & Feuerriegel, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791185 · Cited by 8 · see citing works
Galli, C., Moretti, C., & Calciolari, E. (2024) · Learned Publishing · doi:10.1002/leap.1648 · Cited by 8 · see citing works
Chan, J., Ding, Z., Kamrah, E., & Fuge, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642653 · Cited by 4 · see citing works
Self-citationExploring Human‐LLM Collaboration for Creativity Through the Lens of Concepts
Bai, H., Cheng, P., Duan, J., Peng, K., & Song, T. (2026) · The Journal of Creative Behavior · doi:10.1002/jocb.70132 · Cited by 3 · see citing works
Steering AI-driven Personalization of Scientific Text for General Audiences
Kim, T., Agarwal, D., Ackerman, J., & Saha, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757660 · Cited by 3 · see citing works
Collaborating with LLMs Through a Voice and Graphical User Interface
Sorokin, L., Huynh, K., Eiband, M., Stappen, L., & Dillmann, J. (2025) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/3737821.3749555 · Cited by 2 · see citing works
Flandre, N. Y. J.-P., & Giabbanelli, P. J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75599-6_15 · Cited by 2 · see citing works
Kokate, R., & Onkar, P. S. (2026) · Design Science · doi:10.1017/dsj.2025.10044 · Cited by 1 · see citing works
Anther: Cross-Pollinating Communities of Practice via Video Tutorials
Emerson, A. G., Endow, S., & Torres, C. (2024) · Conference on Designing Interactive Systems · doi:10.1145/3643834.3660727 · Cited by 3 · see citing works
AGen: Personalized Analogy Generation with Large Language Model
Wu, S., Wang, H., & Bai, Z. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99264-3_30
Emakporuena, D., & Tunde, B. D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5418659
Augmenting Collaborative Problem-Solving: Exploring the Design and Use of GenAI for Groupwork
Johnson, J. G., Rick, S., Grønbæk, J. E. S., Wong, E., Yin, M., Nebeling, M., Klein, M., Ackerman, M. S., & Malone, T. W. (2025) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3715070.3748297
Mapping the Collaboration between Crowdsourcing and Large Language Models: A Fine-Grained Survey
Lv, C., Shen, C., & Xie, M. (2026) · Business, management and economics · doi:10.5772/intechopen.1013999
Toward Efficient Deobfuscation via Large Language Models
Choi, B., Jin, H., Lee, D. H., & Choi, W. (2026) · IEEE Access · doi:10.1109/access.2026.3660477
Liu, L., Tan, W., Zhao, Y., Pang, J., & Wong, D. F. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799384
Structural Origination and Creation Capability: Authoring Competitive Terrain in an AI-Driven WorldPreprint
Sloan, L. E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6602859
Modelling Analogies and Analogical Reasoning: Connecting Cognitive Science Theory and NLP Research
Petersen, M. R., Stevenson, C. E., & van der Plas, L. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.632
Generative AI in Knowledge Management: Designing a GenAI Chatbot for Tacit Knowledge Externalization
Dinand, O., Heimburg, V., & Wiesche, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-28313-9_9
Çocuklarla Yürütülen Analojik Akıl Yürütme Temelli Araştırmalara Biliyometrik Bakış
Gündoğmuş, T., & Yaşar, M. C. (2026) · Erken Çocukluk Çalışmaları Dergisi · doi:10.24130/eccdjecs.19672026101700
AI Agents in the Double Diamond: Augmenting Design Thinking Practice in Organizational Innovation
Hor, T., Bierly, T., Biru, A. G., Kim, J., & Helmi, J. (2026) · Research-Technology Management · doi:10.1080/08956308.2026.2705124
- Authors
- Ding, Z., Srinivasan, A., Macneil, S., & Chan, J.
- Affiliations
- University of Maryland, College Park (US)
- Temple University (US)
- Venue
- Creativity and Cognition
- Publisher
- ACM
- Published
- 2023-06-19
- Pages
- 489-505
- OpenAlex
- W4381104096
- Cited by
- 35
- References
- 70
- Citations by year
- 2026: 11 · 2025: 11 · 2024: 10 · 2023: 3
- FWCI
- 12.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Creativity and Cognition (publishedVersion, cc-by-nd)
- Funders
- Office of Naval Research (N000142012506)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Keywords
- large language models, problem reformulation, harmful content
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review