Cited by 35Creativity in Education and NeuroscienceTopic ModelingDesign Education and Practice

Fluid Transformers and Creative Analogies: Exploring Large Language Models’ Capacity for Augmenting Cross-Domain Analogical Creativity

Open access
Ding, Zijian, Srinivasan, Arvind, Macneil, Stephen, Chan, Joel·2023·Creativity and Cognition

Abstract

Cross-domain analogical reasoning is a core creative ability that can be challenging for humans. Recent work has shown some proofs-of-concept of Large language Models’ (LLMs) ability to generate cross-domain analogies. However, the reliability and potential usefulness of this capacity for augmenting human creative work has received little systematic exploration. In this paper, we systematically explore LLMs capacity to augment cross-domain analogical reasoning. Across three studies, we found: 1) LLM-generated cross-domain analogies were frequently judged as helpful in the context of a problem reformulation task (median 4 out of 5 helpfulness rating), and frequently (∼ 80% of cases) led to observable changes in problem formulations, and 2) there was an upper bound of ∼ 25% of outputs being rated as potentially harmful, with a majority due to potentially upsetting content, rather than biased or toxic content. These results demonstrate the potential utility — and risks — of LLMs for augmenting cross-domain analogical creativity.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3591196.3593516

Cites

70 of 72 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Draxler et al.'s work showed that increased AI support corresponded with decreases in users' perceived control.

    “This finding aligns with Draxler et al. 's work [33], which showed that increased AI support corresponded with decreases in users' perceived control.”

    From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [33]

    The cited paper’s Results (§4.2.3; page unavailable) examine ratings of LLM-generated analogies, not users’ perceived control. Searches for “Draxler,” “perceived control,” and AI support found no passage reporting that increased support corresponded with decreased control. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 18

  1. Shlomo Berkovsky, Yoshinori Hijikata, Jun Rekimoto, Margaret Burnett, Mark Billinghurst, and Aaron Quigley. 2018. How Novelists Use Generative Language Models: An Exploratory User Study. In 23rd International Conference on Intelligent User Interfaces. ACM, Tokyo Japan.
  2. Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Dem- szky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christo- pher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2021. On the Opportunities and Risks of Founda- tion Models. arXiv:2108.07258 [cs] (Aug. 2021). http://arxiv.org/abs/2108.07258 00021 arXiv: 2108.07258. · arXiv
  3. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs] (June 2020). http://arxiv.org/abs/2005.14165 00030 arXiv: 2005.14165. · arXiv
  4. Louis L. Bucciarelli. 1994. Designing engineers. MIT Press, Cambridge, MA.
  5. Joel Chan, Joseph Chee Chang, Tom Hope, Dafna Shahaf, and Aniket Kittur. 2018. SOLVENT: A Mixed Initiative System for Finding Analogies between Research Papers. Proceedings of ACM Human-Computer Interaction: CSCW 2, CSCW (2018), 31.
  6. Dawn Chen, Joshua C. Peterson, and Thomas L. Griffiths. 2017. Evaluating vector-space models of analogy. arXiv:1705.04416 [cs] (May 2017). http://arxiv. org/abs/1705.04416 arXiv: 1705.04416. · arXiv
  7. Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, and Noah A. Smith. 2021. All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text. arXiv:2107.00061 [cs] (July 2021). http://arxiv.org/ abs/2107.00061 00008 arXiv: 2107.00061. · arXiv
  8. Zijian Ding and Joel Chan. 2023. Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks. arXiv e-prints (2023), arXiv-2303.
  9. Dedre Gentner and Russell Landers. 1985. Analogical reminding: A good match is hard to find. In Proceedings of the international conference on systems, man and cybernetics.
  10. D. Gentner, M. J. Rattermann, and K. D. Forbus. 1993. The roles of similar- ity in transfer: separating retrievability from inferential soundness. Cognitive Psychology 25, 4 (1993), 524-75.
  11. Keith J. Holyoak and Paul Thagard. 1996. Mental leaps: Analogy in creative thought. MIT Press, Cambridge, MA. 02398.
  12. Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ash- win Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael Bernstein, and Percy Liang. 2022. Evaluating Human- Language Model Interaction. http://arxiv.org/abs/2212.09746 arXiv:2212.09746 [cs] version: 2. · arXiv
  13. J. S. Linsey, J. T. Murphy, A. B. Markman, K. L. Wood, and T. Kurtoglu. 2006. Representing analogies: Increasing the probability of innovation. In Proceedings of IDETC/CIE 2006 ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference.
  14. J. Loewenstein. 2010. How One's Hook Is Baited Matters for Catching an Analogy. In Psychology of Learning and Motivation, B. H. Ross (Ed.). Vol. 53. San Diego, CA, 149-182.
  15. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs] (Jan. 2013). http://arxiv.org/abs/1301.3781 00000 arXiv: 1301.3781. · arXiv
  16. Lior Noy, Yuval Hart, Natalie Andrew, Omer Ramote, Avi Mayo, and Uri Alon. 2012. A quantitative study of creative leaps, Mary Maher, Kristian Ham- mond, Alison Pease, {Rafael Pérez, Dan Ventura, and Geraint Wiggins (Eds.). 72-76. http://computationalcreativity.net/iccc2012/wp-content/uploads/2012/ 05/072-Noy.pdf
  17. Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Train- ing language models to follow instructions with human feedback. http: //arxiv.org/abs/2203.02155 arXiv:2203.02155 [cs]. · arXiv
  18. Taylor Webb, Keith J. Holyoak, and Hongjing Lu. 2022. Emergent Analogi- cal Reasoning in Large Language Models. http://arxiv.org/abs/2212.09196 arXiv:2212.09196 [cs]. · arXiv

Cited by

Sorted by citations

Authors
Ding, Z., Srinivasan, A., Macneil, S., & Chan, J.
Affiliations
  • University of Maryland, College Park (US)
  • Temple University (US)
Venue
Creativity and Cognition
Publisher
ACM
Published
2023-06-19
Pages
489-505
OpenAlex
W4381104096
Cited by
35
References
70
Citations by year
2026: 11 · 2025: 11 · 2024: 10 · 2023: 3
FWCI
12.91
Type
conference paper
Language
en
Open access
Locations
Creativity and Cognition (publishedVersion, cc-by-nd)
Funders
Office of Naval Research (N000142012506)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
Keywords
large language models, problem reformulation, harmful content

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review