CausalMapper: Challenging designers to think in systems with Causal Maps and Large Language Model
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tools are beginning to emerge that focus on how users might interact with LLMs, including mapping UI afordances to an LLM [13], grounding human-AI collaboration in a shared artifact [9], providing templates to facilitate prompt generation [10], and decomposing complex prompts to facilitate debugging [19].”
From Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agents (2023) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“Mixed initiative interfaces enable users and intelligent agents to work collaboratively, guided by a shared representation [17].”
BackgroundJansson, D. G., & Smith, S. M. (1991) · Design Studies · doi:10.1016/0142-694x(91)90003-f · Cited by 1,087
Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 2×
“Given a well-designed prompt, LLMs can generate high-quality and diverse responses [37] which might help designers think more broadly and avoid fixation.”
BackgroundPersistent Anti-Muslim Bias in Large Language Models
Abid, A., Farooqi, M., & Zou, J. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462624 · Cited by 476 · cited 1×
“However, researchers have also raised concerns about the truthiness of responses [3] and have identified problematic biases [1, 28].”
BackgroundMapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“Previous works have demonstrated that non-experts face difficulties thinking in systems such as fixating on surface-level details [6, 26], overly focusing on solutions [11], or failing to anticipate the consequences of their design activity [9, 36].”
BackgroundWordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374
Gender and Representation Bias in GPT-3 Generated Stories
Lucy, L., & Bamman, D. (2021) · Proceedings of the Third Workshop on Narrative Understanding · doi:10.18653/v1/2021.nuse-1.5 · Cited by 287
Agency plus automation: Designing artificial intelligence into interactive systems
Heer, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1807184115 · Cited by 279 · cited 1×
“These shared representations can be authored and edited by people and algorithms to collaboratively “contribute to, and adaptively learn from solutions to shared problems” [14].”
BackgroundSparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161 · cited 1×
“Recent advances in Large Language Models (LLMs) trained on a massive corpus of human-generated text have shown the capability of generating diverse and personalized content, such as creative writing inspiration [13, 42] and code snippets [10, 22].”
Background
Research works printed but not linked: 30
- Bilash Kanti Bala , Fatimah Mohamed Arshad , and Kusairi Mohd Noh . 2017. Stock and Flow Diagram . Springer Singapore , Singapore , 53–118. https://doi.org/10.1007/978-981-10- 2045 -2_4 10.1007/978-981-10-2045-2_4 Bilash Kanti Bala, Fatimah Mohamed Arshad, and Kusairi Mohd Noh. 2017. Stock and Flow Diagram. Springer Singapore, Singapore, 53–118. https://doi.org/10.1007/978-981-10-2045-2_4 · doi:10.1007/978-981-10-
- Thomas Binder , Andreas Vox , Salim Belyazid , Hordur Haraldsson , and Mats Svensson . 2004 . Developing system dynamics models from causal loop diagrams . In Proceedings of the 22nd International Conference of the System Dynamic Society. 1–21 . Thomas Binder, Andreas Vox, Salim Belyazid, Hordur Haraldsson, and Mats Svensson. 2004. Developing system dynamics models from causal loop diagrams. In Proceedings of the 22nd International Conference of the System Dynamic Society. 1–21.
- 10.1145/97243.97263 · DOI · Paper page
- Nigel Cross . 2001. Designerly ways of knowing: Design discipline versus design science. Design issues 17, 3 ( 2001 ), 49–55. Nigel Cross. 2001. Designerly ways of knowing: Design discipline versus design science. Design issues 17, 3 (2001), 49–55.
- 10.1145/1517744.1517816 · DOI
- 10.1145/3544548.3581347 · DOI
- James Finnie-Ansley , Paul Denny , Brett A. Becker , Andrew Luxton-Reilly , and James Prather . 2022 . The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference ( Virtual Event, Australia) (ACE ’22). Association for Computing Machinery, New York, NY, USA, 10–19. https://doi.org/10.1145/351 1861.3511863 10.1145/3511861.3511863 James Finnie-Ansley, Paul Denny, Brett A. Becker, Andrew Luxton-Reilly, and James Prather. 2022. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference (Virtual Event, Australia) (ACE ’22). Association for Computing Machinery, New York, NY, USA, 10–19. https://doi.org/10.1145/3511861.3511863 · doi:10.1145/351
- Katherine Fu , Joel Chan , Jonathan Cagan , Kenneth Kotovsky , Christian Schunn , and Kristin Wood . 2013 . The Meaning of “Near” and “Far”: The Impact of Structuring Design Databases and the Effect of Distance of Analogy on Design Output . Journal of Mechanical Design 135 , 2 (01 2013). https://doi.org/10.1115/1.4023158 arXiv:https://asmedigitalcollection.asme.org/mechanicaldesign/article-pdf/135/2/021007/6221498/md_135_2_021007.pdf021007. 10.1115/1.4023158 Katherine Fu, Joel Chan, Jonathan Cagan, Kenneth Kotovsky, Christian Schunn, and Kristin Wood. 2013. The Meaning of “Near” and “Far”: The Impact of Structuring Design Databases and the Effect of Distance of Analogy on Design Output. Journal of Mechanical Design 135, 2 (01 2013). https://doi.org/10.1115/1.4023158 arXiv:https://asmedigitalcollection.asme.org/mechanicaldesign/article-pdf/135/2/021007/6221498/md_135_2_021007.pdf021007. · DOI · Paper page
- 10.1145/1518701.1518717 · DOI · Paper page
- 10.1145/3491102.3517434 · DOI
- 10.1145/3059454.3059481 · DOI · Paper page
- Kosuke Ishii and Burton H Lee . 1996 . Reverse fishbone diagram: a tool in aid of design for product retirement . In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 80494 . American Society of Mechanical Engineers, V001T01A008. Kosuke Ishii and Burton H Lee. 1996. Reverse fishbone diagram: a tool in aid of design for product retirement. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 80494. American Society of Mechanical Engineers, V001T01A008.
- Ellen Jiang , Kristen Olson , Edwin Toh , Alejandra Molina , Aaron Donsbach , Michael Terry , and Carrie J Cai . 2022 . PromptMaker: Prompt-based Prototyping with Large Language Models. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–8. Ellen Jiang, Kristen Olson, Edwin Toh, Alejandra Molina, Aaron Donsbach, Michael Terry, and Carrie J Cai. 2022. PromptMaker: Prompt-based Prototyping with Large Language Models. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–8.
- 10.1145/3173574.3174180 · DOI · Paper page
- 10.1145/2998181.2998195 · DOI · Paper page
- Mark Klein . 2011 . The MIT deliberatorium: Enabling large-scale deliberation about complex systemic problems . In 2011 International Conference on Collaboration Technologies and Systems (CTS). 161–161 . https://doi.org/10.1109/CTS.2011.5928678 10.1109/CTS.2011.5928678 Mark Klein. 2011. The MIT deliberatorium: Enabling large-scale deliberation about complex systemic problems. In 2011 International Conference on Collaboration Technologies and Systems (CTS). 161–161. https://doi.org/10.1109/CTS.2011.5928678 · doi:10.1109/cts.2011.5928678
- 10.1145/3325480.3326582 · doi:10.1145/3325480.3326582
- Julie S Linsey Ian Tseng Katherine Fu Jonathan Cagan Kristin L Wood and Christian Schunn. 2010. A study of design fixation its mitigation and perception in engineering design faculty. (2010). Julie S Linsey Ian Tseng Katherine Fu Jonathan Cagan Kristin L Wood and Christian Schunn. 2010. A study of design fixation its mitigation and perception in engineering design faculty. (2010). · DOI · Paper page
- Allan MacLean , Richard M Young , Victoria ME Bellotti , and Thomas P Moran . 1991. Questions, Options, and Criteria : Elements of Design Space Analysis. Human–Computer Interaction 6, 3-4 ( 1991 ), 201–250. Allan MacLean, Richard M Young, Victoria ME Bellotti, and Thomas P Moran. 1991. Questions, Options, and Criteria: Elements of Design Space Analysis. Human–Computer Interaction 6, 3-4 (1991), 201–250.
- Stephen MacNeil , Zijian Ding , Kexin Quan , Ziheng Huang , Kenneth Chen , and Steven P. Dow . 2021. ProbMap: Automatically Constructing Design Galleries through Feature Extraction and Semantic Clustering . Association for Computing Machinery , New York, NY, USA , 134–136. https://doi.org/10.1145/3474349.3480203 10.1145/3474349.3480203 Stephen MacNeil, Zijian Ding, Kexin Quan, Ziheng Huang, Kenneth Chen, and Steven P. Dow. 2021. ProbMap: Automatically Constructing Design Galleries through Feature Extraction and Semantic Clustering. Association for Computing Machinery, New York, NY, USA, 134–136. https://doi.org/10.1145/3474349.3480203 · DOI
- 10.1145/3059454.3059472 · DOI · Paper page
- Mary Lou Maher , Josiah Poon , and Sylvie Boulanger . 1996. Formalising design exploration as co-evolution . In Advances in formal design methods for CAD. Springer , 3–30. Mary Lou Maher, Josiah Poon, and Sylvie Boulanger. 1996. Formalising design exploration as co-evolution. In Advances in formal design methods for CAD. Springer, 3–30.
- 10.1145/1978942.1979160 · DOI
- 10.1057/palgrave.jors.2602214 · DOI
- Jeremy Murphy , Katherine Fu , Kevin Otto , Maria Yang , Dan Jensen , and Kristin Wood . 2014 . Function Based Design-by-Analogy: A Functional Vector Approach to Analogical Search . Journal of Mechanical Design 136 , 10 (08 2014). https://doi.org/10.1115/1.4028093 arXiv:https://asmedigitalcollection.asme.org/mechanicaldesign/article-pdf/136/10/101102/6224844/md_136_10_101102.pdf101102. 10.1115/1.4028093 Jeremy Murphy, Katherine Fu, Kevin Otto, Maria Yang, Dan Jensen, and Kristin Wood. 2014. Function Based Design-by-Analogy: A Functional Vector Approach to Analogical Search. Journal of Mechanical Design 136, 10 (08 2014). https://doi.org/10.1115/1.4028093 arXiv:https://asmedigitalcollection.asme.org/mechanicaldesign/article-pdf/136/10/101102/6224844/md_136_10_101102.pdf101102. · DOI
- Priyanka Nanayakkara , Nicholas Diakopoulos , and Jessica Hullman . 2020. Anticipatory ethics and the role of uncertainty. arXiv preprint arXiv:2011.13170 ( 2020 ). Priyanka Nanayakkara, Nicholas Diakopoulos, and Jessica Hullman. 2020. Anticipatory ethics and the role of uncertainty. arXiv preprint arXiv:2011.13170 (2020). · arXiv
- Horst W Rittel and Melvin M Webber . 1974 . Wicked problems . Man-made Futures 26 , 1 (1974), 272 – 280 . Horst W Rittel and Melvin M Webber. 1974. Wicked problems. Man-made Futures 26, 1 (1974), 272–280.
- Hyeonik Song and Katherine Fu. 2019. Design-by-Analogy: Exploring for Analogical Inspiration With Behavior Material and Component-Based Structural Representation of Patent Databases. Journal of Computing and Information Science in Engineering 19 (04 2019). https://doi.org/10.1115/1.4043364 10.1115/1.4043364 · DOI
- Hyeonik Song and Katherine Fu. 2019. Design-by-Analogy: Exploring for Analogical Inspiration With Behavior Material and Component-Based Structural Representation of Patent Databases. Journal of Computing and Information Science in Engineering 19 (04 2019). https://doi.org/10.1115/1.4043364 · DOI
- 10.1145/3491102.3517582 · DOI · Paper page
Cited by
The Effects of Generative AI on Computing Students’ Help-Seeking Preferences
Hou, I., Mettille, S., Man, O., Li, Z., Zastudil, C., & MacNeil, S. (2024) · Proceedings of the 26th Australasian Computing Education Conference · doi:10.1145/3636243.3636248 · Cited by 97
Self-citationMemory Sandbox: Transparent and Interactive Memory Management for Conversational Agents
Huang, Z., Gutierrez, S., Kamana, H., & Macneil, S. (2023) · Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586182.3615796 · Cited by 34
“…beginning to emerge that focus on how users might interact with LLMs, including mapping UI afordances to an LLM [13], grounding human-AI collaboration in a shared artifact [9], providing templates to facilitate prompt generation [10], and decomposing complex prompts to facilitate debugging [19].”
BackgroundSelf-citation
Metadata
- Authors
- Huang, Z., Quan, K., Chan, J., & MacNeil, S.
- Affiliations
- Electrical and Computer Engineering, University of California San Diego, United States
- University of California, San Diego, United States
- College of Information Studies, University of Maryland, United States
- Computer and Information Sciences, Temple University, United States
- Venue
- Creativity and Cognition
- Publisher
- ACM
- Published
- 2023-06-19
- Pages
- 325-329
- Cited by
- 24
- References
- 12
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.