CoChat

GenAICHI: Generative AI and HCI

Muller, Michael, Chilton, Lydia B, Kantosalo, Anna, Martin, Charles Patrick, Walsh, Greg · 2022 · CHI Conference on Human Factors in Computing Systems Extended Abstracts

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Abstract

This workshop applies human centered themes to a new and powerful technology, generative artificial intelligence (AI). Unlike AI systems that produce decisions or descriptions, generative AI systems can produce new and creative content that can include images, texts, music, video, and other forms of design. The results are often similar to results produced by humans. However, it is not yet clear how humans make sense of generative AI algorithms or their outcomes. It is also not yet clear how humans can control and more generally, interact with, these powerful capabilities. Finally, it is not clear what kinds of collaboration patterns will emerge when creative humans and creative technologies work together.

Overview

Integrity signals

Registry

Crossref · 10.1145/3491101.3503719

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

  • Learning Transferable Visual Models From Natural Language Supervision

    Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 1×

    “Recent advances in generative AI methods show impressive abilities in diverse fields from images [4, 15, 42, 42] to text [41], music [14, 20], physical products [30, 31], code [59], andmovement [57].”
    Background
  • The standard definition of creativity

    Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · cited 1×

    “Novelty and utility or value [45] sometimes accompanied by surprise [28] form three basic criteria for evaluating creativity.”
    Background
  • Zero-shot text-to-image generation

    Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., & Sutskever, I. (2021) · arXiv · doi:10.48550/arxiv.2102.12092 · Cited by 2,417 · cited 1×

    “Recent advances in generative AI methods show impressive abilities in diverse fields from images [4, 15, 42, 42] to text [41], music [14, 20], physical products [30, 31], code [59], andmovement [57].”
    Background
  • Creativity support tools: accelerating discovery and innovation

    Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765 · cited 1×

    “The open-ended nature of creative work challenges expectations designers have about designing software for traditional, productivity centered domains; the requirements of creative work are vague, the measures of success unclear and the behaviors of users can be unorthodox [49].”
    Background
  • Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models

    Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376739 · Cited by 271 · cited 1×

    “Systems that are capable of producing novel instances are only recently documented [e.g., 3, 12, 13], and tooling that allows domain experts to control those novel or creative outcomes is even rarer [e.g., 27].”
    Background
  • MEXICA: A computer model of a cognitive account of creative writing

    PÉrez, R. P. Ý., & Sharples, M. (2001) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/09528130010029820 · Cited by 243 · cited 1×

    “Over the last decade, we have seen a shift in methodology moving from expert systems based on patterns and heavy human curating [e.g., 16, 22, 40] towards stochastic and generative models such as Generative Adversarial Networks (GANs) that use big data to produce convincingly human-like results in…”
    Method
  • The Advent of Generative Chemistry

    Vanhaelen, Q., Lin, Y.-C., & Zhavoronkov, A. (2020) · ACS Medicinal Chemistry Letters · doi:10.1021/acsmedchemlett.0c00088 · Cited by 151 · cited 3×

    “What all of these examples have in common is that the AI does not simply categorize data and interpret text as determined by models, but instead creates something new— e.g., in images [28, 47], molecules [37, 56], or designs [38].”
    Background
  • Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets

    Matejka, J., Glueck, M., Bradner, E., Hashemi, A., Grossman, T., & Fitzmaurice, G. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173943 · Cited by 144 · cited 1×

    “Recent advances in generative AI methods show impressive abilities in diverse fields from images [4, 15, 42, 42] to text [41], music [14, 20], physical products [30, 31], code [59], andmovement [57].”
    Background
  • Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent

    Davis, N., Hsiao, C.-P., Yashraj Singh, K., Li, L., & Magerko, B. (2016) · Proceedings of the 21st International Conference on Intelligent User Interfaces · doi:10.1145/2856767.2856795 · Cited by 138 · cited 1×

    “Users of creative software are not necessarily even working towards a specific goal, but the process of creation itself can be the goal of autotelic creativity [8].”
    Background
  • Mixed-Initiative Creative Interfaces

    Deterding, S., Hook, J., Fiebrink, R., Gillies, M., Gow, J., Akten, M., Smith, G., Liapis, A., & Compton, K. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3027072 · Cited by 117 · cited 2×

    “The new paradigm is characterized by the mixing of computer and human initiative [61] and human–computer co-creativity can be seen to flourish in the middle of a continuum between human creativity and autonomous computational creativity [10].”
    Background

Show all 21 references

Research works printed but not linked: 27

  1. Terence Broad Sebastian Berns Simon Colton and Mick Grierson. 2021. Active Divergence with Generative Deep Learning–A Survey and Taxonomy. arXiv preprint arXiv:2107.05599(2021). Terence Broad Sebastian Berns Simon Colton and Mick Grierson. 2021. Active Divergence with Generative Deep Learning–A Survey and Taxonomy. arXiv preprint arXiv:2107.05599(2021). · arXiv
  2. Andrew Brock Jeff Donahue and Karen Simonyan. 2019. Large Scale GAN Training for High Fidelity Natural Image Synthesis. arxiv:1809.11096 [cs.LG] Andrew Brock Jeff Donahue and Karen Simonyan. 2019. Large Scale GAN Training for High Fidelity Natural Image Synthesis. arxiv:1809.11096 [cs.LG] · arXiv
  3. Nicholas Davis . 2013 . Human-computer co-creativity: Blending human and computational creativity . In Doctoral Consortium of the Ninth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment ( Boston, Massachusetts, USA, October 14-18,). AAAI, 9–12. Nicholas Davis. 2013. Human-computer co-creativity: Blending human and computational creativity. In Doctoral Consortium of the Ninth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (Boston, Massachusetts, USA, October 14-18,). AAAI, 9–12.
  4. Upol Ehsan , Philipp Wintersberger , Q Vera Liao , Martina Mara , Marc Streit , Sandra Wachter , Andreas Riener , and Mark O Riedl . 2021 . Operationalizing Human-Centered Perspectives in Explainable AI. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–6. Upol Ehsan, Philipp Wintersberger, Q Vera Liao, Martina Mara, Marc Streit, Sandra Wachter, Andreas Riener, and Mark O Riedl. 2021. Operationalizing Human-Centered Perspectives in Explainable AI. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–6.
  5. Ahmed Elgammal , Bingchen Liu , Mohamed Elhoseiny , and Marian Mazzone . 2017 . Can: Creative adversarial networks, generating ” art” by learning about styles and deviating from style norms. arXiv preprint arXiv:1706.07068(2017). Ahmed Elgammal, Bingchen Liu, Mohamed Elhoseiny, and Marian Mazzone. 2017. Can: Creative adversarial networks, generating” art” by learning about styles and deviating from style norms. arXiv preprint arXiv:1706.07068(2017). · arXiv
  6. Jesse Engel , Kumar Krishna Agrawal , Shuo Chen , Ishaan Gulrajani , Chris Donahue , and Adam Roberts . 2019 . GANSynth: Adversarial Neural Audio Synthesis . In Proceedings of the International Conference on Learning Representations. https://openreview.net/pdf?id=H1xQVn09FX Jesse Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donahue, and Adam Roberts. 2019. GANSynth: Adversarial Neural Audio Synthesis. In Proceedings of the International Conference on Learning Representations. https://openreview.net/pdf?id=H1xQVn09FX
  7. Leon A. Gatys Alexander S. Ecker and Matthias Bethge. 2015. A Neural Algorithm of Artistic Style. arxiv:1508.06576 [cs.CV] Leon A. Gatys Alexander S. Ecker and Matthias Bethge. 2015. A Neural Algorithm of Artistic Style. arxiv:1508.06576 [cs.CV] · arXiv
  8. Cheng- Zhi Anna Huang , Ashish Vaswani , Jakob Uszkoreit , Noam Shazeer , Ian Simon , Curtis Hawthorne , Andrew Dai , Matt Hoffman , Monica Dinculescu , and Douglas Eck . 2019 . Music Transformer: Generating Music with Long-Term Structure. https://arxiv.org/abs/1809.04281 Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Ian Simon, Curtis Hawthorne, Andrew Dai, Matt Hoffman, Monica Dinculescu, and Douglas Eck. 2019. Music Transformer: Generating Music with Long-Term Structure. https://arxiv.org/abs/1809.04281 · arXiv
  9. Anna Kantosalo , Jukka M. Toivanen , Ping Xiao , and Hannu Toivonen . 2014 . From Isolation to Involvement: Adapting Machine Creativity Software to Support Human-Computer Co-Creation . In Proceedings of the Fifth International Conference on Computational Creativity , Ljubljana, Slovenia. 1–7. http://computationalcreativity.net/iccc 2014/wp-content/uploads/2014/06/1.1_Kantosalo.pdf Anna Kantosalo, Jukka M. Toivanen, Ping Xiao, and Hannu Toivonen. 2014. From Isolation to Involvement: Adapting Machine Creativity Software to Support Human-Computer Co-Creation. In Proceedings of the Fifth International Conference on Computational Creativity, Ljubljana, Slovenia. 1–7. http://computationalcreativity.net/iccc2014/wp-content/uploads/2014/06/1.1_Kantosalo.pdf
  10. Pegah Karimi , Kaz Grace , Mary Lou Maher , and Nick Davis . 2018 . Evaluating Creativity in Computational Co-Creative Systems . In Proceedings of the 2018 international conference on computational creativity, Vol. 147 . Citeseer. Pegah Karimi, Kaz Grace, Mary Lou Maher, and Nick Davis. 2018. Evaluating Creativity in Computational Co-Creative Systems. In Proceedings of the 2018 international conference on computational creativity, Vol. 147. Citeseer.
  11. Pegah Karimi , Mary Lou Maher , Nick Davis , and Kaz Grace . 2019 . Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System . In Proceedings of the 2019 international conference on computational creativity, Vol. 147 . Citeseer. Pegah Karimi, Mary Lou Maher, Nick Davis, and Kaz Grace. 2019. Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System. In Proceedings of the 2019 international conference on computational creativity, Vol. 147. Citeseer.
  12. Mary Lou Maher , Katherine Brady , and Douglas H Fisher . 2013 . Computational models of surprise in evaluating creative design . In Proceedings of the fourth international conference on computational creativity, Vol. 147 . Citeseer. Mary Lou Maher, Katherine Brady, and Douglas H Fisher. 2013. Computational models of surprise in evaluating creative design. In Proceedings of the fourth international conference on computational creativity, Vol. 147. Citeseer.
  13. Charles Patrick Martin , Fabio Morreale , Benedikte Wallace , and Hugo Scurto . 2021 . Critical Perspectives on AI/ML in Musical Interfaces. Workshop at NIME 2021. https://critical-ml-music-interfaces.github.io Charles Patrick Martin, Fabio Morreale, Benedikte Wallace, and Hugo Scurto. 2021. Critical Perspectives on AI/ML in Musical Interfaces. Workshop at NIME 2021. https://critical-ml-music-interfaces.github.io
  14. 10.1145/3173574.3173943 · DOI · Paper page
  15. Michael Muller , Cecilia Aragon , Shion Guha , Marina Kogan , Gina Neff , Cathrine Seidelin , Katie Shilton , and Anissa Tanweer . 2020 . Interrogating Data Science. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing. 467–473 . Michael Muller, Cecilia Aragon, Shion Guha, Marina Kogan, Gina Neff, Cathrine Seidelin, Katie Shilton, and Anissa Tanweer. 2020. Interrogating Data Science. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing. 467–473.
  16. Neur IPS. 2019 . Machine Learning for Creativity and Design . Retrieved Oct 10, 2021 from https://neurips2019creativity.github.io/ NeurIPS. 2019. Machine Learning for Creativity and Design. Retrieved Oct 10, 2021 from https://neurips2019creativity.github.io/
  17. AkshatKumar Nigam , Robert Pollice , Mario Krenn , Gabriel dos Passos Gomes , and Alan Aspuru-Guzik . 2021. Beyond generative models: superfast traversal, optimization, novelty, exploration and discovery (STONED) algorithm for molecules using SELFIES. Chemical science ( 2021 ). AkshatKumar Nigam, Robert Pollice, Mario Krenn, Gabriel dos Passos Gomes, and Alan Aspuru-Guzik. 2021. Beyond generative models: superfast traversal, optimization, novelty, exploration and discovery (STONED) algorithm for molecules using SELFIES. Chemical science (2021).
  18. Adam Roberts , Curtis Hawthorne , and Ian Simon . 2018 . Magenta.js: A JavaScript API for Augmenting Creativity with Deep Learning . In Joint Workshop on Machine Learning for Music (ICML). Adam Roberts, Curtis Hawthorne, and Ian Simon. 2018. Magenta.js: A JavaScript API for Augmenting Creativity with Deep Learning. In Joint Workshop on Machine Learning for Music (ICML).
  19. Othman Sbai , Mohamed Elhoseiny , Antoine Bordes , Yann LeCun , and Camille Couprie . 2018 . Design: Design inspiration from generative networks . In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0–0. Othman Sbai, Mohamed Elhoseiny, Antoine Bordes, Yann LeCun, and Camille Couprie. 2018. Design: Design inspiration from generative networks. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0–0.
  20. Isabella Seeber , Eva Bittner , Robert O Briggs , Triparna De Vreede , Gert-Jan De Vreede , Aaron Elkins , Ronald Maier , Alexander B Merz , Sarah Oeste-Reiß , Nils Randrup , 2020. Machines as teammates: A research agenda on AI in team collaboration. Information & management 57, 2 ( 2020 ), 103174. Isabella Seeber, Eva Bittner, Robert O Briggs, Triparna De Vreede, Gert-Jan De Vreede, Aaron Elkins, Ronald Maier, Alexander B Merz, Sarah Oeste-Reiß, Nils Randrup, 2020. Machines as teammates: A research agenda on AI in team collaboration. Information & management 57, 2 (2020), 103174.
  21. Angie Spoto and Natalia Oleynik . [n. d.]. Library of Mixed Initiative Creative Interfaces . Retrieved Oct 10, 2021 from http://mici.codingconduct.cc/ Angie Spoto and Natalia Oleynik. [n. d.]. Library of Mixed Initiative Creative Interfaces. Retrieved Oct 10, 2021 from http://mici.codingconduct.cc/
  22. ICCC’20 The Eleventh International Conference on Computational Creativity. 2020. Workshop on the Future of Co-Creative Systems. Retrieved Oct 11, 2021 from https://computationalcreativity.net/workshops/cocreative-iccc20/ ICCC’20 The Eleventh International Conference on Computational Creativity. 2020. Workshop on the Future of Co-Creative Systems. Retrieved Oct 11, 2021 from https://computationalcreativity.net/workshops/cocreative-iccc20/
  23. ICCC’21 The Twelfth International Conference on Computational Creativity. 2021. Second Workshop on the Future of Co-Creative Systems. Retrieved Oct 11, 2021 from https://computationalcreativity.net/iccc21/wfccs/ ICCC’21 The Twelfth International Conference on Computational Creativity. 2021. Second Workshop on the Future of Co-Creative Systems. Retrieved Oct 11, 2021 from https://computationalcreativity.net/iccc21/wfccs/
  24. April Yi Wang , Dakuo Wang , Jaimie Drozdal , Michael Muller , Soya Park , Justin D Weisz , Xuye Liu , Lingfei Wu , and Casey Dugan . 2021 . Themisto: Towards Automated Documentation Generation in Computational Notebooks. arXiv preprint arXiv:2102.12592(2021). April Yi Wang, Dakuo Wang, Jaimie Drozdal, Michael Muller, Soya Park, Justin D Weisz, Xuye Liu, Lingfei Wu, and Casey Dugan. 2021. Themisto: Towards Automated Documentation Generation in Computational Notebooks. arXiv preprint arXiv:2102.12592(2021). · arXiv
  25. Justin D Weisz , Michael Muller , Stephanie Houde , John Richards , Steven I Ross , Fernando Martinez , Mayank Agarwal , and Kartik Talamadupula . 2021 . Perfection Not Required? Human-AI Partnerships in Code Translation. In 26th International Conference on Intelligent User Interfaces. 402–412 . Justin D Weisz, Michael Muller, Stephanie Houde, John Richards, Steven I Ross, Fernando Martinez, Mayank Agarwal, and Kartik Talamadupula. 2021. Perfection Not Required? Human-AI Partnerships in Code Translation. In 26th International Conference on Intelligent User Interfaces. 402–412.
  26. Georgios N Yannakakis , Antonios Liapis , and Constantine Alexopoulos . 2014 . Mixed-initiative co-creativity . In Proceedings of the 9th International Conference on the Foundations of Digital Games, FDG 2014 (Liberty of the Seas, Caribbean, April 3-7). Georgios N Yannakakis, Antonios Liapis, and Constantine Alexopoulos. 2014. Mixed-initiative co-creativity. In Proceedings of the 9th International Conference on the Foundations of Digital Games, FDG 2014 (Liberty of the Seas, Caribbean, April 3-7).
  27. Yijun Zhou Yuki Koyama Masataka Goto and Takeo Igarashi. 2020. Generative Melody Composition with Human-in-the-Loop Bayesian Optimization. arXiv preprint arXiv:2010.03190(2020). Yijun Zhou Yuki Koyama Masataka Goto and Takeo Igarashi. 2020. Generative Melody Composition with Human-in-the-Loop Bayesian Optimization. arXiv preprint arXiv:2010.03190(2020). · arXiv

Cited by

See all 121

Metadata

Authors
Muller, M., Chilton, L. B., Kantosalo, A., Martin, C. P., & Walsh, G.
Affiliations
  • IBM (United States) (US)
  • Columbia University (US)
  • Aalto University (FI)
  • Australian National University (AU)
  • University of Baltimore (US)
Venue
CHI Conference on Human Factors in Computing Systems Extended Abstracts
Publisher
ACM
Published
2022-04-27
Pages
1-7
OpenAlex
W4225115543
Cited by
101
References
19
Citations by year
2026: 9 · 2025: 33 · 2024: 44 · 2023: 15
FWCI
18.40
Type
conference paper
Language
en
Open access
closed
Locations
  • CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
  • ANU Open Research (Australian National University) (acceptedVersion)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
  • Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
Keywords
generative AI, human-computer interaction, human-centered design, creative content generation, human-AI collaboration, human control over AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: GenAICHI: Generative AI and HCI. https://app.cochat.ai/papers/10.1145/3491101.3503719
The paper
Muller, M., Chilton, L. B., Kantosalo, A., Martin, C. P., & Walsh, G. (2022). GenAICHI: Generative AI and HCI. CHI Conference on Human Factors in Computing Systems Extended Abstracts. https://doi.org/10.1145/3491101.3503719

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.