CoChat

Communication in Human–AI Co-Creation: Perceptual Analysis of Paintings Generated by Text-to-Image System

Open access
Lyu, Yanru, Wang, Xinxin, Lin, Rungtai, Wu, Jun · 2022 · Applied Sciences
Cited by 142

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

In recent years, art creation using artificial intelligence (AI) has started to become a mainstream phenomenon. One of the latest applications of AI is to generate visual artwork from natural language descriptions where anyone can interact with it to create thousands of artistic images with minimal effort, which provokes the questions: what is the essence of artistic creation, and who can create art in this era? Considering that, in this study, the theoretical communication framework was adopted to investigate the difference in the interaction with the text-to-image system between artists and nonartists. In this experiment, ten artists and ten nonartists were invited to co-create with Midjourney. Their actions and reflections were recorded, and two sets of generated images were collected for the visual question-answering task, with a painting created by the artist as a reference sample. A total of forty-two subjects with artistic backgrounds participated in the evaluated experiment. The results indicated differences between the two groups in their creation actions and their attitude toward AI, while the technology blurred the difference in the perception of the results caused by the creator’s artistic experience. In addition, attention should be paid to communication on the effectiveness level for a better perception of the artistic value.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/app122211312

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 30

  1. Eindhoven, 1952, Creative processes in painting, J. Gen. Psychol., 47, 139, 10.1080/00221309.1952.9710660 · DOI
  2. Kay, 1991, The figural problem solving and problem finding of professional and semiprofessional artists and nonartists, Creat. Res. J., 4, 233, 10.1080/10400419109534396 · DOI
  3. Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., and Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv.
  4. Crowson, K., Biderman, S., Kornis, D., Stander, D., Hallahan, E., Castricato, L., and Raff, E. (2022, January 23–27). Vqgan-clip: Open domain image generation and editing with natural language guidance. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel. · DOI · Paper page
  5. Lee, H., Ullah, U., Lee, J.S., Jeong, B., and Choi, H.C. (2021, January 1–3). A Brief Survey of text driven image generation and maniulation. Proceedings of the 2021 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Gangneung, Korea. · DOI
  6. Wu, Y., Yu, N., Li, Z., Backes, M., and Zhang, Y. (2022). Membership Inference Attacks Against Text-to-image Generation Models. arXiv.
  7. Yu, J., Xu, Y., Koh, J.Y., Luong, T., Baid, G., Wang, Z., Vasudevan, V., Ku, A., Yang, Y., and Ayan, B.K. (2022). Scaling autoregressive models for content-rich text-to-image generation. arXiv.
  8. Lin, 2015, The cognition of turning poetry into painting, J. US-China Educ. Rev. B, 5, 471
  9. Audry, S. (2021). Art in the Age of Machine Learning, MIT Press. · DOI
  10. Solso, R.L. (1996). Cognition and the Visual Arts, MIT Press.
  11. Steenberg, 2007, Visual Aesthetic Experience, J. Aesthet. Educ., 41, 89, 10.2307/4140196 · doi:10.2307/4140196
  12. Taylor, 2012, Uncovering the connection between artist and audience: Viewing painted brushstrokes evokes corresponding action representations in the observer, J. Cogn., 125, 26, 10.1016/j.cognition.2012.06.012 · DOI
  13. Kozbelt, 2008, Gombrich, Galenson, and beyond: Integrating case study and typological frameworks in the study of creative individuals, Empir. Stud. Arts, 26, 51, 10.2190/EM.26.1.e · DOI
  14. Ericsson, K.A., Hoffman, R.R., and Kozbelt, A. (2018). Expertise in drawing. The Cambridge Handbook of Expertise and Expert Performance, Cambridge University Press. · DOI · Paper page
  15. Chiarella, 2022, Investigating the negative bias towards artificial intelligence: Effects of prior assignment of AI-authorship on the aesthetic appreciation of abstract paintings, Comput. Hum. Behav., 137, 107406, 10.1016/j.chb.2022.107406 · DOI
  16. Lyu, Y. (2022, October 23). A Study on Perception of Artistic Style Tansfer using Artificial Intelligance Technology. Unpublished Doctor’s Thesis, National Taiwan University, Taipei, Taiwan. Available online: https://hdl.handle.net/11296/grdz93.
  17. Lyu, Y., Lin, C.-L., Lin, P.-H., and Lin, R. (2021). The Cognition of Audience to Artistic Style Transfer. Appl. Sci., 11. · doi:10.3390/app11073290
  18. Sun, Y., Yang, C.H., Lyu, Y., and Lin, R. (2022). From Pigments to Pixels: A Comparison of Human and AI Painting. Appl. Sci., 12. · DOI
  19. Fiske, J. (2010). Introduction to Communication Studies, Routledge. [3rd ed.]. · DOI · Paper page
  20. Jakobson, R. (1987). Language in literature, Harvard University Press.
  21. Lin, R., Qian, F., Wu, J., Fang, W.-T., and Jin, Y. (2017, January 9–14). A Pilot Study of Communication Matrix for Evaluating Artworks. Proceedings of the International Conference on Cross-Cultural Design, Vancouver, BC, Canada. · DOI
  22. Mazzone, M., and Elgammal, A. (2019). Art, creativity, and the potential of artificial intelligence. Arts, 8. · DOI · Paper page
  23. Gao, Y.-J., Chen, L.-Y., Lee, S., Lin, R., and Jin, Y. (2017, January 9–14). A study of communication in turning “poetry” into “painting”. Proceedings of the International Conference on Cross-Cultural Design, Vancouver, BC, Canada. · doi:10.1007/978-3-319-57931-3_4
  24. Gao, Y., Wu, J., Lee, S., and Lin, R. (2019, January 26–31). Communication Between Artist and Audience: A Case Study of Creation Journey. Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA. · DOI
  25. Yu, Y., Binghong, Z., Fei, G., and Jiaxin, T. (2020, January 10–13). Research on Artificial Intelligence in the Field of Art Design Under the Background of Convergence Media. Proceedings of the IOP Conference Series: Materials Science and Engineering, Ulaanbaatar, Mongolia. · doi:10.1088/1757-899x/825/1/012027
  26. Hageback, N., and Hedblom, D. (2021). AI FOR ARTS, CRC Press. · doi:10.1201/9781003195009
  27. Oppenlaender, J. (2022). Prompt Engineering for Text-Based Generative Art. arXiv.
  28. Ghosh, A., and Fossas, G. (2022). Can There be Art Without an Artist?. arXiv.
  29. Hong, 2019, Artificial intelligence, artists, and art: Attitudes toward artwork produced by humans vs. artificial intelligence, ACM Trans. Multimed. Comput. Commun. Appl., 15, 1
  30. Corbin, J., and Strauss, A. (1998). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage Publications.

Metadata

Authors
Lyu, Y., Wang, X., Lin, R., & Wu, J.
Venue
Applied Sciences
Publisher
MDPI AG
Published
2022-11-08
Volume
12
Issue
22
Pages
11312
ISSN
2076-3417 (ISSN-L)
OpenAlex
W4308579274
Cited by
142
References
15
FWCI
35.67
Type
journal article
Language
en
Open access
gold
Funders
Beijing Municipal Education Commission (SM202110011005)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Communication in Human–AI Co-Creation: Perceptual Analysis of Paintings Generated by Text-to-Image System. https://app.cochat.ai/papers/10.3390/app122211312
The paper
Lyu, Y., Wang, X., Lin, R., & Wu, J. (2022). Communication in Human–AI Co-Creation: Perceptual Analysis of Paintings Generated by Text-to-Image System. Applied Sciences. https://doi.org/10.3390/app122211312

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.