CoChat

The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies

Open access
Benjamin, Jesse Josua, Biggs, Heidi, Berger, Arne, Rukanskaitė, Julija, Heidt, Michael B., Merrill, Nick, Pierce, James, Lindley, Joseph · 2023 · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Cited by 35

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) technologies are widely deployed in smartphone photography; and prompt-based image synthesis models have rapidly become commonplace. In this paper, we describe a Research-through-Design (RtD) project which explores this shift in the means and modes of image production via the creation and use of the Entoptic Field Camera. Entoptic phenomena usually refer to perceptions of floaters or bright blue dots stemming from the physiological interplay of the eye and brain. We use the term entoptic as a metaphor to investigate how the material interplay of data and models in AI technologies shapes human experiences of reality. Through our case study using first-person design and a field study, we offer implications for critical, reflective, more-than-human and ludic design to engage AI technologies; the conceptualisation of an RtD research space which contributes to AI literacy discourses; and outline a research trajectory concerning materiality and design affordances of AI technologies.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3544548.3581175

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 78

  1. 2010. entoptic phenomena. In Concise Medical Dictionary. Oxford University Press. https://www.oxfordreference.com/view/10.1093/acref/9780199557141.001.0001/acref-9780199557141-e-3227 · doi:10.1093/acref/9780199557141.001.0001/acref-9780199557141-e-3227
  2. Philip Agre. 1997. Computation and human experience. Cambridge University Press, Cambridge ; New York.
  3. Philip E. Agre. 1997. Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI. In Social Science, Technical Systems, and Cooperative Work: Bridging the Great Divide, Geoff Bowker, Susan Leigh Star, Willian Turner, and Les Gasser (Eds.). L. Erlbaum Associates, New Jersey, USA, 131–156.
  4. M. M. Bakhtin. 1986. Speech genres and other late essays(1st ed ed.). Number no. 8 in University of Texas Press Slavic series. University of Texas Press, Austin.
  5. 10.1145/2470654.2466451 · DOI · Paper page
  6. 10.1111/ips.12017 · DOI
  7. Jesse Josua Benjamin. 2021. The Spark of a Future Anterior: An Archaeology of Entoptic Media. ŠUM Journal for Contemporary Art Criticism and Theory16 (2021), 2172–2184. https://www.sum.si/journal-articles/the-spark-of-a-future-anterior-an-archaeology-of-entoptic-media Publisher: Društvo Galerija Books.
  8. 10.1145/3492858 · DOI · Paper page
  9. 10.1145/3313831.3376429 · DOI
  10. 10.1145/1188816.1188820 · DOI · Paper page
  11. 10.1145/2212776.2212703 · DOI
  12. 10.1145/3325480.3326569 · doi:10.1145/3325480.3326569
  13. 10.1109/CVPR.2016.105 · DOI
  14. 10.1145/3461778.3462000 · DOI
  15. Benjamin Bratton and Blaise Agüera Y Arcas. 2022. The Model Is The Message. NOEMA (July 2022). https://www.noemamag.com/the-model-is-the-message
  16. 10.1111/j.1467-954X.1990.tb03351.x · DOI · Paper page
  17. Ernst Cassirer. 1953. Language and Myth(dover ed ed.). Dover Publications Inc., New York.
  18. 10.1109/CVPR.2018.00660 · DOI · Paper page
  19. Kate Crawford and Vladan Joler. 2018. Anatomy of an AI System. http://www.anatomyof.ai · DOI
  20. 10.1145/3322276.3322311 · DOI
  21. Carl DiSalvo. 2012. Adversarial design. MIT Press, Cambridge, Mass. ; London.
  22. Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell. 2016. Adversarial feature learning. arXiv preprint arXiv:1605.09782 Published as a conference paper at ICLR 2017.(2016). · arXiv
  23. 10.1145/3313831.3376275 · DOI · Paper page
  24. Tony Dunne and Delena Pacenti Bill Gaver. 1999. Cultural Probes. ACM Interactions February (1999), 21–29.
  25. 10.1145/3491102.3501973 · DOI
  26. Vilém Flusser. 2011. Into the Universe of Technical Images. Number 32 in Electronic Mediations. University of Minnesota Press, Minneapolis, London.
  27. Christopher Frayling. 1994. Research in Art and Design. 1, 1 (1994). http://researchonline.rca.ac.uk/384/
  28. 10.1145/3532106.3533524 · DOI · Paper page
  29. 10.1145/2470654.2466474 · DOI
  30. 10.1145/3411764.3445232 · DOI
  31. Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Networks. arXiv:1406.2661 [cs, stat] (June 2014). http://arxiv.org/abs/1406.2661 arXiv:1406.2661. · arXiv
  32. 10.1145/3025453.3025606 · DOI
  33. 10.1145/3173574.3173775 · DOI
  34. Martin Heidegger. 2005. The basic problems of phenomenology. Indiana University Press, Bloomington; Indianapolis. OCLC: 750615910.
  35. Martin Heidegger. 2010. Being and time. State University of New York Press, Albany. OCLC: ocn608297834.
  36. 10.1145/3290605.3300809 · DOI · Paper page
  37. Don Ihde. 1998. Expanding hermeneutics: visualism in science. Northwestern University Press, Evanston, Ill.
  38. 10.1145/2399016.2399019 · DOI
  39. Li Jönsson, Martín Tironi, Pablo Hermansen, and Alex Wilkie. 2022. Doing and Undoing Post-Anthropocentric Design. In DRS Biennial Conference Series. https://dl.designresearchsociety.org/drs-conference-papers/drs2022/editorials/17
  40. 10.2312/trvis.20191183 · DOI
  41. Friedrich Kittler. 2010. Optical media : Berlin lectures 1999. Polity, Cambridge, UK ; Malden, MA.
  42. 10.1145/2901790.2901840 · DOI
  43. 10.23987/sts.75323 · DOI
  44. 10.1086/203629 · DOI · Paper page
  45. 10.1109/MPRV.2012.57 · DOI
  46. 10.1145/3322276.3323701 · DOI
  47. Maria Lindh. 2016. As a Utility – Metaphors of Information Technologies. Human IT 13, 2 (2016), 47–80. http://urn.kb.se/resolve?urn=urn:nbn:se:hb:diva-10679 Publisher: Högskolan i Borås.
  48. 10.1145/3313831.3376792 · DOI · Paper page
  49. Joseph Galen Lindley, Paul Coulton, Haider Ali Akmal, and Franziska Louise Pilling. 2020. Signs of the Time: Making AI Legible. In DRS Biennial Conference Series. https://dl.designresearchsociety.org/drs-conference-papers/drs2020/researchpapers/63
  50. 10.1145/3196709.3196819 · doi:10.1145/3196709.3196819
  51. 10.51151/identities.v15i1-2.329 · DOI
  52. Davor Löffler. 2019. Generative Realitäten I Die Technologische Zivilisation als neue Achsenzeit und Zivilisationsstufe Eine Anthropologie des 21. Jahrhunderts. Velbrück Wissenschaft. OCLC: 1081348786. · doi:10.5771/9783748906582
  53. 10.1145/2901790.2901906 · DOI
  54. W. J. T Mitchell. 1995. Picture theory : essays on verbal and visual representation (paperback ed. ed.). Chicago [u.a.].
  55. Alexander Mordvintsev, Christopher Olah, and Mike Tyke. 2015. Inceptionism: Going Deeper into Neural Networks. http://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html
  56. Dave Murray-Rust Iohanna Nicenboim and Dan Lockton. 2022. Metaphors for designers working with AI. https://doi.org/10.21606/drs.2022.667 · DOI
  57. 10.1145/2377783.2377791 · DOI
  58. Erwin Panofsky. 1991. Perspective as Symbolic Form(1st ed ed.). Zone Books ; Distributed by the MIT Press, New York : Cambridge, Mass.
  59. 10.1145/2598510.2598525 · DOI
  60. 10.1145/3411764.3445406 · DOI · Paper page
  61. 10.1145/2702123.2702405 · DOI
  62. 10.1177/1086296X12457167 · doi:10.1177/1086296x12457167
  63. 10.1007/978-3-030-67070-2_14 · DOI
  64. 10.1007/s00146-020-01088-7 · DOI
  65. 10.1145/3301653 · doi:10.1145/3301653
  66. 10.1007/s11263-015-0816-y · DOI · Paper page
  67. Donald A. Schön. 1979. Generative metaphor: A perspective on problem-setting in social policy. In Metaphor and thought. Vol. 2. Cambridge University Press Cambridge, 137–163.
  68. 10.1145/3461778.3462163 · DOI · Paper page
  69. 10.1145/1978942.1979170 · DOI
  70. 10.21606/drs.2022.782 · DOI
  71. Francisco Varela and Jonathan Shear. 1999. First-Person Methodologies: What, Why, How?Journal of Consciousness Studies 6, 2-3 (1999), 1–14.
  72. 10.1145/2751314 · DOI · Paper page
  73. Ron Wakkary. 2021. Things We Could Design: For More Than Human-Centered Worlds. MIT Press, Cambridge, MA, USA.
  74. 10.1145/3064663.3064734 · DOI
  75. 10.1163/156916400746632 · doi:10.1163/156916400746632
  76. 10.1145/3290605.3300831 · DOI · Paper page
  77. Zili Yi, Qiang Tang, Shekoofeh Azizi, Daesik Jang, and Zhan Xu. 2020. Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting. arXiv:2005.09704 [cs] (May 2020). http://arxiv.org/abs/2005.09704 arXiv:2005.09704. · arXiv
  78. 10.1145/3322276.3323689 · DOI

Cited by

See all 35

Metadata

Authors
Benjamin, J. J., Biggs, H., Berger, A., Rukanskaitė, J., Heidt, M. B., Merrill, N., Pierce, J., & Lindley, J.
Venue
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2023-04-19
Pages
1-19
OpenAlex
W4317951178
Cited by
35
References
27
FWCI
8.33
Type
conference paper
Language
en
Open access
hybrid
Funders
  • NSF (National Science Foundation) (2142795 / 2230825)
  • UK Research and Innovation (MR/T019220/1)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.