Critical-Reflective Human-AI Collaboration: Exploring Computational Tools for Art Historical Image Retrieval
Open accessThe DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Just as other disciplines, the humanities explore how computational research approaches and tools can meaningfully contribute to scholarly knowledge production. Building on related work from the areas of CSCW and HCI, we approach the design of computational tools through the analytical lens of 'human-AI collaboration.' Such work investigates how human competencies and computational capabilities can be effectively and meaningfully combined. However, there is no generalizable concept of what constitutes 'meaningful' human-AI collaboration. In terms of genuinely human competencies, we consider criticality and reflection as guiding principles of scholarly knowledge production and as deeply embedded in the methodologies and practices of the humanities. Although (designing for) reflection is a recurring topic in CSCW and HCI discourses, it has not been centered in work on human-AI collaboration. We posit that integrating both concepts is a viable approach to supporting 'meaningful' human-AI collaboration in the humanities and other qualitative, interpretivist, and hermeneutic research areas. Our research, thus, is guided by the question of how critical reflection can be enabled in human-AI collaboration. We address this question with a use case that centers on computer vision (CV) tools for art historical image retrieval. Specifically, we conducted a qualitative interview study with art historians to explore a) what potentials and affordances art historians ascribe to human-AI collaboration and CV in particular, and b) in what ways art historians conceptualize critical reflection in the context of human-AI collaboration. We extended the interviews with a think-aloud software exploration. We observed and recorded participants' interaction with a ready-to-use CV tool in a possible research scenario. We found that critical reflection, indeed, constitutes a core prerequisite for 'meaningful' human-AI collaboration in humanities research contexts. However, we observed that critical reflection was not fully realized during interaction with the CV tool. We interpret this divergence as supporting our hypothesis that computational tools need to be intentionally designed in such a way that they actively scaffold and support critical reflection during interaction. Based on our findings, we suggest four empirically grounded design implications for 'critical-reflective human-AI collaboration': supporting reflection on the basis of transparency, foregrounding epistemic presumptions, emphasizing the situatedness of data, and strengthening interpretability through contextualized explanations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This view is consistent with prior work showing that reflection is central to human-AI creative collaboration [17, 20, 56].”
From How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters (2026) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 4×
“Our analysis was guided by Braun and Clarke’s ‘reflexive thematic analysis’ (TA) approach, which conceives analysis as an active creation of themes by the researchers at the intersection of data, analytic process, and subjectivity [10, 12].”
BackgroundMethodInfluentialGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 3×
“’s general guidelines for designing human-AI interaction [3].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Over the last few years, reflective technologies have been realized in various contexts, such as slow technology [43], persuasive design (e.g., [40]), and personal informatics (e.g., [58]).”
BackgroundThe reflective practitioner: How professionals think in action
Bogumil, R. J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13210 · Cited by 2,323 · cited 1×
“In this process, we adapt and change our knowledge, behavior, and values [25, 68].”
MethodPrinciples of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“The design concept of collaboration has been taken up over the years and appears in various other concepts such as mixed-initiative interaction [46], interactive-intelligent systems [50], or human-computer integration [35].”
BackgroundThe algorithmic imaginary: exploring the ordinary affects of Facebook algorithms
Bucher, T. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1154086 · Cited by 1,327 · cited 1×
“, “the way in which people imagine, perceive and experience algorithms and what these imaginations make possible” [16].”
BackgroundBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Research works printed but not linked: 15
- Philip E. Agre. 1997. Toward a critical technical practice: Lessons learned in trying to reform AI. In Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide (Computers, Cognition, and Work). Lawrence Erlbaum Associates, Mahwah, N.J, 131 -- 158.
- Caroline Bassett, David Michael Berry, M. Beatrice Fazi, Jack Pay, and Ben Roberts. 2017. Critical Digital Humanities and Machine-Learning. In 12th Annual International Conference of the Alliance of Digital Humanities Organizations, DH 2017, August 8--11, 2017, Conference Abstracts. Alliance of Digital Humanities Organizations, Montréal, Canada, 36 -- 40. https://dh2017.adho.org/abstracts/509/509.pdf
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- 10.1111/j.1755--5825.1978.tb02059.x · doi:10.1111/j.1755--5825.1978.tb02059.x
- 10.1007/978--3-030--85616--8_36 · doi:10.1007/978--3-030--85616--8_36
- Nan Z Da. 2019. The computational case against computational literary studies. Critical inquiry 45, 3 (2019), 601--639.
- John Dewey. 1997. How we think. Dover Publications, Mineola.
- 10.1609/aimag.v24i3.1720 · doi:10.1609/aimag.v24i3.1720
- Catherine D'Ignazio and Lauren F. Klein. 2020. Data Feminism. MIT Press, Cambridge, MA, USA.
- Vilém Flusser. 2005. Thought and reflection. Flusser Studies 1, 3 (2005), 16 -- 35.
- Matthew G Kirschenbaum. 2016. What is digital humanities and what's it doing in English departments? In Defining Digital Humanities. Routledge, New York, NY, 211--220.
- Clayton Lewis. 1982. Using the" thinking-aloud" method in cognitive interface design. IBM TJ Watson Research Center, Yorktown Heights, NY.
- Fabian Offert and Peter Bell. 2023. imgs.ai. A Deep Visual Search Engine for Digital Art History. International Journal for Digital Art History. forthcoming.
- 10.1016/0950--7051(95)98369-H · doi:10.1016/0950--7051(95)98369-h
- Nikolai Ufer, Max Simon, Sabine Lang, and Björn Ommer. 2021. Large-scale interactive retrieval in art collections using multi-style feature aggregation. PLoS ONE 16, 11 (2021), 38 pages.
Cited by
Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713778 · Cited by 490
“Critical thinking interventions have also been explored in data analysis [44, 48].”
Enhanced automated art curation using supervised modified CNN for art style classification
Li, W. (2025) · Scientific Reports · doi:10.1038/s41598-025-91671-z · Cited by 21
Paoli, S. D., & Mathis, W. S. (2024) · Quality & Quantity · doi:10.1007/s11135-024-01950-6 · Cited by 37
EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
Zheng, Q., Chen, M., Sharma, P., Tang, Y., Oswal, M., Liu, Y., & Huang, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714045 · Cited by 30
Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank
Sipos, L., Schäfer, U., Glinka, K., & Müller-Birn, C. (2023) · Mensch und Computer (MuC) · doi:10.1145/3603555.3608551 · Cited by 27
Self-citationBreckner, K., Neumayr, T., Mara, M., Streit, M., & Augstein, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2482742 · Cited by 16
AI-Image Generation in Research Interviews: Opportunities and Challenges
Nardon, L., Brüning, C., Valgardsson, S., & Busato, M. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251333335 · Cited by 12
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790300 · Cited by 5
“This view is consistent with prior work showing that reflection is central to human–AI creative collaboration [17, 20, 56].”
Anthuvan, T., Nagendra, L., Lakhani, O., Prabhuram, S., Rizvi, A. H., Maheshwari, K., & Kalra, S. (2025) · doi:10.2139/ssrn.5394918 · Cited by 2
Collaborating with LLMs Through a Voice and Graphical User Interface
Sorokin, L., Huynh, K., Eiband, M., Stappen, L., & Dillmann, J. (2025) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/3737821.3749555 · Cited by 4
Human-AI Collaboration in Generating Graphical Museum Descriptions
Kim, J., Han, M., Kim, S., & Hong, J.-H. (2025) · Journal on Computing and Cultural Heritage · doi:10.1145/3786327 · Cited by 3
DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignment
Wang, A., Li, Z., Tong, X., & Hui, P. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812885 · Cited by 6
From Exploration to Critique: Catalyzing Critical Inquiry With Cultural Collection Visualizations
Windhager, F., Mayr, E., & Glinka, K. (2025) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2025.3559769 · Cited by 1
“21 Arguably, interface design offers just a limited toolbox to support these complex meta-re fl ec-tions, but users and producers of tools fi nd plenty of space in the surrounding discourse of (critical digital) humanities, visualization research, and HCI to collectively train and re fi ne those…”
Self-citationAugmenting Art Historical Research
Hutson, J. (2025) · Springer series on cultural computing · doi:10.1007/978-3-032-02920-1_3 · Cited by 1
Co-Disclosing the Computer: LLM-Mediated Computing through Reflective Conversation
Rost, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791769 · Cited by 3
“Researchers can code sequences for how user actions project system responses, how the system’s proposals extend or constrain possibilities, and how users subsequently adapt.”
Li, Y. L., Kuang, Q., Xiao, X., Labrune, J., & Ishii, H. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791258 · Cited by 1
Pinkosz, M. (2025) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2025.v07i02.42428
Administrative Leadership and Strategic Management
Hutson, J. (2025) · Springer series on cultural computing · doi:10.1007/978-3-032-02920-1_5
Nurturing Knowledge: A Virtue Epistemology Approach to Explainable AI
Candiotto, L., Growiec, J., Kellmeyer, P., Rabinowitch, I., & Livermore, M. A. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0176
Adhikary, R. P. (2025) · Revue Congo Research Papers · doi:10.59937/sufu9139 · Cited by 1
CoRK Lite A Lightweight Co-design Workshop Reflection Kit
Volkmann, T., Weiß, K., Balke, N., & Jochems, N. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12773-0_27
AI and the Design of Interactive Language Learning Materials
Kayyali, M. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2721-1.ch002
Can AI Influence How We Remember? Revisiting Memory Through AI-Generated Visuals
Qian, Y., Xiao, H., Liu, S., & Lc, R. (2025) · International Conference on Human-Engaged Computing (ICHEC) · doi:10.1145/3786995.3787032
“AI’s proven strength in handling large-scale data classification has led to its growing adoption in memory-related applications, where it is used to construct repositories for personal information retention [19].”
Beyond Distance Metrics: A Nested Model of Similarity in Visual Art Search
Lamqaddam, H., Mortier, Q., Donoso-Guzmán, I., Brosens, K., & Verbert, K. (2026) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3811427.3811442 · Cited by 1
Lay, T., & Nickl, B. (2026) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2026.2693654
Shen, Y., & Huang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29900-0_9
Kim, K., Kwon, K., 권혜성, & Brush, T. A. (2026) · Educational Technology Research and Development · doi:10.1007/s11423-026-10692-1
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · arXiv · Cited by 5
“This view is consistent with prior work showing that reflection is central to human–AI creative collaboration [17, 20, 56].”
Metadata
- Authors
- Glinka, K., & Müller-Birn, C.
- Affiliations
- Freie Universität Berlin (DE)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-09-28
- Volume
- 7
- Issue
- CSCW2
- Pages
- 1-33
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4387329456
- Cited by
- 26
- References
- 67
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 1 · 2023: 1
- FWCI
- 71.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by-sa)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Funders
- Freie Universität Berlin
- Topics
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- human-AI collaboration, critical reflection, art historians, transparency, interpretability, think-aloud
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
