The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index, and 1 are not checked yet.
Critical-Reflective Human-AI Collaboration: Exploring Computational Tools for Art Historical Image Retrieval
Open accessAbstract
Just as other disciplines, the humanities explore how computational research approaches and tools can meaningfully contribute to scholarly knowledge production. Building on related work from the areas of CSCW and HCI, we approach the design of computational tools through the analytical lens of 'human-AI collaboration.' Such work investigates how human competencies and computational capabilities can be effectively and meaningfully combined. However, there is no generalizable concept of what constitutes 'meaningful' human-AI collaboration. In terms of genuinely human competencies, we consider criticality and reflection as guiding principles of scholarly knowledge production and as deeply embedded in the methodologies and practices of the humanities. Although (designing for) reflection is a recurring topic in CSCW and HCI discourses, it has not been centered in work on human-AI collaboration. We posit that integrating both concepts is a viable approach to supporting 'meaningful' human-AI collaboration in the humanities and other qualitative, interpretivist, and hermeneutic research areas. Our research, thus, is guided by the question of how critical reflection can be enabled in human-AI collaboration. We address this question with a use case that centers on computer vision (CV) tools for art historical image retrieval. Specifically, we conducted a qualitative interview study with art historians to explore a) what potentials and affordances art historians ascribe to human-AI collaboration and CV in particular, and b) in what ways art historians conceptualize critical reflection in the context of human-AI collaboration. We extended the interviews with a think-aloud software exploration. We observed and recorded participants' interaction with a ready-to-use CV tool in a possible research scenario. We found that critical reflection, indeed, constitutes a core prerequisite for 'meaningful' human-AI collaboration in humanities research contexts. However, we observed that critical reflection was not fully realized during interaction with the CV tool. We interpret this divergence as supporting our hypothesis that computational tools need to be intentionally designed in such a way that they actively scaffold and support critical reflection during interaction. Based on our findings, we suggest four empirically grounded design implications for 'critical-reflective human-AI collaboration': supporting reflection on the basis of transparency, foregrounding epistemic presumptions, emphasizing the situatedness of data, and strengthening interpretability through contextualized explanations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This view is consistent with prior work showing that reflection is central to human-AI creative collaboration [17, 20, 56].”
From How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters (2026) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 4×
“Our analysis was guided by Braun and Clarke’s ‘reflexive thematic analysis’ (TA) approach, which conceives analysis as an active creation of themes by the researchers at the intersection of data, analytic process, and subjectivity [10, 12].”
BackgroundMethodInfluentialGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 3×
“’s general guidelines for designing human-AI interaction [3].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Over the last few years, reflective technologies have been realized in various contexts, such as slow technology [43], persuasive design (e.g., [40]), and personal informatics (e.g., [58]).”
BackgroundThe reflective practitioner: How professionals think in action
Bogumil, R. J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13210 · Cited by 2,323 · cited 1×
“In this process, we adapt and change our knowledge, behavior, and values [25, 68].”
MethodPrinciples of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“The design concept of collaboration has been taken up over the years and appears in various other concepts such as mixed-initiative interaction [46], interactive-intelligent systems [50], or human-computer integration [35].”
BackgroundThe algorithmic imaginary: exploring the ordinary affects of Facebook algorithms
Bucher, T. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1154086 · Cited by 1,327 · cited 1×
“, “the way in which people imagine, perceive and experience algorithms and what these imaginations make possible” [16].”
BackgroundBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Research works printed but not linked: 15
- Philip E. Agre. 1997. Toward a critical technical practice: Lessons learned in trying to reform AI. In Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide (Computers, Cognition, and Work). Lawrence Erlbaum Associates, Mahwah, N.J, 131 -- 158.
- Caroline Bassett, David Michael Berry, M. Beatrice Fazi, Jack Pay, and Ben Roberts. 2017. Critical Digital Humanities and Machine-Learning. In 12th Annual International Conference of the Alliance of Digital Humanities Organizations, DH 2017, August 8--11, 2017, Conference Abstracts. Alliance of Digital Humanities Organizations, Montréal, Canada, 36 -- 40. https://dh2017.adho.org/abstracts/509/509.pdf
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- 10.1111/j.1755--5825.1978.tb02059.x · doi:10.1111/j.1755--5825.1978.tb02059.x
- 10.1007/978--3-030--85616--8_36 · doi:10.1007/978--3-030--85616--8_36
- Nan Z Da. 2019. The computational case against computational literary studies. Critical inquiry 45, 3 (2019), 601--639.
- John Dewey. 1997. How we think. Dover Publications, Mineola.
- 10.1609/aimag.v24i3.1720 · doi:10.1609/aimag.v24i3.1720
- Catherine D'Ignazio and Lauren F. Klein. 2020. Data Feminism. MIT Press, Cambridge, MA, USA.
- Vilém Flusser. 2005. Thought and reflection. Flusser Studies 1, 3 (2005), 16 -- 35.
- Matthew G Kirschenbaum. 2016. What is digital humanities and what's it doing in English departments? In Defining Digital Humanities. Routledge, New York, NY, 211--220.
- Clayton Lewis. 1982. Using the" thinking-aloud" method in cognitive interface design. IBM TJ Watson Research Center, Yorktown Heights, NY.
- Fabian Offert and Peter Bell. 2023. imgs.ai. A Deep Visual Search Engine for Digital Art History. International Journal for Digital Art History. forthcoming.
- 10.1016/0950--7051(95)98369-H · doi:10.1016/0950--7051(95)98369-h
- Nikolai Ufer, Max Simon, Sabine Lang, and Björn Ommer. 2021. Large-scale interactive retrieval in art collections using multi-style feature aggregation. PLoS ONE 16, 11 (2021), 38 pages.
Cited by
Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713778 · Cited by 490
“Critical thinking interventions have also been explored in data analysis [44, 48].”
Enhanced automated art curation using supervised modified CNN for art style classification
Li, W. (2025) · Scientific Reports · doi:10.1038/s41598-025-91671-z · Cited by 21
Paoli, S. D., & Mathis, W. S. (2024) · Quality & Quantity · doi:10.1007/s11135-024-01950-6 · Cited by 37
EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
Zheng, Q., Chen, M., Sharma, P., Tang, Y., Oswal, M., Liu, Y., & Huang, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714045 · Cited by 30
Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank
Sipos, L., Schäfer, U., Glinka, K., & Müller-Birn, C. (2023) · Mensch und Computer (MuC) · doi:10.1145/3603555.3608551 · Cited by 27
Self-citation
Metadata
- Authors
- Glinka, K., & Müller-Birn, C.
- Affiliations
- Freie Universität Berlin (DE)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-09-28
- Volume
- 7
- Issue
- CSCW2
- Pages
- 1-33
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4387329456
- Cited by
- 26
- References
- 67
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 1 · 2023: 1
- FWCI
- 71.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by-sa)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Funders
- Freie Universität Berlin
- Topics
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- human-AI collaboration, critical reflection, art historians, transparency, interpretability, think-aloud
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Critical-Reflective Human-AI Collaboration: Exploring Computational Tools for Art Historical Image Retrieval. https://app.cochat.ai/papers/10.1145/3610054
- The paper
- Glinka, K., & Müller-Birn, C. (2023). Critical-Reflective Human-AI Collaboration: Exploring Computational Tools for Art Historical Image Retrieval. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3610054
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.