Critical-Reflective Human-AI Collaboration: Exploring Computational Tools for Art Historical Image Retrieval
Open accessThe DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Just as other disciplines, the humanities explore how computational research approaches and tools can meaningfully contribute to scholarly knowledge production. Building on related work from the areas of CSCW and HCI, we approach the design of computational tools through the analytical lens of 'human-AI collaboration.' Such work investigates how human competencies and computational capabilities can be effectively and meaningfully combined. However, there is no generalizable concept of what constitutes 'meaningful' human-AI collaboration. In terms of genuinely human competencies, we consider criticality and reflection as guiding principles of scholarly knowledge production and as deeply embedded in the methodologies and practices of the humanities. Although (designing for) reflection is a recurring topic in CSCW and HCI discourses, it has not been centered in work on human-AI collaboration. We posit that integrating both concepts is a viable approach to supporting 'meaningful' human-AI collaboration in the humanities and other qualitative, interpretivist, and hermeneutic research areas. Our research, thus, is guided by the question of how critical reflection can be enabled in human-AI collaboration. We address this question with a use case that centers on computer vision (CV) tools for art historical image retrieval. Specifically, we conducted a qualitative interview study with art historians to explore a) what potentials and affordances art historians ascribe to human-AI collaboration and CV in particular, and b) in what ways art historians conceptualize critical reflection in the context of human-AI collaboration. We extended the interviews with a think-aloud software exploration. We observed and recorded participants' interaction with a ready-to-use CV tool in a possible research scenario. We found that critical reflection, indeed, constitutes a core prerequisite for 'meaningful' human-AI collaboration in humanities research contexts. However, we observed that critical reflection was not fully realized during interaction with the CV tool. We interpret this divergence as supporting our hypothesis that computational tools need to be intentionally designed in such a way that they actively scaffold and support critical reflection during interaction. Based on our findings, we suggest four empirically grounded design implications for 'critical-reflective human-AI collaboration': supporting reflection on the basis of transparency, foregrounding epistemic presumptions, emphasizing the situatedness of data, and strengthening interpretability through contextualized explanations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This view is consistent with prior work showing that reflection is central to human-AI creative collaboration [17, 20, 56].”
From How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters (2026) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 4×
“Our analysis was guided by Braun and Clarke’s ‘reflexive thematic analysis’ (TA) approach, which conceives analysis as an active creation of themes by the researchers at the intersection of data, analytic process, and subjectivity [10, 12].”
BackgroundMethodInfluentialGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1×
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 3×
“’s general guidelines for designing human-AI interaction [3].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Over the last few years, reflective technologies have been realized in various contexts, such as slow technology [43], persuasive design (e.g., [40]), and personal informatics (e.g., [58]).”
BackgroundThe reflective practitioner: How professionals think in action
Bogumil, R. J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13210 · Cited by 2,323 · cited 1×
“In this process, we adapt and change our knowledge, behavior, and values [25, 68].”
MethodPrinciples of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“The design concept of collaboration has been taken up over the years and appears in various other concepts such as mixed-initiative interaction [46], interactive-intelligent systems [50], or human-computer integration [35].”
BackgroundThe algorithmic imaginary: exploring the ordinary affects of Facebook algorithms
Bucher, T. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1154086 · Cited by 1,327 · cited 1×
“, “the way in which people imagine, perceive and experience algorithms and what these imaginations make possible” [16].”
BackgroundBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
A stage-based model of personal informatics systems
Li, I., Dey, A., & Forlizzi, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753409 · Cited by 1,100
Slow Technology – Designing for Reflection
Hallnäs, L., & Redström, J. (2001) · Personal and Ubiquitous Computing · doi:10.1007/pl00000019 · Cited by 693 · cited 3×
“Over the last few years, reflective technologies have been realized in various contexts, such as slow technology [43], persuasive design (e.”
BackgroundInfluentialBraun, V., & Clarke, V. (2016) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1195588 · Cited by 576 · cited 1×
“By assuring relative heterogeneity within our sample (see Section 3.2) while at the same time limiting the sample to a moderate size, we set the foundation for us to capture the complexity and nuance contained within the data [11].”
BackgroundInfluentialEntanglement HCI The Next Wave?
Frauenberger, C. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3364998 · Cited by 553
Direct manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518 · cited 1×
“, computational tools, in the context of art history through the analytical lens of “human-AI collaboration,” a concept that refers to the integration of complementary competencies [70] of humans and computers.”
BackgroundWhen and why defaults influence decisions: a meta-analysis of default effects
JACHIMOWICZ, J. M., DUNCAN, S., WEBER, E. U., & JOHNSON, E. J. (2019) · Behavioural Public Policy · doi:10.1017/bpp.2018.43 · Cited by 481
Debates in the Digital Humanities 2019
(2019) · University of Minnesota Press eBooks · doi:10.5749/j.ctvg251hk · Cited by 333
Wang, D., Churchill, E., Maes, P., Fan, X., Shneiderman, B., Shi, Y., & Wang, Q. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3381069 · Cited by 271 · cited 2×
“Our findings also echo this suggestion: Participants did not formulate their expectation that a tool should support critical reflection during interaction with it until they engaged in a real-world image retrieval task with a ready-to-use CV tool.”
BackgroundReviewing reflection: on the use of reflection in interactive system design
Baumer, E. P. S., Khovanskaya, V., Matthews, M., Reynolds, L., Schwanda Sosik, V., & Gay, G. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598598 · Cited by 266
Graphesis: visual forms of knowledge production
(2015) · Choice Reviews Online · doi:10.5860/choice.186174 · Cited by 261 · cited 2×
“This conception coincided with the implication or explicit acknowledgment of the need to check, interpret, and revise tool output, i.e., to iteratively and critically interact with a tool and its output.”
BackgroundCOVER STORYBeyond interaction: a short introduction to mediation theory
Verbeek, P.-P. (2015) · Interactions · doi:10.1145/2751314 · Cited by 256
Reflective Informatics: Conceptual Dimensions for Designing Technologies of Reflection
Baumer, E. P. S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702234 · Cited by 254 · cited 8×
“Baumer introduces the third dimension, transformation, as “envisioning alternatives” [5].”
BackgroundInfluentialReflectivity in Research Practice: An Overview of Different Perspectives
Mortari, L. (2015) · International Journal of Qualitative Methods · doi:10.1177/1609406915618045 · Cited by 236
Design Frictions for Mindful Interactions: The Case for Microboundaries
Cox, A. L., Gould, S. J. J., Cecchinato, M. E., Iacovides, I., & Renfree, I. (2016) · Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2851581.2892410 · Cited by 218 · cited 2×
“Building on that, Cox et al. [22] propose “mindful interaction” to realize a deliberate and intentional interaction.”
BackgroundDo Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
Scheuerman, M. K., Hanna, A., & Denton, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476058 · Cited by 216 · cited 1×
“This aspect is already acknowledged within the CSCW and HCI community by calling for a more reflexive data practice (see [67]) or, more generally, a reflexive documentation practice (see [59]).”
BackgroundHuman-XAI Interaction: A Review and Design Principles for Explanation User Interfaces
Chromik, M., & Butz, A. M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85616-8_36 · Cited by 207
Overview of human-computer collaboration
Terveen, L. G. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(95)98369-h · Cited by 201 · cited 3×
“Terveen [74] provided one of the earliest conceptualizations of such collaboration; he states, “collaboration is a process in which two or more agents work together to achieve shared goals.”
BackgroundPROGRESS IN DOCUMENTATION PICTORIAL INFORMATION RETRIEVAL
ENSER, P. G. B. (1995) · Journal of Documentation · doi:10.1108/eb026946 · Cited by 198 · cited 1×
“Classification schemes for art historically relevant objects tend to emphasize the interpretation placed on the objects [33], which is, for example, the case with the widely used ‘Iconclass’ system [21] that allows the classification of iconography in artworks.”
MethodFarooq, U., & Grudin, J. (2016) · Interactions · doi:10.1145/3001896 · Cited by 175 · cited 1×
“The design concept of collaboration has been taken up over the years and appears in various other concepts such as mixed-initiative interaction [46], interactive-intelligent systems [50], or human-computer integration [35].”
BackgroundThe Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
Holland, S., Hosny, A., Newman, S., Joseph, J., & Chmielinski, K. (2018) · arXiv · doi:10.48550/arxiv.1805.03677 · Cited by 175 · cited 1×
“As our findings confirm, humanities researchers and art historians value the potential of computational tools to influence epistemology and knowledge structures (see also Section 2.3).”
BackgroundInfluentialChen, N.-C., Drouhard, M., Kocielnik, R., Suh, J., & Aragon, C. R. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3185515 · Cited by 152
Toward human-centered algorithm design
Baumer, E. P. (2017) · Big Data & Society · doi:10.1177/2053951717718854 · Cited by 125 · cited 1×
“We hypothesize that tools need to be intentionally designed in such a way that they support critical reflection [6].”
BackgroundReflective Practicum: A Framework of Sensitising Concepts to Design for Transformative Reflection
Slovák, P., Frauenberger, C., & Fitzpatrick, G. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025516 · Cited by 123
Documenting Computer Vision Datasets: An Invitation to Reflexive Data Practices
Miceli, M., Yang, T., Naudts, L., Schuessler, M., Serbanescu, D. A., & Hanna, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445880 · Cited by 123
A Companion to Digital Humanities
(2004) · Blackwell Publishing Ltd eBooks · doi:10.1111/b.9781405103213.2004.00002.x · Cited by 122
Is There a “Digital” Art History?
Drucker, J. (2013) · Visual Resources · doi:10.1080/01973762.2013.761106 · Cited by 119 · cited 3×
“Such textual and ontological knowledge representations are usually grounded in long-established epistemologies and knowledge structures, i.e., “doing old work” [28].”
BackgroundHuman-Centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Watkins, E. A., Manger, C., Daumé III, H., Riener, A., & Riedl, M. O. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503727 · Cited by 117 · cited 2×
“Current research in the area of explainable AI or human-centered explainable AI (HCXAI) (see [32]) addresses the question of how AI-based applications can be made interpretable, which is particularly challenging when considering ‘nontechnical’ users.”
BackgroundThe University of Minnesota Press
Werre, P. (2009) · Journal of Scholarly Publishing · doi:10.1353/scp.0.0055 · Cited by 108
Demystifying Critical Reflection: Defining criteria for assessment
Fisher, K. (2003) · Higher Education Research & Development · doi:10.1080/0729436032000145167 · Cited by 95 · cited 1×
“However, what exactly constitutes instances or practices of criticality and reflection and how they can be operationalized in practices of use is rarely made explicit [38].”
BackgroundTheorizing Research Practices We Forgot to Theorize Twenty Years Ago
Underwood, T. (2014) · Representations · doi:10.1525/rep.2014.127.1.64 · Cited by 89 · cited 2×
“As Underwood has argued in regards to search on literary texts, typing in a search term already encodes “tacit hypotheses about the literary significance of a symbol” [76], which also applies to text-based image retrieval.”
BackgroundFeuston, J. L., & Brubaker, J. R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479856 · Cited by 86 · cited 3×
“, [3, 18, 37, 51]), showing us that there is a reasonable overlap despite the differences in contexts.”
BackgroundHuman-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization
Fan, M., Yang, X., Yu, T., Liao, Q. V., & Zhao, J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512943 · Cited by 81 · cited 1×
“Such scrutinization is especially acknowledged in research on human-centered explanations that help people to understand the results of AI methods (see, e.g., [20, 34]).”
Background(2008) · Routledge eBooks · doi:10.4324/9780203892213 · Cited by 53
Waterton, C. (2010) · Science Technology & Human Values · doi:10.1177/0162243909340265 · Cited by 52 · cited 2×
“Such critical and reflective engagements with the hegemonic effects of information systems resonate with work from science and technology studies that point out how databases and classifications mirror and re-perform the knowledge economies of which they are a part [81].”
BackgroundPater, J., Coupe, A., Pfafman, R., Phelan, C., Toscos, T., & Jacobs, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445734 · Cited by 52 · cited 1×
“At the same time, compensating participants could likewise engender positive feelings that collude feedback [64].”
BackgroundToward a model for digital tool criticism: Reflection as integrative practice
Koolen, M., Gorp, J. V., & van Ossenbruggen, J. (2018) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqy048 · Cited by 50
Scholastic: Graphical Human-AI Collaboration for Inductive and Interpretive Text Analysis
Hong, M.-H., Marsh, L. A., Feuston, J. L., Ruppert, J., Brubaker, J. R., & Szafir, D. A. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545681 · Cited by 49 · cited 2×
“They conceptualize human-AI collaboration as a tool for assisting interpretive research [45].”
BackgroundMethodThis is not an apple! Benefits and challenges of applying computer vision to museum collections
Villaespesa, E., & Murphy, O. (2021) · Museum Management and Curatorship · doi:10.1080/09647775.2021.1873827 · Cited by 44 · cited 1×
“, [48, 56, 69, 75, 79]), which is subsequently leading to the implementation of CV in ready to use tools1.”
BackgroundPhrasing history: Selecting sources in digital repositories
Huistra, H., & Mellink, B. (2016) · Historical Methods A Journal of Quantitative and Interdisciplinary History · doi:10.1080/01615440.2016.1205964 · Cited by 41 · cited 1×
“The process of scholarly image retrieval and corpus building has changed significantly with the digitization of textual and visual sources and the creation of digital repositories (see, e.g., [28, 47]).”
BackgroundAn Ontological Approach to the Description of Visual and Iconographical Representations
Carboni, N., & Luca, L. D. (2019) · Heritage · doi:10.3390/heritage2020078 · Cited by 41 · cited 1×
“Even in the digital realm, art-historical objects remain firmly situated within established epis-temological frameworks (see, e.g., [17, 24, 27]).”
BackgroundCritical Digital Humanities: The Search for a Methodology
Rodzvilla, J. (2019) · Journal of Web Librarianship · doi:10.1080/19322909.2019.1695430 · Cited by 41 · cited 1×
“These findings are congruent with the skepticism regarding computational analysis in the humanities (see, e.g., [23, 26, 54]).”
ResultReconstructing Artifacts, Reconstructing Work: From Textual Edition to On-Line Databank
Ruhleder, K. (1995) · Science Technology & Human Values · doi:10.1177/016224399502000103 · Cited by 37 · cited 1×
“Hence, researchers need to understand and reflect on how this technology affects epistemic assumptions, research processes, and knowledge production and how the technology shapes their “ways of thinking” [66].”
Backgroundvan Es, K. F., Wieringa, M., & Schäfer, M. T. (2018) · International Conference on Web Studies (WS) · doi:10.1145/3240431.3240436 · Cited by 33 · cited 2×
“We lay the foundation for our research by reviewing related work on human-AI collaboration, principles of reflection in HCI, and critical reflection in the humanities and DH (Section 2).”
BackgroundBrey, A. P. (2021) · History Compass · doi:10.1111/hic3.12678 · Cited by 32
iART: A Search Engine for Art-Historical Images to Support Research in the Humanities
Springstein, M., Schneider, S., Rahnama, J., Hüllermeier, E., Kohle, H., & Ewerth, R. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3478564 · Cited by 32 · cited 1×
“1Examples for such tools are iART [73] or imgs.”
MethodAccept or Address? Researchers’ Perspectives on Response Bias in Accessibility Research
Ming, J., Heung, S., Azenkot, S., & Vashistha, A. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471216 · Cited by 30 · cited 1×
“Benjamin et al. suggest, amongst other things, offering “contextual cues” that enable stakeholders to combine or contrast a given explanation with their own explanation strategies [9].”
BackgroundBenjamin, J. J., Kinkeldey, C., Müller-Birn, C., Korjakow, T., & Herbst, E.-M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492858 · Cited by 22 · cited 3×
“Second, we need to factor in that domain experts interpret AI technologies within and against a diverse backdrop of existing themes and practices [9].”
BackgroundInfluentialSelf-citationBaumer, E., Siedel, D., McDonnell, L., Zhong, J., Sittikul, P., & McGee, M. (2020) · Hum. Comput. Interact. · doi:10.1080/07370024.2020.1734460 · Cited by 21 · cited 3×
“They similarly emphasize that the role of an AI-based system should be carefully balanced, as suggested by their approach of “designing for interpretation” [8].”
BackgroundIntroduction to the Transactions on Interactive Intelligent Systems
Jameson, A., & Riedl, J. (2011) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2030365.2030366 · Cited by 17 · cited 1×
“The design concept of collaboration has been taken up over the years and appears in various other concepts such as mixed-initiative interaction [46], interactive-intelligent systems [50], or human-computer integration [35].”
BackgroundThe Digital U-Turn in Art History
Näslund, A., & Wasielewski, A. (2021) · Konsthistorisk tidskrift/Journal of Art History · doi:10.1080/00233609.2021.2006774 · Cited by 17 · cited 1×
“Even in the digital realm, art-historical objects remain firmly situated within established epis-temological frameworks (see, e.g., [17, 24, 27]).”
BackgroundAlways somewhere, never there: using critical design to understand database interactions
Feinberg, M., Carter, D. L., & Bullard, J. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557055 · Cited by 16 · cited 2×
“Such stances parallel critical reflective engagements with the hegemonic effects of text-based information systems (see [36, 65, 81]).”
BackgroundBig Image Data within the Big Picture of Art History
Klinke, H. (2016) · doi:10.11588/dah.2016.2.33527 · Cited by 15 · cited 3×
“These findings are congruent with the skepticism regarding computational analysis in the humanities (see, e.g., [23, 26, 54]).”
BackgroundResultAnalyzing Gesture in Digital Art History
Impett, L. (2020) · Routledge eBooks · doi:10.4324/9780429505188-33 · Cited by 14 · cited 3×
“Recently, research in digital humanities (DH) and the sub-field of digital art history (DAH) has been exploring computer Through a reflexive thematic analysis (TA), we confirm that art historians are eager to interact with computational tools in a critical-reflective manner.”
BackgroundRawson, K., & Muñoz, T. (2019) · University of Minnesota Press eBooks · doi:10.5749/j.ctvg251hk.26 · Cited by 14 · cited 2×
“Such stances parallel critical reflective engagements with the hegemonic effects of text-based information systems (see [36, 65, 81]).”
BackgroundThe Replica Project: Building a visual search engine for art historians
Seguin, B. (2018) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/3186653 · Cited by 12 · cited 1×
“, [48, 56, 69, 75, 79]), which is subsequently leading to the implementation of CV in ready to use tools1.”
BackgroundIconclass, a device for the iconographical analysis of art objects
Couprie, L. D. (1978) · Museum International · doi:10.1111/j.1468-0033.1978.tb02136.x · Cited by 11
Linked Open Images: Visual similarity for the Semantic Web
Klic, L. (2022) · Semantic Web · doi:10.3233/sw-212893 · Cited by 7 · cited 1×
“Despite the breadth of research on CV for art historical study purposes, the solutions are, as of yet, rarely made available to nontechnical users in ready-to-use tools [53].”
BackgroundDigital Art History: A Community Assessment
Zorich, D. M. (2013) · Visual Resources · doi:10.1080/01973762.2013.761108 · Cited by 6
Brosens, K., Aerts, J. A., Alen, K., Beerens, R. J., Cardoso, B., Prekel, I. D., Ivanova, A., Lamqaddam, H., Molenberghs, G., Slegten, A., et al. (2019) · Visual Resources · doi:10.1080/01973762.2019.1553444 · Cited by 4
Digital Humanities and the Great Project:
Alvarado, R. C. (2019) · University of Minnesota Press eBooks · doi:10.5749/j.ctvg251hk.9 · Cited by 4 · cited 1×
“The development of computational tools for the retrieval and remediation of objects constituted one of the earlier goals of DH3 [2].”
MethodRepresentation issues in information retrieval system design
Smith, L. C. (1981) · ACM SIGIR Forum · doi:10.1145/1013228.511770 · Cited by 3
Jiang, J. A., Wade, K., Fiesler, C., & Brubaker, J. R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449168 · Cited by 1
Propositions for the future: Museum data standards
Chenhall, R. G., & Homulos, P. S. (1978) · Museum International (Edition Francaise) · doi:10.1111/j.1755-5825.1978.tb02059.x · Cited by 1
Human-AI Collaboration for UX Evaluation: Effects of Explanation and SynchronizationPreprint
Fan, M., Yang, X., Yu, T. T., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.12387
Research works printed but not linked: 15
- Philip E. Agre. 1997. Toward a critical technical practice: Lessons learned in trying to reform AI. In Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide (Computers, Cognition, and Work). Lawrence Erlbaum Associates, Mahwah, N.J, 131 -- 158.
- Caroline Bassett, David Michael Berry, M. Beatrice Fazi, Jack Pay, and Ben Roberts. 2017. Critical Digital Humanities and Machine-Learning. In 12th Annual International Conference of the Alliance of Digital Humanities Organizations, DH 2017, August 8--11, 2017, Conference Abstracts. Alliance of Digital Humanities Organizations, Montréal, Canada, 36 -- 40. https://dh2017.adho.org/abstracts/509/509.pdf
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- 10.1111/j.1755--5825.1978.tb02059.x · doi:10.1111/j.1755--5825.1978.tb02059.x
- 10.1007/978--3-030--85616--8_36 · doi:10.1007/978--3-030--85616--8_36
- Nan Z Da. 2019. The computational case against computational literary studies. Critical inquiry 45, 3 (2019), 601--639.
- John Dewey. 1997. How we think. Dover Publications, Mineola.
- 10.1609/aimag.v24i3.1720 · doi:10.1609/aimag.v24i3.1720
- Catherine D'Ignazio and Lauren F. Klein. 2020. Data Feminism. MIT Press, Cambridge, MA, USA.
- Vilém Flusser. 2005. Thought and reflection. Flusser Studies 1, 3 (2005), 16 -- 35.
- Matthew G Kirschenbaum. 2016. What is digital humanities and what's it doing in English departments? In Defining Digital Humanities. Routledge, New York, NY, 211--220.
- Clayton Lewis. 1982. Using the" thinking-aloud" method in cognitive interface design. IBM TJ Watson Research Center, Yorktown Heights, NY.
- Fabian Offert and Peter Bell. 2023. imgs.ai. A Deep Visual Search Engine for Digital Art History. International Journal for Digital Art History. forthcoming.
- 10.1016/0950--7051(95)98369-H · doi:10.1016/0950--7051(95)98369-h
- Nikolai Ufer, Max Simon, Sabine Lang, and Björn Ommer. 2021. Large-scale interactive retrieval in art collections using multi-style feature aggregation. PLoS ONE 16, 11 (2021), 38 pages.
Cited by
Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713778 · Cited by 490
“Critical thinking interventions have also been explored in data analysis [44, 48].”
Enhanced automated art curation using supervised modified CNN for art style classification
Li, W. (2025) · Scientific Reports · doi:10.1038/s41598-025-91671-z · Cited by 21
Paoli, S. D., & Mathis, W. S. (2024) · Quality & Quantity · doi:10.1007/s11135-024-01950-6 · Cited by 37
EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
Zheng, Q., Chen, M., Sharma, P., Tang, Y., Oswal, M., Liu, Y., & Huang, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714045 · Cited by 30
Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank
Sipos, L., Schäfer, U., Glinka, K., & Müller-Birn, C. (2023) · Mensch und Computer (MuC) · doi:10.1145/3603555.3608551 · Cited by 27
Self-citation
Metadata
- Authors
- Glinka, K., & Müller-Birn, C.
- Affiliations
- Freie Universität Berlin (DE)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-09-28
- Volume
- 7
- Issue
- CSCW2
- Pages
- 1-33
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4387329456
- Cited by
- 26
- References
- 67
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 1 · 2023: 1
- FWCI
- 71.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by-sa)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Funders
- Freie Universität Berlin
- Topics
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- human-AI collaboration, critical reflection, art historians, transparency, interpretability, think-aloud
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.