Hey, Google, is it what the Holocaust looked like?: Auditing algorithmic curation of visual historical content on Web search engines
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
By filtering and ranking information, search engines shape how individuals perceive both the present and past events. However, these information curation mechanisms are prone to malperformance that can misinform their users. In this article, we examine how search malperformance can influence representation of traumatic past by investigating image search outputs of six search engines in relation to the Holocaust in English and Russian. Our findings indicate that besides two common themes - commemoration and liberation of camps - there is substantial variation in visual representation of the Holocaust between search engines and languages. We also observe several instances of search malperformance, including content propagating antisemitism and Holocaust denial, misattributed images, and disproportionate visibility of specific Holocaust aspects that might result in its distorted perception by the public.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Auditing Partisan Audience Bias within Google Search
Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274417 · Cited by 209
Memory, politics and emotions: internet memes and protests in Venezuela and Ukraine
Makhortykh, M., & González Aguilar, J. M. (2020) · Continuum · doi:10.1080/10304312.2020.1764782 · Cited by 74 · cited 1×
“Images have strong affective potential (Makhortykh and Aguilar, 2020) and can facilitate the comprehension of complex phenomena that are hard to express verbally (Bleiker, 2018).”
BackgroundSelf-citationOzalp, S., Williams, M. L., Burnap, P., Liu, H., & Mostafa, M. (2020) · Social Media + Society · doi:10.1177/2056305120916850 · Cited by 57
How search engines disseminate information about COVID-19 and why they should do better
Makhortykh, M., Urman, A., & Ulloa, R. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-017 · Cited by 54 · cited 7×
“Examples of such outputs range from the appearance of hyperpartisan media promoting unreliable information for socially important queries, such as “coronavirus” (Makhortykh, et al. , 2020), to the inclusion of “pornified” content for innocuous queries describing race and gender groups (Noble, 2018).”
BackgroundResultInfluentialSelf-citation
Cited by
Makhortykh, M., Zucker, E. M., Simon, D. J., Bultmann, D., & Ulloa, R. (2023) · Discover Artificial Intelligence · doi:10.1007/s44163-023-00072-6 · Cited by 48
Self-citationTracing the bias loop: AI, cultural heritage and bias-mitigating in practice
Foka, A., Griffin, G., Ortiz Pablo, D., Rajkowska, P., & Badri, S. (2025) · AI & SOCIETY · doi:10.1007/s00146-025-02349-z · Cited by 43
Makhortykh, M. (2023) · Memory Studies · doi:10.1177/17506980231202849 · Cited by 16
Self-citationThe right to audit and power asymmetries in algorithm auditing
Urman, A., Smirnov, I., & Lasser, J. (2024) · EPJ Data Science · doi:10.1140/epjds/s13688-024-00454-5 · Cited by 12
Self-citation
Metadata
- Authors
- Makhortykh, M., Urman, A., & Ulloa, R.
- Venue
- First Monday
- Publisher
- University of Illinois Libraries
- Published
- 2021-10-04
- ISSN
- 1396-0458 (ISSN-L)
- 1396-0466
- OpenAlex
- W3206983972
- Cited by
- 30
- References
- 4
- FWCI
- 5.67
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Hey, Google, is it what the Holocaust looked like?: Auditing algorithmic curation of visual historical content on Web search engines. https://app.cochat.ai/papers/10.5210/fm.v26i10.11562
- The paper
- Makhortykh, M., Urman, A., & Ulloa, R. (2021). Hey, Google, is it what the Holocaust looked like?: Auditing algorithmic curation of visual historical content on Web search engines. First Monday. https://doi.org/10.5210/fm.v26i10.11562
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.