Seek and you shall find? A content analysis on the diversity of five search engines’ results on political queries
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Search engines are important political news sources and should thus provide users with diverse political information – an important precondition of a well-informed citizenry. The search engines’ algorithmic content selection strongly influences the diversity of the content received by the users – particularly since most users highly trust search engines and often click on only the first result. A widespread concern is that users are not informed diversely by search engines, but how far this concern applies has hardly been investigated. Our study is the first to investigate content diversity provided by five search engines on ten current political issues in Germany. The findings show that sometimes even the first result is highly diverse, but in most cases, more results must be considered to be informed diversely. This unreliability presents a serious challenge when using search engines as political news sources. Our findings call for media policy measures, for example in terms of algorithmic transparency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
In Google We Trust: Users’ Decisions on Rank, Position, and Relevance
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00351.x · Cited by 715 · cited 4×
“The fi ndings show that obtaining diverse information on current political issues through search engines is possible, but by no means guaranteed – particularly if a user simply clicks on the fi rst result, as most users do (Pan et al., 2007).”
BackgroundInfluentialBurst of the Filter Bubble?: Effects of personalization on the diversity of Google News
Haim, M., Graefe, A., & Brosius, H.-B. (2018) · Digital Journalism · doi:10.1080/21670811.2017.1338145 · Cited by 399
Möller, J., Trilling, D., Helberger, N., & van Es, B. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2018.1444076 · Cited by 387
Deconstructing the Diversity Principle
Napoli, P. M. (1999) · Journal of Communication · doi:10.1111/j.1460-2466.1999.tb02815.x · Cited by 370
Auditing Partisan Audience Bias within Google Search
Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274417 · Cited by 209
Research works printed but not linked: 48
- 10.1177/0016549204041473 · DOI
- Beiler M., 2013, Nachrichtensuche im Internet: Inhaltsanalyse zur journalistischen Qualität von Nachrichtensuchmaschinen
- 10.1016/j.poetic.2009.09.002 · DOI
- d'Haenens L., 2005, Communications, 30, 293
- 10.1177/107769907805500328 · doi:10.1177/107769907805500328
- 10.2139/ssrn.2960697 · DOI
- 10.1073/pnas.1419828112 · DOI · Paper page
- 10.1080/21670811.2018.1502045 · DOI · Paper page
- 10.5771/9783845262444 · doi:10.5771/9783845262444
- 10.5210/fm.v9i1.1111 · DOI · Paper page
- 10.1080/01972243.2010.511560 · DOI · Paper page
- 10.1080/0144929X.2017.1381166 · DOI
- 10.1145/2488388.2488435 · DOI · Paper page
- 10.1016/S0304-422X(00)00006-1 · DOI
- 10.1080/17512786.2014.889451 · DOI
- 10.5325/jinfopoli.1.2011.0441 · DOI · Paper page
- 10.1145/3308558.3313654 · DOI · Paper page
- 10.1080/1461670X.2017.1308229 · DOI
- 10.1145/2124295.2124345 · DOI
- 10.1080/21670811.2015.1087810 · DOI
- 10.1515/9783110238174.351 · DOI
- 10.1016/j.ipm.2004.10.007 · DOI · Paper page
- 10.1002/poi3.166 · DOI · Paper page
- 10.1177/0163443708098248 · DOI
- 10.1515/nor-2017-0230 · DOI
- 10.1007/s10791-018-9341-2 · DOI · Paper page
- 10.4337/9780857939852.00028 · DOI
- 10.1111/jcc4.12043 · DOI
- 10.5771/1615-634X-2015-4-495 · doi:10.5771/1615-634x-2015-4-495
- Magin M., 2019, Media Perspektiven, 421
- 10.1080/1461670X.2017.1343650 · DOI
- 10.1177/0093650202239026 · DOI · Paper page
- McMahon, C., Johnson, I. & Hecht, B. (2017). The substantial interdependence of Wikipedia and Google: A case study on the relationship between peer production communities and information technologies.Proceedings of the eleventh international AAAI conference on web and social media, ICWSM2017 (pp. 142–151). AAAI Press. · DOI
- McQuail D., 1992, Media performance: Mass communication and the public interest
- Metaxas, P. T. & Pruksachatkun, Y. (2017). Manipulation of search engine results during the 2016 US congressional elections.Proceedings of the ICIW2017, Venice, Italy.
- 10.1016/S0306-4573(01)00020-6 · DOI
- 10.17265/2159-5313/2016.09.003 · DOI · Paper page
- Pariser E., 2011, The filter bubble: What the internet is hiding from you
- 10.1080/00031305.2016.1141708 · DOI
- 10.1108/info-05-2015-0025 · DOI · Paper page
- Shannon C. E., 1949, The mathematical theory of communication
- 10.1515/9783110338218.1 · doi:10.1515/9783110338218.1
- 10.1080/1369118X.2016.1261171 · DOI
- 10.1145/3290605.3300683 · DOI · Paper page
- 10.1177/0894439319881634 · DOI
- van Cuilenburg J., 2000, Measuring media content, quality and diversity: Approaches and issues in content research, 51
- van Cuilenburg J., 2007, Media between culture and commerce, 25
- van Hoboken, J. (2012).Search engine freedom: On the implications of the right to freedom of expression for the legal governance of web search engines[Doctoral dissertation, University of Amsterdam]. UvA-DARE (Digital Academic Repository). https://pure.uva.nl/ws/files/1769429/104098_thesis.pdf
Cited by
Gallagher, R. J., Frank, M. R., Mitchell, L., Schwartz, A. J., Reagan, A. J., Danforth, C. M., & Dodds, P. S. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00260-3 · Cited by 70
Brantner, C., Karlsson, M., & Kuai, J. (2025) · Telecommunications Policy · doi:10.1016/j.telpol.2025.102952 · Cited by 17
Kuai, J., Brantner, C., Karlsson, M., Van Couvering, E., & Romano, S. (2026) · New Media & Society · doi:10.1177/14614448251321162 · Cited by 16
“Nevertheless, users often only view the first result, raising concerns about democracy and informed citizenship (Steiner et al., 2022; Urman and Makhortykh, 2023).”
Digitising “The Big Lie”: Algorithmic Curation as an Inhibitor of Media Exposure Diversity Online
Reid, J. (2024) · Communicatio · doi:10.1080/02500167.2024.2424841 · Cited by 10
Metadata
- Authors
- Steiner, M., Magin, M., Stark, B., & Geiß, S.
- Venue
- Information, Communication & Society
- Publisher
- Informa UK Limited
- Published
- 2020-06-24
- Volume
- 25
- Issue
- 2
- Pages
- 217-241
- ISSN
- 1369-118X (ISSN-L)
- 1468-4462
- OpenAlex
- W3037426931
- Cited by
- 48
- References
- 5
- FWCI
- 7.21
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Johannes Gutenberg University Mainz
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Seek and you shall find? A content analysis on the diversity of five search engines’ results on political queries. https://app.cochat.ai/papers/10.1080/1369118x.2020.1776367
- The paper
- Steiner, M., Magin, M., Stark, B., & Geiß, S. (2022). Seek and you shall find? A content analysis on the diversity of five search engines’ results on political queries. Information, Communication & Society. https://doi.org/10.1080/1369118x.2020.1776367
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.