The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections
Open accessAbstract
Significance: We present evidence from five experiments in two countries suggesting the power and robustness of the search engine manipulation effect (SEME). Specifically, we show that ( i ) biased search rankings can shift the voting preferences of undecided voters by 20% or more, ( ii ) the shift can be much higher in some demographic groups, and ( iii ) such rankings can be masked so that people show no awareness of the manipulation. Knowing the proportion of undecided voters in a population who have Internet access, along with the proportion of those voters who can be influenced using SEME, allows one to calculate the win margin below which SEME might be able to determine an election outcome.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
(1999) · Cited by 12,854
Women, Fire, and Dangerous Things
Lakoff, G. (1987) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226471013.001.0001 · Cited by 12,386
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
A 61-million-person experiment in social influence and political mobilization
Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012) · Nature · doi:10.1038/nature11421 · Cited by 2,575
Forming impressions of personality.
Asch, S. E. (1946) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0055756 · Cited by 2,508
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
FORMING IMPRESSIONS OF PERSONALITY
Asch, S. E. (1961) · Documents of Gestalt Psychology · doi:10.1525/9780520313514-018 · Cited by 2,081
The automated will: nonconscious activation and pursuit of behavioral goals.
Bargh, J. A., Gollwitzer, P. M., Lee-Chai, A., Barndollar, K., & Trötschel, R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.6.1014 · Cited by 1,865
The serial position effect of free recall.
Murdock, B. B. (1962) · Journal of Experimental Psychology · doi:10.1037/h0045106 · Cited by 1,717 · cited 1×
“Specific order effects, such as primacy and recency, show that the first and last items presented on a list, respectively, are more likely to be recalled than items in the middle (16, 17).”
BackgroundMemory: A contribution to experimental psychology.
Ebbinghaus, H. (1913) · doi:10.1037/10011-000 · Cited by 1,645
Attitudes and the Prediction of Behavior: A Meta-Analysis of the Empirical Literature
Kraus, S. J. (1995) · Personality and Social Psychology Bulletin · doi:10.1177/0146167295211007 · Cited by 1,613 · cited 1×
“Laboratory manipulations of preferences and attitudes often impact subjects for only a short time, sometimes just hours (65).”
BackgroundBalanced-budget redistribution as the outcome of political competition
Lindbeck, A., & Weibull, J. W. (1987) · Public Choice · doi:10.1007/bf00116710 · Cited by 1,611
The Fox News Effect: Media Bias and Voting
DellaVigna, S., & Kaplan, E. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1187 · Cited by 1,602 · cited 5×
“It is already well established that biased media sources such as newspapers (36–38), political polls (39), and television (40) sway voters (41, 42).”
BackgroundInfluentialPerverse Accountability: A Formal Model of Machine Politics with Evidence from Argentina
STOKES, S. C. (2005) · American Political Science Review · doi:10.1017/s0003055405051683 · Cited by 1,586
Real life, real users, and real needs: a study and analysis of user queries on the web
Jansen, B. J., Spink, A., & Saracevic, T. (2000) · Information Processing & Management · doi:10.1016/s0306-4573(99)00056-4 · Cited by 1,320
Mere Exposure: A Gateway to the Subliminal
Zajonc, R. B. (2001) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00154 · Cited by 1,299 · cited 1×
“Given hundreds or thousands of exposures of this sort, we speculate not only that the resulting attitudes and preferences would be stable, but that they would become stronger over time, much as brand preferences become stronger when advertisements are presented repeatedly (66).”
BackgroundElectoral Politics as a Redistributive Game
Cox, G. W., & McCubbins, M. D. (1986) · The Journal of Politics · doi:10.2307/2131098 · Cited by 1,274
Analysis of a very large web search engine query log
Silverstein, C., Marais, H., Henzinger, M., & Moricz, M. (1999) · ACM SIGIR Forum · doi:10.1145/331403.331405 · Cited by 1,153
Searching the web: The public and their queries
Spink, A., Wolfram, D., Jansen, M. B. J., & Saracevic, T. (2001) · Journal of the American Society for Information Science and Technology · doi:10.1002/1097-4571(2000)9999:9999<::aid-asi1591>3.0.co;2-r · Cited by 1,084
Improving web search ranking by incorporating user behavior information
Agichtein, E., Brill, E., & Dumais, S. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148177 · Cited by 1,041
Persuasion Bias, Social Influence, and Unidimensional Opinions
DeMarzo, P. M., Vayanos, D., & Zwiebel, J. (2003) · The Quarterly Journal of Economics · doi:10.1162/00335530360698469 · Cited by 958
Mere Exposure: A Gateway to the Subliminal
Zajonc, R. B. (2006) · The Construction of Preference · doi:10.1017/cbo9780511618031.026 · Cited by 936
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825
In Google We Trust: Users’ Decisions on Rank, Position, and Relevance
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00351.x · Cited by 715
Winkielman, P., Berridge, K. C., & Wilbarger, J. L. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167204271309 · Cited by 708
Eye-tracking analysis of user behavior in WWW search
Granka, L. A., Joachims, T., & Gay, G. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009079 · Cited by 696
Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search
Joachims, T., Granka, L., Pan, B., Hembrooke, H., Radlinski, F., & Gay, G. (2007) · ACM Transactions on Information Systems · doi:10.1145/1229179.1229181 · Cited by 677
Ansari, A., & Mela, C. F. (2003) · Journal of Marketing Research · doi:10.1509/jmkr.40.2.131.19224 · Cited by 596
Gerber, A. S., Karlan, D., & Bergan, D. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.2.35 · Cited by 577
The order of presentation in persuasion
Hovland, C. I. (1957) · Medical Entomology and Zoology · Cited by 524
Learning user interaction models for predicting web search result preferences
Agichtein, E., Brill, E., Dumais, S., & Ragno, R. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148175 · Cited by 462
Media Bias and Influence: Evidence from Newspaper Endorsements
Chiang, C.-F., & Knight, B. (2011) · The Review of Economic Studies · doi:10.1093/restud/rdq037 · Cited by 410
Kühberger, A., Fritz, A., & Scherndl, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0105825 · Cited by 399
The Impact of Media Bias: How Editorial Slant Affects Voters
Druckman, J. N., & Parkin, M. (2005) · The Journal of Politics · doi:10.1111/j.1468-2508.2005.00349.x · Cited by 374
Valuing thoughts, ignoring behavior: The introspection illusion as a source of the bias blind spot
Pronin, E., & Kugler, M. B. (2007) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2006.05.011 · Cited by 366 · cited 1×
“Invisible sources of influence can be harder to defend against (67–69), and for people who are impressionable, invisible sources of influence not only persuade, they also leave people feeling that they made up their own minds— that no external force was applied (70, 71).”
BackgroundHow much can behavioral targeting help online advertising?
Yan, J., Liu, N., Wang, G., Zhang, W., Jiang, Y., & Chen, Z. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526745 · Cited by 365
The Impact of Candidate Name Order on Election Outcomes
Miller, J. M., & Krosnick, J. A. (1998) · Public Opinion Quarterly · doi:10.1086/297848 · Cited by 353
Bandwagon and Underdog Effects and the Possibility of Election Predictions
Simon, H. A. (1954) · Public Opinion Quarterly · doi:10.1086/266513 · Cited by 326
Beyond Vicary’s fantasies: The impact of subliminal priming and brand choice
Karremans, J. C., Stroebe, W., & Claus, J. (2006) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2005.12.002 · Cited by 307
Congressional Elections and the Pork Barrel
Stein, R. M., & Bickers, K. N. (1994) · The Journal of Politics · doi:10.2307/2132144 · Cited by 266
The Electoral Dynamics of the Federal Pork Barrel
Bickers, K. N., & Stein, R. M. (1996) · American Journal of Political Science · doi:10.2307/2111752 · Cited by 258
Opinion change as a function of the communicator's attractiveness and desire to influence.
Mills, J., & Aronson, E. (1965) · Journal of Personality and Social Psychology · doi:10.1037/h0021646 · Cited by 243
An eye tracking study of the effect of target rank on web search
Guan, Z., & Cutrell, E. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240691 · Cited by 243
Berger, J., & Fitzsimons, G. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.1.1 · Cited by 242
Swing voters, core voters, and distributive politics
Cox, G. W. (2010) · Political Representation · doi:10.1017/cbo9780511813146.015 · Cited by 221
Large-scale behavioral targeting
Chen, Y., Pavlov, D., & Canny, J. F. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557048 · Cited by 203
Estimating Causal Effects of Ballot Order from a Randomized Natural Experiment
Ho, D. E., & Imai, K. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn018 · Cited by 198
Eye tracking and online search: Lessons learned and challenges ahead
Lorigo, L., Haridasan, M., Brynjarsdóttir, H., Xia, L., Joachims, T., Gay, G., Granka, L., Pellacini, F., & Pan, B. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20794 · Cited by 188
Congressional elections and the pork barrel
(1995) · Perpetuating the Pork Barrel · doi:10.1017/cbo9781139174459.007 · Cited by 181
Primacy and Recency Effects on Clicking Behavior
Murphy, J., Hofacker, C. F., & Mizerski, R. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2006.00025.x · Cited by 171
The demographics of web search
Weber, I. G., & Castillo, C. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835537 · Cited by 166
Measurement of online visibility and its impact on Internet traffic
Drèze, X., & Zufryden, F. (2004) · Journal of Interactive Marketing · doi:10.1002/dir.10072 · Cited by 166
What users see – Structures in search engine results pages
Höchstötter, N., & Lewandowski, D. (2009) · Information Sciences · doi:10.1016/j.ins.2009.01.028 · Cited by 153
Inferring the demographics of search users: social data meets search queries
Bi, B., Shokouhi, M., Kosiński, M., & Graepel, T. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488401 · Cited by 144
Morwitz, V. G., & Pluzinski, C. (1996) · Journal of Consumer Research · doi:10.1086/209466 · Cited by 106
Rest in peace? Brand-induced mortality salience and consumer behavior
Fransen, M. L., Fennis, B. M., Pruyn, A. T. H., & Das, E. (2008) · Journal of Business Research · doi:10.1016/j.jbusres.2007.09.020 · Cited by 100 · cited 1×
“Of greater concern in the present context, when people are unaware they are being manipulated, they tend to believe they have adopted their new thinking voluntarily (69, 70).”
BackgroundBrasel, S. A., & Gips, J. (2010) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2010.09.008 · Cited by 87
Do Web search engines suppress controversy?
Gerhart, S. L. (2004) · First Monday · doi:10.5210/fm.v9i1.1111 · Cited by 85
James, W. (1889) · Mind · doi:10.1093/mind/xiv.55.321 · Cited by 80
Moderators of Candidate Name‐Order Effects in Elections: An Experiment
Kim, N., Krosnick, J. A., & Casasanto, D. J. (2014) · Political Psychology · doi:10.1111/pops.12178 · Cited by 71
Landing Page Optimization: The Definitive Guide to Testing and Tuning for Conversions
Ash, T., Ginty, M., & Page, R. (2008) · Cited by 65
The impact of candidate name order on election outcomes in North Dakota
Chen, E., Simonovits, G., Krosnick, J. A., & Josh Pasek, B. (2014) · Electoral Studies · doi:10.1016/j.electstud.2014.04.018 · Cited by 64
Lund, F. H. (1925) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0076047 · Cited by 60
Prevalence and Moderators of the Candidate Name-Order Effect
Josh Pasek, B., Schneider, D., Krosnick, J. A., Tahk, A. M., Ophir, E., & Milligan, C. (2014) · Public Opinion Quarterly · doi:10.1093/poq/nfu013 · Cited by 60
Tourangeau, R., Couper, M. P., & Conrad, F. G. (2013) · Public Opinion Quarterly · doi:10.1093/poq/nfs063 · Cited by 60
Visual Design, Order Effects, and Respondent Characteristics in a Self-Administered Survey
Stern, M., Dillman, D. A., & Smyth, J. D. (2007) · Survey research methods · doi:10.18148/srm/2007.v1i3.600 · Cited by 59
Don't you know that you want to trust me? Subliminal goal priming and persuasion
Légal, J., Chappé, J., Coiffard, V., & Villard-Forest, A. (2011) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2011.06.006 · Cited by 52
Web-scale multi-task feature selection for behavioral targeting
Ahmed, A. A., Aly, M., Das, A., Smola, A. J., & Anastasakos, T. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398508 · Cited by 13
Zittrain, J. L. (2014) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 10
Cited by
Countering Misinformation and Fake News Through Inoculation and Prebunking
Lewandowsky, S., & van der Linden, S. (2021) · European Review of Social Psychology · doi:10.1080/10463283.2021.1876983 · Cited by 773
Accountability in algorithmic decision making
Diakopoulos, N. (2016) · Communications of the ACM · doi:10.1145/2844110 · Cited by 763
Citizens Versus the Internet: Confronting Digital Challenges With Cognitive Tools
Kozyreva, A., Lewandowsky, S., & Hertwig, R. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620946707 · Cited by 479
How behavioural sciences can promote truth, autonomy and democratic discourse online
Lorenz-Spreen, P., Lewandowsky, S., Sunstein, C. R., & Hertwig, R. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0889-7 · Cited by 223
Auditing Partisan Audience Bias within Google Search
Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274417 · Cited by 209
Self-citation
Metadata
- Authors
- Epstein, R., & Robertson, R. E.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2015-08-04
- Volume
- 112
- Issue
- 33
- Pages
- E4512-21
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2099865247
- Cited by
- 577
- References
- 71
- FWCI
- 101.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.