Fake images: The effects of source, intermediary, and digital media literacy on contextual assessment of image credibility online
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Fake or manipulated images propagated through the Web and social media have the capacity to deceive, emotionally distress, and influence public opinions and actions. Yet few studies have examined how individuals evaluate the authenticity of images that accompany online stories. This article details a 6-batch large-scale online experiment using Amazon Mechanical Turk that probes how people evaluate image credibility across online platforms. In each batch, participants were randomly assigned to 1 of 28 news-source mockups featuring a forged image, and they evaluated the credibility of the images based on several features. We found that participants’ Internet skills, photo-editing experience, and social media use were significant predictors of image credibility evaluation, while most social and heuristic cues of online credibility (e.g. source trustworthiness, bandwagon, intermediary trustworthiness) had no significant impact. Viewers’ attitude toward a depicted issue also positively influenced their credibility evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the salience of source information does not appear to change how accurately people identify fabricated news stories55, manipulated images56, or false news headlines57,58”
From Human detection of political speech deepfakes across transcripts, audio, and video (2024) · cites this paper as [56]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“forms of fake news may include false text such as hyperlinks or embedded content; multimedia such as false videos (Demuyakor and Opata 2022), images (Masciari et al. 2020; Shen et al. 2019), audios (Demuyakor and Opata 2022) and so on. Moreover, we can also find multimodal content (Shu et al. 2020a)”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Shen et al. 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · cited 1×
“Still, research found that the MTurk samples are slightly more diverse demographically than standard Internet samples, and a lot more diverse than American college samples (Buhrmester et al., 2011).”
Ellison, N. B., Steinfield, C., & Lampe, C. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00367.x · Cited by 9,939 · cited 2×
“If they did, we proceeded with a six-item instrument on a 5-points Likert-type scale (1 = strongly disagree, 5 = strongly agree), adapted from (Ellison et al., 2007), to measure participants’ intensity of Facebook use (e.g. “Facebook is part of my everyday activity”; “I would be sorry if Facebook…”
MethodSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 3×
“A study found that “the average American adult saw on the order of one or perhaps several fake news stories in the months around the [2016 US] election, with just over half of those who recalled seeing them believing them” (Allcott and Gentzkow, 2017: 211).”
BackgroundSocial and Heuristic Approaches to Credibility Evaluation Online
Metzger, M. J., Flanagin, A. J., & Medders, R. B. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2010.01488.x · Cited by 1,394 · cited 8×
“website reputation, endorsements, consistency, and expectancy violation), and persuasive intent (Metzger et al., 2010).”
BackgroundInfluentialDigital Media, Youth, and Credibility
Metzger, M. J., & Flanagin, A. J. (2007) · Cited by 1,060
The like economy: Social buttons and the data-intensive web
Gerlitz, C., & Helmond, A. (2013) · New Media & Society · doi:10.1177/1461444812472322 · Cited by 871 · cited 2×
“Information sharing and curating behaviors online, fueled by the prevalence of “social buttons” on social network sites and news media websites (Gerlitz and Helmond, 2013), foregrounds the importance of second-order sources, or intermediaries , that share or endorse information published originally…”
BackgroundMetzger, M. J. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20672 · Cited by 871
Flanagin, A. J., & Metzger, M. J. (2007) · New Media & Society · doi:10.1177/1461444807075015 · Cited by 796
Metzger, M. J., Flanagin, A. J., Eyal, K., Lemus, D. R., & Mccann, R. M. (2003) · Annals of the International Communication Association · doi:10.1080/23808985.2003.11679029 · Cited by 768 · cited 1×
“In this article, we purposefully combine media platform with the type of source into one factor, as the two are often conflated in the contemporary media environment (Metzger et al., 2003).”
Social Media as Information Source: Recency of Updates and Credibility of Information
Westerman, D., Spence, P. R., & Van Der Heide, B. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12041 · Cited by 708 · cited 1×
“For example, we did not manipulate the recency of images posted (all images were presented with random 2015 dates), which could influence credibility judgments (Westerman et al., 2014).”
Credibility and computing technology
Tseng, S., & Fogg, B. J. (1999) · Communications of the ACM · doi:10.1145/301353.301402 · Cited by 583 · cited 4×
“In their article examining the elements of computer credibility, Tseng and Fogg (1999) argue that credibility, or “believability,” is not an objective quality of the information itself but ultimately a perception of the user.”
BackgroundInfluentialGupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573 · cited 2×
“Among the few empirical studies specifically on image credibility, for instance, Gupta et al. (2013) identified more than 10,000 tweets containing fake photos, and used machine learning models to compare fake images to real ones based on several features.”
BackgroundHow do users evaluate the credibility of Web sites?: a study with over 2,500 participants
Fogg, B. J., Soohoo, C., Danielson, D. R., Marable, L., Stanford, J., & Tauber, E. R. (2003) · Proceedings of the 2003 conference on Designing for user experiences · doi:10.1145/997078.997097 · Cited by 565 · cited 1×
“To save cognitive time and effort, they instead process and determine the credibility of the information by relying on social and heuristic cues (Fogg et al., 2003; Metzger et al., 2010).”
BackgroundNet Smart: How to Thrive Online
Rheingold, H. (2012) · Cited by 550
A picture is worth a thousand lies: Using false photographs to create false childhood memories
Wade, K. A., Garry, M., Don Read, J., & Lindsay, D. S. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196318 · Cited by 467 · cited 1×
“Studies suggest that manipulated images can distort viewer’s memory (Wade et al., 2002)— therefore further enhancing the credibility of these images—and even influence decision-making behaviors such as voting (Bailenson et al.”
BackgroundThe Nature of Political Ideology in the Contemporary Electorate
Treier, S., & Hillygus, D. S. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp067 · Cited by 422 · cited 1×
“The issue relevant questions were adapted from Treier and Hillygus (2009) and modified to fit each of the images tested.”
MethodTweeting is believing?: understanding microblog credibility perceptions
Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145274 · Cited by 411 · cited 2×
“Previous research in this area has either predominantly focused on fake image detection using machine learning approaches (Gupta et al., 2013), or on the credibility of textual information, such as websites and blogs (Allcott and Gentzkow, 2017; Morris et al., 2012; Wineburg and McGrew, 2016).”
BackgroundFriggeri, A., Adamic, L., Eckles, D., & Cheng, J. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14559 · Cited by 382 · cited 1×
“Quite often the distribution of fake images will far surpass the distribution of any correction or attempt to expose the forgery (Friggeri et al., 2014).”
BackgroundWesterman, D., Spence, P. R., & Van Der Heide, B. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.09.001 · Cited by 321 · cited 1×
“Social network sites such as Facebook and Twitter introduce a host of system-gener-ated metrics (e.g. number of followers) as cognitive heuristics for credibility judgment (Sundar, 2008; Westerman et al., 2012, 2014).”
BackgroundThe average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Stewart, N., Ungemach, C., Harris, A. J. L., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015) · Judgment and Decision Making · doi:10.1017/s1930297500005611 · Cited by 304 · cited 1×
“Since participants were only allowed to take part in one of our 6-batch series, the eligible MTurk pool became smaller as we proceeded with each subsequent study and recruitment process became longer (see Stewart et al., 2015: for an estimate of MTurk worker pool size).”
Succinct survey measures of web-use skills
Hargittai, E., & Hsieh, Y. P. (2012) · Social Science Computer Review · doi:10.1177/0894439310397146 · Cited by 288 · cited 4×
“Internet skills generally refer to users’ ability to use various online media effectively (Hargittai and Hsieh, 2012).”
BackgroundResultInfluentialHargittai, E., & Shaw, A. (2015) · Information, Communication & Society · doi:10.1080/1369118x.2014.957711 · Cited by 257 · cited 1×
“We found them to have good self-reported Internet skills ( M = 4.04 on a 5-point scale), compared to a student sample in our study and those reported previously (Hargittai and Hsieh, 2012; Hargittai and Shaw, 2015), perhaps unsurprisingly as they participated in an online labor marketplace.”
ResultInfluentialAn Update on Survey Measures of Web-Oriented Digital Literacy
Hargittai, E. (2009) · Social Science Computer Review · doi:10.1177/0894439308318213 · Cited by 229 · cited 1×
“Furthermore, participants’ Internet and digital photography skills were self-reported rather than measured objectively, although evidence shows that the likelihood of participants misreporting their Internet skills is low (Hargittai, 2009).”
BackgroundFacial Similarity between Voters and Candidates Causes Influence
Bailenson, J. N., Iyengar, S., Yee, N., & Collins, N. A. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn064 · Cited by 223 · cited 1×
“, 2002)— therefore further enhancing the credibility of these images—and even influence decision-making behaviors such as voting (Bailenson et al., 2008; Nash et al., 2009).”
BackgroundTo Tweet or to Retweet? That Is the Question for Health Professionals on Twitter
Lee, J. Y., & Sundar, S. S. (2013) · Health Communication · doi:10.1080/10410236.2012.700391 · Cited by 196 · cited 1×
“Several studies have shown consistent evidence for “bandwagon” effects where people are more likely to agree with a perceived consensus from aggregate metrics (Lee and Sundar, 2013; Sundar, 2008).”
BackgroundImpact of Popularity Indications on Readers' Selective Exposure to Online News
Knobloch-Westerwick, S., Sharma, N., Hansen, D. L., & Alter, S. (2005) · Journal of Broadcasting & Electronic Media · doi:10.1207/s15506878jobem4903_3 · Cited by 191 · cited 1×
“In asking participants to select and read news articles with different recommendation ratings, Knobloch-Westerwick et al. (2005) found that higher rated articles were selected more often.”
BackgroundAntin, J., & Shaw, A. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208699 · Cited by 172 · cited 1×
“MTurk participants were certainly not motivated to pay attention (Antin and Shaw, 2012), as they were compensated by the completion of the task, regardless of the response quality.”
BackgroundWeb credibility assessment: Conceptualization, operationalization, variability, and models
Choi, W., & Stvilia, B. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23543 · Cited by 168 · cited 3×
“Familiarity and expertise with various online platforms, or “digital media literacy,” are found to inform users’ credibility assessment (Choi and Stvilia, 2015).”
BackgroundInfluentialKnobloch-Westerwick, S., Johnson, B. K., & Westerwick, A. (2015) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12105 · Cited by 167
Can people identify original and manipulated photos of real-world scenes?
Nightingale, S. J., Wade, K. A., & Watson, D. G. (2017) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-017-0067-2 · Cited by 135 · cited 3×
“Past studies reported that people generally believe that they are rarely capable of identifying fake images as such (Farid and Bravo, 2010), and that images are generally considered trust-worthy (Kasra et al., 2018; Nightingale et al., 2017).”
BackgroundMethodChanging history: doctored photographs affect memory for past public events
Sacchi, D. L. M., Agnoli, F., & Loftus, E. F. (2007) · Applied Cognitive Psychology · doi:10.1002/acp.1394 · Cited by 123 · cited 1×
“Moreover, even when individuals do become aware of the true nature of a forgery, the harmful impact of misinformation on their perception, memory, emotions, viewpoints, and attitude toward a topic can linger (Sacchi et al., 2007).”
BackgroundImage forensic analyses that elude the human visual system
Farid, H., & Bravo, M. J. (2010) · SPIE Proceedings · doi:10.1117/12.837788 · Cited by 66 · cited 2×
“Past studies reported that people generally believe that they are rarely capable of identifying fake images as such (Farid and Bravo, 2010), and that images are generally considered trust-worthy (Kasra et al., 2018; Nightingale et al., 2017).”
BackgroundWhy do doctored images distort memory?
Nash, R. A., Wade, K. A., & Brewer, R. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.04.011 · Cited by 41 · cited 1×
“, 2002)— therefore further enhancing the credibility of these images—and even influence decision-making behaviors such as voting (Bailenson et al., 2008; Nash et al., 2009).”
BackgroundSeeing Is Believing: How People Fail to Identify Fake Images on the Web
Kasra, M., Shen, C., & O'Brien, J. F. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188604 · Cited by 36
Self-citationGreer, J. D., & Gosen, J. D. (2002) · Visual Communication Quarterly · doi:10.1080/15551390209363485 · Cited by 31 · cited 1×
“Two items on a 5-point scale (1 = None, 5 = I’m an expert) were used to measure participants’ digital imaging (e.g. photo editing) experiences and skills (Greer and Gosen, 2002; Cronbach’s alpha = .74).”
Method(2008) · Issue Lab (Candid)
Research works printed but not linked: 2
- Friggeri A, 2014, Proceedings of the 8th International AAAI conference on weblogs and social media (ICWSM), 101
- Light K, 2004, Fonda, Kerry and photo fakery
Cited by
The psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
“…studies , which investigate the effect of signals (e.g., sources) to detect and recognize fake news (Vraga and Bode 2017; Jakesch et al. 2019; Shen et al. 2019; Avram et al. 2020; Hameleers et al. 2020; Dias et al. 2020; Nyhan et al. 2020; Bode and Vraga 2015; Tsang 2020; Vishwakarma et al.…”
Calvillo, D. P., Ross, B. J., Garcia, R. J. B., Smelter, T. J., & Rutchick, A. M. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550620940539 · Cited by 514
“Mechanical Turk workers may have greater internet skills (Shen et al., 2019) that could make them less susceptible to fake news.”
BackgroundSocial Media, Echo Chambers, and Political Polarization
Barberá, P. (2020) · Social Media and Democracy · doi:10.1017/9781108890960.004 · Cited by 373
Metadata
- Authors
- Shen, C., Kasra, M., Pan, W., Bassett, G. A., Malloch, Y., & O’Brien, J. F.
- Affiliations
- University of California, Davis (US)
- University of Virginia (US)
- University of California, Berkeley (US)
- Corresponding author
- Shen, Cuihua
- Venue
- New Media & Society
- Publisher
- SAGE Publications
- Published
- 2018-09-24
- Volume
- 21
- Issue
- 2
- Pages
- 438-463
- ISSN
- 1461-4448 (ISSN-L)
- 1461-7315
- OpenAlex
- W2893790011
- Cited by
- 209
- References
- 36
- Citations by year
- 2026: 15 · 2025: 31 · 2024: 26 · 2023: 34 · 2022: 24 · 2021: 28 · 2020: 42 · 2019: 6 · 2018: 3
- FWCI
- 44.95
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- New Media & Society (publishedVersion)
- SSRN Electronic Journal (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Division of Information and Intelligent Systems (1444861)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Education › Literacy, Media, and Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Keywords
- fake images, image credibility, digital media literacy, image editing, social media use, source trustworthiness, heuristic cues, online news credibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.