The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Is artificial intelligence more persuasive than humans? A meta-analysis
Abstract
The rapid deployment of artificial intelligence (AI) technology has enabled AI agents to take on various roles as communicators, such as virtual assistants, robot journalists, and AI doctors. This study meta-analyzed 121 randomized experimental studies (N = 53,977) that compared the effects of AI and human agency on persuasion outcomes, including perceptions, attitudes, intentions, and behaviors. The results showed that AI agents were as persuasive as humans in terms of overall persuasion outcomes. With regard to different types of outcomes, AI was less effective than humans at shaping behavioral intentions, but did not differ significantly from humans in eliciting perceptions, attitudes, or actual behaviors. Additionally, heterogeneous patterns were observed for different roles of AI communicators, directions of communication, experimental settings, and demographic segments. The implications of these findings for human–machine communication and persuasion in the era of AI are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations across Nations
Bhagat, R. S., & Hofstede, G. (2002) · The Academy of Management Review · doi:10.2307/4134391 · Cited by 21,664
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Cultures and organizations: software of the mind
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4203 · Cited by 3,673
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
(2020) · doi:10.1145/3313831 · Cited by 1,951
Persuasion theory and research
O’Keefe, D. J. (1990) · Cited by 1,555
Persuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338
Mende, M., Scott, M. L., van Doorn, J., Grewal, D., & Shanks, I. (2019) · Journal of Marketing Research · doi:10.1177/0022243718822827 · Cited by 1,197
Blut, M., Wang, C., Wünderlich, N. V., & Brock, C. (2021) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-020-00762-y · Cited by 1,194
The SAGE Encyclopedia of Communication Research Methods
Allen, M. (2017) · doi:10.4135/9781483381411 · Cited by 1,103
Digital Media, Youth, and Credibility
Metzger, M. J., & Flanagin, A. J. (2007) · Cited by 1,060
Artificial intelligence and communication: A Human–Machine Communication research agenda
Guzman, A. L., & Lewis, S. C. (2020) · New Media & Society · doi:10.1177/1461444819858691 · Cited by 951
Rise of Machine Agency: A Framework for Studying the Psychology of Human–AI Interaction (HAII)
Sundar, S. S. (2020) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmz026 · Cited by 871
See Something, Say Something: Correction of Global Health Misinformation on Social Media
Bode, L., & Vraga, E. K. (2018) · Health Communication · doi:10.1080/10410236.2017.1331312 · Cited by 745
People are averse to machines making moral decisions.
Bigman, Y. E., & Gray, K. (2018) · Cognition · doi:10.1016/j.cognition.2018.08.003 · Cited by 738
Gender and attitudes toward technology use: A meta-analysis
Cai, Z., Fan, X., & Du, J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.11.003 · Cited by 728
The Dynamics of Persuasion: Communication and Attitudes in the 21st Century
Perloff, R. M. (1993) · EngagedScholarship @ Cleveland State University (Cleveland State University) · Cited by 645
Meta-analysis of multiple outcomes: a multilevel approach
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0527-2 · Cited by 450
The relative influence of advice from human experts and statistical methods on forecast adjustments
Önkal, D., Goodwin, P., Thomson, M., Gönül, S., & Pollock, A. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.637 · Cited by 341
Emotional Support from AI Chatbots: Should a Supportive Partner Self-Disclose or Not?
Meng, J., & Dai, Y. (. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab005 · Cited by 304
Liu, B. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab013 · Cited by 228
Persuasion : new directions in theory and research
Roloff, M. E., & Miller, G. R. (1980) · Cited by 219
Social Responses to Media Technologies in the 21st Century: The Media are Social Actors Paradigm
Lombard, M., & Xu, K. (2021) · Human-Machine Communication · doi:10.30658/hmc.2.2 · Cited by 195
The Ecological Fallacy in National Culture Research
Brewer, P., & Venaik, S. (2014) · Organization Studies · doi:10.1177/0170840613517602 · Cited by 186
Thumbs Up or Down: Consumer Reactions to Decisions by Algorithms Versus Humans
Yalcin, G., Lim, S., Puntoni, S., & van Osselaer, S. M. J. (2022) · Journal of Marketing Research · doi:10.1177/00222437211070016 · Cited by 175
Overcoming Resistance Through Narratives: Findings from a Meta-Analytic Review
Ratcliff, C. L., & Sun, Y. (2020) · Human Communication Research · doi:10.1093/hcr/hqz017 · Cited by 170
Waddell, T. F. (2019) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699018815891 · Cited by 122
Rethinking Communication in the Era of Artificial Intelligence
Sundar, S. S., & Lee, E. (2022) · Human Communication Research · doi:10.1093/hcr/hqac014 · Cited by 116
Close, J.-P., & Ham, J. R. C. (2016) · SpringerBriefs on case studies of sustainable development · doi:10.1007/978-3-319-45620-1_1 · Cited by 113
When algorithms meet journalism: The user perception to automated news in a cross-cultural context
Zheng, Y., Zhong, B., & Yang, F. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.04.046 · Cited by 111
Starke, C., & Lünich, M. (2020) · Data & Policy · doi:10.1017/dap.2020.19 · Cited by 107
Cultural Anthropology: A Global Perspective
Scupin, R. (1992) · Cited by 99
VEVEA, J. L., COBURN, K., & SUTTON, A. (2019) · The Handbook of Research Synthesis and Meta-Analysis · doi:10.7758/9781610448864.21 · Cited by 96
Wang, J., Hwang, G., & Chang, C. (2021) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2021.100023 · Cited by 95
Machine Authorship In Situ: Effect of news organization and news genre on news credibility
Liu, B., & Wei, L. (2018) · Digital Journalism · doi:10.1080/21670811.2018.1510740 · Cited by 94
Persuasion: Theory and practice
Andersen, K. E. (1978) · Medical Entomology and Zoology · Cited by 92
Dehnert, M., & Mongeau, P. A. (2022) · Human Communication Research · doi:10.1093/hcr/hqac006 · Cited by 86
Enhancing human agency through redress in Artificial Intelligence Systems
Fanni, R., Steinkogler, V. E., Zampedri, G., & Pierson, J. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01454-7 · Cited by 66
Wojcieszak, M., Thakur, A., Gonçalves, J. F. F., Casas, A., Menchen-Trevino, E., & Boon, M. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab006 · Cited by 64
The Str(AI)ght Scoop: Artificial Intelligence Cues Reduce Perceptions of Hostile Media Bias
Cloudy, J., Banks, J., & Bowman, N. D. (2021) · Digital Journalism · doi:10.1080/21670811.2021.1969974 · Cited by 54
Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction
Ashktorab, Z., Dugan, C., Johnson, J., Pan, Q., Zhang, W., Kumaravel, S., & Campbell, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445256 · Cited by 50
Man vs. machine: Human responses to an AI newscaster and the role of social presence
Kim, J., Xu, K., & Merrill, K. (2022) · The Social Science Journal · doi:10.1080/03623319.2022.2027163 · Cited by 44
Xu, K., Liu, F., Mou, Y., Wu, Y., Zeng, J., & Schäfer, M. S. (2020) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2020.1835136 · Cited by 37
Adam, M. T. P., Teubner, T., & Gimpel, H. (2018) · Group Decision and Negotiation · doi:10.1007/s10726-018-9579-5 · Cited by 27
O’Keefe, D. J. (2016) · doi:10.4135/9781483398853 · Cited by 19
Dillard, J. P. (2010) · Sage eBooks · doi:10.4135/9781412982818.n12 · Cited by 12
Research works printed but not linked: 5
- Acemoglu, 2021, The AI we should fear is already here
- High Level Expert Group on Artificial Intelligence, 2019, A definition of AI: Main capabilities and scientific disciplines
- Lee, 2017, Human aspects of IT for the aged population (ITAP2017), Lecture Notes in Computer Science, 3
- Mendelson, 2013, Universal access in human-computer interaction (UAHCI 2013), Lecture Notes in Computer Science, vol 8010, 156
- Smith, 1982, Persuasion and human action: A review and critique of social influence theories
Cited by
Gelbrich, K., Roschk, H., Miederer, S., & Kerath, A. (2026) · Journal of Marketing · doi:10.1177/00222429251344139 · Cited by 38
Klein, S. H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05618-w · Cited by 36
Boissin, E., Costello, T. H., Spinoza-Martín, D., Rand, D. G., & Pennycook, G. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf325 · Cited by 18
“This aligns with a recent meta-analysis showing no consistent advantage of humans over AI sources in shaping attitudes and behaviors (14).”
Understanding Gender Bias in AI-Generated Product Descriptions
Kelly, M., Tahaei, M., Smyth, P., & Wilcox, L. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732169 · Cited by 4
Metadata
- Authors
- Huang, G., & Wang, S.
- Affiliations
- City University of Hong Kong (HK)
- Hong Kong Baptist University (HK)
- Corresponding author
- Huang, Guanxiong
- Venue
- Journal of Communication
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-08-09
- Volume
- 73
- Issue
- 6
- Pages
- 552-562
- ISSN
- 0021-9916 (ISSN-L)
- 1460-2466
- OpenAlex
- W4385691183
- Cited by
- 95
- References
- 53
- Citations by year
- 2026: 42 · 2025: 39 · 2024: 13 · 2023: 1
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Communication (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Social Psychology › Psychology of Social Influence
- Keywords
- AI agents, human-machine communication, behavioral intention, attitudes, perception, virtual assistants, demographic differences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.