Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 801–900 of 1,004
Changing Views of Sex Offender Policies: A Counterevidence Based Intervention
Reynolds, J. J., & Estrada-Reynolds, V. C. (2025) · Basic and Applied Social Psychology · doi:10.1080/01973533.2025.2572627 · Cited by 1
Jackson, K. M., & Rosero, A. (2025) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813251367727 · Cited by 1
Ng, L. H. X., Jaidka, K., Tay, K. Y., & Chhaya, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757484 · Cited by 3
Laypersons' perceptions of sex trafficking victimisation and attribution of blame
Kim, S. C., Dianiska, R. E., Simpson, E., & Quas, J. A. (2025) · Legal and Criminological Psychology · doi:10.1111/lcrp.70011 · Cited by 1
Villanti, A. C., Barnwell, P. V., Chen, A., Uriarte, C., Wadie, K. A., Hrywna, M., & Delnevo, C. D. (2025) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2025.103286 · Cited by 1
Schlechter, P., Hoppen, T. H., & Nexhmedin Morina, B. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120526 · Cited by 2
Goals Out Loud: Telling Others About a Goal Increases Support Received and Facilitates Goal Pursuit
Peetz, J., Buehler, R., & Wells, T. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251382271 · Cited by 1
Meier, S., & Ju, I. (2025) · Communication Reports · doi:10.1080/08934215.2025.2576724 · Cited by 1
Assessing the economic value of reducing perceived risk in ride-hailing: Evidence from US cities
Hong, S. J., & Lee, K. (2025) · Electronic Markets · doi:10.1007/s12525-025-00850-3 · Cited by 1
Hypothetical nudges provide directional but noisy estimates of real behavior change
Gandhi, L., Kiyawat, A., Camerer, C. F., & Watts, D. J. (2025) · Communications Psychology · doi:10.1038/s44271-025-00339-x · Cited by 5
Alley, E. (2025) · Southern Communication Journal · doi:10.1080/1041794x.2025.2591642 · Cited by 2
Sexual Assault Victimization in Virtual Worlds: A Cyberlifestyle-Routine Activity Theory Approach
Lee, N. (2025) · Journal of Interpersonal Violence · doi:10.1177/08862605251384908 · Cited by 1
Bajaba, S. M., & Basaad, S. (2025) · Stress and Health · doi:10.1002/smi.70127 · Cited by 2
Is Trying Harder Enough? Causal Analysis of the Effort-IQ Relationship Suggests Not
Bates, T. C. (2025) · Intelligence & Cognitive Abilities · doi:10.65550/001c.142071 · Cited by 1
Watching to win: When watching others play improves performance
Johanson, C., Wessels, H., & Friehs, M. A. (2025) · Entertainment Computing · doi:10.1016/j.entcom.2025.101067 · Cited by 1
Xia, M., Dunlop, P. D., Tian, A. W., & Wee, S. (2025) · Human Resource Management · doi:10.1002/hrm.70042 · Cited by 1
Consumer Perceptions of GenAI in Service Delivery: Scale Development and Validation
van Esch, P., Cui, Y. G., Arli, D. I., & Eskridge, B. (2025) · Australasian Marketing Journal (AMJ) · doi:10.1177/14413582251395758 · Cited by 1
Focusing on Inclusion (vs. Leadership) Boosts Gender Bias Recognition and Intended Action
Bergsieker, H. B., Trickey, J., Jansen, E. J., Huynh, A. C., & Schmader, T. (2025) · Journal of Applied Social Psychology · doi:10.1111/jasp.70037 · Cited by 1
Climbing the ladder under pressure: precarious manhood and the ambition gender gap
Mojzisch, A., & Roswag, M. (2025) · Career Development International · doi:10.1108/cdi-01-2025-0046 · Cited by 3
Kashefi, A., Bosschaerts, K., Ongenae, F., Marez, L. D., Murphy, S. L., Conradie, P. D., & Abeele, M. V. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2598453 · Cited by 2
Ambiguous Actorhood: Twenty-First Century Firms and the Evasion of Responsibility
Knight, C. R., & Goldstein, A. (2025) · Sociological Science · doi:10.15195/v13.a4 · Cited by 1
Beam, A. J., Newell, E. E., Nguyen, T.-V. C., & Wellman, J. D. (2025) · British Journal of Social Psychology · doi:10.1111/bjso.70028 · Cited by 2
Chakraborty, T., Koelle, M., Schlötterer, J., Schlicker, N., Wirth, C., & Seifert, C. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10671-6 · Cited by 1
Food choices flirt with gender norms in mating contexts
Gąsiorowska, A., Folwarczny, M., & Otterbring, T. (2025) · Food Quality and Preference · doi:10.1016/j.foodqual.2025.105712 · Cited by 1
The relationship between psychological ownership and sustainable behavior in coworking spaces
Magnusson, D., Raharjo, H., & Bosch‐Sijtsema, P. M. (2025) · Journal of Corporate Real Estate · doi:10.1108/jcre-03-2025-0022 · Cited by 1
Nuding, S., Williams, C. R., & Gollwitzer, M. (2025) · Personality Science · doi:10.1177/27000710251401142 · Cited by 1
Moreno-Gata, S., Rodríguez‐Torres, R., Betancor, V., & Pérez, A. R. (2026) · European Journal of Social Psychology · doi:10.1002/ejsp.70040 · Cited by 2
Exploring Australian men’s views on podcast-based mental health support
Dascombe, E. M., Morgan, P. J., Drew, R. J., & Young, D. M. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200477 · Cited by 1
The Impact of Co-Opetition on Cognitive Flexibility: A Replication Study of
Araya, C., & Sassenberg, K. (2025) · Social Psychology · doi:10.1027/1864-9335/a000585 · Cited by 1
Validating the German Translation of the Revised Comprehensive Autistic Trait Inventory
Hechler, F. C., Caruana, N., Fahr, F., Karlek, B., Maroske, M., Misia, M., & Tuomainen, O. (2026) · Autism in Adulthood · doi:10.1177/25739581251406751 · Cited by 1
Park, G., Kim, J., Jung, J.-B., & Lee, T. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2025.106162 · Cited by 1
Puddy, H. N., Burton, A. L., Jonson, C. L., & Hong, S. (2025) · American Journal of Criminal Justice · doi:10.1007/s12103-025-09884-x · Cited by 2
Linguistic Features of Banyuwangi Traditional Culinary Terms and Osing Cultural Identity
Aminulloh, A., Rastitiati, N. K. J., Pradana, W. R. Y., Yanyan, B., & Subayil, S. (2025) · Journal of Language Intelligence and Culture · doi:10.35719/jlic.v7i2.654 · Cited by 1
Grace, K. T., Auerbach, S. L., Alspaugh, A., Rios, N., Altay, T., Kanselaar, S., & Mosley, E. A. (2026) · Studies in Family Planning · doi:10.1111/sifp.70045 · Cited by 1
Bosley, S. A., Kotasek, K., Greenman, S. J., & Snyder, S. (2026) · Journal of Public Policy & Marketing · doi:10.1177/07439156261416351 · Cited by 1
Reviving legends through holographic AI event experiences: Consumer acceptance and value insights
Doğan, S., Aluri, A., & Çavuşoğlu, M. (2026) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-05-2025-0767 · Cited by 1
The limits of moral framing in promoting pro-environmentalism: A preregistered replication of
Voit, M., Twardawski, M., & Fischer, M. V. (2026) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2026.104871 · Cited by 1
Novak, S. R., Reed-Jones, L., Kedrowicz, A. A., Birkenheuer, A. J., Royal, K. D., & McCool, K. E. (2026) · Journal of Veterinary Internal Medicine · doi:10.1093/jvimsj/aalaf058 · Cited by 1
Harriger, J. A., Brown, S. A., Chung, H. G., & Trammell, J. P. (2026) · Body Image · doi:10.1016/j.bodyim.2026.102030 · Cited by 2
Salvo, H. D., Mahr, T., Sandgren, C., Mabie, H. L., & Hustad, K. C. (2026) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-25-00391 · Cited by 2
Mertel, M., & Voigt, K.-I. (2026) · European Journal of Information Systems · doi:10.1080/0960085x.2026.2617357 · Cited by 1
Delegating Destruction: Coercive Threats and Automated Nuclear Systems
Schwartz, J. A., & Horowitz, M. C. (2026) · International Organization · doi:10.1017/s0020818325101215 · Cited by 2
Can Brief Empathy Training Increase Sexual Harassment Bystander Intervention Intentions?
Barta, T., Piper, Z. E., Chaubey, H., Kiebler, J., & Stockdale, M. S. (2026) · Behavioral Sciences · doi:10.3390/bs16020227 · Cited by 1
Henry, C. M., & Sharp, R. L. (2025) · Leisure Sciences · doi:10.1080/01490400.2025.2545317 · Cited by 1
Reverse Linguistic Stereotyping Through an Intersectional Lens
Licata, G. (2026) · Journal of Sociolinguistics · doi:10.1111/josl.70015 · Cited by 1
Simon, C. (2026) · Corporate Communications An International Journal · doi:10.1108/ccij-08-2025-0231 · Cited by 1
Tarannum, I. (2026) · Journal of Consumer Behaviour · doi:10.1002/cb.70128 · Cited by 1
Hayes, A. S. (2026) · Acta Sociologica · doi:10.1177/00016993261419697 · Cited by 1
Supply Chain Guardianship: Why Some Firms Intervene When Other Firms Commit Fraud
DuHadway, S., Carnovale, S., & Kaufmann, L. (2026) · Journal of Operations Management · doi:10.1002/joom.70035 · Cited by 1
Schöni, L., Roch, N., Carles, V., Sievers, H., Strohmeier, M., Mayer, P., & Zimmermann, V. (2026) · Information and Computer Security · doi:10.1108/ics-02-2025-0059 · Cited by 2
Terblanche, N. H. D., Rutschmann, R., & Reitz, J. (2026) · Coaching An International Journal of Theory Research and Practice · doi:10.1080/17521882.2026.2625707 · Cited by 1
Owens, H. N., Griner, S. B., Beckstead, J. W., Kim, E., Zgibor, J. C., & Daley, E. M. (2026) · Women s Health Issues · doi:10.1016/j.whi.2025.08.004 · Cited by 1
Intervening and reducing sharing of false cancer treatments on social media: Online experiment
Lazard, A. J., Lake, S., Queen, T. L., Avendaño-Galdamez, M. I., Brennen, S. B., Varma, T., Tan, H.-J., Charlot, M., & Dasgupta, N. (2026) · PLoS ONE · doi:10.1371/journal.pone.0341907 · Cited by 2
Are You, You? Seamlessly Fighting Identity Fraud with Keystroke Dynamics
Kim, D., Valacich, J. S., Jenkins, J. L., Wilson, D. W., Kumar, M. N. V. R., & Weisgarber, P. (2026) · Information Systems Research · doi:10.1287/isre.2023.0088 · Cited by 6
Rethinking Recovery: Psychological Flexibility and Growth Across Diverse Recovery Approaches
Pyke, N. M., Perkins, D. R., & Sandoz, E. K. (2026) · Behavioral Sciences · doi:10.3390/bs16030366 · Cited by 1
Perceptions and preferences of U.S. wine consumers: Glass vs. alternative packaging
Bartz, M. W., Rider, S., Nalley, L. L., McFadden, B. R., & Threlfall, R. T. (2026) · Cleaner and Responsible Consumption · doi:10.1016/j.clrc.2026.100417 · Cited by 1
Assessing Experiential Avoidance: Further Testing of the AAQ-II and the MEAQ
Jimenez, A., Rochefort, C., & Chmielewski, M. S. (2026) · Assessment · doi:10.1177/10731911261423143 · Cited by 1
Kim, D. J., Nordstrom, O. A., Monsen, E. W., & Marineau, J. E. (2026) · Small Business Economics · doi:10.1007/s11187-026-01189-5 · Cited by 2
Schwepker, C. H., & Good, M. C. (2026) · Journal of Business-to-Business Marketing · doi:10.1080/1051712x.2026.2642238 · Cited by 2
Susceptibility of the CAARS-2 Self-Report to Sophisticated Malingering
Weis, R., & Sund, A. M. (2026) · Journal of Attention Disorders · doi:10.1177/10870547261427112 · Cited by 1
Opinion Change in Nonpartisan Contexts: The Case of Residential Zoning Reform
Ternullo, S. (2026) · Political Behavior · doi:10.1007/s11109-026-10128-9 · Cited by 1
Diel, A., Hölsken, S., Christoph, J., Lalgi, T. J., Lena, H., Martin, T. C., & Bäuerle, A. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200503 · Cited by 1
Meeting Men Where They Listen: Preferences for Podcast‐Delivered Mental Health Support
Dascombe, E. M., Morgan, P. J., Drew, R. J., & Young, D. M. (2026) · Mental Illness · doi:10.1155/mij/5510212 · Cited by 1
The importance of founding stories to entrepreneurial pitch success
Gruss, R. J., Collier, Z. A., & Canter, R. J. (2026) · Journal of Research in Marketing and Entrepreneurship · doi:10.1108/jrme-03-2025-0050 · Cited by 2
Bystrytska, K. (2026) · Media War & Conflict · doi:10.1177/17506352261424846 · Cited by 1
Exploring the process of consumer empowerment: The role of perceived control in consumer power
Akhavannasab, S., & Roschk, H. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.104811 · Cited by 1
Alyasein, O. I. Y., Ojha, D., Damali, U., Gligor, D. M., & Russo, I. (2026) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2026.103063 · Cited by 1
Male Rape Myth Correlates Among Male and Female Canadian Adults
Nicol, A. A. M., & Nicol, A. M. (2026) · Journal of Interpersonal Violence · doi:10.1177/08862605261432497 · Cited by 1
AI-Driven Product Recommendation Systems Informed by Emotional Responses
Prabhakar, A. A. J., Sudheer, V. N., Priya, N. S. V., Manju, C., Karpagavalli, C., & Selvakumar, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5997-7.ch003 · Cited by 1
Evidence for the common or usual name for plant-based food products
Feltz, A., Feltz, S., Hoang, U., Holt, J. R., & Liu, Y. (2026) · Psychology of Human-Animal Intergroup Relations · doi:10.5964/phair.19407 · Cited by 1
McGray, T. L., Peterson, Z. D., Bedrick, E. J., Dodge, B., & Koss, M. P. (2026) · Journal of Sexual Aggression · doi:10.1080/13552600.2026.2653767 · Cited by 1
When Play Hurts: Understanding Common Barriers in Movement-Based Games
Cmentowski, S., Karaosmanoglu, S., Steinicke, F., & Bernhaupt, R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790905 · Cited by 1
Andraschko, L., & Weritz, P. (2026) · Electronic Markets · doi:10.1007/s12525-026-00894-z · Cited by 4
Conversational Inoculation to Enhance Resistance to Misinformation
Szabó, D., Yang, C.-L., Visuri, A., Oppenlaender, J., Sekar, B., Yatani, K., & Hosio, S. J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790954 · Cited by 1
Too Many Zombies: Exploring Challenges and Motivations for (Not) Deleting Unused Online Accounts
Bumiller, F., Rodriguez, S. D., Mecke, L., Distler, V., & Alt, F. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790497 · Cited by 1
My Body, Their Business: User Perspectives on Commercial Data Practices in FemTech mHealth Apps
Alsebayel, G., Lainfiesta, X., Fatima, A., Troiano, G. M., Jia, C., & Harteveld, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790847 · Cited by 1
The Positively Energizing Leadership Scale (PELS): Development and Validation
Shea, K., Diaz, J., Shapiro, J., Donaldson, S. I., & Cameron, K. S. (2026) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-026-00283-z · Cited by 1
de Kerf, J., van der Linden, D., Cooman, R. D., Gieter, S. D., Bakker, A. B., & Hofmans, J. (2026) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2026.104246 · Cited by 1
Quiles, J. R. G., Robison, M., Kurtz, A., Clausen, B. K., & Schmidt, N. B. (2026) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.70098 · Cited by 1
Crisis Narratives and Communication: An Evaluation of CDC Messages About COVID-19 Information
Lorenzo, S. B. (2026) · International Journal of Strategic Communication · doi:10.1080/1553118x.2026.2660769 · Cited by 2
Vasil, N., Curiel, A., Zhu, T., Pederneschi, A., & Ritchie, K. (2026) · Child Development · doi:10.1093/chidev/aacag071 · Cited by 1
Schwepker, C. H., & Good, M. C. (2026) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-08-2025-0748 · Cited by 2
Warning people about the risk of AI error mitigates human acquisition of AI bias
Vicente, L., & Matute, H. (2026) · Cognitive Research Principles and Implications · doi:10.1186/s41235-026-00726-w · Cited by 5
Valentine Joseph Owan, P. D., Nwannunu, B. I., Obogo, G. O., Owan, M. V., Оконь, С., Etorti, I. J., & Ngwanya, N. (2026) · Psychological Science and Education · doi:10.17759/pse.2026310204 · Cited by 1
Cha, J. (2026) · The International Journal on Media Management · doi:10.1080/14241277.2026.2667537 · Cited by 2
Augmented reality and consumer well-being in retailing: A SEM–ANN analysis
Foroughi, B., Ghobakhloo, M., & Hsu, H. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.104862 · Cited by 1
Who Supports the Ideal Worker Norm? Group Differences and Consequences of Remote Work
Tamayo, J. P. M., Augustine, J., & Brashears, L. A. (2026) · Social Currents · doi:10.1177/23294965261438392 · Cited by 1
The influence of metaphor on gender stereotyping in entrepreneurial pitches
Ahrens, K., Li, Y., Zeng, W. H., Chen, J. Z., Beukeboom, C. J., & Burgers, C. F. (2026) · European Management Journal · doi:10.1016/j.emj.2026.05.001 · Cited by 2
Rosemarino, N. M. (2026) · The Journal of Applied Behavioral Science · doi:10.1177/00218863261446968 · Cited by 2
Potential for Harm and Privacy Are Top AI Ethics Concerns: Evidence From a Representative UK Survey
Grassini, S., Mamsheli, S. T., Paulsen, A. T., Menicucci, D., & Cipriani, E. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2666666 · Cited by 5
Rasti, A. R., Betz, M. E., Finn, J., Boffa, J. W., Berkowitz, S. J., Flarity, K. M., Simonetti, J. A., & Stanley, I. H. (2026) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2026.05.023 · Cited by 1
Public cooperation with AI-enabled policing: Testing a socio-technical legitimacy model
Guo, S., & Wu, Y. (2026) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2026.102674 · Cited by 1
Taylor, C. J., Salim, S., Levanon, A., Katz, T. K., & England, P. (2026) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2026.101161 · Cited by 2
Beyond Bias Detection: Community Auditors and Normative Reasoning in AI Oversight CSCW006
Jackson, C., Ahmad, T., Raj, S. D., & Wu, N. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788042 · Cited by 1
Low, F., & Earleywine, M. (2026) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2026.2673844 · Cited by 3
Miles, A., Samim, Y., & Khan, S. (2026) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2026.104947 · Cited by 1
Fernández, D., Begeny, C. T., Lizzio‐Wilson, M., & Ryan, M. K. (2026) · Social Psychology of Education · doi:10.1007/s11218-026-10232-y · Cited by 1
News headline themes and approval of police use-of-force: evidence from a national survey experiment
Mourtgos, S. M. (2026) · Journal of Experimental Criminology · doi:10.1007/s11292-026-09756-2 · Cited by 1
Are all uses of AI created equal? An experimental review of AI disclosure types on credibility
Merle, P. F., Schneider, E. J., & Krueger, M. (2026) · Journalism · doi:10.1177/14648849261460934 · Cited by 1
Sestino, A., Bernal, P. M., Sádaba, T., & Guercini, S. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.104930 · Cited by 1
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.