Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 601–700 of 1,004
Klassen, A. F., Mansouri, J., Kaur, M. N., Rae, C. S., Poulsen, L., Dayan, S. H., Cano, S., & Pusic, A. L. (2024) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.16465 · Cited by 4
Sarter, E., Hegarty, P. V., & Casini, A. (2024) · Sex Roles · doi:10.1007/s11199-024-01507-9 · Cited by 3
Henry, R. M., & Schudson, Z. C. (2024) · Psychology and Sexuality · doi:10.1080/19419899.2024.2403002 · Cited by 5
Simpson, B., Hazin, I., & Eriksson, K. (2024) · Social Psychology Quarterly · doi:10.1177/01902725241268455 · Cited by 3
Howard, M. C. (2024) · British Journal of Health Psychology · doi:10.1111/bjhp.12753 · Cited by 3
Harris, B. N., & Lin-Greenberg, E. (2024) · Journal of Experimental Political Science · doi:10.1017/xps.2024.10 · Cited by 4
Narrative misinformation from a credible source can be discredited with counternarrative
Johnson, N., & Sparks, G. G. (2024) · Journal of Science Communication · doi:10.22323/2.23080202 · Cited by 3
Development and Validation of the Perfectionism Literacy Questionnaire
Etherson, M. E., Hill, A. P., Grugan, M. C., Madigan, D. J., & Smith, M. M. (2025) · Journal of Psychoeducational Assessment · doi:10.1177/07342829241313089 · Cited by 5
Colmenero‐Navarrete, L., Salguero, J. M., & García‐Sancho, E. (2025) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2025.01.041 · Cited by 3
Zhang, Q., & Chen, S. (2025) · International Journal of Entrepreneurial Behaviour & Research · doi:10.1108/ijebr-11-2023-1188 · Cited by 6
Solovida, G. T., Izzaty, K. N., Latan, H., Jabbour, C. J. C., & Jabbour, A. B. L. D. S. (2025) · The Bottom Line Managing Library Finances · doi:10.1108/bl-08-2024-0130 · Cited by 3
Getting things done: Conscientiousness enables physical effort by reducing frustration
Bates, T. C. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113367 · Cited by 3
Liu, S. M., Canada, A. L., Dryjańska, L., & Morin, R. T. (2025) · Journal of Religion Spirituality & Aging · doi:10.1080/15528030.2025.2530391 · Cited by 5
Liberacka-Dwojak, M., Cruz, G. V., Wiłkość-Dębczyńska, M., Rochat, L., Khan, R., Müller, S. M., Brand, M., & Khazaal, Y. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1595502 · Cited by 4
Landers, M., & Shaw, A. (2025) · Emotion · doi:10.1037/emo0001575 · Cited by 3
Examining the Relationship Between Multiple Tests of Receptive Vocabulary
Harel, D., Goudelias, D., Cheng, H.-S., Baese‐Berk, M. M., Theodore, R. M., & Levi, S. V. (2024) · Journal of Speech Language and Hearing Research · doi:10.1044/2023_jslhr-22-00617 · Cited by 5
Klassen, A. F., Pusic, A. L., Kaur, M. N., Rae, C. S., Poulsen, L., Mansouri, J., Tsangaris, E., Dayan, S. H., Klok, J. A., Armstrong, K., et al. (2024) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000005736 · Cited by 3
Dryzin-Amit, Y., Vashdi, D. R., & Vigoda‐Gadot, E. (2024) · Journal of General Management · doi:10.1177/03063070241258806 · Cited by 3
Countering Search Ad Avoidance: How Political Orientation Affects Trust in Search Advertising
Davidson, A. (2024) · Journal of Advertising · doi:10.1080/00913367.2024.2393708 · Cited by 4
Critchley, A. J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4943150 · Cited by 3
The influence of trait intolerance of uncertainty on behavioural flexibilityPreprint
Williams, B., Rodriguez-Sobstel, C., FitzGibbon, L., Morriss, J., & Christakou, A. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.30.621039 · Cited by 2
Privacy Concerns and Willingness to Adopt AI Products: A Cross-Country Randomized Survey ExperimentPreprint
Brandimarte, L., Gutmann, J., Muehlheusser, G., & Weber, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5201894 · Cited by 4
A Human-centered Conceptual Framework of EV Charging DecisionsPreprint
Reimer, T. O., Loaiza-Ramírez, J. P., Qian, X., Gazmeh, H., Todd, P. M., Ukkusuri, S. V., & Hamim, O. F. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/svq4u_v1 · Cited by 3
Conducting Rehabilitation Research Through Amazon Mechanical Turk: A User-Friendly Guide
Huang, Y., & Smedema, S. M. (2023) · Rehabilitation Research Policy and Education · doi:10.1891/re-22-20 · Cited by 2
Ran, W., & Yamamoto, M. (2024) · Communication Studies · doi:10.1080/10510974.2024.2353393 · Cited by 3
Jeon, Y. A. (2024) · Internet Research · doi:10.1108/intr-08-2022-0635 · Cited by 2
Ibasco, G. C., Ahmed, S., Cai, M., & Chib, A. I. (2024) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2024.102004 · Cited by 3
Testing Different Message Styles about Unnecessary Antibiotics Using an Online Platform
Stenlund, S., Appelt, K. C., Ruby, M. B., Smith, N., Lishman, H., & Patrick, D. M. (2024) · Antibiotics · doi:10.3390/antibiotics13070657 · Cited by 2
Syrett, K., Lu, J., & Parrish, K. (2024) · Glossa Psycholinguistics · doi:10.5070/g60111672 · Cited by 2
The Political Determinants of Public Support for Obstruction of Supreme Court Nominees
Stone, A. R. (2024) · Journal of Law and Courts · doi:10.1017/jlc.2024.6 · Cited by 2
Assessing the Deterrent Effects of Ignition Interlock Devices
Zeithammer, R., Macinko, J. A., & Silver, D. (2024) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2024.09.009 · Cited by 4
Sestino, A., Nasta, L., Rossi, M. V., & Barth, H. (2024) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2024.2405137 · Cited by 3
Charnysh, V., Kalow, J., Lieberman, E. S., & Walk, E. (2024) · Climatic Change · doi:10.1007/s10584-024-03826-y · Cited by 3
Yehle, L., Michaelsen, P., Harring, N., & Jagers, S. C. (2024) · Journal of Public Policy · doi:10.1017/s0143814x24000266 · Cited by 2
Senn, S., Mutzner, N., Oberhauser, V., & Rauhut, H. (2025) · Frontiers in Behavioral Economics · doi:10.3389/frbhe.2025.1494271 · Cited by 3
Adam, M., Greuel, M., Liu, S., Rogge, J. R., Martin, A., & Amsalem, D. (2025) · International Journal of Transgender Health · doi:10.1080/26895269.2025.2478497 · Cited by 2
Is There a Sexual Stereotype Linking Casual Sex with Low Self-Esteem?
Sprecher, S., Verette‐Lindenbaum, J., Felmlee, D., Fleming, F., & Odeh, Y. (2025) · Sexuality & Culture · doi:10.1007/s12119-025-10343-2 · Cited by 2
Presenting return charts in investment decisions
Huber, C., & Rose, J. (2025) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2025.101040 · Cited by 2
Yan, V. X., Rea, S. D., & Sana, F. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102683 · Cited by 3
Puffer, H., & Hodson, G. (2025) · British Journal of Social Psychology · doi:10.1111/bjso.12900 · Cited by 3
Dennison, R. A., Morris, S., Clune, R. J., Wright, S. J., Waller, J., & Usher‐Smith, J. A. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-093803 · Cited by 2
Project Portfolio Selection with Strategic Buckets—The Role of Naïve Diversification
Fügener, A., Schiffels, S., & Thonemann, U. W. (2025) · Manufacturing & Service Operations Management · doi:10.1287/msom.2020.0373 · Cited by 5
Brochu, P. M., Georgia, E. J., Jubran, M., Robbins, M., West, K., Crocker, J., Schmidt, A. M., Rinaldi, K., Joseph, E., & Roddy, M. K. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1576406 · Cited by 3
McGray, T. L., Dodge, B., Peterson, Z. D., Bedrick, E. J., & Koss, M. P. (2025) · The Journal of Sex Research · doi:10.1080/00224499.2025.2507881 · Cited by 3
Sheppard, H., Bizumić, B., Huxley, E., & Calear, A. L. (2025) · International Journal of Social Psychiatry · doi:10.1177/00207640251345028 · Cited by 2
Relative Performance Evaluation and Executive Compensation: Adding Fuel to the Fire
Bönte, W., & Galkin, D. (2025) · Managerial and Decision Economics · doi:10.1002/mde.70003 · Cited by 2
Riggio, C. R., Olson, J., Lee, J.-H., Kim, J. J. H., & Constantino, S. M. (2025) · International Perspectives in Psychology · doi:10.1027/2157-3891/a000129 · Cited by 2
Thomas, A. G., Costello, W., Bendixen, M., Kennair, L. E. O., Apostolou, M., Bártová, K., Burýšek, O., Lowe, R., Jonason, P. K., Kowal, M., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-12607-1 · Cited by 5
Moyer, M. B. L., & Shenk, M. K. (2025) · American Journal of Biological Anthropology · doi:10.1002/ajpa.70104 · Cited by 3
Exploratory Assessment of Learning in an Intelligent Text Framework: iTELL RCT
Crossley, S., Morris, W., Choi, J., & Holmes, L. (2025) · ACM Conference on Learning @ Scale · doi:10.1145/3698205.3729548 · Cited by 6
Uncovering Transferable Collaboration Patterns Across Tasks Using Large Language Models
Jiang, Y., Hao, J., Cui, W., Kerzabi, E., & Kyllonen, P. C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98417-4_23 · Cited by 4
Szczęśniak, M., Falewicz, A., Chmiel, M., & Kroplewski, Z. (2025) · PLoS ONE · doi:10.1371/journal.pone.0329404 · Cited by 3
Schmitz, R. M., Tabler, J., Gomez, G., & Charak, R. (2025) · Journal of Prevention & Intervention in the Community · doi:10.1080/10852352.2025.2547441 · Cited by 2
Effectance Motivation: Unpredictability and Uncontrollability in the Anthropomorphism Strategy
David, D., & Spatola, N. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01306-6 · Cited by 2
Traces of Intentionality: Balance, Complexity, and Organization in Artworks by Humans and Apes
Straffon, L. M., Perea‐García, J. O., den Blaauwen, T., & Kret, M. E. (2025) · Topics in Cognitive Science · doi:10.1111/tops.70022 · Cited by 2
Hannibal, G., & Bauer, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05002-1_33 · Cited by 2
Revisiting social media’s power in luxury loyalty and purchases
Molaeb, G., Paulet, E., & Mavoori, H. (2025) · Journal of Marketing Communications · doi:10.1080/13527266.2025.2560399 · Cited by 2
Harney, J., Nascimbeni, C., Sanders, L., & Kuhn, N. (2025) · Public Performance & Management Review · doi:10.1080/15309576.2025.2560620 · Cited by 2
Dang, S., Quach, S., & Roberts, R. E. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2556233 · Cited by 3
A Comparative Examination of Anger and Resentment Episodes
DiBlasi, T., & Kassinove, H. (2025) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-025-00618-w · Cited by 2
Whitley, C. T., Kalof, L., Urquhart, L. C., Tatem, N., Mair, M., Ankoudinova, K., Haight, I., Meglathery, E., Worden, M., Wilkinson, D., et al. (2025) · Sustainability · doi:10.3390/su17198833 · Cited by 2
Alexander, D., Alexander, B., Martin, T. C., & Christoph, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-21290-1 · Cited by 4
Khan, R. A., Feng, G., & Zhu, J. (2026) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919392.2025.2563463 · Cited by 2
Heath, C., Williams, J. M., Leightley, D., Murphy, D., & Dymond, S. (2025) · JMIR mhealth and uhealth · doi:10.2196/73706 · Cited by 3
Kanter, R. L., Gomez, R. M., Hassija, C. M., & Wortham, J. S. (2025) · Journal of Religion and Health · doi:10.1007/s10943-025-02481-6 · Cited by 2
'How Do You Know That Stuff?': Barriers to Expertise Sharing Among Spreadsheet Users
Qing, Sarkar, A., Brumby, D. P., & Cox, A. L. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757411 · Cited by 4
Stepchenkova, S. O., Baniya, R., Kirilenko, A., & Chen, T. (2025) · Sustainability · doi:10.3390/su17219631 · Cited by 3
Kim, Y. K. (2025) · Sustainability · doi:10.3390/su172210076 · Cited by 2
Unmasking survey fraud: investigating data quality issues in an MTurk sample
Maline, M. N., & Polonijo, A. N. (2025) · International Journal of Social Research Methodology · doi:10.1080/13645579.2025.2601994 · Cited by 4
Caution when Crowdsourcing: Prolific as a Superior Platform Compared with MTurk
O’Connell, D., Bautista, A., Johnson, C., & Venta, A. C. (2025) · Graduate Student Journal of Psychology · doi:10.52214/gsjp.v25i1.14129 · Cited by 5
Wolsko, C. V., & Marino, E. K. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1606229 · Cited by 3
Attig, C., Winzer, L., Schrills, T., Zoubir, M., Mortaga, M., Wollstadt, P., Wiebel-Herboth, C. B., & Franke, T. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100246 · Cited by 8
Zhang, Z., Yang, Y., Wang, X., Wang, C., & Zhang, Z. (2025) · Information & Management · doi:10.1016/j.im.2025.104275 · Cited by 3
Das, C., Das, B., Bose, A., Mandal, A., Mishra, A. K., & Raghuvanshi, C. S. (2026) · Information systems engineering and management · doi:10.1007/978-3-032-10122-8_10 · Cited by 4
Peeling The Onion: a study of audience reactions to anti-classism satire
Corsbie-Massay, C. L., Santia, M., & Anderson, L. (2026) · Frontiers in Communication · doi:10.3389/fcomm.2025.1576408 · Cited by 2
Understanding reactions to alternative labels for diversity, equity and inclusion initiatives
Bell, E. A., Johnson, J. A., Traylor, A., Desing, L., Lander, A., & Mastro, M. D. (2026) · Equality Diversity and Inclusion An International Journal · doi:10.1108/edi-04-2025-0235 · Cited by 4
Police staffing shortages, public awareness, and policy preferences
Boehme, H. M., McCrain, J., Mourtgos, S. M., & Tregle, B. (2026) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2026.102599 · Cited by 3
Time poverty and disaster readiness: How routine constraints shape hurricane preparation
Wang, Y., Guo, Z., & McCarty, C. (2026) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2026.106037 · Cited by 4
Dinero, R. E., Monti, W. B., & Kmush, B. L. (2026) · PLoS ONE · doi:10.1371/journal.pone.0342063 · Cited by 2
Ji, A., Paltaratskaya, V., & Wise, K. R. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2623229 · Cited by 3
Engle, T. A., Connealy, N. T., & Dulisse, B. C. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103277 · Cited by 5
Using Large Language Models to Detect Insufficient Effort Responding in Open-Ended Survey Questions
von Felten, N. (2026) · doi:10.1145/3780045.3780059 · Cited by 2
Lee, M., & Su, Y. (2026) · International Journal of Sports Marketing and Sponsorship · doi:10.1108/ijsms-08-2025-0407 · Cited by 2
Virtual Social Influencer Scale Development and Validation: An Algorithmic Approach
van Esch, P., Cui, Y. G., Arli, D. I., & Eskridge, B. (2026) · Australasian Marketing Journal (AMJ) · doi:10.1177/14413582261423028 · Cited by 2
Fernandez-Nieto, G. M., Echeverría, V., Li, Y., Tsai, Y., Sha, L., Chen, G., Gašević, D., & Swiecki, Z. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2636694 · Cited by 2
Costa, S. P., Coyle‐Shapiro, J. A., Corlett, S., & Aguiar, T. (2026) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.70103 · Cited by 3
Schlechter, P., Meyer, T., Kerneck, L. E., Mengering, P. S., Hoppen, T. H., König, M., & Nexhmedin Morina, B. (2026) · Clinical Psychological Science · doi:10.1177/21677026261424180 · Cited by 3
The Role of Intrusiveness and Color in Content Warning Label Effectiveness
Liban, H. S., & Horne, B. D. (2026) · ACM Transactions on Applied Perception · doi:10.1145/3805797 · Cited by 2
Greenwashing and firm performance in an emerging market: Short-term gains vs long-term risks
Luhgiatno, L., Solovida, G. T., Jabbour, A. B. L. D. S., Jabbour, C. J. C., Latan, H., & Adhi, D. K. (2026) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2026.148235 · Cited by 3
Özpınar, A., & ÖZPINAR, Ş. B. (2026) · Systems · doi:10.3390/systems14040425 · Cited by 2
Beliefs About Using Construal Level to Modulate Regulatory Scope
Le, P., Nguyen, T., Scholer, A. A., & Fujita, K. (2026) · Personality and Social Psychology Bulletin · doi:10.1177/01461672261433130 · Cited by 2
Self-reported and task-based measures of attention control are distinct
DiCarlo, J. A., Burgoyne, A. P., Conroy, C., Lin, D. J., & Ward, N. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03006-z · Cited by 2
Barnum, T. C., Herman, S., Nagin, D. S., & Pickett, J. T. (2026) · Criminology · doi:10.1111/1745-9125.70048 · Cited by 2
Kallitsounaki, A., Williams, D. M., & Fysh, M. C. (2026) · International Journal of Transgender Health · doi:10.1080/26895269.2026.2658857 · Cited by 2
Enhancing customer inspiration and engagement experiences on restaurant social media
Lee, S. (., & Kwak, S. Y. (2026) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2026.104713 · Cited by 3
Wang, D., & Tao, W. (2026) · Public Relations Review · doi:10.1016/j.pubrev.2026.102704 · Cited by 2
Çavuşoğlu, M., Nanu, L., Mistry, T. G., Kement, Ü., & Ali, F. (2026) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-05-2025-0786 · Cited by 3
Wang, D., Jin, H., Shi, H., & Li, Z. (2026) · Public Relations Review · doi:10.1016/j.pubrev.2026.102718 · Cited by 2
Jang, J., & Kang, J. (2026) · Journal of Consumer Affairs · doi:10.1111/joca.70057 · Cited by 2
Zhou, Y., Yuan, J. J., Chang, H. J., Koo, B., & Tang, Z. (2026) · Journal of Hospitality and Tourism Management · doi:10.1016/j.jhtm.2026.101482 · Cited by 2
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.