Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 501–600 of 1,004
Houck, A. M., King, A., & Taylor, J. B. (2024) · Public Understanding of Science · doi:10.1177/09636625241246084 · Cited by 5
Tatum, A. K., & Ugurluoglu, I. (2024) · Psychology and Sexuality · doi:10.1080/19419899.2024.2372468 · Cited by 5
Tarka, P., Harnish, R. J., & Babaev, J. (2024) · International Journal of Consumer Studies · doi:10.1111/ijcs.13094 · Cited by 4
An Investigation of the Test-Retest Reliability of the miniPXI
Haider, A., Wallner, G., Gerling, K., & Abeele, V. V. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677058 · Cited by 4
Development of an Inconsistent Responding Scale for the Big Five Inventory-2
Ruchensky, J. R., Edens, J. F., & Donnellan, M. B. (2024) · Journal of Personality Assessment · doi:10.1080/00223891.2024.2411557 · Cited by 4
Schlechter, P., Meyer, T., & Morina, N. (2024) · Journal of Experimental Psychopathology · doi:10.1177/20438087241288532 · Cited by 4
Partisan belief in new misinformation is resistant to accuracy incentives
Stein, J., Keuschnigg, M., & van de Rijt, A. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae506 · Cited by 8
Stojanov, A., Hannawa, A. F., & Adam, L. A. (2024) · Communication Reports · doi:10.1080/08934215.2024.2424535 · Cited by 4
Social Mobility Among United States Immigrants: A Psychology of Working Perspective
Choi, Y., Duffy, R. D., Kim, T., Bridges, B. L., Perez, G., Kim, H. J., Park, J., & Steranka, M. (2024) · The Counseling Psychologist · doi:10.1177/00110000241301110 · Cited by 5
Galway, S. C., & Gammage, K. L. (2024) · Appetite · doi:10.1016/j.appet.2024.107821 · Cited by 7
Consumer confusion about products that contain animal-derived ingredients
Feltz, A., Feltz, S., Hoang, U., & Holt, J. R. (2024) · Food and Humanity · doi:10.1016/j.foohum.2024.100485 · Cited by 4
Financial literacy and investment in wine: a two-country study on Generations Y and Z
Agnoli, L., Fur, E. L., & Outreville, J. F. (2025) · Managerial Finance · doi:10.1108/mf-12-2024-0919 · Cited by 4
Browning, N., & Cheema, S. E. (2025) · Public Relations Review · doi:10.1016/j.pubrev.2025.102569 · Cited by 5
Schlechter, P., Churbaji, D., Hoppen, T. H., & Nexhmedin Morina, B. (2025) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2025.100611 · Cited by 4
Functional and dysfunctional personality dispositions as antecedents of practical wisdom
Serenko, A. (2025) · Journal of Knowledge Management · doi:10.1108/jkm-01-2025-0061 · Cited by 4
When GenAI writes public foresight reports: Effects on convincing citizens
Zumbrunn, L., & Guenduez, A. A. (2025) · Public Policy and Administration · doi:10.1177/09520767251403049 · Cited by 4
Understanding Consumer’s Willingness to Engage with Digital Reuse Systems
Matthews, M., & Webb, T. L. (2023) · Sustainability · doi:10.3390/su151914560 · Cited by 5
Berry, C., Kees, J., & Burton, S. (2024) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2024.2385374 · Cited by 6
The Ethics of Conducting Research with Human Participants in HCI
Petrie, H. (2025) · Springer eBooks · doi:10.1007/978-3-319-27648-9_86-1 · Cited by 4
Verhoeven, D. C., Doose, M., Chollette, V. Y., & Weaver, S. J. (2024) · Journal of Cancer Survivorship · doi:10.1007/s11764-023-01488-w · Cited by 4
Do Teams Alleviate or Exacerbate Cognitive Biases? Evidence from Extrapolation in Mutual Funds
Barahona, R., Cassella, S., Jansen, K. A. E., & Pezone, V. (2021) · Journal of Financial Economics · doi:10.1016/j.jfineco.2025.104219 · Cited by 7
My Boss, the Algorithm – AI Leadership Increases Turnover through Reduced Psychological SafetyPreprint
de Almeida, F., Киреева, Т. А., Orghian, D., Moreira, P., & Santos, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4605825 · Cited by 6
AITurk: Using ChatGPT for Social Science ResearchPreprint
Qin, X., Huang, M., & Ding, J. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xkd23 · Cited by 4
Schneider, E., Kyriakopoulos, V., Seo, Y., Hong, N., Lee, M., & Lim, J. S. (2026) · Corporate Reputation Review · doi:10.1057/s41299-026-00254-9 · Cited by 4
Konegen, K., Halbeisen, G., & Paslakis, G. (2024) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-024-00259-y · Cited by 4
Rakhimov, R., Aweko, S., & Thulin, E. W. (2024) · Oxford Open Climate Change · doi:10.1093/oxfclm/kgae021 · Cited by 3
From Reflection to Action: Enhancing Workplace Well-Being Through Digital Solutions
van Berkel, N., Visuri, A., Shalawadi, S., Evans, M. R., Tag, B., & Hosio, S. J. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae049 · Cited by 3
Santia, M., Bauer, N. M., & Gonzalez, S. (2024) · Political Research Quarterly · doi:10.1177/10659129241303449 · Cited by 4
The autonomous vehicle dilemma: passenger(s) versus pedestrian(s)
Bovesi, A., Calabretto, A., Stroppa, A., Adamo, G. M., Canepa, F., & Guidi, S. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2433037 · Cited by 3
Is Crowdsourcing a Puppet Show? Detecting a New Type of Fraud in Online Platforms
Wang, S., Jui, I. J., & Thorpe, J. (2024) · New Security Paradigms Workshop · doi:10.1145/3703465.3703472 · Cited by 6
Powell, D. N., & Hamilton, M. J. (2025) · Journal of Child and Family Studies · doi:10.1007/s10826-024-02996-8 · Cited by 5
Xu, Y., & Jeong, E. (2025) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2025.104157 · Cited by 3
L2 listening comprehension: effects of task-related and learner-related variables
Alzahrani, A. A., & Alghamdi, E. A. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2497498 · Cited by 3
Raising iPad kids: Parents' rules and management strategies for children's mobile devices
Harmon, T. M., & Arnold, D. H. (2025) · Family Relations · doi:10.1111/fare.13190 · Cited by 3
Chiang, P., Xu, Y., Williams, D. Y., Srivastava, A., Leite, J. A., Englert, A. R., & Hall, W. J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0327370 · Cited by 3
From relatedness frustrated to violent extremism: the mediating role of aggression
Waterschoot, M., Waterschoot, J., & Roets, A. (2025) · Motivation and Emotion · doi:10.1007/s11031-025-10140-2 · Cited by 4
Gottert, A., Abuya, T., Proos, E., Johnson, I., Dormer, N. H., Foley, U., Saul, G., Haddad, L. B., & Friend, D. R. (2025) · Contraception and Reproductive Medicine · doi:10.1186/s40834-025-00380-5 · Cited by 3
The moderating role of maximizing decision-making style on consumer response to price discounts
Liu, M., & Morrin, M. (2025) · European Journal of Marketing · doi:10.1108/ejm-08-2023-0664 · Cited by 3
Warning label messages about the cancer risk associated with alcohol: Effects of causal language
Payne, J. B., Rohde, J. A., Garrido, C. O., Jesch, E., Klein, W. M. P., Berrigan, D. A., Moser, R. P., & Han, P. K. J. (2025) · Addictive Behaviors · doi:10.1016/j.addbeh.2025.108453 · Cited by 4
Ditchburn, G. J., Nicola, M., Correia, H., & Drummond, P. D. (2025) · Psychology and Health · doi:10.1080/08870446.2025.2552227 · Cited by 3
Find the cause: Critical historical education affects racism attributions and policy support
Betz, D. E. (2025) · Group Processes & Intergroup Relations · doi:10.1177/13684302251378036 · Cited by 3
The leadership inclusion framework: Conceptualization and application in hospitality
Russen, M., Dawson, M., Madera, J. M., Kitterlin-Lynch, M., & Abbott, J. (2025) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2025.104487 · Cited by 4
Zhang, B. (2025) · Communication Reports · doi:10.1080/08934215.2025.2583063 · Cited by 3
The role of non-state actors in administrative burden reduction (ABR): a randomized experiment
Johnson, D. (2025) · Journal of Civil Society · doi:10.1080/17448689.2025.2586108 · Cited by 3
Smith-Spark, J. H., & Huang, M. (2025) · Behavioral Sciences · doi:10.3390/bs15111582 · Cited by 4
Serenko, A. (2025) · Journal of Knowledge Management · doi:10.1108/jkm-05-2025-0745 · Cited by 3
Yu, Y., Yetim, M. A., & Cocieru, O. C. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2588652 · Cited by 9
Alsaad, A. K., Alanezi, S., & Melhim, L. K. B. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2589498 · Cited by 4
Problematic usage of the internet is associated with orthorexia nervosa tendency in adults
Boutouis, S., & Grant, J. E. (2025) · CNS Spectrums · doi:10.1017/s1092852925100771 · Cited by 4
Yu, L., Talwar, S., Chaudhary, S., Alghafes, R. A., & Gupta, B. (2025) · Journal of Knowledge Management · doi:10.1108/jkm-06-2025-0811 · Cited by 5
Zlatanou, F., Dickert, S., & Henneberg, S. C. M. (2025) · Industrial Marketing Management · doi:10.1016/j.indmarman.2025.12.002 · Cited by 3
Initial Attempts to Detect or Screen Out AI Responses Prove Elusive in the Age of Agentic AI
Walker, D. C., Tran, M. P. N., Bizer, G. Y., & Flynn, S. T. (2026) · International Journal of Eating Disorders · doi:10.1002/eat.70024 · Cited by 3
Is happiness for all? The happiness halo effect on coworkers’ perceptions
Amir, A., Shtudiner, Z., & Shavit, T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1653843 · Cited by 3
Balerna, J. A., Fisher, B., Wemple, B. C., Myers, M., Soares, R., Quainoo, R., Khan, M. A., Merrill, S. C., & Shrum, T. (2026) · People and Nature · doi:10.1002/pan3.70229 · Cited by 2
Adam, M., Rohr, J. K., Greuel, M., Nguyễn, V. K., Aziz, M. A. E., Überreiter, C., Coles, O., Bärnighausen, T., & Supady, A. (2026) · npj Digital Medicine · doi:10.1038/s41746-025-02258-x · Cited by 4
Fenstermacher, E., Owsiany, M. T., Ju, C. H., Lohmar, S., & Edelstein, B. A. (2026) · Aging & Mental Health · doi:10.1080/13607863.2026.2612916 · Cited by 4
Anhedonia and altered reward responsiveness: Relations to psychosocial functioning
Sapperstein, M., Thai, M., Ang, Y., & Pizzagalli, D. A. (2026) · Journal of Mood and Anxiety Disorders · doi:10.1016/j.xjmad.2026.100169 · Cited by 4
Duan, Y., Zhu, Q., & Sarkis, J. (2026) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2026.3655220 · Cited by 5
The Emerging Social Media Water Cooler? Motivations for Reddit Use in a Niche League
Boehmer, J., & O’Hallarn, B. (2026) · Sport Marketing Quarterly · doi:10.1177/10616934251394147 · Cited by 4
Quantifying adoption: A SEM study of quantum software technology in software development
Lambiase, S., & Lucia, A. D. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10805-7 · Cited by 6
Wieberneit, M., Notebaert, L., Clare, J., & Tubex, H. (2026) · Behavioral Sciences & the Law · doi:10.1002/bsl.70041 · Cited by 3
Afshin, P., Mutonyi, B. R., & Nybakk, E. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1743364 · Cited by 4
Hong, S. J. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2634845 · Cited by 3
Lim, J. S., Lee, C., Kim, J., & Shin, D. (2026) · New Media & Society · doi:10.1177/14614448261426383 · Cited by 4
Poandl, M. M., Gutiérrez, D., & Kitching, E. (2026) · Journal of Aggression Maltreatment & Trauma · doi:10.1080/10926771.2026.2646521 · Cited by 3
‘Cost’-playing: paid vs. free non-functional virtual goods experiences
Zhang, W. Z., Marder, B. L., Cowan, K. L., & Ketron, S. C. (2026) · Journal of Business Research · doi:10.1016/j.jbusres.2026.116180 · Cited by 3
Hermanns, L., Degen, K., & Teubner, T. (2026) · Government Information Quarterly · doi:10.1016/j.giq.2026.102142 · Cited by 3
Extroversion-Introversion Design of Social Robots: The Role of the Mental Model Attribution Process
Oberhofer, V. M., Seeber, I., & Waizenegger, L. (2026) · Group Decision and Negotiation · doi:10.1007/s10726-026-09990-z · Cited by 4
Physical distancing during the COVID‐19 crisis: The roles of threat and moralization
Versteegt, L., van Dijke, M., & van den Bos, K. (2024) · Journal of Applied Social Psychology · doi:10.1111/jasp.13021 · Cited by 3
Benau, E. M., Zavodnick, J. H., & Jaffe, R. C. (2024) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2023.2300398 · Cited by 7
Bennett, A. R., & Grigoropoulou, N. (2024) · Journal of Marketing Management · doi:10.1080/0267257x.2024.2312197 · Cited by 3
Leung, R., Cook, M., Capra, M. F., & Johnstone, K. R. (2024) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2024.103595 · Cited by 3
Identifying Psychological Predictors of SARS-CoV-2 Vaccination: A Machine Learning Study
Bronstein, M. V., Kummerfeld, E., MacDonald, A. W., & Vinogradov, S. (2022) · Vaccine · doi:10.1016/j.vaccine.2024.126198 · Cited by 4
Haesevoets, T., Folmer, C. R., & Brebels, L. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09992-1 · Cited by 5
Graham, A., & Somers, L. J. (2024) · Policing A Journal of Policy and Practice · doi:10.1093/police/paae115 · Cited by 3
de Winter, J., Onkhar, V., & Dodou, D. (2025) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2024.12.021 · Cited by 4
Rogers, M. L., Reinbergs, E. J., & Murley, W. D. (2025) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2025.01.021 · Cited by 4
Do gritty salespersons mitigate relationship damage in unethical sales subcultures?
Merkle, A. C., Zmich, L. J., Leggett, B. R., & Hair, J. F. (2025) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2025.2452843 · Cited by 4
Pejic, S. R., & Deska, J. C. (2025) · Group Processes & Intergroup Relations · doi:10.1177/13684302241305368 · Cited by 4
The Predictive Processing of Number Information in L1 and L2 Arabic Speakers
Alzahrani, A. A. (2025) · Languages · doi:10.3390/languages10020025 · Cited by 6
DiGiuseppe, M. R., & Shea, P. E. (2025) · British Journal of Political Science · doi:10.1017/s0007123424000462 · Cited by 4
MacNeill, A. L., Luke, A., & Doucet, S. A. (2025) · Digital Health · doi:10.1177/20552076241311066 · Cited by 4
Californians’ perceptions of the causes of homelessness and potential policy solutions
Srivastava, S., Rosenberg, B. D., & Berardi, V. (2025) · Journal of Social Distress and the Homeless · doi:10.1080/10530789.2025.2485684 · Cited by 4
Misiak, M., Kavanagh, C. M., Muzzulini, B., & Whitehouse, H. (2025) · Political Psychology · doi:10.1111/pops.70024 · Cited by 3
Lucibello, K. M., Marashi, M., Vani, M. F., Thibodeau, D. E., & Sabiston, C. M. (2025) · Body Image · doi:10.1016/j.bodyim.2025.101893 · Cited by 3
A hidden bias: How organizational identification impacts organizational favoritism
Guisard, T., Hebl, W. I., & Madera, J. M. (2025) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2025.104307 · Cited by 3
Benavides, S. V., & Brindle, R. C. (2025) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-025-00721-1 · Cited by 5
Meral, E. O., Moss‐Racusin, C. A., & van der Toorn, J. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251339690 · Cited by 3
Walker, L. O., Murry, N., & Becker, H. (2025) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2025.06.004 · Cited by 4
Mei, P., Cannon, R., Everett, J. A. C., Liu, P., & Awad, E. (2025) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2025.101545 · Cited by 4
Mao, J., Zeng, Z., Yang, S., Guo, Y., Wang, B., & van Prooijen, J. (2025) · British Journal of Psychology · doi:10.1111/bjop.70016 · Cited by 4
Mixed signals? A receiver-centric perspective on the interpretation of algorithmic control signals
Bunzel, C., Boon, C. T., Hartog, D. N. D., & Verburg, R. M. (2025) · The International Journal of Human Resource Management · doi:10.1080/09585192.2025.2542772 · Cited by 5
ChatGPT in the Working World: A Qualitative Study
Libera, P. S., Bilgram, V., Schötteler, S., & Mammen, J. (2025) · Information Resources Management Journal · doi:10.4018/irmj.386593 · Cited by 6
Bayesian factor mixture modeling with response time for detecting careless respondents
Zhang, L., Ulitzsch, E., & Domingue, B. W. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02797-x · Cited by 4
Denecke, S., Strakeljahn, F., Bott, A., & Lincoln, T. M. (2025) · Communications Psychology · doi:10.1038/s44271-025-00311-9 · Cited by 3
A Bidirectional Link between Financial Communication in Romantic Relationships and Financial Stress
Peetz, J., & Robson, J. (2025) · Journal of Family and Economic Issues · doi:10.1007/s10834-025-10063-7 · Cited by 5
Explaining Consumer Reactions to Brand Activism With the ABC Model of Brand Stereotypes
Gidaković, P., Koklič, M. K., Zečević, M., & Žabkar, V. (2025) · Psychology and Marketing · doi:10.1002/mar.70072 · Cited by 4
I Can’t Stop: The Effects of Psychological Climate for Overwork on Recovery Experiences
Terry, J. D., & Cigularov, K. P. (2026) · Occupational Health Science · doi:10.1007/s41542-026-00254-5 · Cited by 3
Abdel-sayyed, A., Hoang, K. N., Turk, T., Xu, L., & Fujiwara, E. (2024) · Journal of Health Psychology · doi:10.1177/13591053241247376 · Cited by 4
Prouty, H., Rose, L. E., Hussaini, H., Sy, J. R. T., & Sanders, S. M. (2024) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2024.2367243 · Cited by 3
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.