Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 401–500 of 1,004
When ‘Pay Later’ means ‘Pay Now’: How deferred payment options shape choice
Kumari, P., & Tripathi, S. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.104774 · Cited by 7
A crowdsourced megastudy of 12 digital single-session interventions for depression in US adults
Kaveladze, B. T., Voelkel, J. G., Stagnaro, M. N., Huang, M., Smock, A., Sullivan, E., Xu, Y., McCall, M. P., Zapata, J. P., Ahmed, S. I., et al. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02415-6 · Cited by 12
Consumer perceptions of plant-based meat innovation: a focus group study on food technology
Broad, G. M., & Ruby, M. B. (2026) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2026.1800499 · Cited by 5
Cruwys, T., Corkin, N., & Pasalich, D. S. (2024) · Journal of Child and Family Studies · doi:10.1007/s10826-024-02808-z · Cited by 6
Berkout, O. V., & Flynn, M. K. (2024) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-024-00411-z · Cited by 8
Hesse, C., & Mikkelson, A. C. (2024) · International Journal of Business Communication · doi:10.1177/23294884241248133 · Cited by 7
Liang, A., Murphy-Hill, E. R., Weimer, W. R., & Huang, Y. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3437355 · Cited by 9
Zhu, C., Huang, D., & Zuo, B. (2024) · Current Psychology · doi:10.1007/s12144-024-06347-0 · Cited by 6
Evaluating Cross-Training’s Impact on Perceived Teaming Outcomes for Human-AI Teams
Lancaster, C., Gilreath, H., Mallick, R., & McNeese, N. J. (2024) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813241262033 · Cited by 5
Weis, R., & Costenbader, R. (2024) · Psychological Injury and Law · doi:10.1007/s12207-024-09520-9 · Cited by 6
Balit, N., Sun, S., Zhang, Y., & Sharp, M. E. (2024) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2024.107183 · Cited by 7
Talk about shared money: Account pooling is associated with financial communication
Peetz, J. (2025) · Journal of Social and Personal Relationships · doi:10.1177/02654075241312690 · Cited by 5
Benau, E. M., Hanna, M. R., Yirdong, F., & Polanco-Roman, L. A. (2025) · British Journal of Clinical Psychology · doi:10.1111/bjc.12525 · Cited by 5
Baysu, G., & Uluğ, Ö. M. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251313831 · Cited by 8
Biancofiore, S. E., & Hughes, I. M. (2025) · Psychology and Sexuality · doi:10.1080/19419899.2025.2465989 · Cited by 6
Pre-K–12 Teachers’ Views on ASD+ADHD: Prevalence Estimates and Teaching Preparedness
Justus, S. A., Pogue, E. D., & Simanovich, V. (2025) · Children · doi:10.3390/children12030342 · Cited by 9
Cyber Conflict & Domestic Audience Costs
Shandler, R. (2025) · International Interactions · doi:10.1080/03050629.2025.2478145 · Cited by 5
Grigoryeva, M. S., & Robbins, B. G. (2025) · Sociological Forum · doi:10.1111/socf.13055 · Cited by 5
Adverse childhood experiences, adult emotional eating, and the role of self-compassion
Hong, A. E., Ehmann, M. M., Chwyl, C., & Hagerman, C. J. (2025) · Eating Behaviors · doi:10.1016/j.eatbeh.2025.101978 · Cited by 5
Chen, Y., Jarecka, D., Abraham, S. A., Gau, R., Ng, E., Low, D. M., Bevers, I., Johnson, A. E. W., Keshavan, A., Klein, A., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/63343 · Cited by 9
Out of the labs and into the streets: Effects of climate protests by environmental scientists
Dablander, F., Sachisthal, M. S. M., & Aron, A. R. (2025) · Royal Society Open Science · doi:10.1098/rsos.241001 · Cited by 6
Cultural stereotypes and personal beliefs about thin people: A form of fat resistance
Oswald, F., Khera, D. S., Matsick, J. L., & Chaney, K. E. (2025) · Body Image · doi:10.1016/j.bodyim.2025.101897 · Cited by 5
Reputation-based reciprocity in human–bot and human–human networks
Harrell, A., & Traeger, M. L. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf150 · Cited by 5
Konstantinidou, E., & Michaelides, M. P. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1595648 · Cited by 5
Dixit, U., Barnhart, W. R., Ahlich, E. M., Henderson, R. R., Love, A. A., He, J., & Zickgraf, H. F. (2025) · Appetite · doi:10.1016/j.appet.2025.108235 · Cited by 6
What if the swans wreaking havoc in supply chains are grey not black?
Lynch, T. N. K., Mondragón, A. E. C., & Jung, J. Y. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2543961 · Cited by 5
Winter, K., Pummerer, L., & Sassenberg, K. (2025) · British Journal of Psychology · doi:10.1111/bjop.70030 · Cited by 8
Jeon, Y. A., Ryoo, Y., Lee, S., & Yoon, H. J. (2025) · Journal of Advertising Research · doi:10.1080/00218499.2025.2537503 · Cited by 6
Pande, D., Khanal, S., & Taeihagh, A. (2025) · Journal of Comparative Policy Analysis Research and Practice · doi:10.1080/13876988.2025.2543546 · Cited by 8
Korman, B. A. (2023) · Drug Science Policy and Law · doi:10.1177/20503245231191400 · Cited by 6
Baker, C. L., & Finkelstein, L. M. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112482 · Cited by 6
Null, K. E., Duda, J. M., & Pizzagalli, D. A. (2024) · Journal of Mood and Anxiety Disorders · doi:10.1016/j.xjmad.2024.100057 · Cited by 5
Experimental Philosophy of Free Will and the Comprehension of Determinism
Lim, D., Nichols, R., & Wagoner, J. A. (2024) · Review of Philosophy and Psychology · doi:10.1007/s13164-024-00726-z · Cited by 5
Park, J., Leung, X. Y., Ponting, S. S.-A., & Cain, L. (2024) · Journal of Hospitality and Tourism Management · doi:10.1016/j.jhtm.2024.03.011 · Cited by 7
Hornbæk, K., Lyngs, U., Iarygina, O., & Skov, M. B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642820 · Cited by 9
Oh, Y. S., Arthur-Banning, S. G., Mamo, Y., & Chiu, W. (2024) · Sport Marketing Quarterly · doi:10.32731/smq.334.122024.05 · Cited by 5
The Endowment Effect and Housing Studies: The Role of Multiple Reference Points
Tomal, M. (2024) · Critical Housing Analysis · doi:10.13060/23362839.2024.11.2.576 · Cited by 5
Pallesen, S., Vedaa, Ø., Sunde, E., Harris, A., Waage, S., Saxvig, I. W., Zhang, J., & Bjorvatn, B. (2025) · Frontiers in Sleep · doi:10.3389/frsle.2025.1499802 · Cited by 6
Wang, H. E., Stephens, S. W., Jacobsen, K. K., Brown, B. A., Elsholz, C. L., Frey, J. A., VanBuren, J. M., Gausche‐Hill, M., Shah, M. I., Bosson, N., et al. (2025) · Resuscitation Plus · doi:10.1016/j.resplu.2025.100919 · Cited by 5
Higher cognitive ability linked to weaker moral foundations in UK adults
Zakharin, M., & Bates, T. C. (2025) · Intelligence · doi:10.1016/j.intell.2025.101930 · Cited by 7
Zeng, Z., Clyde, N., Dai, H., Zhang, D., Xu, Z., & Shen, Z. M. (2020) · Manufacturing & Service Operations Management · doi:10.1287/msom.2022.0224 · Cited by 6
Reyes, M. A., & Clark, E. M. (2024) · Sexual & Relationship Therapy · doi:10.1080/14681994.2024.2332622 · Cited by 6
Men's Hostile Sexism Predicts Skepticism of Sexual Assault Science
Betz, D. E., Deegan, K., & Gomes, A. (2023) · Psychology of Women Quarterly · doi:10.1177/03616843231215373 · Cited by 5
Vuoskoski, J. K., & Peltola, H. (2024) · Psychology of Music · doi:10.1177/03057356241239336 · Cited by 4
Montefiore, T., Formosa, P., & Polito, V. (2024) · Philosophical Psychology · doi:10.1080/09515089.2024.2354432 · Cited by 8
Экспериментальный анализ моральной конформности в ситуации пассивного социального давления
Fedorov, A. A. (2024) · Психология Журнал Высшей школы экономики · doi:10.17323/1813-8918-2024-2-277-305 · Cited by 4
SACCIA Communication, Attitudes Towards Cheating and Academic Misconduct
Stojanov, A., Hannawa, A. F., & Adam, L. A. (2024) · Journal of Academic Ethics · doi:10.1007/s10805-024-09541-8 · Cited by 4
Coppersmith, D. D. L., Bentley, K. H., Kleiman, E. M., Jaroszewski, A. C., Daniel, M., & Nock, M. K. (2024) · JMIR Mental Health · doi:10.2196/58409 · Cited by 6
How Unique is Whose Web Browser? The role of demographics in browser fingerprinting among US users
Berke, A., Ghazi, B., Bacis, E., Kamath, P., Kumar, R., Lassonde, R., Manurangsi, P., & Syed, U. (2024) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2025-0038 · Cited by 4
Szymkowiak, A., Garczarek-Ba̧k, U., & Bączyk, M. (2024) · Sport, Business and Management: An International Journal · doi:10.1108/sbm-11-2023-0138 · Cited by 2
Loaiza-Ramírez, J. P., Reimer, T. O., & Moreno-Mantilla, C. E. (2024) · Cleaner and Responsible Consumption · doi:10.1016/j.clrc.2024.100237 · Cited by 4
Lee, S. Y. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112956 · Cited by 6
The more, the merrier? Young adults’ sibling relationship quality in medium to large families
Jensen, A. C., Ashby, S., Noorda, N. M., & Jasperson, J. (2024) · Journal of Social and Personal Relationships · doi:10.1177/02654075241302240 · Cited by 4
Ko, J. (., Lee, M., & Park, B. (2025) · International Journal of Sport Communication · doi:10.1123/ijsc.2024-0205 · Cited by 5
Measuring criticism of the police in the local news media using large language models
Crowl, L., Dutta, S., KhudaBukhsh, A. R., Severnini, E., & Nagin, D. S. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2418821122 · Cited by 9
Hersugondo, H., Batu, K. L., Latan, H., Jabbour, C. J. C., & Jabbour, A. B. L. D. S. (2025) · Review of Public Personnel Administration · doi:10.1177/0734371x251316597 · Cited by 4
Normative face recognition ability test scores vary across online participant pools
Popovic, B., Dunn, J. D., Towler, A., & White, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-92907-8 · Cited by 4
Ince, C., Tiego, J., Albertella, L., Fontenelle, L. F., Chamberlain, S. R., Yücel, M., & Rotaru, K. (2025) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00022 · Cited by 5
Social mobility beliefs lower preferences for genetically-modified foods
Chan, E. Y., Saqib, N. U., & Gohary, A. (2025) · Appetite · doi:10.1016/j.appet.2025.107981 · Cited by 5
Association among nutrition knowledge, food frequency, and food insecurity during pregnancy
Adylbekova, P., Balantekin, K. N., Feeser, K., & Temple, J. L. (2025) · BMC Nutrition · doi:10.1186/s40795-025-01051-z · Cited by 6
Hospitality Gig Worker Motivation Profiles: A Latent Profile Analysis
Yu, H. C., Ponting, S. S.-A., Lee, L., & King, C. (2025) · Journal of Hospitality & Tourism Research · doi:10.1177/10963480251336155 · Cited by 4
Adam, M., Klapow, M. C., Greuel, M., Seeff, M., Rohr, J. K., Gordon, A., Amsalem, D., & Bärnighausen, T. (2025) · JMIR Research Protocols · doi:10.2196/73382 · Cited by 5
YANIT, M. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100682 · Cited by 4
Vinas, A., Blanco, F., & Matute, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-01043-w · Cited by 6
Leal, M. M. (2025) · International Interactions · doi:10.1080/03050629.2025.2495697 · Cited by 4
How the design of product-service systems affects consumer adoption
Arani, H. V., de Vries, H., & de Koster, R. B. M. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2508918 · Cited by 4
Before the attempt: How people think and plan in suicide crises
Xu, I., Jacobucci, R., & Ammerman, B. A. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119660 · Cited by 5
The Role of Ecological Factors, Gender, and Age in Shaping Visual Preferences for Urban Wetlands
Zakharova, K., Lehtilä, K., & Rodela, R. (2025) · Journal of Environmental Studies and Sciences · doi:10.1007/s13412-025-01026-3 · Cited by 5
Ullstein, C., Hohendanner, M., Sharma, N., Иванов, С. Е., Tsipov, G., & Großklags, J. (2025) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3715335.3735470 · Cited by 6
Cognitive Bias Affects Perception and Decision-Making in Simulated Facial Recognition Searches
Stewart, C. K., & Kukucka, J. (2025) · Behavioral Sciences · doi:10.3390/bs15081094 · Cited by 5
Brown, M. A., & Toyama, M. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2547922 · Cited by 5
Employment-Related Assistive Technology Needs in Autistic Adults: A Mixed-Methods Study
Zhou, K., Richard, C., Zhai, Y., Li, D., & Fry, H. E. (2025) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe15090170 · Cited by 6
Disruptive but costly: How upside-down logos backfire in consumer responses to brands
Baek, T. H., Yim, M. Y., Park, J., & Cho, A. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104500 · Cited by 5
Geslin, E. (2025) · Multimedia · doi:10.3390/multimedia1010004 · Cited by 4
Feltz, A., Feltz, S., Hoang, U., & Holt, J. R. (2025) · Journal of Consumer Policy · doi:10.1007/s10603-025-09601-5 · Cited by 5
Rosemarino, N. M., Jones, C. H., & Dolsten, C. R. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104490 · Cited by 4
Applications of the ErrVarNorm index in case 1 best-worst scaling and data quality insights
Jaeger, S. R., Chheang, S. L., & Llobell, F. (2025) · Food Quality and Preference · doi:10.1016/j.foodqual.2025.105730 · Cited by 6
Banerjee, N., Rawal, M., Torres, J. L. S., & Bagherzadeh, R. (2025) · Journal of Promotion Management · doi:10.1080/10496491.2025.2571948 · Cited by 4
Yang, J. J., Maeng, A., & Jung, S.-U. (2025) · Journal of Advertising · doi:10.1080/00913367.2025.2566851 · Cited by 8
Xie, W., & Iyer, L. S. (2025) · Journal of Fashion Marketing and Management · doi:10.1108/jfmm-08-2024-0299 · Cited by 4
Streaming, Fast and Slow: Cognitive Load-Aware Streaming for Efficient LLM Serving
Xiao, C., & Yang, Z. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747721 · Cited by 12
Polat, İ., Sesliokuyucu, O. S., Doğan, S., & Çobanoğlu, C. (2025) · Journal of Air Transport Management · doi:10.1016/j.jairtraman.2025.102932 · Cited by 7
Lee, G., Kim, J., Kim, K., Huh, J. Y., & Park, J. J. (2025) · Journal of Fashion Marketing and Management · doi:10.1108/jfmm-11-2024-0431 · Cited by 8
Diversity, equity and inclusion in language research: Addressing English-centricity
Brysbaert, M. (2025) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2025.100286 · Cited by 6
Khan, M. A., Zia, A., Merrill, S. C., Koliba, C., Balerna, J. A., Quainoo, R., Soares, R., & Shrum, T. (2025) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2025.105941 · Cited by 5
Zhang, B., Kim, S. J., & Scott, A. (2025) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990251357949 · Cited by 4
Sun, J., & Si, J. (2025) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer20040341 · Cited by 4
Conducting online randomized experiments: lessons from a policing survey using AI-Edited videos
Wu, Y., Qiu, B. R., & Swadish, S. (2026) · Journal of Experimental Criminology · doi:10.1007/s11292-025-09722-4 · Cited by 5
Hu, Y. (2026) · Journal of Hospitality and Tourism Management · doi:10.1016/j.jhtm.2026.101400 · Cited by 4
Who’s Sorry Now: User Preferences Among Rote, Empathic, and Explanatory Apologies from LLM Chatbots
Ashktorab, Z., Buccella, A., D’Cruz, J., Fowler, Z., Gill, A., Leung, K. Y., Magnus, P. D., Richards, J., & Varshney, K. R. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3793679 · Cited by 9
Heitz, J., Engler, I., & Langer, N. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02360-8 · Cited by 10
You've got (no) mail: Unpacking risk of non-delivery fraud victimization among an online sample
Maher, C. A., McNealey, R. L., Fisher, T., & Holt, T. J. (2026) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2026.102644 · Cited by 4
Chen, C., & Jia, X.-L. (2026) · AI and Ethics · doi:10.1007/s43681-026-01039-w · Cited by 9
Chen, T., Alghafes, R. A., Rustambekov, E., Malik, P., & Rai, J. S. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103333 · Cited by 4
Tran, D. T., & Howard, J. L. (2026) · Motivation and Emotion · doi:10.1007/s11031-026-10263-0 · Cited by 5
Fun in the Workplace and Employee Substance Use: A Double-Edged Sword?
Tews, M. J., Yu, H. C., & Pons, S. (2023) · Journal of Drug Issues · doi:10.1177/00220426231187284 · Cited by 4
Safety and Exposure in Transparent School Interiors: Patterned User Perceptions of Glass
Altenburger, E., & Russell, L. T. (2023) · Journal of Interior Design · doi:10.1177/10717641231202738 · Cited by 6
Givi, J., Grossman, D. M., & Kardes, F. R. (2023) · Psychology and Marketing · doi:10.1002/mar.21944 · Cited by 7
Bhuptani, P. H., López, G., Peterson, R. S., & Orchowski, L. M. (2024) · Journal of Child Sexual Abuse · doi:10.1080/10538712.2024.2314287 · Cited by 5
McConnell, P. A., Finetto, C., & Heise, K.-F. (2024) · Scientific Reports · doi:10.1038/s41598-024-58300-7 · Cited by 6
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.