Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 101–200 of 1,004
The DOES Scale: Measuring Sensory Processing Sensitivity as a Trait Constellation
Gubler, D. A., Janelt, T., Roth, M., Schlegel, K., Guggisberg, J., & Troche, S. J. (2024) · Journal of Personality Assessment · doi:10.1080/00223891.2024.2405536 · Cited by 27
Troy, C. L. C., Eng, N., & Overton, H. K. (2025) · Public Relations Review · doi:10.1016/j.pubrev.2025.102545 · Cited by 27
Characteristics and food consumption for current, previous, and potential consumers of GLP-1 s
Dilley, A., Adhikari, S., Silwal, P., L. Lusk, J., & McFadden, B. R. (2025) · Food Quality and Preference · doi:10.1016/j.foodqual.2025.105507 · Cited by 18
Rathcke, T. V., Smit, E. A., Zheng, Y., & Canzi, M. (2024) · Attention Perception & Psychophysics · doi:10.3758/s13414-024-02893-8 · Cited by 20
The fear of missing out influence on excitement-seeking and the thrill of a sale
Bok, S., Shum, J., & Lee, M. (2025) · Cogent Business & Management · doi:10.1080/23311975.2025.2451125 · Cited by 23
Ethically Problematic Practices on Potential Traumas and Betrayals: Perspectives of Therapy Clients
Rogers, R., Chang, Y.-T., Drogin, E. Y., Tazi, K. Y., & Williamson‐Butler, S. (2025) · Psychological Injury and Law · doi:10.1007/s12207-025-09539-6 · Cited by 19
Békés, V., Bőthe, B., & Doorn, K. A. (2025) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70085 · Cited by 21
Ruben, M. A., Blanch‐Hartigan, D., & Hall, J. A. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-025-10068-w · Cited by 31
Playing with food – The effects of augmented reality on meal perceptions
Jeganathan, K., & Szymkowiak, A. (2023) · Food Quality and Preference · doi:10.1016/j.foodqual.2023.104969 · Cited by 21
Effects of Ayahuasca on Gratitude and Relationships with Nature: A Prospective, Naturalistic Study
Aday, J. S., Bloesch, E. K., Davis, A. K., Domoff, S. E., Scherr, K. C., Woolley, J. D., & Davoli, C. C. (2024) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2024.2312980 · Cited by 20
Assaker, G. (2024) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-01-2024-0012 · Cited by 18
Shaikh, S., Yamim, A. P., & Werle, C. O. C. (2024) · Appetite · doi:10.1016/j.appet.2024.107670 · Cited by 22
COVID-19 vaccine refusal is driven by deliberate ignorance and cognitive distortions
Fuławka, K., Hertwig, R., & Pachur, T. (2024) · npj Vaccines · doi:10.1038/s41541-024-00951-8 · Cited by 29
Choi, S. M., Brown‐Devlin, N., & Jin, E. (2025) · Communication & Sport · doi:10.1177/21674795251346506 · Cited by 12
Robbins, M., Rinaldi, K., Brochu, P. M., & Mensinger, J. L. (2025) · Body Image · doi:10.1016/j.bodyim.2025.101860 · Cited by 21
Gaczek, P., Leszczyński, G., Wei, Y., & Sun, H. (2025) · Journal of Business Ethics · doi:10.1007/s10551-025-06083-w · Cited by 27
Békés, V., & Doorn, K. A. (2026) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70220 · Cited by 21
Seatbelts and raincoats, or banks and castles: Investigating the impact of vaccine metaphors
Flusberg, S. J., Mackey, A., & Semino, E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0294739 · Cited by 19
The role of framing and effort in green nudging acceptance
Grelle, S., Kuhn, S., Fuhrmann-Riebel, H., & Hofmann, W. (2024) · Behavioural Public Policy · doi:10.1017/bpp.2024.8 · Cited by 17
Fabiani, C., Shantha, J. G., Gangaputra, S., Vitale, A., Thorne, J. E., Jabs, D. A., Fawzi, A. A., Smith, J. R., Accorinti, M., de Smet, M. D., et al. (2024) · Ocular Immunology and Inflammation · doi:10.1080/09273948.2024.2423870 · Cited by 17
Survey Experiments in Sociology
Schachter, A., & Weisshaar, K. (2024) · Annual Review of Sociology · doi:10.1146/annurev-soc-083024-070113 · Cited by 20
Zamudio, C., Grigsby, J. L., & Michelsen, M. (2025) · Journal of Advertising · doi:10.1080/00913367.2024.2438002 · Cited by 23
Russen, M., Dawson, M., & Madera, J. M. (2025) · Journal of Hospitality and Tourism Management · doi:10.1016/j.jhtm.2025.02.002 · Cited by 24
Cullen, H. J., Paterson, H. M., Dutton, T. S., & van Golde, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296489 · Cited by 16
Lorenzo‐Luaces, L., & Howard, J. (2023) · Journal of Medical Internet Research · doi:10.2196/45411 · Cited by 23
TikToks Lead to Higher Knowledge and Perceived Severity of Sexual Violence among Adolescent Men
Nicolla, S., Lazard, A. J., Austin, L., Freelon, D., Reyes, H. L. M., & Moracco, K. E. (2023) · Journal of Youth and Adolescence · doi:10.1007/s10964-023-01867-7 · Cited by 20
Bunker, C. J., & Kwan, V. S. Y. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108025 · Cited by 20
Conscientiousness makes effort less frustrating
Bates, T. C. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112690 · Cited by 20
Examining the replicability of online experiments selected by a decision market
Holzmeister, F., Johannesson, M., Camerer, C. F., Chen, Y., Ho, T., Hoogeveen, S., Huber, J., Imai, N., Imai, T., Jin, L. J., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02062-9 · Cited by 26
Chih, W., Wang, K.-Y., & Banda, H. W. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104254 · Cited by 20
Effects of learner choice over automated, immediate feedback
Kuklick, L. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102065 · Cited by 15
Nai, A., & Young, E. L. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112794 · Cited by 19
Inglis, G., Sosu, E., McHardy, F., Witteveen, I., Jenkins, P., & Knifton, L. (2024) · International Journal of Social Psychiatry · doi:10.1177/00207640241296055 · Cited by 20
Machine Learning for Custom-Designed Light Emitters in Biomedicine
Afolabi, S. O., Скорб, Е. В., & Shityakov, S. (2025) · Engineering materials · doi:10.1007/978-3-031-88731-4_11 · Cited by 17
Exploring Coworker Perceptions of and Reactions to Quiet Quitting
Bennett, A. A., Epler, R. T., Thomas, V. L., & Jalil, D. (2025) · Human Resource Management · doi:10.1002/hrm.70014 · Cited by 23
Buschmeyer, K., Hatfield, S., & Zenner, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1249322 · Cited by 28
Evaluation of the Scales for Social Comparison of Appearance and Social Comparison of Well-Being
Nexhmedin Morina, B., Meyer, T., McCarthy, P. A., Hoppen, T. H., & Schlechter, P. (2024) · Journal of Personality Assessment · doi:10.1080/00223891.2023.2298887 · Cited by 16
Schumann, S., Clemmow, C., Rottweiler, B., & Gill, P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0293810 · Cited by 16
Zachrich, L., Wagner, W., Bertram, C., & Trautwein, U. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101921 · Cited by 19
Transparent Threads: Understanding How U.S. Consumers Respond to Traceable Information in Fashion
Huynh, H., Wojdyla, W., Dyk, C. V., Yang, Z., & Chi, T. (2024) · Sustainability · doi:10.3390/su16125010 · Cited by 19
Ndone, J., & Kyriakopoulos, V. (2024) · Public Relations Review · doi:10.1016/j.pubrev.2024.102517 · Cited by 18
Starvaggi, I., & Lorenzo‐Luaces, L. (2025) · JMIR Mental Health · doi:10.2196/65356 · Cited by 20
Sijbom, R. B. L., Emanuel, E. S., Koen, J., Baas, M., & Schutter, L. D. (2025) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2025.2458343 · Cited by 23
The role of psychological strengths in positive life outcomes in adults with ADHD
Hargitai, L. D., Laan, E. L. M., Schippers, L. M., Livingston, L. A., Fairchild, G., Shah, P., & Hoogman, M. (2025) · Psychological Medicine · doi:10.1017/s0033291725101232 · Cited by 14
“…online platform that facilitates high-quality data collection from diverse samples, including large-scale research on neurodevelopmental conditions (Douglas, Ewell, & Brauer, 2023; Palan & Schitter, 2018; Peer, Brandimarte, Samat, & Acquisti, 2017; Taylor, Farmer, Livingston, Callan, & Shah, 2022).”
The brief scale of existential loneliness: scale development and psychometric evaluation
McKenna-Plumley, P. E., Turner, R. N., Yang, K., & Groarke, J. M. (2024) · Current Psychology · doi:10.1007/s12144-024-06828-2 · Cited by 15
Kalmanovich-Cohen, H., & Stanton, S. J. (2025) · International Journal of Manpower · doi:10.1108/ijm-11-2024-0773 · Cited by 16
Droogenbroeck, E. V., & Willems, K. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104326 · Cited by 17
Sahebi, S., Formosa, P., & Bankins, S. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100304 · Cited by 24
Yu, S., & Shea, C. T. (2023) · Organization Science · doi:10.1287/orsc.2020.14640 · Cited by 16
Judge, S., Goodson, B. M., & Stefaniak, C. M. (2024) · Contemporary Accounting Research · doi:10.1111/1911-3846.12936 · Cited by 14
Schlechter, P., Hoppen, T. H., & Nexhmedin Morina, B. (2024) · Journal of Traumatic Stress · doi:10.1002/jts.23018 · Cited by 14
How do surrogates make treatment decisions for patients with dementia: An experimental survey study
Nicholas, L. H., Langa, K. M., Halpern, S. D., & Macis, M. (2024) · Health Economics · doi:10.1002/hec.4810 · Cited by 17
Sievert, E. D. C., Korn, L., Groß, M., Santana, A. P., BOHM, R. M., & Betsch, C. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12536 · Cited by 17
Holm, R. H., Anderson, L. B., Ness, H. D., LaJoie, A. S., & Smith, T. (2024) · Journal of Water and Health · doi:10.2166/wh.2024.074 · Cited by 14
Integrating Visual Context Into Language Models for Situated Social Conversation Starters
Janssens, R., Wolfert, P., Demeester, T., & Belpaeme, T. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3428704 · Cited by 20
Sestino, A., Tuček, D., & Bresciani, S. (2024) · Journal of Small Business and Enterprise Development · doi:10.1108/jsbed-10-2023-0468 · Cited by 18
Carbone, A., Pestell, C., Nevill, T., & Mancini, V. O. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22010011 · Cited by 22
Kretzer, F., Kolthoff, K., Bartelt, C., Ponzetto, S. P., & Maedche, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713932 · Cited by 22
An Expert Guide to Planning Experimental Tasks For Evidence-Accumulation Modeling
Boag, R. J., Innes, R. J., Stevenson, N., Bahg, G., Busemeyer, J. R., Cox, G. E., Donkin, C., Frank, M. J., Hawkins, G. E., Heathcote, A., et al. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251336127 · Cited by 21
Gaddis, S. M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3022217 · Cited by 19
Reinero, D. A., Harris, E., Rathje, S., Duke, A., & Bavel, J. J. V. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/z4df3 · Cited by 20
AITurk: Using ChatGPT for Social Science ResearchPreprint
Qin, X., Huang, M., & Ding, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4922861 · Cited by 25
Lim, J. S., Lee, C., Shin, D., Kim, J., & Zhang, J. (2025) · Journal of Public Relations Research · doi:10.1080/1062726x.2025.2501552 · Cited by 16
Cheng, Z., Medina, L., Durotoye, T., & Chadha, M. (2025) · Journalism Studies · doi:10.1080/1461670x.2025.2559020 · Cited by 13
Fowler, C., Gasiorek, J., & Giles, H. (2025) · Communication Monographs · doi:10.1080/03637751.2025.2546102 · Cited by 16
Zimmerman, A. (2024) · Food Quality and Preference · doi:10.1016/j.foodqual.2024.105194 · Cited by 13
Susceptibility to misinformation about COVID-19 vaccines: A signal detection analysis
Nahon, L. S., Ng, N. L., & Gawronski, B. (2024) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2024.104632 · Cited by 18
Hechler, F. C., Tuomainen, O., Weber, N., Fahr, F., Karlek, B., Maroske, M., Misia, M., & Caruana, N. (2025) · Molecular Autism · doi:10.1186/s13229-025-00643-7 · Cited by 12
Jiang, H.-L., Lu, L.-H., Yuen, T. W., & Liu, Y. (2025) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2025.2484282 · Cited by 20
Online consumer research: more attention needs to be given to data quality
Asioli, D., & Jaeger, S. R. (2025) · Current Opinion in Food Science · doi:10.1016/j.cofs.2025.101307 · Cited by 16
Giles, F. C., McKenzie, M., Kyei-Nimakoh, M., Satyen, L., Tarzia, L., & Hegarty, K. L. (2025) · Methodological Innovations · doi:10.1177/20597991251333345 · Cited by 14
Animal welfare information frames US public perceptions of precision technology use on dairy farms
Kelly, B. L., Proudfoot, K. L., da Silva, T. É., Costa, J. H. C., & Ventura, B. A. (2025) · Journal of Dairy Science · doi:10.3168/jds.2024-25603 · Cited by 14
Schwemmer, C., & Riedl, M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321592 · Cited by 17
Strickland, I. B., Ferketich, A. K., Tackett, A., Patterson, J. G., Breitborde, N., Davis, J., & Roberts, M. E. (2025) · Online Journal of Public Health Informatics · doi:10.2196/70926 · Cited by 13
Meng, K., & Xiao, J. J. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104496 · Cited by 13
Requirements Elicitation Follow-Up Question Generation
Shen, Y., Singhal, A., & Breaux, T. D. (2025) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re63999.2025.00021 · Cited by 16
Assessing public support for degrowth: survey-based experimental and predictive studies
Krpan, D., Bassó, F., Hickel, J., & Kallis, G. (2025) · The Lancet Planetary Health · doi:10.1016/j.lanplh.2025.101326 · Cited by 27
The Emotional Burden of Loneliness and its Association with Mental Health Outcomes
Lazuras, L., Ypsilanti, A., & Mullings, E. L. (2024) · International Journal of Behavioral Medicine · doi:10.1007/s12529-023-10255-1 · Cited by 16
Choi, J., & Park, H. Y. (2024) · European Journal of Marketing · doi:10.1108/ejm-08-2022-0583 · Cited by 15
Robinson, M. M., Hassija, C. M., & Wellman, J. (2024) · Journal of loss & trauma · doi:10.1080/15325024.2024.2362695 · Cited by 12
Ndone, J. (2024) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.12620 · Cited by 13
Understanding screenshot collection and sharing on messaging platforms: a privacy perspective
Ingber, A. S. (2025) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmae023 · Cited by 14
Byrd, K., Kapadia, K., & John, R. (2025) · Environment Systems and Decisions · doi:10.1007/s10669-025-10004-7 · Cited by 10
Measuring Constitutional Loyalty: Evidence from the COVID-19 Pandemic
Gutmann, J., Sarel, R., & Voigt, S. (2022) · Public Choice · doi:10.1007/s11127-025-01271-8 · Cited by 14
Goldkorn, M., Schwartz, B. N., & Monterosso, J. R. (2025) · Obesity Science & Practice · doi:10.1002/osp4.70041 · Cited by 14
Loneliness Mindsets: A New Measurement Approach and Implications for Predicting Wellbeing
Burnette, J. L., Earl, S., Hoyt, C. L., & Pollack, J. M. (2025) · Behavioral Sciences · doi:10.3390/bs15091196 · Cited by 12
Development and rigorous multistep validation of a psychometric tool to measure food noise
Dhurandhar, E. J., Maki, K. C., Dhurandhar, N. V., Kyle, T. K., Yurkow, S., Hawkins, M. A. W., Agley, J. D., Ho, E., Cheskin, L. J., Sørensen, T. I. A., et al. (2025) · Appetite · doi:10.1016/j.appet.2025.108339 · Cited by 13
Visualizing machine learning-based predictions of postpartum depression risk for lay audiences
Desai, P., Harkins, S., Rahman, S., Kumar, S., Hermann, A. D., Joly, R., Zhang, Y., Pathak, J., Kim, J., D’Angelo, D., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad198 · Cited by 11
How do citizens define and value the rule of law? A conjoint experiment in Germany and Poland
Gutmann, J., Kantorowicz, J., & Voigt, S. (2024) · Journal of European Public Policy · doi:10.1080/13501763.2024.2326189 · Cited by 21
Assaker, G. (2024) · Consumer Behavior in Tourism and Hospitality · doi:10.1108/cbth-01-2024-0001 · Cited by 11
Insomnia symptom severity and dynamics of arousal‐related symptoms across the day
Balter, L. J. T., Someren, E. J. W. V., & Axelsson, J. (2024) · Journal of Sleep Research · doi:10.1111/jsr.14276 · Cited by 13
Roster, C. A. (2024) · Sustainability · doi:10.3390/su16156393 · Cited by 11
Appels, M., Edinger‐Schons, L. M., Korschun, D., & Almanzar, A. D. R. (2024) · Business & Society · doi:10.1177/00076503241255691 · Cited by 16
Krispenz, A., & Bertrams, A. (2024) · Current Psychology · doi:10.1007/s12144-024-06575-4 · Cited by 11
Ke, P. F., & Ng, K. C. (2025) · ACM Transactions on Management Information Systems · doi:10.1145/3700597 · Cited by 18
Monson, A., James, R. J. E., Wootton, R. E., & Newall, P. W. S. (2024) · Psychology of Addictive Behaviors · doi:10.1037/adb0001036 · Cited by 17
Understanding users’ trust transfer mechanism in food delivery apps
Mai, X. T., & Nguyen, T. (2024) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-05-2024-0449 · Cited by 15
Enhancing Phishing Defenses: The Impact of Timing and Explanations in Warnings for Email Clients
Greco, F., Desolda, G., Buono, P., & Piccinno, A. (2025) · Computer Standards & Interfaces · doi:10.1016/j.csi.2025.103982 · Cited by 16
Muscularity Concerns and Disordered Eating Symptoms in Adult Women: A Network Analysis
Juergensen, V., Halbeisen, G., Lehe, M. S., & Paslakis, G. (2025) · European Eating Disorders Review · doi:10.1002/erv.3192 · Cited by 16
Lu, X., & Kim, J. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2483788 · Cited by 15
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.