Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our primary concern was the potential compromise in data quality and representativeness often associated with these platforms, as highlighted in recent studies [23,35,68].”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Combined with superior prescreening tools, transparent demographic targeting, and cost-efficiency (Douglas et al., 2023), these strengths make prolific particularly well-suited for research in educational psychology.”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prolific participants show higher attentiveness, longer and more appropriate completion times, fewer signs of disengagement, and greater response consistency (Albert and Smilek, 2023; Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Douglas et al. found that the data quality of samples recruited on Prolific is higher than on other labour markets and student samples, with participants paying more attention to the tasks and providing more meaningful answers [22].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prolific and CloudResearch users consistently outperform Amazon Mechanical Turk (MTurk), Qualtrics, and SONA users on key data quality indicators (Douglas et al., 2023).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Douglas et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“, to account for the fact that we already “used up” all available degrees of freedom for the test of our a priori hypotheses) [43].”
BackgroundAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
(1999) · Medical Entomology and Zoology · Cited by 3,151
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 3×
“[19] observed that MTurk (the platform with the most experienced workers) had worse data quality than Prolific (one of two platforms with less experienced workers) but better data quality than CrowdFlower (the other platform with less experienced workers).”
BackgroundInfluentialData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 3×
“, Cronbach’s alphas and internal validity between scales) [2].”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Research works printed but not linked: 1
- Ternovski J, Orr L. A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description: Digital Media. 2022; 2: 1– 35.
Cited by
Items 701–800 of 1,004
Examining sexual grooming behaviors of children: Variations by relationship to the perpetrator
Jeglic, E. L., Winters, G. M., Johnson, B. N., Steedman, L. A., & Rasol, A. (2026) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2026.108174 · Cited by 2
Common phenomenal and neural substrate geometry in visual motion perception
Robinson, K., Zeleznikow-Johnston, A., Wu, J., Yoshimura, Y., & Tsuchiya, N. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.122313 · Cited by 6
Highlighting Opportunities (Versus Outcomes) Increases Support for Economic Redistribution
Dolifka, D., Christensen, K. L., & Shaddy, F. (2024) · Social Psychological and Personality Science · doi:10.1177/19485506241228469 · Cited by 4
Leon, T., Weidemann, G., Kneebone, I., & Bailey, P. E. (2024) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbae080 · Cited by 2
Schapansky, E., Roets, A., Caluwé, E. D., & Vandeviver, C. (2024) · Journal of Interpersonal Violence · doi:10.1177/08862605241270031 · Cited by 5
Evaluative conditioning of conflict aversiveness and its effects on adaptive control
Ivanchei, I. I., Braem, S., Vermeylen, L., & Notebaert, W. (2024) · Motivation and Emotion · doi:10.1007/s11031-024-10091-0 · Cited by 2
Exploring Saliency Bias in Manipulation Detection
Krinsky, J., Bettis, A., Tang, Q., Moreira, D., & Bharati, A. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10648063 · Cited by 2
Hexed by Pressure: How Action-State Orientation Explains Propensity to Choke in Super Hexagon
Johanson, C., Poeller, S., Klarkowski, M., & Mandryk, R. L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677077 · Cited by 3
Effects of central vs. peripheral attentional-oculomotor exercise on lexical processing
Kress, S., Caron, S., Neudorf, J., Borowsky, B., & Borowsky, R. (2025) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241310440 · Cited by 4
Childhood Adversity Is Not Related to Associative Memory for Emotional Stimuli
Wardell, V., Rho, K., Stewardson, C. I., Hunsche, M. C., Rights, J. D., LeMoult, J., Palombo, D. J., & Kerns, C. M. (2025) · Clinical Psychological Science · doi:10.1177/21677026241306048 · Cited by 2
Information Costs and the Impact of Charitable Giving
Mitchell, G. E., Xu, C., & Li, H. (2025) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/08997640251343049 · Cited by 2
3–6-9 “Threatened-Me” Rule: Testing a New Method to Reduce Unrealistic Comparative Optimism
Kulesza, W. M., Doliński, D., Muniak, P., Izydorczak, K., Kozłowska, P., Mazurkiewicz, W., & Rizulla, A. (2023) · Current Psychology · doi:10.1007/s12144-023-04927-0 · Cited by 3
The social life of digital methods in psychology: Situating digital methods in the new data politics
Yen, J. (2023) · Social and Personality Psychology Compass · doi:10.1111/spc3.12923 · Cited by 2
Tassone, A. U., Breitenfeldt, K. E., DeLucia, E. A., Albright, J., & McDonnell, C. G. (2024) · Autism in Adulthood · doi:10.1089/aut.2023.0119 · Cited by 3
Stirling, N. S. J., & Takarangi, M. K. T. (2024) · Ethics & Behavior · doi:10.1080/10508422.2024.2341639 · Cited by 7
The WOUND-Q Function and Symptoms Scales for Chronic Lower Extremity Wounds: A Validation Study
Simonsen, N. V., Klassen, A. F., Rae, C. S., Mundy, L. R., Poulsen, L., Pusic, A. L., Fan, K. L., & Sørensen, J. A. (2025) · Advances in Wound Care · doi:10.1089/wound.2024.0035 · Cited by 3
Douglas, A. E., Childers, M. G., Felicione, N. J., Milstred, A. R., & Blank, M. D. (2024) · Substance Use & Misuse · doi:10.1080/10826084.2024.2392517 · Cited by 2
Hide and Seek with Finances: Financial Infidelity and Financial Snooping in Relationships
Joseph, M., & Peetz, J. (2024) · Journal of Family and Economic Issues · doi:10.1007/s10834-024-09988-2 · Cited by 6
Schneider, S., Livingston, T. N., Elliott, L., Chrzanowski, L., Abu-Samaha, A., & Singer, J. (2024) · Clinical Gerontologist · doi:10.1080/07317115.2024.2399588 · Cited by 2
Rosenstreich, E., Russo‐Netzer, P., & Icekson, T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0307443 · Cited by 2
Rawal, M., Torres, J. L. S., Bagherzadeh, R., Bhattarai, A., & Zaad, A. (2024) · Journal of Global Scholars of Marketing Science · doi:10.1080/21639159.2024.2397586 · Cited by 2
Tubman, J. G., & Galo, G. E. (2024) · Clinical Social Work Journal · doi:10.1007/s10615-024-00967-6 · Cited by 2
The superstar effect on perceived performance in professional football: An online experiment
Pan, Y., Pereira, M. H., Gómez‐González, C., & Dietl, H. (2024) · Journal of Economic Psychology · doi:10.1016/j.joep.2024.102776 · Cited by 5
The effect of stretch goals and moral justification on counterproductive work behavior
Ferdiansah, M. I., Chong, V. K., Wang, I. Z., & Woodliff, D. (2025) · Journal of Accounting & Organizational Change · doi:10.1108/jaoc-06-2024-0196 · Cited by 2
Vargas, R., & Verstynen, T. (2025) · Communications Psychology · doi:10.1038/s44271-025-00186-w · Cited by 3
McCord, M. A. (2025) · Occupational Health Science · doi:10.1007/s41542-024-00218-7 · Cited by 2
Hsu, K. J., Morandini, J. S., & Rudd, S. (2025) · Archives of Sexual Behavior · doi:10.1007/s10508-024-03053-7 · Cited by 2
Floyd, K., Ray, C. D., & Hesse, C. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2465760 · Cited by 2
The missing link: Theory in social psychology as key contribution to transdisciplinary research
Ellemers, N. (2025) · European Review of Social Psychology · doi:10.1080/10463283.2025.2489867 · Cited by 3
Chai, S., Chang, Y., & Li, Y. (2025) · Psychology and Marketing · doi:10.1002/mar.22220 · Cited by 2
Studying short-term rental platform perceptions and use through a digital inequality lens
Dinan, M. M., & Lutz, C. (2025) · Frontiers in Sustainable Tourism · doi:10.3389/frsut.2025.1561748 · Cited by 2
Psychological distress, coping styles, and suicidal ideation in sexual minority college students
Rose, L. E., Meidinger-Behrens, E. K., Kirrene, K. J., Florence, E. R., & Sanders, S. M. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101520 · Cited by 3
Developing a Measure of Trust in Recycled Water
Hoang, U., Holt, J. R., Mahmoud‐Elhaj, D., Muhammad, A., Tanner, B., & Feltz, A. (2025) · Water and Environment Journal · doi:10.1111/wej.12987 · Cited by 2
When Love and Money Collide: The Role of Financially Focused Self‐Concept in Relationships
Peetz, J., Wohl, M. J. A., & Tabri, N. (2025) · Personal Relationships · doi:10.1111/pere.70032 · Cited by 2
Bodenschatz, A., & Uhl, M. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00999-x · Cited by 2
Bodien, Y. G., Borsi, L., Pier, E., Kanny, S., Droscha, L., Choi, W. J. W., Filoramo, R., Burnetta, D., McColgan, K., Patel, B. B., et al. (2026) · Critical Care Medicine · doi:10.1097/ccm.0000000000007017 · Cited by 3
Ju, I., & Song, H. (2026) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2025.2612353 · Cited by 2
The Joint Effect of Pay Range Disclosure Width and Gender on Job Applications
Bernard, D., Croom, J., & Yang, B. (2026) · Accounting Horizons · doi:10.2308/horizons-2025-142 · Cited by 3
Bertrams, A., & Krispenz, A. (2026) · Archives of Sexual Behavior · doi:10.1007/s10508-025-03371-4 · Cited by 2
Visual Privacy: The Impact of Privacy Labels on Privacy Behaviors Online
García, K., Tamò‐Larrieux, A., Meier, Y., Mayer, S., Lutz, C., Guitton, C., Stern, L., Rot, R., Pilz, S., & Mulders, S. (2026) · ACM Transactions on Social Computing · doi:10.1145/3804460 · Cited by 3
Seeing Through Different Lenses: Partisanship and Updating of Inflation ExpectationsPreprint
Huseynov, S., & Murad, Z. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4773415 · Cited by 4
Williams, C. C., Owen, L. L. W., Gunsilius, C. Z., Nassar, M. R., & Petzschner, F. H. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.09.663993 · Cited by 3
Comparing the effectiveness of animated videos and talking‐head videos in science communication
Marx, C. L., & König, L. M. (2025) · British Journal of Health Psychology · doi:10.1111/bjhp.12786 · Cited by 1
“Indeed, prior research suggests that typical samples recruited from various subject pools differ e.g. in belief in conspiracy theories (Douglas et al., 2023); however, we are unable to compare our sample, or the platform we used, to this data.”
Can’t get no (life) satisfaction: narrative engagement, boundary expansion, and well-being
McLaughlin, B., Moya, J. D., Rodriguez, N. S., Hunter, J., & White, G. (2023) · Communication Research Reports · doi:10.1080/08824096.2023.2209713 · Cited by 1
Stevenson, M. C., Ravipati, V. M., & Schaefer, C. T. (2024) · Child Maltreatment · doi:10.1177/10775595241240755 · Cited by 1
Cole, J., & Logan, T. (2024) · Journal of Drug Issues · doi:10.1177/00220426241252336 · Cited by 1
Wolff, S. M., Wright, D. B., & Hatcher, W. J. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1360848 · Cited by 4
Gender Stereotypes and Candidate Qualifications in Judicial Elections
Kennedy, M., Nelson, M. J., & Heidt-Forsythe, E. (2024) · Political Research Quarterly · doi:10.1177/10659129241275458 · Cited by 1
The Comprehensive Adversity Measure (CAM): A measure of early adversity and its severity
Schlechter, P., Lutz, N. M., Morina, N., Grant, J. E., Löchner, C., Chamberlain, S. R., Wilkinson, P. O., & Fritz, J. (2024) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2024.107117 · Cited by 1
Leguesse, Y., Vella, M., Colombo, C., & Hernandez-Castro, J. C. (2024) · European Symposium on Usable Security (EuroUSEC) · doi:10.1145/3688459.3688470 · Cited by 1
Becker, A. B. (2024) · Communication Quarterly · doi:10.1080/01463373.2024.2432379 · Cited by 1
Is support for authoritarian rule contagious? Evidence from field and survey experiments
Dahlum, S., Hanson, T., Johnsen, Å. A., Kotsadam, A., & Wuttke, A. (2026) · American Journal of Political Science · doi:10.1111/ajps.70067 · Cited by 2
The Silent Divide: Leader-Member Exchange, Communication Anxiety, and Age-Related Defensive Silence
Greer, R. J., & Talbert, N. (2024) · Business and Professional Communication Quarterly · doi:10.1177/23294906241301354 · Cited by 1
Layson, H. M., Jahan, N., & Mell, J. (2024) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3652988.3673947 · Cited by 1
Osuna, J. J. O., Martín-Fernández, M., Barrada, J. R., Moyano, M., & Clari, E. (2025) · Political Studies · doi:10.1177/00323217241309962 · Cited by 1
Howard, M. C. (2025) · Public Health · doi:10.1016/j.puhe.2025.01.012 · Cited by 1
Perez‐Albela, A., Hanna, J., Daniels, A. H., & Basques, B. A. (2025) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2025.100588 · Cited by 3
Entrepreneurial adaptability in times of uncertainty: the impact of passion and sleep quality
Rice, E. F., Oo, P. P., & Casper, W. J. (2024) · Small Enterprise Research · doi:10.1080/13215906.2025.2463650 · Cited by 1
Varma, A., Masullo, G., Limov, B., Graham, E., Kim, M. S., & Malik, K. K. (2025) · News Research Journal · doi:10.1177/30497841251317293 · Cited by 1
Benau, E. M., Jung, S., Vaughan, C. R., & Cooper, M. A. (2025) · Social Cognition · doi:10.1521/soco.2025.43.1.17 · Cited by 1
Epistemic beliefs predict evaluation and critical reading when learning from multiple texts
Du, H., & List, A. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102370 · Cited by 1
Grok Hackspeak? Communicating Cybersecurity With Figurative Language
Marsen, S., & Biddle, R. (2025) · International Journal of Business Communication · doi:10.1177/23294884251329160 · Cited by 1
Distributing a survey using Every Door Direct Mail in an ideal use case
White, J., & Bessette, D. (2025) · Methodological Innovations · doi:10.1177/20597991251329754 · Cited by 1
Provision of brand information and critical reasoning predict advertising literacy
Yao, E. Z., & List, A. (2025) · Journal of Media Literacy Education · doi:10.23860/jmle-2025-17-1-2 · Cited by 3
Fleming, A. M., Montgomery, M. D., & Rogol, N. C. (2025) · Social Science Quarterly · doi:10.1111/ssqu.70027 · Cited by 1
What norming reveals about idioms: Making the case for a presuppositional account
Griffen, N., & Noveck, I. A. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01719-8 · Cited by 1
Moral preferences in ultimatum and impunity games
Capraro, V., & Rodríguez-Lara, I. (2025) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2025.102371 · Cited by 3
The limits of Brexit prejudice
Phillips, J. B., & Stoeckel, F. (2025) · Political Psychology · doi:10.1111/pops.70037 · Cited by 1
Increasing Parental Acceptance of Trans Youth Through Narrative Persuasion
Pariera, K. L., Mergens, M., Oyola, I., & Pham, B. (2025) · Communication Reports · doi:10.1080/08934215.2025.2504875 · Cited by 1
Schwarz, A. L., Melamed, T. C., Bowers, J., Perez, C. T., & Abdi, H. (2025) · Speech Language and Hearing · doi:10.1080/2050571x.2025.2501774 · Cited by 1
Klassen, A. F., Rae, C. S., Gallo, L., Cano, S., Kaur, M. N., Dayan, S. H., Armstrong, K., Poulsen, L., Tsangaris, E., Santosa, K. B., et al. (2025) · Aesthetic Surgery Journal · doi:10.1093/asj/sjaf075 · Cited by 1
Lim, C., Ratan, R., Pandita, S., Foxman, M., Hales, G. E., Liu, H., Lei, Y. S., & Beyea, D. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/8808655 · Cited by 1
Kim, J. K., Xiong, Y., & Hunt, D. S. (2025) · Corporate Communications An International Journal · doi:10.1108/ccij-11-2024-0204 · Cited by 2
Song, H., & Oh, J. (2025) · Communication Studies · doi:10.1080/10510974.2025.2515032 · Cited by 1
A short, animated storytelling video to reduce addiction stigma: A pilot randomized controlled trial
Klapow, M. C., Seeff, M., Adam, M., Greuel, M., Hoffman, D., Rogge, J. R., Gordon, A., Bärnighausen, T., & Amsalem, D. (2025) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2025.100622 · Cited by 4
Sexual Identity-Related Shame as a Barrier to Mpox Prevention Among Gay and Bisexual Men
Lake, S., Zhao, X., & Ma, R. (2025) · Health Communication · doi:10.1080/10410236.2025.2524434 · Cited by 1
Jia, R., Sudina, E., & Du, K. (2025) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2025.100235 · Cited by 2
Babatunde, S. O., Dust, S. B., & Fagan, B. (2025) · Journal of Management & Organization · doi:10.1017/jmo.2025.10021 · Cited by 1
Riedel, A. S., Mulcahy, R. F., Beatson, A., & Keating, B. W. (2025) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2025.102957 · Cited by 2
Emotion Regulation in Daily Life Among Adults With Suicidal Thoughts
Millgram, Y., Coppersmith, D. D. L., Sheppes, G., Fortgang, R. G., Goldenberg, A., & Nock, M. K. (2025) · Clinical Psychological Science · doi:10.1177/21677026251349809 · Cited by 3
Kobayashi, T., & Madrid‐Morales, D. (2025) · Japanese Psychological Research · doi:10.1111/jpr.12599 · Cited by 1
Yirdong, F., Benau, E. M., Segura, P., & Polanco-Roman, L. A. (2025) · Crisis · doi:10.1027/0227-5910/a001020 · Cited by 1
Harney, J. (2025) · Corrections · doi:10.1080/23774657.2025.2542952 · Cited by 1
God’s country: perceptions of religious and place-based candidate identities
Allen, L. G., & Kirk, J. R. G. (2025) · NPL report DEM-TQD · doi:10.1017/s175504832510014x · Cited by 1
Decius, J., Knappstein, M., & Seifert, A. (2025) · Frontiers in Organizational Psychology · doi:10.3389/forgp.2025.1580957 · Cited by 3
Hardy, A. R., & Lamont, J. M. (2025) · Psychology Health & Medicine · doi:10.1080/13548506.2025.2546588 · Cited by 1
Furman, C. R., Standen, E. C., Diem, S. J., & Rothman, A. J. (2025) · Psychology and Health · doi:10.1080/08870446.2025.2552228 · Cited by 1
Childress, C. (2025) · Poetics · doi:10.1016/j.poetic.2025.102043 · Cited by 1
Lo, T. T., van Weerdenburg, M., Williams, J. M., Jen, E., Hoogeveen, L., Chan, S. W. Y., Sin, K. F., & Cheung, H. N. (2025) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe15090178 · Cited by 1
Neuner, F. G. (2025) · Journal of Experimental Political Science · doi:10.1017/xps.2025.10018 · Cited by 1
Kühlwein, F., Merk, S., Schneider, J. M., & Schmidt, K. A. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102179 · Cited by 3
Evaluating and applying the Multidimensional Fatalism Scale for aging and well-being research
Toyama, M., & Hooper, C. (2025) · The Gerontologist · doi:10.1093/geront/gnaf203 · Cited by 1
Assessing Racial Disparities in Crowdfunding Donations Through an Experimental Survey
Whitehead, E. M., Lopez, B., & Langham, N. (2025) · Social Currents · doi:10.1177/23294965251374636 · Cited by 1
Caillier, J. G. (2025) · International Public Management Journal · doi:10.1080/10967494.2025.2557875 · Cited by 1
A Beta Mixture Model for Careless Respondent Detection in Visual Analogue Scale Data
Zhang, L., Domingue, B. W., Vogelsmeier, L. V. D. E., & Ulitzsch, E. (2025) · Psychometrika · doi:10.1017/psy.2025.10041 · Cited by 2
Social Media Posts to Encourage In-Person Connections: Online Experiment With Young Adults
Lazard, A. J., Queen, T. L., Avendaño-Galdamez, M. I., Varma, T., Zhou, J., Berman, C. J., West, T. N., Firestine, A. M., Dasgupta, N., & Fredrickson, B. L. (2025) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2025.08.016 · Cited by 1
Consumer preferences for leftover packaging in food waste utilization
Bozgeyik, Y., Arslan, İ., Metin, T., & Muvakit, S. (2025) · Discover Sustainability · doi:10.1007/s43621-025-01863-w · Cited by 1
Kogan, L. R., & Williamson, L. E. (2025) · Human-Animal Interactions · doi:10.1079/hai.2025.0041 · Cited by 1
Lee, J., & Cho, M.-J. (2025) · New Media & Society · doi:10.1177/14614448251377994 · Cited by 6
Banning of cockfighting in Puerto Rico: assessing public support and opposition
Whitley, C. T., Bowers, M. M., & Kohl, Ú. A. (2025) · Social Problems · doi:10.1093/socpro/spaf064 · Cited by 1
Metadata
- Authors
- Douglas, B. D., Ewell, P. J., & Brauer, M.
- Affiliations
- University of Wisconsin–Madison (US)
- Kenyon College (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-14
- Volume
- 18
- Issue
- 3
- Pages
- e0279720
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10013894
- OpenAlex
- W4324129606
- Cited by
- 1,532
- References
- 44
- Citations by year
- 2026: 558 · 2025: 571 · 2024: 329 · 2023: 69
- FWCI
- 347.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- BRITE Lab Grant: Behavioral Research Insights Through Experiments Lab, <https://brite.wisc.edu/>
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- online data collection, data quality, crowdsourcing platforms, Amazon Mechanical Turk, Prolific, Qualtrics, Sona, attention checks, bot detection, online surveys
- MeSH terms
- Data Accuracy, Humans, Surveys and Questionnaires, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.