The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Crowdsourcing research: Data collection with Amazon’s Mechanical Turk
Abstract
Researchers in a variety of disciplines use Amazon’s crowdsourcing platform called Mechanical Turk as a way to collect data from a respondent pool that is much more diverse than a typical student sample. The platform also provides cost efficiencies over other online panel services and data can be collected very quickly. However, some researchers have been slower to try the platform, perhaps because of a lack of awareness of its functions or concerns with validity. This article provides an overview of Mechanical Turk as an academic research platform and a critical examination of its strengths and weaknesses for research. Guidelines for collecting data that address issues of validity, reliability, and ethics are presented.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Respondents were recruited via Amazon Mechanical Turk (MTurk), which has been utilized for many social science studies for sample recruitment, and data quality confirmed in previous studies (e.g., Buhrmester et al., 2011; Sheehan, 2018).”
From Fostering Employee Trust via Effective Supervisory Communication during the COVID-19 Pandemic: Through the Lens of Motivating Language Theory (2022) · cites this paper as Sheehan, 2018
In the citing paper
“Another benefit of using MTurk is that the population is generally more diverse than the typical sample of college students used in social science research [60].”
From Internalized Racism and Mental Health: The Moderating Role of Collective Racial Self-Esteem (2024) · cites this paper as [60]
Citations
Cites
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
WEIRD languages have misled us, too
Majid, A., & Levinson, S. C. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1000018x · Cited by 4,177
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Introducing the Short Dark Triad (SD3): A Brief Measure of Dark Personality Traits
Jones, D. N., & Paulhus, D. L. (2014) · Assessment · doi:10.1177/1073191113514105 · Cited by 2,162
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Research works printed but not linked: 2
- 10.1007/s10683-011-9273-9 · DOI
- Howe J., 2006, Wired Magazine, 14, 1
Cited by
Sorted by citations
Items 101–200 of 412
Plea decision-making: the influence of attorney expertise, trustworthiness, and recommendation
Henderson, K. S., & Shteynberg, R. V. (2019) · Psychology Crime and Law · doi:10.1080/1068316x.2019.1696801 · Cited by 22
Knowledge Brokering in an Era of Communication Visibility
van Zoonen, W., & Sivunen, A. E. (2020) · International Journal of Business Communication · doi:10.1177/2329488420937348 · Cited by 21
Epstein, R., Lee, V., Mohr, R., & Zankich, V. R. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268081 · Cited by 19
Hong, S. J., & Cho, H. (2023) · Digital Health · doi:10.1177/20552076231169836 · Cited by 24
Ko, Y., & Phua, J. (2024) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2023.2288813 · Cited by 21
Siegel, J. T., & Navarro, M. (2019) · Journal of Applied Social Psychology · doi:10.1111/jasp.12580 · Cited by 21
Post-dissolution ambivalence, breakup adjustment, and relationship reconciliation
Dailey, R. M., Zhong, L., Pett, R. C., & Varga, S. (2020) · Journal of Social and Personal Relationships · doi:10.1177/0265407520906014 · Cited by 21
Mental Distress, Label Avoidance, and Use of a Mental Health Chatbot: Results From a US Survey
Kosyluk, K. A., Baeder, T., Greene, K. Y., Tran, J. T., Bolton, C., Loecher, N., DiEva, D., & Galea, J. T. (2024) · JMIR Formative Research · doi:10.2196/45959 · Cited by 22
Impact of photo manipulation and visual literacy on consumers’ responses to persuasive communication
Lazard, A. J., Bock, M., & Mackert, M. S. (2020) · Journal of Visual Literacy · doi:10.1080/1051144x.2020.1737907 · Cited by 19
Kaufmann, W., Ingrams, A. R., & Jacobs, D. (2020) · The American Review of Public Administration · doi:10.1177/0275074020954250 · Cited by 22
Chronemic urgency in everyday digital communication
Kalman, Y. M., Ballard, D. I., & Aguilar, A. M. (2021) · Time & Society · doi:10.1177/0961463x20987721 · Cited by 19
Said, M., Biehl, A., & Stathopoulos, A. (2021) · International Journal of Sustainable Transportation · doi:10.1080/15568318.2021.1885769 · Cited by 19
Anxiety sensitivity prospectively predicts pandemic-related distress
Schmidt, N. B., Morabito, D. M., Mathes, B. M., & Martin, A. D. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.124 · Cited by 19
NORMSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly
Fung, Y. R., Chakrabarty, T., Guo, H., Rambow, O., Muresan, S., & Ji, H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.941 · Cited by 49
Kaufmann, W., Ingrams, A. R., & Jacobs, D. (2020) · International Review of Administrative Sciences · doi:10.1177/0020852320966037 · Cited by 19
Crowdsourcing as a Tool for Research: Methodological, Fair, and Political Considerations
Rea, S. C., Kleeman, H., Zhu, Q., Gilbert, B., & Yue, C. (2020) · Bulletin of Science Technology & Society · doi:10.1177/02704676211003808 · Cited by 19
Stigma Toward Consensual Non-Monogamy: Thematic Analysis and Minority Stress
Mahar, E. A., Irving, L. H., Derovanesian, A., Masterson, A., & Webster, G. D. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221139086 · Cited by 30
NormBank: A Knowledge Bank of Situational Social Norms
Ziems, C., Dwivedi-Yu, J., Wang, Y., Halevy, A. Y., & Yang, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.429 · Cited by 50
Measuring the Service Quality of Artificial Intelligence in the Tourism and Hospitality Industry
Sankar, J. G., & David, A. (2023) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/978-1-6684-6985-9.ch007 · Cited by 18
Hill, E. M., & Nolan, M. T. (2021) · Eating Behaviors · doi:10.1016/j.eatbeh.2021.101480 · Cited by 18
Chon, M., Tam, L., & Kim, J. (2021) · Journal of Communication Management · doi:10.1108/jcom-10-2020-0114 · Cited by 18
Is Regulatory Focus Related to Condom Use, STI/HIV Testing, and Sexual Satisfaction?
Evans-Paulson, R., Widman, L. M., Javidi, H., & Lipsey, N. P. (2021) · The Journal of Sex Research · doi:10.1080/00224499.2021.1961671 · Cited by 17
An Examination of the Psychology of Working Theory With Employed Asian American Women
Choi, N., Kim, Y. H., & Evans, C. A. (2022) · The Counseling Psychologist · doi:10.1177/00110000221116885 · Cited by 19
Kuang, K., Wilson, S. R., Tian, Z., & Buzzanell, P. M. (2022) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2022.09.003 · Cited by 18
Yuan, S., & Yan, Y. (2024) · Journal of Managerial Psychology · doi:10.1108/jmp-03-2023-0154 · Cited by 17
Mazor, K. M., King, A., Hoppe, R. B., Kochersberger, A. O., Jie, Y., & Reim, J. D. (2018) · JMIR Medical Education · doi:10.2196/10400 · Cited by 16
Ndone, J. (2022) · International Journal of Business Communication · doi:10.1177/23294884221106999 · Cited by 15
Seberger, J. S., Choung, H., Snyder, J., & David, P. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637299 · Cited by 17
Beyond lazy; external locus of control as an alternative explanation for the privacy paradox
Whelan, E., Lang, M., & Butler, M. J. (2024) · Internet Research · doi:10.1108/intr-04-2023-0282 · Cited by 18
Pennington, N., & Hall, J. A. (2020) · Communication Monographs · doi:10.1080/03637751.2020.1854476 · Cited by 16
Myrick, J. G., & Chen, J. (2021) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990211008534 · Cited by 16
The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical Turk
Hanrahan, B. V., Chen, A., Ma, J., Ma, N. F., Squicciarini, A., & Savage, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449202 · Cited by 16
Dionisi, A. M., & Barling, J. I. (2019) · Stress and Health · doi:10.1002/smi.2858 · Cited by 18
Hipp, C. J., & Carlson, R. G. (2021) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2021.1922562 · Cited by 15
Gettings, P. E., & Kuang, K. (2022) · Communication Monographs · doi:10.1080/03637751.2021.2025410 · Cited by 14
van der Goot, M. J., Koubayová, N., & van Reijmersdal, E. A. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01818-7 · Cited by 14
Lee, D., Kim, Y., & Lee, J. (2024) · Public Administration · doi:10.1111/padm.12985 · Cited by 14
Creating a prediction model of passenger preference between low cost and legacy airlines
Mehta, R., Rice, S. C., Deaton, J. E., & Winter, S. R. (2019) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2019.100075 · Cited by 14
Exploring Political Discussion Motivations: Relationships with Different Forms of Political Talk
Morey, A. C., & Yamamoto, M. (2019) · Communication Studies · doi:10.1080/10510974.2019.1692885 · Cited by 14
COVID-19 Impact Battery: Development and Validation
Schmidt, N. B., Allan, N. P., Koscinski, B., Mathes, B. M., Eackles, K., Accorso, C., Saulnier, K. G., Allan, D. M., Potter, K., Garey, L., et al. (2021) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-021-09919-7 · Cited by 14
CrowdXR - Pitfalls and Potentials of Experiments with Remote Participants
Zhao, J., Simpson, M., Sajjadi, P., Wallgrün, J. O., Li, P., Bagher, M. M., Oprean, D., Padilla, L., & Klippel, A. (2021) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar52148.2021.00062 · Cited by 14
Piercy, C. W., & Underhill, G. R. (2020) · Mobile Media & Communication · doi:10.1177/2050157920927049 · Cited by 14
Internalized Racism and Mental Health: The Moderating Role of Collective Racial Self-Esteem
Sanders, S., Williams, T., Berry, A., Garcia-Aguilera, C., Robinson, K., Martin, R., & Jones, P. (2024) · Behavioral Sciences · doi:10.3390/bs14111003 · Cited by 14
Singer, J., McLean, E., Kahler, J., & Papa, A. (2021) · Aging & Mental Health · doi:10.1080/13607863.2021.1998359 · Cited by 14
Epstein, R., Aries, S., Grebbien, K., Salcedo, A. M., & Zankich, V. R. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108342 · Cited by 13
Crowdsourced Feedback to Improve Resident Physician Error Disclosure Skills
White, A. A., King, A., D’Addario, A. E., Brigham, K. B., Bradley, J., Gallagher, T. H., & Mazor, K. M. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.25923 · Cited by 13
Gans, R., & Zhan, M. M. (2022) · International Journal of Business Communication · doi:10.1177/23294884221091275 · Cited by 13
Rogers, C. J., Forster, M., & Unger, J. B. (2018) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2018.03.006 · Cited by 13
Kim, Y., & Uysal, N. (2025) · International Journal of Business Communication · doi:10.1177/23294884251349496 · Cited by 16
Text to Speech: Transportation-Imagery Theory and Outcomes of Narrative Delivery Format
Gregg, P. B. (2020) · Journal of Radio & Audio Media · doi:10.1080/19376529.2020.1801689 · Cited by 14
Instinctive Commercial Peace Theorists? Interpreting American Views of the US–China Trade War
Bulman, D. J. (2022) · Business and Politics · doi:10.1017/bap.2022.9 · Cited by 12
Zhang, B., Chen, L., & Moe, A. (2024) · Journal of Health Communication · doi:10.1080/10810730.2024.2385638 · Cited by 12
Howard, M. C. (2018) · Psychological Reports · doi:10.1177/0033294118781319 · Cited by 11
Jeon, Y. A., Koh, H. E., Ahn, J., & Coleman, R. (2019) · Journal of Applied Communication Research · doi:10.1080/00909882.2019.1682181 · Cited by 14
Watson, G. P., & Sinclair, R. R. (2022) · Stress and Health · doi:10.1002/smi.3207 · Cited by 12
Long, T., Cooke, F. L., & Mavondo, F. T. (2025) · The International Journal of Human Resource Management · doi:10.1080/09585192.2025.2458281 · Cited by 11
Ndone, J. (2025) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.70029 · Cited by 14
Kuang, K., & Gettings, P. E. (2020) · Health Communication · doi:10.1080/10410236.2020.1751401 · Cited by 11
Crowdsourcing for Research: Perspectives From a Delphi Panel
Bassi, H., Misener, L., & Johnson, A. M. (2020) · SAGE Open · doi:10.1177/2158244020980751 · Cited by 11
Anthony, K. E., Bagley, B. H., Petrun, E. L., & Bright, C. F. (2021) · Atlantic Journal of Communication · doi:10.1080/15456870.2021.1981329 · Cited by 11
Comedic convergence: Humor responses to verbal irony in text messages
Coolidge, A. A., Montagnolo, C., & Attardo, S. (2023) · Language Sciences · doi:10.1016/j.langsci.2023.101566 · Cited by 11
On-Again, Off-Again Relationships
Dailey, R. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108567756 · Cited by 12
Herman, P. M., Edelen, M. O., Rodriguez, A., Hilton, L. G., & Hays, R. D. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-03696-2 · Cited by 11
Denying and Accepting a Family Member’s Illness: Uncertainty Management as a Process
Thompson, C. M., Romo, L. K., Pulido, M. D., Liao, D., Kriss, L. A., & Babu, S. (2021) · Health Communication · doi:10.1080/10410236.2021.1964713 · Cited by 11
Lock-In Effects in Online Labor MarketsPreprint
Ciotti, F., Hornuf, L., & Stenzhorn, E. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3953015 · Cited by 11
Shin, I., Riforgiate, S. E., Godager, E. A., & Coker, M. C. (2025) · Sustainability · doi:10.3390/su17072830 · Cited by 14
Age Metastereotypes and the Content of Imagined Interage Conversations
Fowler, C., & Gasiorek, J. (2019) · Communication Research · doi:10.1177/0093650219849351 · Cited by 10
Logan, T. (2019) · Violence and Gender · doi:10.1089/vio.2019.0044 · Cited by 10
How Volunteer Commitment Differs in Online and Offline Environments
Ihm, J., & Shumate, M. (2022) · Management Communication Quarterly · doi:10.1177/08933189211073460 · Cited by 9
Generalizability of Effect Sizes Within Aviation Research: More Samples Are Needed
Mehta, R., Rice, S. C., Winter, S. R., Spence, T. B., Edwards, M., & Candelaria-Oquendo, K. (2019) · International Journal of Aviation Aeronautics and Aerospace · doi:10.15394/ijaaa.2019.1404 · Cited by 10
Police surveillance of cell phone location data: Supreme Court versus public opinion
Marshall, E. W., Groscup, J., Brank, E. M., Perez, A., & Hoetger, L. A. (2019) · Behavioral Sciences & the Law · doi:10.1002/bsl.2442 · Cited by 9
Assessing Workplace Culture and Disability Inclusion Climate: A Preliminary Study
Iwanaga, K., Chan, F. H., Ditchman, N., & Tansey, T. N. (2021) · Journal of Applied Rehabilitation Counseling · doi:10.1891/jarc-d-20-00001 · Cited by 11
Sturges, H. A., & Nunez, N. L. (2021) · Psychology Crime and Law · doi:10.1080/1068316x.2021.1900180 · Cited by 10
Awao, S., Park, C. L., Russell, B. S., & Fendrich, M. (2022) · Behavioral Medicine · doi:10.1080/08964289.2022.2069667 · Cited by 9
Communicating Antibiotic Resistance via Linguistic Agency Assignment
Zhang, Z., Jia, M., & McGlone, M. S. (2022) · Health Communication · doi:10.1080/10410236.2022.2147125 · Cited by 9
Self-Compassion, Performance, and Burnout: Surfacing an Unknown Work Construct
George, L., Wallace, J. C., Snider, J. B., & Suh, H. (2023) · Group & Organization Management · doi:10.1177/10596011231161123 · Cited by 13
Research Ethics in the Age of Digital Platforms
Molina, J. L., Tubaro, P., Casilli, A. A., & Ortega, A. S. (2023) · Science and Engineering Ethics · doi:10.1007/s11948-023-00437-1 · Cited by 9
Adamis, A. M., & Olatunji, B. O. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.12.029 · Cited by 12
Sun, Y., Lee, T. K., & Qian, S. (2019) · Journal of Health Communication · doi:10.1080/10810730.2019.1643954 · Cited by 9
The Role of Gender Ideology in Consumers’ Reception of Ads Featuring Stay-at-home Dads
Gangadharbatla, H., & Khedekar, D. (2020) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2020.1781713 · Cited by 12
Gettings, P. E., & McNallie, J. (2021) · Journal of Family Communication · doi:10.1080/15267431.2021.1976183 · Cited by 9
Visuals misleading consumers? Testing the visual superiority effect in advertising
Kim, K., & Kim, H. S. (2022) · Journal of Consumer Marketing · doi:10.1108/jcm-04-2020-3757 · Cited by 11
Xia, H. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.548 · Cited by 9
Chuyin, Z., Koh, Z. H., Gallagher, R., Nishimoto, S., & Tsuchiya, N. (2022) · F1000Research · doi:10.12688/f1000research.75364.1 · Cited by 12
Zhang, N., Russell, B. S., Park, C. L., & Fendrich, M. (2022) · Journal of Social and Personal Relationships · doi:10.1177/02654075221098419 · Cited by 12
U.S. Election 2020: Intentions to Participate in Political Crowdfunding during COVID-19 Pandemic
Baber, H., Kusumarani, R., & Yang, H. (2022) · Administrative Sciences · doi:10.3390/admsci12030077 · Cited by 10
Rogers, J. M., Smith, K. E., Schriefer, D., & Epstein, D. H. (2022) · Substance Abuse Research and Treatment · doi:10.1177/11782218221123977 · Cited by 9
Actual versus perceived infection rates of COVID-19: Impact on distress, behavior and disability
Schmidt, N. B., Martin, A. D., Allan, N. P., Mathes, B. M., Saulnier, K. G., & March, D. S. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.03.061 · Cited by 9
Sanders, S. M., Williams, T. R., Gao, F., Muwele, C., Mitchell, J. M., & Mitchell, T. (2024) · Journal of Black Psychology · doi:10.1177/00957984241309166 · Cited by 12
Revolutionizing food ordering: predicting the dynamics of chatbot adoption in a tech-driven era
Aslam, W., Ham, M., Mirza, F., Ting, D. H., & Hussain, A. (2025) · Journal of Foodservice Business Research · doi:10.1080/15378020.2025.2468035 · Cited by 13
Amazeen, M. A. (2021) · Digital Journalism · doi:10.1080/21670811.2020.1860783 · Cited by 6
Towards a typology development of crowdsourcing in science
Lenart-Gansiniec, R. A. (2022) · Journal of Information Science · doi:10.1177/01655515221118045 · Cited by 8
Gans, R., & Zhan, M. M. (2023) · International Journal of Business Communication · doi:10.1177/23294884231216952 · Cited by 8
Kim, Y., & Lim, H. D. (2024) · Journal of Public Relations Research · doi:10.1080/1062726x.2024.2333549 · Cited by 8
Using crowdsourced analog patients to provide feedback on physician communication skills
Mazor, K. M., King, A., Hoppe, R. B., D’Addario, A. E., Musselman, T. G., Tallia, A. F., & Gallagher, T. H. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.02.047 · Cited by 8
Singer, J., Breen, L. J., & Loggers, E. T. (2022) · Palliative & Supportive Care · doi:10.1017/s1478951522000852 · Cited by 9
Chuyin, Z., Koh, Z. H., Gallagher, R., Nishimoto, S., & Tsuchiya, N. (2022) · F1000Research · doi:10.12688/f1000research.75364.2 · Cited by 8
Zhou, K. (2023) · Rehabilitation Counseling Bulletin · doi:10.1177/00343552231155216 · Cited by 10
Predicting vocational self-efficacy of unemployed adults with disabilities
Fry, H. E., Norwood, A. A., Phillips, B. N., Fleming, A. R., Smith, G., & Lozano, F., III (2020) · Journal of Vocational Rehabilitation · doi:10.3233/jvr-201089 · Cited by 7
Take a break! Leisure participation moderates the workaholism–work stress relationship
Aziz, S., Meier, B., Wuensch, K. L., & Dolbier, C. L. (2023) · The Career Development Quarterly · doi:10.1002/cdq.12336 · Cited by 9
Metadata
- Authors
- Sheehan, K. B.
- Affiliations
- University of Oregon (US)
- Corresponding author
- Sheehan, Kim Bartel
- Venue
- Communication Monographs
- Publisher
- Informa UK Limited
- Published
- 2017-07-04
- Volume
- 85
- Issue
- 1
- Pages
- 140-156
- ISSN
- 0363-7751 (ISSN-L)
- 1479-5787
- OpenAlex
- W2724582867
- Cited by
- 408
- References
- 46
- Citations by year
- 2026: 13 · 2025: 33 · 2024: 39 · 2023: 43 · 2022: 78 · 2021: 73 · 2020: 64 · 2019: 49 · 2018: 12 · 2017: 2
- FWCI
- 41.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communication Monographs (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- Amazon Mechanical Turk, crowdsourcing, online data collection, validity, reliability statistics, research ethics, cost efficiency, online panels
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review