Cited by 412Mobile Crowdsensing and CrowdsourcingSurvey Methodology and NonresponseComputational and Text Analysis Methods

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Crowdsourcing research: Data collection with Amazon’s Mechanical Turk

Sheehan, Kim Bartel·2018·Communication Monographs

DOI 10.1080/03637751.2017.1342043

Open this paper in CoChat — free account

Abstract

Researchers in a variety of disciplines use Amazon’s crowdsourcing platform called Mechanical Turk as a way to collect data from a respondent pool that is much more diverse than a typical student sample. The platform also provides cost efficiencies over other online panel services and data can be collected very quickly. However, some researchers have been slower to try the platform, perhaps because of a lack of awareness of its functions or concerns with validity. This article provides an overview of Mechanical Turk as an academic research platform and a critical examination of its strengths and weaknesses for research. Guidelines for collecting data that address issues of validity, reliability, and ethics are presented.

Integrity signals

Registry

Crossref · 10.1080/03637751.2017.1342043

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
WEIRD languages have misled us, too
Majid, A., & Levinson, S. C. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1000018x · Cited by 4,177
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Introducing the Short Dark Triad (SD3): A Brief Measure of Dark Personality Traits
Jones, D. N., & Paulhus, D. L. (2014) · Assessment · doi:10.1177/1073191113514105 · Cited by 2,162
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739

Show all 46 references

Research works printed but not linked: 2

10.1007/s10683-011-9273-9 · DOI
Howe J., 2006, Wired Magazine, 14, 1

Sorted by citations

Items 201–300 of 412

Augmented Impressions: The role of augmented reality in shaping perceived product value and enhancing purchase intention
Taub, G., Elmalech, A., & Aharony, N. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100726 · Cited by 9
Trolling in social media: A deindividuation and contagion perspective
Hossain, M. A., Quaddus, M., Akter, S., Mikalef, P., & Warren, M. J. (2025) · Information & Management · doi:10.1016/j.im.2025.104211 · Cited by 7
Cognitively Congruent Color Palettes for Mapping Spatial Emotional Data. Matching Colors to Emotions.
Kushkin, A., Giordano, A., Griffin, A. L., & Savelyev, A. (2023) · Cartographic Perspectives · doi:10.14714/cp102.1821 · Cited by 10
A Needs Driven Model of Workplace Social Effectiveness in Adults With Disabilities
Phillips, B. N., Reyes, A., Mainella, A. M. K., Kesselmayer, R. F., & Jacobson, J. D. (2018) · Rehabilitation Counseling Bulletin · doi:10.1177/0034355217747690 · Cited by 8
The ties that mobilize us: Networks, intergroup contact, and participation in the Black Lives Matter movement
Hong, P. M., & Peoples, C. D. (2020) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.12230 · Cited by 8
Factors Contributing to Parents' Psychological and Medical Help Seeking During the COVID-19 Global Pandemic
Tambling, R. R., Russell, B. S., Tomkunas, A. J., Horton, A. L., & Hutchison, M. (2021) · Family & Community Health · doi:10.1097/fch.0000000000000298 · Cited by 8
Opportunities for a More Interdisciplinary Approach to Measuring Perceptions of Fairness in Machine Learning
Boykin, C. M., Dasch, S. T., Rice, V., Lakshminarayanan, V. R., Togun, T. A., & Brown, S. M. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483302 · Cited by 10
Video-Based Communication Assessment of Physician Error Disclosure Skills by Crowdsourced Laypeople and Patient Advocates Who Experienced Medical Harm: Reliability Assessment With Generalizability Theory
White, A. A., King, A., D’Addario, A. E., Brigham, K. B., Dintzis, S. M., Fay, E., Gallagher, T. H., & Mazor, K. M. (2022) · JMIR Medical Education · doi:10.2196/30988 · Cited by 7
INFORMATION SOURCE AND DESTINATION CHOICE: MEDIATION OF PERCEPTION OF COVID-19 PANDEMIC IMPACTS AND PERCEPTION OF DESTINATION
Le, T. M., & Bui, M.-T. (2022) · Verslas teorija ir praktika · doi:10.3846/btp.2022.14852 · Cited by 7
Differential Effects of Functioning on the Career Development of Individuals with Disabilities
Brehmer, C. E., Strauser, D. R., Shen, S., Phillips, B. N., Kosciulek, J. F., & Austin, B. S. (2022) · Rehabilitation Counseling Bulletin · doi:10.1177/00343552221130311 · Cited by 7
An Exploratory Study Examining Obesity Risk in Non-Obese Mothers of Young Children Using a Socioecological Approach
Martin‐Biggers, J. T., Quick, V., Spaccarotella, K., & Byrd‐Bredbenner, C. (2018) · Nutrients · doi:10.3390/nu10060781 · Cited by 8
Unpacking the Quantifying and Qualifying Potential of Semi-Open Job Satisfaction Questions through Computer-Aided Sentiment Analysis
Wijngaards, I., Burger, M., & van Exel, J. N. A. (2020) · Journal of Well-Being Assessment · doi:10.1007/s41543-021-00040-w · Cited by 9
Development and Application of an Interdisciplinary Rapid Message Testing Model for COVID-19 in North Carolina
Bartels, S. M., Combs, K. G., Lazard, A. J., Shelus, V., Davis, C. H., Rothschild, A. W., Drewry, M., Carpenter, K., Newman, E., Goldblatt, A., et al. (2021) · Public Health Reports · doi:10.1177/00333549211018676 · Cited by 7
Emozionalmente: A Crowdsourced Corpus of Simulated Emotional Speech in Italian
Catania, F., Wilke, J. W., & Garzotto, F. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3540662 · Cited by 6
Exploring the effects of location information on perceptions of news credibility and sharing intention
Ma, Y., Sarsenbayeva, Z., Knibbe, J., & Gonçalves, J. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103378 · Cited by 6
Relational partners’ uncertainty management: testing the moderating effect of context in the theory of motivated information management
Kuang, K., & Gettings, P. E. (2020) · Communication Quarterly · doi:10.1080/01463373.2020.1821736 · Cited by 6
The Association between Gender and Physical Activity Was Partially Mediated by Social Network Size during COVID-19
Kuzmik, A., Liu, Y., Cuffee, Y., Kong, L., Sciamanna, C., & Rovniak, L. S. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19052495 · Cited by 6
Attitudes Toward Payment for Research Participation: Results from a U.S. Survey of People Living with HIV
Polonijo, A. N., Dubé, K., Galea, J. T., Greene, K. Y., Taylor, J., Christensen, C. J., & Brown, B. J. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03660-2 · Cited by 6
Going against the grain? Examining the efficacy of media literacy interventions on congenial media effects
Blomberg, M. (2022) · Journal of Media Literacy Education · doi:10.23860/jmle-2022-14-1-4 · Cited by 7
Comparing the Recruitment of Research Participants With Chronic Low Back Pain Using Amazon Mechanical Turk With the Recruitment of Patients From Chiropractic Clinics: A Quasi-Experimental Study
Hilton, L. G., Coulter, I. D., Ryan, G. W., & Hays, R. D. (2021) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2022.02.004 · Cited by 6
Using Rational Choice Theory to Explore Factors Impacting Contact Tracing Application Adoption
Johnson, V., Esfahani, S. M., & Mohit, H. (2023) · Information Systems Management · doi:10.1080/10580530.2023.2196454 · Cited by 6
Meme sharing in relationships: The role of humor styles and functions
Brody, N., & Cullen, S. (2023) · First Monday · doi:10.5210/fm.v28i5.12789 · Cited by 6
Point-to-point suborbital space tourism motivation and willingness to fly
Musselman, B. T., Winter, S. R., Rice, S. C., Keebler, J. R., & Ruskin, K. J. (2024) · Annals of Tourism Research Empirical Insights · doi:10.1016/j.annale.2024.100119 · Cited by 8
Are You Getting Enough to Eat? Addressing Food Insecurity in Rehabilitation Clients
Fleming, A. R., Phillips, B. N., & Hanna, J. L. (2019) · Rehabilitation Counseling Bulletin · doi:10.1177/0034355219886654 · Cited by 6
Social factors shaping the adoption of lead-filtering point-of-use systems: an observational study of an MTurk sample
Chesley, N., Meier, H. C. S., Luo, J., Apchemengich, I., & Davies, W. H. (2020) · Journal of Water and Health · doi:10.2166/wh.2020.053 · Cited by 6
Transitioning to digital first line intervention – validation of a brief online screener for early identification of a suspected eating disorder: study protocol
Bryant, E., Miskovic‐Wheatley, J., Touyz, S. W., Crosby, R. D., Koreshe, E., Cao, L., & Maguire, S. (2020) · Journal of Eating Disorders · doi:10.1186/s40337-020-00339-8 · Cited by 6
How Stakeholders React to Issues with Risk Implications: Extending a Relational Perspective of Issues Management
Zhan, M. M., & Zhao, X. (2021) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.12359 · Cited by 6
Improving Volunteer Engagement in Nonprofit Healthcare Organizations
Hudson, S. K. (2021) · Open Journal of Business and Management · doi:10.4236/ojbm.2021.93074 · Cited by 6
What is That? Crowdsourcing Questions to a Virtual Exhibition
Kiesel, J., Bernhard, V., Gohsen, M., Roth, J., & Stein, B. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505836 · Cited by 6
The Qualia Structure Paradigm: towards a construction of a Qualia Periodic Table for the dissolution of the Hard Problem of ConsciousnessPreprint
Tsuchiya, N. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/492hu · Cited by 13
Navigating the "mode effect": A comparison of online questionnaires and face-to-face interviews
Pérez, F. M. D., Fyall, A., García-González, C. G., Fu, X., & Deel, G. L. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e41742 · Cited by 7
Unraveling the Path from Autism Acceptance to Quality of Life in Autistic Transition-Age Youths: A Parallel Mediation Model
Zhou, K., & Kim, J. (2024) · Autism in Adulthood · doi:10.1089/aut.2023.0186 · Cited by 5
The Science of Social Work: Public Perceptions
LeCroy, C. W., & Kaplan, T. (2021) · Journal of the Society for Social Work and Research · doi:10.1086/712897 · Cited by 5
Evaluating the Impact of Incentives on Clinical Trial Participation: Protocol for a Mixed Methods, Community-Engaged Study
Galea, J. T., Greene, K. Y., Nguyen, B., Polonijo, A. N., Dubé, K., Taylor, J., Christensen, C. J., Zhang, Z., & Brown, B. J. (2021) · JMIR Research Protocols · doi:10.2196/33608 · Cited by 5
Does Convenience Come with a Price? The Impact of Remote Testimony on Perceptions of Expert Credibility
Jones, A. C. T., Batastini, A. B., Patel, M. B., Sacco, D. F., & Warlick, C. A. (2022) · Criminal Justice and Behavior · doi:10.1177/00938548221087177 · Cited by 5
Perceived Partner Confirmation, Depression Management Efforts, and Relationship Functioning in Committed Romantic Relationships
Zhong, L., Wang, Y., & Dailey, R. M. (2022) · Western Journal of Communication · doi:10.1080/10570314.2022.2071457 · Cited by 5
Combining Worker Factors for Heterogeneous Crowd Task Assignment
Wijenayake, S., Hettiachchi, D., & Gonçalves, J. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583190 · Cited by 5
Visual Juxtapositions as Exemplars in Messages Promoting Healthy Dietary Behavior
King, A. J., Niederdeppe, J., & Dahl, E. (2020) · Health Communication · doi:10.1080/10410236.2020.1748835 · Cited by 5
The adult public’s perception of the utility of play therapy.
Hindman, M., Perryman, K. L., & Robinson, S. (2021) · International Journal of Play Therapy · doi:10.1037/pla0000164 · Cited by 4
The effects of variations in confession evidence and need for cognition on jurors’ decisions.
Henderson, K. S., & Levett, L. M. (2020) · Psychology Public Policy and Law · doi:10.1037/law0000233 · Cited by 5
Encouraging Parental Sexual Communication with Teen Sons: A Social Norms Experiment
Pariera, K. L., & Brody, E. (2021) · Health Communication · doi:10.1080/10410236.2021.2010352 · Cited by 5
Political Psychology in the Arab Region
Hawi, D. R., Zeineddine, F. B., Saab, R., Ayanian, A. H., & Harb, C. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108779104.042 · Cited by 5
Transactive Memory and the Job Search: Finding Expertise and Influence in Socio-technical Networks
Piercy, C. W., & Zhu, Y. (2020) · Western Journal of Communication · doi:10.1080/10570314.2020.1761994 · Cited by 5
Development and Validation of the Repetitive Negative Thoughts Questionnaire (RNTQ)Preprint
Stout, Z., Jack, E., Fletcher, S., Sanderson, W. C., & Dam, N. T. V. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3c5z7 · Cited by 7
Antecedents of researchers’ behavioral intentions to use crowdsourcing in science: a multilevel approach
Lenart-Gansiniec, R., Czakon, W., & Meyer, N. (2025) · Review of Managerial Science · doi:10.1007/s11846-024-00797-3 · Cited by 4
Investigating the Effects of Racial Identity on the Relationship Between Black Women’s Endorsement of Eurocentric Beauty Standards and Psychological Health
Williams, T. R., Sanders, S. M., Bass, J. E., Tookes‐Williams, K., Popplewell, R., Hooper, V. S., & Garcia-Aguilera, C. (2025) · Women & Therapy · doi:10.1080/02703149.2025.2515013 · Cited by 5
The effects of age-morphing technology on older adult issue campaigns: The interplay of construal level, perceived probability, and message appeal
Lee, A. R., & Hon, L. C. (2022) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2022-2-7 · Cited by 4
What can we experience and report on a rapidly presented image? Intersubjective measures of specificity of freely reported contents of consciousness
Chuyin, Z., Koh, Z. H., Gallagher, R., Nishimoto, S., & Tsuchiya, N. (2024) · F1000Research · doi:10.12688/f1000research.75364.3 · Cited by 5
Explicating the mechanisms between overwork-related media exposure and workplace resilience: a study of tech employees in China
Ye, J., & Kuang, K. (2025) · Journal of applied communications research · doi:10.1080/00909882.2024.2445130 · Cited by 5
An Exploration of Crowdwork, Machine Learning and Experts for Extracting Information from Data
Kauker, F., Hau, K., & Iannello, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92043-6_51 · Cited by 4
Boys in the Booth: The Impact of Announcer Gender on Audience Demand
Rogers, R. P. (2020) · Journal of Sports Economics · doi:10.1177/1527002520921231 · Cited by 4
Investigating Sport Fan Attitudes toward Tanking: The Role of Values-Based Connections
Aiken, K. D., Sukhdial, A. S., Campbell, R. M., & Kent, A. (2020) · Sport Marketing Quarterly · doi:10.32731/smq.294.122020.02 · Cited by 4
Mobilizing Crowdwork:A Systematic Assessment of the Mobile Usability of HITs
Dutta, S., Linder, R., Lowe, D., Rosenbalm, R., Kuzminykh, A., & Williams, A. C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501876 · Cited by 4
Effects of Practicing With and Obtaining Crowdsourced Feedback From the Video-Based Communication Assessment App on Resident Physicians’ Adverse Event Communication Skills: Pre-post Trial
White, A. A., King, A., D’Addario, A. E., Brigham, K. B., Dintzis, S. M., Fay, E., Gallagher, T. H., & Mazor, K. M. (2022) · JMIR Medical Education · doi:10.2196/40758 · Cited by 4
Face Covered and Six Feet Apart: Behavioral Awareness Predicts Greater Adherence to Public Health Guidelines during the COVID-19 Pandemic
Schneider, A., & Kroska, E. B. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168247 · Cited by 4
The ‘death of innovation’ paradox, R&D and the scientific potential of crowdsourcing
Callaghan, C. W. (2019) · African Journal of Science Technology Innovation and Development · doi:10.1080/20421338.2019.1634899 · Cited by 4
Exploring the role of sexual experiences in on‐again/off‐again dating relationships
Dailey, R. M., Zhang, Z., & Kearns, K. (2020) · Personal Relationships · doi:10.1111/pere.12323 · Cited by 4
Fake Google restaurant reviews and the implications for consumers and restaurantsPreprint
Berry, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4702097 · Cited by 14
Beyond Negative Emotions: The Effects of Positive Emotions and Stealing Thunder on Organizational Outcomes After a Crisis
Ndone, J. (2025) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.70075 · Cited by 3
Uncovering the Cultural Beliefs in a Nascent Entrepreneurial Ecosystem
Marineau, J. E., & Nordstrom, O. A. (2020) · Entrepreneurship Research Journal · doi:10.1515/erj-2019-0358 · Cited by 3
Empirically Evaluating Creative Arc Negotiation for Improvisational Decision-making
Jacob, M., & Magerko, B. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465263 · Cited by 4
Relationship Talk in Cyclical and Non-Cyclical Relationships: Applying the Theory of Motivated Information Management
Dailey, R. M., Zhang, Z., Varga, S., Kearns, K., & Hazzard, J. (2022) · Western Journal of Communication · doi:10.1080/10570314.2022.2100467 · Cited by 3
Development and Initial Assessment of an Emotional Support Provision Training Intervention for Interpersonal Support Providers in the Context of Chronic Illness
Thompson, C. M., Voorhees, H. L., Taniguchi, E., Makos, S., Pool, K., & Babu, S. (2024) · Health Communication · doi:10.1080/10410236.2024.2325183 · Cited by 3
An experimental-causal-chain design to explore three mechanisms linking economic inequality and crime
Itskovich, E., & Factor, R. (2024) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2024.102190 · Cited by 3
Crowdsourcing in Management Research
Lenart-Gansiniec, R. A. (2024) · Routledge eBooks · doi:10.4324/9781003482253 · Cited by 3
The Impact of Home Environment Insecurity on Tourists’ Self-Protective Behavior in the Event of a Terrorist Attack
Li, S.-S., Xu, J., Jiang, Y., Walters, G., & Lehto, X. Y. (2024) · Journal of Travel Research · doi:10.1177/00472875241288852 · Cited by 2
CrowdBA: A Low-Cost Quality-Driven Crowdsourcing Architecture for Bounding Box Annotation Based on Blockchain
Liao, S., Guo, R., & Zhu, J. (2025) · Electronics · doi:10.3390/electronics14020345 · Cited by 3
Impact of dissatisfaction on funders’ decision to reinvest in crowdfunding: A distrust-based perspective
Strohmaier, D., Zeng, J., & Hafeez, M. (2020) · Human Systems Management · doi:10.3233/hsm-190734 · Cited by 3
Dispelling a Myth: Reevaluating the Predictive Validity of Rape Myth Acceptance for Likelihood of Engaging in Sexual Violence
Frazier, A., & Gonzales, J. E. (2021) · Sexual Abuse · doi:10.1177/10790632211026287 · Cited by 4
The Impact of Dementia on the Self: Do We Consider Ourselves the Same as Others?
Harris, S. A., Baird, A., Matthews, S., Kennett, J., Gelding, R. W., & Harris, C. B. (2021) · Neuroethics · doi:10.1007/s12152-021-09472-w · Cited by 3
Functionality‐based life cycle assessment framework: An information and communication technologies (ICT) product case study
Shi, L., Mach, K. J., Suh, S., & Brandt, A. (2022) · Journal of Industrial Ecology · doi:10.1111/jiec.13240 · Cited by 3
Public perceptions of radiofrequency ablation versus standard surgery for benign thyroid nodules
Ding, A. S., Xie, D. X., Zhang, L., Creighton, F. X., & Russell, J. O. (2022) · Surgery · doi:10.1016/j.surg.2022.01.031 · Cited by 3
Mental illness disclosure from confidants’ perspective within romantic relationships: Validation and extension of the disclosure quality model
Taniguchi, E., Voorhees, H. L., & Donovan, E. E. (2022) · Communication Monographs · doi:10.1080/03637751.2022.2125995 · Cited by 3
Perceptions about Court-Appointed and Privately-Retained Attorney Representation: (How) Do They Differ?
Henderson, K. S., & Shteynberg, R. V. (2022) · Criminology Criminal Justice Law & Society · doi:10.54555/ccjls.5382.56908 · Cited by 3
Video-based communication assessment for weight management counseling training in medical residents: a mixed methods study
Faro, J. M., D’Addario, A. E., King, A., Mazor, K. M., Pbert, L. A., Sadasivam, R. S., Geller, A. C., Murphy, E. A., & Ockene, J. K. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03984-6 · Cited by 3
Risky digital behavior or risky digital places? Victimization risk perception and evaluation on the internet
McNealey, R. L., & Ghazi-Tehrani, A. K. (2023) · Journal of Crime and Justice · doi:10.1080/0735648x.2023.2244927 · Cited by 3
C3-PO: A Convolutional Neural Network for COVID Onset Prediction from Cough Sounds
Chen, X., Khan, M. A. R., Hasan, M. R., Gedeon, T., & Hossain, M. Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53311-2_26 · Cited by 3
Development and Validation of the Satisfaction With Labor Market Participation Survey
Phillips, B. N., Fleming, A. R., McDaniels, B. W., & Levine, A. (2021) · Rehabilitation Counseling Bulletin · doi:10.1177/00343552211017215 · Cited by 4
A TWO-LEVEL APPROACH FOR THE CROWD-BASED COLLECTION OF VEHICLES FROM 3D POINT CLOUDS
Walter, V., Kölle, M., Collmar, D., & Zhang, Y. (2021) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-v-4-2021-97-2021 · Cited by 3
ViSDM: A Liquid Democracy based Visual Data Marketplace for Sovereign Crowdsourcing Data Collection
Daliparthi, V. S. S. A., Momen, N., Tutschku, K., & de Prado, M. (2023) · European Interdisciplinary Cybersecurity Conference (EICC) · doi:10.1145/3590777.3590794 · Cited by 3
Characterizing Conflicting User Values for Cyber Authentication Using a Virtual Public Values Forum
Kusumastuti, S. A., Rosoff, H., & John, R. S. (2019) · Decision Analysis · doi:10.1287/deca.2018.0383 · Cited by 3
Use of crowdsourced images for determining 2D:4D and relationship to pro-environmental variables
Pickering, G. J., Anger, N., Baird, J., Dale, G., & Tattersall, G. J. (2022) · acta ethologica · doi:10.1007/s10211-022-00401-5 · Cited by 3
Evaluating fluctuations in homicide: crowdsourcing trends and assessing sentiments of change
Mancik, A. M., Hawk, S. R., Jarvis, J. P., & Regoeczi, W. C. (2020) · Journal of Crime and Justice · doi:10.1080/0735648x.2020.1842790 · Cited by 3
Preferences for perceived attractiveness in modern dance
Lau, R., & Krause, B. L. (2021) · Journal of Cultural Economics · doi:10.1007/s10824-021-09424-5 · Cited by 3
A lurking bias: Representativeness of users across social media and its implications for sampling bias in cognitive sciencePreprint
Vuorio, V., & Horne, Z. (2023) · doi:10.31234/osf.io/n5d9j · Cited by 3
Neutral news from in- and out-party media and attitudes toward them: integration of expectancy violations theory and hostile media perceptions
Ran, W., & Yamamoto, M. (2024) · Communication Studies · doi:10.1080/10510974.2024.2353393 · Cited by 2
Amazon Mechanical Turk: The Human Sciences’ Labor Problem
Wei, J. T. (2024) · Labor Studies in Working-Class History of the Americas · doi:10.1215/15476715-11199970 · Cited by 2
“The more I think about it, the less I like it”: Effects of elaboration, narrative transportation, and freedom threat on the effectiveness of HPV vaccination advocacy messages
Gans, R. (2025) · Risk Analysis · doi:10.1111/risa.17688 · Cited by 3
Doctor–patient relationships are a perceived barrier to chiropractic use by non-Hispanic Black Americans
Wates, R. J., Wilson, J., & Pfefer, M. T. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00936-1 · Cited by 2
Undue Influence or Exploitation — A Qualitative Inquiry into an Ethical Dilemma Around Payment in Crowd Work-Based Research in the U.S.
Xia, H. (2023) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-023-09472-9 · Cited by 2
ViSDM 1.0: Vision Sovereignty Data Marketplace a Decentralized Platform for Crowdsourcing Data Collection and Trading
Daliparthi, V. S. S. A., Momen, N., Tutschku, K., & de Prado, M. (2023) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3582515.3609556 · Cited by 2
Brand innovation, brand relationship, brand commitment, quality of customer interaction, and behavioral intention in hotels
Murphy, K. (2023) · Human Resources Management and Services · doi:10.18282/hrms.v5i1.3355 · Cited by 2
Subjective Stress Appraisals Over Time: the Evolving Structure of the COVID-19 Stressor Scale
Hynes, K. C., Russell, B. S., Tambling, R. R., Park, C. L., & Fendrich, M. (2024) · Prevention Science · doi:10.1007/s11121-024-01694-7 · Cited by 2
A MOBILE CROWDSOURCING SYSTEM FOR FOOTBALL MATCH LIVE VIDEO STREAMING
Iliev, G. (2018) · CBU International Conference Proceedings · doi:10.12955/cbup.v6.1298 · Cited by 2
Development and validation of the Illinois Brief Functioning Inventory
Strauser, D. R., Brehmer, C. E., Rumrill, P. D., Strauser, D., Phillips, B. N., Kosciulek, J. F., & Shen, S. (2022) · Journal of Vocational Rehabilitation · doi:10.3233/jvr-221215 · Cited by 2
Beyond the Pandemic and Privacy Concerns: Perceived Benefit and Expected Use of Pandemic-Tracking Apps in India
Seberger, J. S., & Patil, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555596 · Cited by 2
Do You Know How Humans Sound? Exploring a Qualification Test Design for Crowdsourced Evaluation of Voice Synthesis Quality
Yaegashi, M., Saito, S., Nakano, T., & Ogawa, T. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9979812 · Cited by 2
Understanding the Appropriate and Beneficial Use of Before and After Photos in Breast Surgery: A North American Survey
Datta, S., Valiquette, C. R., & Somogyi, R. B. (2023) · Plastic Surgery · doi:10.1177/22925503221146783 · Cited by 2
Validation of an Operationalized Model of Iso-Ahola’s Theory of Tourism Motivation: A Case in Point-to-Point Suborbital Space Travel
Musselman, B. T., & Winter, S. R. (1990) · The Journal of Aviation/Aerospace Education and Research · doi:10.15394/jaaer.2023.1944 · Cited by 2
Latent Hatred: A Benchmark for Understanding Implicit Hate SpeechPreprint
ElSherief, M., Ziems, C., Muchlinski, D., Anupindi, V., Seybolt, J., Choudhury, M. D., & Yang, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05322 · Cited by 28

Authors: Sheehan, K. B.
Affiliations: University of Oregon (US)
Corresponding author: Sheehan, Kim Bartel
Venue: Communication Monographs
Publisher: Informa UK Limited
Published: 2017-07-04
Volume: 85
Issue: 1
Pages: 140-156
ISSN: 0363-7751 (ISSN-L)
1479-5787
DOI: 10.1080/03637751.2017.1342043
OpenAlex: W2724582867
Cited by: 408
References: 46
Citations by year: 2026: 13 · 2025: 33 · 2024: 39 · 2023: 43 · 2022: 78 · 2021: 73 · 2020: 64 · 2019: 49 · 2018: 12 · 2017: 2
FWCI: 41.62
Type: journal article
Language: en
Open access: closed
Locations: Communication Monographs (publishedVersion)
Topics: Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: Amazon Mechanical Turk, crowdsourcing, online data collection, validity, reliability statistics, research ethics, cost efficiency, online panels

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Crowdsourcing research: Data collection with Amazon’s Mechanical Turk

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks