Cited by 1,072Mobile Crowdsensing and CrowdsourcingSurvey Methodology and NonresponseEthics in Clinical Research

The DOI matches its Crossref record; 174 of the 177 references it cites were found in a registry or an index.

Conducting Clinical Research Using Crowdsourced Convenience Samples

Chandler, Jesse, Shapiro, Danielle·2016·Annual Review of Clinical Psychology

DOI 10.1146/annurev-clinpsy-021815-093623

Open this paper in CoChat — free account

Abstract

Crowdsourcing has had a dramatic impact on the speed and scale at which scientific research can be conducted. Clinical scientists have particularly benefited from readily available research study participants and streamlined recruiting and payment systems afforded by Amazon Mechanical Turk (MTurk), a popular labor market for crowdsourcing workers. MTurk has been used in this capacity for more than five years. The popularity and novelty of the platform have spurred numerous methodological investigations, making it the most studied nonprobability sample available to researchers. This article summarizes what is known about MTurk sample composition and data quality with an emphasis on findings relevant to clinical psychological research. It then addresses methodological issues with using MTurk--many of which are common to other nonprobability samples but unfamiliar to clinical science researchers--and suggests concrete steps to avoid these issues or minimize their impact.

Integrity signals

Registry

Crossref · 10.1146/annurev-clinpsy-021815-093623

Cites

174 of 174 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Self-citation
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Self-citation
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Ed, H., & Suh, B. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,941

Show all 177 references

Research works printed but not linked: 12

Barnhoorn JS, 2014, Behav. Res. Methods, 530, 1
Beramendi P, Duch RM, Matsuo A. 2014. When lab subjects meet real people: comparing different modes of experiments. Presented at Asian Polit. Methodol. Conf., Taipai
Casey L, Chandler J, Levine AS, Proctor A, Strolovitch D. 2015. Demographic characteristics of a large sample of US workers. Mathematica Policy Res. Rep. In press
Downes-Le Guin T, 2006, ESOMAR World Res. Conf. Panel Res.
Higgins C, 2010, Proc. NAACL HLT 2010 Workshop on Creat. Speech and Language Data with Amazon's Mechanical Turk, Los Angeles, 89
10.1007/s10683-011-9273-9 · DOI
10.1145/2676431.2676437 · DOI
Lang ASID, 2011, Code4Lib J., 15, 1
Lebreton P, 2015, Proc. SPIE Conf. Hum. Vis. Electron. Imaging, 20th, San Francisco
10.1026//1618-3169.49.4.243 · DOI
Shao W, 2015, Digit. Cult. Educ., 7
Suri S, 2011, AAAI Workshops, 25th, San Francisco, 61

Sorted by citations

Items 901–1,000 of 1,001

How recent psychological distress relates to session quality in psychotherapy: The mediating roles of the real relationship and working alliance
Stefana, A. (2026) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.70049 · Cited by 1
Deciphering the Data: Health Numeracy and Its Impact on Decision-Making in Breast Augmentation
Mehdizadeh, M., Lee, D., Knerr, R. M., Escobar‐Domingo, M. J., Foppiani, J., Fanning, J. E., Miller, A. S., & Lee, B. T. (2026) · Aesthetic Plastic Surgery · doi:10.1007/s00266-026-05735-0 · Cited by 2
A missed opportunity to examine reliability in computational psychiatry
Brown, V. M. (2026) · Nature Mental Health · doi:10.1038/s44220-026-00662-0 · Cited by 1
Pseudo-slimy: A novel phenomenon to evoke stickiness perception
Kawabe, T., Morisaki, T., & Ujitoko, Y. (2026) · i-Perception · doi:10.1177/20416695261458511 · Cited by 1
The Role of Metacognitive Beliefs and the Cognitive Attentional Syndrome in the Development of Anxiety: A Cross-lagged Panel Design
Gorday, J. Y., & Bardeen, J. R. (2026) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-026-10309-0 · Cited by 1
Strategies for measuring peer alcohol use within egocentric network analysis
Russell, A. M., Barry, A. E., & Patterson, M. S. (2021) · Journal of American College Health · doi:10.1080/07448481.2021.1965144 · Cited by 1
The relationship between electronic health literacy and individual factors among adults with chronic pain: A cross-sectional study
Martorella, G., Park, H. J., & Schluck, G. (2022) · International Health Trends and Perspectives · doi:10.32920/ihtp.v2i3.1671 · Cited by 1
Framing Effects of Cognitive Behavioural Therapy for Depression on Perceptions of Believability, Acceptability, and Credibility
Salimuddin, S., Beshai, S., Iskric, A., & Watson, L. M. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20146330 · Cited by 1
Perceptions of parenthood and child development among parents who experienced child maltreatment
Wamser‐Nanney, R. A., & Sager, J. C. (2023) · Journal of Traumatic Stress · doi:10.1002/jts.22993 · Cited by 1
Participant multitasking in online studies
Brigden, N. (2024) · Marketing Letters · doi:10.1007/s11002-024-09718-6 · Cited by 1
What looks dangerous? Reliability of anxiety and harm ratings of animal and tool visual stimuli
Seow, T. X. F., & Hauser, T. U. (2024) · Wellcome Open Research · doi:10.12688/wellcomeopenres.20693.1 · Cited by 1
A sexual empowerment process predicting heterosexual women’s sexual pleasure
Grose, R. G. (2024) · Psychology and Sexuality · doi:10.1080/19419899.2024.2331496 · Cited by 1
Improving data quality in online parenting research
Kaylor‐Tapscott, M. L., Tolliver‐Lynn, M. N., & Sullivan, M. A. (2024) · Infant and Child Development · doi:10.1002/icd.2525 · Cited by 1
Orthopaedic Surgery and Indusry: What our Potential Patients Believe
Parikh, H. B., Ewing, B., Tseng, C. C., Yoshida, R., Kulber, D. A., & Kuschner, S. H. (2024) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-24-00164 · Cited by 1
Development and Validation of the Perceived Interpersonal Relevancy Scales: A New Measure of Perceived Threat, Opportunity, and Invisibility Appraisals for Use Across the Adult Life Course
Brady, B., Zheng, L., Eramudugolla, R., & Anstey, K. J. (2024) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbae162 · Cited by 1
Rural Patients’ Perceived Importance of Racial and Ethnic Concordance With Providers and Receipt of Annual Routine Visits
Johannes, B. L., Mainous, A. G., Prochnow, T. M., Chen, X., Ortiz, S. E., & Smith, M. L. (2025) · Journal of Patient Experience · doi:10.1177/23743735251341732 · Cited by 1
Social Anxiety and Emotion Regulation in the Everyday Life of Adolescents
Tsarpalis-Fragkoulidis, A., Kolar, D. R., Schneckenreiter, C., & Zemp, M. (2025) · Kindheit und Entwicklung · doi:10.1026/0942-5403/a000492 · Cited by 1
Examining the Utility of Behavioral Economic Demand in Addiction Science
Strickland, J. C. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.030 · Cited by 1
Analyzing the boundaries of balance theory in evaluating cause-related marketing compatibility
Yun, J. T. (2018) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Retirement Planning Versus Family Support
Svynarenko, R. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.271 · Cited by 1
Approaches from cognitive neuroscience and comparative cognition
Koushik, C. S. N., Choubey, S. B., & Choubey, A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819445-4.00001-1 · Cited by 1
Therapist and client attitudes toward client independent review of psychotherapy sessions
King, B. R., & Boswell, J. F. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23122 · Cited by 1
How Much is Enough? Public Perception of Minimum Surgeon Volumes
Danford, J., Wong, S. L., Sirovich, B., Underbakke, D. L., & Sorensen, M. J. (2021) · World Journal of Surgery · doi:10.1007/s00268-021-06015-5 · Cited by 1
Relations Between Interpersonal Hopelessness and Help-Seeking Intentions and Behaviors in Suicidal Individuals
Peros, O. M., & Ward‐Ciesielski, E. F. (2021) · Crisis · doi:10.1027/0227-5910/a000815 · Cited by 1
Electronic health literacy among adults with chronic pain: A descriptive, cross-sectional survey
Park, H., Martorella, G., & Schluck, G. (2021) · International Health Trends and Perspectives · doi:10.32920/ihtp.v1i3.1469 · Cited by 1
Misconceptions, Myths, and Mystery: A Cross-sectional Survey Study on Public Knowledge and Values of Microsurgery
Bustos, V. P., Xun, H., McLarney, J., Haddad, A. G., Hyland, C. J., Nassar, A. H., Lin, S. J., & Lee, B. T. (2022) · Journal of Reconstructive Microsurgery · doi:10.1055/a-1896-5598 · Cited by 1
Non-suicidal self-injury as a predictor of stress-related social network use
Corcoran, V. P., & Andover, M. S. (2022) · Behaviour and Information Technology · doi:10.1080/0144929x.2022.2097125 · Cited by 1
Psychological flexibility prospectively predicts COVID-19 PPE use across a two-month interval
O’Brien, W. H., Wang, S., Varga, A. V., Lim, C. X., Xu, H., Jarukasemthawee, S., Pisitsungkagarn, K., Suvanbenjakule, P., & Braden, A. L. (2023) · Psychology Health & Medicine · doi:10.1080/13548506.2022.2162936 · Cited by 1
Securing Donor Support on Nonprofit Commercialization: The Effects of Thematic and Episodic Message Framing
Lee, C. (2023) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-023-00611-w · Cited by 1
Mindfulness Processes that Mitigate COVID-Related Stressors in Caregivers in the United States
Wen, N. J., Lo, S. L., & Miller, A. L. (2023) · Journal of Child and Family Studies · doi:10.1007/s10826-023-02681-2 · Cited by 1
Social Media Crowdsourcing in Health Care Research
Seidenwurm, D. J. (2018) · Medical Care · doi:10.1097/mlr.0000000000000879 · Cited by 1
Understanding and improving subjective measures in human-computer interaction
Brühlmann, F. (2019) · edoc (University of Basel) · doi:10.5451/unibas-007078326 · Cited by 1
Developing an Automation Locus of Control Scale
Edwards, M. (2019) · Cited by 1
The influence of anthropomorphic spokescharacters on consumers' recycling intentions
Jain, R. (2021) · Queensland University of Technology · doi:10.5204/thesis.eprints.208973 · Cited by 1
Breaking Down or Breaking Through: The Role of Appraisals in the Challenge-Hindrance Stressors’ Effect on Work Engagement and Performance
Hajj, R. A. (2020) · Spectrum Research Repository (Concordia University) · Cited by 1
Examining the Efficacy of an Online Program to Cultivate Mindfulness and Self-Compassion Skills (Mind-OP): Randomized Controlled Trial on Amazon’s Mechanical TurkPreprint
Beshai, S. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/967hq · Cited by 1
Counting polyamorists who count: Prevalence and definitions of an under-researched form of consensual nonmonogamyPreprint
Burleigh, T. J., & Rubel, A. N. (2018) · doi:10.31234/osf.io/st2k5 · Cited by 1
Social Threat Indirectly Increases Moral Condemnation via Thwarting Fundamental Social NeedsPreprint
Henderson, R. K., & Schnall, S. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rjzys · Cited by 1
Fearless Dominance/Boldness is not strongly related to externalizing behaviors: An item response-based analysisPreprint
Crowe, M. L., Weiss, B., Sleep, C. E., Harris, A. M., CARTER, N. T., Lynam, D. R., & Miller, J. (2020) · doi:10.31219/osf.io/akybh · Cited by 1
Direct replications in the era of open samplingPreprint
Paolacci, G., & Chandler, J. (2018) · doi:10.31234/osf.io/najwk · Cited by 1
Self-citation
Biased and Inflexible Interpretations of Ambiguous Social Situations: Associations with Restrictive Eating Behavior and Socioemotional FunctioningPreprint
Bronstein, M. V., Everaert, J., Kummerfeld, E., Haynos, A. F., & Vinogradov, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936928 · Cited by 1
Maladaptive Variants of Adaptive Traits and Bloated Specific FactorsPreprint
Oltmanns, J. R., & Widiger, T. A. (2018) · doi:10.31234/osf.io/fn2pv · Cited by 1
How regulatory focus-mode fit impacts variety-seeking
Pham, T. M. T. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.230505 · Cited by 1
Eating pathology in sexual minority men : evaluating an objectification theory framework and the role of identity acceptance concerns
Donahue, J. M. (2017) · doi:10.54014/4hvt-0yct · Cited by 1
From Media Advocacy to Health Behaviors: Examining the Relationships between Mass Media Messages, Public Opinion, and Point-of-Sale Tobacco Control Policy Implementation in the United States
Myers, A. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/mthq-pa38
The relationship between sense of virtual community and work/family conflict among working parents
VanDerzee, S. A. (2017) · doi:10.17760/d20258307
Episodic Salutary Experiences (ESE): A New Type of Positive Affect and its Relationship to Physical Health
Nusinow, N. (2017) · Digital Commons @ Butler University (Butler University)
The impact of explicit culturally transmitted frames on economic decision makingPreprint
Lightner, A. D., & Hagen, E. H. (2017) · OSF Preprints (OSF Preprints)
From perceptions to hostilities : An experimental study of realistic and symbolic threats
Woonink, A. (2018) · Uppsala University Publications (Uppsala University)
Direct replications in the era of open sampling
Paolacci, G., & Chandler, J. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000808
Self-citation
Bipolarity and the Five Factor Model of Personality Disorder
Crego, C. (2018) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2018.335
Competition, Status, and Markets
Ajit, T. C., & Ferrier, W. J. (2019) · Academy of Management Proceedings · doi:10.5465/ambpp.2019.15208abstract
Adults’ Perceptions of Children with Mental Illness Labels Who Tell Truths and Lies
McCurdy, J. L. (2018) · CUNY Academic Works (City University of New York)
Lost In The Crowd
Behrend, T. S., & Ravid, D. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108649636.029
Treatment Preference, Changes in Preference, and Quality of Life
Sage-Germain, C. (2018) · ScholarWorks - WMU (Western Michigan University)
Framing climate change as national security: a survey-experiment on climate change perceptions.
Lyons, A. (2018) · doi:10.18297/etd/3086
Cognitive Complexity in Sexual Minority Individuals: The Effect of Positive Identity Factors, Age, Ethnicity, and Education Level on Cognitive Complexity
Schneider, B. W. (2018) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)
THE COST-EFFFECTIVENESS OF IMPROVED COMMUNICATION OF PREGNANCY RISK AND CONTRACEPTIVE INFORMATION
Anderson, S. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/v3aq-8x45
Racial Ideology and Psychosocial Implications among African Americans: Integrating Variable-Centered and Person-Centered Approaches
Ajayi, A. A. (2018) · University of Minnesota Digital Conservancy (University of Minnesota)
Thinking (and Thinking…) About Perfection: A Test of the Perfectionism Cognitions Theory
Janssen, W. F. (2019) · Brock University Digital Repository (Brock University) · doi:10.17605/osf.io/9xzju
The Effect of Numeric Format on Probability Discounting Rates of Medical and Monetary Outcomes
Smieszhala, G., Macaskill, A. C., & Hunt, M. J. (2019) · The Psychological Record · doi:10.1007/s40732-019-00358-1
Subjective Experience of Autonomy and Psychological Well-Being: A Cross-Cultural Study with Korean American and European American Young Adults
Lee, E. J. (2019) · CUNY Academic Works (City University of New York)
Addiction or Disorder? Using the BIAS Map Model to Explain the Stigmatizing Effects of News Media Labels for Opioid Use Disorder
Wilson, K. J. (2020) · doi:10.33915/etd.7554
Evidence-Based Policy and Misinformation: Exploring the Public's Processing of Information
Hann, A. E. (2025) · International Journal of Strategic Research in Public Administration and Organizational Process · doi:10.48028/iiprds/ijsrpaop.v5.i1.11
From the Distal to the Proximate: Exploring Social Cognitions in Risk-taking
Wuth, A. (2019) · oURspace (University of Regina) · doi:10.82465/7244
Exploring the role of schizotypy in creative cognition
Hedley, S. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17149103
Recent Books and Journals Articles in Public Opinion, Survey Methods, Survey Statistics, and Big Data. 2017 Update
Callegaro, M. (2017) · Survey Practice · doi:10.29115/sp-2018-0018
Maternal Perceptions of Safeguards for Research Involving Children
Rostami, M., Kim, J. P., Turner-Essel, L. D., & Roberts, L. W. (2021) · Journal of Child and Family Studies · doi:10.1007/s10826-021-02037-8
Treatment choice in the presence of conflicting information: The role of physician likeability in the choice of non‐proven therapies against conventional treatment
Niszczota, P., & Petrova, D. (2021) · British Journal of Health Psychology · doi:10.1111/bjhp.12559
The Impact of Religious Music on Chronic Pain Perception
Alter, G. (2021) · Deep Blue (University of Michigan) · doi:10.7302/2593
The Relationship Amongst Faith, Perceived Discrimination, Sexuality Acceptance, and Psychological Well-Being in Black Sexual Minority Individuals
Fanning, S. (2021) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.8319
Exploring the role of schizotypy in creative cognition
Hedley, S. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17149103.v1
Reply: Public Perceptions on Breast Implant–Associated Anaplastic Large Cell Lymphoma
Lee, E. H., & Sacks, J. M. (2021) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000008106
Peer Review #1 of "Forgetting faces over a week: investigating self-reported face recognition ability and personality (v0.2)"
(2021) · PeerJ · doi:10.7287/peerj.11828v0.2/reviews/1
Psychopathy and ratings of persuasiveness: Examining their relations in weaker and stronger contextsPreprint
Weiss, B., Lynam, D. R., & Miller, J. (2017) · doi:10.31234/osf.io/qmpc4
Suspicious Minds: The Link Between Stress and Perceptions of Agency
Meier, J. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17151278
Peer Review #1 of "Forgetting faces over a week: investigating self-reported face recognition ability and personality (v0.1)"
(2021) · PeerJ · doi:10.7287/peerj.11828v0.1/reviews/1
How Does the Benefits-Value-Advisor Program Steer Beneficiary Choices?Preprint
Huang, J., & Gupta, D. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3922294
Peer Review #2 of "Forgetting faces over a week: investigating self-reported face recognition ability and personality (v0.2)"
(2021) · PeerJ · doi:10.7287/peerj.11828v0.2/reviews/2
Psychopathic boldness: Narcissism, self-esteem, or something in between?Preprint
Sleep, C. E., Miller, J., Lynam, D. R., & Crowe, M. L. (2019) · doi:10.31219/osf.io/ncgxm
Intranasal Use of Prescription Stimulants Among Adults Aged 18 to 30: Results From A Crowdsourcing Platform
Vosburg, S. K., Faraone, S. V., Riley, E. N., Whitaker, T., Kardish, J., Baker, D., Kollins, S. H., & Rush, C. R. (2022) · Journal of Attention Disorders · doi:10.1177/10870547221112948
Developing a theoretical model to examine the antecedents to cyberchondria among Chinese Internet users
Zheng, H. (2022) · doi:10.32657/10356/161151
Peer Review #2 of "Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields (v0.3)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1136v0.3/reviews/2
Peer Review #1 of "Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1136v0.1/reviews/1
Peer Review #2 of "Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1136v0.1/reviews/2
Peer Review #2 of "Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1136v0.2/reviews/2
Peer Review #1 of "Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1136v0.2/reviews/1
Hydrocarbon Citizens and Government Performance in the Middle East
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0003
A Gush of Oil and a Trickle
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0005
Oil Merchants
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.002.0004
Survey Details and Methodology
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.005.0001
Introduction
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0001
Copyright Page
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.002.0003
Notes
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.002.0007
Conclusion
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0007
Seeds of Doubt
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0006
A Passion in the Desert
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0004
Why Do Hydrocarbon Citizens Think Differently about Their Government?
Mazaheri, N. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197636725.003.0002
An Innovation in Neuroscience and Neuroethics Survey Research: Amazon MTurk
Tsungmey, T., Kim, J. P., Termuehlen, H., Paik, J., & Roberts, L. W. (2023) · Springer eBooks · doi:10.1007/978-3-031-14339-7_17
The Future of Psychiatry
IsHak, W. W., Magakian, N., Ishak, W. W., Mikhail, A. A., & Lim, R. F. (2023) · Springer eBooks · doi:10.1007/978-3-031-15401-0_25

Authors: Chandler, J., & Shapiro, D.
Affiliations: Mathematica Policy Research (US)
University of Michigan (US)
ORCID: Chandler, Jesse
Venue: Annual Review of Clinical Psychology
Publisher: Annual Reviews
Published: 2016-03-28
Volume: 12
Issue: 1
Pages: 53-81
ISSN: 1548-5943 (ISSN-L)
1548-5951
DOI: 10.1146/annurev-clinpsy-021815-093623
OpenAlex: W2126493218
Cited by: 1,072
References: 177
Citations by year: 2026: 27 · 2025: 70 · 2024: 105 · 2023: 103 · 2022: 150 · 2021: 168 · 2020: 122 · 2019: 115 · 2018: 111 · 2017: 77 · 2016: 24
FWCI: 17.58
Type: journal article
Language: en
Open access: closed
Locations: Annual Review of Clinical Psychology (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
Topics: Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
Keywords: crowdsourcing, Amazon Mechanical Turk, convenience samples, non-probability sampling, sample composition, data quality, participant recruitment, digital labour markets
MeSH terms: Humans, Biomedical Research, Crowdsourcing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Conducting Clinical Research Using Crowdsourced Convenience Samples

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks