The DOI matches its Crossref record; 174 of the 177 references it cites were found in a registry or an index.
Conducting Clinical Research Using Crowdsourced Convenience Samples
Abstract
Crowdsourcing has had a dramatic impact on the speed and scale at which scientific research can be conducted. Clinical scientists have particularly benefited from readily available research study participants and streamlined recruiting and payment systems afforded by Amazon Mechanical Turk (MTurk), a popular labor market for crowdsourcing workers. MTurk has been used in this capacity for more than five years. The popularity and novelty of the platform have spurred numerous methodological investigations, making it the most studied nonprobability sample available to researchers. This article summarizes what is known about MTurk sample composition and data quality with an emphasis on findings relevant to clinical psychological research. It then addresses methodological issues with using MTurk--many of which are common to other nonprobability samples but unfamiliar to clinical science researchers--and suggests concrete steps to avoid these issues or minimize their impact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chandler and Shapiro (2016), including empirical work by Shapiro and colleagues (2013), demonstrate that MTurk-recruited research study participants are similarly honest, attentive, and reliable compared to non-MTurk samples, and that MTurk is particularly well suited to reaching populations with social anxiety symptoms.”
From A Randomized Trial of Brief Online Interventions to Facilitate Treatment Seeking for Social Anxiety. (2022) · cites this paper as Chandler and Shapiro, 2016
In the citing paper
“However, as noted, research reviewed by Chandler and Shapiro (2016), including empirical work by Shapiro and colleagues (2013), illustrates that MTurk workers are comparably honest, attentive, and reliable compared to non-MTurk samples, and that MTurk is well suited to reaching populations with clinically relevant symptoms.”
From A Randomized Trial of Brief Online Interventions to Facilitate Treatment Seeking for Social Anxiety. (2022) · cites this paper as Chandler and Shapiro (2016)
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Self-citationInstructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Self-citationCrowdsourcing user studies with Mechanical Turk
Kittur, A., Ed, H., & Suh, B. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,941
Research works printed but not linked: 12
- Barnhoorn JS, 2014, Behav. Res. Methods, 530, 1
- Beramendi P, Duch RM, Matsuo A. 2014. When lab subjects meet real people: comparing different modes of experiments. Presented at Asian Polit. Methodol. Conf., Taipai
- Casey L, Chandler J, Levine AS, Proctor A, Strolovitch D. 2015. Demographic characteristics of a large sample of US workers. Mathematica Policy Res. Rep. In press
- Downes-Le Guin T, 2006, ESOMAR World Res. Conf. Panel Res.
- Higgins C, 2010, Proc. NAACL HLT 2010 Workshop on Creat. Speech and Language Data with Amazon's Mechanical Turk, Los Angeles, 89
- 10.1007/s10683-011-9273-9 · DOI
- 10.1145/2676431.2676437 · DOI
- Lang ASID, 2011, Code4Lib J., 15, 1
- Lebreton P, 2015, Proc. SPIE Conf. Hum. Vis. Electron. Imaging, 20th, San Francisco
- 10.1026//1618-3169.49.4.243 · DOI
- Shao W, 2015, Digit. Cult. Educ., 7
- Suri S, 2011, AAAI Workshops, 25th, San Francisco, 61
Cited by
Sorted by citations
Items 301–400 of 1,001
Evaluating effects of context changes on resurgence in humans
Ritchey, C. M., Kuroda, T., & Podlesnik, C. A. (2021) · Behavioural Processes · doi:10.1016/j.beproc.2021.104563 · Cited by 25
April, K., Cole, L. M., & Goldstein, N. E. S. (2022) · Current Psychology · doi:10.1007/s12144-022-02709-8 · Cited by 26
Hallford, D. J., & Mellor, D. J. (2017) · International Journal of Mental Health · doi:10.1080/00207411.2017.1294968 · Cited by 25
Does stress mediate the association between personal relative deprivation and gambling?
Mishra, S., & Meadows, T. J. S. (2017) · Stress and Health · doi:10.1002/smi.2789 · Cited by 25
Adverse Childhood Experiences, Tobacco Use, and Obesity: A Crowdsourcing Study
Meadows, A. L., Strickland, J. C., Kerr, M. S., Rayapati, A. O., & Rush, C. R. (2019) · Substance Use & Misuse · doi:10.1080/10826084.2019.1608254 · Cited by 25
Not All Scientists Are Equal: Role Aspirants Influence Role Modeling Outcomes in STEM
Hu, D., Ahn, J. N., Vega, M., & Lin‐Siegler, X. (2020) · Basic and Applied Social Psychology · doi:10.1080/01973533.2020.1734006 · Cited by 25
An Examination of the Factor Structure of the Multidimensional Psychological Flexibility Inventory.
Thomas, K. N., Bardeen, J. R., Witte, T. K., Rogers, T. A., Benfer, N., & Clauss, K. (2022) · Assessment · doi:10.1177/10731911211024353 · Cited by 24
Family Communication About Climate Change in the United States
Dayton, L., Balaban, A., Scherkoske, M., & Latkin, C. A. (2022) · Journal of Prevention · doi:10.1007/s10935-022-00712-0 · Cited by 24
Gray, P. B., & Brogdon, E. M. (2017) · Evolutionary Psychology · doi:10.1177/1474704917694367 · Cited by 24
Development and Evaluation of the ADHD Cognitions Scale for Adults
Knouse, L. E., Mitchell, J. T., Kimbrel, N. A., & Anastopoulos, A. D. (2017) · Journal of Attention Disorders · doi:10.1177/1087054717707580 · Cited by 24
Bergunde, L., & Dritschel, B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227564 · Cited by 33
COVID-19 vaccine delay: An examination of United States residents’ intention to delay vaccine uptake
Latkin, C. A., Dayton, L., Yi, G. T., Jaleel, A., Nwosu, C. C., & Limaye, R. J. (2021) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2021.1917234 · Cited by 24
Ritchey, C. M., Kuroda, T., Rung, J. M., & Podlesnik, C. A. (2021) · Learning and Motivation · doi:10.1016/j.lmot.2021.101728 · Cited by 24
The General Factors of Personality Disorder, Psychopathology, and Personality
McCabe, G. A., Oltmanns, J. R., & Widiger, T. A. (2021) · Journal of Personality Disorders · doi:10.1521/pedi_2021_35_530 · Cited by 30
Warner, T. D., & Steidley, T. (2021) · Journal of Crime and Justice · doi:10.1080/0735648x.2021.1997787 · Cited by 24
Brazeau, B. W., & Hodgins, D. C. (2022) · Addictive Behaviors · doi:10.1016/j.addbeh.2022.107310 · Cited by 24
Tambling, R. R., Russell, B. S., Fendrich, M., & Park, C. L. (2022) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-022-09796-2 · Cited by 27
Yung, J. J., & Tabri, N. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23719 · Cited by 24
Anti-Vaccine Attitudes among Adults in the U.S. during the COVID-19 Pandemic after Vaccine Rollout
Choi, J., Lieff, S. A., Meltzer, G., Grivel, M. M., Chang, V. W., Yang, L. H., & Jarlais, D. C. D. (2022) · Vaccines · doi:10.3390/vaccines10060933 · Cited by 24
Dixon, G., & Hubner, A. Y. (2018) · Science Communication · doi:10.1177/1075547018769907 · Cited by 24
Posttraumatic stress, uncontrollability, and emotional distress tolerance
Hancock, L., & Bryant, R. A. (2018) · Depression and Anxiety · doi:10.1002/da.22783 · Cited by 27
Strickland, J. C., & Victor, G. A. (2019) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2019.10.013 · Cited by 24
Efficacy in deceptive vocal exaggeration of human body size
Pisanski, K., & Reby, D. (2021) · Nature Communications · doi:10.1038/s41467-021-21008-7 · Cited by 24
Rogers, M. L., Gorday, J. Y., & Joiner, T. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.05.001 · Cited by 24
Safi, A. G., Reyes, C. B., Jesch, E., Steinhardt, J., Niederdeppe, J., Skurka, C., Kalaji, M., Scolere, L., & Byrne, S. E. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.112597 · Cited by 23
Cramer, A. O. J., Leertouwer, I., Lanius, R. A., & Frewen, P. (2020) · Journal of Traumatic Stress · doi:10.1002/jts.22488 · Cited by 26
A socio-ecological perspective on parents’ intentions to vaccinate their children against COVID-19
Dayton, L., Miller, J., Strickland, J. C., Davey-Rothwell, M. A., & Latkin, C. A. (2022) · Vaccine · doi:10.1016/j.vaccine.2022.05.089 · Cited by 23
Privacy in the sharing economy: Why don't users disclose their negative experiences?
Zhu, Y., & Grover, V. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102543 · Cited by 24
Grubbs, J. B., Chapman, H. A., Milner, L. A., Gutierrez, I. A., & Bradley, D. F. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000399 · Cited by 24
Paging Dr. Google: The Effect of Online Health Information on Trust in Pediatricians’ Diagnoses
Sood, N., Jimenez, D. E., Pham, T. B., Cordrey, K., Awadalla, N. R., & Milanaik, R. L. (2019) · Clinical Pediatrics · doi:10.1177/0009922819845163 · Cited by 23
Yun, J. T., Duff, B. R. L., Vargas, P. T., Himelboim, I., & Sundaram, H. (2019) · Psychology and Marketing · doi:10.1002/mar.21250 · Cited by 23
Crowdsourcing in Cognitive and Systems Neuroscience
Johnson, B. P., Dayan, E., Censor, N., & Cohen, L. G. (2021) · The Neuroscientist · doi:10.1177/10738584211017018 · Cited by 23
Hanink, P. A., & Dunbar, A. (2022) · Social movement studies · doi:10.1080/14742837.2022.2067842 · Cited by 23
Customer Service Chatbots: Anthropomorphism, Adoption and Word of Mouth
Sheehan, B. T. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.121188 · Cited by 23
Beshai, S., Salimuddin, S., Refaie, N., & Maierhoffer, J. (2022) · Mindfulness · doi:10.1007/s12671-022-02008-0 · Cited by 22
Black, J., Belicki, K., Piro, R., & Hughes, H. (2020) · OMEGA - Journal of Death and Dying · doi:10.1177/0030222820903850 · Cited by 22
Contributions of the dark triad to moral disengagement among incarcerated and community adults
Navas, M. P., Maneiro, L., Cutrín, O., Fraguela, J. A. G., & Sobral, J. (2021) · Legal and Criminological Psychology · doi:10.1111/lcrp.12190 · Cited by 22
Davis, E. B., Lacey, E. K., Heydt, E. J., LaBouff, J. P., Barker, S. B., van Elk, M., & Ladd, K. L. (2022) · Psychology of Religion and Spirituality · doi:10.1037/rel0000485 · Cited by 22
Binoy, S., Montaser‐Kouhsari, L., Ponger, P., & Saban, W. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1325215 · Cited by 22
Wright, M., Galante, J., Corneille, J. S., Grabovac, A. D., Ingram, D. M., & Sacchet, M. D. (2024) · Mindfulness · doi:10.1007/s12671-024-02356-z · Cited by 26
Citizen Science: Crowdsourcing for Research
Lichten, C. A., Ioppolo, B., d'Angelo, C., Simmons, R. K., & Jones, M. M. (2018) · Cited by 22
Patterson, J. G., Keller-Hamilton, B. L., Wedel, A. V., Wagener, T. L., & Stevens, E. M. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2021.109249 · Cited by 22
Post-Traumatic Stress and Gambling Related Cognitions: Analyses in Inpatient and Online Samples
Grubbs, J. B., Chapman, H., & Shepherd, K. A. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.09.035 · Cited by 21
Owczarek, M., Redican, E., Shevlin, M. E., & Nolan, E. (2025) · Current Psychology · doi:10.1007/s12144-025-07519-2 · Cited by 24
Direct-to-Consumer Marketing for Parent-Child Interaction Therapy: Impact of Language and Messenger
Barnett, M. L., Bernal, N. A., & Sanchez, B. E. L. (2019) · Journal of Child and Family Studies · doi:10.1007/s10826-019-01575-6 · Cited by 23
Caldas, S. V., Contractor, A. A., Koh, S., & Wang, L. (2020) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-020-09800-z · Cited by 24
Benfer, N., Rogers, T. A., & Bardeen, J. R. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.06.003 · Cited by 21
Mapping alexithymia: Level of emotional awareness differentiates emotion-specific somatosensory maps
Lloyd, C., Stafford, E., McKinnon, M. C., Rabellino, D., D'Andrea, W. M., Densmore, M., Thome, J., Neufeld, R. W. J., & Lanius, R. A. (2021) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104919 · Cited by 22
Gaur, M., Aribandi, V., Kursuncu, U., Alambo, A., Shalin, V. L., Thirunarayan, K., Beich, J., Narasimhan, M., & Sheth, A. (2021) · JMIR Mental Health · doi:10.2196/20865 · Cited by 21
Ciardha, C. Ó., Ildeniz, G., & Karoğlu, N. (2021) · Sexual Abuse · doi:10.1177/10790632211013811 · Cited by 28
How racialized policy contact shapes the social constructions of policy targets
Maltby, E., & Kreitzer, R. (2022) · Policy Studies Journal · doi:10.1111/psj.12481 · Cited by 21
Stefana, A., Langfus, J. A., Vieta, E., Fusar‐Poli, P., & Youngstrom, E. A. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12155156 · Cited by 21
Mundy, L. R., Klassen, A. F., Pusic, A. L., deJong, T., Hollenbeck, S. T., Gage, M. J., & LIMB-Q Development Team (2024) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000011293 · Cited by 21
Stavropoulos, V., Bamford, L., Beard, C. L., Gomez, R., & Griffiths, M. D. (2019) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-019-00099-w · Cited by 21
A Bibliometric Analysis of Crowdsourcing in the Field of Public Health
Wang, L., Xia, E., Li, H., & Wang, W. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16203825 · Cited by 21
Gandullia, L., Lezzi, E., & Parciasepe, P. (2020) · Journal of Economic Psychology · doi:10.1016/j.joep.2020.102268 · Cited by 21
Object attachment and emotions in hoarding disorder
Yap, K., & Grisham, J. R. (2020) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2020.152179 · Cited by 23
Wuth, A., Mishra, S., Beshai, S., & Feeney, J. R. (2021) · Current Psychology · doi:10.1007/s12144-020-01274-2 · Cited by 24
Public Perceptions on Breast Implant–Associated Anaplastic Large Cell Lymphoma
Lee, E. H., Khavanin, N., He, W. Y., Darrach, H. M., Kraenzlin, F. S., Jenny, H. E., Yang, R. S., & Sacks, J. M. (2020) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000006889 · Cited by 20
Choices between money and hyper-palatable food: Choice impulsivity and eating behavior.
Fazzino, T. L., Bjorlie, K. A., Rohde, K., Smith, A. P., & Yi, R. (2022) · Health Psychology · doi:10.1037/hea0001185 · Cited by 20
Reacting to changing environment: Updating patterns in social anxiety
Zabag, R., Gilboa‐Schechtman, E., & Levy‐Gigi, E. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104159 · Cited by 20
Siritzky, E. M., Cox, P., Nadler, S. M., Grady, J. N., Kravitz, D. J., & Mitroff, S. R. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00520-y · Cited by 20
Multi-Class Adaptive Active Learning for Predicting Student Anxiety
Almadhor, A. S., Abbas, S., Sampedro, G. A., Alsubai, S., Ojo, S., Hejaili, A. A., & Strážovská, Ľ. (2024) · IEEE Access · doi:10.1109/access.2024.3391418 · Cited by 20
Jaso, B. A., Hudiburgh, S. E., Heller, A. S., & Timpano, K. R. (2019) · International Journal of Cognitive Therapy · doi:10.1007/s41811-019-00061-7 · Cited by 20
Kjell, K., Johnsson, P., & Sikström, S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.602581 · Cited by 24
US young adults’ perceived effectiveness of draft pictorial e-cigarette warning labels
Sontag, J. M., Manderski, M. T. B., Hammond, D. G., & Wackowski, O. A. (2019) · Tobacco Control · doi:10.1136/tobaccocontrol-2018-054802 · Cited by 20
Fergus, T. A., & Bardeen, J. R. (2017) · Psychological Trauma: Theory, Research, Practice, and Policy · doi:10.1037/tra0000247 · Cited by 19
Stanton, K. J., DeLucia, E. A., Brown, M. F. D., & McDonnell, C. G. (2020) · Personality and Mental Health · doi:10.1002/pmh.1498 · Cited by 20
Benzodiazepine Use and Dependence in Relation to Chronic Pain Intensity and Pain Catastrophizing
Lape, E. C., Powers, J. M., Hooker, J. E., Edwards, R. R., & Ditre, J. W. (2022) · Journal of Pain · doi:10.1016/j.jpain.2022.09.019 · Cited by 19
Development and validation of an 8-item version of the Real Relationship Inventory–Client form
Stefana, A., Fusar‐Poli, P., Vieta, E., Gelso, C. J., & Youngstrom, E. A. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2320331 · Cited by 19
Teasdale, A. E., & Limbers, C. A. (2018) · Journal of Child Health Care · doi:10.1177/1367493518767068 · Cited by 22
Kim, H. S. A., Shifrin, A., Sztainert, T., & Wohl, M. J. A. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.23 · Cited by 19
Associations among dimensions of political ideology and Dark Tetrad personality features
Bardeen, J. R., & Michel, J. S. (2019) · Journal of Social and Political Psychology · doi:10.5964/jspp.v7i1.1071 · Cited by 22
The Replication Crisis and Qualitative Research in the Psychology of Religion
Anczyk, A., Grzymała-Moszczyńska, H., Krzysztof-Świderska, A., & Prusak, J. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1687197 · Cited by 19
The buffering effect of attentional control on the relationship between cognitive fusion and anxiety
Thomas, K. N., & Bardeen, J. R. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103653 · Cited by 19
Iverson, G. L., Merz, Z. C., & Terry, D. P. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.632618 · Cited by 21
Racial and Ethnic Disparities in Fertility Awareness Among Reproductive-Aged Women
Siegel, D. R., Sheeder, J. L., & Polotsky, A. J. (2021) · Women s Health Reports · doi:10.1089/whr.2021.0034 · Cited by 19
Two brief valid measures of therapeutic alliance in counseling for tobacco dependence
Warlick, C. A., Richter, K. P., Catley, D., Gajewski, B. J., Martin, L. E., & Mussulman, L. M. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.12.010 · Cited by 19
Woike, J. K. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02646 · Cited by 23
Framing States: Unitary Actor Language and Public Support for Coercive Foreign Policy
Altier, M. B., & Kane, J. (2022) · International Studies Quarterly · doi:10.1093/isq/sqac080 · Cited by 18
Evaluating mobile-based data collection for crowdsourcing behavioral research
Esch, D. T., Mylonopoulos, N. A., & Theoharakis, V. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02618-1 · Cited by 20
Prevalence and Predictors of Cyber Psychological Abuse among Adults
Mahoney, J. C., Farrell, D. M., & Murphy, C. M. (2021) · Journal of Family Violence · doi:10.1007/s10896-021-00317-x · Cited by 18
Everaert, J., Benisty, H., Polack, R. G., Joormann, J., & Mishne, G. (2022) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0000775 · Cited by 18
Dey, S., Joormann, J., Moulds, M. L., & Newell, B. R. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.06.007 · Cited by 18
Posttraumatic stress symptoms, shame, and substance use among Asian Americans
Saraiya, T. C., Smith, K., Campbell, A. N. C., & Hien, D. A. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2018.10.002 · Cited by 18
Quantitative Data Visualisation on Virtual Globes
Satriadi, K. A., Ens, B. M., Czauderna, T., Cordeil, M., & Jenny, B. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445152 · Cited by 19
Mathur, M. B., Peacock, J., Robinson, T. N., & Gardner, C. D. (2021) · Nutrients · doi:10.3390/nu13124555 · Cited by 20
On the Link Between Benevolent Sexism and Orgasm Frequency in Heterosexual Women
Harris, E. A., Hornsey, M. J., & Barlow, F. K. (2016) · Archives of Sexual Behavior · doi:10.1007/s10508-016-0780-9 · Cited by 18
How generalizable is the inverse relationship between social class and emotion perception?
Deveney, C. M., Chen, S. H., Wilmer, J. B., Zhao, V., Schmidt, H. B., & Germine, L. T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205949 · Cited by 18
Obsessive-Compulsive and Depressive Symptoms: The Role of Depressive Cognitive Styles
Shaw, A. M., Carbonella, J. Y., Arditte Hall, K. A., & Timpano, K. R. (2017) · The Journal of Psychology · doi:10.1080/00223980.2017.1372341 · Cited by 17
Development and Initial Validation of the Perceived Classism Experiences Scale
Cavalhieri, K. E., & Chwalisz, K. (2020) · The Counseling Psychologist · doi:10.1177/0011000019899395 · Cited by 17
Posttraumatic stress, stressor controllability, and avoidance
Hancock, L., & Bryant, R. A. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103591 · Cited by 17
Victor, G. A., Strickland, J. C., Kheibari, A., & Flaherty, C. W. (2020) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2020.102973 · Cited by 18
Feasibility and Efficacy of Online Neuropsychological Assessment
Binoy, S., Woody, R., Ivry, R. B., & Saban, W. (2023) · Sensors · doi:10.3390/s23115160 · Cited by 18
Esmaeilzadeh, P., & Mirzaei, T. (2023) · Journal of Medical Internet Research · doi:10.2196/41805 · Cited by 18
The Power of Social Media: Stigmatizing Content Affects Perceptions of Mental Health Care
Competiello, S. K., Bizer, G. Y., & Walker, D. C. (2023) · Social Media + Society · doi:10.1177/20563051231207847 · Cited by 22
Picciotto, Y. D., Algon, A. L., Amit, I., Vakil, E., & Saban, W. (2024) · The Clinical Neuropsychologist · doi:10.1080/13854046.2024.2397835 · Cited by 18
Prevalence of Anxiety and Depression among Parents of Children with Cancer—A Preliminary Study
Lewandowska, A., Lewandowski, T., Bartosiewicz, A., Papp, K., Zrubcová, D., Šupínová, M., Stryjkowska-Góra, A., Laskowska, B. J., Joniec, G., & Apay, S. E. (2024) · Children · doi:10.3390/children11101227 · Cited by 17
Lightner, A. D., Barclay, P., & Hagen, E. H. (2017) · Royal Society Open Science · doi:10.1098/rsos.170543 · Cited by 18
Clauss, K. E., & Bardeen, J. R. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1521417 · Cited by 17
Metadata
- Authors
- Chandler, J., & Shapiro, D.
- Affiliations
- Mathematica Policy Research (US)
- University of Michigan (US)
- ORCID
- Chandler, Jesse
- Venue
- Annual Review of Clinical Psychology
- Publisher
- Annual Reviews
- Published
- 2016-03-28
- Volume
- 12
- Issue
- 1
- Pages
- 53-81
- ISSN
- 1548-5943 (ISSN-L)
- 1548-5951
- OpenAlex
- W2126493218
- Cited by
- 1,072
- References
- 177
- Citations by year
- 2026: 27 · 2025: 70 · 2024: 105 · 2023: 103 · 2022: 150 · 2021: 168 · 2020: 122 · 2019: 115 · 2018: 111 · 2017: 77 · 2016: 24
- FWCI
- 17.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annual Review of Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Keywords
- crowdsourcing, Amazon Mechanical Turk, convenience samples, non-probability sampling, sample composition, data quality, participant recruitment, digital labour markets
- MeSH terms
- Humans, Biomedical Research, Crowdsourcing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review