Reliability and validity of data obtained from alcohol, cannabis, and gambling populations on Amazon’s Mechanical Turk.
The DOI matches its Crossref record.
Abstract
Researchers recently have begun using Mechanical Turk (MTurk), an online crowdsourcing platform, to recruit addiction populations. However, whether the data obtained from substance users and gamblers on MTurk are reliable and valid is unknown. Herein, we assessed the internal and retest reliability of and concurrent and convergent validity of data obtained from addiction populations on MTurk. Current drinkers (N = 208), cannabis users (N = 200), and gamblers (N = 200) residing in the United States completed measures of alcohol, cannabis, and gambling severity, psychological constructs (e.g., impulsivity) related to addictions, overt and subtle measures of valid responding, and motivations for completing MTurk studies. Of the original sample, 88-92% of participants who provided informed consent for recontact completed a reassessment 1 week later. The internal consistency of the addiction severity measures ranged from α = .75 to .93. The stability over 1 week ranged from κ = .57 to .70 for categorical classification, and intraclass correlation coefficient (ICC) = .71 to .86 for continuous measures. The addiction measures were significantly correlated with each other and with other constructs related to addictive behaviors. Overall, 80-85% of participants provided valid responses. They reported attending and answering questions honestly, with financial motives being the most frequently endorsed motivation. After invalid responses were excluded, results remained the same for alcohol and gambling, but significant differences emerged for the cannabis sample. The results suggest that the self-report data obtained from alcohol and gambling populations are of high quality, however, caution is warranted with cannabis populations. MTurk shows promise as a recruitment tool for some addictive behaviors. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mturk is an online survey management system that has been found to yield valid and representative data (Kim & Hodgins, 2017).”
From Evaluating Experiential Avoidance in terms of COVID-19 Fear and Pandemic Emotional Distress Symptoms Among Latinx Adults (2022) · cites this paper as Kim & Hodgins, 2017
Citations
Cites
Still being checked.
Cited by
Items 101–200 of 207
Baptist-Mohseni, N., Morris, V. L., Vedelago, L., Kempe, T., Rapinda, K. K., Mesmer, E., Bilevicius, E., Wardell, J. D., MacKillop, J. M., & Keough, M. T. (2022) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14774 · Cited by 16
Niles, J. K., Gutiérrez, D., Dukes, A. T., Mullen, P. R., & Goode, C. D. (2022) · Journal of Addictions & Offender Counseling · doi:10.1002/jaoc.12099 · Cited by 16
Salmon, M. M., Kim, H. S. A., & Wohl, M. J. A. (2018) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2018.37.6.405 · Cited by 16
Self-citationContribution of cannabis-related cues to concurrent reinforcer choice in humans
Strickland, J. C., Lile, J. A., & Stoops, W. W. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.02.022 · Cited by 12
The impact of financial strain on medication non-adherence: Influence of psychiatric medication use
Strickland, J. C., Stoops, W. W., Kincer, M. A., & Rush, C. R. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.11.055 · Cited by 15
Examining drinking game harms as a function of gender and college student status.
Zamboanga, B. L., Napper, L. E., George, A. M., & Olthuis, J. V. (2019) · Psychology of Addictive Behaviors · doi:10.1037/adb0000520 · Cited by 12
Strickland, J., & Stoops, W. W. (2019) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2019.1689990 · Cited by 11
The Indirect Effect of Distress Tolerance on Young Adult Alcohol Use Behaviors via Coping Motives
Wahesh, E., Moreton, A., & McKechnie, M. (2020) · Journal of Addictions & Offender Counseling · doi:10.1002/jaoc.12084 · Cited by 12
Individual Differences in Psychological Stress Associated with Data Breach Experiences
Sears, C. R., & Cunningham, D. R. (2024) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp4030028 · Cited by 15
Almog, S., Scaglione, N. M., Cheong, J., Rung, J. M., Ferreiro, A. V., & Berry, M. S. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192013356 · Cited by 14
Does perceived post-traumatic growth during the COVID-19 pandemic reflect actual positive changes?
Park, C. L., Wilt, J. A., Russell, B. S., & Fendrich, M. (2023) · Anxiety Stress & Coping · doi:10.1080/10615806.2022.2157821 · Cited by 13
Assessing the role of impulsivity in smoking & non-smoking disordered gamblers
Boothby, C. A., Kim, H. S. A., Romanow, N. K., Hodgins, D. C., & McGrath, D. S. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.02.002 · Cited by 16
Self-citationLinden‐Carmichael, A. N., & Allen, H. K. (2020) · Journal of Drug Issues · doi:10.1177/0022042620979617 · Cited by 12
Brunkow, A., Cannon, M. E., Graff, F. S., Martin, J. L., Hausmann, L. R. M., & McAndrew, L. M. (2020) · Journal of Pain · doi:10.1016/j.jpain.2019.12.008 · Cited by 12
Assessing the quality and reliability of the Amazon Mechanical Turk (MTurk) data in 2024
Shimoni, H., & Axelrod, V. (2025) · Royal Society Open Science · doi:10.1098/rsos.250361 · Cited by 16
High Rollers: Correlates of Problematic Cocaine Use Among a Community Sample of Gamblers
Ethier, A. R., Kim, H. S. A., Hodgins, D. C., & McGrath, D. S. (2020) · Journal of Gambling Studies · doi:10.1007/s10899-020-09943-4 · Cited by 11
Self-citationPeople Prefer to Continue with Painful Activities Even if They Lead to Earlier Surgery
Amiri, M. M., Ring, D., & Fatehi, A. (2021) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001730 · Cited by 10
Schluter, M. G., & Hodgins, D. C. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.758329 · Cited by 14
Self-citationSalmon, M. M., & Wohl, M. J. A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01794 · Cited by 12
Discounting of delayed monetary and cannabis rewards in a crowdsourced sample of adults.
Patel, H., Naish, K. R., & Amlung, M. T. (2020) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000327 · Cited by 10
Risk factors for traumatic bonding and associations with PTSD symptoms: A moderated mediation
Shaughnessy, E., Simons, R. M., Simons, J. S., & Freeman, H. (2023) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2023.106390 · Cited by 15
The Role of Experiential Avoidance in Terms of Fatigue and Pain During COVID-19 Among Latinx Adults
Mayorga, N. A., Manning, K. F., Garey, L., Viana, A. G., Ditre, J. W., & Zvolensky, M. J. (2022) · Cognitive Therapy and Research · doi:10.1007/s10608-022-10292-2 · Cited by 10
Awao, S., Park, C. L., Russell, B. S., & Fendrich, M. (2022) · Behavioral Medicine · doi:10.1080/08964289.2022.2069667 · Cited by 12
Saran, S., Salinas, K. Z., Foulds, J., Kaynak, Ö., Hoglen, B., Houser, K. R., Krebs, N. M., Yingst, J. M., Allen, S. I., Bordner, C. R., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191610392 · Cited by 11
Mayorga, N. A., Manning, K. F., Derrick, J. L., Viana, A. G., Garey, L., Nizio, P., Matoska, C. T., & Zvolensky, M. J. (2022) · Cognitive Therapy and Research · doi:10.1007/s10608-021-10265-x · Cited by 8
Using Reddit as a recruitment strategy for addiction science research
Goodwin, S. R., Dwyer, M. J., Caliva, S., Burrows, C. A., & Raiff, B. R. (2023) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2023.209011 · Cited by 12
The effects of urbanization and social media use on individuals’ perceived social isolation
Horan, T. J. (2024) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/14171 · Cited by 10
Examining the relationship between public stigma, models of addiction, and addictive disorders
Rundle, S. M., Goldstein, A. L., Wardell, J. D., Cunningham, J. A., Rehm, J. T., & Hendershot, C. S. (2024) · Addiction Research & Theory · doi:10.1080/16066359.2024.2365156 · Cited by 11
Montes, K. S. (2019) · Journal of Gambling Studies · doi:10.1007/s10899-019-09885-6 · Cited by 8
Kim, H. S. A., Rockloff, M., McGrath, D. S., Wohl, M. J. A., & Hodgins, D. C. (2019) · Journal of Behavioral Addictions · doi:10.1556/2006.8.2019.48 · Cited by 8
Self-citationFree-Spins Spur Gamblers to Quit EGMs Early: An Online EGM Study
Rockloff, M., Stuart, G. P., Kim, H. S. A., & Hodgins, D. C. (2019) · Journal of Gambling Studies · doi:10.1007/s10899-019-09925-1 · Cited by 11
Self-citationTabri, N., Salmon, M. M., & Wohl, M. J. A. (2022) · Journal of Gambling Studies · doi:10.1007/s10899-022-10105-x · Cited by 9
Brooks, G. A., & Clark, L. (2022) · Journal of Behavioral Addictions · doi:10.1556/2006.2022.00021 · Cited by 10
Maddah, M., Esmaeilzadeh, P., & Mirzaei, T. (2023) · Information systems management · doi:10.1080/10580530.2023.2237187 · Cited by 5
Hollingshead, S. J., & Wohl, M. J. A. (2022) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-022-00905-y · Cited by 11
Lac, A. (2023) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-023-10033-z · Cited by 7
Differentiating Medicinal and Recreational Cannabis Users via Cannabis Use Motives
Vedelago, L., Metrik, J., & Amlung, M. T. (2020) · Cannabis · doi:10.26828/cannabis.2020.01.006 · Cited by 10
McPhail, A., Whelan, J., Peter, S. C., Li, Q., Winters, K. C., & Meyers, A. W. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106531 · Cited by 8
Expectations about how alcohol consumption influences gambling
Horn, T. L., Lerma, M., Pfund, R. A., & Whelan, J. P. (2023) · International Gambling Studies · doi:10.1080/14459795.2023.2224858 · Cited by 8
Lac, A., & Donaldson, C. D. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000343 · Cited by 8
How one small text change in a study document can impact recruitment rates and follow-up completions
Godinho, A., Schell, C., & Cunningham, J. A. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100284 · Cited by 6
Mayorga, N. A., Nizio, P., Garey, L., Viana, A. G., Kauffman, B. Y., Matoska, C. T., & Zvolensky, M. J. (2022) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2022.2114103 · Cited by 7
The effects of conflict resolution styles on perceived relational self-concept change
Caselli, A. J., Watt, S., Machia, L. V., & Beauparlant, E. T. (2024) · Self and Identity · doi:10.1080/15298868.2024.2348776 · Cited by 9
Ysidron, D. W., Slepian, P. M., Ankawi, B., Himawan, L. K., & France, C. R. (2020) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000872 · Cited by 7
Magnusson, B. M., Long, M. C., Larson, R. J., Maycock, L., Wood, E. H., Stratford, G., & Thacker, E. L. (2025) · Journal of Psychosomatic Obstetrics & Gynecology · doi:10.1080/0167482x.2025.2541951 · Cited by 5
Kim, N., & Oh, J. (2022) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2022.2073895 · Cited by 8
Patterns and Motives for Electronic Cigarette Use in a Sample of Community-Recruited Gamblers
McGrath, D. S., Kim, H. S. A., Boothby, C. A., Romanow, N. K., & Hodgins, D. C. (2016) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-016-9722-y · Cited by 5
Self-citationThe Role of Safety Behaviors in the Relationship between Social Anxiety and Marijuana Use Problems
Mueller, N. E., McDermott, K. A., & Cougle, J. R. (2021) · Substance Use & Misuse · doi:10.1080/10826084.2021.1922449 · Cited by 7
Turner, B. W., Cox, D. H., Shellenberg, T., Katz, N. R., Lundie, B. A., Lile, J. A., Stoops, W. W., & Rush, C. R. (2022) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2021.1984492 · Cited by 7
Rosansky, J. A., Borgogna, N. C., Kraus, S. W., & Grubbs, J. B. (2022) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2022.09.003 · Cited by 5
Contribution of alcohol- and cigarette-related cues to concurrent reinforcer choice in humans
Strickland, J. C., & Bergeria, C. L. (2020) · Behavioural Processes · doi:10.1016/j.beproc.2020.104124 · Cited by 5
Indirect effects of personality on high‐intensity drinking: The role of drinking motives
Bachrach, R. L., Zhou, A., Kumar, L., Lyons, G., Skrzynski, C. J., & Creswell, K. G. (2022) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14994 · Cited by 5
Genetics, imaging, and cognition
Whelan, R., Cao, Z., O’Halloran, L., & Pennie, B. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-815298-0.00027-7 · Cited by 4
Determining the Pathways to Alcohol Use Consequences: a Chained Mediation Approach
Chavarria, J., Ennis, C. R., Moltisanti, A. J., Allan, N. P., & Taylor, J. E. (2020) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-020-00272-6 · Cited by 4
Carr, M. M., Saules, K. K., Ellis, J. D., Staples, A. D., Ledgerwood, D. M., & Loverich, T. M. (2020) · Substance Use & Misuse · doi:10.1080/10826084.2020.1797806 · Cited by 6
Russell, K. A., Swift, J. K., & Bingham, J. (2023) · Counselling and Psychotherapy Research · doi:10.1002/capr.12698 · Cited by 4
Li, Q., & Whelan, J. (2023) · Journal of Gambling Studies · doi:10.1007/s10899-023-10210-5 · Cited by 7
Bowen, E. A., LaBarre, C., Linn, B. K., & Irish, A. (2024) · Alcoholism Treatment Quarterly · doi:10.1080/07347324.2024.2373443 · Cited by 3
Rash, C. L., Kim, H. S. A., Hodgins, D. C., & McGrath, D. S. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.07.026 · Cited by 3
Self-citationComparison of CBD and Cannabis Use Motives
Bilaonova, A., Phillips, J. A., & Anderson, K. G. (2021) · Cannabis · doi:10.26828/cannabis/2021.02.005 · Cited by 3
Cultural and Psychosocial Correlates of co-use among Black-White Biracial Adults
Miller-Roenigk, B. D., Peteet, B. J., McCuistian, C. L., & Burlew, A. K. (2023) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2023.209006 · Cited by 3
Drake, A. C., & Sears, C. R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295995 · Cited by 6
Benefit perceptions of risk, dark triad personality traits, and gambling behavior
Refaie, N., Wuth, A., & Mishra, S. (2024) · International Gambling Studies · doi:10.1080/14459795.2024.2307047 · Cited by 4
Online Ranking System Effects on Perceived Fairness: Gender, Income and EducationPreprint
Horan, T. J., & Bullen-Smith, I. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/2u3y5 · Cited by 4
Serpas, D. G., García, J. J., & Ahmed, S. R. (2023) · Annals of LGBTQ Public and Population Health · doi:10.1891/lgbtq-2022-0033 · Cited by 3
Potentially traumatic pandemic stressors and anxiety‐related sleep disturbance among Latinx persons
Buitron, V., Mayorga, N. A., Vujanovic, A. A., Schmidt, N. B., & Zvolensky, M. J. (2023) · Journal of Traumatic Stress · doi:10.1002/jts.22976 · Cited by 2
Lindner, P., Ramnerö, J., Ivanova, E., & Carlbring, P. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.571954 · Cited by 3
Jordan, H. R., Madson, M. B., Mohn, R. S., Dahlen, E. R., Nicholson, B. C., & Hoover, S. M. (2021) · Drugs Education Prevention and Policy · doi:10.1080/09687637.2021.2012128 · Cited by 4
Mayorga, N. A., Manning, K. F., Viana, A. G., Buitron, V., Argueta, S., & Zvolensky, M. J. (2023) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2023.2273794 · Cited by 2
Rose, A. L., Single, A. N., Goldstein, A. L., Goldberg, J. O., & Keough, M. T. (2024) · SAGE Open · doi:10.1177/21582440241282182 · Cited by 2
Khauli, N., Reavis, J. V., Martini, V., Harmon, D. A., & Haas, A. L. (2023) · Alcoholism Treatment Quarterly · doi:10.1080/07347324.2023.2205828 · Cited by 2
Expectations of How Acute Cannabis Use Affects Gambling Experiences and Behaviors
Smith, E. H., McPhail, A., Lerma, M., Pfund, R. A., & Whelan, J. P. (2024) · Cannabis · doi:10.26828/cannabis/2024/000231 · Cited by 3
Williams, S. R., Agapoff, J. R., Lu, B. Y., Hishinuma, E. S., & Lee, M. (2018) · Journal of Substance Use · doi:10.1080/14659891.2018.1489013 · Cited by 2
Editorial: The Use of Mechanical Turk Data in Psychological Research
Lopez, S. G., Rouse, S. V., & Treadwell, K. R. H. (2023) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn28.2.91 · Cited by 2
Crane, C. A., Berbary, C. M., Schlauch, R. C., & Easton, C. J. (2020) · Trauma Violence & Abuse · doi:10.1177/1524838020946807 · Cited by 1
Skrzynski, C. J., & Creswell, K. G. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282506 · Cited by 1
Expectations of the effects of nicotine on gambling behavior
Andersland, M. D., McPhail, A., Dow, C. V., Valencia, A. J., Pfund, R. A., & Whelan, J. P. (2024) · International Gambling Studies · doi:10.1080/14459795.2024.2409449 · Cited by 1
Who Engages in Simultaneous Gambling and Alcohol Use, and Why? A Mixed-Method Study
Sinclair, E. S.-L. L., Punia, K., Tabri, N., Balodis, I. M., & Kim, H. S. A. (2025) · Journal of Gambling Studies · doi:10.1007/s10899-025-10378-y · Cited by 1
Self-citationDepressive symptoms are associated with impaired body affect recognition for neutral expressions
Grzelak, L. N., Glazer, J. E., Klemballa, D. M., Nabb, C. B., Mittal, V. A., Walther, S., Shankman, S. A., & Letkiewicz, A. M. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119531 · Cited by 3
Bossom, I. R. L., Wohl, M. J. A., Dowson, M. E., Salmon, M. M., & Tabri, N. (2026) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2026.45.1.79 · Cited by 2
Changing for the worse: The effects of attachment anxiety on perceived self-adulteration
Caselli, A. J., Machia, L. V., & Beauparlant, E. T. (2024) · Journal of Social and Personal Relationships · doi:10.1177/02654075241263225 · Cited by 1
Lac, A. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.07.055 · Cited by 1
Wahesh, E., & Ondrejack, L. (2024) · Journal of Addictions & Offender Counseling · doi:10.1002/jaoc.12145 · Cited by 1
Examining the Utility of Behavioral Economic Demand in Addiction Science
Strickland, J. C. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.030 · Cited by 1
Assessment of the relevance of the student survey results in the educational process
Shestakov, V. N., Yakunin, Y. Y., Ликсонова, Д. И., & Pogrebnikov, A. K. (2022) · Perspectives of science and education · doi:10.32744/pse.2022.2.38 · Cited by 1
Patel, H., & Amlung, M. T. (2023) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000596 · Cited by 3
Giron, S. E. (2019) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/76246
Hollingshead, S. J. (2021) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2021-14765
Salmon, M. M. (2016) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2016-11494
Content development and initial psychometric analysis of the problematic hypersexuality scale
Oberheim, S. T., DePue, M. K., & Liu, R. (2022) · Journal of Addictions & Offender Counseling · doi:10.1002/jaoc.12113
Salmon, M. M. (2022) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2022-15246
An Innovation in Neuroscience and Neuroethics Survey Research: Amazon MTurk
Tsungmey, T., Kim, J. P., Termuehlen, H., Paik, J., & Roberts, L. W. (2023) · Springer eBooks · doi:10.1007/978-3-031-14339-7_17
The Acute and Long-Term Impact of COVID-19 on Mental Health of Children and Adolescents
Yuan, K., Bao, Y., Leng, Y., & Li, X. (2023) · Frontiers research topics · doi:10.3389/978-2-8325-3391-8
Expectations of How Acute Cannabis Use Affects Gambling Experiences and BehaviorsPreprint
Smith, E. H. (2023) · doi:10.31219/osf.io/nkgtw
Profiles of cannabis users and impact on cannabis cessation
MacQuarrie, A. L., & Brunelle, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305088
Thomas, H. A., Ellis, J. D., & Grekin, E. R. (2024) · Assessment · doi:10.1177/10731911241273352
Opioid Misuse by Adults with Chronic Pain: The Impact of Illness and Medication Beliefs
Cannon, M. E., Martin, J. L., McAndrew, L. M., & Brenner, R. E. (2024) · International Journal of Behavioral Medicine · doi:10.1007/s12529-024-10324-z
McPhail, A., Whelan, J., Ginley, M. K., & Pfund, R. A. (2025) · Journal of Gambling Studies · doi:10.1007/s10899-025-10381-3
Opioid misuse by patients with chronic pain : the impact of illness and medication beliefs
Cannon, M. E. (2022) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/nhr1-e2f3
Richardson, L., Marvin, C., Mitchell, S. M., Petrovic, J., Victor, S. E., & Mills, D. J. (2025) · Archives of Suicide Research · doi:10.1080/13811118.2025.2513020
Metadata
- Authors
- Kim, H. S., & Hodgins, D. C.
- Affiliations
- University of Calgary (CA)
- Venue
- Psychology of Addictive Behaviors
- Published
- 2017-02
- Volume
- 31
- Issue
- 1
- Pages
- 85-94
- ISSN
- 0893-164X (ISSN-L)
- 1939-1501
- OpenAlex
- W2558243715
- Cited by
- 206
- References
- 0
- Citations by year
- 2026: 2 · 2025: 10 · 2024: 15 · 2023: 25 · 2022: 25 · 2021: 29 · 2020: 30 · 2019: 31 · 2018: 23 · 2017: 13
- FWCI
- 30.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychology of Addictive Behaviors (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Alberta Gambling Research Institute
- Social Sciences and Humanities Research Council of Canada
- Alberta Innovates Health Solutions
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- Amazon Mechanical Turk, addiction research, alcohol consumption, cannabis use, gambling, reliability statistics, validity, test-retest reliability, concurrent validity, convergent validity, self-report validity, response validity, economic motivation, impulsivity, addiction severity
- MeSH terms
- Adult, Marijuana Abuse, Data Collection, Female, Gambling, Humans, Male, United States, Reproducibility of Results, Behavior, Addictive, Alcohol-Related Disorders, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.