Reliability and validity of data obtained from alcohol, cannabis, and gambling populations on Amazon’s Mechanical Turk.
The DOI matches its Crossref record.
Abstract
Researchers recently have begun using Mechanical Turk (MTurk), an online crowdsourcing platform, to recruit addiction populations. However, whether the data obtained from substance users and gamblers on MTurk are reliable and valid is unknown. Herein, we assessed the internal and retest reliability of and concurrent and convergent validity of data obtained from addiction populations on MTurk. Current drinkers (N = 208), cannabis users (N = 200), and gamblers (N = 200) residing in the United States completed measures of alcohol, cannabis, and gambling severity, psychological constructs (e.g., impulsivity) related to addictions, overt and subtle measures of valid responding, and motivations for completing MTurk studies. Of the original sample, 88-92% of participants who provided informed consent for recontact completed a reassessment 1 week later. The internal consistency of the addiction severity measures ranged from α = .75 to .93. The stability over 1 week ranged from κ = .57 to .70 for categorical classification, and intraclass correlation coefficient (ICC) = .71 to .86 for continuous measures. The addiction measures were significantly correlated with each other and with other constructs related to addictive behaviors. Overall, 80-85% of participants provided valid responses. They reported attending and answering questions honestly, with financial motives being the most frequently endorsed motivation. After invalid responses were excluded, results remained the same for alcohol and gambling, but significant differences emerged for the cannabis sample. The results suggest that the self-report data obtained from alcohol and gambling populations are of high quality, however, caution is warranted with cannabis populations. MTurk shows promise as a recruitment tool for some addictive behaviors. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mturk is an online survey management system that has been found to yield valid and representative data (Kim & Hodgins, 2017).”
From Evaluating Experiential Avoidance in terms of COVID-19 Fear and Pandemic Emotional Distress Symptoms Among Latinx Adults (2022) · cites this paper as Kim & Hodgins, 2017
Citations
Cites
Still being checked.
Cited by
Mortensen, K., & Hughes, T. L. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-017-4246-0 · Cited by 441
Wardell, J. D., Kempe, T., Rapinda, K. K., Single, A., Bilevicius, E., Frohlich, J. R., Hendershot, C. S., & Keough, M. T. (2020) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.14425 · Cited by 288
The use of crowdsourcing in addiction science research: Amazon Mechanical Turk.
Strickland, J. C., & Stoops, W. W. (2019) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000235 · Cited by 250
The relationship of loot box purchases to problem video gaming and problem gambling
Li, W., Mills, D., & Nower, L. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.05.016 · Cited by 205
McPhee, M. D., Keough, M. T., Rundle, S. M., Heath, L. M., Wardell, J. D., & Hendershot, C. S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.574676 · Cited by 154
Ettinger, J., Walton, P., Painter, J., & DiBlasi, T. (2021) · Climatic Change · doi:10.1007/s10584-021-02975-8 · Cited by 169
Park, C. L., Finkelstein-Fox, L., Russell, B. S., Fendrich, M., Hutchison, M., & Becker, J. (2021) · American Psychologist · doi:10.1037/amp0000813 · Cited by 127
Mills, D. J., & Nower, L. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.01.005 · Cited by 153
Agley, J. D., Xiao, Y., Nolan, R., & Golzarri‐Arroyo, L. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01665-8 · Cited by 138
Price elasticity of illegal versus legal cannabis: a behavioral economic substitutability analysis
Amlung, M. T., Reed, D. D., Morris, V. L., Aston, E. R., Metrik, J., & MacKillop, J. M. (2018) · Addiction · doi:10.1111/add.14437 · Cited by 109
Paid online convenience samples in gambling studies: questionable data quality
Pickering, D., & Blaszczynski, A. P. (2021) · International Gambling Studies · doi:10.1080/14459795.2021.1884735 · Cited by 106
Poole, J. C., Kim, H. S. A., Dobson, K. S., & Hodgins, D. C. (2017) · Journal of Gambling Studies · doi:10.1007/s10899-017-9680-8 · Cited by 107
Self-citationAmericans’ distress early in the COVID-19 pandemic: Protective resources and coping strategies.
Park, C. L., Finkelstein‐Fox, L., Russell, B. S., Fendrich, M., Hutchison, M., & Becker, J. (2021) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000931 · Cited by 82
Use of online crowdsourcing platforms for gambling research
Mishra, S., & Carleton, R. N. (2017) · International Gambling Studies · doi:10.1080/14459795.2017.1284250 · Cited by 71
Slepian, P. M., Ankawi, B., & France, C. R. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kaz051 · Cited by 81
Rundle, S. M., Cunningham, J. A., & Hendershot, C. S. (2021) · Drug and Alcohol Review · doi:10.1111/dar.13244 · Cited by 61
Development and psychometric evaluation of the Pornography Purchase Task
Mulhauser, K. R. W., Short, E. M., & Weinstock, J. (2018) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.04.016 · Cited by 59
Cunningham, J. A., Godinho, A., & Kushnir, V. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0440-3 · Cited by 57
Crowdsourcing for Online Samples in Counseling Research
Mullen, P. R., Fox, J., Goshorn, J. R., & Warraich, L. K. (2021) · Journal of Counseling & Development · doi:10.1002/jcad.12369 · Cited by 59
Mindsets of Addiction: Implications for Treatment Intentions
Burnette, J. L., Forsyth, R. B., Desmarais, S. L., & Hoyt, C. L. (2019) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2019.38.5.367 · Cited by 58
Stiff, C. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.044 · Cited by 52
Strickland, J. C., Lile, J. A., & Stoops, W. W. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05234-y · Cited by 54
Jensen‐Doss, A., Patel, Z. S., Casline, E. P., Ringle, V. A. M., & Timpano, K. R. (2021) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1815205 · Cited by 53
Are any samples representative or unbiased? reply to Pickering and Blaszczynski
Russell, A. M. T., Browne, M., Hing, N., Rockloff, M., & Newall, P. W. S. (2021) · International Gambling Studies · doi:10.1080/14459795.2021.1973535 · Cited by 57
Jones, A., Earnest, J., Adam, M., Clarke, R., Yates, J., & Pennington, C. R. (2022) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000546 · Cited by 59
The Problem with Online Data Collection: Predicting Invalid Responding in Undergraduate Samples
Al-Salom, P., & Miller, C. J. (2017) · Current Psychology · doi:10.1007/s12144-017-9674-9 · Cited by 57
Strickland, J. C., & Stoops, W. W. (2018) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.445 · Cited by 55
Lim, M. S. M., Cheung, F. Y.-L., Kho, J. M., & Tang, C. S. (2019) · Addiction Research & Theory · doi:10.1080/16066359.2019.1594203 · Cited by 56
Reliability of MTurk Data From Masters and Workers
Rouse, S. V. (2019) · Journal of Individual Differences · doi:10.1027/1614-0001/a000300 · Cited by 44
Substitution behaviors among people who gamble during COVID-19 precipitated casino closures
Xuereb, S., Kim, H. S. A., Clark, L., & Wohl, M. J. A. (2021) · International Gambling Studies · doi:10.1080/14459795.2021.1903062 · Cited by 43
Self-citationDevelopment and Validation of the Questionnaire of Vaping Craving
Dowd, A. N., Motschman, C. A., & Tiffany, S. T. (2018) · Nicotine & Tobacco Research · doi:10.1093/ntr/nty046 · Cited by 50
Role stress and alcohol use on restaurant server’s job satisfaction: Which comes first?
Hight, S. K., & Park, J. (2018) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2018.05.012 · Cited by 48
Cunningham, J. A., Godinho, A., & Kushnir, V. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.08.005 · Cited by 47
Tabri, N., Shead, N. W., & Wohl, M. J. A. (2017) · Journal of Gambling Studies · doi:10.1007/s10899-017-9673-7 · Cited by 42
Huhn, A. S., Tompkins, D. A., Campbell, C. M., & Dunn, K. E. (2018) · Pain Medicine · doi:10.1093/pm/pny295 · Cited by 41
Mills, D. J., Li, W., & Nower, L. (2020) · Addiction Research & Theory · doi:10.1080/16066359.2020.1787389 · Cited by 51
Use of Self-control Strategies for Managing Gambling Habits Leads to Less Harm in Regular Gamblers
Currie, S. R., Brunelle, N., Dufour, M., Flores‐Pajot, M., Hodgins, D. C., Nadeau, L., & Young, M. M. (2019) · Journal of Gambling Studies · doi:10.1007/s10899-019-09918-0 · Cited by 34
Self-citationThematic Analysis of Parent–Child Conversations About COVID-19: “Playing It Safe”
Tambling, R. R., Tomkunas, A. J., Russell, B. S., Horton, A. L., & Hutchison, M. (2021) · Journal of Child and Family Studies · doi:10.1007/s10826-020-01889-w · Cited by 37
Wohl, M. J. A., Kim, H. S. A., Salmon, M. M., Santesso, D. L., Wildschut, T., & Sedikides, C. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.11.011 · Cited by 40
Self-citationShek, D. T. L., Dou, D., Zhu, X., Wong, T., & Tan, L. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.931404 · Cited by 36
Schluter, M. G., Kim, H. S. A., & Hodgins, D. C. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.117 · Cited by 36
Self-citationSofis, M. J., Lemley, S. M., Lee, D. C., & Budney, A. J. (2020) · Psychology of Addictive Behaviors · doi:10.1037/adb0000557 · Cited by 34
Using behavioral economic variables to predict future alcohol use in a crowdsourced sample
Strickland, J. C., Alcorn, J. L., & Stoops, W. W. (2019) · Journal of Psychopharmacology · doi:10.1177/0269881119827800 · Cited by 35
Privacy Concerns and Continued Use Intention of Telemedicine During COVID-19
Kato-Lin, Y.-C., & Thelen, S. T. (2022) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2021.0603 · Cited by 35
Doing It for the Money: The Relationship Between Gambling and Money Attitudes Among College Students
Lostutter, T. W., Enkema, M. C., Schwebel, F. J., Cronce, J. M., Garberson, L. A., Ou, B., Lewis, M. A., & Larimer, M. E. (2018) · Journal of Gambling Studies · doi:10.1007/s10899-018-9789-4 · Cited by 37
Park, C. L., Wilt, J. A., Russell, B. S., & Fendrich, M. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.12.040 · Cited by 36
Validation of a Seven-Factor Structure for the Motives for Playing Drinking Games Measure
Zamboanga, B. L., Audley, S., Olthuis, J. V., Blumenthal, H., Tomaso, C. C., Bui, N. H., & Borsari, B. E. (2017) · Assessment · doi:10.1177/1073191117701191 · Cited by 35
Kim, H. S. A., Poole, J. C., Hodgins, D. C., McGrath, D. S., & Dobson, K. S. (2018) · Addiction Research & Theory · doi:10.1080/16066359.2018.1455188 · Cited by 43
Self-citationSkrzynski, C. J., Creswell, K. G., Bachrach, R. L., & Chung, T. A. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.11.009 · Cited by 35
Lac, A., & Luk, J. W. (2019) · Prevention Science · doi:10.1007/s11121-019-0986-x · Cited by 34
Yingst, J. M., Bordner, C. R., Hobkirk, A. L., Hoglen, B., Allen, S. I., Krebs, N. M., Houser, K. R., Livelsberger, C., & Foulds, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18010207 · Cited by 30
Whelan, E., Laato, S., Islam, A. K. M. N., & Billieux, J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0246432 · Cited by 35
Development and psychometric properties of the Multidimensional Inventory of Recovery Capital (MIRC)
Bowen, E. A., Irish, A., Wilding, G. E., LaBarre, C., Capozziello, N., Nochajski, T. H., Granfield, R., & Kaskutas, L. A. (2023) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2023.109875 · Cited by 28
Strickland, J. C., Hill, J. C., Stoops, W. W., & Rush, C. R. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13987 · Cited by 29
Sexual Desire and Subjective Distress among Pornography Consumers
Droubay, B. A., Shafer, K. M., & Butters, R. P. (2020) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2020.1822483 · Cited by 30
A preliminary examination of the multiple dimensions of opioid craving
Bergeria, C. L., Strickland, J. C., Huhn, A. S., Strain, E. C., & Dunn, K. E. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108473 · Cited by 28
Perspectives on using decision-making nudges in physician-patient communications
Fridman, I., Hart, J. L., Yadav, K. N., & Higgins, E. T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202874 · Cited by 36
The condom purchase task: A hypothetical demand method for evaluating sexual health decision‐making
Strickland, J. C., Marks, K. R., & Bolin, B. L. (2020) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.585 · Cited by 31
Development and validation of a cannabis cue stimulus set
Macatee, R. J., Carr, M., Afshar, K., & Preston, T. J. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106643 · Cited by 27
Elevated Behavioral Economic Demand for Alcohol in Co-Users of Alcohol and Cannabis
Morris, V. L., Patel, H., Vedelago, L., Reed, D. D., Metrik, J., Aston, E. R., MacKillop, J. M., & Amlung, M. T. (2018) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2018.79.929 · Cited by 26
Adverse Childhood Experiences, Tobacco Use, and Obesity: A Crowdsourcing Study
Meadows, A. L., Strickland, J. C., Kerr, M. S., Rayapati, A. O., & Rush, C. R. (2019) · Substance Use & Misuse · doi:10.1080/10826084.2019.1608254 · Cited by 26
Kirkpatrick, M. G., Cruz, T. B., Unger, J. B., Herrera, J., Schiff, S. J., & Allem, J.-P. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.04.018 · Cited by 26
Brazeau, B. W., & Hodgins, D. C. (2022) · Addictive Behaviors · doi:10.1016/j.addbeh.2022.107310 · Cited by 24
Self-citationStrickland, J. C., & Victor, G. A. (2019) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2019.10.013 · Cited by 25
Schell, C., Godinho, A., & Cunningham, J. A. (2020) · Substance Abuse · doi:10.1080/08897077.2019.1697998 · Cited by 26
Grubbs, J. B., Chapman, H. A., Milner, L. A., Gutierrez, I. A., & Bradley, D. F. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000399 · Cited by 27
Emotion regulation in emerging adult gamblers and its mediating role with depressive symptomology
Marchica, L. A., Mills, D. J., Keough, M. T., Montreuil, T. C., & Derevensky, J. L. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.07.078 · Cited by 22
Baer, M. M., Tull, M. T., & Gratz, K. L. (2021) · Archives of Suicide Research · doi:10.1080/13811118.2021.1931595 · Cited by 24
Borodovsky, J. T. (2022) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000581 · Cited by 29
Post-Traumatic Stress and Gambling Related Cognitions: Analyses in Inpatient and Online Samples
Grubbs, J. B., Chapman, H., & Shepherd, K. A. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.09.035 · Cited by 21
Mayorga, N. A., Garey, L., Viana, A. G., Cardoso, J. B., Schmidt, N. B., & Zvolensky, M. J. (2021) · Cognitive Therapy and Research · doi:10.1007/s10608-021-10243-3 · Cited by 25
Scheibein, F., Donnelly, W., & WELLS, J. S. G. (2021) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2021.103505 · Cited by 26
A fan’s search for meaning: Testing the dimensionality of sport fan superstition
Dwyer, B., Slavich, M. A., & Gellock, J. L. (2017) · Sport Management Review · doi:10.1016/j.smr.2017.12.001 · Cited by 27
Kim, H. S. A., Shifrin, A., Sztainert, T., & Wohl, M. J. A. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.23 · Cited by 22
Self-citationDependence and Use Characteristics of Adult JUUL Electronic Cigarette Users
Yingst, J. M., Foulds, J., & Hobkirk, A. L. (2020) · Substance Use & Misuse · doi:10.1080/10826084.2020.1834582 · Cited by 19
Two brief valid measures of therapeutic alliance in counseling for tobacco dependence
Warlick, C. A., Richter, K. P., Catley, D., Gajewski, B. J., Martin, L. E., & Mussulman, L. M. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.12.010 · Cited by 21
Platelet interaction with bacteria. V. Ultrastructure of congenital afibrinogenemic platelets.
Clawson, C. C., & White, J. G. (1980) · PubMed · Cited by 19
Fernandez, L. R., Giron, S. E., Killoren, S. E., & Campione‐Barr, N. (2022) · Journal of Child and Family Studies · doi:10.1007/s10826-022-02474-z · Cited by 24
Criminology in the age of data explosion: New directions
Ozkan, T. (2019) · The Social Science Journal · doi:10.1016/j.soscij.2018.10.010 · Cited by 25
Tabri, N., Salmon, M. M., & Wohl, M. J. A. (2020) · Addiction Research & Theory · doi:10.1080/16066359.2020.1714039 · Cited by 19
Are you for real? Maximizing participant eligibility on Amazon's Mechanical Turk
Kim, H. S. A., & Hodgins, D. C. (2020) · Addiction · doi:10.1111/add.15065 · Cited by 17
Self-citationStanmyre, J. F., Mills, D. J., Li, W., & Nower, L. (2021) · Mindfulness · doi:10.1007/s12671-021-01791-6 · Cited by 21
Campbell, E. M., & Strickland, J. C. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.01.007 · Cited by 18
Hooper, R. C., Hsu, J. J., Duncan, A., Bensenhaver, J. M., Newman, L. A., Kidwell, K., Chung, K. C., & Momoh, A. O. (2019) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000005523 · Cited by 16
Cunningham, J. A., Godinho, A., & Bertholet, N. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0770-4 · Cited by 17
Predicting Gambling Situations: The Roles of Impulsivity, Substance Use, and Post-Traumatic Stress
Grubbs, J. B., & Chapman, H. A. (2019) · Substance Abuse Research and Treatment · doi:10.1177/1178221819852641 · Cited by 21
Cwalina, S. N., Pacek, L. R., Barrington‐Trimis, J. L., Tackett, A. P., & Pentz, M. A. (2021) · Substance Use & Misuse · doi:10.1080/10826084.2021.1954026 · Cited by 17
Tabri, N., Werner, K. M., Milyavskaya, M., & Wohl, M. J. A. (2021) · Journal of Behavioral Addictions · doi:10.1556/2006.2021.00068 · Cited by 16
Validation of a brief behavioral economic assessment of demand among cigarette smokers.
Athamneh, L. N., Stein, J. S., Amlung, M. T., & Bickel, W. K. (2018) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000228 · Cited by 15
Russell, A. M., Barry, A. E., & Patterson, M. S. (2020) · Drug and Alcohol Review · doi:10.1111/dar.13140 · Cited by 17
Feng, Y., & Xie, Q. (2023) · Journal of Promotion Management · doi:10.1080/10496491.2023.2279768 · Cited by 18
E-Cigarette Demand: Impact of Commodity Definitions and Test–Retest Reliability
Strickland, J. C., Vsevolozhskaya, O. A., & Stoops, W. W. (2020) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntaa139 · Cited by 14
Telemedicine for Acute Conditions During COVID-19: A Nationwide Survey Using Crowdsourcing
Kato-Lin, Y.-C., & Thelen, S. T. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0351 · Cited by 16
Study framing influences crowdsourced rates of problem gambling and alcohol use disorder.
Angus, D. J., Pickering, D., Keen, B., & Blaszczynski, A. P. (2021) · Psychology of Addictive Behaviors · doi:10.1037/adb0000687 · Cited by 14
King, S. E., Skrzynski, C. J., Bachrach, R. L., Wright, A. G. C., & Creswell, K. G. (2023) · Assessment · doi:10.1177/10731911221146515 · Cited by 16
Rockloff, M., Browne, M., Russell, A. M. T., Newall, P. W. S., Hing, N., & Armstrong, T. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107893 · Cited by 18
Schell, C., Godinho, A., & Cunningham, J. A. (2020) · Journal of Gambling Studies · doi:10.1007/s10899-020-09970-1 · Cited by 17
Associations between recalled use of legal UK youth gambling products and adult disordered gambling
Newall, P. W. S., Russell, A. M. T., Sharman, S., & Walasek, L. (2020) · Journal of Behavioral Addictions · doi:10.1556/2006.2020.00048 · Cited by 13
Kim, H. S. A., Rash, C. L., & McGrath, D. S. (2018) · Personality and Mental Health · doi:10.1002/pmh.1433 · Cited by 17
Self-citationMiller-Roenigk, B. D., Peteet, B. J., McCuistian, C. L., & Burlew, A. K. (2021) · Substance Use & Misuse · doi:10.1080/10826084.2021.1975745 · Cited by 14
Metadata
- Authors
- Kim, H. S., & Hodgins, D. C.
- Affiliations
- University of Calgary (CA)
- Venue
- Psychology of Addictive Behaviors
- Published
- 2017-02
- Volume
- 31
- Issue
- 1
- Pages
- 85-94
- ISSN
- 0893-164X (ISSN-L)
- 1939-1501
- OpenAlex
- W2558243715
- Cited by
- 206
- References
- 0
- Citations by year
- 2026: 2 · 2025: 10 · 2024: 15 · 2023: 25 · 2022: 25 · 2021: 29 · 2020: 30 · 2019: 31 · 2018: 23 · 2017: 13
- FWCI
- 30.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychology of Addictive Behaviors (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Alberta Gambling Research Institute
- Social Sciences and Humanities Research Council of Canada
- Alberta Innovates Health Solutions
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- Amazon Mechanical Turk, addiction research, alcohol consumption, cannabis use, gambling, reliability statistics, validity, test-retest reliability, concurrent validity, convergent validity, self-report validity, response validity, economic motivation, impulsivity, addiction severity
- MeSH terms
- Adult, Marijuana Abuse, Data Collection, Female, Gambling, Humans, Male, United States, Reproducibility of Results, Behavior, Addictive, Alcohol-Related Disorders, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.