The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
The use of crowdsourcing in addiction science research: Amazon Mechanical Turk.
Open accessAbstract
Crowdsourcing, the use of the Internet to outsource work to a large number of people, has witnessed a dramatic growth over the past decade. One popular crowdsourcing option, Amazon Mechanical Turk (MTurk), is now commonly used to sample participants for psychological research. Addiction science is positioned to benefit greatly from crowdsourced sampling due to the ability to efficiently and effectively tap into populations with specific behavioral and health histories. The primary objective of this review is to describe the utility of crowdsourcing, broadly, and MTurk, specifically, for conducting research relevant to substance use and misuse. Studies in psychological and other health science have supported the reliability and validity of data gathered using crowdsourced samples. Promising research relevant to addiction science has also been conducted, including studies using cross-sectional designs and those for measure development purposes. Preliminary work using longitudinal methods and for interventions development has also revealed the potential of MTurk for studying alcohol and other drug use through these designs. Additional studies are needed to better understand the benefits, as well as the limits and constraints, of research conducted through crowdsourced online platforms. Crowdsourcing, such as on MTurk, can ultimately provide an important complement to existing methods used in human laboratory, clinical trial, community intervention, and epidemiological research. The combinations of these methodological approaches could help improve the rigor, reproducibility, and overall scope of research conducted in addiction science. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Nature · doi:10.1038/466029a · Cited by 3,441
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618
Cited by
Trust in a COVID-19 vaccine in the U.S.: A social-ecological perspective
Latkin, C. A., Dayton, L., Yi, G., Konstantopoulos, A., & Boodram, B. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.113684 · Cited by 386
Retention of participants recruited to a multi-year longitudinal study via Prolific
Kothe, E. J., & Ling, M. (2019) · doi:10.31234/osf.io/5yv2u · Cited by 42
Musi, E., Carmi, E., Reed, C., Yates, S., & O’Halloran, K. (2023) · Social Media + Society · doi:10.1177/20563051221150407 · Cited by 34
Metadata
- Authors
- Strickland, J. C., & Stoops, W. W.
- Venue
- Experimental and Clinical Psychopharmacology
- Published
- 2019-02
- Volume
- 27
- Issue
- 1
- Pages
- 1-18
- ISSN
- 1064-1297 (ISSN-L)
- 1936-2293
- OpenAlex
- W2903296215
- Cited by
- 250
- References
- 32
- FWCI
- 29.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.