Is Amazon’s Mechanical Turk (MTurk) a comparable recruitment source for trauma studies?
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Trauma researchers have recently begun using Amazon's Mechanical Turk (MTurk) as a data collection platform that is both time- and cost-efficient. Research is needed to determine the utility, generalizability, and validity of MTurk as a recruitment source for trauma-exposed samples. METHOD: Data were collected from 266 trauma-exposed MTurk participants on several clinical and psychological constructs relevant to trauma research. The mean scores, prevalence rates, and correlation strengths of the MTurk sample were compared to those reported in previously published studies of undergraduate, community, and treatment-seeking samples. RESULTS: Findings indicated that prevalence rates of posttraumatic stress disorder (PTSD) and depression were not significantly different from comparison samples, but prevalence rates of generalized anxiety were significantly higher than that of a community sample. The MTurk sample showed significantly lower mean scores of PTSD, depression, and generalized anxiety symptoms than all comparison samples. Correlations were examined to determine whether established relationships between common trauma-related constructs were correlated for MTurk participants as they were in other samples. Correlations between PTSD symptom severity, posttraumatic cognitions (PTCs), and trauma coping self-efficacy (CSE-T) in the MTurk sample were not significantly different from the correlations observed in all comparison samples. Finally, MTurk participants who met criteria for probable PTSD scored significantly higher on measures of depression, generalized anxiety, and PTCs, and lower on CSE-T, than those without probable PTSD. CONCLUSIONS: Future trauma researchers utilizing MTurk should consider potential similarities and differences between MTurk samples and community, clinical, and undergraduate samples when interpreting the generalizability of findings. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22059 · Cited by 5,233
Predictors of posttraumatic stress disorder and symptoms in adults: a meta-analysis
Ozer, E. J., Best, S. R., Lipsey, T. L., & Weiss, D. S. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.1.52 · Cited by 3,322
Bovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., & Keane, T. M. (2016) · Psychological Assessment · doi:10.1037/pas0000254 · Cited by 2,532
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.005 · Cited by 1,882
The Posttraumatic Cognitions Inventory (PTCI): development and validation
Foa, E. B., Ehlers, A., Clark, D. M., Tolin, D. F., & Orsillo, S. M. (1999) · Psychological Assessment · doi:10.1037/1040-3590.11.3.303 · Cited by 1,727
Using Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139
Pietrzak, R. H., Goldstein, R. B., Southwick, S. M., & Grant, B. F. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.11.010 · Cited by 963
Santiago, P. N., Ursano, R. J., Gray, C. L., Pynoos, R. S., Spiegel, D., Lewis-Fernandez, R., Friedman, M. J., & Fullerton, C. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059236 · Cited by 536
A comparison of PTSD symptom patterns in three types of civilian trauma
Kelley, L. P., Weathers, F. W., McDevitt‐Murphy, M. E., Eakin, D. E., & Flood, A. M. (2009) · Journal of Traumatic Stress · doi:10.1002/jts.20406 · Cited by 204
Trauma in the Lives of Older Men: Findings from the Normative Aging Study
Schnurr, P. P., Spiro, A., Vielhauer, M. J., Findler, M. N., & Hamblen, J. L. (2002) · Journal of Clinical Geropsychology · doi:10.1023/a:1015992110544 · Cited by 204
Psychological Processes Related to Recovery from a Trauma and an Effective Treatment for PTSD
FOA, E. B. (1997) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1997.tb48295.x · Cited by 139
Latent profile analysis and principal axis factoring of the DSM-5 dissociative subtype
Frewen, P. A., Brown, M. F. D., Steuwe, C., & Lanius, R. A. (2015) · European Journal of Psychotraumatology · doi:10.3402/ejpt.v6.26406 · Cited by 78
Erwin, M. C., Mitchell, M. A., Contractor, A. A., Dranger, P., Charak, R., & Elhai, J. D. (2018) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2018.01.012 · Cited by 27
Frewen, P. A., Brown, M. F. D., & Lanius, R. A. (2017) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000091 · Cited by 27
Cited by
Coping during the COVID-19 pandemic: Relations with mental health and quality of life.
Shamblaw, A. L., Rumas, R. L., & Best, M. W. (2021) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000263 · Cited by 156
Liebman, R. E., Becker, K. R., Smith, K. E., Cao, L., Keshishian, A. C., Crosby, R. D., Eddy, K. T., & Thomas, J. J. (2021) · Journal of Traumatic Stress · doi:10.1002/jts.22644 · Cited by 27
Alsubaie, M. K., Dolezal, M., Sheikh, I. S., Rosencrans, P., Walker, R. S., Zoellner, L. A., & Bentley, J. (2021) · Mental Health, Religion & Culture · doi:10.1080/13674676.2021.1973978 · Cited by 28
“…literature points toward the utility of using MTurk as a recruiting method of trauma-exposed participants, especially since no significant differences between MTurk and other recruitment methods were found pertaining to correlations between PTSD and post-trauma adaptation (Engle et al., 2019).”
Background
Metadata
- Authors
- Engle, K., Talbot, M., & Samuelson, K. W.
- Venue
- Psychological Trauma: Theory, Research, Practice, and Policy
- Published
- 2020-05
- Volume
- 12
- Issue
- 4
- Pages
- 381-388
- ISSN
- 1942-9681 (ISSN-L)
- 1942-969X
- OpenAlex
- W2966160774
- Cited by
- 52
- References
- 16
- FWCI
- 9.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.