Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.

The Demographic and Political Composition of Mechanical Turk Samples

Open access
Levay, Kevin E., Freese, Jeremy, Druckman, James N. · 2016 · Sage Open

Abstract

One of the most notable recent developments in survey research is the increased usage of online convenience samples drawn from Amazon’s Mechanical Turk (MTurk). While scholars have noted various social and political differences (e.g., age, partisanship) between MTurk and population-based samples, the breadth and depth of these variations remain unclear. We investigate the extent to which MTurk samples differ from population samples, and the underlying nature of these differences. We do so by replicating items from the population-based American National Election Studies (ANES) 2012 Time Series Study in a survey administered to a sample of MTurk respondents. With few exceptions, we not only find that MTurk respondents differ significantly from respondents completing the 2012 ANES via the Web but also that most differences are reduced considerably when controlling for easily measurable sample features. Thus, MTurk respondents do not appear to differ fundamentally from population-based respondents in unmeasurable ways. This suggests that MTurk data can be used to advance research programs, particularly if researchers measure and account for a range of political and demographic variables as needed.

Overview

Integrity signals

Registry

Crossref · 10.1177/2158244016636433

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 26 references

Research works printed but not linked: 2

  1. Leeper T. J., 2013, The Political Methodologist, 2, 2
  2. Mason W. A., 2009, Association for Computing Machinery Explorations Newsletter, 11, 100

Cited by

See all 785

Metadata

Authors
Levay, K. E., Freese, J., & Druckman, J. N.
Affiliations
  • Northwestern University (US)
  • Stanford University, CA, USA
Corresponding author
Druckman, James N.
Venue
Sage Open
Published
2016-01-01
Volume
6
Issue
1
ISSN
2158-2440 (ISSN-L)
OpenAlex
W2301926123
Cited by
676
References
26
Citations by year
2026: 21 · 2025: 48 · 2024: 58 · 2023: 75 · 2022: 88 · 2021: 103 · 2020: 103 · 2019: 72 · 2018: 61 · 2017: 38 · 2016: 8
FWCI
170.58
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • SAGE Open (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
  • Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
  • Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
Keywords
Mechanical Turk, sample representativeness, demographic structure, political composition, partisanship, American National Election Studies, replication, survey sampling bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Demographic and Political Composition of Mechanical Turk Samples. https://app.cochat.ai/papers/10.1177/2158244016636433
The paper
Levay, K. E., Freese, J., & Druckman, J. N. (2016). The Demographic and Political Composition of Mechanical Turk Samples. Sage Open. https://doi.org/10.1177/2158244016636433

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.