CoChat

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note

Graham, Amanda, Pickett, Justin T., Cullen, Francis T. · 2021 · Crime & Delinquency

Abstract

Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Not all opt-in samples are alike, however, and matching may improve data quality. Replicating and extending prior work, we compare the generalizability of relational inferences from unmatched and matched opt-in samples. Estimating identical models for four criminal justice outcomes, we compare multivariate regression results from national matched (YouGov) and unmatched (MTurk) opt-in samples to those from the General Social Survey (GSS). YouGov coefficients are almost always in the same direction as GSS coefficients, especially when statistically significant, and are mostly of a similar magnitude; less than 10% of the YouGov and GSS coefficients differ significantly. By contrast, MTurk coefficients are more likely to be in the wrong direction, more likely to be much larger or smaller, and are about three times as likely to differ significantly from GSS coefficients. Matched opt-in samples provide a relatively inexpensive data source for criminal justice researchers, compared to probability samples, and also appear to carry a smaller generalizability penalty than unmatched samples. Our study suggests relational inferences from matched opt-in samples are more likely to generalize than those from unmatched samples.

Overview

Integrity signals

Registry

Crossref · 10.1177/0011128720977439

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 46 references

Research works printed but not linked: 2

  1. Groves R. M., 2009, Survey methodology
  2. Mercer A., 2018, For weighting online opt-in samples, what matters most

Cited by

See all 114

Metadata

Authors
Graham, A., Pickett, J. T., & Cullen, F. T.
Affiliations
  • Georgia Southern University (US)
  • University at Albany, State University of New York (US)
  • University of Cincinnati (US)
Corresponding author
Graham, Amanda
Venue
Crime & Delinquency
Published
2020-12-07
Volume
67
Issue
12
Pages
1962-1981
ISSN
  • 0011-1287 (ISSN-L)
  • 1552-387X
OpenAlex
W3111058860
Cited by
114
References
46
Citations by year
2026: 22 · 2025: 27 · 2024: 22 · 2023: 16 · 2022: 13 · 2021: 14
FWCI
14.37
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Crime & Delinquency (publishedVersion)
Topics
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
  • Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
  • Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
Keywords
matched samples, generalizability, criminal justice attitudes, Amazon Mechanical Turk, General Social Survey, data quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note. https://app.cochat.ai/papers/10.1177/0011128720977439
The paper
Graham, A., Pickett, J. T., & Cullen, F. T. (2021). Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note. Crime & Delinquency. https://doi.org/10.1177/0011128720977439

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.