Can Non-full-probability Internet Surveys Yield Useful Data? A Comparison with Full-probability Face-to-face Surveys in the Domain of Race and Social Inequality Attitudes
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The authors investigate the potential utility of Web-based surveys of non-full-probabilistically sampled respondents for social science research. Specifically, they compare demographic, attitude response, and multivariate model results produced by two distinct survey modalities: the traditional full-probability sample face-to-face survey and the non-full-probability Web survey. Using data from the 2009 Race Cues, Attitudes, and Punitiveness Survey (RCAPS), the 2008 General Social Survey (GSS), and the 2008 American National Election Study (ANES), the authors find that (1) the unweighted demographic differences between surveys tend to be slight; (2) in comparison with GSS and ANES respondents, RCAPS respondents are more interested in politics and ideologically polarized; (3) in comparison with ANES respondents, RCAPS respondents are more racially and socially conservative, often selecting the most extreme response option; (4) when the dependent variable is a more general and abstract measure of social attitudes, the multivariate models generated by the ANES and RCAPS show several differences that are trivial in magnitude, but when the dependent variable is a more specific and concrete measure, the models show remarkable similarity; and (5) RCAPS multivariate models consistently explain more variance than ANES models. Overall, these findings show both substantial similarities across the two survey modalities as well as a few clear, reasonably well-specified differences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sears, D. O. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.3.515 · Cited by 2,119
Whatever does not kill us: cumulative lifetime adversity, vulnerability, and resilience
Seery, M. D., Holman, E. A., & Silver, R. C. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0021344 · Cited by 954
THE CENTRALITY OF RACE IN AMERICAN POLITICS
Hutchings, V. L., & Valentino, N. A. (2004) · Annual Review of Political Science · doi:10.1146/annurev.polisci.7.012003.104859 · Cited by 493 · cited 1×
“…attitudes (e.g., Malhotra and Krosnick 2007; Chang and Krosnick 2009; Stephenson and Crête 2011), this project advances the literature by focusing on social attitudes that underlie support for public policies: egalitarianism and racial resentment (Krysan 2000; Hutchings and Valentino 2004).”
Background
Cited by
Graham, A., Pickett, J. T., & Cullen, F. T. (2021) · Crime & Delinquency · doi:10.1177/0011128720977439 · Cited by 114
“Simmons and Bobo (2015), for example, found evidence suggesting YouGov’s sample matching method eliminated bias in regression models predicting egalitarianism, but not in those predicting racial resentment.”
BackgroundResultInfluentialPublic Support for Policies to Reduce School Shootings: A Moral-Altruistic Model
Burton, A. L., Pickett, J. T., Jonson, C. L., Cullen, F. T., & Burton, V. S. (2021) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427820953202 · Cited by 86
Silver, E., Goff, K., & Iceland, J. (2022) · Criminology · doi:10.1111/1745-9125.12303 · Cited by 59
Attributions as Anchors: How the Public Explains School Shootings and Why It Matters
Lee, H., Pickett, J. T., Burton, A. L., Cullen, F. T., Jonson, C. L., & Burton, Jr. (2022) · Justice Quarterly · doi:10.1080/07418825.2020.1769710 · Cited by 31
Understanding How to Administer Voice Surveys through Smart Speakers
Wei, J., Jiang, W., Wang, C., Yu, D., Goncalves, J., Dingler, T., & Kostakos, V. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555606 · Cited by 9
Metadata
- Authors
- Simmons, A. D., & Bobo, L. D.
- Venue
- Sociological Methodology
- Publisher
- SAGE Publications
- Published
- 2015-03-11
- Volume
- 45
- Issue
- 1
- Pages
- 357-387
- ISSN
- 0081-1750 (ISSN-L)
- 1467-9531
- OpenAlex
- W2038617379
- Cited by
- 187
- References
- 3
- FWCI
- 24.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can Non-full-probability Internet Surveys Yield Useful Data? A Comparison with Full-probability Face-to-face Surveys in the Domain of Race and Social Inequality Attitudes. https://app.cochat.ai/papers/10.1177/0081175015570096
- The paper
- Simmons, A. D., & Bobo, L. D. (2015). Can Non-full-probability Internet Surveys Yield Useful Data? A Comparison with Full-probability Face-to-face Surveys in the Domain of Race and Social Inequality Attitudes. Sociological Methodology. https://doi.org/10.1177/0081175015570096
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.