The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Social Media, Web, and Panel Surveys: Using Non‐Probability Samples in Social and Policy Research
Open accessAbstract
The use of online surveys has grown rapidly in social science and policy research, surpassing more established methods. We argue that a better understanding is needed, especially of the strengths and weaknesses of non‐probability online surveys, which can be conducted relatively quickly and cheaply. We describe two common approaches to non‐probability online surveys—river and panel sampling—and theorize their inherent selection biases: namely, topical self‐selection and economic self‐selection. We conduct an empirical comparison of two river samples (Facebook and web‐based sample) and one panel sample (from a major survey research company) with benchmark data grounded in a comprehensive population registry. The river samples diverge from the benchmark on demographic variables and yield much higher frequencies on non‐demographic variables, even after demographic adjustments; we attribute this to topical self‐selection. The panel sample is closer to the benchmark. When examining the characteristics of a non‐demographic subpopulation, we detect no differences between the river and panel samples. We conclude that non‐probability online surveys do not replace probability surveys, but augment the researcher's toolkit with new digital practices, such as exploratory studies of small and emerging non‐demographic subpopulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Encyclopedia of Survey Research Methods
Lavrakas, P. (2008) · doi:10.4135/9781412963947 · Cited by 2,689
The Deepening Divide: Inequality in the Information Society
van Dijk, J. (2005) · doi:10.4135/9781452229812 · Cited by 2,243
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Second-Level Digital Divide: Differences in People's Online Skills
Hargittai, E. (2002) · First Monday · doi:10.5210/fm.v7i4.942 · Cited by 1,951
Big data: a revolution that will transform how we live, work, and think
Armstrong, K. (2014) · Information, Communication & Society · doi:10.1080/1369118x.2014.923482 · Cited by 1,629
Bethlehem, J. (2010) · International Statistical Review · doi:10.1111/j.1751-5823.2010.00112.x · Cited by 1,315
Survey Errors and Survey Costs
Groves, R. M. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725277 · Cited by 1,062
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Chang, L., & Krosnick, J. A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp075 · Cited by 955
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 925
Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey
Keeter, S., Kennedy, C., Dimock, M., Best, J., & Craighill, P. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl035 · Cited by 902
Second-Level Digital Divide: Differences in People's Online Skills
Hargittai, E. (2007) · Defence Science Journal · Cited by 843
Yeager, D. S., Krosnick, J. A., Chang, L., Javitz, H. S., Levendusky, M. S., Simpser, A., & Wang, R. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr020 · Cited by 758
Weinberg, J., Freese, J., & McElhattan, D. (2014) · Sociological Science · doi:10.15195/v1.a19 · Cited by 582
Flexibility in the gig economy: managing time on three online piecework platforms
Lehdonvirta, V. (2018) · New Technology, Work and Employment · doi:10.1111/ntwe.12102 · Cited by 550
Self-citationComputing Response Metrics for Online Panels
Callegaro, M., & DiSogra, C. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn065 · Cited by 512
Comparative Response to a Survey Executed by Post, E-mail, & Web Form
Yun, G. W., & Trumbo, C. W. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2000.tb00112.x · Cited by 464
‘Vaping’ profiles and preferences: an online survey of electronic cigarette users
Dawkins, L., Turner, J., Roberts, A., & Soar, K. (2013) · Addiction · doi:10.1111/add.12150 · Cited by 461
Generalizability of heterogeneous treatment effect estimates across samples
Coppock, A., Leeper, T. J., & Mullinix, K. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808083115 · Cited by 445
Malhotra, N., & Krosnick, J. A. (2007) · Political Analysis · doi:10.1093/pan/mpm003 · Cited by 268
Dreßing, H., Bailer, J., Anders, A., Wagner, H., & Gallas, C. (2014) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2012.0231 · Cited by 242
The Digital Divide Among Twitter Users and Its Implications for Social Research
Blank, G. (2017) · Social Science Computer Review · doi:10.1177/0894439316671698 · Cited by 225
Self-citationNormalizing Heterosexuality: Mothers' Assumptions, Talk, and Strategies with Young Children
Martin, K. A. (2009) · American Sociological Review · doi:10.1177/000312240907400202 · Cited by 206
Online Panel Research: Data Quality Perspective, A
(2014) · doi:10.1002/9781118763520 · Cited by 184
Social science in the era of big data
González‐Bailón, S. (2013) · Policy & Internet · doi:10.1002/1944-2866.poi328 · Cited by 161
The characteristics of those in the gig economy: final report
Lepanjuuri, K., Wishart, R. P., & Cornick, P. (2018) · Cited by 148
Lugtig, P. J., & Toepoel, V. (2015) · Social Science Computer Review · doi:10.1177/0894439315574248 · Cited by 141
Professional respondents in nonprobability online panels
Hillygus, D. S., Jackson, N., & Young, M. (2014) · Wiley eBooks · doi:10.1002/9781118763520.ch10 · Cited by 139
Self-Selected and Randomly Selected Respondents in a Computer Network Survey
Walsh, J. P., Kiesler, S. B., Sproull, L. S., & Hesse, B. W. (1992) · Public Opinion Quarterly · doi:10.1086/269315 · Cited by 111
Helweg‐Larsen, K., Schütt, N., & Larsen, H. B. (2012) · Acta Paediatrica · doi:10.1111/j.1651-2227.2011.02587.x · Cited by 109
Online Hate and Harmful Content: Cross-national perspectivesPreprint
Jacques, S. (2016) · CrimRxiv · doi:10.21428/cb6ab371.bb1bcc50 · Cited by 96
Internet Surveys: Can Statistical Adjustments Eliminate Coverage Bias?
Dever, J. A., Rafferty, A. P., & Valliant, R. L. (2007) · Survey research methods · doi:10.18148/srm/2008.v2i2.128 · Cited by 90
Couper, M. P., Singer, E., Conrad, F. G., & Groves, R. M. (2008) · PubMed · Cited by 79
Cowbirds, Locals, and the Dynamic Endurance of Regionalism
Griswold, W., & Wright, N. (2004) · American Journal of Sociology · doi:10.1086/381773 · Cited by 77
Redistribution and the New Fiscal Sociology: Race and the Progressivity of State and Local Taxes
O’Brien, R. (2017) · American Journal of Sociology · doi:10.1086/690118 · Cited by 57
Bošnjak, M., Das, M., & Lynn, P. J. (2015) · Social Science Computer Review · doi:10.1177/0894439315579246 · Cited by 51
Näsi, M., Räsänen, P., Oksanen, A., E.Hawdon, J., Keipi, T., & Holkeri, E. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.019 · Cited by 48
Self-citationSolving the Nonresponse Problem With Sample Matching?
Bethlehem, J. G. (2015) · Social Science Computer Review · doi:10.1177/0894439315573926 · Cited by 43
Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels
DiSogra, C., & Callegaro, M. (2015) · Social Science Computer Review · doi:10.1177/0894439315573925 · Cited by 23
Räsänen, P. (2006) · International Journal of Sociology and Social Policy · doi:10.1108/01443330610644425 · Cited by 19
Self-citationPink and Blue Pixel$: Gender and Economic Disparity in Two Massive Online Games
Lehdonvirta, V., Ratan, R., Kennedy, T. L. M., & Williams, D. C. (2014) · The Information Society · doi:10.1080/01972243.2014.915277 · Cited by 15
Self-citationFang, J., Wen, C., & Prybutok, V. R. (2012) · Behaviour and Information Technology · doi:10.1080/0144929x.2012.751621 · Cited by 13
Online Research Methods and Social Theory
Blank, G. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473957992.n36 · Cited by 11
Self-citationEssay: Sunday shopping - The case of three surveys
Bethlehem, J. G. (2015) · Survey research methods · doi:10.18148/srm/2015.v9i3.6202 · Cited by 10
Cosmopolitanism through mobility: physical‐corporeal or virtual‐imagined?
Petzold, K. (2017) · British Journal of Sociology · doi:10.1111/1468-4446.12253 · Cited by 10
Cited by
Daily emotional well‐being during the COVID‐19 pandemic
Lades, L. K., Laffan, K., Daly, M., & Delaney, L. (2020) · British Journal of Health Psychology · doi:10.1111/bjhp.12450 · Cited by 448
Exploring the boundaries of open innovation: Evidence from social media mining
Saura, J. R., Palacios-Marqués, D., & Ribeiro-Soriano, D. (2023) · Technovation · doi:10.1016/j.technovation.2021.102447 · Cited by 256
The influence of media exposure on anxiety and working memory during lockdown period in Italy.
Fabio, R. A., & Suriano, R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179279 · Cited by 33
Baum, M. A., Druckman, J. N., Simonson, M. D., Lin, J., & Perlis, R. H. (2024) · American Journal of Political Science · doi:10.1111/ajps.12827 · Cited by 31
Moisoglou, I., Katsiroumpa, A., Konstantakopoulou, O., Yfantis, A., Galani, O., Tsiachri, M., Peleka, P., Katsiroumpa, Z., & Galanis, P. (2026) · Healthcare · doi:10.3390/healthcare14040425 · Cited by 2
Metadata
- Authors
- Lehdonvirta, V., Oksanen, A., Räsänen, P., & Blank, G.
- Venue
- Policy & Internet
- Publisher
- Wiley
- Published
- 2020-04-29
- Volume
- 13
- Issue
- 1
- Pages
- 134-155
- ISSN
- 1944-2866 (ISSN-L)
- OpenAlex
- W3021769827
- Cited by
- 393
- References
- 44
- FWCI
- 56.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.