The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Selection Bias in Web Surveys and the Use of Propensity Scores
Open accessAbstract
Web surveys are a popular survey mode, but the subpopulation with Internet access may not represent the population of interest. The authors investigate whether adjusting using weights or matching on a small set of variables makes the distributions of target variables representative of the population. This application has a rich sampling design; the Internet sample is part of an existing probability sample, the Health and Retirement Study, that is representative of the U.S. population aged 50 and older. For the dichotomous variables investigated, the adjustment helps. On average, the sample means in the Internet access sample differ by 6.5 percent before and 3.7 percent after adjustment. Still, a large number of adjusted estimates remain significantly different from their target estimates based on the complete sample. This casts doubt on the common procedure to use only a few variables to correct for the selectivity of convenience samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Self-citationSurvey Errors and Survey Costs.
Faulkenberry, G. D., & Groves, R. M. (1990) · Journal of the American Statistical Association · doi:10.2307/2289634 · Cited by 1,438
An Overview of the Health and Retirement Study
Juster, F. T., & Suzman, R. (1995) · The Journal of Human Resources · doi:10.2307/146277 · Cited by 1,435
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
Rao, J. N. K., & Scott, A. J. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346391 · Cited by 1,280
Diamond, A., & Sekhon, J. S. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,102
Matching Using Estimated Propensity Scores: Relating Theory to Practice
Rubin, D. B., & Thomas, N. (1996) · Biometrics · doi:10.2307/2533160 · Cited by 1,074
Survey Errors and Survey Costs
Groves, R. M. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725277 · Cited by 1,062
Matching Using Estimated Propensity Scores: Relating Theory to Practice
Thomas, N. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.024 · Cited by 1,018
Rao, J. N. K., & Scott, A. J. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477633 · Cited by 1,007
Nonresponse in Household Interview Surveys
Ziegel, E. R., Groves, R. M., & Couper, M. P. (1999) · Technometrics · doi:10.2307/1271375 · Cited by 1,003
Self-citationRosenbaum, P. R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478441 · Cited by 997
The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies
Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
Human Research and Data Collection via the Internet
Birnbaum, M. H. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141601 · Cited by 869
Nonresponse in Household Interview Surveys
Groves, R. M., & Couper, M. P. (1998) · doi:10.1002/9781118490082 · Cited by 761
Self-citationConducting Research Surveys via E-mail and the Web
(2002) · RAND Corporation eBooks · doi:10.7249/mr1480 · Cited by 597
Singha, T. M. (2003) · Journal of Nepal Medical Association · doi:10.31729/jnma.1154 · Cited by 582
Comparing Data from Online and Face-to-face Surveys
Duffy, B., Smith, K., Terhanian, G., & Bremer, J. (2005) · International Journal of Market Research · doi:10.1177/147078530504700602 · Cited by 568
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2_1 · Cited by 484
Context Effects in Social and Psychological Research
(1992) · Springer eBooks · doi:10.1007/978-1-4612-2848-6 · Cited by 429
Age Differences in Attitudes Toward Computers
Czaja, S. J., & Sharit, J. (1998) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/53b.5.p329 · Cited by 380
On representative social capital
Bellemare, C., & Kröger, S. (2007) · European Economic Review · doi:10.1016/j.euroecorev.2006.03.006 · Cited by 371
Berrens, R. P., Bohara, A. K., Jenkins-Smith, H., Silva, C., & Weimer, D. L. (2003) · Political Analysis · doi:10.1093/pan/11.1.1 · Cited by 364
Noncoverage and nonresponse in an Internet survey
Couper, M. P., Kapteyn, A., Schonlau, M., & Winter, J. (2007) · Social Science Research · doi:10.1016/j.ssresearch.2005.10.002 · Cited by 292
Self-citationA Survey of World Wide Web Use in Middle-Aged and Older Adults
Morrell, R. W., Mayhorn, C. B., & Bennett, J. (2000) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779656444 · Cited by 240
Causal Inference in the Social and Behavioral Sciences
Sobel, M. E. (1995) · Springer eBooks · doi:10.1007/978-1-4899-1292-3_1 · Cited by 188
Propensity score adjustment as a weighting scheme for volunteer panel web surveys
Lee, S.-H. (2006) · Journal of Official Statistics · Cited by 179
A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey
Schonlau, M., Zapert, K., Simon, L. P., Sanstad, K. H., Marcus, S. M., Adams, J., Spranca, M., Kan, H., Turner, R., & Berry, S. H. (2004) · Social Science Computer Review · doi:10.1177/0894439303256551 · Cited by 171
Self-citationSome Frontiers in Social Science
Butz, W., & Torrey, B. B. (2006) · Science · doi:10.1126/science.1130121 · Cited by 106
Projecting From Advance Data Using Propensity Modeling: An Application to Income and Tax Statistics
Czajka, J. L., Hirabayashi, S. M., Little, R. J. A., & Rubin, D. B. (1992) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1992.10509892 · Cited by 87
Causal Inference in Sociological Studies
Winship, C., & Sobel, M. E. (2004) · SAGE Publications Ltd eBooks · doi:10.4135/9781848608184.n21 · Cited by 81
Web Surveys as Part of a Mixed-Mode Strategy for Populations that cannot be Contacted by E-Mail
Schonlau, M., Asch, B. J., & Du, C. (2003) · Social Science Computer Review · doi:10.1177/0894439303021002007 · Cited by 56
Self-citationSurvey Sampling. By Leslie Kish. (New York: John Wiley & Sons, Inc., 1965. Pp. xvi, 643. $10.95.)
(1965) · American Political Science Review · doi:10.1017/s0003055400132113 · Cited by 41
The Answering Machine Generation: Who Are They and What Problem do They Pose for Survey Research?
Oldendick, R. W., & Link, M. (1994) · Public Opinion Quarterly · doi:10.1086/269422 · Cited by 40
Call Screening: Is It Really a Problem for Survey Research?
Link, M., & Oldendick, R. W. (1999) · Public Opinion Quarterly · doi:10.1086/297872 · Cited by 38
Smith, P. J., Rao, J. N., Battaglia, M. P., Ezzati‐Rice, T. M., Daniels, D. S., & Khare, M. (2001) · PubMed · Cited by 36
Iannacchione, V. G. (2003) · Journal of Official Statistics · Cited by 20
Comparing propensity score weighting with other Weighting Methods : A Case Study
Varedian, M. (2003) · Cited by 5
Cited by
Yeager, D. S., Krosnick, J. A., Chang, L., Javitz, H. S., Levendusky, M. S., Simpser, A., & Wang, R. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr020 · Cited by 758
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584
Self-citationComputing Response Metrics for Online Panels
Callegaro, M., & DiSogra, C. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn065 · Cited by 512
The role of urban green space for human well-being
Bertram, C., & Rehdanz, K. (2015) · Ecological Economics · doi:10.1016/j.ecolecon.2015.10.013 · Cited by 503
Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel
Liu, H., Cella, D., Gershon, R., Shen, J., Morales, L. S., Riley, W., & Hays, R. D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.021 · Cited by 446
Metadata
- Authors
- Schonlau, M., van Soest, A., Kapteyn, A., & Couper, M.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2009-02
- Volume
- 37
- Issue
- 3
- Pages
- 291-318
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2098695000
- Cited by
- 268
- References
- 42
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.