The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Nonresponse Rates and Nonresponse Bias in Household Surveys
Abstract
Many surveys of the U.S. household population are experiencing higher refusal rates. Nonresponse can, but need not, induce nonresponse bias in survey estimates. Recent empirical findings illustrate cases when the linkage between nonresponse rates and nonresponse biases is absent. Despite this, professional standards continue to urge high response rates. Statistical expressions of nonresponse bias can be translated into causal models to guide hypotheses about when nonresponse causes bias. Alternative designs to measure nonresponse bias exist, providing different but incomplete information about the nature of the bias. A synthesis of research studies estimating nonresponse bias shows the bias often present. A logical question at this moment in history is what advantage probability sample surveys have if they suffer from high nonresponse rates. Since postsurvey adjustment for nonresponse requires auxiliary variables, the answer depends on the nature of the design and the quality of the auxiliary variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“when a survey loses its overall statistical representativeness (for example, through bias in coverage or non-response), which is difficult to repair (for example, by weighting or modelling on observable characteristics) and almost impossible to verify 45”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [45]
In the citing paper
“While it has been shown that the empirical relationship between response rate and nonresponse bias is weak (Groves, 2006)”
From Severe role impairment associated with mental disorders: Results of the WHO World Mental Health Surveys International College Student Project (2018) · cites this paper as Groves, 2006
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
The Practice of Social Research
Neustadtl, A., & Babbie, E. R. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,434
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
The Practice of Social Research.
Williams, D. G., & Babbie, E. R. (1976) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062956 · Cited by 7,234
Mail and Telephone Surveys: The Total Design Method.
Babbie, E. R., & Dillman, D. A. (1982) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2068433 · Cited by 6,859
Mail and Telephone Surveys: The Total Design Method.
Osmond, M. W., & Dillman, D. A. (1979) · Social Forces · doi:10.2307/2577403 · Cited by 5,023
Dowdall, G. W., Singleton, R. A., Straits, B. C., Straits, M. N., & McAllister, R. J. (1989) · Teaching Sociology · doi:10.2307/1317936 · Cited by 2,821
Calibration Estimators in Survey Sampling
Deville, J.-C., & Särndal, C.-E. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475217 · Cited by 1,735
Nonresponse In Household Interview Surveys
Ziegel, E., Groves, R., & Couper, M. (1998) · Technometrics · doi:10.2307/1271375 · Cited by 1,283
Self-citationNeyman, J. (1934) · Journal of the Royal Statistical Society · doi:10.2307/2342192 · Cited by 1,086
Consequences of reducing nonresponse in a national telephone survey.
Keeter, S., Miller, C., Kohut, A., Groves, R., & Presser, S. (2000) · Public Opinion Quarterly · doi:10.1086/317759 · Cited by 1,063
Self-citation(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90035-r · Cited by 1,025
The Effects of Response Rate Changes on the Index of Consumer Sentiment
Curtin, R. T., Presser, S., & Singer, E. (2000) · Public Opinion Quarterly · doi:10.1086/318638 · Cited by 1,015
Heberlein, T. A., & Baumgartner, R. (1978) · American Sociological Review · doi:10.2307/2094771 · Cited by 999
Neyman, J. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_12 · Cited by 932
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R. T., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 929
Leverage-Saliency Theory of Survey Participation
Groves, R. M., Singer, E., & Corning, A. D. (2000) · Public Opinion Quarterly · doi:10.1086/317990 · Cited by 778
Self-citationNonresponse in Household Interview Surveys
Groves, R. M., & Couper, M. P. (1998) · doi:10.1002/9781118490082 · Cited by 761
Self-citationThe Role of Topic Interest in Survey Participation Decisions
Groves, R. M., Presser, S., & Dipko, S. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh002 · Cited by 680
Self-citationTrends in household survey nonresponse: a longitudinal and international comparison
de Leeuw, E. D., & de Heer, W. (2002) · Cited by 564
Estimation in Surveys with Nonresponse
Särndal, C., & Lundström, S. (2005) · Wiley eBooks · doi:10.1002/0470011351 · Cited by 499
Generalized Raking Procedures in Survey Sampling
Deville, J.-C., Särndal, C.-E., & Sautory, O. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476369 · Cited by 481
Pearson, K. (1903) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1903.0001 · Cited by 415
Albaum, G., Alreck, P. L., & Settle, R. B. (1985) · Journal of Marketing Research · doi:10.2307/3151595 · Cited by 391
Criqui, M. H., Barrett-Connor, E. L., & Austin, M. A. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112633 · Cited by 384
Analysis of non-response bias in a mailed health survey
Etter, J., & Perneger, T. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00166-2 · Cited by 360
Using Survey Participants to Estimate the Impact of Nonparticipation
Lin, I.-F., & Schaeffer, N. C. (1995) · Public Opinion Quarterly · doi:10.1086/269471 · Cited by 356
Generalized Raking Procedures in Survey Sampling
Deville, J., Särndal, C., & Sautory, O. (1993) · Journal of the American Statistical Association · doi:10.2307/2290793 · Cited by 296
Kott, P. S., Lessler, J. T., & Kalsbeek, W. D. (1993) · Journal of the American Statistical Association · doi:10.2307/2291300 · Cited by 291
The phantom respondents: opinion surveys and political representation
(1993) · Choice Reviews Online · doi:10.5860/choice.31-2316 · Cited by 276
Models for Nonresponse in Sample Surveys
Little, R. J. A. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477792 · Cited by 262
Goldberg, M. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.4.373 · Cited by 255
Compensating for missing survey data
Kalton, G. (1982) · Deep Blue (University of Michigan) · Cited by 237
The Effects of Black and White Interviewers on Black Responses in 1968
Schuman, H., & Converse, J. M. (1971) · Public Opinion Quarterly · doi:10.1086/267866 · Cited by 235
Investigating non-response bias in mail surveys.
Sheikh, K., & Mattingly, S. (1981) · Journal of Epidemiology & Community Health · doi:10.1136/jech.35.4.293 · Cited by 231
On the Validity of Inferences from Non-random Sample
Smith, T. M. F. (1983) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981454 · Cited by 217
American journal of epidemiology
(1993) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(93)91686-k · Cited by 185
NON-RESPONSE BIAS IN A SAMPLE SURVEY ON ALCOHOL CONSUMPTION
Lahaut, V. M. H. C. J. (2002) · Alcohol and Alcoholism · doi:10.1093/alcalc/37.3.256 · Cited by 164
On weighting the rates in non‐response weights
Little, R. J. A., & Vartivarian, S. (2003) · Statistics in Medicine · doi:10.1002/sim.1513 · Cited by 159
The Influence of Advance Letters on Response in Telephone Surveys: A Meta-Analysis
de Leeuw, E. D., Callegaro, M., Hox, J. J., Korendijk, E. J. H., & Lensvelt‐Mulders, G. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm014 · Cited by 146
Weighting nonresponse adjustments based on auxiliary information
Bethlehem, J. G. (2002) · UvA-DARE (University of Amsterdam) · Cited by 143
Face-to-Face Interviews and Mailed Questionnaires: The Net Difference in Response Rate
Goyder, J. (1985) · Public Opinion Quarterly · doi:10.1086/268917 · Cited by 142
Nonresponse Bias in a Survey of Patient Perceptions of Hospital Care
Perneger, T., Chamot, E., & BOVIER, P. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000156856.36901.40 · Cited by 142
Nonsampling vs. Sampling Errors in Survey Research
Assael, H., & Keon, J. W. (1982) · Journal of Marketing · doi:10.1177/002224298204600212 · Cited by 140
Employee attitude surveys: Examining the attitudes of noncompliant employees.
Rogelberg, S. G., Luong, A., Sederburg, M. E., & Cristol, D. S. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.2.284 · Cited by 139
Alternative Methods for CPS Income Imputation
David, M., Little, R. J. A., Samuhel, M. E., & Triest, R. K. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478235 · Cited by 136
Hudson, D., Seah, L.-H., Hite, D., & Haab, T. C. (2004) · Applied Economics Letters · doi:10.1080/13504850410001674876 · Cited by 134
Calibration as a Standard Method for Treatment of Nonresponse
Lundström, S. (1997) · Cited by 129
Self-Selected and Randomly Selected Respondents in a Computer Network Survey
Walsh, J. P., Kiesler, S. B., Sproull, L. S., & Hesse, B. W. (1992) · Public Opinion Quarterly · doi:10.1086/269315 · Cited by 111
Reijneveld, S. A. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.6.1134 · Cited by 104
Costs and Benefits of Improving Response Rates for a Hard-to-Reach Population
Teitler, J. O., Reichman, N. E., & Sprachman, S. (2003) · Public Opinion Quarterly · doi:10.1086/346011 · Cited by 101
Response Bias: Effect on Outcomes Evaluation by Mail Surveys After Total Knee Arthroplasty
Kim, J., Lonner, J. H., Nelson, C. L., & Lotke, P. A. (2004) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200401000-00004 · Cited by 100
Comparison of Early and Late Respondents to a Postal Health Survey Questionnaire
Paganini‐Hill, A., Hsu, G., Chao, A., & Ross, R. K. (1993) · Epidemiology · doi:10.1097/00001648-199307000-00014 · Cited by 98
Sample Surveys 1975-1990; An Age of Reconciliation?
Smith, T. M. F. (1994) · International Statistical Review · doi:10.2307/1403539 · Cited by 81
Poststratification and Conditional Variance Estimation
Valliant, R. L. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594298 · Cited by 79
The influence of topic involvement on mail‐survey response behavior
Kenhove, P. V., Wijnen, K., & Wulf, K. D. (2002) · Psychology and Marketing · doi:10.1002/mar.1053 · Cited by 77
Assessment of Weighting Methodology for the National Comorbidity Survey
Little, R. J. A., Lewitzky, S., Heeringa, S. G., Lepkowski, J. M., & Kessler, R. C. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009297 · Cited by 76
Barchielli, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.5.1038 · Cited by 68
Probability Sampling With Quotas: An Experiment
Stephenson, C. B. (1979) · Public Opinion Quarterly · doi:10.1086/268545 · Cited by 68
Messonnier, M. L., Bergstrom, J. C., Cornwell, C. M., Teasley, R. J., & Cordell, H. K. (2000) · American Journal of Agricultural Economics · doi:10.1111/0002-9092.00037 · Cited by 65
Non-response bias in studies of diabetic complications: The rochester diabetic neuropathy study
Melton, L. J., Dyck, P. J. B., Karnes, J. L., O’Brien, P. C., & Service, F. J. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90148-t · Cited by 61
Ziegel, E. R., Lessler, J. T., & Kalsbeek, W. D. (1993) · Technometrics · doi:10.2307/1270300 · Cited by 55
Sampling for Household Financial Characteristics Using Frame Information on Past Income
Kennickell, A. B., & McManus, D. A. (1993) · Cited by 53
Nonsampling vs. Sampling Errors in Survey Research
Assael, H., & Keon, J. W. (1982) · Journal of Marketing · doi:10.2307/3203346 · Cited by 52
Correcting for Nonavailability Bias in Surveys by Weighting Based on Number of Callbacks
Potthoff, R. F., Mantón, K. G., & Woodbury, M. A. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476399 · Cited by 51
Nonresponse Bias and Callbacks in Sample Surveys
Dunkelberg, W. C., & Day, G. S. (1973) · Journal of Marketing Research · doi:10.1177/002224377301000206 · Cited by 49
McNutt, L. (2000) · American Journal of Epidemiology · doi:10.1093/aje/152.5.438 · Cited by 47
An investigation into nonresponse bias in a postal survey on urinary symptoms
Dallosso, H. M., Matthews, R. J., McGrother, C. W., Clarke, M., Perry, S., Shaw, C., Jagger, C., & the Leicestershire MRC Incontinence Study Team (2003) · British Journal of Urology · doi:10.1046/j.1464-410x.2003.04172.x · Cited by 39
Roberts, P.-J., Roberts, C., Sibbald, B., & Torgerson, D. J. (2000) · Journal of Epidemiology & Community Health · doi:10.1136/jech.54.1.71 · Cited by 38
Nonresponse Bias and Stimulus Effects in the Dutch National Election Study
Voogt, R. J. J., & van Kempen, H. (2002) · Quality & Quantity · doi:10.1023/a:1020966227669 · Cited by 37
Nonresponse Bias and Callbacks in Sample Surveys
Dunkelberg, W. C., & Day, G. S. (1973) · Journal of Marketing Research · doi:10.2307/3149821 · Cited by 27
Those Not at Home: Riddle for Pollsters
Hilgard, E. R., & Payne, S. L. (1944) · Public Opinion Quarterly · doi:10.1086/265686 · Cited by 26
Brownstone, D. M., Golob, T. F., & Kazimi, C. (1999) · RePEc: Research Papers in Economics · Cited by 20
Comparison of the Likelihood to Vote Among Preelection Poll Respondents and Nonrespondents
Bolstein, R. (1991) · Public Opinion Quarterly · doi:10.1086/269287 · Cited by 12
ASCF Group, Bajos, N., & Spira, A. (1992) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/075910639203500103 · Cited by 12
Do safety practices differ between responders and non-responders to a safety questionnaire?
Kendrick, D., Hapgood, R., & Marsh, P. (2001) · Injury Prevention · doi:10.1136/ip.7.2.100 · Cited by 11
Izazola-Licea, J. A., Gortmaker, S. L., Gruttola, V. D., Tolbert, K., & Mann, J. M. (2000) · Salud Pública de México · doi:10.1590/s0036-36342000000200003 · Cited by 11
Non-Response Bias – A Study Using Matched Survey-Register Labour Market DataPreprint
Pedersen, P. J. (2002) · RePEc: Research Papers in Economics · Cited by 4
Grosset, J. M. (1994) · Cited by 2
Research works printed but not linked: 15
- AAPOR, 2006, Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Survey
- Bogen, 1996, The Effect of Questionnaire Length on Response Rates: A Review of the Literature, 1020
- Botman, 1992, Survey Design Features Correlates of Nonresponse, 309
- Brick, 2003, No. 8: 2002 NSAF Response Rates
- Brick, 2003, Dealing with Movers in a Longitudinal Study of Children, 2
- Brunner, 1969, The Effect of Prior Notification on the Refusal Rate in Fixed Address Surveys, Journal of Advertising, 9, 42
- Cannell, 1963, A Study of the Reporting Visits to Doctors in the National Health Survey
- Deville, 1991, A Theory of Quota Surveys, Survey Methodology, 17, 163
- Ekholm, 1991, Weighting via Response Modeling in the Finnish Household Budget Survey, Journal of Official Statistics, 7, 1325
- Groves, 2004, Survey Methodology
- Luppes, 2000, A Content Analysis of Advance Letters from Expenditure Surveys of Seven Countries, Journal of Official Statistics, 11, 461
- Merkle, 2002, Nonresponse in Exit Polls: A Comprehensive Analysis, 243
- Nealon, 1983, The Effects of Male vs. Female Telephone Interviewers, 139
- Office of Management and Budget (OMB), 2006, Questions and Answers When Designing Surveys for Information Collections
- Stephan, 1958, Sampling Opinions
Cited by
Sorted by citations
Putnam, R. D. (2007) · Scandinavian Political Studies · doi:10.1111/j.1467-9477.2007.00176.x · Cited by 4,027
Survey response rate levels and trends in organizational research
Baruch, Y., & Holtom, B. C. (2008) · Human Relations · doi:10.1177/0018726708094863 · Cited by 3,462
Contemporary Guidance for Stated Preference Studies
Johnston, R. J., Boyle, K., Adamowicz, W., Bennett, J., Brouwer, R., Cameron, T. A., Hanemann, W. M., Hanley, N. D., Ryan, M., Scarpa, R., et al. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/691697 · Cited by 1,566
The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
Groves, R. M., & Peytcheva, E. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn011 · Cited by 1,441
Self-citationStigma and Help Seeking for Mental Health Among College Students
Eisenberg, D., Downs, M. F., Golberstein, E., & Zivin, K. (2009) · Medical Care Research and Review · doi:10.1177/1077558709335173 · Cited by 1,193
Metadata
- Authors
- Groves, R. M.
- Affiliations
- U.S. National Science Foundation (US)
- Corresponding author
- Groves, Robert M.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2006
- Volume
- 70
- Issue
- 5
- Pages
- 646-675
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2116971494
- Cited by
- 2,420
- References
- 80
- Citations by year
- 2026: 90 · 2025: 78 · 2024: 87 · 2023: 90 · 2022: 103 · 2021: 129 · 2020: 152 · 2019: 133 · 2018: 152 · 2017: 161 · 2016: 155 · 2015: 176 · 2014: 170 · 2013: 152 · 2012: 163
- FWCI
- 193.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Public Opinion Quarterly (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Census and Population Estimation
- Keywords
- nonresponse bias, nonresponse rates, household surveys, response rate, auxiliary variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review