Nonresponse rates and nonresponse bias in household surveys
Abstract
Many surveys of the U.S. household population are experiencing higher refusal rates. Nonresponse can, but need not, induce nonresponse bias in survey estimates. Recent empirical findings illustrate cases when the linkage between nonresponse rates and nonresponse biases is absent. Despite this, professional standards continue to urge high response rates. Statistical expressions of nonresponse bias can be translated into causal models to guide hypotheses about when nonresponse causes bias. Alternative designs to measure nonresponse bias exist, providing different but incomplete information about the nature of the bias. A synthesis of research studies estimating nonresponse bias shows the bias often present. A logical question at this moment in history is what advantage probability sample surveys have if they suffer from high nonresponse rates. Since postsurvey adjustment for nonresponse requires auxiliary variables, the answer depends on the nature of the design and the quality of the auxiliary variables.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When a survey loses its overall statistical representativeness, it is difficult to repair and almost impossible to verify.
“when a survey loses its overall statistical representativeness (for example, through bias in coverage or non-response), which is difficult to repair (for example, by weighting or modelling on observable characteristics) and almost impossible to verify 45”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [45]
The empirical relationship between response rate and nonresponse bias is weak.
“While it has been shown that the empirical relationship between response rate and nonresponse bias is weak (Groves, 2006)”
From Severe role impairment associated with mental disorders: Results of the WHO World Mental Health Surveys International College Student Project (2018) · cites this paper as Groves, 2006
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
The Practice of Social Research
Neustadtl, A., & Babbie, E. R. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,424 · see citing works
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473 · see citing works
The Practice of Social Research.
Williams, D. G., & Babbie, E. R. (1976) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062956 · Cited by 7,222 · see citing works
Mail and Telephone Surveys: The Total Design Method.
Babbie, E. R., & Dillman, D. A. (1982) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2068433 · Cited by 6,859 · see citing works
Mail and Telephone Surveys: The Total Design Method.
Osmond, M. W., & Dillman, D. A. (1979) · Social Forces · doi:10.2307/2577403 · Cited by 5,023 · see citing works
Dowdall, G. W., Singleton, R. A., Straits, B. C., Straits, M. N., & McAllister, R. J. (1989) · Teaching Sociology · doi:10.2307/1317936 · Cited by 2,821 · see citing works
Calibration Estimators in Survey Sampling
Deville, J.-C., & Särndal, C.-E. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475217 · Cited by 1,735 · see citing works
Nonresponse In Household Interview Surveys
Ziegel, E., Groves, R., & Couper, M. (1998) · Technometrics · doi:10.2307/1271375 · Cited by 1,283 · see citing works
Self-citationNeyman, J. (1934) · Journal of the Royal Statistical Society · doi:10.2307/2342192 · Cited by 1,086 · see citing works
Consequences of reducing nonresponse in a national telephone survey.
Keeter, S., Miller, C., Kohut, A., Groves, R., & Presser, S. (2000) · Public Opinion Quarterly · doi:10.1086/317759 · Cited by 1,063 · see citing works
Self-citation(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90035-r · Cited by 1,025 · see citing works
The Effects of Response Rate Changes on the Index of Consumer Sentiment
Curtin, R. T., Presser, S., & Singer, E. (2000) · Public Opinion Quarterly · doi:10.1086/318638 · Cited by 1,015 · see citing works
Heberlein, T. A., & Baumgartner, R. (1978) · American Sociological Review · doi:10.2307/2094771 · Cited by 999 · see citing works
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R. T., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 936 · see citing works
Neyman, J. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_12 · Cited by 932 · see citing works
Leverage-Saliency Theory of Survey Participation
Groves, R. M., Singer, E., & Corning, A. D. (2000) · Public Opinion Quarterly · doi:10.1086/317990 · Cited by 778 · see citing works
Self-citationNonresponse in Household Interview Surveys
Groves, R. M., & Couper, M. P. (1998) · doi:10.1002/9781118490082 · Cited by 761 · see citing works
Self-citationThe Role of Topic Interest in Survey Participation Decisions
Groves, R. M., Presser, S., & Dipko, S. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh002 · Cited by 680 · see citing works
Self-citationTrends in household survey nonresponse: a longitudinal and international comparison
de Leeuw, E. D., & de Heer, W. (2002) · Cited by 564 · see citing works
Estimation in Surveys with Nonresponse
Särndal, C., & Lundström, S. (2005) · Wiley eBooks · doi:10.1002/0470011351 · Cited by 499 · see citing works
Generalized Raking Procedures in Survey Sampling
Deville, J.-C., Särndal, C.-E., & Sautory, O. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476369 · Cited by 481 · see citing works
Pearson, K. (1903) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1903.0001 · Cited by 415 · see citing works
Albaum, G., Alreck, P. L., & Settle, R. B. (1985) · Journal of Marketing Research · doi:10.2307/3151595 · Cited by 391 · see citing works
Criqui, M. H., Barrett-Connor, E. L., & Austin, M. A. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112633 · Cited by 387 · see citing works
Using Survey Participants to Estimate the Impact of Nonparticipation
Lin, I.-F., & Schaeffer, N. C. (1995) · Public Opinion Quarterly · doi:10.1086/269471 · Cited by 356 · see citing works
Analysis of non-response bias in a mailed health survey
Etter, J., & Perneger, T. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00166-2 · Cited by 352 · see citing works
Generalized Raking Procedures in Survey Sampling
Deville, J., Särndal, C., & Sautory, O. (1993) · Journal of the American Statistical Association · doi:10.2307/2290793 · Cited by 296 · see citing works
Kott, P. S., Lessler, J. T., & Kalsbeek, W. D. (1993) · Journal of the American Statistical Association · doi:10.2307/2291300 · Cited by 291 · see citing works
The phantom respondents: opinion surveys and political representation
(1993) · Choice Reviews Online · doi:10.5860/choice.31-2316 · Cited by 276 · see citing works
Models for Nonresponse in Sample Surveys
Little, R. J. A. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477792 · Cited by 262 · see citing works
Goldberg, M. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.4.373 · Cited by 255 · see citing works
Compensating for missing survey data
Kalton, G. (1982) · Deep Blue (University of Michigan) · Cited by 237 · see citing works
The Effects of Black and White Interviewers on Black Responses in 1968
Schuman, H., & Converse, J. M. (1971) · Public Opinion Quarterly · doi:10.1086/267866 · Cited by 235 · see citing works
Investigating non-response bias in mail surveys.
Sheikh, K., & Mattingly, S. (1981) · Journal of Epidemiology & Community Health · doi:10.1136/jech.35.4.293 · Cited by 231 · see citing works
On the Validity of Inferences from Non-random Sample
Smith, T. M. F. (1983) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981454 · Cited by 212 · see citing works
American journal of epidemiology
(1993) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(93)91686-k · Cited by 179 · see citing works
NON-RESPONSE BIAS IN A SAMPLE SURVEY ON ALCOHOL CONSUMPTION
Lahaut, V. M. H. C. J. (2002) · Alcohol and Alcoholism · doi:10.1093/alcalc/37.3.256 · Cited by 164 · see citing works
On weighting the rates in non‐response weights
Little, R. J. A., & Vartivarian, S. (2003) · Statistics in Medicine · doi:10.1002/sim.1513 · Cited by 159 · see citing works
The Influence of Advance Letters on Response in Telephone Surveys: A Meta-Analysis
de Leeuw, E. D., Callegaro, M., Hox, J. J., Korendijk, E. J. H., & Lensvelt‐Mulders, G. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm014 · Cited by 146 · see citing works
Weighting nonresponse adjustments based on auxiliary information
Bethlehem, J. G. (2002) · UvA-DARE (University of Amsterdam) · Cited by 143 · see citing works
Face-to-Face Interviews and Mailed Questionnaires: The Net Difference in Response Rate
Goyder, J. (1985) · Public Opinion Quarterly · doi:10.1086/268917 · Cited by 142 · see citing works
Nonresponse Bias in a Survey of Patient Perceptions of Hospital Care
Perneger, T., Chamot, E., & BOVIER, P. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000156856.36901.40 · Cited by 142 · see citing works
Nonsampling vs. Sampling Errors in Survey Research
Assael, H., & Keon, J. W. (1982) · Journal of Marketing · doi:10.1177/002224298204600212 · Cited by 140 · see citing works
Employee attitude surveys: Examining the attitudes of noncompliant employees.
Rogelberg, S. G., Luong, A., Sederburg, M. E., & Cristol, D. S. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.2.284 · Cited by 139 · see citing works
Alternative Methods for CPS Income Imputation
David, M., Little, R. J. A., Samuhel, M. E., & Triest, R. K. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478235 · Cited by 136 · see citing works
Hudson, D., Seah, L.-H., Hite, D., & Haab, T. C. (2004) · Applied Economics Letters · doi:10.1080/13504850410001674876 · Cited by 134 · see citing works
Calibration as a Standard Method for Treatment of Nonresponse
Lundström, S. (1997) · Cited by 129 · see citing works
Self-Selected and Randomly Selected Respondents in a Computer Network Survey
Walsh, J. P., Kiesler, S. B., Sproull, L. S., & Hesse, B. W. (1992) · Public Opinion Quarterly · doi:10.1086/269315 · Cited by 111 · see citing works
Reijneveld, S. A. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.6.1134 · Cited by 104 · see citing works
Costs and Benefits of Improving Response Rates for a Hard-to-Reach Population
Teitler, J. O., Reichman, N. E., & Sprachman, S. (2003) · Public Opinion Quarterly · doi:10.1086/346011 · Cited by 101 · see citing works
Response Bias: Effect on Outcomes Evaluation by Mail Surveys After Total Knee Arthroplasty
Kim, J., Lonner, J. H., Nelson, C. L., & Lotke, P. A. (2004) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200401000-00004 · Cited by 100 · see citing works
Comparison of Early and Late Respondents to a Postal Health Survey Questionnaire
Paganini‐Hill, A., Hsu, G., Chao, A., & Ross, R. K. (1993) · Epidemiology · doi:10.1097/00001648-199307000-00014 · Cited by 98 · see citing works
Sample Surveys 1975-1990; An Age of Reconciliation?
Smith, T. M. F. (1994) · International Statistical Review · doi:10.2307/1403539 · Cited by 81 · see citing works
Poststratification and Conditional Variance Estimation
Valliant, R. L. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594298 · Cited by 79 · see citing works
The influence of topic involvement on mail‐survey response behavior
Kenhove, P. V., Wijnen, K., & Wulf, K. D. (2002) · Psychology and Marketing · doi:10.1002/mar.1053 · Cited by 77 · see citing works
Assessment of Weighting Methodology for the National Comorbidity Survey
Little, R. J. A., Lewitzky, S., Heeringa, S. G., Lepkowski, J. M., & Kessler, R. C. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009297 · Cited by 76 · see citing works
Barchielli, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.5.1038 · Cited by 68 · see citing works
Probability Sampling With Quotas: An Experiment
Stephenson, C. B. (1979) · Public Opinion Quarterly · doi:10.1086/268545 · Cited by 68 · see citing works
Messonnier, M. L., Bergstrom, J. C., Cornwell, C. M., Teasley, R. J., & Cordell, H. K. (2000) · American Journal of Agricultural Economics · doi:10.1111/0002-9092.00037 · Cited by 65 · see citing works
Non-response bias in studies of diabetic complications: The rochester diabetic neuropathy study
Melton, L. J., Dyck, P. J. B., Karnes, J. L., O’Brien, P. C., & Service, F. J. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90148-t · Cited by 61 · see citing works
Ziegel, E. R., Lessler, J. T., & Kalsbeek, W. D. (1993) · Technometrics · doi:10.2307/1270300 · Cited by 55 · see citing works
Sampling for Household Financial Characteristics Using Frame Information on Past Income
Kennickell, A. B., & McManus, D. A. (1993) · Cited by 53 · see citing works
Nonsampling vs. Sampling Errors in Survey Research
Assael, H., & Keon, J. W. (1982) · Journal of Marketing · doi:10.2307/3203346 · Cited by 52 · see citing works
Correcting for Nonavailability Bias in Surveys by Weighting Based on Number of Callbacks
Potthoff, R. F., Mantón, K. G., & Woodbury, M. A. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476399 · Cited by 51 · see citing works
McNutt, L. (2000) · American Journal of Epidemiology · doi:10.1093/aje/152.5.438 · Cited by 49 · see citing works
Nonresponse Bias and Callbacks in Sample Surveys
Dunkelberg, W. C., & Day, G. S. (1973) · Journal of Marketing Research · doi:10.1177/002224377301000206 · Cited by 49 · see citing works
An investigation into nonresponse bias in a postal survey on urinary symptoms
Dallosso, H. M., Matthews, R. J., McGrother, C. W., Clarke, M., Perry, S., Shaw, C., Jagger, C., & the Leicestershire MRC Incontinence Study Team (2003) · British Journal of Urology · doi:10.1046/j.1464-410x.2003.04172.x · Cited by 39 · see citing works
Roberts, P.-J., Roberts, C., Sibbald, B., & Torgerson, D. J. (2000) · Journal of Epidemiology & Community Health · doi:10.1136/jech.54.1.71 · Cited by 38 · see citing works
Nonresponse Bias and Stimulus Effects in the Dutch National Election Study
Voogt, R. J. J., & van Kempen, H. (2002) · Quality & Quantity · doi:10.1023/a:1020966227669 · Cited by 37 · see citing works
Nonresponse Bias and Callbacks in Sample Surveys
Dunkelberg, W. C., & Day, G. S. (1973) · Journal of Marketing Research · doi:10.2307/3149821 · Cited by 27 · see citing works
Those Not at Home: Riddle for Pollsters
Hilgard, E. R., & Payne, S. L. (1944) · Public Opinion Quarterly · doi:10.1086/265686 · Cited by 26 · see citing works
Brownstone, D. M., Golob, T. F., & Kazimi, C. (1999) · RePEc: Research Papers in Economics · Cited by 20 · see citing works
Comparison of the Likelihood to Vote Among Preelection Poll Respondents and Nonrespondents
Bolstein, R. (1991) · Public Opinion Quarterly · doi:10.1086/269287 · Cited by 12 · see citing works
ASCF Group, Bajos, N., & Spira, A. (1992) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/075910639203500103 · Cited by 12 · see citing works
Do safety practices differ between responders and non-responders to a safety questionnaire?
Kendrick, D., Hapgood, R., & Marsh, P. (2001) · Injury Prevention · doi:10.1136/ip.7.2.100 · Cited by 11 · see citing works
Izazola-Licea, J. A., Gortmaker, S. L., Gruttola, V. D., Tolbert, K., & Mann, J. M. (2000) · Salud Pública de México · doi:10.1590/s0036-36342000000200003 · Cited by 11 · see citing works
Non-Response Bias – A Study Using Matched Survey-Register Labour Market DataPreprint
Pedersen, P. J. (2002) · RePEc: Research Papers in Economics · Cited by 4 · see citing works
Grosset, J. M. (1994) · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Putnam, R. D. (2007) · Scandinavian Political Studies · doi:10.1111/j.1467-9477.2007.00176.x · Cited by 4,027 · see citing works
Survey response rate levels and trends in organizational research
Baruch, Y., & Holtom, B. C. (2008) · Human Relations · doi:10.1177/0018726708094863 · Cited by 3,462 · see citing works
Contemporary Guidance for Stated Preference Studies
Johnston, R. J., Boyle, K., Adamowicz, W., Bennett, J., Brouwer, R., Cameron, T. A., Hanemann, W. M., Hanley, N. D., Ryan, M., Riccardo Scarpa, A., et al. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/691697 · Cited by 1,458 · see citing works
The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
Groves, R. M., & Peytcheva, E. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn011 · Cited by 1,441 · see citing works
Self-citationStigma and Help Seeking for Mental Health Among College Students
Eisenberg, D., Downs, M. F., Golberstein, E., & Zivin, K. (2009) · Medical Care Research and Review · doi:10.1177/1077558709335173 · Cited by 1,193 · see citing works
Hulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067 · see citing works
Mental health problems in college freshmen: Prevalence and academic functioning
Bruffaerts, R., Mortier, P., Kiekens, G., Auerbach, R. P., Cuijpers, P., Demyttenaere, K., Green, J. G., Nock, M. K., & Kessler, R. C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.044 · Cited by 1,047 · see citing works
Web Surveys versus other Survey Modes: A Meta-Analysis Comparing Response Rates
Manfreda, K. L., Bošnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008) · International Journal of Market Research · doi:10.1177/147078530805000107 · Cited by 1,003 · see citing works
Epidemiology of Autism Spectrum Disorders in Adults in the Community in England
Brugha, T. S., McManus, S., Bankart, J., Scott, F., Purdon, S., Smith, J., Bebbington, P., Jenkins, R., & Meltzer, H. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.38 · Cited by 903 · see citing works
Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey
Keeter, S., Kennedy, C., Dimock, M. A., Best, J., & Craighill, P. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl035 · Cited by 902 · see citing works
Violence, Crime, and Abuse Exposure in a National Sample of Children and Youth
David Finkelhor, B., Turner, H. A., Shattuck, A., & Hamby, S. L. (2013) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2013.42 · Cited by 781 · see citing works
Poly-Victimization in a National Sample of Children and Youth
Turner, H. A., David Finkelhor, B., & Ormrod, R. K. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.11.012 · Cited by 766 · see citing works
Eisenberg, D., Hunt, J., & Speer, N. (2013) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e31827ab077 · Cited by 728 · see citing works
Summary Report of the AAPOR Task Force on Non-probability Sampling
Baker, R., Brick, J. M., Bates, N., Battaglia, M., Couper, M. P., Dever, J. A., Gile, K. J., & Tourangeau, R. (2013) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smt008 · Cited by 663 · see citing works
Improving the Adverse Childhood Experiences Study Scale
David Finkelhor, B., Shattuck, A., Turner, H. A., & Hamby, S. L. (2012) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2013.420 · Cited by 617 · see citing works
Berry, S. H., Elliott, M. N., Suttorp, M., Bogart, L. M., Stoto, M. A., Eggers, P., Nyberg, L., & Clemens, J. Q. (2011) · Journal of Urology · doi:10.1016/j.juro.2011.03.132 · Cited by 595 · see citing works
Fear, N. T., Jones, M., Murphy, D., Hull, L., Iversen, A. C., Coker, B., Machell, L., Sundin, J., Woodhead, C., Jones, N., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60672-1 · Cited by 586 · see citing works
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584 · see citing works
Self-citationThe prevalence of suicidal thoughts and behaviours among college students: a meta-analysis
Mortier, P., Cuijpers, P., Kiekens, G., Auerbach, R. P., Demyttenaere, K., Green, J. G., Kessler, R. C., Nock, M. K., & Bruffaerts, R. (2018) · Psychological Medicine · doi:10.1017/s0033291717002215 · Cited by 572 · see citing works
Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison
Ansolabehere, S., & Schaffner, B. F. (2014) · Political Analysis · doi:10.1093/pan/mpt025 · Cited by 573 · see citing works
Meyer, B., Mok, W. K. C., & Sullivan, J. X. (2015) · The Journal of Economic Perspectives · doi:10.1257/jep.29.4.199 · Cited by 556 · see citing works
The Use and Effects of Incentives in Surveys
Singer, E., & Ye, C. (2012) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716212458082 · Cited by 529 · see citing works
Computing Response Metrics for Online Panels
Callegaro, M., & DiSogra, C. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn065 · Cited by 516 · see citing works
Eveland, W. P., & Hively, M. (2009) · Journal of Communication · doi:10.1111/j.1460-2466.2009.01412.x · Cited by 488 · see citing works
Development of origin–destination matrices using mobile phone call data
Iqbal, S., Choudhury, C. F., Wang, P., & González, M. C. (2014) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2014.01.002 · Cited by 508 · see citing works
Keyes, C. L. M., Eisenberg, D., Perry, G. S., Dube, S. R., Kroenke, K., & Dhingra, S. S. (2012) · Journal of American College Health · doi:10.1080/07448481.2011.608393 · Cited by 483 · see citing works
How Important are High Response Rates for College Surveys?
Fosnacht, K. J., Sarraf, S. A., Howe, E. C., & Peck, L. K. (2016) · Review of higher education/The review of higher education · doi:10.1353/rhe.2017.0003 · Cited by 476 · see citing works
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 472 · see citing works
Bedtime mobile phone use and sleep in adults
Exelmans, L., & den Bulck, J. V. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.11.037 · Cited by 488 · see citing works
Employee engagement: an examination of antecedent and outcome variables
Shuck, B., Reio, T. G., & Rocco, T. S. (2011) · Human Resource Development International · doi:10.1080/13678868.2011.601587 · Cited by 436 · see citing works
Lyratzopoulos, G., Neal, R. D., Barbiere, J. M., Rubin, G. P., & Abel, G. A. (2012) · The Lancet Oncology · doi:10.1016/s1470-2045(12)70041-4 · Cited by 425 · see citing works
Prevalence of mental disorders in elderly people: the European MentDis_ICF65+ study
Andreas, S., Schulz, H., Volkert, J., Dehoust, M., Sehner, S., Suling, A., Ausín, B., Canuto, A., Crawford, M., Da Ronch, C., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.180463 · Cited by 425 · see citing works
Stedman, R. C., Connelly, N. A., Heberlein, T. A., Decker, D. J., & Allred, S. B. (2019) · Society & Natural Resources · doi:10.1080/08941920.2019.1587127 · Cited by 405 · see citing works
Data Collection in the Digital Age: Innovative Alternatives to Student Samples1
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.02 · Cited by 406 · see citing works
Roxas, B., & Coetzer, A. (2012) · Journal of Business Ethics · doi:10.1007/s10551-012-1211-z · Cited by 411 · see citing works
South, E. C., Hohl, B. C., Kondo, M. C., MacDonald, J. M., & Branas, C. C. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.0298 · Cited by 399 · see citing works
Pusic, A. L., Matros, E., Fine, N. A., Buchel, E. W., Gordillo, G. M., Hamill, J. B., Kim, H. M., Qi, J., Albornoz, C. R., Klassen, A. F., et al. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2016.69.9561 · Cited by 376 · see citing works
Han, B., Compton, W. M., Jones, C. M., & Cai, R. (2015) · JAMA · doi:10.1001/jama.2015.11859 · Cited by 366 · see citing works
Opioid Use and Storage Patterns by Patients after Hospital Discharge following Surgery
Bartels, K., Mayes, L. M., Dingmann, C., Bullard, K. J., Hopfer, C. J., & Binswanger, I. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147972 · Cited by 363 · see citing works
Disparities in Alcohol‐Related Problems Among White, Black, and Hispanic Americans
Mulia, N., Ye, Y., Greenfield, T. K., & Zemore, S. E. (2009) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2008.00880.x · Cited by 348 · see citing works
Explaining Rising Nonresponse Rates in Cross-Sectional Surveys
Brick, J. M., & Williams, D. (2012) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716212456834 · Cited by 344 · see citing works
Estimating aggregate consumer preferences from online product reviews
Decker, R., & Trusov, M. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.09.001 · Cited by 342 · see citing works
Sinclair, M. I., O’Toole, J., Malawaraarachchi, M., & Leder, K. S. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-132 · Cited by 341 · see citing works
Matz, C., Stieb, D., Davis, K., Egyed, M., Rose, A., Chou, B., & Brion, O. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph110202108 · Cited by 339 · see citing works
Wisdom of crowds: Conducting importance-performance analysis (IPA) through online reviews
Bi, J., Liu, Y., Fan, Z.-P., & Zhang, J. (2019) · Tourism Management · doi:10.1016/j.tourman.2018.09.010 · Cited by 324 · see citing works
Mining customer requirements from online reviews: A product improvement perspective
Qi, J., Zhang, Z., Jeon, S., & Zhou, Y. (2016) · Information & Management · doi:10.1016/j.im.2016.06.002 · Cited by 334 · see citing works
Hendra, R., & Hill, A. (2018) · Evaluation Review · doi:10.1177/0193841x18807719 · Cited by 323 · see citing works
Student Eligibility for a Free Lunch as an SES Measure in Education Research
Harwell, M. R., & LeBeau, B. C. (2010) · Educational Researcher · doi:10.3102/0013189x10362578 · Cited by 317 · see citing works
Suicidal Thoughts and Behaviors Among First-Year College Students: Results From the WMH-ICS Project
Mortier, P., Auerbach, R. P., Alonso, J., Bantjes, J., Benjet, C., Cuijpers, P., Ebert, D. D., Green, J. G., Hasking, P., Nock, M. K., et al. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.01.018 · Cited by 307 · see citing works
How to ask sensitive questions in conservation: A review of specialized questioning techniques
Nuño, A., & John, F. A. V. S. (2014) · Biological Conservation · doi:10.1016/j.biocon.2014.09.047 · Cited by 298 · see citing works
Mol, C. V. (2016) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1185255 · Cited by 307 · see citing works
Halbesleben, J. R. B., & Whitman, M. V. (2012) · Health Services Research · doi:10.1111/1475-6773.12002 · Cited by 293 · see citing works
The French CONSTANCES population-based cohort: design, inclusion and follow-up
CONSTANCES team, Zins, M., & Goldberg, M. (2015) · European Journal of Epidemiology · doi:10.1007/s10654-015-0096-4 · Cited by 289 · see citing works
Axsen, J., Mountain, D. C., & Jaccard, M. (2009) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2009.02.001 · Cited by 288 · see citing works
Do College Student Surveys Have Any Validity?
Porter, S. R. (2011) · The Review of Higher Education · doi:10.1353/rhe.2011.0034 · Cited by 286 · see citing works
Indicators for the representativeness of survey response
Schouten, B., Cobben, F., & Bethlehem, J. G. (2009) · UvA-DARE (University of Amsterdam) · Cited by 273 · see citing works
Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102
Phillips, A. W., Reddy, S. T., & Durning, S. J. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1105945 · Cited by 273 · see citing works
Restricting consumer credit access: Household survey evidence on effects around the Oregon rate cap
Zinman, J. (2009) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2009.08.024 · Cited by 269 · see citing works
Azevedo, L. F., Costa-Pereira, A., Mendonça, L., Dias, C. C., & Castro-Lopes, J. M. (2012) · The Journal of Pain · doi:10.1016/j.jpain.2012.05.012 · Cited by 264 · see citing works
Unrepresentative big surveys significantly overestimated US vaccine uptake
Bradley, V. C., Kuriwaki, S., Isakov, M., Sejdinovic, D., Meng, X.-L., & Flaxman, S. (2021) · Nature · doi:10.1038/s41586-021-04198-4 · Cited by 248 · see citing works
Explaining Interviewer Effects: A Research Synthesis
West, B. T., & Blom, A. G. (2016) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smw024 · Cited by 246 · see citing works
An Exploration of Organizational Level Information Systems Discontinuance Intentions1
Furneaux, B., & Wade (2011) · MIS Quarterly · doi:10.2307/23042797 · Cited by 245 · see citing works
Bi, J.-W., Liu, Y., Fan, Z., & Cambria, E. (2019) · International Journal of Production Research · doi:10.1080/00207543.2019.1574989 · Cited by 245 · see citing works
Stutzman, F., & Kramer‐Duffield, J. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753559 · Cited by 240 · see citing works
Mulia, N., Ye, Y., Zemore, S., & Greenfield, T. (2008) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2008.69.824 · Cited by 238 · see citing works
Mújica-Mota, R., Roberts, M. J., Abel, G., Elliott, M. N., Lyratzopoulos, G., Roland, M. O., & Campbell, J. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0820-7 · Cited by 239 · see citing works
Brand personality appeal: conceptualization and empirical validation
Freling, T. H., Crosno, J. L., & Henard, D. H. (2010) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-010-0208-3 · Cited by 238 · see citing works
Nonresponse in the American Time Use Survey
Abraham, K. G., Maitland, A., & Bianchi, S. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl037 · Cited by 238 · see citing works
Bruffaerts, R., Mortier, P., Auerbach, R. P., Alonso, J., Hermosillo De la Torre, A. E., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., Hasking, P., et al. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1764 · Cited by 228 · see citing works
Use of Global Positioning Systems to Study Physical Activity and the Environment
Krenn, P. J., Titze, S., Oja, P., Jones, A., & Ogilvie, D. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.06.046 · Cited by 223 · see citing works
Hidden Populations, Online Purposive Sampling, and External Validity
Barratt, M. J., Ferris, J., & Lenton, S. R. (2014) · Field Methods · doi:10.1177/1525822x14526838 · Cited by 223 · see citing works
Experiments in Producing Nonresponse Bias
Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Acosta, G. P., & Nelson, L. D. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl036 · Cited by 220 · see citing works
Self-citationNonresponse Rates are a Problematic Indicator of Nonresponse Bias in Survey Research
Davern, M. J. (2013) · Health Services Research · doi:10.1111/1475-6773.12070 · Cited by 219 · see citing works
Do low survey response rates bias results? Evidence from Japan
Rindfuss, R., Choe, M., Tsuya, N., Bumpass, L., & Tamaki, E. (2015) · Demographic Research · doi:10.4054/demres.2015.32.26 · Cited by 219 · see citing works
A National Descriptive Portrait of Adolescent Relationship Abuse
Taylor, B. G., & Mumford, E. A. (2014) · Journal of Interpersonal Violence · doi:10.1177/0886260514564070 · Cited by 218 · see citing works
Gauvin, L., Tizzoni, M., Piaggesi, S., Young, A. J., Adler, N., Verhulst, S., Ferres, L., & Cattuto, C. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0500-x · Cited by 216 · see citing works
Self-Report of Alcohol Use for Pain in a Multi-Ethnic Community Sample
Riley, J. L., & King, C. (2009) · Journal of Pain · doi:10.1016/j.jpain.2009.03.005 · Cited by 213 · see citing works
Henker, N., Sonnentag, S., & Unger, D. (2014) · Journal of Business and Psychology · doi:10.1007/s10869-014-9348-7 · Cited by 221 · see citing works
on behalf of the HES Response Rate Group, Mindell, J. S., Giampaoli, S., Gößwald, A., Kamtsiuris, P., Mann, C., Männistö, S., Morgan, K., Shelton, N. J., Verschuren, W. M. M., et al. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0072-4 · Cited by 206 · see citing works
Police research, officer surveys, and response rates
Nix, J., Pickett, J. T., Baek, H., & Alpert, G. P. (2017) · Policing & Society · doi:10.1080/10439463.2017.1394300 · Cited by 204 · see citing works
Alonso, J., Mortier, P., Auerbach, R. P., Bruffaerts, R., Vilagut, G., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Ennis, E., Gutiérrez-García, R. A., et al. (2018) · Depression and Anxiety · doi:10.1002/da.22778 · Cited by 205 · see citing works
Swannell, S., Martin, G., Page, A., Hasking, P., Hazell, P., Taylor, A., & Protani, M. (2012) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2012.05.005 · Cited by 204 · see citing works
Calibrating Survey Data using Iterative Proportional Fitting (Raking)
Kolenikov, S. (2014) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1401400104 · Cited by 202 · see citing works
Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias
Olson, K. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl038 · Cited by 197 · see citing works
Religious Involvement, Gratitude, and Change in Depressive Symptoms Over Time
Krause, N. (2009) · International Journal for the Psychology of Religion · doi:10.1080/10508610902880204 · Cited by 194 · see citing works
Witbrodt, J., Mulia, N., Zemore, S. E., & Kerr, W. C. (2014) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12398 · Cited by 193 · see citing works
Social Media Analyses for Social Measurement
Schober, M. F., Josh Pasek, B., Guggenheim, L., Lampe, C. A. C., & Conrad, F. G. (2016) · Public Opinion Quarterly · doi:10.1093/poq/nfv048 · Cited by 188 · see citing works
Polyvictimization in Developmental Context
David Finkelhor, B., Shattuck, A., Turner, H. A., Ormrod, R. K., & Hamby, S. L. (2011) · Journal of Child & Adolescent Trauma · doi:10.1080/19361521.2011.610432 · Cited by 187 · see citing works
Keusch, F. (2015) · Management Review Quarterly · doi:10.1007/s11301-014-0111-y · Cited by 187 · see citing works
Internet information-seeking and its relation to support for access to government records
Cuillier, D., & Piotrowski, S. J. (2009) · Government Information Quarterly · doi:10.1016/j.giq.2009.03.001 · Cited by 182 · see citing works
Kaufman, D., Bollinger, J. M., Dvoskin, R. L., & Scott, J. A. (2012) · Journal of Genetic Counseling · doi:10.1007/s10897-012-9483-0 · Cited by 180 · see citing works
Statistical Design and Estimation for the National Social Life, Health, and Aging Project
O’Muircheartaigh, C. A., Eckman, S., & Smith, S. M. (2009) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbp045 · Cited by 180 · see citing works
Rural-Urban Differences in General and Health-Related Internet Use
Hale, T. M., Cotten, S. R., Drentea, P., & Goldner, M. (2010) · American Behavioral Scientist · doi:10.1177/0002764210361685 · Cited by 179 · see citing works
Scaliza, J. A. A., Jugend, D., Jabbour, C. J. C., Latan, H., Armellini, F., Twigg, D., & Andrade, D. F. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.10.065 · Cited by 179 · see citing works
Theory and Practice in Nonprobability Surveys
Mercer, A. W., Kreuter, F., Keeter, S., & Stuart, E. A. (2016) · Public Opinion Quarterly · doi:10.1093/poq/nfw060 · Cited by 174 · see citing works
Consequences of Survey Nonresponse
Peytchev, A. (2012) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716212461748 · Cited by 176 · see citing works
Bartram, D. J., Yadegarfar, G., & Baldwin, D. S. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0030-8 · Cited by 180 · see citing works
Studer, J., Baggio, S., Mohler‐Kuo, M., Dermota, P., Gaume, J., Bertholet, N., Daeppen, J., & Gmel, G. E. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.02.029 · Cited by 174 · see citing works
Brooks, S. C., Simmons, G., Worthington, H. C., Bobrow, B. J., & Morrison, L. J. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.09.392 · Cited by 171 · see citing works
KRAUSE, N. M., & Ellison, C. G. (2009) · Journal for the Scientific Study of Religion · doi:10.1111/j.1468-5906.2009.01448.x · Cited by 171 · see citing works
- Authors
- Groves, R. M.
- Affiliations
- U.S. National Science Foundation (US)
- Corresponding author
- Groves, Robert M.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2006
- Volume
- 70
- Issue
- 5
- Pages
- 646-675
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2116971494
- Cited by
- 2,420
- References
- 80
- Citations by year
- 2026: 90 · 2025: 78 · 2024: 87 · 2023: 90 · 2022: 103 · 2021: 129 · 2020: 152 · 2019: 133 · 2018: 152 · 2017: 161 · 2016: 155 · 2015: 176 · 2014: 170 · 2013: 152 · 2012: 163
- FWCI
- 193.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Public Opinion Quarterly (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Census and Population Estimation
- Keywords
- nonresponse bias, nonresponse rates, household surveys, response rate, auxiliary variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review