The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Consequences of Reducing Nonresponse in a National Telephone Survey
Abstract
Critics of public opinion polls often claim that methodological shortcuts taken to collect timely data produce biased results. This study compares two random digit dial national telephone surveys that used identical questionnaires but very different levels of effort: a "Standard" survey conducted over a 5-day period that used a sample of adults who were home when the interviewer called, and a "Rigorous" survey conducted over an 8-week period that used random selection from among all adult household members. Response rates, computed according to AAPOR guidelines, were 60.6 percent for the Rigorous and 36.0 percent for the Standard study. Nonetheless, the two surveys produced similar results. Across 91 comparisons, no difference exceeded 9 percentage points, and the average difference was about 2 percentage points. Most of the statistically significant differences were among demographic items. Very few significant differences were found on attention to media and engagement in politics, social trust and connectedness, and most social and political attitudes, including even those toward surveys.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonresponse in Household Interview Surveys
Ziegel, E. R., Groves, R. M., & Couper, M. P. (1999) · Technometrics · doi:10.2307/1271375 · Cited by 1,003
Self-citationAMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH
STAR, S. A. (1980) · Public Opinion Quarterly · doi:10.1093/poq/44.3.420 · Cited by 814
The phantom respondents: opinion surveys and political representation
(1993) · Choice Reviews Online · doi:10.5860/choice.31-2316 · Cited by 274
The Effects of Black and White Interviewers on Black Responses in 1968
Schuman, H., & Converse, J. M. (1971) · Public Opinion Quarterly · doi:10.1086/267866 · Cited by 232
White Respondents and Race-of-Interviewer Effects
Hatchett, S., & Schuman, H. (1975) · Public Opinion Quarterly · doi:10.1086/268249 · Cited by 229
Verba, S. (1996) · American Political Science Review · doi:10.2307/2082793 · Cited by 181
The Silent Minority: Nonrespondents on Sample Surveys.
Frey, J. H., & Goyder, J. (1989) · Contemporary Sociology · doi:10.2307/2072023 · Cited by 172
DeMaio, T. J. (1980) · Public Opinion Quarterly · doi:10.1086/268586 · Cited by 167
Nonresponse Effects on Relationships Between Variables
Goudy, W. J. (1976) · Public Opinion Quarterly · doi:10.1086/268312 · Cited by 107
Nonresponse Bias for Attitude Questions
Stinchcombe, A. L., Jones, C., & Sheatsley, P. B. (1981) · Public Opinion Quarterly · doi:10.1086/268670 · Cited by 105
Cited by
(2012) · Choice Reviews Online · doi:10.5860/choice.49-2699 · Cited by 2,593
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420
Self-citationParticipation Rates in Epidemiologic Studies
Galea, S., & Tracy, M. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2007.03.013 · Cited by 1,877
The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
Groves, R. M., & Peytcheva, E. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn011 · Cited by 1,434
Self-citationContemporary Guidance for Stated Preference Studies
Johnston, R. J., Boyle, K. J., Adamowicz, W. (., Bennett, J., Brouwer, R., Cameron, T. A., Hanemann, W. M., Hanley, N., Ryan, M., Scarpa, R., et al. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/691697 · Cited by 1,430
The Effects of Response Rate Changes on the Index of Consumer Sentiment
Curtin, R., Presser, S., & Singer, E. (2000) · Public Opinion Quarterly · doi:10.1086/318638 · Cited by 1,007
Self-citationWeb Surveys versus other Survey Modes: A Meta-Analysis Comparing Response Rates
Manfreda, K. L., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008) · International Journal of Market Research · doi:10.1177/147078530805000107 · Cited by 1,000
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Chang, L., & Krosnick, J. A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp075 · Cited by 955
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 925
Self-citationAtheists as “other”: Moral boundaries and cultural membership in American society
Edgell, P., Gerteis, J., & Hartmann, D. (2006) · American Sociological Review · doi:10.1177/000312240607100203 · Cited by 914
Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey
Keeter, S., Kennedy, C., Dimock, M., Best, J., & Craighill, P. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl035 · Cited by 902
Self-citationHouseholds' Perceived Personal Risk and Responses in a Multihazard Environment
Lindell, M. K., & Hwang, S. N. (2008) · Risk Analysis · doi:10.1111/j.1539-6924.2008.01032.x · Cited by 824
Violence, Crime, and Abuse Exposure in a National Sample of Children and Youth: An Update
Finkelhor, D., Turner, H. A., Shattuck, A., & Hamby, S. L. (2013) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2013.42 · Cited by 781
Poly-Victimization in a National Sample of Children and Youth
Turner, H. A., Finkelhor, D., & Ormrod, R. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.11.012 · Cited by 764
Yeager, D. S., Krosnick, J. A., Chang, L., Javitz, H. S., Levendusky, M. S., Simpser, A., & Wang, R. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr020 · Cited by 758
Politically Motivated Reinforcement Seeking: Reframing the Selective Exposure Debate
Garrett, R. K. (2009) · Journal of Communication · doi:10.1111/j.1460-2466.2009.01452.x · Cited by 714
Polyvictimization and trauma in a national longitudinal cohort
FINKELHOR, D., ORMROD, R. K., & TURNER, H. A. (2007) · Development and Psychopathology · doi:10.1017/s0954579407070083 · Cited by 704
The Role of Topic Interest in Survey Participation Decisions
Groves, R. M., Presser, S., & Dipko, S. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh002 · Cited by 680
Self-citationImproving the Adverse Childhood Experiences Study Scale
Finkelhor, D., Shattuck, A., Turner, H., & Hamby, S. (2013) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2013.420 · Cited by 615
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584
Self-citationPublic Perception of Climate Change
Semenza, J. C., Hall, D. E., Wilson, D. J., Bontempo, B. D., Sailor, D. J., & George, L. A. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.08.020 · Cited by 595
Self-medication with Antimicrobial Drugs in Europe
Grigoryan, L., Haaijer-Ruskamp, F. M., Burgerhof, J. G. M., Mechtler, R., Deschepper, R., Tambic-Andrasevic, A., Andrajati, R., Monnet, D. L., Cunney, R., Di Matteo, A., et al. (2006) · Emerging Infectious Diseases · doi:10.3201/eid1203.050992 · Cited by 585
Gerber, A. S., Karlan, D., & Bergan, D. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.2.35 · Cited by 577
Digital Childhood: Electronic Media and Technology Use Among Infants, Toddlers, and Preschoolers
Vandewater, E. A., Rideout, V. J., Wartella, E. A., Huang, X., Lee, J. H., & Shim, M.-S. (2007) · Pediatrics · doi:10.1542/peds.2006-1804 · Cited by 504
Household Decision Making and Evacuation in Response to Hurricane Lili
Lindell, M. K., Lu, J.-C., & Prater, C. S. (2005) · Natural Hazards Review · doi:10.1061/(asce)1527-6988(2005)6:4(171 · Cited by 485
The Oslo Health Study: The impact of self-selection in a large, population-based survey
Søgaard, A. J., Selmer, R., Bjertness, E., & Thelle, D. (2004) · International Journal for Equity in Health · doi:10.1186/1475-9276-3-3 · Cited by 473
How Important are High Response Rates for College Surveys?
Fosnacht, K., Sarraf, S., Howe, E., & Peck, L. K. (2017) · The Review of Higher Education · doi:10.1353/rhe.2017.0003 · Cited by 472
Patel, N. P., Grandner, M. A., Xie, D., Branas, C. C., & Gooneratne, N. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-475 · Cited by 451
Black-White Differences in Attitudes toward Homosexuality and Gay Rights
Lewis, G. B. (2003) · Public Opinion Quarterly · doi:10.1086/346009 · Cited by 427
Prevalence of mental disorders in elderly people: the European MentDis_ICF65+ study
Andreas, S., Schulz, H., Volkert, J., Dehoust, M., Sehner, S., Suling, A., Ausín, B., Canuto, A., Crawford, M., Da Ronch, C., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.180463 · Cited by 425
Exploring the Digital Divide: Internet Connectedness and Age
LOGES, W. E., & JUNG, J.-Y. (2001) · Communication Research · doi:10.1177/009365001028004007 · Cited by 414
Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates
Daikeler, J., Bošnjak, M., & Lozar Manfreda, K. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz008 · Cited by 411
Group Threat and Social Control: Race, Perceptions of Minorities and the Desire to Punish
King, R. D., & Wheelock, D. (2007) · Social Forces · doi:10.1353/sof.2007.0045 · Cited by 407
Data Collection in the Digital Age: Innovative Alternatives to Student Samples1
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.02 · Cited by 405
Cook, T. E., & Gronke, P. (2005) · The Journal of Politics · doi:10.1111/j.1468-2508.2005.00339.x · Cited by 401
Analyzing the representativeness of internet political participation
Best, S. J., & Krueger, B. S. (2005) · Political Behavior · doi:10.1007/s11109-005-3242-y · Cited by 399
Constantine, N. A., & Jerman, P. (2007) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2006.10.007 · Cited by 387
Holbrook, A. L., Krosnick, J. A., & Pfent, A. (2007) · Advances in Telephone Survey Methodology · doi:10.1002/9780470173404.ch23 · Cited by 380
Storytelling Neighborhood: Paths to Belonging in Diverse Urban Environments
BALL-ROKEACH, S. J., KIM, Y.-C., & MATEI, S. (2001) · Communication Research · doi:10.1177/009365001028004003 · Cited by 383
The digital production gap: The digital divide and Web 2.0 collide
Schradie, J. (2011) · Poetics · doi:10.1016/j.poetic.2011.02.003 · Cited by 365
Survey Research and Societal Change
Tourangeau, R. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142040 · Cited by 361
Electronic cigarette use by college students
Sutfin, E. L., McCoy, T. P., Morrell, H. E. R., Hoeppner, B. B., & Wolfson, M. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.05.001 · Cited by 347
Alternative Measures of Offshorability: A Survey Approach
Blinder, A. S., & Krueger, A. B. (2013) · Journal of Labor Economics · doi:10.1086/669061 · Cited by 340
Methods of the International Tobacco Control (ITC) Four Country Survey
Thompson, M. E., Fong, G. T., Hammond, D., Boudreau, C., Driezen, P., Hyland, A., Borland, R., Cummings, K. M., Hastings, G. B., Siahpush, M., et al. (2006) · Tobacco Control · doi:10.1136/tc.2005.013870 · Cited by 340
Collective Preferences in Democratic Politics: Opinion Surveys and the Will of the People
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042 · Cited by 338
Contingent Valuation in Practice
Boyle, K. J. (2017) · The Economics of Non-Market Goods and Resources · doi:10.1007/978-94-007-7104-8_4 · Cited by 323
Urban Neighborhood Poverty and the Incidence of Depression in a Population-Based Cohort Study
Galea, S., Ahern, J., Nandi, A., Tracy, M., Beard, J., & Vlahov, D. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2006.07.008 · Cited by 311
Healthy Lifestyle Characteristics Among Adults in the United States, 2000
Reeves, M. J., & Rafferty, A. P. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.8.854 · Cited by 293
New Challenges for Telephone Survey Research in the Twenty-First Century
Kempf, A. M., & Remington, P. L. (2007) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144059 · Cited by 295
The Internet as Psychological Laboratory
Skitka, L. J., & Sargis, E. G. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190048 · Cited by 293
Bartels, J., Pruyn, A., de Jong, M., & Joustra, I. (2007) · Journal of Organizational Behavior · doi:10.1002/job.420 · Cited by 293
Internet Connectedness and Inequality: Beyond the “Divide”
JUNG, J.-Y., QIU, J. L., & KIM, Y.-C. (2001) · Communication Research · doi:10.1177/009365001028004006 · Cited by 291
Household Evacuation Decision Making in Response to Hurricane Ike
Huang, S.-K., Lindell, M. K., Prater, C. S., Wu, H.-C., & Siebeneck, L. K. (2012) · Natural Hazards Review · doi:10.1061/(asce)nh.1527-6996.0000074 · Cited by 282
Collective preferences in democratic politics: opinion surveys and the will of the people
(2004) · Choice Reviews Online · doi:10.5860/choice.42-1221 · Cited by 274
Terpstra, T., & Lindell, M. K. (2013) · Environment and Behavior · doi:10.1177/0013916512452427 · Cited by 269
Nuru-Jeter, A., Dominguez, T. P., Hammond, W. P., Leu, J., Skaff, M., Egerter, S., Jones, C. P., & Braveman, P. (2009) · Maternal and Child Health Journal · doi:10.1007/s10995-008-0357-x · Cited by 268
Social capital, socio-economic status and psychological distress among Australian adults
Phongsavan, P., Chey, T., Bauman, A., Brooks, R., & Silove, D. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.06.021 · Cited by 263
May, D. C., Rader, N. E., & Goodrum, S. (2010) · Criminal Justice Review · doi:10.1177/0734016809349166 · Cited by 262
The online audience as gatekeeper: The influence of reader metrics on news editorial selection
Vu, H. T. (2014) · Journalism · doi:10.1177/1464884913504259 · Cited by 261
Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study
Sanders, D., Clarke, H. D., Stewart, M. C., & Whiteley, P. (2007) · Political Analysis · doi:10.1093/pan/mpl010 · Cited by 259
Rader, N. E., May, D. C., & Goodrum, S. (2007) · Sociological Spectrum · doi:10.1080/02732170701434591 · Cited by 257
A comparison of reliability between telephone and web-based surveys
Braunsberger, K., Wybenga, H., & Gates, R. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2007.02.015 · Cited by 222
The logistics of household hurricane evacuation
Lindell, M. K., Kang, J. E., & Prater, C. S. (2011) · Natural Hazards · doi:10.1007/s11069-011-9715-x · Cited by 200
Mediterranean diet adherence is related to reduced probability of prodromal Parkinson's disease
Maraki, M. I., Yannakoulia, M., Stamelou, M., Stefanis, L., Xiromerisiou, G., Kosmidis, M. H., Dardiotis, E., Hadjigeorgiou, G. M., Sakka, P., Anastasiou, C. A., et al. (2019) · Movement Disorders · doi:10.1002/mds.27489 · Cited by 195
Disability and Victimization in a National Sample of Children and Youth
Turner, H. A., Vanderminden, J., Finkelhor, D., Hamby, S., & Shattuck, A. (2011) · Child Maltreatment · doi:10.1177/1077559511427178 · Cited by 161
Begle, A. M., Hanson, R. F., Danielson, C. K., McCart, M. R., Ruggiero, K. J., Amstadter, A. B., Resnick, H. S., Saunders, B. E., & Kilpatrick, D. G. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2010.12.026 · Cited by 152
Carlson, S. A., Densmore, D., Fulton, J. E., Yore, M. M., & Kohl, H. W. (2009) · Journal of Physical Activity and Health · doi:10.1123/jpah.6.s1.s18 · Cited by 144
Patients who feel judged about their weight have lower trust in their primary care providers
Gudzune, K. A., Bennett, W. L., Cooper, L. A., & Bleich, S. N. (2014) · Patient Education and Counseling · doi:10.1016/j.pec.2014.06.019 · Cited by 143
Child maltreatment rates assessed in a national household survey of caregivers and youth
Finkelhor, D., Vanderminden, J., Turner, H., Hamby, S., & Shattuck, A. (2014) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2014.05.005 · Cited by 132
Adverse childhood experiences are associated with spontaneous preterm birth: a case-control study
Christiaens, I., Hegadoren, K., & Olson, D. M. (2015) · BMC Medicine · doi:10.1186/s12916-015-0353-0 · Cited by 130
Vemuri, A. W., Morgan Grove, J., Wilson, M. A., & Burch, W. R. (2011) · Environment and Behavior · doi:10.1177/0013916509338551 · Cited by 119
Perceived Stakeholder Role Relationships and Adoption of Seismic Hazard Adjustments 1
Arlikatti, S., Lindell, M. K., & Prater, C. S. (2007) · International Journal of Mass Emergencies & Disasters · doi:10.1177/028072700702500302 · Cited by 115
Gudzune, K. A., Bennett, W. L., Cooper, L. A., & Bleich, S. N. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.02.001 · Cited by 114
Sociodemographic determinants of cancer treatment health literacy
Gansler, T., Henley, S. J., Stein, K., Nehl, E. J., Smigal, C., & Slaughter, E. (2005) · Cancer · doi:10.1002/cncr.21194 · Cited by 110
Nonresponse and mode effects in self‐ and interviewer‐administered surveys
Atkeson, L. R., Adams, A. N., & Alvarez, R. M. (2014) · Political Analysis · doi:10.1093/pan/mpt049 · Cited by 70
The Impact of Hot Spots Policing on Collective Efficacy: Findings from a Randomized Field Trial
Rinehart Kochel, T., & Weisburd, D. (2019) · Justice Quarterly · doi:10.1080/07418825.2018.1465579 · Cited by 42
Parents’ Beliefs Regarding Sex Education for Their Children in Southern Alabama Public Schools
Millner, V., Mulekar, M., & Turrens, J. (2015) · Sexuality Research and Social Policy · doi:10.1007/s13178-015-0180-2 · Cited by 26
Schieve, L. A., Harris, S., Maenner, M. J., Alexander, A., & Dowling, N. F. (2018) · Emerging Themes in Epidemiology · doi:10.1186/s12982-018-0081-y · Cited by 12
Measuring affective polarization: Matching concepts to measures
Druckman, J. N., Klar, S., Krupnikov, Y., Levendusky, M., & Ryan, J. B. (2026) · Political Psychology · doi:10.1111/pops.70152 · Cited by 3
Metadata
- Authors
- Keeter, S., Miller, C., Kohut, A., Groves, R. M., & Presser, S.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2000
- Volume
- 64
- Issue
- 2
- Pages
- 125-148
- ISSN
- 0033-362X (ISSN-L)
- OpenAlex
- W1986056512
- Cited by
- 986
- References
- 11
- FWCI
- 82.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.