The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Abstract
The last 50 years have seen a gradual replacement of face-to-face interviewing with telephone interviewing as the dominant mode of survey data collection in the United States. But some of the most expensive and large-scale nationally funded, long-term survey research projects involving national area-probability samples and long questionnaires retain face-to-face interviewing as their mode. In this article, we propose two ways in which shifting such surveys to random digit dialing (RDD) telephone interviewing might affect the quality of data acquired, and we test these hypotheses using data from three national mode experiments. Random digit dialing telephone respondents were more likely to satisfice (as evidenced by no-opinion responding, nondifferentiation, and acquiescence), to be less cooperative and engaged in the interview, and were more likely to express dissatisfaction with the length of the interview than were face-to-face respondents, despite the fact that the telephone interviews were completed more quickly than the face-to-face interviews. Telephone respondents were also more suspicious about the interview process and more likely to present themselves in socially desirable ways than were face-to-face respondents. These findings shed light on the nature of the survey response process, on the costs and benefits associated with particular survey modes, and on the nature of social interaction generally.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Presentation of Self in Everyday Life.
Naegele, K. D., & Goffman, E. (1956) · American Sociological Review · doi:10.2307/2089106 · Cited by 25,991
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
The chameleon effect: the perception–behavior link and social interaction
Chartrand, T. L., & Bargh, J. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.76.6.893 · Cited by 3,674
Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias
Warner, S. L. (1965) · Journal of the American Statistical Association · doi:10.1080/01621459.1965.10480775 · Cited by 3,255
Two-component models of socially desirable responding.
Paulhus, D. L. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.46.3.598 · Cited by 3,013
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,460
Self-citationFazio, R. H., Jackson, J. R., Dunton, B. C., & Williams, C. J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.6.1013 · Cited by 1,793
Thinking too much: Introspection can reduce the quality of preferences and decisions.
Wilson, T. D., & Schooler, J. W. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.60.2.181 · Cited by 1,417
A Procedure for Objective Respondent Selection within the Household
Kish, L. (1949) · Journal of the American Statistical Association · doi:10.1080/01621459.1949.10483314 · Cited by 1,255
Education and democratic citizenship in America
(1997) · Choice Reviews Online · doi:10.5860/choice.34-4140 · Cited by 1,253
The mind in the middle: A practical guide to priming and automaticity research.
Bargh, J. A., & Chartrand, T. L. (2000) · Cited by 1,136
The Effects of Response Rate Changes on the Index of Consumer Sentiment
Curtin, R., Presser, S., & Singer, E. (2000) · Public Opinion Quarterly · doi:10.1086/318638 · Cited by 1,007
The nature of rapport and its nonverbal correlates
Tickle-Degnen, L., & Rosenthal, R. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0104_1 · Cited by 960
Ceci, S. J. (1991) · Developmental Psychology · doi:10.1037/0012-1649.27.5.703 · Cited by 837 · cited 1×
“disposition in this regard appears to be the extent of a person’s cognitive skills (for a review, see Krosnick 1991), which is very strongly correlated with years of formal education (see Ceci 1991; Nie, Junn, and Stehlik-Barry 1996) and can therefore be effectively measured in that way.”
BackgroundQuestions and Answers in Attitude Surveys.
Robinson, J. P., Schuman, H., & Presser, S. (1983) · Social Forces · doi:10.2307/2578327 · Cited by 778
Bogardus, E. S. (1933) · Open Scholarship Institutional Repository (Washington University in St. Louis) · Cited by 685
Response Effects in Surveys: A Review and Synthesis.
King, B. F., Sudman, S., & Bradburn, N. M. (1976) · Journal of the American Statistical Association · doi:10.2307/2285784 · Cited by 644
Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
Schwarz, N. (2014) · Medical Entomology and Zoology · Cited by 537
Interview Mode Effects in Surveys of Drug and Alcohol Use: A Field Experiment
Aquilino, W. S. (1994) · Public Opinion Quarterly · doi:10.1086/269419 · Cited by 458
Research on Interviewing Techniques
Cannell, C. F., Miller, P. V., & Oksenberg, L. (1981) · Sociological Methodology · doi:10.2307/270748 · Cited by 436
Experimental comparisons of face-to-face and mediated communication: A review.
Williams, E. (1977) · Psychological Bulletin · doi:10.1037//0033-2909.84.5.963 · Cited by 430
A Critical Comparison of Three Strategies of Collecting Data from Households
Hochstim, J. R. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500909 · Cited by 418
Rating Scales: Numeric Values May Change the Meaning of Scale Labels
Schwarz, N., Knauper, B., Hippler, H.-J., Noelle-Neumann, E., & Clark, L. (1991) · Public Opinion Quarterly · doi:10.1086/269282 · Cited by 411
Drolet, A. L., & Morris, M. W. (2000) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1999.1395 · Cited by 405
A comparison of mail, telephone, and home interview strategies for household health surveys.
Siemiatycki, J. (1979) · American Journal of Public Health · doi:10.2105/ajph.69.3.238 · Cited by 402
Data Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 393
Surveys by Telephone: A National Comparison with Personal Interviews.
Ferree, G. D., Groves, R. M., & Kahn, R. L. (1982) · Contemporary Sociology · doi:10.2307/2066654 · Cited by 371
Satisficing in surveys: Initial evidence
Krosnick, J. A., Narayan, S., & Smith, W. R. (1996) · New Directions for Evaluation · doi:10.1002/ev.1033 · Cited by 354
Self-citationIncreasing the validity of self-reports of behavior in a smoking in children investigation.
Evans, R. I., Hansen, W. B., & Mittelmark, M. B. (1977) · Journal of Applied Psychology · doi:10.1037//0021-9010.62.4.521 · Cited by 304
Computer Support for Group Versus Individual Decisions
Turoff, M., & Hiltz, S. (1982) · IEEE Transactions on Communications · doi:10.1109/tcom.1982.1095370 · Cited by 287
Bernieri, F. J., Davis, J. M., Rosenthal, R., & Knee, C. R. (1994) · Personality and Social Psychology Bulletin · doi:10.1177/0146167294203008 · Cited by 259
Current stereotypes: A little fading, a little faking.
Sigall, H., & Page, R. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030839 · Cited by 254
Hox, J. J., & De Leeuw, E. D. (1994) · Quality and Quantity · doi:10.1007/bf01097014 · Cited by 248
Comparisons of Party Identification and Policy Preferences: The Impact of Survey Question Format
Krosnick, J. A., & Berent, M. K. (1993) · American Journal of Political Science · doi:10.2307/2111580 · Cited by 244
Self-citationAn Investigation of Interview Method, Threat and Response Distortion
Locander, W., Sudman, S., & Bradburn, N. (1976) · Journal of the American Statistical Association · doi:10.1080/01621459.1976.10480332 · Cited by 242
Reducing Vote Overreporting in Surveys: Social Desirability, Memory Failure, and Source Monitoring
Belli, R. F., Traugott, M. W., Young, M., & McGonagle, K. A. (1999) · Public Opinion Quarterly · doi:10.1086/297704 · Cited by 241
Education Moderates Some Response Effects in Attitude Measurement
Narayan, S., & Krosnick, J. A. (1996) · Public Opinion Quarterly · doi:10.1086/297739 · Cited by 233
Self-citationThe Social Psychology of Bargaining.
Peterson, R. B., Morley, I. E., & Stephenson, G. M. (1978) · Administrative Science Quarterly · doi:10.2307/2392427 · Cited by 233
Burton, S., & Blair, E. (1991) · Public Opinion Quarterly · doi:10.1086/269241 · Cited by 230
Effects of telephone versus face‐to‐face interview modes on reports of alcohol consumption
Greenfield, T. K., Midanik, L. T., & Rogers, J. D. (2000) · Addiction · doi:10.1046/j.1360-0443.2000.95227714.x · Cited by 222
26 In-Person Versus Telephone Interviewing
Shuy, R. W. (2012) · Handbook of Interview Research · doi:10.4135/9781412973588.d32 · Cited by 205
Effects of Interview Mode on Self-Reported Drug Use
Aquilino, W. S., & Sciuto, L. A. L. (1990) · Public Opinion Quarterly · doi:10.1086/269212 · Cited by 201
Interviews by Telephone and in Person: Quality of Responses and Field Performance
Rogers, T. F. (1976) · Public Opinion Quarterly · doi:10.1086/268267 · Cited by 195
Wiggins, J. S. (1959) · Journal of Consulting Psychology · doi:10.1037/h0047823 · Cited by 192
Personal versus telephone surveys for collecting household health data at the local level.
Weeks, M. F., Kulka, R. A., Lessler, J. T., & Whitmore, R. W. (1983) · American Journal of Public Health · doi:10.2105/ajph.73.12.1389 · Cited by 184
Measuring Depression in the Community: A Comparison of Telephone and Personal Interviews
Aneshensel, C. S., Frerichs, R. R., Clark, V. A., & Yokopenic, P. A. (1982) · Public Opinion Quarterly · doi:10.1086/268703 · Cited by 180
Telephone Versus Face-to-Face Interviewing for Household Drug Use Surveys
Aquilino, W. S. (1991) · International Journal of the Addictions · doi:10.3109/10826089109063463 · Cited by 169
Methodological Bias in Public Opinion Surveys
Wiseman, F. (1972) · Public Opinion Quarterly · doi:10.1086/267981 · Cited by 154
Response Styles in Telephone and Household Interviewing: A Field Experiment
Jordan, L. A., Marcus, A. C., & Reeder, L. G. (1980) · Public Opinion Quarterly · doi:10.1086/268585 · Cited by 141
Meeting at the Desktop: An Empirical Study of Virtually Collocated Teams
Mark, G. J., Grudin, J. T., & Poltrock, S. E. (1999) · Springer eBooks · doi:10.1007/978-94-011-4441-4_9 · Cited by 123
Psychological Determinants of Political Opinionation
Krosnick, J. A., & Milburn, M. A. (1990) · Social Cognition · doi:10.1521/soco.1990.8.1.49 · Cited by 113
Self-citationHerzog, A. R., & Rodgers, W. L. (1988) · Public Opinion Quarterly · doi:10.1086/269083 · Cited by 100
Social Desirability Bias: A Demonstration and Technique for Its Reduction
Gordon, R. A. (1987) · Teaching of Psychology · doi:10.1207/s15328023top1401_11 · Cited by 97
Social desirability and the randomized response technique.
Himmelfarb, S., & Lickteig, C. W. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.4.710 · Cited by 91
Actors and Questions in Telephone and Personal Interview Surveys
Groves, R. M. (1979) · Public Opinion Quarterly · doi:10.1086/268511 · Cited by 91
Goals and the self-identification process: Constructing desired identities.
Schlenker, B. R., & Weigold, M. F. (1989) · Cited by 90
Social Distance and Interviewer Effects
Dohrenwend, B. S., Colombotos, J., & Dohrenwend, B. P. (1968) · Public Opinion Quarterly · doi:10.1086/267624 · Cited by 87
Random Digit Dialing: A Comparison to Personal Surveys
Klecka, W. R., & Tuchfarber, A. J. (1978) · Public Opinion Quarterly · doi:10.1086/268433 · Cited by 83
Interviewing Older Adults: A Comparison of Telephone and Face-to-Face Modalities
Herzog, A. R., Rodgers, W. L., & Kulka, R. A. (1983) · Public Opinion Quarterly · doi:10.1086/268798 · Cited by 82
Mangione, T. W., Hingson, R., & BARRETT, J. A. (1982) · Sociological Methods & Research · doi:10.1177/0049124182010003006 · Cited by 73
Generality of the effects of practice on social judgment tasks.
Smith, E. R., Branscombe, N. R., & Bormann, C. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.3.385 · Cited by 70
Communication Media and Negotiation Processes
Poole, M. S., Shannon, D. L., & Desanctis, G. L. (1992) · Sage eBooks · doi:10.4135/9781483325880.n3 · Cited by 66
The feasibility of collecting drug abuse data by telephone.
Gfroerer, J., & Hughes, A. (1991) · Europe PMC (PubMed Central) · Cited by 64
Attempts to improve the accuracy of self-reports of voting.
Abelson, R. P., Loftus, E. F., & Greenwald, A. G. (1992) · Cited by 62
Cognitive Performance Measures in Survey Research on Older Adults
Herzog, A. R., & Rodgers, W. L. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203345115_chapter_16 · Cited by 52
Medical Economics Survey-Methods Study: Cost-Effectiveness of Alternative Survey Strategies
Yaffe, R., Shapiro, S., Fuchsberg, R. R., & Rohde, C. A. (1978) · Medical Care · doi:10.1097/00005650-197808000-00003 · Cited by 46
A Study of Experimental Techniques for Telephone Interviewing
Miller, P. V., & Cannell, C. F. (1982) · Public Opinion Quarterly · doi:10.1086/268717 · Cited by 32
Telephone Interviewing: A Reappraisal and a Field Experiment
Quinn, R. P., Gutek, B. A., & Walsh, J. T. (1980) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp0102_3 · Cited by 29
An experimental comparison of telephone and personal health interview surveys.
Thornberry, O. T. (1987) · PubMed · Cited by 28
Acquiescence in Needs Assessment Studies of the Elderly
Calsyn, R. J., Roades, L. A., & Calsyn, D. A. (1992) · The Gerontologist · doi:10.1093/geront/32.2.246 · Cited by 23
Cited by
Sensitive questions in surveys.
Tourangeau, R., & Yan, T. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.859 · Cited by 3,057
Determinants of social desirability bias in sensitive surveys: a literature review
Krumpal, I. (2013) · Quality & Quantity · doi:10.1007/s11135-011-9640-9 · Cited by 2,860
Validating vignette and conjoint survey experiments against real-world behavior
Hainmueller, J., Hangartner, D., & Yamamoto, T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416587112 · Cited by 1,344
Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity
Kreuter, F., Presser, S., & Tourangeau, R. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn063 · Cited by 1,220
DEPARTMENT OF HEALTH & HUMAN SERVICES
Schuchat, A. (2015) · Pharmacy Today · doi:10.1016/s1042-0991(15)32122-8 · Cited by 1,098
Metadata
- Authors
- Holbrook, A. L., Green, M. C., & Krosnick, J. A.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2003
- Volume
- 67
- Issue
- 1
- Pages
- 79-125
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2184015064
- Cited by
- 916
- References
- 71
- FWCI
- 64.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.