The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Mode of questionnaire administration can have serious effects on data quality
Abstract
BACKGROUND: One of the main primary data collection instruments in social, health and epidemiological research is the survey questionnaire. Modes of data collection by questionnaire differ in several ways, including the method of contacting respondents, the medium of delivering the questionnaire to respondents, and the administration of the questions. These are likely to have different effects on the quality of the data collected. METHODS: This paper is based on a narrative review of systematic and non-systematic searches of the literature on the effects of mode of questionnaire administration on data quality. RESULTS: Within different modes of questionnaire administration, there were many documented potential, biasing influences on the responses obtained. These were greatest between different types of mode (e.g. self-administered versus interview modes), rather than within modes. It can be difficult to separate out the effects of the different influences, at different levels. CONCLUSIONS: The biasing effects of mode of questionnaire administration has important implications for research methodology, the validity of the results of research, and for the soundness of public policy developed from evidence using questionnaire-based research. All users of questionnaires need to be aware of these potential effects on their data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Validating the SF-36 health survey questionnaire: new outcome measure for primary care.
Brazier, J. E., Harper, R., Jones, N. M., O'Cathain, A., Thomas, K. J., Usherwood, T., & Westlake, L. (1992) · BMJ · doi:10.1136/bmj.305.6846.160 · Cited by 4,653
Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias
Warner, S. L. (1965) · Journal of the American Statistical Association · doi:10.1080/01621459.1965.10480775 · Cited by 3,255
Research methods in the social sciences
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6257 · Cited by 3,122
Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998) · Science · doi:10.1126/science.280.5365.867 · Cited by 2,046
Dooley, D. (1984) · Cited by 1,632
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Tourangeau, R., & Smith, T. W. (1996) · Public Opinion Quarterly · doi:10.1086/297751 · Cited by 1,295
Nyklícek, I. (2000) · Journal of Psychophysiology · doi:10.1027//0269-8803.14.2.126 · Cited by 1,266
Dillman, D. A. (1999) · Cited by 1,161
Presser, S., Rossi, P. H., Wright, J. D., & Anderson, A. B. (1985) · Social Forces · doi:10.2307/2578982 · Cited by 921
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825
McColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., & Bond, J. (2001) · Health Technology Assessment · doi:10.3310/hta5310 · Cited by 788
Thinking about Answers: The Application of Cognitive Process to Survey Methodology
Aalbaum, G., Sudman, S., Bradburn, N. M., & Schwarz, N. (1996) · Journal of Marketing Research · doi:10.2307/3152133 · Cited by 783
Questions and Answers in Attitude Surveys.
Robinson, J. P., Schuman, H., & Presser, S. (1983) · Social Forces · doi:10.2307/2578327 · Cited by 778
Mackay, I. R. (1995) · Cited by 667
Park, D. C., & Schwarz, N. (1999) · Medical Entomology and Zoology · Cited by 657
Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines.
Schaible, W. L., Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. (1987) · Journal of the American Statistical Association · doi:10.2307/2289187 · Cited by 618
McHorney, C. A., Kosinski, M., & Ware, J. E. (1994) · Medical Care · doi:10.1097/00005650-199406000-00002 · Cited by 608
Presser, S., Groves, R. M., Biemer, P. M., Lyberg, L. E., Massey, J. T., Nicholls, W. L., & Waksberg, J. (1990) · Contemporary Sociology · doi:10.2307/2072660 · Cited by 553
Data Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 525
Data Collection Mode and Social Desirability Bias in Self-Reported Religious Attendance
Presser, S., & Stinson, L. (1998) · American Sociological Review · doi:10.2307/2657486 · Cited by 440
Rating Scales: Numeric Values May Change the Meaning of Scale Labels
Schwarz, N., Knauper, B., Hippler, H.-J., Noelle-Neumann, E., & Clark, L. (1991) · Public Opinion Quarterly · doi:10.1086/269282 · Cited by 411
A comparison of mail, telephone, and home interview strategies for household health surveys.
Siemiatycki, J. (1979) · American Journal of Public Health · doi:10.2105/ajph.69.3.238 · Cited by 402
Surveys by Telephone: A National Comparison with Personal Interviews.
Ferree, G. D., Groves, R. M., & Kahn, R. L. (1982) · Contemporary Sociology · doi:10.2307/2066654 · Cited by 371
A multidimensional model of the quality of life in older age
Bowling, A., Banister, D., Sutton, S., Evans, O., & Windsor, J. (2002) · Aging & Mental Health · doi:10.1080/1360786021000006983 · Cited by 328
Self-citationBowling, A., Bond, M., Jenkinson, C., & Lamping, D. (1999) · Journal of Public Health · doi:10.1093/pubmed/21.3.255 · Cited by 289
Self-citationScott, C. (1961) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2984129 · Cited by 258
Cognition, Aging and Self-Reports
(1998) · Psychology Press eBooks · doi:10.4324/9780203345115 · Cited by 254
Are health-related quality-of-life measures affected by the mode of administration?
Weinberger, M., Oddone, E. Z., Samsa, G. P., & Landsman, P. B. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00556-0 · Cited by 234
Bradburn, N. M. (1983) · Elsevier eBooks · doi:10.1016/b978-0-12-598226-9.50014-8 · Cited by 185
Self-administered questionnaire compared with interview to assess past-year physical activity
VUILLEMIN, A., OPPERT, J.-M., GUILLEMIN, F., ESSERMEANT, L., FONTVIEILLE, A.-M., GALAN, P., KRISKA, A. M., & HERCBERG, S. (2000) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200006000-00013 · Cited by 182
Johnson, A. M., Copas, A. J., Erens, B., Mandalia, S., Fenton, K. A., Korovessis, C., Wellings, K., & Field, J. (2001) · AIDS · doi:10.1097/00002030-200101050-00016 · Cited by 135
CONFIDENTIALITY ASSURANCES IN SURVEYS: REASSURANCE OR THREAT?
Singer, E., Hippler, H., & Schwarz, N. (1992) · International Journal of Public Opinion Research · doi:10.1093/ijpor/4.3.256 · Cited by 128
Fouladi, R. T., McCarthy, C. J., & Moller, N. P. (2002) · Assessment · doi:10.1177/10791102009002011 · Cited by 127
Williams, M. L., Freeman, R. C., Bowen, A. M., Zhao, Z., Elwood, W. N., Gordon, C., Young, P. A., Rusek, R., & Signes, C.-A. (2000) · AIDS Education and Prevention · doi:10.1521/aeap.2000.12.3.199 · Cited by 127
Durant, L. E., & Carey, M. P. (2000) · Archives of Sexual Behavior · doi:10.1023/a:1001930202526 · Cited by 126
An Examination of Self- and Telephone-Administered Modes of Administration for the Australian SF-36
Perkins, J. J., & Sanson‐Fisher, R. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00088-2 · Cited by 120
The Impact of Age and Education on Response Order Effects in Attitude Measurement
Knäuper, B. (1999) · Public Opinion Quarterly · doi:10.1086/297724 · Cited by 118
Telephone versus in-person interviews for alcohol use: results of the 2000 National Alcohol Survey
Midanik, L. T., & Greenfield, T. K. (2003) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(03)00204-7 · Cited by 117
Ryan, J., Corry, J. R., Attewell, R. G., & Smithson, M. J. (2002) · Quality of Life Research · doi:10.1023/a:1014415709997 · Cited by 113
Brambilla, D. J., & McKinlay, S. M. (1987) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114734 · Cited by 112
Subsequent Questions May Influence Answers to Preceding Questions in Mail Surveys
Schwarz, N., & Hippler, H. (1995) · Public Opinion Quarterly · doi:10.1086/269460 · Cited by 104
SF-36 scores vary by method of administration: implications for study design
Lyons, R. A., Wareham, K., Lucas, M., Price, D., Williams, J. G., & Hutchings, H. A. (1999) · Journal of Public Health · doi:10.1093/pubmed/21.1.41 · Cited by 104
Wu, A. W., Jacobson, D. L., Berzon, R. A., Revicki, D. A., van der Horst, C., Fichtenbaum, C. J., Saag, M. S., Lynn, L. A., Hardy, D., & Feinberg, J. (1997) · Quality of Life Research · doi:10.1023/a:1026471020698 · Cited by 99
Harewood, G. C., Yacavone, R. F., Locke, G. R., & Wiersema, M. J. (2001) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2001.05331.x · Cited by 82
Glaser, A., Davies, K., Walker, D. A., & Brazier, D. (1997) · Quality of Life Research · doi:10.1023/a:1026465411669 · Cited by 81
EVANS, M., KESSLER, D., LEWIS, G., PETERS, T. J., & SHARP, D. (2004) · Psychological Medicine · doi:10.1017/s0033291703008055 · Cited by 80
Comparing Telephone and Mail Responses to the CAHPS™ Survey Instrument
Fowler, F. J., Gallagher, P. M., & Nederend, S. (1999) · Medical Care · doi:10.1097/00005650-199903001-00005 · Cited by 79
Assessing research outcomes by postal questionnaire with telephone follow-up
Parker, C., & Dewey, M. E. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.6.1065 · Cited by 71
Assessing Inner-City Patients' Hospital Experiences
Harris, L. E., Weinberger, M., & Tierney, W. M. (1997) · Medical Care · doi:10.1097/00005650-199701000-00006 · Cited by 65
Gasquet, I., Falissard, B., & Ravaud, P. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00387-0 · Cited by 64
Does the mode of questionnaire administration affect the reporting of urinary symptoms?
Rhodes, T., Girman, C. J., Jacobsen, S. J., Guess, H. A., Hanson, K. A., Oesterling, J. E., & Lieber, M. M. (1995) · Urology · doi:10.1016/s0090-4295(99)80217-9 · Cited by 55
Olsen, J. (1998) · International Journal of Epidemiology · doi:10.1093/ije/27.6.935 · Cited by 48
Sensitivity to Change and the Effect of Mode of Administration on Health Status Measurement
Chambers, L. W., Haight, M. E., Norman, G., & Macdonald, L. A. (1987) · Medical Care · doi:10.1097/00005650-198706000-00002 · Cited by 44
Nebot, M., Celentano, D. D., Burwell, L. G., Davis, A., Davis, M., Polacsek, M., & Santelli, J. S. (1994) · Journal of Epidemiology & Community Health · doi:10.1136/jech.48.4.412 · Cited by 44
Interview vs. paper-and-pencil administration of the McGill pain questionnaire
Klepac, R. K., Dowling, J., Rokke, P. D., Dodge, L., & Schafer, L. C. (1981) · Pain · doi:10.1016/0304-3959(81)90009-9 · Cited by 42
Interview Modality: Effects on Costs and Data Quality in a Sample of Older Women
Pruchno, R. A., & Hayden, J. M. (2000) · Journal of Aging and Health · doi:10.1177/089826430001200101 · Cited by 36
Kaplan, C. P., Hilton, J. F., Park-Tanjasiri, S., et al. (2001) · Evaluation Review · doi:10.1177/0193841x0102500403 · Cited by 24
Agreement between interview data and a self-administered questionnaire on dietary supplement use.
Dorant, E., van den Brandt, P. A., Goldbohm, R. A., Hermus, R. J. J., & STURMANS, F. (1994) · PubMed · Cited by 17
Effect of Mode of Administration on I–PSS Scores in a Large BPH Patient Population
Garcı́a-Losa, M., Unda, M., Badia, X. C., Rodriguez-Alcantara, F., Carballido, J., eacute, R. D.-R., & Herdman, M. (2001) · European Urology · doi:10.1159/000049815 · Cited by 11
Cited by
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051
Irwin, D. E., Milsom, I., Hunskaar, S., Reilly, K., Kopp, Z., Herschorn, S., Coyne, K., Kelleher, C., Hampel, C., Artibani, W., et al. (2006) · European Urology · doi:10.1016/j.eururo.2006.09.019 · Cited by 2,632
Burnout–Depression Overlap: A Review
Bianchi, R., Schonfeld, I. S., & Laurent, E. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.01.004 · Cited by 868
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Stolk, R. P., Rosmalen, J. G. M., Postma, D. S., de Boer, R. A., Navis, G., Slaets, J. P. J., Ormel, J., & Wolffenbuttel, B. H. R. (2008) · European Journal of Epidemiology · doi:10.1007/s10654-007-9204-4 · Cited by 391
Metadata
- Authors
- Bowling, A.
- Venue
- Journal of Public Health
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-05-03
- Volume
- 27
- Issue
- 3
- Pages
- 281-291
- ISSN
- 0943-1853 (ISSN-L)
- 1741-3850
- 1741-3842
- OpenAlex
- W2156813589
- Cited by
- 1,871
- References
- 62
- FWCI
- 60.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.