The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Mode of questionnaire administration can have serious effects on data quality
Abstract
BACKGROUND: One of the main primary data collection instruments in social, health and epidemiological research is the survey questionnaire. Modes of data collection by questionnaire differ in several ways, including the method of contacting respondents, the medium of delivering the questionnaire to respondents, and the administration of the questions. These are likely to have different effects on the quality of the data collected. METHODS: This paper is based on a narrative review of systematic and non-systematic searches of the literature on the effects of mode of questionnaire administration on data quality. RESULTS: Within different modes of questionnaire administration, there were many documented potential, biasing influences on the responses obtained. These were greatest between different types of mode (e.g. self-administered versus interview modes), rather than within modes. It can be difficult to separate out the effects of the different influences, at different levels. CONCLUSIONS: The biasing effects of mode of questionnaire administration has important implications for research methodology, the validity of the results of research, and for the soundness of public policy developed from evidence using questionnaire-based research. All users of questionnaires need to be aware of these potential effects on their data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Validating the SF-36 health survey questionnaire: new outcome measure for primary care.
Brazier, J. E., Harper, R., Jones, N. M., O'Cathain, A., Thomas, K. J., Usherwood, T., & Westlake, L. (1992) · BMJ · doi:10.1136/bmj.305.6846.160 · Cited by 4,653
Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias
Warner, S. L. (1965) · Journal of the American Statistical Association · doi:10.1080/01621459.1965.10480775 · Cited by 3,255
Research methods in the social sciences
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6257 · Cited by 3,122
Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998) · Science · doi:10.1126/science.280.5365.867 · Cited by 2,046
Dooley, D. (1984) · Cited by 1,632
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Tourangeau, R., & Smith, T. W. (1996) · Public Opinion Quarterly · doi:10.1086/297751 · Cited by 1,295
Nyklícek, I. (2000) · Journal of Psychophysiology · doi:10.1027//0269-8803.14.2.126 · Cited by 1,266
Cited by
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051
Irwin, D. E., Milsom, I., Hunskaar, S., Reilly, K., Kopp, Z., Herschorn, S., Coyne, K., Kelleher, C., Hampel, C., Artibani, W., et al. (2006) · European Urology · doi:10.1016/j.eururo.2006.09.019 · Cited by 2,632
Burnout–Depression Overlap: A Review
Bianchi, R., Schonfeld, I. S., & Laurent, E. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.01.004 · Cited by 868
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Stolk, R. P., Rosmalen, J. G. M., Postma, D. S., de Boer, R. A., Navis, G., Slaets, J. P. J., Ormel, J., & Wolffenbuttel, B. H. R. (2008) · European Journal of Epidemiology · doi:10.1007/s10654-007-9204-4 · Cited by 391
Heerwegh, D., & Loosveldt, G. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn045 · Cited by 367
Udmale, P., Ichikawa, Y., Manandhar, S., Ishidaira, H., & Kiem, A. S. (2014) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2014.09.011 · Cited by 357
Defining chronic pain in epidemiological studies: a systematic review and meta-analysis
Steingrímsdóttir, Ó. A., Landmark, T., Macfarlane, G. J., & Nielsen, C. S. (2017) · Pain · doi:10.1097/j.pain.0000000000001009 · Cited by 339
Assessing the validity of the Global Activity Limitation Indicator in fourteen European countries
Berger, N., Van Oyen, H., Cambois, E., Fouweather, T., Jagger, C., Nusselder, W., & Robine, J.-M. (2015) · BMC Medical Research Methodology · doi:10.1186/1471-2288-15-1 · Cited by 317
Outdoor Time, Screen Time, and Connection to Nature: Troubling Trends Among Rural Youth?
Larson, L. R., Szczytko, R., Bowers, E. P., Stephens, L. E., Stevenson, K. T., & Floyd, M. F. (2019) · Environment and Behavior · doi:10.1177/0013916518806686 · Cited by 300
Patient-Reported Outcomes In Performance Measurement
Cella, D., Hahn, E., Jensen, S., Butt, Z., Nowinski, C., Rothrock, N., & Lohr, K. (2015) · doi:10.3768/rtipress.2015.bk.0014.1509 · Cited by 299
Roth, A., Ogrin, S., & Schmitz, B. (2016) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-015-9229-2 · Cited by 294
Physician Awareness of Drug Cost: A Systematic Review
Allan, G. M., Lexchin, J., & Wiebe, N. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040283 · Cited by 292
Major Depressive and Anxiety Disorders in Visually Impaired Older Adults
van der Aa, H. P. A., Comijs, H. C., Penninx, B. W. J. H., van Rens, G. H. M. B., & van Nispen, R. M. A. (2015) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-15848 · Cited by 280
The development of children’s environmental attitude and behavior
Otto, S., Evans, G. W., Moon, M. J., & Kaiser, F. G. (2019) · Global Environmental Change · doi:10.1016/j.gloenvcha.2019.101947 · Cited by 278
Jordan, S., & Hoebel, J. (2015) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-015-2200-z · Cited by 268
Hoebel, J., Maske, U. E., Zeeb, H., & Lampert, T. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169764 · Cited by 261
Forkus, S. R., Raudales, A. M., Rafiuddin, H. S., Weiss, N. H., Messman, B. A., & Contractor, A. A. (2023) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000111 · Cited by 262
Algren, M. H., Ekholm, O., Nielsen, L., Ersbøll, A. K., Bak, C. K., & Andersen, P. T. (2018) · BMC Public Health · doi:10.1186/s12889-018-5170-x · Cited by 187
“generally had a higher risk of social desirability bias than self-administered questionnaires [67].”
BackgroundDunlop, W. L., & Tracy, J. L. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0031185 · Cited by 166
Hunger, M., Thorand, B., Schunk, M., Döring, A., Menn, P., Peters, A., & Holle, R. (2011) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-9-53 · Cited by 154
Christensen, A. I., Ekholm, O., Glümer, C., & Juel, K. (2014) · European Journal of Public Health · doi:10.1093/eurpub/ckt067 · Cited by 148
Boosey, R., Prestwich, G., & Deave, T. (2014) · Pan African Medical Journal · doi:10.11604/pamj.2014.19.253.5313 · Cited by 122
Anxiety prevalence following spinal cord injury: a meta-analysis
Le, J., & Dorstyn, D. (2016) · Spinal Cord · doi:10.1038/sc.2016.15 · Cited by 109
Van De Looij‐Jansen, P. M., & De Wilde, E. J. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00860.x · Cited by 102
Stallings-Smith, S., Zeka, A., Goodman, P., Kabir, Z., & Clancy, L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062063 · Cited by 99
Kim, S. (2017) · International Review of Administrative Sciences · doi:10.1177/0020852315596214 · Cited by 86
Chacky, F., Runge, M., Rumisha, S. F., Machafuko, P., Chaki, P., Massaga, J. J., Mohamed, A., Pothin, E., Molteni, F., Snow, R. W., et al. (2018) · Malaria Journal · doi:10.1186/s12936-018-2601-1 · Cited by 85
Unmet psychosocial needs of Pennsylvanians with cancer: 1986–2005
Barg, F. K., Cronholm, P. F., Straton, J. B., Keddem, S., Knott, K., Grater, J., Houts, P., & Palmer, S. C. (2007) · Cancer · doi:10.1002/cncr.22820 · Cited by 84
Landry, E. C., Sandoval, X. C. R., Simeone, C. N., Tidball, G., Lea, J., & Westerberg, B. D. (2020) · Otology & Neurotology · doi:10.1097/mao.0000000000002472 · Cited by 82
Turk, T., Elhady, M. T., Rashed, S., Abdelkhalek, M., Nasef, S. A., Khallaf, A. M., Mohammed, A. T., Attia, A. W., Adhikari, P., Amin, M. A., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194239 · Cited by 81
Chumpitazi, B. P., Weidler, E. M., Lu, D. Y., Tsai, C. M., & Shulman, R. J. (2016) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2016.04.017 · Cited by 68
Cancer survivorship and aging: Moving the science forward
Bellizzi, K. M., Mustian, K. M., Palesh, O. G., & Diefenbach, M. (2008) · Cancer · doi:10.1002/cncr.23942 · Cited by 67
Barber, F. D. (2013) · Oncology Nursing Forum · doi:10.1188/13.onf.481-489 · Cited by 67
“According to Bowling (2005), self-report questionnaires are considered the most burdensome mode of obtaining information from participants because self-administration surveys require respondents to be literate, have no visual or dexterity impairments, and may cause easy fatigability.”
Antimicrobial use practices, attitudes and responsibilities in UK farm animal veterinary surgeons
Coyne, L. A., Latham, S. M., Dawson, S., Donald, I. J., Pearson, R. B., Smith, R. F., Williams, N. J., & Pinchbeck, G. L. (2018) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2018.10.021 · Cited by 60
“In addition, there may be limitations in self-reported behaviours, whereby participants may respond to questions as they believe the authors expect them to, rather than reporting actual practices may occur (Bowling, 2005).”
BackgroundMori, A., Okamoto, Y., Okada, G., Takagaki, K., Jinnin, R., Takamura, M., Kobayakawa, M., & Yamawaki, S. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.09.036 · Cited by 49
Mofsen, A. M., Rodebaugh, T. L., Nicol, G. E., Depp, C. A., Miller, J. P., & Lenze, E. J. (2019) · JMIR Mental Health · doi:10.2196/11845 · Cited by 51
Norms of filial obligation in the Netherlands.
Dykstra, P. A., & Fokkema, T. (2012) · Population (english edition) · doi:10.3917/pope.1201.0097 · Cited by 46
Fragility Fracture Nursing: Holistic Care and Management of the Orthogeriatric Patient
(2018) · Perspectives in Nursing Management and Care for Older Adults · doi:10.1007/978-3-319-76681-2 · Cited by 40
Yuan, Q., Wang, P., Tan, T. H., Devi, F., Poremski, D., Magadi, H., Goveas, R., Ng, L. L., Chong, S. A., & Subramaniam, M. (2021) · The Gerontologist · doi:10.1093/geront/gnaa080 · Cited by 35
Smith, L., Malcolm-Smith, S., & de Vries, P. J. (2017) · Autism · doi:10.1177/1362361316648469 · Cited by 37
Psychiatric diagnosis by telephone: is it an opportunity?
Muskens, E. M. H., Lucassen, P., Groenleer, W., van Weel, C., Oude Voshaar, R., & Speckens, A. (2014) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-014-0861-9 · Cited by 24
“Telephone interviews in general show more compliance or acquiescence (yes-saying), evasiveness (‘‘I don’t know’’ answers, or no response at all) and more extreme responses compared with the face-to-face interviews [2, 3, 9–11].”
BackgroundReligious Commitment’s Moderating Effect on Refugee Trauma and Growth
Acquaye, H. E., Sivo, S. A., & Dayle Jones, K. (2018) · Counseling and Values · doi:10.1002/cvj.12073 · Cited by 21
Mindful attention regulation and non-judgmental orientation in depression: A multi-method approach
Rohde, K., Adolph, D., Dietrich, D. E., & Michalak, J. (2014) · Biological Psychology · doi:10.1016/j.biopsycho.2014.06.009 · Cited by 20
The assessment of psychological factors on upper extremity disability: a scoping review
MacDermid, J. C., Valdes, K., Szekeres, M., Naughton, N., & Algar, L. (2018) · Journal of Hand Therapy · doi:10.1016/j.jht.2017.05.017 · Cited by 19
Mulvany, J. L., Hetherington, V. J., & VanGeest, J. B. (2019) · The Foot · doi:10.1016/j.foot.2019.05.005 · Cited by 13
Undisclosed HIV infection among MSM in a behavioral surveillance study.
Hoots, B. E., Wejnert, C., Martin, A., Haaland, R., Masciotra, S., Sionean, C., Smith, A., Switzer, W. M., & Paz-Bailey, G. (2019) · AIDS · doi:10.1097/qad.0000000000002147 · Cited by 10
Willingness of general dental practices in South East London to engage with research
Afeef, M., Redican, C., & Bernabé, E. (2019) · Primary Health Care Research & Development · doi:10.1017/s1463423618000944 · Cited by 1
Metadata
- Authors
- Bowling, A.
- Venue
- Journal of Public Health
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-05-03
- Volume
- 27
- Issue
- 3
- Pages
- 281-291
- ISSN
- 0943-1853 (ISSN-L)
- 1741-3850
- 1741-3842
- OpenAlex
- W2156813589
- Cited by
- 1,871
- References
- 62
- FWCI
- 60.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.