Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs
Open accessAbstract
BACKGROUND: Non-response is an important potential source of bias in survey research. With evidence of falling response rates from GPs, it is of increasing importance when undertaking postal questionnaire surveys of GPs to seek to maximize response rates and evaluate the potential for non-response bias. OBJECTIVES: Our aim was to investigate the effectiveness of follow-up procedures when undertaking a postal questionnaire study of GPs, the use of publicly available data in assessing non-response bias and the development of regression models predicting responder behaviour. METHOD: A postal questionnaire study was carried out of a random sample of 600 GPs in Wales concerning their training and knowledge in palliative care. RESULTS: A cumulative response rate graph permitted optimal timing of follow-up mailings: a final response rate of 67.6% was achieved. Differences were found between responders and non-responders on several parameters and between sample and population on some parameters: some of these may bias the sample data. Logistic regression analysis indicated medical school of qualification and current membership of the Royal College of General Practitioners to be the only significant predictors of responders. Late responders were significantly more likely to have been qualified for longer. CONCLUSIONS: This study has several implications for future postal questionnaire studies of GPs. The optimal timing of reminders may be judged from plotting the cumulative response rate: it is worth sending at least three reminders. There are few parameters that significantly predict GPs who are unlikely to respond; more of these may be included in the sample, or they may be targeted for special attention. Publicly available data may be used readily in the analysis of non-response bias and generalizability.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Clinician survey response rates are typically low, between 20% and 60%.
“Though clinicians usually have low survey response rates (20% to 60%) [37]”
From The Work-life Check-ins randomized controlled trial: a leader-based adaptive, semi-structured burnout intervention in primary care clinics (2024) · cites this paper as [37]
The Introduction says response rates in GP studies have been falling and reports a mean of 61% in published GP studies. This supports concern about low response rates, but not a typical range of 20%–60% for clinicians generally; the paper's own survey had a 67.6% response rate (Results). (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hesselbart, S., & Fowler, F. J. (1985) · Journal of the American Statistical Association · doi:10.2307/2288598 · Cited by 4,767 · see citing works
Square, T., London, & Wc, H. (1920) · British Journal of Ophthalmology · doi:10.1136/bjo.4.1.25 · Cited by 1,623 · see citing works
The Royal College of General Practitioners
Fry, J. (1983) · Springer eBooks · doi:10.1007/978-94-011-7304-9_14 · Cited by 1,317 · see citing works
The Design and Administration of Mail Surveys
Dillman, D. A. (1991) · Annual Review of Sociology · doi:10.1146/annurev.so.17.080191.001301 · Cited by 1,311 · see citing works
Heberlein, T. A., & Baumgartner, R. (1978) · American Sociological Review · doi:10.2307/2094771 · Cited by 999 · see citing works
Stimson, R. J. (2014) · Edward Elgar Publishing eBooks · doi:10.4337/9780857932976.00016 · Cited by 491 · see citing works
Air Pollution and Infant Mortality in Mexico City
LOOMIS, D. P., Castillejos, M., Gold, D. R., McDonnell, W. F., & Borja‐Aburto, V. H. (1999) · Epidemiology · doi:10.1097/00001648-199903000-00006 · Cited by 326 · see citing works
General practice postal surveys: a questionnaire too far?
McAvoy, B., & Kaner, E. (1996) · BMJ · doi:10.1136/bmj.313.7059.732 · Cited by 283 · see citing works
Surveying general practitioners: does a low response rate matter?
Templeton, L., Deehan, A., Taylor, C., Drummond, C., & Strang, J. (1997) · Europe PMC (PubMed Central) · Cited by 229 · see citing works
Kaner, E., Haighton, C., & McAvoy, B. (1998) · PubMed · Cited by 186 · see citing works
Telephone versus postal surveys of general practitioners: methodological considerations.
Sibbald, B., Addington-Hall, J. M., Brenneman, D., et al. (1994) · PubMed · Cited by 162 · see citing works
Professionals as responders: variations in and effects of response rates to questionnaires, 1961-77.
Cartwright, A. (1978) · BMJ · doi:10.1136/bmj.2.6149.1419 · Cited by 144 · see citing works
Further Evidence on Factors Affecting Response Rates to Mailed Questionnaires
Goyder, J. (1982) · American Sociological Review · doi:10.2307/2095199 · Cited by 130 · see citing works
The Design And Administration Of Mail Surveys
Dillman, D. A. (1991) · Annual Review of Sociology · doi:10.1146/annurev.soc.17.1.225 · Cited by 118 · see citing works
Deehan, A., Templeton, L., Taylor, C., Drummond, C., & Strang, J. (1997) · Europe PMC (PubMed Central) · Cited by 99 · see citing works
RESEARCH: IS AN ‘IDEAL’ QUESTIONNAIRE POSSIBLE?
Charlton, R. C. (2000) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2000.tb11922.x · Cited by 74 · see citing works
Physician Participation in Research Surveys
Donaldson, G. W., Moinpour, C. M., Bush, N. E., Chapko, M. K., Jocom, J., Siadak, M. F., Nielsen-Stoeck, M., Bradshaw, J. M., Bichindaritz, I., & Sullivan, K. M. (1999) · Evaluation & the Health Professions · doi:10.1177/01632789922034392 · Cited by 60 · see citing works
Armstrong, D., & Ashworth, M. J. (2000) · PubMed · Cited by 59 · see citing works
How common is medical training in palliative care? A postal survey of general practitioners.
Barclay, S. I. G., Todd, C., Grande, G., et al. (1997) · PubMed · Cited by 54 · see citing works
Self-citationFormal instruction in United Kingdom medical schools about death and dying
Field, D. J. (1984) · Medical Education · doi:10.1111/j.1365-2923.1984.tb01298.x · Cited by 51 · see citing works
Response Bias in a Study of General Practice
Cockburn, J., Campbell, E. M., GORDON, J. J., & Sanson‐Fisher, R. (1988) · Family Practice · doi:10.1093/fampra/5.1.18 · Cited by 47 · see citing works
Commentary: avoid surveys masquerading as research
Lydeard, S. (1996) · BMJ · doi:10.1136/bmj.313.7059.733 · Cited by 34 · see citing works
(1962) · The Lancet · doi:10.1016/s0140-6736(62)90911-x · Cited by 30 · see citing works
Barclay, S. I. G., Todd, C., McCabe, J., et al. (1999) · PubMed · Cited by 28 · see citing works
Self-citationMcDonald, P. (1993) · PubMed · Cited by 27 · see citing works
Palliative medicine education for medical students: a survey of British medical schools, 1992
Smith, A. (1994) · Medical Education · doi:10.1111/j.1365-2923.1994.tb02698.x · Cited by 17 · see citing works
Improving response rates among doctors: randomised trial: Table 1
Sloan, M., Kreiger, N., & James, B. (1997) · BMJ · doi:10.1136/bmj.315.7116.1136 · Cited by 15 · see citing works
Gordon, G. A. S. (1892) · BMJ · doi:10.1136/bmj.2.1666.1259-c · Cited by 14 · see citing works
Moore, M., Post, K., & Smith, H. E. (1999) · PubMed · Cited by 12 · see citing works
Women may be more susceptible to adverse events: Table 1
Phillips, M. (1996) · BMJ · doi:10.1136/bmj.313.7071.1552c · Cited by 9 · see citing works
Wyld, R., Robertson, R., & Gillon, J. (1997) · PubMed · Cited by 8 · see citing works
Ashworth, M. J. (2001) · BMJ · doi:10.1136/bmj.322.7287.675/a · Cited by 8 · see citing works
Cottrill, M. (1996) · BMJ · doi:10.1136/bmj.313.7071.1552 · Cited by 7 · see citing works
Postal surveys in general practice
Summerton, N. (1996) · BMJ · doi:10.1136/bmj.313.7071.1551c · Cited by 4 · see citing works
Jeffree, P. (1990) · Springer eBooks · doi:10.1007/978-1-4899-6876-0_10 · Cited by 4 · see citing works
Drug development means economics in the end
Senn, S. J. (2001) · BMJ · doi:10.1136/bmj.322.7287.675 · Cited by 3 · see citing works
Britain was healthier than Germany in 1914
Kealey, T. (1996) · BMJ · doi:10.1136/bmj.313.7071.1551 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Hartge P. Raising response rates: getting to yes. Epidemiology 1999; 10: 105-107.
- McDonald P. Response rates in general practice studies. Br J Gen Pract 1993; 43: 484.
- O'Neill T, Marsden D, Silman A. Differences in the character- istics of responders and non-responders in a prevalence study of vertebral osteoporosis. Osteoporosis Int 1995; 5: 327-334.
- Barclay S, Todd C, Grande G, Lipscombe J. How common is medical training in palliative care? Br J Gen Pract 1997; 47: 800-805.
- Sloan M, Kreiger N, James B. Improving response rates among doctors: randomised trial. Br Med J 1997; 315: 1136.
Cited by
Sorted by citations
Exploring physician specialist response rates to web-based surveys
Cunningham, C. T., Quan, H., Hemmelgarn, B., Noseworthy, T., Beck, C. A., Dixon, E., Samuel, S., Ghali, W. A., Sykes, L. L., & Jetté, N. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0016-z · Cited by 995 · see citing works
The Experience Sampling Method on Mobile Devices
van Berkel, N., Ferreira, D., & Kostakos, V. (2018) · ACM Computing Surveys · doi:10.1145/3123988 · Cited by 432 · see citing works
Prenatal detection of congenital heart disease
Friedberg, M. K., Silverman, N. H., Moon-Grady, A. J., Tong, E., Nourse, J., Sorenson, B., Lee, J., & Hornberger, L. K. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2009.01.050 · Cited by 299 · see citing works
Scott, A., Jeon, S.-H., Joyce, C. M., Humphreys, J. S., Kalb, G., Witt, J., & Leahy, A. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-126 · Cited by 244 · see citing works
Jenkins, P. E., Ducker, I., Gooding, R., James, M., & Rutter-Eley, E. (2021) · Journal of American College Health · doi:10.1080/07448481.2019.1709474 · Cited by 147 · see citing works
Gamper, G., Willeit, M., Sterz, F., Herkner, H., Zoufaly, A., Hornik, K., Havel, C., & Laggner, A. N. (2004) · Critical Care Medicine · doi:10.1097/01.ccm.0000108880.97967.c0 · Cited by 119 · see citing works
GEIRSSON, M., BENDTSEN, P., & SPAK, F. (2005) · Alcohol and Alcoholism · doi:10.1093/alcalc/agh185 · Cited by 93 · see citing works
van Sluisveld, N., Oerlemans, A., Westert, G., van der Hoeven, J. G., Wollersheim, H., & Zegers, M. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2139-x · Cited by 61 · see citing works
Hurtado, D. A., Boyd, J., Madjlesi, R., Greenspan, S. A., Ezekiel-Herrera, D., Potgieter, G., Hammer, L. B., Everson, T., & Lenhart, A. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107609 · Cited by 3 · see citing works
- Authors
- Barclay, S.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Barclay, S.
- ORCID
- Barclay, S.
- Venue
- Family Practice
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-02-01
- Volume
- 19
- Issue
- 1
- Pages
- 105-111
- ISSN
- 0263-2136 (ISSN-L)
- 1460-2229
- OpenAlex
- W2134361987
- Cited by
- 301
- References
- 37
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 10 · 2023: 13 · 2022: 10 · 2021: 11 · 2020: 12 · 2019: 2 · 2018: 7 · 2017: 14 · 2016: 14 · 2015: 22 · 2014: 22 · 2013: 18 · 2012: 21
- FWCI
- 34.91
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Family Practice (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (submittedVersion, other-oa)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Census and Population Estimation
- Keywords
- nonresponse bias, response rate, postal questionnaires, general practitioners, follow-up reminders, predictors of non-response, generalizability, palliative care education
- MeSH terms
- Adult, Family Practice, Female, Health Services Research, Humans, Male, Middle Aged, Surveys and Questionnaires, Bias, Logistic Models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review