The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
Open accessAbstract
BACKGROUND: Research needs to be reported transparently so readers can critically assess the strengths and weaknesses of the design, conduct, and analysis of studies. Reporting guidelines have been developed to inform reporting for a variety of study designs. The objective of this study was to identify whether there is a need to develop a reporting guideline for survey research. METHODS AND FINDINGS: We conducted a three-part project: (1) a systematic review of the literature (including "Instructions to Authors" from the top five journals of 33 medical specialties and top 15 general and internal medicine journals) to identify guidance for reporting survey research; (2) a systematic review of evidence on the quality of reporting of surveys; and (3) a review of reporting of key quality criteria for survey research in 117 recently published reports of self-administered surveys. Fewer than 7% of medical journals (n = 165) provided guidance to authors on survey research despite a majority having published survey-based studies in recent years. We identified four published checklists for conducting or reporting survey research, none of which were validated. We identified eight previous reviews of survey reporting quality, which focused on issues of non-response and accessibility of questionnaires. Our own review of 117 published survey studies revealed that many items were poorly reported: few studies provided the survey or core questions (35%), reported the validity or reliability of the instrument (19%), defined the response rate (25%), discussed the representativeness of the sample (11%), or identified how missing data were handled (11%). CONCLUSIONS: There is limited guidance and no consensus regarding the optimal reporting of survey research. The majority of key reporting criteria are poorly reported in peer-reviewed survey research articles. Our findings highlight the need for clear and consistent reporting guidelines specific to survey research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Although many surveys have been published in high-impact journals, comprehensive reporting guidelines for survey research are limited 13, 14 and substantial variabilities and inconsistencies can be identified in the reporting of survey studies.”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Because of concerns regarding survey qualities and lack of well-developed guidelines, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies. 13, 25 -28, 31, 32”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Although the entire process was conducted electronically, we gathered data and feedback from the participants via email instead of conducting Skype or face-to-face discussions as suggested by the EQUATOR network. 13”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480
Mail and Internet Surveys: The Tailored Design Method
CHISNALL, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,435
Good practice in the conduct and reporting of survey research
KELLEY, K. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg031 · Cited by 2,157 · cited 2×
“Reporting Item Kelley [13] Burns [14] Draugalis [15] AAPOR [18]”
BackgroundResponse rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110
Guidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 3×
“The needs assessment should also include a search for evidence on the quality of reporting of published research in the domain of interest [7].”
BackgroundInfluentialSelf-citationA guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354 · cited 3×
“Reporting Item Kelley [13] Burns [14] Draugalis [15] AAPOR [18]”
BackgroundMethodResponse Rates and Responsiveness for Surveys, Standards, and the Journal
Fincham, J. E. (2008) · American Journal of Pharmaceutical Education · doi:10.5688/aj720243 · Cited by 1,294 · cited 2×
“However, despite lack of explicit policies regarding acceptable standards for response rates or the reporting of response rates, journal editors are known to have implicit policies for acceptable response rates when considering the publication of surveys [17,22,29,30].”
BackgroundPlint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Self-citationMcColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., & Bond, J. (2001) · Health Technology Assessment · doi:10.3310/hta5310 · Cited by 788 · cited 2×
“However, there is substantial literature to show that the methods used in conducting survey research can significantly affect the reliability, validity, and generalisability of study results [3,4].”
BackgroundReported response rates to mailed physician questionnaires.
Cummings, S., Konrad, T., & Savitz, L. A. (2020) · PubMed · doi:10.17615/e1d3-9q29 · Cited by 687
Cook, J. V., Dickinson, H. O., & Eccles, M. P. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-160 · Cited by 493
Best Practices for Survey Research Reports: A Synopsis for Authors and Reviewers
Draugalis, J. R., Coons, S. J., & Plaza, C. M. (2008) · American Journal of Pharmaceutical Education · doi:10.5688/aj720111 · Cited by 434 · cited 1×
“Reporting Item Kelley [13] Burns [14] Draugalis [15] AAPOR [18]”
Designing and Conducting Health Surveys
Aday, L. A. (1998) · Journal For Healthcare Quality · doi:10.1097/01445442-199805000-00015 · Cited by 391
The quality of diagnostic accuracy studies since the STARD statement: Has it improved?
Smidt, N., Rutjes, A. W. S., van der Windt, D. A. W. M., Ostelo, R. W. J. G., Bossuyt, P. M., Reitsma, J. B., Bouter, L. M., & de Vet, H. C. W. (2006) · Neurology · doi:10.1212/01.wnl.0000238386.41398.30 · Cited by 235
Questionnaires in clinical trials: guidelines for optimal design and administration
Edwards, P. (2010) · Trials · doi:10.1186/1745-6215-11-2 · Cited by 188
Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.330.7499.1056 · Cited by 178 · cited 2×
“Using a strategy originally developed by Altman [12] to assess endorsement of CONSORT by top medical journals, we identified the top five journals from each of 33 medical specialties, and the top 15 journals from the general and internal medicine category, using Web of Science citation impact factors (list of journals…”
MethodPrady, S. L., Richmond, S. J., Morton, V. M., & MacPherson, H. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001577 · Cited by 145 · cited 2×
“Given the positive impact that reporting guidelines have had on the quality of reporting of health research [8–11], and the potential for a positive upstream effect on the design and conduct of research [32], there is a fundamental need for well-developed reporting guidelines.”
BackgroundThe Reporting of Nonresponse Analyses in Survey Research
Werner, S., Praxedes, M., & Kim, H. (2007) · Organizational Research Methods · doi:10.1177/1094428106292892 · Cited by 127 · cited 2×
“Five studies [19–23] addressed the reporting of response rates; three evaluated the reporting of non-response analyses in survey research [20,21,24]; and two assessed the degree to which authors make their survey instrument available to readers (Table 3) [25,26].”
BackgroundSimera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2009) · Maturitas · doi:10.1016/j.maturitas.2009.03.011 · Cited by 97 · cited 1×
“Reporting guidelines are evidence-based, validated tools that employ expert consensus to specify minimum criteria for authors to report their research such that readers can critically appraise and interpret study findings [5–7].”
Self-citationBadger, F. J., & Werrett, J. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03521.x · Cited by 86 · cited 1×
“Response rates Badger 2005 [19] 3 nursing journals 2002 270 49% did not report a response rate or provide sufficient sample disposition to calculate”
BackgroundSmith, B. A., Lee, H.-J., Lee, J. H., Choi, M., Jones, D. E., Bausell, R. B., & Broome, M. E. (2008) · Nursing Outlook · doi:10.1016/j.outlook.2007.09.002 · Cited by 74 · cited 2×
“Given the positive impact that reporting guidelines have had on the quality of reporting of health research [8–11], and the potential for a positive upstream effect on the design and conduct of research [32], there is a fundamental need for well-developed reporting guidelines.”
BackgroundNarahari, S. R. B., Ryan, T. J., Aggithaya, M. G., Bose, K. S., & Prasanna, K. S. (2008) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2007.0818 · Cited by 62 · cited 1×
“, and the potential for a positive upstream effect on the design and conduct of research”
BackgroundReporting on surveys: information for authors and peer reviewers.
Huston, P. (1996) · Europe PMC (PubMed Central) · Cited by 39
Invited Commentary: The Art of Making Questionnaires Better
Rosen, T., & Olsen, J. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj348 · Cited by 27 · cited 3×
“When corresponding authors were contacted, 46% failed to provide the questionnaire despite repeated contact Rosen 2006 [26] 4 epidemiological journals 2005 71 85% did not provide access to the complete questionnaire.”
BackgroundResultInaccessible Novel Questionnaires in Published Medical Research: Hidden Methods, Hidden Costs
Schilling, L. M., Kozak, K., Lundahl, K. R., & Dellavalle, R. P. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj349 · Cited by 24 · cited 4×
“These challenges will be particularly apparent as the articles age and study authors become more difficult to contact [25].”
BackgroundResultInfluentialReporting Survey Nonresponse in Academic Journals
Smith, T. W. (2002) · International Journal for Quality in Health Care · doi:10.1093/ijpor/14.4.469 · Cited by 11
Responses to survey research: transparency and representativeness are key
Coons, S. J. (2007) · Clinical Therapeutics · doi:10.1016/s0149-2918(07)80084-1 · Cited by 7 · cited 1×
“The wide variation in how response rates are reported in the literature is perhaps a historical reflection of the limited consensus or explicit journal policy for response rate reporting [22,28,29].”
Background
Research works printed but not linked: 1
- 1999, Editor's Preface. A word about manuscripts., CMAJ, 161, 5
Cited by
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06737-1 · Cited by 2,292
“Considering all this, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies [13,25-28,31-32].”
BackgroundMethodReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationBlumenthal-Barby, J. S., & Krieger, H. (2015) · Medical Decision Making · doi:10.1177/0272989x14547740 · Cited by 545
Supervised injection services: What has been demonstrated? A systematic literature review
Potier, C., Laprévote, V., Dubois-Arber, F., Cottencin, O., & Rolland, B. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.10.012 · Cited by 495
“ecause there is currently no consensual assessment method for either qualitative tudies or surveys (Bennett et al., 2011), we did not score these types of articles in ur review.”
MethodBall, H. L. (2019) · Journal of Human Lactation · doi:10.1177/0890334419848734 · Cited by 480
Metadata
- Authors
- Bennett, C., Khangura, S., Brehaut, J. C., Graham, I. D., Moher, D., Potter, B. K., & M. Grimshaw, J.
- Affiliations
- Ottawa Hospital Research Institute (CA)
- University of Ottawa (CA)
- Canadian Institutes of Health Research (CA)
- Corresponding author
- Bennett, Carol
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-08-02
- Volume
- 8
- Issue
- 8
- Pages
- e1001069
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3149080
- OpenAlex
- W2050025843
- Cited by
- 397
- References
- 29
- Citations by year
- 2026: 15 · 2025: 19 · 2024: 25 · 2023: 32 · 2022: 27 · 2021: 62 · 2020: 42 · 2019: 37 · 2018: 22 · 2017: 28 · 2016: 19 · 2015: 24 · 2014: 20 · 2013: 17 · 2012: 8
- FWCI
- 15.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Canadian Institutes of Health Research (MGC-42668)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- survey research, reporting guidelines, reporting quality, self-administered surveys, author guidelines, medical journals, response rate, questionnaire reliability and validity, missing data, nonresponse, sample representativeness, reporting checklist
- MeSH terms
- Data Collection, Health Surveys, Publishing, Surveys and Questionnaires, Research Design, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

