Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
Open accessThe DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Research needs to be reported transparently so readers can critically assess the strengths and weaknesses of the design, conduct, and analysis of studies. Reporting guidelines have been developed to inform reporting for a variety of study designs. The objective of this study was to identify whether there is a need to develop a reporting guideline for survey research. METHODS AND FINDINGS: We conducted a three-part project: (1) a systematic review of the literature (including "Instructions to Authors" from the top five journals of 33 medical specialties and top 15 general and internal medicine journals) to identify guidance for reporting survey research; (2) a systematic review of evidence on the quality of reporting of surveys; and (3) a review of reporting of key quality criteria for survey research in 117 recently published reports of self-administered surveys. Fewer than 7% of medical journals (n = 165) provided guidance to authors on survey research despite a majority having published survey-based studies in recent years. We identified four published checklists for conducting or reporting survey research, none of which were validated. We identified eight previous reviews of survey reporting quality, which focused on issues of non-response and accessibility of questionnaires. Our own review of 117 published survey studies revealed that many items were poorly reported: few studies provided the survey or core questions (35%), reported the validity or reliability of the instrument (19%), defined the response rate (25%), discussed the representativeness of the sample (11%), or identified how missing data were handled (11%). CONCLUSIONS: There is limited guidance and no consensus regarding the optimal reporting of survey research. The majority of key reporting criteria are poorly reported in peer-reviewed survey research articles. Our findings highlight the need for clear and consistent reporting guidelines specific to survey research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Although many surveys have been published in high-impact journals, comprehensive reporting guidelines for survey research are limited 13, 14 and substantial variabilities and inconsistencies can be identified in the reporting of survey studies.”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Because of concerns regarding survey qualities and lack of well-developed guidelines, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies. 13, 25 -28, 31, 32”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Although the entire process was conducted electronically, we gathered data and feedback from the participants via email instead of conducting Skype or face-to-face discussions as suggested by the EQUATOR network. 13”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480
Mail and Internet Surveys: The Tailored Design Method
CHISNALL, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,435
Good practice in the conduct and reporting of survey research
KELLEY, K. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg031 · Cited by 2,157 · cited 2×
“Reporting Item Kelley [13] Burns [14] Draugalis [15] AAPOR [18]”
BackgroundResponse rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110
Guidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 3×
“The needs assessment should also include a search for evidence on the quality of reporting of published research in the domain of interest [7].”
BackgroundInfluentialSelf-citationA guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354 · cited 3×
“Reporting Item Kelley [13] Burns [14] Draugalis [15] AAPOR [18]”
BackgroundMethodResponse Rates and Responsiveness for Surveys, Standards, and the Journal
Fincham, J. E. (2008) · American Journal of Pharmaceutical Education · doi:10.5688/aj720243 · Cited by 1,294 · cited 2×
“However, despite lack of explicit policies regarding acceptable standards for response rates or the reporting of response rates, journal editors are known to have implicit policies for acceptable response rates when considering the publication of surveys [17,22,29,30].”
BackgroundPlint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Self-citationMcColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., & Bond, J. (2001) · Health Technology Assessment · doi:10.3310/hta5310 · Cited by 788 · cited 2×
“However, there is substantial literature to show that the methods used in conducting survey research can significantly affect the reliability, validity, and generalisability of study results [3,4].”
Background
Research works printed but not linked: 1
- 1999, Editor's Preface. A word about manuscripts., CMAJ, 161, 5
Cited by
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06737-1 · Cited by 2,292
“Considering all this, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies [13,25-28,31-32].”
BackgroundMethodReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationBlumenthal-Barby, J. S., & Krieger, H. (2015) · Medical Decision Making · doi:10.1177/0272989x14547740 · Cited by 545
Supervised injection services: What has been demonstrated? A systematic literature review
Potier, C., Laprévote, V., Dubois-Arber, F., Cottencin, O., & Rolland, B. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.10.012 · Cited by 495
“ecause there is currently no consensual assessment method for either qualitative tudies or surveys (Bennett et al., 2011), we did not score these types of articles in ur review.”
MethodBall, H. L. (2019) · Journal of Human Lactation · doi:10.1177/0890334419848734 · Cited by 480
Meyer, V. M., Benjamens, S., Moumni, M. E., Lange, J. F. M., & Pol, R. A. (2022) · Annals of Surgery · doi:10.1097/sla.0000000000004078 · Cited by 398
“Does one include all the returned questionnaires or only the completed ones? A 2011 review showed that 154 of 165 journals do not provide guidance on survey reporting, whereas 82% have published survey research.(49) These results show that, although separate guidelines exist, there is little control on survey reportin…”
BackgroundDoes age matter? The impact of rodent age on study outcomes
Jackson, S. J., Andrews, N., Ball, D., Bellantuono, I., Gray, J., Hachoumi, L., Holmes, A., Latcham, J., Petrie, A., Potter, P., et al. (2017) · Laboratory Animals · doi:10.1177/0023677216653984 · Cited by 369
“In order to explore the age at which rodents are currently being used in research, an online survey was formulated by the expert working group with reference to published guidance on survey design.(38) The survey requested data on the type of rodent model used by the researcher, and the age chosen for the model (see s…”
MethodA systematic review of the validity and reliability of patient‐reported experience measures
Bull, C., Byrnes, J., Hettiarachchi, R., & Downes, M. (2019) · Health Services Research · doi:10.1111/1475-6773.13187 · Cited by 331
The evolution of health literacy assessment tools: a systematic review
Altin, S. V., Finke, I., Kautz-Freimuth, S., & Stock, S. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1207 · Cited by 314
Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals
Hirst, A., & Altman, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035621 · Cited by 200
“We consulted a recent overview of guidance on reporting survey research [12] and ensured we reported applicable items in this report.”
MethodHealth Care Provider Surveys in the United States, 2000–2010: A Review
McLeod, C. C., Klabunde, C. N., Willis, G. B., & Stark, D. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278712474001 · Cited by 190
Heslehurst, N., Newham, J., Maniatopoulos, G., Fleetwood, C., Robalino, S., & Rankin, J. (2014) · Obesity Reviews · doi:10.1111/obr.12160 · Cited by 169
“Standardized quality assessment templates were developed using published quality criteria for qualitative and survey research (32,33).”
MethodBlackwood, D. H., Walker, D., Mythen, M. G., Taylor, R. M., & Vindrola‐Padros, C. (2019) · Journal of Clinical Nursing · doi:10.1111/jocn.15049 · Cited by 165
“Bennett et al. (2011) reviewed the availability of guidance for reporting survey research from major journals as well as reviewing published studies on the quality of survey reporting.”
BackgroundMethodInfluentialMeyer Sauteur, P. M., Beeton, M. L., Uldum, S. A., Bossuyt, N., Vermeulen, M., Loens, K., Pereyre, S., Bébéar, C., Keše, D., Day, J., et al. (2022) · Eurosurveillance · doi:10.2807/1560-7917.es.2022.27.19.2100746 · Cited by 162
“Survey development A structured survey was developed by a group of members from the European Society of Clinical Microbiology and Infectious Diseases (ESCMID) Study Group for Mycoplasma and Chlamydia Infections (ESGMAC), according to guidelines for survey research [21,22].”
MethodSelig, H. F., Lumenta, D. B., Giretzlehner, M., Jeschke, M. G., Upton, D., & Kamolz, L. (2012) · Burns · doi:10.1016/j.burns.2012.04.007 · Cited by 156
Long-term unmet needs after stroke: systematic review of evidence from survey studies
Chen, T., Zhang, B., Deng, Y., Fan, J., Zhang, L., & Song, F. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028137 · Cited by 183
Newton, P. M., & Essex, K. (2024) · Journal of Academic Ethics · doi:10.1007/s10805-023-09485-5 · Cited by 144
Vaccine Education of Medical Students: A Nationwide Cross-sectional Survey
Kernéis, S., Jacquet, C., Bannay, A., May, T., Launay, O., Verger, P., Pulcini, C., Abgueguen, P., Ansart, S., Bani‐Sadr, F., et al. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.01.014 · Cited by 144
Kim, Y. (2018) · Journal of Communication Management · doi:10.1108/jcom-03-2018-0025 · Cited by 179
“To measure employee communication behaviors (ECBs) and internal communication factors in a valid manner, a realistic setting was needed that was based on uncontrolled environments from different organizations (Bennett et al., 2011).”
BackgroundAssessment Tools for Health Literacy among the General Population: A Systematic Review
Liu, H., Zeng, H., Shen, Y., Zhang, F., Sharma, M., Lai, W., Zhao, Y., Tao, G., Yuan, J., & Zhao, Y. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15081711 · Cited by 163
“The quality assessment of the research was examined with the use of the specifications of the reporting guidelines for survey research (SURGE), which was captured in eight domains [21].”
BackgroundMethodLeadership in evidence-based practice: a systematic review
Reichenpfader, U., Carlfjord, S., & Nilsen, P. (2015) · Leadership in Health Services · doi:10.1108/lhs-08-2014-0061 · Cited by 122
Using survey methods in telehealth research: A practical guide
Langbecker, D., Caffery, L. J., Gillespie, N. A., & Smith, A. C. (2017) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17721814 · Cited by 136
Consumer Attitudes Towards Deprescribing: A Systematic Review and Meta-Analysis
Weir, K. R., Ailabouni, N. J., Schneider, C. R., Hilmer, S. N., & Reeve, E. (2021) · The Journals of Gerontology Series A · doi:10.1093/gerona/glab222 · Cited by 142
“Two authors independently assessed the quality of reporting using the SUrvey Reporting GuidelinE (SURGE) (20) (modified slightly for the purposes of this review).”
MethodHow to assess a survey report: a guide for readers and peer reviewers
Burns, K. E. A., & Kho, M. E. (2015) · Canadian Medical Association Journal · doi:10.1503/cmaj.140545 · Cited by 146
Newton, P. M., & Salvi, A. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.602451 · Cited by 193
“These metrics were derived from multiple sources (Kelley et al., 2003; Bennett et al., 2011; Boutron et al., 2019).”
BackgroundMethodGrant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., & Montgomery, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065442 · Cited by 111
“Following recommended techniques for guideline development and dissemination,[3] a structured approach to reporting guideline development should begin with a needs assessment that (i) reviews whether an adequate guideline already exists for a given research method and (ii) obtains evidence of the reporting quality of…”
BackgroundMethodInfluentialSurvey Guidelines in Software Engineering: An Annotated Review
Molléri, J. S., Petersen, K., & Mendes, E. (2016) · Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2961111.2962619 · Cited by 103
“Examples of those are the guidelines for cross-sectional and longitudinal studies on marketing research [25], and the guidelines for reporting surveys of medical research [1].”
BackgroundScarcella, A., Page, R., & Furtado, V. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166947 · Cited by 149
Global priorities of environmental issues to combat food insecurity and biodiversity loss
Scherer, L., Svenning, J.-C., Huang, J., Seymour, C. L., Sandel, B., Mueller, N., Kummu, M., Bekunda, M., Bruelheide, H., Hochman, Z., et al. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.139096 · Cited by 90
Euthanasia and assisted suicide in psychiatric patients: A systematic review of the literature
Calati, R., Olié, E., Dassa, D., Gramaglia, C., Guillaume, S., Madeddu, F., & Courtet, P. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.12.006 · Cited by 88
“Case Series Studies (National Institutes of Health, 2014), the checklist for reporting survey research (Bennett et al., 2010), the COnsolidated criteria for REporting Qualitative research (COREQ) checklist (Tong et al.”
MethodTurk, T., Elhady, M. T., Rashed, S., Abdelkhalek, M., Nasef, S. A., Khallaf, A. M., Mohammed, A. T., Attia, A. W., Adhikari, P., Amin, M. A., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194239 · Cited by 81
Lewis, E. F., Hardy, M., & Snaith, B. A. (2013) · Radiography · doi:10.1016/j.radi.2013.02.003 · Cited by 89
Agius, A., Xuereb, R. B., Carrick‐Sen, D., Sultana, R., & Rankin, J. M. (2016) · Midwifery · doi:10.1016/j.midw.2016.02.013 · Cited by 93
“was appropriate to the study design (Bennett et al., 2011).”
MethodWhistleblowing: An integrative literature review of data-based studies involving nurses
Jackson, D. W., Hickman, L., Hutchinson, M., Andrew, S., Smith, J. A., Potgieter, I., Cleary, M. L., & Peters, K. (2014) · Contemporary Nurse · doi:10.1080/10376178.2014.11081946 · Cited by 92
“There are few appraisal tools for cross- sectional survey studies or validated guidelines for publication of this type of study (Bennett et al., 2011). It was felt, however, that it was important to make some appraisal of the quantitative studies to enable some comparisons across the research (Table 3). Bowling’s (200…”
MethodInfluentialIndicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis
Suter, E., Oelke, N. D., Lima, M. A. D. D. S., Stiphout, M., Janke, R., Witt, R. R., Vliet-Brown, C. V., Schill, K., Rostami, M., Hepp, S. L., et al. (2017) · International Journal of Integrated Care · doi:10.5334/ijic.3931 · Cited by 88
“Poor reporting may contribute to the quality gap, prompting some researchers to demand clear guidelines for reporting of survey research [155].”
BackgroundAn Overview of Survey Research
Goodfellow, L. T. (2023) · Respiratory Care · doi:10.4187/respcare.11041 · Cited by 69
Schwarz (1999) · doi:10.1097/acm.0000000000002002 · Cited by 67
Koo, M., & Lin, S. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e16780 · Cited by 91
“Instead, our checklist should be seen as a guide to help researchers write more complete and transparent bibliometric studies [43].”
BackgroundRubenstein, E., & Furnier, S. (2021) · Autism in Adulthood · doi:10.1089/aut.2020.0031 · Cited by 65
“…challenges are similar to issues in survey research in general, including relying on participant self-report and poor description of study methods 19 ; however, the paucity of research in autistic adults leaves us without the baseline knowledge needed to evaluate internal and external validity…”
Association of Race With Cancer-Related Financial Toxicity
Panzone, J. M., Welch, C., Morgans, A. K., Bhanvadia, S. K., Mossanen, M., Shenhav‐Goldberg, R., Chandrasekar, T., Pinkhasov, R. M., Shapiro, O., Jacob, J. M., et al. (2021) · JCO Oncology Practice · doi:10.1200/op.21.00440 · Cited by 67
“This cross-sectional survey was conducted in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology statement13 as well as the Survey Reporting Guideline.14 Data for this study were obtained from the Health Information National Trends Survey (HINTS) database from the years 2012, 2014,…”
MethodBatchelor, F., Hwang, K., Haralambous, B., Fearn, M., Mackell, P., Nolte, L., & Detering, K. M. (2019) · Australian Journal on Ageing · doi:10.1111/ajag.12639 · Cited by 69
Rolland, B., Paillé, F., Fleury, B., Cottencin, O., Benyamina, A., & Aubin, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098062 · Cited by 62
“The assessment of the overall quality of this survey is also restrained by the limited literature and the lack of consensus regarding the optimal drafting and reporting of survey research [28].”
BackgroundMello, M. J., Merchant, R. C., & Clark, M. A. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12103 · Cited by 61
Eccles, M., Foy, R., Sales, A. E., Wensing, M., & Mittman, B. S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-71 · Cited by 68
Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017.
Malički, M., Jerončić, A., Aalbersberg, I. J., Bouter, L., & ter Riet, G. (2021) · Nature Communications · doi:10.1038/s41467-021-26027-y · Cited by 53
York, T., Jenney, H., & Jones, G. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100233 · Cited by 57
“These findings should be interpreted cautiously due to the limited number of responses from which they are drawn.”
BackgroundMohebbi, B., Sabouri, M., & Tol, A. (2021) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_173_21 · Cited by 61
“It includes reporting items in eight subdomains such article background, methods used, sample selection criteria, research instrument, presentation of findings, interpretation, and discussions of results and ethical considerations [Table 1 and Figure 2].[25] Results The PRISMA flow chart in Figure 1 reviews the search…”
MethodSURGE (The SUrvey Reporting GuidelinE)
Grimshaw, J. (2014) · Guidelines for Reporting Health Research: A User's Manual · doi:10.1002/9781118715598.ch20 · Cited by 57
Self-citationCastellini, G., Corbetta, D., Cecchetto, S., & Gianola, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037133 · Cited by 66
The Italian Osteopathic Practitioners Estimates and RAtes (OPERA) study: A cross sectional survey
Cerritelli, F., van Dun, P. L. S., Esteves, J. E., Consorti, G., Sciomachen, P., Lacorte, E., Vanacore, N., & for the OPERA-IT Group (2019) · PLoS ONE · doi:10.1371/journal.pone.0211353 · Cited by 54
Suga, U. S. G., Terada, R. S. S., Ubaldini, A. L. M., Fujimaki, M., Pascotto, R. C., Batilana, A. P., Pietrobon, R. S., Vissoci, J. R. N., & Rodrigues, C. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0107831 · Cited by 49
“[11] for surveys, and the Joanna Briggs Institute Qualitative”
MethodNavarro, D., Juan, R. S., Manuel, O., Giménez, E., Fernández‐Ruiz, M., Hirsch, H. H., Grossi, P., & Aguado, J. M. (2017) · Transplant Infectious Disease · doi:10.1111/tid.12773 · Cited by 51
Stretton, S. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004777 · Cited by 50
van Zuuren, E. J., Logullo, P., Price, A. I., Fedorowicz, Z., Hughes, E. L., & Gattrell, W. T. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-065154 · Cited by 57
Fadiga, A., Ferreira, L. M. D. F., & Bigotte, J. F. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.142209 · Cited by 82
“Since surveys are especially critical when working on beliefs, attitudes, or opinions, more studies could be conducted using this investigation strategy (Bennett et al., 2011).”
BackgroundMorton, R. L., Lioufas, N. M., Dansie, K. B., Palmer, S. C., Jose, M., Raj, R., Salmon, A. H. J., Sypek, M. P., Tong, A., Ludlow, M. J., et al. (2019) · Nephrology · doi:10.1111/nep.13577 · Cited by 53
Questionnaire surveys - sources of error and implications for design, reporting and appraisal
Shelley, A., & Horner, K. (2021) · BDJ · doi:10.1038/s41415-021-2654-3 · Cited by 55
Varela‐Centelles, P. I., Diz‐Iglesias, P., Estany‐Gestal, A., Romero, J. M., González, R. B., & Seoane, J. (2015) · Journal of Periodontology · doi:10.1902/jop.2015.150458 · Cited by 61
Violence Risk Assessment Tools: A Systematic Review of Surveys
Hurducas, C., Singh, J. P., de Ruiter, C., & Petrila, J. P. (2014) · International Journal of Forensic Mental Health · doi:10.1080/14999013.2014.942923 · Cited by 61
Eisele, T. P., Rhoda, D. A., Cutts, F. T., Keating, J. A., Ren, R., Barros, A. J. D., & Arnold, F. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001386 · Cited by 49
“Importantly, we commend recent calls for establishing reporting guidelines for survey research [32].”
BackgroundCanning, A., Fairhurst, R., Chauhan, M., & Weir, K. A. (2019) · Dysphagia · doi:10.1007/s00455-019-10047-4 · Cited by 47
Zobell, J. T., Epps, K. L., Young, D. C., Montague, M., Olson, J. A., Ampofo, K., Chin, M. J., Marshall, B. C., & Dasenbrook, E. C. (2015) · Pediatric Pulmonology · doi:10.1002/ppul.23132 · Cited by 46
A survey on quality attributes in service-based systems
Ameller, D., Galster, M., Avgeriou, P., & Franch, X. (2015) · Software Quality Journal · doi:10.1007/s11219-015-9268-4 · Cited by 56
“, we compiled a checklist to evaluate our survey [11, 32].”
MethodGobat, N., Gal, M., Francis, N. A., Hood, K., Watkins, A. K., Turner, J., Moore, R., Webb, S. A. R., Butler, C., & Nichol, A. (2015) · Trials · doi:10.1186/s13063-015-1110-6 · Cited by 53
“While most of our sample consisted of qualitative studies and surveys, there is variability in terms of the way these studies were designed, conducted, and reported [26].”
MethodResultSystematic review and metasummary of attitudes toward research in emergency medical conditions
Limkakeng, A. T., de Oliveira, L. L. H., Moreira, T., Phadtare, A., Garcia Rodrigues, C., Hocker, M. B., McKinney, R., Voils, C. I., & Pietrobon, R. (2014) · Journal of Medical Ethics · doi:10.1136/medethics-2012-101147 · Cited by 42
Roberts, D. J., Zygun, D. A., Faris, P., Ball, C. G., Kirkpatrick, A. W., & Stelfox, H. T. (2016) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2016.06.002 · Cited by 42
Allen, E., Elliott, D., & Jackson, D. W. (2017) · Journal of Clinical Nursing · doi:10.1111/jocn.13839 · Cited by 53
“Similar to qualitative studies, survey-based inquiry has inherent limitations in the context of achieving rigour, for example participant bias and interpretation of each item (Bennett et al., 2011).”
BackgroundMethodUndertreatment of Tobacco Use Relative to Other Chronic Conditions
Bernstein, S. L., Yu, S., Post, L. A., Dziura, J. D., & Rigotti, N. A. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301112 · Cited by 39
The use of skin substitutes and burn care—a survey
Wurzer, P., Keil, H., Branski, L. K., Parvizi, D., Clayton, R. P., Finnerty, C. C., Herndon, D. N., & Kamolz, L. (2015) · Journal of Surgical Research · doi:10.1016/j.jss.2015.10.048 · Cited by 39
Preparedness for eHealth: Health Sciences Students’ Knowledge, Skills, and Confidence
Lam, M. K., Hines, M., Lowe, R., Nagarajan, S. V., Keep, M., Penman, M., & Power, E. (2016) · Journal of Information Technology Education Research · doi:10.28945/3523 · Cited by 54
“Both the design and reporting of the study were informed by available survey reporting guidelines (Bennett et al., 2011).”
MethodCzigány, Z., Scherer, M. N., Pratschke, J., Guba, M. O., Nadalin, S., Mehrabi, A., Berlakovich, G. A., Rogiers, X., Pirenne, J., Lerut, J. P., et al. (2018) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-018-3915-6 · Cited by 39
Parry, M. W., Markowitz, J. S., Nordberg, C. M., Patel, A. A., Bronson, W. H., & DelSole, E. M. (2023) · Indian Journal of Orthopaedics · doi:10.1007/s43465-023-00845-2 · Cited by 42
“Data derived from patient surveys may be confounded by complex influences and are difficult to validate; however, several methods can be used to mitigate these uncertainties such as utilizing multiple Likert scales and easily comprehensible language in the survey [7, 22].”
MethodHow to interpret surveys in medical research: A practical approach
Colbert, C. Y., Diaz‐Guzman, E., Myers, J., & Arroliga, A. C. (2013) · Cleveland Clinic Journal of Medicine · doi:10.3949/ccjm.80a.12122 · Cited by 41
Moth, A. E., Hølmkjær, P., Holm, A., Rozing, M. P., & Overbeck, G. (2021) · Drugs & Aging · doi:10.1007/s40266-021-00875-1 · Cited by 44
Paudyal, V., Cunningham, S., Smith, K. G., MacLure, K., Ryan, C. A., & Cordina, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205087 · Cited by 37
Sowerbutts, A. M., Jones, D. J., Lal, S., & Burden, S. T. (2021) · Clinical Nutrition · doi:10.1016/j.clnu.2021.02.009 · Cited by 39
The Importance of Survey Research Standards
Fincham, J. E., & Draugalis, J. R. (2013) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7714 · Cited by 44
Brown, B. T., Bonello, R., Fernandez-Caamano, R., Eaton, S., Graham, P. L., & Green, H. (2014) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2014.01.001 · Cited by 36
Are risk minimization measures for approved drugs in Europe effective? A systematic review
Artime, E., Qizilbash, N., Garrido‐Estepa, M., Vora, P., Soriano‐Gabarró, M., Asiimwe, A., & Pocock, S. (2019) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2019.1612875 · Cited by 36
Bouchard, J., Lavergne, V., Roberts, D. M., Cormier, M. J., Morissette, G., & Ghannoum, M. (2016) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw456 · Cited by 37
“Third, due to the objective and quantitative nature of the data surveyed, reliability assessment was not performed [25, 30].”
BackgroundMethodAn Alternative Consent Process for Minimal Risk Research in the ICU*
Terry, M., Freedberg, D. E., & Morris, M. C. (2017) · Critical Care Medicine · doi:10.1097/ccm.0000000000002539 · Cited by 35
Gass, J. S., Mitchell, S. D., & Hanna, M. (2019) · BMC Cancer · doi:10.1186/s12885-019-5553-0 · Cited by 37
Barnett, P., Oshinowo, I. D., Cooper, C., Taylor, C. J., Smith, S. M., & Pilling, S. (2022) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-022-02378-9 · Cited by 46
Dimairo, M., Julious, S. A., Todd, S., Nicholl, J. P., & Boote, J. D. (2015) · Trials · doi:10.1186/s13063-015-1119-x · Cited by 31
“The research utilised a recent review of existing guidance on the reporting of survey research and attempted to use relevant items to enhance its reporting [20].”
Use of Health Apps and Wearable Devices: Survey Among Italian Associations for Patient Advocacy
Mosconi, P., Radrezza, S., Lettieri, E., & Santoro, E. (2018) · JMIR mhealth and uhealth · doi:10.2196/10242 · Cited by 36
“Results were presented according to CHERRIES” [23] and a similar guideline formulated by Bennett et al [24].”
MethodCappa, C., Petrowski, N., Castro, E. F., Geisen, E., LeBaron, P. A., Allen‐Leigh, B., Place, J. M., & Scanlon, P. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182212181 · Cited by 31
“However, research literature documenting the development of new survey instruments remains limited [2], and reports about the pre-testing of survey tools focus predominantly on psychometric validity [3].”
BackgroundCMI guidance for authors of surveys
Pulcini, C., & Leibovici, L. (2016) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2016.08.015 · Cited by 31
Ntovas, P., Loubrinis, N., Maniatakos, P., & Rahiotis, C. (2018) · Journal of Conservative Dentistry · doi:10.4103/jcd.jcd_67_17 · Cited by 30
“were followed for reporting of this survey.[24] The sample of this interactive, cross-sectional, population-based study was designed to be representative of dentists who are employed in Greece.”
BackgroundColbert, C. Y., French, J. C., Arroliga, A. C., & Bierer, S. B. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1673596 · Cited by 35
“education which performed in-depth reviews of survey reporting practices (four to five journals) [5,26,50] and an analysis of survey research in health professions education (three journals).”
BackgroundResultInfluentialStudent Education About Pre-exposure Prophylaxis (PrEP) Varies Between Regions of the United States
Bunting, S. R., Garber, S. S., Goldstein, R. H., Ritchie, T. D., Batteson, T. J., & Keyes, T. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-05736-y · Cited by 32
Emergency management of traumatic dental injuries in 42 countries
Alnaggar, D., & Andersson, L. (2014) · Dental Traumatology · doi:10.1111/edt.12155 · Cited by 38
Goldberg, H., Ajaj, R., Herrera-Caceres, J. O., Berlín, A., Chandrasekar, T., Klaassen, Z. W. A., Wallis, C. J. D., Ahmad, A. E., Leao, R. R. N., Petrella, A. R., et al. (2020) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2020.02.015 · Cited by 29
Designing effective image-based surveys for urban visual perception
Gu, Y., Quintana, M., Liang, X., Ito, K., Yap, W., & Biljecki, F. (2025) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2025.105368 · Cited by 41
Physical Activity Counseling in Primary Care in Germany—An Integrative Review
Füzéki, E., Weber, T., Groneberg, D. A., & Banzer, W. B. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155625 · Cited by 28
“There are no widely accepted reporting schemes for survey studies, which leads to inconsistent reporting [54].”
BackgroundQuality of Survey Reporting in Nephrology Journals: A Methodologic Review
Li, A. H.-T., Thomas, S. M., Farag, A., Duffett, M., Garg, A. X., & Naylor, K. L. (2014) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02130214 · Cited by 27
“Low response rates may threaten the validity of the findings and conclusions of survey studies; some journals do not accept articles with response rates ,60% (1).”
BackgroundMethodInfluentialIAH-ACS Study Group, Strang, S. G., Lieshout, E. M. M. V., Verhoeven, R. A., Waes, O. J. F. V., & Verhofstad, M. H. J. (2016) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-016-0637-x · Cited by 27
“[22].”
Perspectives on the application of CONSORT guidelines to randomised controlled trials in nutrition
Rigutto‐Farebrother, J., Ahles, S., Cade, J. E., Murphy, K. J., Plat, J., Schwingshackl, L., Roche, H. M., Shyam, S., Lachat, C. K., Minihane, A. M., et al. (2023) · European Journal of Nutrition · doi:10.1007/s00394-023-03137-5 · Cited by 37
Quality of care in rural youth with type 1 diabetes: a cross-sectional pilot assessment
Stumetz, K., Yi‐Frazier, J. P., Mitrovich, C., & Early, K. B. (2016) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2016-000300 · Cited by 27
Quality of cross-infection control in dental laboratories. A critical systematic review
Vázquez‐Rodríguez, I., Estany‐Gestal, A., Romero, J. M., Mora, M. J., Varela‐Centelles, P. I., & Mora, U. S. (2018) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzy058 · Cited by 26
Conclusions from surveys may not consider important biases: a systematic survey of surveys
Santesso, N. A., Barbara, A. M., Kamran, R., Akkinepally, S., Cairney, J., Akl, E. A., & Schünemann, H. J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.019 · Cited by 28
Metadata
- Authors
- Bennett, C., Khangura, S., Brehaut, J. C., Graham, I. D., Moher, D., Potter, B. K., & M. Grimshaw, J.
- Affiliations
- Ottawa Hospital Research Institute (CA)
- University of Ottawa (CA)
- Canadian Institutes of Health Research (CA)
- Corresponding author
- Bennett, Carol
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-08-02
- Volume
- 8
- Issue
- 8
- Pages
- e1001069
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3149080
- OpenAlex
- W2050025843
- Cited by
- 397
- References
- 29
- Citations by year
- 2026: 15 · 2025: 19 · 2024: 25 · 2023: 32 · 2022: 27 · 2021: 62 · 2020: 42 · 2019: 37 · 2018: 22 · 2017: 28 · 2016: 19 · 2015: 24 · 2014: 20 · 2013: 17 · 2012: 8
- FWCI
- 15.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Canadian Institutes of Health Research (MGC-42668)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- survey research, reporting guidelines, reporting quality, self-administered surveys, author guidelines, medical journals, response rate, questionnaire reliability and validity, missing data, nonresponse, sample representativeness, reporting checklist
- MeSH terms
- Data Collection, Health Surveys, Publishing, Surveys and Questionnaires, Research Design, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

