The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Quality of reporting of surveys in critical care journals: A methodologic review*
Abstract
OBJECTIVE: Adequate reporting is needed to judge methodologic quality and assess the risk of bias of surveys. The objective of this study is to describe the methodology and quality of reporting of surveys published in five critical care journals. DATA SOURCES: All issues (1996-2009) of the American Journal of Respiratory and Critical Care Medicine, Critical Care, Critical Care Medicine, Intensive Care Medicine, and Pediatric Critical Care Medicine. STUDY SELECTION: Two reviewers hand-searched all issues in duplicate. We included publications of self-administered questionnaires of health professionals and excluded surveys that were part of a multi-method study or measured the effect of an intervention. DATA EXTRACTION: Data were abstracted in duplicate. DATA SYNTHESIS: We included 151 surveys. The frequency of survey publication increased at an average rate of 0.38 surveys per 1000 citations per year from 1996-2009 (p for trend = 0.001). The median number of respondents and reported response rates were 217 (interquartile range 90 to 402) and 63.3% (interquartile range 45.0% to 81.0%), respectively. Surveys originated predominantly from North America (United States [40.4%] and Canada [18.5%]). Surveys most frequently examined stated practice (78.8%), attitudes or opinions (60.3%), and less frequently knowledge (9.9%). The frequency of reporting on the survey design and methods were: 1) instrument development: domains (59.1%), item generation (33.1%), item reduction (12.6%); 2) instrument testing: pretesting or pilot testing (36.2%) and assessments of clarity (25.2%) or clinical sensibility (15.7%); and 3) clinimetric properties: qualitative or quantitative description of at least one of face, content, construct validity, intra- or inter-rater reliability, or consistency (28.5%). The reporting of five key elements of survey design and conduct did not significantly change over time. CONCLUSIONS: Surveys, primarily conducted in North America and focused on self-reported practice, are increasingly published in highly cited critical care journals. More uniform and comprehensive reporting will facilitate assessment of methodologic quality.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mark et al. also found several deficiencies in survey methodologies and reporting practices and suggested a need for establishing minimum reporting standards for survey studies. 27”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [27]
In the citing paper
“Because of concerns regarding survey qualities and lack of well-developed guidelines, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies. 13, 25 -28, 31, 32”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [27]
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Self-citationGood practice in the conduct and reporting of survey research
KELLEY, K. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg031 · Cited by 2,157
A guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354
Self-citationRecommendations for Reporting Cost-effectiveness Analyses
Siegel, J. E. (1996) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1996.03540160061034 · Cited by 1,147
Siegel, J. E. (1996) · JAMA · doi:10.1001/jama.276.16.1339 · Cited by 1,037
McColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., & Bond, J. (2001) · Health Technology Assessment · doi:10.3310/hta5310 · Cited by 788
Research works printed but not linked: 3
- Henry, 1986, Fam Pract Res J, 5, 145
- Rubenfeld, 2004, Respir Care, 49, 1181
- Huston, 1996, CMAJ, 154, 1695
Cited by
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06737-1 · Cited by 2,292
Electronic surveys: how to maximise success
McPeake, J., Bateson, M., & O’Neill, A. (2014) · Nurse Researcher · doi:10.7748/nr2014.01.21.3.24.e1205 · Cited by 178
How to assess a survey report: a guide for readers and peer reviewers
Burns, K. E. A., & Kho, M. E. (2015) · Canadian Medical Association Journal · doi:10.1503/cmaj.140545 · Cited by 132
Self-citationDeye, N., Vincent, F., Michel, P., Ehrmann, S., Silva, D. D., Piagnerelli, M., Kimmoun, A., Hamzaoui, O., Lachérade, J.-C., Jonghe, B. D., et al. (2016) · Annals of Intensive Care · doi:10.1186/s13613-015-0104-6 · Cited by 106
Lin, X., Wu, R., Lim, Y.-T., Jieping, H., & Chen, S. (2019) · Sustainability · doi:10.3390/su11195532 · Cited by 110
Ista, E., de Hoog, M., Tibboel, D., Duivenvoorden, H. J., & van Dijk, M. (2013) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e31829f5be1 · Cited by 98
How to interpret surveys in medical research: A practical approach
Colbert, C. Y., Diaz‐Guzman, E., Myers, J., & Arroliga, A. C. (2013) · Cleveland Clinic Journal of Medicine · doi:10.3949/ccjm.80a.12122 · Cited by 40
Using Electronic Surveys in Nursing Research
Cope, D. G. (2014) · Oncology nursing forum · doi:10.1188/14.onf.681-682 · Cited by 37
Bouchard, J., Lavergne, V., Roberts, D. M., Cormier, M. J., Morissette, G., & Ghannoum, M. (2016) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw456 · Cited by 37
Colbert, C. Y., French, J. C., Arroliga, A. C., & Bierer, S. B. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1673596 · Cited by 35
Haemodynamic monitoring and management in COVID-19 intensive care patients: an International survey
Michard, F., Malbrain, M. L. N. G., Martin, G. S., Fumeaux, T., Lobo, S. M., Gonzalez, F. A., Pinho-Oliveira, V. M., & Constantin, J. (2020) · Anaesthesia Critical Care & Pain Medicine · doi:10.1016/j.accpm.2020.08.001 · Cited by 33
Prevalence, Characteristics, and Opinions of Pediatric Rapid Response Teams in the United States
Chen, J. G., Kemper, A. R., Odetola, F. O., Cheifetz, I. M., & Turner, D. A. (2012) · Hospital Pediatrics · doi:10.1542/hpeds.2011-0030 · Cited by 32
Keys to Successful Survey Research in Health Professions Education
Hochberg, C. H., & Eakin, M. N. (2024) · ATS Scholar · doi:10.34197/ats-scholar.2023-0112re · Cited by 30
Perioperative Ventilatory Management in Cardiac Surgery: A French Nationwide Survey
Fischer, M.-O., Courteille, B., Guinot, P., Dupont, H., Gérard, J.-L., Hanouz, J., & Lorne, E. (2016) · Medicine · doi:10.1097/md.0000000000002655 · Cited by 29
Conclusions from surveys may not consider important biases: a systematic survey of surveys
Santesso, N. A., Barbara, A. M., Kamran, R., Akkinepally, S., Cairney, J., Akl, E. A., & Schünemann, H. J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.019 · Cited by 28
Quality of Survey Reporting in Nephrology Journals: A Methodologic Review
Li, A. H.-T., Thomas, S. M., Farag, A., Duffett, M., Garg, A. X., & Naylor, K. L. (2014) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02130214 · Cited by 27
Self-citationTai, X., Smith, A. M., McGeer, A., Dubé, È., Holness, D. L., Katz, K. C., Hall, L. M., McNeil, S., Powis, J. E., & Coleman, B. L. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0524-8 · Cited by 24
Fairclough, R., & Thelwall, M. A. (2021) · Learned Publishing · doi:10.1002/leap.1417 · Cited by 27
A methodological review of the quality of reporting of surveys in transfusion medicine
Pagano, M. B., Dunbar, N. M., Tinmouth, A., Apelseth, T. O., Lozano, M., Cohn, C. S., Stanworth, S. J., & Collaborative, O. B. O. T. B. E. F. S. T. (. (2018) · Transfusion · doi:10.1111/trf.14937 · Cited by 16
How do we design and report a high‐quality survey?
Pagano, M. B., Dunbar, N. M., & Stanworth, S. J. (2020) · Transfusion · doi:10.1111/trf.15861 · Cited by 16
Survey Research Reporting in Radiology Publications: A Review of 2017 to 2018
Shankar, P. R., & Maturen, K. E. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.07.012 · Cited by 15
Caminiti, C., Diodati, F., Puntoni, M., Balan, D. G., & Maglietta, G. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22020177 · Cited by 15
Quality indicators in burn care: An international burn care professionals survey to define them
Dash, S., Pompermaier, L., Lavrentieva, A., Rogers, A. D., & Depetris, N. (2022) · Burns · doi:10.1016/j.burns.2022.11.006 · Cited by 13
Use of probiotics to prevent ventilator-associated pneumonia: A survey of pharmacists' attitudes
Wheeler, K. E., Cook, D. J., Mehta, S., Calce, A., Guenette, M. D., Perreault, M. M., Thiboutot, Z., Duffett, M., & Burry, L. D. (2015) · Journal of Critical Care · doi:10.1016/j.jcrc.2015.10.016 · Cited by 13
Self-citationDuffett, M., Choong, K. L. M., Vanniyasingam, T., Thabane, L., & Cook, D. J. (2014) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000000280 · Cited by 11
Self-citationGuidolin, K., Wexner, S. D., Jung, F., Khan, S., Deng, S. X., Kirubarajan, A., Quereshy, F. A., & Chadi, S. A. (2021) · Surgery · doi:10.1016/j.surg.2021.01.006 · Cited by 10
Assessing the Quality of Published Surveys in Ophthalmology
Tran, E., Tran, M. M., Clark, M. A., Scott, I. U., Margo, C. E., Cosenza, C. A., Johnson, T. P., & Greenberg, P. B. (2020) · Ophthalmic Epidemiology · doi:10.1080/09286586.2020.1746359 · Cited by 9
Detsky, M. E., Ailon, J., Weinerman, A. S., Amaral, A. C. K.-B., & Bell, C. M. (2014) · Journal of Critical Care · doi:10.1016/j.jcrc.2014.10.026 · Cited by 9
Duffett, M., Choong, K. L. M., Foster, J. R., Gilfoyle, E., Lacroix, J., & Cook, D. J. (2017) · The Canadian Journal of Hospital Pharmacy · doi:10.4212/cjhp.v70i4.1679 · Cited by 7
Self-citationThe quality of survey research in burn care: A systematic review
Anderson, D. I., Fordyce, E., & Vrouwe, S. Q. (2022) · Burns · doi:10.1016/j.burns.2022.01.009 · Cited by 6
Rashid, B. A., Masri, A. A., Splieth, C. H., Abdalla, M., & Schmoeckel, J. (2024) · Medicina · doi:10.3390/medicina60111907 · Cited by 5
Post resuscitation care – some words of caution and a call for action
Søreide, E., & Larsen, A. I. (2015) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-015-0167-2 · Cited by 5
Survey research in anesthesiology: a field guide to interpretation
Schroeck, H., Wiredu, K., Ko, T. W., Record, D., & Sirovich, B. (2020) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2020-101299 · Cited by 5
Reliability Studies and Surveys
Wise, K. L., Kelly, B. J., Knudsen, M. L., & Macalena, J. A. (2019) · Springer eBooks · doi:10.1007/978-3-662-58254-1_38 · Cited by 5
Surrogate Receptivity to Participation in Critical Illness Genetic Research
Freeman, B. D., Butler, K., Bolcic‐Jankovic, D., Clarridge, B. R., Kennedy, C. R., LeBlanc, J. L., & Hull, S. C. (2014) · CHEST Journal · doi:10.1378/chest.14-0797 · Cited by 4
Variation in the Care of Acute Liver Failure: A Survey of Intensive Care Professionals
Cardoso, F. S., McPhail, M. J. W., Karvellas, C. J., Fuhrmann, V., Germano, N., & Auzinger, G. M. (2021) · GE Portuguese Journal of Gastroenterology · doi:10.1159/000516672 · Cited by 4
Doing better with survey-based research in paramedicine
Simpson, P. (2025) · Paramedicine · doi:10.1177/27536386251318443 · Cited by 4
A survey of surveys: an evaluation of the quality of published surveys in neurosurgery
Venkatesan, S., Kalvapudi, S., Muppidi, V., Ajith, K., Dutt, A., & Madhugiri, V. S. (2024) · Acta Neurochirurgica · doi:10.1007/s00701-024-06042-w · Cited by 2
Liu, A., & Menon, K. (2018) · Trials · doi:10.1186/s13063-018-2664-x · Cited by 2
Jamjoom, A. B., Gahtani, A. Y., Jamjoom, J. M., Sharab, B. M., Jamjoom, O. M., & Alzahrani, M. T. (2024) · Cureus · doi:10.7759/cureus.64785 · Cited by 2
Systematic Review Assessing Quality of the Survey Literature in Surgery
Newton, L., Predovic, M., & Wong, S. L. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.04.051 · Cited by 1
The Aspetar Rectus Femoris Injury Rehabilitation Pathway
Wallace, S., Simpson, D., Keever, H. M., Whiteley, R. J., & King, E. (2026) · JOSPT open. · doi:10.2519/josptopen.2026.0212 · Cited by 1
Cachat, F., Marques-Vidal, P. M., Girardin, E. P., Chehade, H., & Piot‐Ziegler, C. (2014) · Acta Paediatrica · doi:10.1111/apa.12725 · Cited by 1
Gerull, R., Manser, H., Küster, H., Arenz, T., Arenz, S., & Nelle, M. (2015) · European Journal of Pediatrics · doi:10.1007/s00431-015-2519-3
Zakrison, T. L., & McCREDIE, V. A. (2012) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e3182509103
Neurointerventional surveys between 2000 and 2023: a systematic review
Bosshart, S. L., Stebner, A., Weyland, C. S., Radu, R. A., & Ospel, J. M. (2024) · Journal of NeuroInterventional Surgery · doi:10.1136/jnis-2024-022298
Packer, R. L., Howells, S. R., Lim, E. K. Y., Hutchison, A. R., Rumbach, A. F., Wishart, L. R., & Brown, B. (2025) · International Journal of Speech-Language Pathology · doi:10.1080/17549507.2025.2544738
Anémie à la sortie de réanimation pédiatrique : prévalence, marqueurs de risque et prise en charge
Demaret, P. (2020) · theses.fr (ABES) · doi:10.70675/9f43b8dfz2d19z4048zb4a2z2d5ac9df5190
Optimisation de la prise en charge des lésions carieuses profondes
Gasqui, M.-A. (2021) · theses.fr (ABES) · doi:10.70675/da75615dz0159z4d3fza344zbfe825a60824 · Cited by 1
Surveys in clinical research: methodological aspects and practical guidance
Bianchini, L., Pereira, A. B., Tomazini, B. M., Righy, C., Maia, I. S., Ramos, J. G. R., Rosa, R. G., Roepke, R. M. L., Ferreira, J. C., & Besen, B. A. M. P. (2026) · Critical Care Science · doi:10.62675/2965-2774.20260322
Metadata
- Authors
- Duffett, M., Burns, K. E., Adhikari, N. K., Arnold, D. M., Lauzier, F., Kho, M. E., Meade, M. O., Hayani, O., Koo, K., Choong, K., Lamontagne, F., Zhou, Q., & Cook, D. J.
- Affiliations
- McMaster University (CA)
- ORCID
- Venue
- Critical Care Medicine
- Published
- 2012-02
- Volume
- 40
- Issue
- 2
- Pages
- 441-449
- ISSN
- 0090-3493 (ISSN-L)
- OpenAlex
- W2063130778
- Cited by
- 49
- References
- 18
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 6 · 2022: 2 · 2021: 4 · 2020: 6 · 2019: 4 · 2018: 3 · 2017: 1 · 2016: 3 · 2015: 4 · 2014: 7 · 2013: 2 · 2012: 2
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Critical Care Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- survey methodology, response rate, clinimetric properties, instrument development, face validity, content validity, construct validity, rater reliability, methodological quality, risk of bias
- MeSH terms
- Critical Care, Female, Humans, Male, North America, Periodicals as Topic, Quality Assurance, Health Care, Quality Control, Surveys and Questionnaires, Research Design, Health Care Surveys
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.