CoChat

Quality of reporting of surveys in critical care journals: A methodologic review*

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Abstract

OBJECTIVE: Adequate reporting is needed to judge methodologic quality and assess the risk of bias of surveys. The objective of this study is to describe the methodology and quality of reporting of surveys published in five critical care journals. DATA SOURCES: All issues (1996-2009) of the American Journal of Respiratory and Critical Care Medicine, Critical Care, Critical Care Medicine, Intensive Care Medicine, and Pediatric Critical Care Medicine. STUDY SELECTION: Two reviewers hand-searched all issues in duplicate. We included publications of self-administered questionnaires of health professionals and excluded surveys that were part of a multi-method study or measured the effect of an intervention. DATA EXTRACTION: Data were abstracted in duplicate. DATA SYNTHESIS: We included 151 surveys. The frequency of survey publication increased at an average rate of 0.38 surveys per 1000 citations per year from 1996-2009 (p for trend = 0.001). The median number of respondents and reported response rates were 217 (interquartile range 90 to 402) and 63.3% (interquartile range 45.0% to 81.0%), respectively. Surveys originated predominantly from North America (United States [40.4%] and Canada [18.5%]). Surveys most frequently examined stated practice (78.8%), attitudes or opinions (60.3%), and less frequently knowledge (9.9%). The frequency of reporting on the survey design and methods were: 1) instrument development: domains (59.1%), item generation (33.1%), item reduction (12.6%); 2) instrument testing: pretesting or pilot testing (36.2%) and assessments of clarity (25.2%) or clinical sensibility (15.7%); and 3) clinimetric properties: qualitative or quantitative description of at least one of face, content, construct validity, intra- or inter-rater reliability, or consistency (28.5%). The reporting of five key elements of survey design and conduct did not significantly change over time. CONCLUSIONS: Surveys, primarily conducted in North America and focused on self-reported practice, are increasingly published in highly cited critical care journals. More uniform and comprehensive reporting will facilitate assessment of methodologic quality.

Overview

Integrity signals

Registry

Crossref · 10.1097/ccm.0b013e318232d6c6

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 19 references

Research works printed but not linked: 3

  1. Henry, 1986, Fam Pract Res J, 5, 145
  2. Rubenfeld, 2004, Respir Care, 49, 1181
  3. Huston, 1996, CMAJ, 154, 1695

Cited by

See all 50

Metadata

Authors
Duffett, M., Burns, K. E., Adhikari, N. K., Arnold, D. M., Lauzier, F., Kho, M. E., Meade, M. O., Hayani, O., Koo, K., Choong, K., Lamontagne, F., Zhou, Q., & Cook, D. J.
Affiliations
McMaster University (CA)
Venue
Critical Care Medicine
Published
2012-02
Volume
40
Issue
2
Pages
441-449
ISSN
0090-3493 (ISSN-L)
OpenAlex
W2063130778
Cited by
49
References
18
Citations by year
2026: 2 · 2025: 3 · 2024: 6 · 2022: 2 · 2021: 4 · 2020: 6 · 2019: 4 · 2018: 3 · 2017: 1 · 2016: 3 · 2015: 4 · 2014: 7 · 2013: 2 · 2012: 2
FWCI
3.75
Type
journal article
Language
en
Open access
closed
Locations
  • Critical Care Medicine (publishedVersion)
  • PubMed (publishedVersion)
Funders
Canadian Institutes of Health Research
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords
survey methodology, response rate, clinimetric properties, instrument development, face validity, content validity, construct validity, rater reliability, methodological quality, risk of bias
MeSH terms
Critical Care, Female, Humans, Male, North America, Periodicals as Topic, Quality Assurance, Health Care, Quality Control, Surveys and Questionnaires, Research Design, Health Care Surveys

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quality of reporting of surveys in critical care journals: A methodologic review*. https://app.cochat.ai/papers/10.1097/ccm.0b013e318232d6c6
The paper
Duffett, M., Burns, K. E., Adhikari, N. K., Arnold, D. M., Lauzier, F., Kho, M. E., Meade, M. O., Hayani, O., Koo, K., Choong, K., Lamontagne, F., Zhou, Q., & Cook, D. J. (2012). Quality of reporting of surveys in critical care journals: A methodologic review*. Critical Care Medicine. https://doi.org/10.1097/ccm.0b013e318232d6c6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.