The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Inconsistent Survey Reporting in Anesthesia Journals
Abstract
BACKGROUND: As with other types of research, there are concerns about reporting of survey research in anesthesia journals. We hypothesized that use of survey reporting items would be inconsistent in survey research reported in anesthesia journals. METHODS: After a literature review we constructed a 17-item reporting list for a limited systematic review of survey reporting in 6 anesthesia journals. We identified survey reports by MEDLINE (PubMed) search for January 2000 to April 2009. RESULTS: The initial search identified 347 publications. Of these, we excluded 107 because they were not questionnaire surveys (often audits), were reviews, or were letters. We therefore identified 240 surveys published as full survey reports. From the 17-item reporting list, the median number of items recorded was 9 (interquartile range: 7 to 10; range 2 to 15). The number (and percentage) of surveys reporting specific items ranged widely for different items: from 9 surveys (4%; 95% confidence interval [CI]: 2% to 7%) for sample size to 240 surveys (100%; 95% CI: 98% to 100%) for response rate. In addition to sample size, the 5 least frequently reported items included the following: reporting confidence intervals, 21 surveys (9%; 95% CI: 6% to 13%); stating a hypothesis, 23 of 240 surveys (10%; 95% CI: 7% to 14%); accounting for nonresponders, 61 surveys (25%; 95% CI: 20% to 31%); and survey design, 67 surveys (28%; 95% CI: 33% to 34%). CONCLUSIONS: Inconsistent reporting may compromise the transparency and reproducibility of survey reports.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of concerns regarding survey qualities and lack of well-developed guidelines, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies. 13, 25 -28, 31, 32”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [28]
In the citing paper
“Similar concerns regarding the qualities of surveys have been raised in other medical fields. 28 -33”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [28]
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Statistics notes: Cronbach's alpha: Table 1
Bland, J. M., & Altman, D. G. (1997) · BMJ · doi:10.1136/bmj.314.7080.572 · Cited by 5,300 · cited 1×
“We also calculated Cronbach’s .(25) Data were collected on an Excel spreadsheet, and statistical analysis consisted of descriptive statistics including mean, interquartile range, percentages, and confidence intervals using GraphPad Prism version 4 software (GraphPad Software, San Diego, CA) and Confidence Interval Ana…”
MethodGood practice in the conduct and reporting of survey research
KELLEY, K. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg031 · Cited by 2,157 · cited 2×
“Fourth, nonresponders can bias survey results.(2,8,17) Sources of bias associated with response rate include nonresponders differing in demographics from responders.”
BackgroundKrosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
A guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354 · cited 2×
“Second, the complexity of designing a good new survey is often underestimated.(2,8,15) Alternatively, if an existing survey is used, the validity of that survey should be discussed.”
BackgroundMethodSelecting, designing, and developing your questionnaire
Boynton, P. M., & Greenhalgh, T. (2004) · BMJ · doi:10.1136/bmj.328.7451.1312 · Cited by 1,083
A catalogue of reporting guidelines for health research
Simera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2009.02234.x · Cited by 1,047 · cited 1×
“We also used reporting guides for other types of research including CONSORT (randomized trials), PRISMA (systematic reviews), and STROBE (observational studies).(20) This study was reported using the PRISMA guidelines for systematic reviews and meta-analyses.”
MethodSimera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
Cited by
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06737-1 · Cited by 2,292
Story, D. A., & Tait, A. R. (2019) · Anesthesiology · doi:10.1097/aln.0000000000002436 · Cited by 339
Self-citationA Survey of the Management of Neuromuscular Blockade Monitoring in Australia and New Zealand
Phillips, S., Slewarl, P. A., & BILGIN, A. A. B. (2013) · Anaesthesia and Intensive Care · doi:10.1177/0310057x1304100316 · Cited by 67
Schoenfeld, E. M., Kanzaria, H. K., Quigley, D. D., Marie, P. S., Nayyar, N., Sabbagh, S. H., Gress, K. L., & Probst, M. A. (2018) · Academic Emergency Medicine · doi:10.1111/acem.13499 · Cited by 59
“The study was approved by each hospital’s institutional review board and designed to comply with suggested quality standards for survey reporting in medical literature.(17,18) All three hospitals are urban, teaching, safety-net hospitals.”
Soong, W., Sherwani, S. S., Ault, M. L., Baudo, A. M., Herborn, J. C., & WOLF, A. M. D. (2014) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2013.10.011 · Cited by 49
Variations in assessment and certification in postgraduate anaesthesia training: a European survey
Jonker, G., Manders, L. A., Marty, A., Kalkman, C. J., ten Cate, O., Gessel, E. F. V., & Hoff, R. G. (2017) · British Journal of Anaesthesia · doi:10.1093/bja/aex196 · Cited by 50
“The report of this study adheres, wherever applicable, to the Survey Reporting List.(7)”
A survey of the choice of general anaesthetic agents in Australia and New Zealand
McGain, F., Bishop, J. R., Elliot-Jones, L. M., Story, D., & Imberger, G. L. (2019) · Anaesthesia and Intensive Care · doi:10.1177/0310057x19836104 · Cited by 43
Self-citationThe science of opinion: survey methods in research
Bryson, G. L., Turgeon, A. F., & Choi, P. T. (2012) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-012-9727-3 · Cited by 41
“Une synthèse récente a trouvé des rapports d’enquêtes incohérents dans des revues d’anesthésie.(7) D’une manière générale, les caractéristiques suivantes d’une enquête correctement développée doivent être décrites de façon claire: 1) la question de recherche; 2) les détails sur la population cible et l’échantillon de…”
MethodInfluentialDrug shortages in Canadian anesthesia: a national survey
Hall, R., Bryson, G. L., Flowerdew, G. J., Neilipovitz, D., Grabowski-Comeau, A., & Turgeon, A. F. (2013) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-013-9920-z · Cited by 39
Perioperative anaesthetic practice for head and neck free tissue transfer - a UK national survey
Gooneratne, H., Lalabekyan, B., Clarke, S., & Burdett, E. (2013) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12180 · Cited by 30
Perioperative Ventilatory Management in Cardiac Surgery: A French Nationwide Survey
Fischer, M.-O., Courteille, B., Guinot, P., Dupont, H., Gérard, J.-L., Hanouz, J., & Lorne, E. (2016) · Medicine · doi:10.1097/md.0000000000002655 · Cited by 29
“Indication for lung recruitment maneuvers All patients 61 (30) Only in obese patients (BMI >30 kg/m(2)) 39 (20) Only in high-risk patients 30 (15) Only if low SpO2 88 (44) Never 15 (8) Other situations 4 (2) Pressure of lung recruitment maneuvers On accessory circuit with no pressure control 28 (14) Manually, with pre…”
BackgroundKeys to Successful Survey Research in Health Professions Education
Hochberg, C. H., & Eakin, M. N. (2024) · ATS Scholar · doi:10.34197/ats-scholar.2023-0112re · Cited by 30
Conclusions from surveys may not consider important biases: a systematic survey of surveys
Santesso, N. A., Barbara, A. M., Kamran, R., Akkinepally, S., Cairney, J., Akl, E. A., & Schünemann, H. J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.019 · Cited by 28
Quality of Survey Reporting in Nephrology Journals: A Methodologic Review
Li, A. H.-T., Thomas, S. M., Farag, A., Duffett, M., Garg, A. X., & Naylor, K. L. (2014) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02130214 · Cited by 27
Isaak, R. S., Chen, F., Arora, H., Martinelli, S. M., Zvara, D. A., & Stiegler, M. P. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002189 · Cited by 23
Keon-Cohen, Z., Myles, P. S., & Story, D. (2017) · Anaesthesia and Intensive Care · doi:10.1177/0310057x1704500316 · Cited by 23
Self-citationSiddiqui, S., Bartels, K., Schaefer, M. S., Novack, L., Sreedharan, R., Ben-Jacob, T. K., Khanna, A. K., Nunnally, M., Souter, M. J., Simmons, S. T., et al. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005030 · Cited by 22
National Survey of US academic anesthesiology chairs on clinician wellness
Vinson, A. E., Zurakowski, D., Randel, G. I., & Schlecht, K. D. (2016) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2016.06.015 · Cited by 20
Quality and Impact of Survey Research Among Anesthesiologists: A Systematic Review
Geyer, E. D., Miller, R., Kim, S. S., Tobias, J. D., Nafiu, O. O., & Tumin, D. (2020) · Advances in Medical Education and Practice · doi:10.2147/amep.s259908 · Cited by 17
A methodological review of the quality of reporting of surveys in transfusion medicine
Pagano, M. B., Dunbar, N. M., Tinmouth, A., Apelseth, T. O., Lozano, M., Cohn, C. S., Stanworth, S. J., & Collaborative, O. B. O. T. B. E. F. S. T. (. (2018) · Transfusion · doi:10.1111/trf.14937 · Cited by 16
“” 38 (70) Yes, implicitly 14 (26) No 2 (4) Details of questionnaire How is the questionnaire described? Full questionnaire provided 28 (52) Core questions provided 6 (11) Summary of core questions provided 17 (31) Questions not provided 3 (6) If an existing tool was used, are its psychometric properties presented? Yes…”
How do we design and report a high‐quality survey?
Pagano, M. B., Dunbar, N. M., & Stanworth, S. J. (2020) · Transfusion · doi:10.1111/trf.15861 · Cited by 16
Mistry, R., Frei, D. R., Badenhorst, C., & Broadbent, J. (2021) · Anaesthesia and Intensive Care · doi:10.1177/0310057x20968841 · Cited by 16
Walker, S. L. M., Abbott, T. E. F., Brown, K., Pearse, R. M., & Ackland, G. L. (2018) · PeerJ · doi:10.7717/peerj.5061 · Cited by 15
“(Story et al. 2011) 83 84 Questionnaire design PeerJ reviewing PDF | (2017:11:21760:2:0:CHECK 22 May 2018) 85 The survey consisted of 11 questions designed to ascertain opinions regarding perioperative 86 ACEi/ARB use and illicit routine perioperative prescribing patterns.”
MethodQuality indicators in burn care: An international burn care professionals survey to define them
Dash, S., Pompermaier, L., Lavrentieva, A., Rogers, A. D., & Depetris, N. (2022) · Burns · doi:10.1016/j.burns.2022.11.006 · Cited by 13
Valkenburg, A. J., van der Kreeft, S. M., de Leeuw, T. G., Stolker, R. J., Tibboel, D., & van Dijk, M. (2012) · Pediatric Anesthesia · doi:10.1111/j.1460-9592.2012.03800.x · Cited by 14
Frei, D. R., Beasley, R. W., Campbell, D., Leslie, K., Merry, A., Moore, M. R., Myles, P. S., Ruawai-Hamilton, L., Short, T. G., & Young, P. J. (2019) · Anaesthesia and Intensive Care · doi:10.1177/0310057x19842245 · Cited by 12
Tracking the employee satisfaction-life satisfaction binary: The case of South African academics
Mafini, C. (2014) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v40i2.1181 · Cited by 12
Saastamoinen, M., Larsson, J., & Frykholm, P. (2019) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13426 · Cited by 10
Afonso, A. M., Diaz, J. H., Scher, C., Beyl, R. A., Nair, S., & Kaye, A. D. (2013) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2013.01.007 · Cited by 8
Progress to publication of survey research presented at anesthesiology society meetings
Geyer, E. D., Tumin, D., Miller, R., Cartabuke, R. S., & Tobias, J. D. (2018) · Pediatric Anesthesia · doi:10.1111/pan.13466 · Cited by 7
Ruszkai, Z., Kiss, E., & Molnár, Z. (2019) · The Journal of Critical Care Medicine · doi:10.2478/jccm-2019-0002 · Cited by 7
“, (2017) was used to obtain consistency, clarity, reproducibility and validity of the survey report [14].”
MethodBrasel, K. J. (2020) · Success in academic surgery · doi:10.1007/978-3-030-28357-5_20 · Cited by 7
The quality of survey research in burn care: A systematic review
Anderson, D. I., Fordyce, E., & Vrouwe, S. Q. (2022) · Burns · doi:10.1016/j.burns.2022.01.009 · Cited by 6
O’Leary, J. D., & Crawford, M. W. (2015) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-015-0427-7 · Cited by 5
Ozcan, G., Singh, M., & Mortensen, E. M. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-88423-5.00097-2 · Cited by 4
Survey of international regional anesthesia fellowship directors
McHardy, P. G., Lansdown, Patel, Nix, C. M., & McCartney (2013) · Local and Regional Anesthesia · doi:10.2147/lra.s38789 · Cited by 4
“26 A concurrent survey of the RA fellows themselves might provide a more frank opinion on the quality of the fellowship experience, but it too would suffer from inherent bias and would present greater logistical challenges to complete.”
BackgroundOut of Africa: three generalisable lessons about clinical research
Leslie, K., Story, D., & Diouf, E. (2018) · British Journal of Anaesthesia · doi:10.1016/j.bja.2018.07.005 · Cited by 3
“think that a consensus guideline about the design and reporting of survey research would greatly assist researchers in overcoming these and other challenges.(8)”
BackgroundSelf-citationA survey of self-reported management of hypernatraemia acquired in Australasian intensive care units
Pearson, D. C., & McGain, F. (2014) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01457-6 · Cited by 4
Balmaks, E., Seglenieks, R., Botha, T., & McGain, F. (2025) · Anaesthesia and Intensive Care · doi:10.1177/0310057x251330318 · Cited by 2
The known knowns, known unknowns, and unknown unknowns of surveys and sleep
Shaker, M. S., & Moore‐Clingenpeel, M. (2022) · Annals of Allergy Asthma & Immunology · doi:10.1016/j.anai.2022.09.007 · Cited by 2
Systematic Review Assessing Quality of the Survey Literature in Surgery
Newton, L., Predovic, M., & Wong, S. L. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.04.051 · Cited by 1
A survey of surveys: an evaluation of the quality of published surveys in neurosurgery
Venkatesan, S., Kalvapudi, S., Muppidi, V., Ajith, K., Dutt, A., & Madhugiri, V. S. (2024) · Acta Neurochirurgica · doi:10.1007/s00701-024-06042-w · Cited by 2
“Studies evaluating the quality of surveys in clinical specialties such as anesthesia, transfusion medicine, critical care, and nephrology have all found wide variations in survey design and inconsistencies in reporting practices [18, 32, 41, 54].”
The Impact Of Perioperative Oxygen Regimens On Recovery After Major Surgery
Frei, D. (2024) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.25432819 · Cited by 1
Brasel, K. J. (2014) · Success in academic surgery · doi:10.1007/978-1-4471-4718-3_17
Pediatric massive hemorrhage—are we all following similar protocols?
Vlatten, A. (2023) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-023-02640-x
Neurointerventional surveys between 2000 and 2023: a systematic review
Bosshart, S. L., Stebner, A., Weyland, C. S., Radu, R. A., & Ospel, J. M. (2024) · Journal of NeuroInterventional Surgery · doi:10.1136/jnis-2024-022298
Graduate paramedic experience of rolling recruitment: an exploration
Wilkinson-Stokes, M., & Whitfield, S. (2026) · International Paramedic Practice · doi:10.12968/ippr.2026.0005
Metadata
- Authors
- Story, D. A., Gin, V., na Ranong, V., Poustie, S., & Jones, D.
- Affiliations
- The University of Melbourne (AU)
- Austin Hospital (AU)
- Australian and New Zealand College of Anaesthetists (AU)
- Corresponding author
- Story, David A.
- Gin, Veronica
- Venue
- Anesthesia & Analgesia
- Published
- 2011-09
- Volume
- 113
- Issue
- 3
- Pages
- 591-595
- ISSN
- 0003-2999 (ISSN-L)
- OpenAlex
- W2317590778
- Cited by
- 52
- References
- 24
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 5 · 2019: 5 · 2018: 9 · 2017: 3 · 2016: 2 · 2015: 1 · 2014: 5 · 2013: 6 · 2012: 2
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Anesthesia & Analgesia (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- survey reporting, reporting guidelines, reporting bias, anesthesiology journals, questionnaire survey, sample size reporting, confidence intervals, nonresponse adjustment, survey design, reproducibility, transparency
- MeSH terms
- Anesthesia, Humans, Periodicals as Topic, Quality Control, Surveys and Questionnaires, Reproducibility of Results, Bibliometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.