Quality of Survey Reporting in Nephrology Journals: A Methodologic Review
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
BACKGROUND AND OBJECTIVES: Survey research is an important research method used to determine individuals' attitudes, knowledge, and behaviors; however, as with other research methods, inadequate reporting threatens the validity of results. This study aimed to describe the quality of reporting of surveys published between 2001 and 2011 in the field of nephrology. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: The top nephrology journals were systematically reviewed (2001-2011: American Journal of Kidney Diseases, Nephrology Dialysis Transplantation, and Kidney International; 2006-2011: Clinical Journal of the American Society of Nephrology) for studies whose primary objective was to collect and report survey results. Included were nephrology journals with a heavy focus on clinical research and high impact factors. All titles and abstracts were screened in duplicate. Surveys were excluded if they were part of a multimethod study, evaluated only psychometric characteristics, or used semi-structured interviews. Information was collected on survey and respondent characteristics, questionnaire development (e.g., pilot testing), psychometric characteristics (e.g., validity and reliability), survey methods used to optimize response rate (e.g., system of multiple contacts), and response rate. RESULTS: After a screening of 19,970 citations, 216 full-text articles were reviewed and 102 surveys were included. Approximately 85% of studies reported a response rate. Almost half of studies (46%) discussed how they developed their questionnaire and only a quarter of studies (28%) mentioned the validity or reliability of the questionnaire. The only characteristic that improved over the years was the proportion of articles reporting missing data (2001-2004: 46.4%; 2005-2008: 61.9%; and 2009-2011: 84.8%; respectively) (P<0.01). CONCLUSIONS: The quality of survey reporting in nephrology journals remains suboptimal. In particular, reporting of the validity and reliability of the questionnaire must be improved. Guidelines to improve survey reporting and increase transparency are clearly needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, Alvin et al. reviewed 102 surveys in top nephrology journals and found that the quality of surveys was suboptimal and highlighted the need for new reporting guidelines to improve reporting quality and increase transparency. 25”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [25]
The cited source says what the claim attributes to it.
In the citing paper
“Because of concerns regarding survey qualities and lack of well-developed guidelines, there is a need for a single comprehensive tool that can be used as a standard reporting checklist for survey research to address significant discrepancies in the reporting of survey studies. 13, 25 -28, 31, 32”
From A Consensus-Based Checklist for Reporting of Survey Studies (CROSS) (2021) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2008) · Cited by 7,000
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Vandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Good practice in the conduct and reporting of survey research
KELLEY, K. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg031 · Cited by 2,157
Increasing response rates to postal questionnaires: systematic review
Edwards, P., Roberts, I., Clarke, M., DiGuiseppi, C., Pratap, S., Wentz, R., & Kwan, I. (2002) · BMJ · doi:10.1136/bmj.324.7347.1183 · Cited by 1,915
Clinical Epidemiology: The Essentials.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_10 · Cited by 1,835
Research works printed but not linked: 1
- Porta M: A Dictionary of Epidemiology, 5th Ed. Oxford, New York, Oxford University Press, 2008 [Google Scholar]
Cited by
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06737-1 · Cited by 2,292
“highlighted the need for new reporting guidelines to improve the reporting quality and increase transparency [25].”
BackgroundMethodDesigning, Conducting, and Reporting Survey Studies: A Primer for Researchers
Zimba, O., & Gasparyan, A. Y. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e403 · Cited by 213
“8 - 10 Additionally, no discussions of respondents' representativeness, reasons for nonresponse, and generalizability of the results have been pinpointed as drawbacks of some survey reports.”
ResultQuestionnaire Use and Development in Health Research
Koo, M., & Yang, S.-W. (2025) · Encyclopedia · doi:10.3390/encyclopedia5020065 · Cited by 87
“However, deficiencies in survey reporting remain prevalent across medical research [55,56].”
Morton, R. L., Lioufas, N. M., Dansie, K. B., Palmer, S. C., Jose, M., Raj, R., Salmon, A. H. J., Sypek, M. P., Tong, A., Ludlow, M. J., et al. (2019) · Nephrology · doi:10.1111/nep.13577 · Cited by 53
“This study follows the Survey Reporting Guideline (SuRGe)(12) and quality indicators for surveys in nephrology.(13) Before embarking on collection of PROMs and PREMs for people treated with renal replacement therapy, ANZDATA set up a Working Group in November 2016 (chaired by RLM) to explore the utility of registry-ba…”
MethodColbert, C. Y., French, J. C., Arroliga, A. C., & Bierer, S. B. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1673596 · Cited by 35
“Unlike previous studies examining only journals with the highest impact factors in their fields [3,5,26,50], we”
BackgroundResultInfluentialResh, W. G., Moldogaziev, T. T., Fernández, S., & Leslie, C. A. (2019) · Review of Public Personnel Administration · doi:10.1177/0734371x19865012 · Cited by 31
“There are established guidelines for survey research in the code of ethics of the American Association for Public Opinion Research (AAPOR, 2015) and the report on best practices for survey research by National Science Foundation Advisory Committee for the Social, Behavioral and Economic Sciences (NSF SBE report by Kro…”
BackgroundShanahan, D. R., Sousa, I. L. D., & Marshall, D. M. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0044-9 · Cited by 26
“Inadequate reporting is also a huge problem in study types other than randomised trials, including systematic reviews [23], diagnostic studies [24], animal studies [25], observational studies [26], clinical predication studies [27], qualitative studies [28] and surveys [29, 30], contributing to an estimated $85billion…”
Surveys in Surgical Education: A Systematic Review and Reporting Guideline
Banning, L. B. D., Meyer, V., Keupers, J., Lange, J. F. M., Pol, R. A., & Benjamens, S. (2021) · European Surgical Research · doi:10.1159/000516125 · Cited by 24
A methodological review of the quality of reporting of surveys in transfusion medicine
Pagano, M. B., Dunbar, N. M., Tinmouth, A., Apelseth, T. O., Lozano, M., Cohn, C. S., Stanworth, S. J., & Collaborative, O. B. O. T. B. E. F. S. T. (. (2018) · Transfusion · doi:10.1111/trf.14937 · Cited by 16
“Title, abstract, introduction Is the study design stated in the title and/or abstract? Both title and abstract “survey/questionnaire” 44 (81) Either title or abstract “survey/questionnaire” 9 (17) Neither title nor abstract “survey/questionnaire” 1 (2) Is there an explanation of why the research is necessary? Yes 52 (…”
BackgroundInfluentialHow do we design and report a high‐quality survey?
Pagano, M. B., Dunbar, N. M., & Stanworth, S. J. (2020) · Transfusion · doi:10.1111/trf.15861 · Cited by 16
Survey Research Reporting in Radiology Publications: A Review of 2017 to 2018
Shankar, P. R., & Maturen, K. E. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.07.012 · Cited by 15
Caminiti, C., Diodati, F., Puntoni, M., Balan, D. G., & Maglietta, G. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22020177 · Cited by 15
Quality indicators in burn care: An international burn care professionals survey to define them
Dash, S., Pompermaier, L., Lavrentieva, A., Rogers, A. D., & Depetris, N. (2022) · Burns · doi:10.1016/j.burns.2022.11.006 · Cited by 13
Mallappallil, M. C., Mehta, R. L., Yoshiuchi, E., Briefel, G. R., Lerma, E. V., & Salifu, M. O. (2015) · The Nephron journals/Nephron journals · doi:10.1159/000381924 · Cited by 13
Development and evaluation of shared decision-making tools in rheumatology: A scoping review
Aref, H. A. T., Turk, T., Dhanani, R., Xiao, A., Olson, J., Paul, P., Dennett, L., Yacyshyn, E., & Sadowski, C. A. (2024) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2024.152432 · Cited by 11
Assessing the Quality of Published Surveys in Ophthalmology
Tran, E., Tran, M. M., Clark, M. A., Scott, I. U., Margo, C. E., Cosenza, C. A., Johnson, T. P., & Greenberg, P. B. (2020) · Ophthalmic Epidemiology · doi:10.1080/09286586.2020.1746359 · Cited by 9
Quality of survey-based study reports in dentistry
Mattos-Vela, M. A., Evaristo-Chiyong, T. A., & Vera, K. S. (2023) · BMC Oral Health · doi:10.1186/s12903-023-02979-z · Cited by 8
“[7] in the area of nephrology, Pagano et al.”
BackgroundThe quality of survey research in burn care: A systematic review
Anderson, D. I., Fordyce, E., & Vrouwe, S. Q. (2022) · Burns · doi:10.1016/j.burns.2022.01.009 · Cited by 6
Bianco, L., Raffa, S., Fornelli, P., Mancini, R., Gabriele, A., Medici, F., Battista, C., Greco, S., Croce, G., Germani, A., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19137806 · Cited by 7
“Even if it is believed that the intellectual rigor of EBM is applicable in this context [6], the lack of adequate data may threaten the validity of results, as complete and transparent reporting is necessary for readers to adequately assess the biases, strengths, and weaknesses of the study and the generalizability of…”
BackgroundCalidad de las investigaciones basadas en encuestas: directrices para buenos informes
Mattos-Vela, M. A., & Carballido, D. A. (2020) · Odontología Sanmarquina · doi:10.15381/os.v23i1.17507 · Cited by 6
Survey research in anesthesiology: a field guide to interpretation
Schroeck, H., Wiredu, K., Ko, T. W., Record, D., & Sirovich, B. (2020) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2020-101299 · Cited by 5
Umaroh, A. K., & Nugroho, P. S. (2025) · Psychology Health & Medicine · doi:10.1080/13548506.2025.2481623 · Cited by 3
“Conversely, some journals may not accept articles with response rates below 60% (Li et al., 2014).”
A survey of surveys: an evaluation of the quality of published surveys in neurosurgery
Venkatesan, S., Kalvapudi, S., Muppidi, V., Ajith, K., Dutt, A., & Madhugiri, V. S. (2024) · Acta Neurochirurgica · doi:10.1007/s00701-024-06042-w · Cited by 2
“Studies evaluating the quality of surveys in clinical specialties such as anesthesia, transfusion medicine, critical care, and nephrology have all found wide variations in survey design and inconsistencies in reporting practices [18, 32, 41, 54].”
Jamjoom, A. B., Gahtani, A. Y., Jamjoom, J. M., Sharab, B. M., Jamjoom, O. M., & Alzahrani, M. T. (2024) · Cureus · doi:10.7759/cureus.64785 · Cited by 2
Systematic Review Assessing Quality of the Survey Literature in Surgery
Newton, L., Predovic, M., & Wong, S. L. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.04.051 · Cited by 2
Neurointerventional surveys between 2000 and 2023: a systematic review
Bosshart, S. L., Stebner, A., Weyland, C. S., Radu, R. A., & Ospel, J. M. (2024) · Journal of NeuroInterventional Surgery · doi:10.1136/jnis-2024-022298
Chess and eSports Nutrition: Dietary Habits, Lifestyles and Hydration Status
Ribeiro, F. J. V. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/c69n-fb38 · Cited by 2
Optimisation de la prise en charge des lésions carieuses profondes
Gasqui, M.-A. (2021) · theses.fr (ABES) · doi:10.70675/da75615dz0159z4d3fza344zbfe825a60824 · Cited by 1
Dietary Habits and the Use of Nutritional Supplements by esports Competitors: A Scoping Review
Ribeiro, F. J., & Poínhos, R. (2026) · Revista Ciencias de la Salud · doi:10.12804/revistas.urosario.edu.co/revsalud/a.14304
“…assess the bias, strengths, weaknesses, and applicability of study findings, it is recommended that studies that include surveys should comprehensively report the procedures applied, and provide access to the applied questionnaire, including information regarding its psychometric properties (20).”
Metadata
- Authors
- Li, A. H.-T., Thomas, S. M., Farag, A., Duffett, M., Garg, A. X., & Naylor, K. L.
- Affiliations
- Western University (CA)
- McMaster University (CA)
- Corresponding author
- Li, Alvin Ho-Ting
- Thomas, Sonia M.
- Farag, Alexandra
- Garg, Amit X.
- Naylor, Kyla L.
- Venue
- Clinical Journal of the American Society of Nephrology
- Published
- 2014-12
- Volume
- 9
- Issue
- 12
- Pages
- 2089-2094
- ISSN
- 1555-9041 (ISSN-L)
- PMC
- PMC4255395
- OpenAlex
- W2045014844
- Cited by
- 27
- References
- 23
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 5 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 4 · 2019: 4 · 2018: 1 · 2017: 1 · 2015: 1
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Clinical Journal of the American Society of Nephrology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Osteoporosis Canada
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- reporting guidelines, nephrology journals, questionnaire development, psychometric reliability and validity, response rate, missing data, survey methodology, research transparency
- MeSH terms
- Data Collection, Humans, Nephrology, Periodicals as Topic, Surveys and Questionnaires, Research Design, Reproducibility of Results, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.