The DOI matches its Crossref record; 35 of the 38 references it cites were found in a registry or an index; 18 of the 37 sources its claims cite were checked for support.
A Consensus-Based Checklist for Reporting of Survey Studies (CROSS)
Open accessOverview
CoChat Summary
## TL;DR
This paper develops CROSS, a 19-section, 40-item reporting checklist for survey studies, created through literature review and a three-round Delphi process with international experts. The authors argue it is a more comprehensive tool than existing survey checklists because it covers both web-based and non-web-based surveys and adds items on methods, limitations, interpretation, and generalizability.
## Key findings
- The Delphi panel included 24 experts, with a median of 20 years of research experience (Q1, Q3: 15.75, 31).
- Across Delphi rounds, 24 items were selected in original form in round 1, 27 items were reviewed in round 2, 10 items were merged into five, 11 items were modified, and 1 additional item was included in round 3.
- The final CROSS checklist contains 19 sections and 40 different items.
- The checklist adds content the authors say is missing from prior tools, including items on study limitations, interpretation, and generalizability.
## Methods
- The study used a Delphi method from January 2018 to December 2019 to develop a reporting checklist for survey studies.
- Checklist development had five phases: planning, drafting checklist items, consensus building using Delphi, dissemination of guidelines, and maintenance of guidelines.
- The team conducted a literature review, searched the EQUATOR Network, and then ran three Delphi rounds with invited experts who rated items on a 5-point Likert scale; a 70% agreement threshold was used for inclusion.
## Limitations
- The paper states that the Delphi method may involve subjectivity in interpreting experts’ responses and suggestions.
- The authors report that six experts were lost to follow-up.
- Evident from the text: the checklist was developed by expert consensus rather than tested here for whether it improves reporting quality in practice; the paper presents the tool and rationale, but not an outcome evaluation of its use.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 Valid · 2 Not valid · 8 Not checked · 71 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“SURGE 22 and CHERRIES 23 are frequently recommended for reporting of non-web and web-based surveys.”
What the sources say
- Not checked — no full text of the sourcecites [22] Grimshaw, J. (2014). SURGE (The SUrvey Reporting GuidelinE). In Guidelines for Reporting Health Research: a User’s Manual (eds D. Moher, D.G. Altman, K.F. Schulz, I. Simera and E. Wager). https://doi.org/10.1002/9781118715598.ch20 source
- Supportedcites [23] Eysenbach G. Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 2004;6(3):e34. DOI: https://doi.org/10.2196/jmir.6.3.e34. source
Citation 23 identifies CHERRIES as the checklist for reporting web-based surveys; citation 22, not this source, is attached to SURGE. The CHERRIES Checklist section says the journal’s editor and peer reviewers ask authors to report Web-survey methods according to CHERRIES, supporting its characterization as a recommended reporting checklist. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, a report by Tarek et al. found that many items of the SURGE and CHERRIES guidelines (e.g., development, description, testing of the questionnaire, advertisement, and administration of the questionnaire, sample representativeness, response rates, informed consent, statistical analysis) had been missed by authors.”
What the sources say
- Not matchedcites Tarek et al.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
None of the sources cited for this claim have been checked yet.
In the paper
“Furthermore, even after the development of these guidelines (SURGE and CHERRIES), there has been limited improvement in reporting of surveys.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These components are missing from previous checklists (i.e., CHERRIES and SURGE).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The development of CROSS is the result of a literature review and Delphi process which involved international experts with significant expertise in the development and implementation of survey studies.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 48
- Probably not a substantial claim. 83
- The quote only partly states this claim. 10
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“A quantitative cross-sectional survey was conducted in accordance with (a) the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [52] (b) the STrengthening the Reporting of OBservational Studies in Epidemiology (STROBE) [53] and (c) the Consensus-Based Checklist for Reporting of Survey Studies (CROSS) [54] guidelines.”
The cited source says what the claim attributes to it.
In the citing paper
“The research was developed and conducted following the international reporting guidelines (STROBE, CHERRIES and CROSS) [52–54], ensuring methodological rigor.”
The cited source says what the claim attributes to it.
In the citing paper
“This study was reported in accordance with the consensus-based Checklist for Reporting of Survey Studies (CROSS) checklist (Multimedia Appendix 1) [24].”
In the citing paper
“The CROSS guidelines for reporting surveys were followed for this study (Sharma et al., 2021).”
From Migrant women’s experience of antenatal care in an urban and rural setting in north and North-West Thailand: A cross sectional survey (2025) · cites this paper as Sharma et al., 2021
In the citing paper
“A 56 question survey was developed in accordance with the Consensus-Based Checklist for Reporting of Survey Studies (CROSS) guidelines for survey studies and coded in Microsoft Forms (Additional file 2 [9];).”
From Exploration of exposure to artificial intelligence in undergraduate medical education: a Canadian cross-sectional mixed-methods study (2022) · cites this paper as [9]
Citations
Cites
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480
Consulting the oracle: ten lessons from using the Delphi technique in nursing research
Keeney, S., Hasson, F., & McKenna, H. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03716.x · Cited by 1,511
Guidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 3×
“For example, Moher et al.20 reported that, although over 63,000 new studies are published in PubMed on a monthly basis, many publications face the problem of inadequate reporting.”
BackgroundMethodInfluentialSimera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
A quick guide to survey research
Jones, T., Baxter, M., & Khanduja, V (2013) · The Annals of The Royal College of Surgeons of England · doi:10.1308/003588413x13511609956372 · Cited by 456
Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
Bennett, C., Khangura, S., Brehaut, J. C., Graham, I. D., Moher, D., Potter, B. K., & M. Grimshaw, J. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001069 · Cited by 397
Guidelines for Reporting Health Research: A User's Manual
Moher, D. (2014) · Wiley eBooks · doi:10.1002/9781118715598 · Cited by 287
Alcock, I., White, M. P., Pahl, S., Duarte-Davidson, R., & Fleming, L. E. (2020) · Environment International · doi:10.1016/j.envint.2019.105441 · Cited by 208
A quick guide to survey research
Misro, A., Hussain, M., Jones, T., Baxter, M., & Khanduja, V (2014) · The Annals of The Royal College of Surgeons of England · doi:10.1308/003588414x13824511649454 · Cited by 190
Describing reporting guidelines for health research: a systematic review
Moher, D., Weeks, L., Ocampo, M., Seely, D., Sampson, M., Altman, D. G., Schulz, K. F., Miller, D., Simera, I., Grimshaw, J., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.013 · Cited by 151
Cited by
Fritsch, S. J., Blankenheim, A., Wahl, A., Hetfeld, P., Maassen, O., Deffge, S., Kunze, J., Rossaint, R., Riedel, M., Marx, G., et al. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221116772 · Cited by 232
“The reporting is carried out according to the Consensus-Based Checklist for Reporting of Survey Studies (CROSS).(44)”
MethodDesigning, Conducting, and Reporting Survey Studies: A Primer for Researchers
Zimba, O., & Gasparyan, A. Y. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e403 · Cited by 198
“13 20 Precautions should be taken to avoid confidentiality breaches and bot activities when surveying via insecure online platforms.”
BackgroundPucchio, A., Rathagirishnan, R., Caton, N., Gariscsak, P. J., Del Papa, J., Nabhen, J. J., Vo, V., Lee, W., & Moraes, F. Y. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03896-5 · Cited by 138
“Survey design A 56 question survey was developed in accordance with the Consensus-Based Checklist for Reporting of Survey Studies (CROSS) guidelines for survey studies and coded in Microsoft Forms (Additional file 2 [9];).”
MethodWillmann, J., Appelt, A. L., Balermpas, P., et al. (2023) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2023.109947 · Cited by 82
Lokmic‐Tomkins, Z., Choo, D., Foley, P., Dix, S., Wong, P., & Brand, G. (2022) · Nurse Education Today · doi:10.1016/j.nedt.2022.105308 · Cited by 62
Metadata
- Authors
- Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., Karbwang, J., de Waure, C., Drummond, F. J., Kizawa, Y., Taal, E., Vermeulen, J., Lee, G. H. M., Gyedu, A., To, K. G., Verra, M. L., Jacqz-Aigrain, É. M., Leclercq, W. K. G., Salminen, S. T., Sherbourne, C. D., Mintzes, B., Lozano, S., Tran, U. S., Matsui, M., & Karamouzian, M.
- Affiliations
- University College of Medical Sciences (IN)
- Kyoto University (JP)
- Crozer-Keystone Health System (US)
- Alexandria University (EG)
- Nagasaki University (JP)
- University of Split (HR)
- University of Newcastle Australia (AU)
- Queen Mary Hospital (CN)
- University of Perugia (IT)
- University College Cork (IE)
- Kobe University (JP)
- University of Twente (NL)
- Vrije Universiteit Brussel (BE)
- University of Hong Kong (HK)
- Kwame Nkrumah University of Science and Technology (GH)
- University of Medicine and Pharmacy at Ho Chi Minh City (VN)
- University Hospital of Bern (CH)
- Assistance Publique – Hôpitaux de Paris (FR)
- Máxima Medisch Centrum (NL)
- University of Helsinki (FI)
- RAND Corporation (US)
- The University of Sydney (AU)
- Universitat de Barcelona (ES)
- University of Vienna (AT)
- University of British Columbia (CA)
- Corresponding author
- Huy, Nguyen Tien
- ORCID
- Sharma, Akash
- Minh Duc, Nguyen Tran
- Luu Lam Thang, Tai
- Nam, Nguyen Hai
- Ng, Sze Jia
- Abbas, Kirellos Said
- Huy, Nguyen Tien
- Marušić, Ana
- Paul, Christine L.
- Kwok, Janette
- Karbwang, Juntra
- de Waure, Chiara
- Drummond, Frances J.
- Kizawa, Yoshiyuki
- Taal, Erik
- Vermeulen, Joeri
- Lee, Gillian H. M.
- Gyedu, Adam
- To, Kien Gia
- Verra, Martin L.
- Jacqz-Aigrain, Évelyne M.
- Leclercq, Wouter K. G.
- Mintzes, Barbara
- Lozano, Sergi
- Tran, Ulrich S.
- Matsui, Mitsuaki
- Karamouzian, Mohammad
- Venue
- Journal of General Internal Medicine
- Published
- 2021-04-22
- Volume
- 36
- Issue
- 10
- Pages
- 3179-3187
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- PMC
- PMC8481359
- OpenAlex
- W3154790864
- Cited by
- 2,292
- References
- 35
- Citations by year
- 2026: 613 · 2025: 607 · 2024: 513 · 2023: 335 · 2022: 189 · 2021: 33
- FWCI
- 371.81
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Journal of General Internal Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, other-oa)
- Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (submittedVersion, public-domain)
- VUBIR (Vrije Universiteit Brussel) (submittedVersion)
- NOVA (University of Newcastle Australia) (submittedVersion)
- University of Twente Research Information (submittedVersion, other-oa)
- Funders
- Ottawa Hospital Research Institute
- University of Tokyo
- Keele University
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- reporting guidelines, survey studies, reporting checklist, checklist development, Delphi consensus, reporting bias, survey data collection, survey data analysis, survey data interpretation, survey reliability, survey ethics, EQUATOR Network, PRISMA, reporting quality
- MeSH terms
- Delphi Technique, Humans, Surveys and Questionnaires, Consensus, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Consensus-Based Checklist for Reporting of Survey Studies (CROSS). https://app.cochat.ai/papers/10.1007/s11606-021-06737-1
- The paper
- Sharma, A., Minh Duc, N. T., Luu Lam Thang, T., Nam, N. H., Ng, S. J., Abbas, K. S., Huy, N. T., Marušić, A., Paul, C. L., Kwok, J., Karbwang, J., de Waure, C., Drummond, F. J., Kizawa, Y., Taal, E., Vermeulen, J., Lee, G. H. M., Gyedu, A., To, K. G., . . . Karamouzian, M. (2021). A Consensus-Based Checklist for Reporting of Survey Studies (CROSS). Journal of General Internal Medicine. https://doi.org/10.1007/s11606-021-06737-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.