The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index; 10 of the 104 sources its claims cite were checked for support.
COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology
Open accessAbstract
BACKGROUND: To our knowledge, no publication providing overarching guidance on the conduct of systematic reviews of observational studies of etiology exists. METHODS AND FINDINGS: Conducting Systematic Reviews and Meta-Analyses of Observational Studies of Etiology (COSMOS-E) provides guidance on all steps in systematic reviews of observational studies of etiology, from shaping the research question, defining exposure and outcomes, to assessing the risk of bias and statistical analysis. The writing group included researchers experienced in meta-analyses and observational studies of etiology. Standard peer-review was performed. While the structure of systematic reviews of observational studies on etiology may be similar to that for systematic reviews of randomised controlled trials, there are specific tasks within each component that differ. Examples include assessment for confounding, selection bias, and information bias. In systematic reviews of observational studies of etiology, combining studies in meta-analysis may lead to more precise estimates, but such greater precision does not automatically remedy potential bias. Thorough exploration of sources of heterogeneity is key when assessing the validity of estimates and causality. CONCLUSION: As many reviews of observational studies on etiology are being performed, this document may provide researchers with guidance on how to conduct and analyse such reviews.
Overview
CoChat Summary
TL;DR
COSMOS-E is an expert guidance document for conducting systematic reviews and meta-analyses of observational studies of etiology, covering all steps from question formulation to interpretation. It stresses that meta-analysis may improve precision but does not automatically remedy confounding, selection bias, or information bias, so heterogeneity and risk of bias must be explored.
Key findings
- No overarching guidance on systematic reviews of observational studies of etiology existed to the authors’ knowledge; COSMOS-E addresses all review steps, including PECO definition, protocol, search, data extraction, bias assessment, meta-analysis, and interpretation.
- In 2014, of about 8,000 systematic reviews published, 36% were on etiology, prognosis, or diagnosis; reviews of observational studies typically include 10 to 20 studies.
- Bias assessment should distinguish confounding, selection bias, information bias, and study sensitivity; more than 80 tools exist for assessing risk of bias in nonrandomised studies, and 30%–50% of studies indexed as “case-control studies” in specialty journals are not actually case-control studies.
- Combining studies in meta-analysis may lead to more precise estimates, but “greater precision does not automatically remedy potential bias”; thorough exploration of heterogeneity is key when assessing validity and causality.
Methods
- Guidance was developed by a writing group of researchers experienced in meta-analyses and observational studies of etiology; no external advice was sought, and standard peer-review was performed.
- The document is not formally a guideline and does not prescribe how researchers must perform or report reviews; it covers basic principles and advanced topics but excludes systematic reviews of nonrandomised studies of interventions, or of diagnostic, prognostic, or genetic studies.
- No empirical data collection or meta-analysis was performed; recommendations are based on theoretical considerations, empirical work, and experience with assessing risk of bias in RCTs and other studies.
Limitations
- The paper states that COSMOS-E is not formally meant to be a guideline, does not formally prescribe conduct or reporting, and will not settle ongoing debates and controversies around reviews of observational studies of etiology.
- The paper states that no external advice was sought and that standard peer-review was performed.
- Evident from the text: the recommendations are expert guidance rather than a systematic review or empirical validation of methods, and the authors note that the “roadmap” for observational reviews is less standardised and some design issues are not settled.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Flow chart of study selection. From [15].](https://figures.cochat.ai/paper-figures/b0d6cff55ef043e1b23baa2d5394d204/cosmos-e-guidance-on-conducting-systematic-reviews-and-meta-analyses-of-figure-1.jpg)

![Fig 3 Illustration of the ecological fallacy. Hypothetical example of aggregate and individual level CD4 cell count data at the start of ART. Adapted from [83]. ART, antiretroviral therapy.](https://figures.cochat.ai/paper-figures/fef53086551b4ddd9ed09136439a4a89/cosmos-e-guidance-on-conducting-systematic-reviews-and-meta-analyses-of-figure-3.jpg)
Verification
Claims the paper makes
9 Valid · 8 Not valid · 78 Not checked · 73 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A related issue arises when the selection of the study population or statistical model is chosen based on the P value (‘P hacking’) [64].”
§ COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology > Assessing quality and bias > Reporting biases, P hacking, and analytic choices
What the sources say
- Supportedcites [64] ML Head, 2015, The extent and consequences of p-hacking in science, PLoS Biol source
The paper’s discussion of p-hacking (section and page not identified in our copy) lists post-analysis decisions to drop outliers, change treatment groups, and include or exclude covariates. It also describes stopping data exploration when an analysis yields a significant p-value. These examples support the claim that choosing a study population or statistical model based on p-values is p-hacking. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“All of these models, including more advanced techniques such as propensity scores [46] or inverse probability weighting, rely on the assumption of no unmeasured confounding for the validity of the effect estimate.”
§ COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology > Assessing quality and bias > Risk of bias in individual studies: Confounding, selection bias, and information bias
What the sources say
- Supportedcites [46] PC Austin, 2011, An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies, Multivariate Behav Res source
The passage in 'THE PROPENSITY SCORE AND PROPENSITY SCORE METHODS' states that the first condition of strong ignorability is the 'no unmeasured confounders' assumption and that 'this is the crucial assumption that underlies propensity score analyses', conditioning on the score yielding unbiased average treatment effects only when it holds. The same section lists inverse probability of treatment weighting as one of the four propensity score methods (also in its IPTW subsection), so IPTW falls within what the assumption underlies; the passage adds that the assumption also underlies regression-based approaches, matching the citing sentence's broader framing about statistical models for confounding adjustment. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The studies included in a systematic review will generally vary with respect to design, study populations, and risk of bias [1].”
§ COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology > Exploring and exploiting heterogeneity
What the sources say
- Partly supportedcites [1] MJ Page, 2016, Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research, A Cross-Sectional Study. PLoS Med sourceExperimental — accuracy not yet measured
The Results section on study eligibility criteria says that some categories of systematic reviews included a range of study designs. The Results section on risk-of-bias assessment reports that many reviews assessed the quality of included studies, and the Discussion warns about synthesizing clinically heterogeneous studies. Neither establishes that studies within a systematic review generally vary in all three specified respects—design, study populations, and risk of bias. (LLM, conf=0.81)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subclinical or early disease might go undetected if such conditions are not ruled out explicitly.”
§ COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology > Preparing the systematic review > Defining population, exposure, contrast, and outcome
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviewers may develop precise definitions and criteria for exposure and outcomes, but if no single study used these definitions, the review will not be able to answer the research question.”
§ COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology > Preparing the systematic review > Defining population, exposure, contrast, and outcome
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
49 more claims
Create a free account to see all 168 claims and to verify the 94 references still open.
- Probably not a substantial claim. 91
- It may state two separate claims as one. 47
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“PRISMA 2020 is not intended to guide systematic review conduct, for which comprehensive resources are available.[43–46]”
From The PRISMA 2020 statement: An updated guideline for reporting systematic reviews (2021) · cites this paper as [44]
The cited source says what the claim attributes to it.
In the citing paper
“PRISMA 2020 is not intended to guide systematic review conduct, for which comprehensive resources are available [43–46].”
From The PRISMA 2020 statement: an updated guideline for reporting systematic reviews (2021) · cites this paper as [44]
In the citing paper
“El objetivo de la declaracio ´ n PRISMA 2020 no es orientar la realizacio ´ n de revisiones sistema ´ticas, para las que se dispone de varios recursos 42-45 .”
From Declaración PRISMA 2020: una guía actualizada para la publicación de revisiones sistemáticas (2021) · cites this paper as [43]
In the citing paper
“PRISMA 2020 is not intended to guide systematic review conduct, for which comprehensive resources are available [43-46] .”
From The PRISMA 2020 statement: An updated guideline for reporting systematic reviews (2021) · cites this paper as [44]
In the citing paper
“Case–control studies with less than ten matched-pairs were excluded due to the increased risk of bias (RoB) encountered in studies with sample sizes below this threshold”
From Risk-thresholds for the association between frequency of cannabis use and the development of psychosis: a systematic review and meta-analysis (2023) · cites this paper as Dekkers et al., 2019
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationStang, A. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9491-z · Cited by 17,396
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Cited by
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.105906 · Cited by 11,748
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003583 · Cited by 5,148
Metadata
- Authors
- Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M.
- Affiliations
- Leiden University Medical Center (NL)
- University of Bern (CH)
- University of Manchester (GB)
- University of Oxford (GB)
- Corresponding author
- Dekkers, Olaf M.
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-02-21
- Volume
- 16
- Issue
- 2
- Pages
- e1002742
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC6383865
- OpenAlex
- W2917632902
- Semantic Scholar
- 4fda707b38de63950725cb84e6342baa4ffd57e7
- Cited by
- 525
- References
- 105
- Citations by year
- 2026: 45 · 2025: 78 · 2024: 101 · 2023: 79 · 2022: 63 · 2021: 93 · 2020: 53 · 2019: 13
- FWCI
- 11.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation
- Sanofi
- Cancer Research UK (16895)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (174281)
- Novo Nordisk
- Sanofi Pasteur
- Cilag
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- meta-analysis, risk of bias assessment, confounding, selection bias, information bias, heterogeneity, causality, research question formulation
- MeSH terms
- Systematic Reviews as Topic, Humans, Meta-Analysis as Topic, Selection Bias, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology. https://app.cochat.ai/papers/10.1371/journal.pmed.1002742
- The paper
- Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019). COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology. PLOS Medicine. https://doi.org/10.1371/journal.pmed.1002742
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.