The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Open accessAbstract
BACKGROUND: Hundreds of studies of maternity care interventions have been published, too many for most people involved in providing maternity care to identify and consider when making decisions. It became apparent that systematic reviews of individual studies were required to appraise, summarise and bring together existing studies in a single place. However, decision makers are increasingly faced by a plethora of such reviews and these are likely to be of variable quality and scope, with more than one review of important topics. Systematic reviews (or overviews) of reviews are a logical and appropriate next step, allowing the findings of separate reviews to be compared and contrasted, providing clinical decision makers with the evidence they need. METHODS: The methods used to identify and appraise published and unpublished reviews systematically, drawing on our experiences and good practice in the conduct and reporting of systematic reviews are described. The process of identifying and appraising all published reviews allows researchers to describe the quality of this evidence base, summarise and compare the review's conclusions and discuss the strength of these conclusions. RESULTS: Methodological challenges and possible solutions are described within the context of (i) sources, (ii) study selection, (iii) quality assessment (i.e. the extent of searching undertaken for the reviews, description of study selection and inclusion criteria, comparability of included studies, assessment of publication bias and assessment of heterogeneity), (iv) presentation of results, and (v) implications for practice and research. CONCLUSION: Conducting a systematic review of reviews highlights the usefulness of bringing together a summary of reviews in one place, where there is more than one review on an important topic. The methods described here should help clinicians to review and appraise published reviews systematically, and aid evidence-based clinical decision-making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, conducting systematic reviews and meta-analyses is time-consuming and resource-intensive, with some studies estimating up to 72 weeks of skilled labor in the health sciences (Smith et al., 2011).”
From Screening Smarter, Not Harder: A Comparative Analysis of Machine Learning Screening Algorithms and Heuristic Stopping Criteria for Systematic Reviews in Educational Research (2024) · cites this paper as Smith et al., 2011
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Furthermore, many reviewers nowadays move towards metareviews when analysing very large literature streams, that is, systematic reviews of systematic reviews 37 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“As shown below, the Cochrane Collaboration methodology [11] and available methodological guidelines for overviews of reviews [12,13] were rigorously applied throughout this study.”
From Effects of Home Telemonitoring Interventions on Patients With Chronic Heart Failure: An Overview of Systematic Reviews (2015) · cites this paper as [12]
In the citing paper
“A systematic review of reviews provides a summary of evidence from a variety of different levels, including the combination of different interventions, different populations and different settings [10] in a coherent and economical way [7].”
From Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update) (2016) · cites this paper as [10]
In the citing paper
“Methodology for this overview followed recognised guidance for conducting systematic overviews 14, 15 .”
From An overview of systematic reviews on the public health consequences of social isolation and loneliness (2017) · cites this paper as [15]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Pharmaceutical policies: effects on rational drug use
Aaserud, M., Dahlgren, A., Sturm, H., Kösters, J. P., Hill, S. R., Furberg, C. D., Grilli, R. G., Henry, D. A., Oxman, A. D., Ramsay, C. R., et al. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004397.pub2 · Cited by 40
RetractedLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Pharmacological interventions for somatoform disorders in adults
Kleinstäuber, M., Witthöft, M., Steffanowski, A., van Marwijk, H., Hiller, W., & Lambert, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010628.pub2 · Cited by 11,335
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Cochrane Database of Systematic Reviews
(2008) · Encyclopedia of Public Health · doi:10.1007/978-1-4020-5614-7_436 · Cited by 4,527
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The Cochrane Database of Systematic Reviews
Handoll, H. H., Howe, T. E., & Madhok, R. (2002) · Physiotherapy · doi:10.1016/s0031-9406(05)60709-2 · Cited by 1,497
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 1×
“In recent years however, decision makers who were once overwhelmed by the number of individual studies have become faced by a plethora of reviews [4,5].”
Cited by
Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000055 · Cited by 2,587
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Leigh-Hunt, N., Bagguley, D., Bash, K., Turner, V., Turnbull, S., Valtorta, N., & Caan, W. (2017) · Public Health · doi:10.1016/j.puhe.2017.07.035 · Cited by 2,158
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
Systematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318
The impact of mHealth interventions: systematic review of systematic reviews
Marcolino, M. S., Oliveira, J. A. Q., D'Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo-Ortiz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8873 · Cited by 1,163
Metadata
- Authors
- Smith, V., Devane, D., Begley, C. M., & Clarke, M.
- Affiliations
- Trinity College Dublin (IE)
- Ollscoil na Gaillimhe – University of Galway (IE)
- National Institute for Health and Care Research (GB)
- Corresponding author
- Smith, Valerie
- Venue
- BMC Medical Research Methodology
- Published
- 2011-02-03
- Volume
- 11
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3039637
- OpenAlex
- W2111011000
- Cited by
- 1,227
- References
- 42
- Citations by year
- 2026: 54 · 2025: 83 · 2024: 125 · 2023: 137 · 2022: 117 · 2021: 128 · 2020: 121 · 2019: 67 · 2018: 78 · 2017: 81 · 2016: 79 · 2015: 54 · 2014: 46 · 2013: 34 · 2012: 17
- FWCI
- 7.83
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion, cc-by-nc-sa)
- ARAN (University of Galway Research Repository) (Ollscoil na Gaillimhe – University of Galway) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Trinity's Access to Research Output (TARA) (Trinity College Dublin) (submittedVersion)
- Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion)
- Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- overviews of reviews, evidence appraisal, publication bias, heterogeneity, study selection, quality assessment, evidence-based clinical decision-making
- MeSH terms
- Systematic Reviews as Topic, Female, Health Services Research, Humans, Maternal Health Services, Meta-Analysis as Topic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodology in conducting a systematic review of systematic reviews of healthcare interventions. https://app.cochat.ai/papers/10.1186/1471-2288-11-15
- The paper
- Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011). Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-11-15
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.