The methodological quality of systematic reviews published in high‐impact nursing journals: a review of the literature
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Aims and objectives: To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Background: Systematic review is defined as a scientific research method that synthesises high‐quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. Design: A review of the literature using a narrative approach. Methods: Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms ‘systematic review’ and ‘systematic literature review’. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Results: Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. Conclusion: The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high‐impact factor. Relevance to clinical practice: Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Simulation‐based learning in nurse education: systematic review
Cant, R. P., & Cooper, S. J. (2010) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05240.x · Cited by 984 · cited 1×
“…British Nursing Index EMBASE PSYCHIATRY International Bibliography of Social Sciences PsychINFO Ageinfo Manual and other searches PRISMA guidelines Cant & Cooper (2010) Australia 12 Experimental (n = 11), and quasi-experimental (n = 1) CINAHL Plus ERIC EMBASE MEDLINE SCOPUS ProQuest…”
BackgroundCook, D. J., Sackett, D. L., & Spitzer, W. O. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00172-m · Cited by 573
Systematic Reviews from Astronomy to Zoology: Myths and Misconceptions
Petticrew, M. (2001) · BMJ · doi:10.1136/bmj.322.7278.98 · Cited by 550
Dixon-Woods, M., Sutton, A., Shaw, R., Miller, T., Smith, J., Young, B., Bonas, S., Booth, A., & Jones, D. (2007) · Journal of Health Services Research & Policy · doi:10.1258/135581907779497486 · Cited by 546
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Grey Literature in Meta-Analyses
Conn, V. S., Valentine, J. C., Cooper, H. M., & Rantz, M. J. (2003) · Nursing Research · doi:10.1097/00006199-200307000-00008 · Cited by 400 · cited 3×
“In addition, grey literature (i.e. publications not included in computerised bibliographic retrieval systems) may be difficult to obtain, causing publication bias (Petticrew 2001, Conn et al. 2003, Petticrew & Roberts 2006).”
BackgroundNurses’ role in detecting deterioration in ward patients: systematic literature review
Odell, M., Victor, C., & Oliver, D. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05109.x · Cited by 291
Bridges, J., Flatley, M., & Meyer, J. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.09.009 · Cited by 255
Allen, J. K., & Dennison, C. R. (2010) · Journal of Cardiovascular Nursing · doi:10.1097/jcn.0b013e3181cc79be · Cited by 84
Cited by
Reviewing the methodology of an integrative review
Hopia, H., Latvala, E., & Liimatainen, L. (2016) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.12327 · Cited by 459
Denicol, J., Davies, A., & Krystallis, I. (2020) · Project Management Journal · doi:10.1177/8756972819896113 · Cited by 266
Meert, D., Torabi, N., & Costella, J. (2016) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.104.4.004 · Cited by 108
Integrative Review of Emotional Care Following Perinatal Loss
Furtado-Eraso, S., Escalada-Hernández, P., & Marín-Fernández, B. (2021) · Western Journal of Nursing Research · doi:10.1177/0193945920954448 · Cited by 51
Metadata
- Authors
- Pölkki, T., Kanste, O., Kääriäinen, M., Elo, S., & Kyngäs, H.
- Venue
- Journal of Clinical Nursing
- Publisher
- Wiley
- Published
- 2013-03-13
- Volume
- 23
- Issue
- 3-4
- Pages
- 315-332
- ISSN
- 0962-1067 (ISSN-L)
- 1365-2702
- OpenAlex
- W2082317090
- Cited by
- 41
- References
- 10
- FWCI
- 0.85
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.