Research methods: Managing primary study quality in meta‐analyses
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Meta‐analyses synthesize multiple primary studies and identify patterns of relationships. Differences in primary study methodological quality must be addressed for meta‐analysis to produce meaningful results. No single standard exists for addressing these quality variations. Quality measurement scales are fraught with development and application problems. Several strategies have been proposed to address quality. Researchers can set minimum levels for inclusion or require that certain quality attributes be present. An inclusive method is to weight effect sizes by quality scores. This allows the inclusion of diverse studies but relies on questionable quality measures. By considering quality an empirical question, meta‐analysts can examine associations between quality and effect sizes and thus preserve the purpose of meta‐analysis to systematically examine data. Researchers increasingly are combining strategies to overcome the limitations of using a single approach. Future work to develop valid measures of primary study quality dimensions will improve the ability of meta‐analysis to inform research and nursing practice. © 2003 Wiley Periodicals, Inc. Res Nurs Health 26:322–333, 2003
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Morley, S., Eccleston, C., & Williams, A. (1999) · Pain · doi:10.1016/s0304-3959(98)00255-3 · Cited by 1,597
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Bias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640
Cited by
The integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241
Coping flexibility and psychological adjustment to stressful life changes: A meta-analytic review.
Cheng, C., Lau, H.-P. B., & Chan, M.-P. S. (2014) · Psychological Bulletin · doi:10.1037/a0037913 · Cited by 664
“The studies included in any meta-analysis vary considerably in terms of methodological rigor, and those with methodological flaws are likely to bias the overall findings (see e.g., Conn & Rantz, 2003).”
BackgroundUsing qualitative metasummary to synthesize qualitative and quantitative descriptive findings
Sandelowski, M., Barroso, J., & Voils, C. I. (2007) · Research in Nursing & Health · doi:10.1002/nur.20176 · Cited by 528
(2006) · PubMed · Cited by 485
Koch, S., Kunz, T., Lykou, S., & Cruz, R. (2014) · The Arts in Psychotherapy · doi:10.1016/j.aip.2013.10.004 · Cited by 349
Combining Evidence in Nursing Research: Methods and Implications
Whittemore, R. (2005) · Nursing Research · doi:10.1097/00006199-200501000-00008 · Cited by 334
Effects of Exercise Interventions on Body Image: A Meta-analysis
Campbell, A., & Hausenblas, H. A. (2009) · Journal of Health Psychology · doi:10.1177/1359105309338977 · Cited by 320
Murray, J., Farrington, D. P., & Eisner, M. P. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-008-9066-0 · Cited by 280
Interventions to Increase Physical Activity Among Older Adults: A Meta-Analysis
Chase, J.-A. D. (2015) · The Gerontologist · doi:10.1093/geront/gnu090 · Cited by 215
“Recommendations for managing primary study quality in meta-analysis work are diverse (Conn & Rantz, 2003; Valentine, 2009).”
BackgroundFarrand, P., & Woodford, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.11.001 · Cited by 125
Three risk of bias tools lead to opposite conclusions in observational research synthesis
Losilla, J.-M., Oliveras, I., Marin-Garcia, J. A., & Vives, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.05.021 · Cited by 111
Self-Help Interventions for Psychosis: A Meta-Analysis
Scott, A. J., Webb, T. L., & Rowse, G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.05.002 · Cited by 33
Methodological quality is underrated in systematic reviews and meta-analyses in health psychology
Oliveras, I., Losilla, J.-M., & Vives, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.002 · Cited by 15
Lobo, V., Fisher, A., Peachey, G., Ploeg, J., & Akhtar‐Danesh, N. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12560 · Cited by 8
Metadata
- Authors
- Conn, V. S., & Rantz, M. J.
- Venue
- Research in Nursing & Health
- Publisher
- Wiley
- Published
- 2003-07-21
- Volume
- 26
- Issue
- 4
- Pages
- 322-333
- ISSN
- 0160-6891 (ISSN-L)
- 1098-240X
- OpenAlex
- W2052107730
- Cited by
- 115
- References
- 16
- FWCI
- 4.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.