The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Conducting quantitative synthesis when comparing medical interventions: AHRQ and the Effective Health Care Program
Abstract
Objective This article is to establish recommendations for conducting quantitative synthesis, or meta-analysis, using study-level data in comparative effectiveness reviews (CERs) for the Evidence-based Practice Center (EPC) program of the Agency for Healthcare Research and Quality.Study design and setting We focused on recurrent issues in the EPC program and the recommendations were developed using group discussion and consensus based on current knowledge in the literature.Results We first discussed considerations for deciding whether to combine studies, followed by discussions on indirect comparison and incorporation of indirect evidence. Then, we described our recommendations on choosing effect measures and statistical models, giving special attention to combining studies with rare events; and on testing and exploring heterogeneity. Finally, we briefly presented recommendations on combining studies of mixed design and on sensitivity analysis.Conclusion Quantitative synthesis should be conducted in a transparent and consistent way. Inclusion of multiple alternative interventions in CERs increases the complexity of quantitative synthesis, whereas the basic issues in quantitative synthesis remain crucial considerations in quantitative synthesis for a CER. We will cover more issues in future versions and update and improve recommendations with the accumulation of new research to advance the goal for transparency and consistency.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, inadequate statistical power for subgroup analyses was noted. Several subgroups (such as intervention durations for ALM) included a small number of RCTs (less than six), which may not have adequate power for detecting differences among subgroups [71,72]; the results of such subgroup analyses should be cautiously interpreted.”
In the citing paper
“Several subgroups (such as participant types for lean body mass) included a small number of RCTs less than six, which may not have adequate power for detecting a difference among subgroups [89,90]; the results of such subgroup analyses should be cautiously interpreted.”
From Effects of Protein Supplementation Combined with Exercise Intervention on Frailty Indices, Body Composition, and Physical Function in Frail Older Adults (2018) · cites this paper as [89]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Practical methods for incorporating summary time-to-event data into meta-analysis.
Tierney, J. F., Stewart, L. A., Ghersi, D., Burdett, S., & Sydes, M. R. (2007) · Trials · doi:10.1186/1745-6215-8-16 · Cited by 6,208
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Effect of Rosiglitazone on the Risk of Myocardial Infarction and Death from Cardiovascular Causes
Nissen, S. E., & Wolski, K. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa072761 · Cited by 4,675
Parmar, M. K. B., Torri, V., & Stewart, L. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19981230)17:24 · Cited by 4,519
Cited by
Sorted by citations
Items 701–728 of 728
Alcaraz-Ibáñez, M., Paterna, A., Diaz-Carrasco, A. F., Sicilia, Á., & Griffiths, M. D. (2026) · Scandinavian Journal of Psychology · doi:10.1111/sjop.70097
Li, W., Chong, Z. Y., Mao, Y., & Xu, W. (2026) · Journal of Youth and Adolescence · doi:10.1007/s10964-026-02358-1
Støve, L. L., Dalgaard, N. T., Mohr, J. E. W., Hansen, J. E., Wendelboe, K. I., Hestbæk, E., Vieira, C. C., Væver, M. S., & Smith‐Nielsen, J. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10162-3 · Cited by 2
Daniel, K. S., Sari, S. P., & Ardi, A. (2026) · F1000Research · doi:10.12688/f1000research.180597.1
The Effects of Family Sports on Mental Health in Children and Adolescents: A Meta-Analysis
Peng, S., Li, C., Wang, J., & Wang, S. (2026) · Behavioral Sciences · doi:10.3390/bs16050776
Association Between Interpersonal Relationships and Academic Achievement: A Multilevel Meta-Analysis
Ding, Y., Zhou, T., Li, X., Yu, R., & Chen, N. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10182-z · Cited by 1
Deilhaug, E., Moerkerke, M., Sartorius, A. M., Kang, H., Kildal, E. S.-M., Walle, K. M., Elvsåshagen, T., Westlye, L. T., Nærland, T., Andreassen, O. A., et al. (2026) · Psychophysiology · doi:10.1111/psyp.70334
Attractive Things Do Work Better: A Meta-Analysis on Visual Aesthetics and User Performance
Schlamann, M., Nestler, S., & Thielsch, M. T. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2664081 · Cited by 1
A Meta-Analysis of Inhibitory Control’s Effect on Code-Switching Comprehension
Chang, X., Ni, H., Su, F., & Wang, P. (2026) · International Journal of Bilingualism · doi:10.1177/13670069261444812
Liang, J., Yu, L., Wu, S., & Tong, X. (2026) · Reading and Writing · doi:10.1007/s11145-026-10879-1
Anderson, G., Preziosi, J., Gabrielli, G., Proia, S., Anderson, G., Rizzi, F., Salvi, S., Durante, Á., Rega, M. L., Colaceci, S., et al. (2026) · Journal of Human Lactation · doi:10.1177/08903344261451214
Karska, J., Kowalski, S., Rudy, K., Szyszka, M., Lewicka, W., Enrico, P., Drexhage, H. A., Pawlak, E., Piotrowski, P., & Misiak, B. (2026) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2026.106934
Goulet, J., Archambault, I., Maltais, C., Gilbert-Blanchard, O., & Janosz, M. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10204-w · Cited by 1
Yu, L., Liu, D., Payne, J. M., Thompson, H. L., Wu, X., Moreira, J. P., Morey, L., Peper, M., Iroff, H., Mujica, B. F., et al. (2026) · Neuropsychology Review · doi:10.1007/s11065-026-09698-6
Problematic videogame use and academic achievement: A systematic review and meta-analysis
Paterna, A., Alcaraz‐Ibáñez, M., Diaz‐Carrasco, A. F., & Griffiths, M. D. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100835
Favro, F., Beratto, L., Gobbo, S., Rainoldi, A., Capuzzo, A., Bullo, V., Bergamin, M., & Mulasso, A. (2026) · Applied Ergonomics · doi:10.1016/j.apergo.2026.104874
The Association Between Internet Gaming Disorder and Resilience: A Meta-Analysis
Hidalgo-Fuentes, S., Martínez-Álvarez, I., & González-Pérez, E. (2026) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-026-01715-2
Rajasankar, V., Chen, C. A., Kang, T., Gutiérrez, J. M. G., Giovannone, N., Medrano, M., Restar, A., Operario, D., Guy, A. A., & Sun, S. (2026) · Nature Mental Health · doi:10.1038/s44220-026-00713-6
Cong, Q., van Geel, M., Zhao, X., & Vedder, P. H. (2026) · Trauma Violence & Abuse · doi:10.1177/15248380261476689
Resilience and Overload in Caregivers of Dependent Persons: a Systematic Review and Meta-Analysis
Andrés-Pérez, F., Bru-Luna, L. M., Hidalgo-Fuentes, S., & Vilar, M. M. (2026) · Adversity and Resilience Science · doi:10.1007/s42844-026-00245-z
Ye, Z., Yalikun, S., Isak, G., Li, Y., Du, X., Hu, J., & Ren, Z. (2026) · Trauma Violence & Abuse · doi:10.1177/15248380261476086
Allami, Y., Michaud, A., Bőthe, B., Kim, H. S. A., Williams, R. J., & Hodgins, D. C. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102803
Gestiardi, R., & Yuniawatika, Y. (2026) · The Internet and Higher Education · doi:10.1016/j.iheduc.2026.101119
Chen, B., Cui, X., Feng, M., Qu, A., Wang, H., Zhang, H., & Zhang, L. (2026) · Public Health · doi:10.1016/j.puhe.2026.106517
Neves, V. V., Larbi, N. A. O. O., Acabchuk, R. L., Haygood, L. N., Rajasankar, V., Goldberg, S. B., Sun, S., Hoge, E. A., Brewer, J. A., Li, C., et al. (2026) · medRxiv · doi:10.64898/2026.10.21.26366048
The Association of Gender and Socioeconomic Position with Cardiorespiratory Fitness in Adolescents
Oliphant, Q. (2015) · ScholarWorks (Walden University)
Feikin, D. R., Higdon, M. M., Abu-Raddad, L. J., Andrews, N., & Araos, R. (2023) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(23)00015-6
Metadata
- Authors
- Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., Santaguida, P., Lau, J., & Trikalinos, T. A.
- Affiliations
- Oregon Health & Science University (US)
- Universität für Weiterbildung Krems (AT)
- Blue Cross Blue Shield Association (US)
- University of Minnesota (US)
- Agency for Healthcare Research and Quality (US)
- McMaster University (CA)
- Tufts Medical Center (US)
- Corresponding author
- Fu, Rongwei
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2011-11
- Volume
- 64
- Issue
- 11
- Pages
- 1187-1197
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2145171366
- Cited by
- 730
- References
- 62
- Citations by year
- 2026: 46 · 2025: 64 · 2024: 88 · 2023: 75 · 2022: 99 · 2021: 92 · 2020: 56 · 2019: 50 · 2018: 29 · 2017: 27 · 2016: 33 · 2015: 26 · 2014: 18 · 2013: 13 · 2012: 10
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Agency for Healthcare Research and Quality
- H2020 European Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- meta-analysis, comparative effectiveness research, evidence-based practice centers, Agency for Healthcare Research and Quality, indirect comparison, effect measures, rare events, heterogeneity, sensitivity analysis
- MeSH terms
- Data Interpretation, Statistical, Humans, Review Literature as Topic, Statistics as Topic, United States, Meta-Analysis as Topic, Models, Statistical, Bias, United States Agency for Healthcare Research and Quality, Outcome Assessment, Health Care, Evidence-Based Medicine, Consensus, Comparative Effectiveness Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
