The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Sequential methods for random‐effects meta‐analysis
Open accessAbstract
Although meta‐analyses are typically viewed as retrospective activities, they are increasingly being applied prospectively to provide up‐to‐date evidence on specific research questions. When meta‐analyses are updated account should be taken of the possibility of false‐positive findings due to repeated significance tests. We discuss the use of sequential methods for meta‐analyses that incorporate random effects to allow for heterogeneity across studies. We propose a method that uses an approximate semi‐Bayes procedure to update evidence on the among‐study variance, starting with an informative prior distribution that might be based on findings from previous meta‐analyses. We compare our methods with other approaches, including the traditional method of cumulative meta‐analysis, in a simulation study and observe that it has Type I and Type II error rates close to the nominal level. We illustrate the method using an example in the treatment of bleeding peptic ulcers. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 2×
“This can be achieved using a predictive interval for the effect in a new study, which takes into account both the mean and variance 2 of effects [24].”
BackgroundSelf-citationA modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Group Sequential Methods with Applications to Clinical Trials
Jennison, C., & Turnbull, B. W. (1999) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367805326 · Cited by 1,336
Brok, J., Thorlund, K., Gluud, C., & Wetterslev, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.007 · Cited by 1,113
Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events
Bradburn, M. J., Deeks, J. J., Berlin, J. A., & Russell Localio, A. (2007) · Statistics in Medicine · doi:10.1002/sim.2528 · Cited by 938
A general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750
Self-citationGroup Sequential Methods with Applications to Clinical Trials
Kim, K. (2001) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00127-6 · Cited by 706
BORROWING STRENGTH FROM EXTERNAL TRIALS IN A META-ANALYSIS
HIGGINS, J. P. T., & WHITEHEAD, A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961230)15:24<2733::aid-sim562>3.0.co;2-0 · Cited by 557
Self-citationA LIKELIHOOD APPROACH TO META-ANALYSIS WITH RANDOM EFFECTS
HARDY, R. J., & THOMPSON, S. G. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960330)15:6<619::aid-sim188>3.0.co;2-a · Cited by 522
The Design and Analysis of Sequential Clinical Trials.
Whitehead, J. (1997) · Biometrics · doi:10.2307/2533535 · Cited by 516
Devereaux, P. J., Beattie, W. S., Choi, P. T.-L., Badner, N. H., Guyatt, G. H., Villar, J. C., Cinà, C. S., Leslie, K., Jacka, M. J., Montori, V. M., et al. (2005) · BMJ · doi:10.1136/bmj.38503.623646.8f · Cited by 438
Pogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00051-2 · Cited by 415
Schunkert, H., Götz, A., Braund, P., McGinnis, R., Tregouet, D.-A., Mangino, M., Linsel-Nitschke, P., Cambien, F., Hengstenberg, C., Stark, K., et al. (2008) · Circulation · doi:10.1161/circulationaha.107.730614 · Cited by 387
Endoscopic hemostasis. An effective therapy for bleeding peptic ulcers
Sacks, H. S. (1990) · JAMA · doi:10.1001/jama.264.4.494 · Cited by 294
INCORPORATING VARIABILITY IN ESTIMATES OF HETEROGENEITY IN THE RANDOM EFFECTS MODEL IN META-ANALYSIS
BIGGERSTAFF, B. J., & TWEEDIE, R. L. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970415)16:7<753::aid-sim494>3.0.co;2-g · Cited by 272
Interim Analyses: The Repeated Confidence Interval Approach
Jennison, C., & Turnbull, B. W. (1989) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1989.tb01433.x · Cited by 244
Endoscopic Hemostasis: An Effective Therapy for Bleeding Peptic Ulcers
Sacks, H. S. (1990) · JAMA · doi:10.1001/jama.1990.03450040090037 · Cited by 199
Effect Measures for Meta‒Analysis of Trials with Binary Outcomes
Deeks, J. J., & Altman, D. G. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch16 · Cited by 170
Evidence‐based sample size calculations based upon updated meta‐analysis
Sutton, A. J., Cooper, N. J., Jones, D. R., Lambert, P. C., Thompson, J. R., & Abrams, K. R. (2006) · Statistics in Medicine · doi:10.1002/sim.2704 · Cited by 144
Empirical vs natural weighting in random effects meta‐analysis
Shuster, J. J. (2009) · Statistics in Medicine · doi:10.1002/sim.3607 · Cited by 125
Comparison of Bayesian with group sequential methods for monitoring clinical trials
Freedman, L. S., & Spiegelhalter, D. J. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90001-9 · Cited by 124
Sims, A.-M., Timms, A. E., Bruges‐Armas, J., et al. (2007) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2007.081364 · Cited by 121
Meta-analytic stimulus for changes in clinical trials
Harvard, T. C., & Lau, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200204 · Cited by 115
Interim analyses in clinical trials: Classical vs. bayesian approaches
Berry, D. A. (1985) · Statistics in Medicine · doi:10.1002/sim.4780040412 · Cited by 112
Uncertainty of the time of first significance in random effects cumulative meta-analysis
Berkey, C. S., Mosteller, F. C., Lau, J., & Antman, E. M. (1996) · Controlled Clinical Trials · doi:10.1016/s0197-2456(96)00014-1 · Cited by 77
A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials
Whitehead, A. (1997) · Statistics in Medicine · Cited by 66
Self-citationHu, M., Cappelleri, J. C., & Lan, K. K. G. (2007) · Clinical Trials · doi:10.1177/1740774507081219 · Cited by 61
Simes, R. J., & The PPP and CTT Investigators (1995) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)80482-2 · Cited by 59
Maintaining Reviews: Updates, Amendments and Feedback
Higgins, J. P., Green, S., & Scholten, R. J. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch3 · Cited by 54
Self-citationStallard, N., & Facey, K. M. (1996) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543409608835149 · Cited by 33
APPLYING THE LAW OF ITERATED LOGARITHM TO CUMULATIVE META-ANALYSIS OF A CONTINUOUS ENDPOINT
Lan, K. K. G., Hu, M., & Cappelleri, J. C. (2003) · Cited by 29
Comments on ‘Empirical vs natural weighting in random effects meta‐analysis’
Laird, N. M., Fitzmaurice, G. M., & Ding, X. X. (2010) · Statistics in Medicine · doi:10.1002/sim.3657 · Cited by 13
Sequential Meta-analysis of Past Clinical Trials to Determine the Use of a New Trial
Bollen, C. W., Uiterwaal, C. S. P. M., van Vught, A. J., & van der Tweel, I. (2006) · Epidemiology · doi:10.1097/01.ede.0000239658.19288.22 · Cited by 10
Comments on ‘Empirical vs natural weighting in random effects meta‐analysis’
Thompson, S. G., & Higgins, J. P. T. (2010) · Statistics in Medicine · doi:10.1002/sim.3718 · Cited by 9
Self-citationComments on ‘Empirical vs natural weighting in random effects meta‐analysis’
Waksman, J. A. (2010) · Statistics in Medicine · doi:10.1002/sim.3692 · Cited by 8
Research works printed but not linked: 7
- The Cochrane Collaboration, 2010, The Cochrane Library
- 10.1093/bja/81.5.713 · doi:10.1093/bja/81.5.713
- 10.1002/(SICI)1097‐0258(19971230)16:24 <2901::AID‐SIM700 >3.0.CO;2‐5 · doi:10.1002/(sici)1097-0258(19971230)16:24
- 2000, PEST 4
- 10.1002/(SICI)1097‐0258(19970415)16:7 <753::AID‐SIM494 >3.0.CO;2‐G · doi:10.1002/(sici)1097-0258(19970415)16:7
- 10.1002/(SICI)1097‐0258(19960330)15:6 <619::AID‐SIM188 >3.0.CO;2‐A · doi:10.1002/(sici)1097-0258(19960330)15:6
- 10.1002/(SICI)1097‐0258(19961230)15:24 <2733::AID‐SIM562 >3.0.CO;2‐0 · doi:10.1002/(sici)1097-0258(19961230)15:24
Cited by
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Chatterjee, S., Chakraborty, A., Weinberg, I., Kadakia, M., Wilensky, R. L., Sardar, P., Kumbhani, D. J., Mukherjee, D., Jaff, M. R., & Giri, J. (2014) · JAMA · doi:10.1001/jama.2014.5990 · Cited by 818
Jakobsen, J. C., Wetterslev, J., Winkel, P., Lange, T., & Gluud, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-120 · Cited by 704
Living systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655
Self-citationLiving Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596
Self-citation
Metadata
- Authors
- Higgins, J. P. T., Whitehead, A., & Simmonds, M.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2010-12-28
- Volume
- 30
- Issue
- 9
- Pages
- 903-921
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2104634108
- Cited by
- 258
- References
- 42
- FWCI
- 10.26
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- onlinelibrary.wiley.com/termsAndConditions#vor (vor)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Funders
- Re-use of this article is permitted in accordance with the Terms and Conditions set out at [http://wileyonlinelibrary.com/author resources/onlineopen.html]
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.