Development of a combined database for meta‐epidemiological research
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Collections of meta‐analyses assembled in meta‐epidemiological studies are used to study associations of trial characteristics with intervention effect estimates. However, methods and findings are not consistent across studies. To combine data from 10 meta‐epidemiological studies into a single database, and derive a harmonized dataset without overlap between meta‐analyses. The database design allowed trials to be contained in different meta‐analyses, multiple meta‐analyses in systematic reviews, overlapping meta‐analyses between systematic reviews, and multiple references to the same trial or review. Unique identifiers were assigned to each reference and used to identify duplicate trials. Sets of meta‐analyses with overlapping trials were identified and duplicates removed. Overlapping trials were used to examine agreement between assessments of trial characteristics. The combined database contained 427 reviews, 454 meta‐analyses and 4874 trial results. Of these, 258 meta‐analyses were unique, while for 196 at least one trial overlapped with another meta‐analysis. Median kappa statistics for reliability of assessments were 0.60 for sequence generation, 0.58 for allocation concealment and 0.87 for blinding. Based on inspection of sets of overlapping meta‐analyses, 91 meta‐analyses containing 1344 trial results were removed. Additionally, 24 duplicated trial results were removed from 16 meta‐analyses, to derive a final database containing 363 meta‐analyses and 3477 unique trial results. The final database will be used to examine the combined evidence on sources of bias in randomized controlled trials. The strategy used to remove overlap between meta‐analyses may be of use for future empirical research. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 1×
“Bias may arise because of selective reporting of whole trials or of outcomes within trials (Chan et al., 2004; Dickersin et al., 1992; Hopewell et al., 2009; Scherer et al., 2007), or because of methodological flaws in trial conduct that compromise internal validity (Gluud, 2006).”
BackgroundSelf-citationEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181 · cited 7×
“The authors of 10 meta-epidemiological studies (Als-Nielsen et al., 2004; Balk et al., 2002; Contopoulos-Ioannidis et al., 2005; Egger et al., 2003; Kjaergard et al., 2001; McAuley et al., 2000; Pildal et al., 2007; Royle and Milne, 2003; Sampson et al., 2003; Schulz et al., 1995) (see Table I)…”
BackgroundMethodInfluentialSelf-citationMcAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812 · cited 4×
“…increase heterogeneity (Als-Nielsen et al., 2004; Balk et al., 2002; Contopoulos-Ioannidis et al., 2005; Egger et al., 2003; Kjaergard et al., 2001; McAuley et al., 2000; Moher et al., 1998; Pildal et al., 2007; Royle and Milne, 2003; Sampson et al., 2003; Schulz et al., 1995; Siersma et al.,…”
BackgroundMethodInfluentialSelf-citationRoyle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693 · cited 4×
“…2004; Balk et al., 2002; Contopoulos-Ioannidis et al., 2005; Egger et al., 2003; Kjaergard et al., 2001; McAuley et al., 2000; Pildal et al., 2007; Royle and Milne, 2003; Sampson et al., 2003; Schulz et al., 1995) (see Table I) agreed to contribute their original data to a combined database that…”
BackgroundMethodInfluentialBias in clinical intervention research.
Gluud, L. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj069 · Cited by 636
Self-citationBalk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478 · cited 4×
“…evidence from different studies is not consistent: some studies did not find evidence of effects of these characteristics (Als-Nielsen et al., 2004; Balk et al., 2002; Pildal et al., 2007; Siersma et al., 2007), whereas others suggested that other flaws in trial conduct were of importance (Egger…”
BackgroundMethodResultInfluentialSelf-citationImpact of allocation concealment on conclusions drawn from meta-analyses of randomized trials
Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym087 · Cited by 472
Self-citationRisk of bias versus quality assessment of randomised controlled trials: cross sectional study
Hartling, L., Ospina, M., Liang, Y., Dryden, D. M., Hooton, N., Krebs Seida, J., & Klassen, T. P. (2009) · BMJ · doi:10.1136/bmj.b4012 · Cited by 348 · cited 1×
“A recent study by Hartling et al. (Hartling et al., 2009) assessed inter-rater agreement between two independent reviewers who applied the Cochrane risk of bias tool on a convenience sample of 163 published randomized trials.”
MethodShould meta-analysts search Embase in addition to Medline?
Sampson, M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00110-0 · Cited by 160
Research works printed but not linked: 13
- 10.1136/bmj.323.7310.446 · DOI · Paper page
- 10.1002/9780470712184.ch8 · DOI · Paper page
- 10.1176/appi.ajp.162.3.578 · DOI · Paper page
- 10.1001/jama.1992.03480030052036 · DOI · Paper page
- 10.7326/0003-4819-135-11-200112040-00010 · DOI · Paper page
- 10.1016/S0140-6736(98)01085-X · DOI · Paper page
- 10.1136/bmj.38414.515938.8F · DOI · Paper page
- 10.1136/bmj.315.7109.617 · DOI · Paper page
- 10.1001/jama.1995.03520290060030 · DOI
- 10.1002/sim.2752 · DOI · Paper page
- 10.1177/026988119701100116 · DOI
- 10.1002/sim.1184 · DOI · Paper page
- 10.1136/bmj.39465.451748.AD · DOI · Paper page
Cited by
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Self-citationThe Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Self-citationSavović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049
Self-citationSavović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668
“Blinding All 71 (36) 725 290 (40) 33 (17) 286 84 (29) Mortality 13 (5) 119 39 (33) 5 (3) 48 10 (21) Objective 20 (12) 208 81 (39) 9 (5) 63 23 (37) Subjective 38 (19) 398 170 (43) 19 (9) 175 51 (29)”
Self-citationBurr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Self-citationDias, S., Sutton, A. J., Welton, N. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485157 · Cited by 466
Valentine, J. C., & Thompson, S. G. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1064 · Cited by 130
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
Siemens, W., Meerpohl, J. J., Rohe, M. S., Buroh, S., Schwarzer, G., & Becker, G. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1543 · Cited by 24
“Outcome classification modified after Savovi c et al.(31,32) Objective outcomes:”
Method
Metadata
- Authors
- Savović, J., Harris, R. J., Wood, L., Beynon, R., Altman, D., Als‐Nielsen, B., Balk, E. M., Deeks, J., Gluud, L. L., Gluud, C., Ioannidis, J. P. A., Jűni, P., Moher, D., Pildal, J., Schulz, K. F., & Sterne, J. A. C.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2010-07
- Volume
- 1
- Issue
- 3-4
- Pages
- 212-225
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2147006306
- Cited by
- 25
- References
- 9
- FWCI
- 1.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.