The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
LITERATURE SEARCHING FOR RANDOMIZED CONTROLLED TRIALS USED IN COCHRANE REVIEWS: RAPID VERSUS EXHAUSTIVE SEARCHES
Abstract
Objectives:To analyze sources searched in Cochrane reviews, to determine the proportion of trials included in reviews that are indexed in major databases, and to compare the quality of these trials with those from other sources. Methods:All new systematic reviews in the Cochrane Library, Issue1 2001, that were restricted to randomized controlled trials (RCTs) or quasi-RCTs were selected. The sources searched in the reviews were recorded, and the trials included were checked to see whether they were indexed in four major databases. Trials not indexed were checked to determine how they could be identified. The quality of trials found in major databases was compared with those found from other sources. Results:The range in the number of databases searched per review ranged between one and twenty-seven. The proportion of the trials in the four databases were Cochrane Controlled Trials Register=78.5%, MEDLINE=68.8%, Embase=65.0%, and Science/Social Sciences Citation Index=60.7%. Searching another twenty-six databases after Cochrane Controlled Trials Register (CCTR), MEDLINE, and Embase only found 2.4% additional trials. There was no significant difference between trials found in the CCTR, MEDLINE, and Embase compared with other trials, with respect to adequate allocation concealment or sample size. Conclusions:There was a large variation between reviews in the exhaustiveness of the literature searches. CCTR was the single best source of RCTs. Additional database searching retrieved only a small percentage of extra trials. Contacting authors and manufacturers to find unpublished trials appeared to be a more effective method of obtaining the additional better quality trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“More recently, the overlap in MEDLINE and EMBASE was found to be 79% [ 13 ] based on trials that had been included in 66 Cochrane systematic reviews.”
From Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module (2015) · cites this paper as [13]
In the citing paper
“Similarly, Royle and Milne found that searches in databases additional to Cochrane Controlled Trials Register (CCTR), Medline and Embase identified only 2.4 % more studies [41].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [41]
Citations
Cites
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1×
“The Cochrane Reviewers Handbook (5) states the quality of the trials used in reviews should be assessed, although there is no widespread consensus on how this should be done; however, it is generally thought that concealment of treatment allocation, blinding of outcome assessment, and handling of patient attrition in…”
BackgroundKjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283 · cited 2×
“Smaller studies are thought to be associated with lower methodological quality and to be more susceptible to publication bias than larger trials (14;15;20;21).”
BackgroundPublication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · cited 1×
“Smaller studies are thought to be associated with lower methodological quality and to be more susceptible to publication bias than larger trials (14;15;20;21).”
BackgroundInvestigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Direction and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892 · cited 1×
“Also, research has investigated the impact of grey literature and non-English trials on the results of meta-analyses (13;18).”
BackgroundMcAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812 · cited 1×
“Also, research has investigated the impact of grey literature and non-English trials on the results of meta-analyses (13;18).”
BackgroundJadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Investigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Systematic reviews and meta-analyses on treatment of asthma: critical evaluation
Jadad, A. R. (2000) · BMJ · doi:10.1136/bmj.320.7234.537 · Cited by 263
Identifying Clinical Trials in the Medical Literature with Electronic Databases
Suarez-Almazor, M. E., Belseck, E., Homik, J., Dorgan, M., & Ramos-Remus, C. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00067-2 · Cited by 180 · cited 1×
“The overlap between MEDLINE and Embase has been estimated variously at between 10% and 75%, depending on the topic being searched (6;23).”
Background
Research works printed but not linked: 3
- Clarke M , Oxman AD , eds.2001 Locating and selecting studies. Cochrane Reviewers Handbook 4.1.2 [updated March 2001] Section 5.In: The Cochrane Library.Oxford:Update Software,Issue 2.
- Clarke M , Oxman AD , eds.2001 Assessment of study quality. Cochrane Reviewers Handbook 4.1.2 [updated March 2001] Section 6.In: The Cochrane Library.Oxford:Update Software,Issue 2.
- Early Breast Cancer Trialists' Collaborative Group.2001 Tamoxifen for early breast cancer (Cochrane Review).In: The Cochrane Library.Oxford:Update Software,Issue 1.
Cited by
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Bjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2007) · JAMA · doi:10.1001/jama.297.8.842 · Cited by 2,275
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
Bjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Metadata
- Authors
- Royle, P., & Milne, R.
- Venue
- International Journal of Technology Assessment in Health Care
- Publisher
- Cambridge University Press (CUP)
- Published
- 2003-12
- Volume
- 19
- Issue
- 4
- Pages
- 591-603
- ISSN
- 0266-4623 (ISSN-L)
- 1471-6348
- OpenAlex
- W1964489041
- Cited by
- 693
- References
- 23
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 5 · 2023: 2 · 2022: 4 · 2021: 17 · 2020: 22 · 2019: 30 · 2018: 39 · 2017: 47 · 2016: 30 · 2015: 50 · 2014: 45 · 2013: 53 · 2012: 49
- FWCI
- 16.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Technology Assessment in Health Care (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- literature searching, randomized controlled trials, database searching, MEDLINE, Embase, trial quality, allocation concealment, unpublished trials
- MeSH terms
- Review Literature as Topic, Technology Assessment, Biomedical, Meta-Analysis as Topic, Bibliometrics, Randomized Controlled Trials as Topic, Databases, Bibliographic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: LITERATURE SEARCHING FOR RANDOMIZED CONTROLLED TRIALS USED IN COCHRANE REVIEWS: RAPID VERSUS EXHAUSTIVE SEARCHES. https://app.cochat.ai/papers/10.1017/s0266462303000552
- The paper
- Royle, P., & Milne, R. (2003). LITERATURE SEARCHING FOR RANDOMIZED CONTROLLED TRIALS USED IN COCHRANE REVIEWS: RAPID VERSUS EXHAUSTIVE SEARCHES. International Journal of Technology Assessment in Health Care. https://doi.org/10.1017/s0266462303000552
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.