A simplified search strategy for identifying randomised controlled trials for systematic reviews of health care interventions: a comparison with more exhaustive strategies
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Background: It is generally believed that exhaustive searches of bibliographic databases are needed for systematic reviews of health care interventions. The CENTRAL database of controlled trials (RCTs) has been built up by exhaustive searching. The CONSORT statement aims to encourage better reporting, and hence indexing, of RCTs. Our aim was to assess whether developments in the CENTRAL database, and the CONSORT statement, mean that a simplified RCT search strategy for identifying RCTs now suffices for systematic reviews of health care interventions. Methods: RCTs used in the Cochrane reviews were identified. A brief RCT search strategy (BRSS), consisting of a search of CENTRAL, and then for variants of the word random across all fields (random$.af.) in MEDLINE and EMBASE, was devised and run. Any trials included in the meta-analyses, but missed by the BRSS, were identified. The meta-analyses were then re-run, with and without the missed RCTs, and the differences quantified. The proportion of trials with variants of the word random in the title or abstract was calculated for each year. The number of RCTs retrieved by searching with "random$.af." was compared to the highly sensitive search strategy (HSSS). Results: The BRSS had a sensitivity of 94%. It found all journal RCTs in 47 of the 57 reviews. The missing RCTs made some significant differences to a small proportion of the total outcomes in only five reviews, but no important differences in conclusions resulted. In the post-CONSORT years, 1997–2003, the percentage of RCTs with random in the title or abstract was 85%, a mean increase of 17% compared to the seven years pre-CONSORT (95% CI, 8.3% to 25.9%). The search using random$.af. reduced the MEDLINE retrieval by 84%, compared to the HSSS, thereby reducing the workload of checking retrievals. Conclusion: A brief RCT search strategy is now sufficient to locate RCTs for systematic reviews in most cases. Exhaustive searching is no longer cost-effective, because in effect it has already been done for CENTRAL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
Early intervention for psychosis
Marshall, M., & Rathbone, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004718.pub3 · Cited by 531
Development of The Cochrane Collaboration's Central Register of Controlled Clinical Trials
Dickersin, K., Manheimer, E., Wieland, S., Robinson, K. A., Lefebvre, C., & McDonald, S. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001004 · Cited by 198
Dretzke, J., Toff, W. D., Lip, G. Y., Raftery, J., Fry-Smith, A., & Taylor, R. S. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003710.pub2 · Cited by 89
Research works printed but not linked: 44
- Alderson P, Green S, Higgins JP, editors: Cochrane Reviewers' Handbook 4.2.2 [updated March 2004]. In: The Cochrane Library, Issue 2, 2004; Section 5. 2004, Chichester, UK, John Wiley & Sons, Ltd
- Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.276.8.637. · DOI · Paper page
- Linde K, Rossnagel K: Propranolol for migraine prophylaxis. Cochrane Database Syst Rev. 2004, 2: CD003225-
- Badger C, Preston N, Seers K, Mortimer P: Benzo-pyrones for reducing and controlling lymphoedema of the limbs. Cochrane Database Syst Rev. 2004, 2: CD003140-
- Zhang D: Benzo-pyrones in the treatment of chronic lymphoedema of the arms and legs. Zhonghua Yi Xue Za Zhi. 1990, 70: 655-657.
- Chang TS, Gan JL, Fu KD, Huang WY: The use of 5,6 benzo-[alpha]-pyrone (coumarin) and heating by microwaves in the treatment of chronic lymphedema of the legs. Lymphology. 1996, 29: 106-111.
- Stensrud P, Sjaastad O: Comparative trial of Tenormin (atenol) and Inderal (propranolol) in migraine. Headache. 1980, 20: 204-207. 10.1111/j.1526-4610.1980.h2004006.x. · DOI
- Stensrud P, Sjaastad O: Comparative trial of Tenormin (atenolol) and Inderal (propranolol) in migraine. Ups J Med Sci Suppl. 1980, 31: 37-40.
- Schroeder K, Fahey T, Ebrahim S: Interventions for improving adherence to treatment in patients with high blood pressure in ambulatory settings. Cochrane Database Syst Rev. 2004, 2: CD004804-
- Wu HM, Tang JL, Sha ZH, Cao L, Li YP: Interventions for preventing infection in nephrotic syndrome. Cochrane Database Syst Rev. 2004, 2: CD003964-
- Koning S, Verhagen AP, Suijlekom-Smit LW, Morris A, Butler CC, van der Wouden JC: Interventions for impetigo. Cochrane Database Syst Rev. 2004, 2: CD003261-
- Rees K, Bennett P, West R, Davey SG, Ebrahim S: Psychological interventions for coronary heart disease. Cochrane Database Syst Rev. 2004, 2: CD002902-
- Allen SJ, Okoko B, Martinez E, Gregorio G, Dans LF: Probiotics for treating infectious diarrhoea. Cochrane Database Syst Rev. 2004, 2: CD003048-
- Chow TK, To E, Goodchild CS, McNeil JJ: A simple, fast, easy method to identify the evidence base in pain-relief research: validation of a computer search strategy used alone to identify quality randomized controlled trials. Anesth Analg. 2004, 98: 1557-65, table. 10.1213/01.ANE.0000114071.78448.2D. · DOI
- Badger C, Seers K, Preston N, Mortimer P: Antibiotics / anti-inflammatories for reducing acute inflammatory episodes in lymphoedema of the limbs. Cochrane Database Syst Rev. 2004, CD003143-
- Kasseroller R: Erysipelprophylaxe beim sekundaren lymphoedem mit selen. Der Allgemeinartzt. 1996, 3: 244-247.
- Davis MJ, Mundin HA, Mews GC, Cope GD: Functional benefits of physiologic compared with ventricular pacing in complete heart block. Clin Prog Electrophysiol Pacing. 1985, 3: 457-460.
- Linszen D, Dingemans PM, Lenior ME, Scholte WF, Goldstein M: Early family and individual interventions and relapse in recent-onset schizophrenia and related disorders. Ital J Psychiatry Behav Sci. 1998, 8: 77-84.
- Linszen DH, Dingemans PMAJ, Scholte WF, Lenior ME, Goldstein M: Early recognition, intensive intervention and other protective and risk factors for psychotic relapse in patients with first psychotic episodes in schizophrenia. Int Clin Psychopharmacol. 1998, 13: S7-S12. · DOI
- Arata J, Kanzaki H, Kanamoto A, Okawara A, Kato N, Kumakiri M, Shimizu T, Ishibashi Y, Nogita T, Iozumi K, Harada S, Nakanishi H, Hyang YS, Okouchi H, Takano S, Ohara K, Ota T, Shishiba T, Nakabayashi Y: A double blind comparative study of cefdinir and cefaclor in skin and skin structure infections. Chemotherapy. 1989, 37: 1016-1042.
- Arata J, Yamamoto Y, Tamaki H, Ookawara A, Fukaya T, Ishibashi Y, Shimozuma M, Iozumi T, Kukita A, Kimura Y, Takahashi H, Sasaki J, Nishiwaki M, Urushibata O, Tomizawa T, Eto H, Kurihara S, Morohashi M, Seki T: Double-blind study of lomefloxacin vs. norfloxacin in the treatment of skin and soft tissue infections. Chemotherapy. 1989, 37: 482-503.
- Bass JW, Chan DS, Creamer KM, Thompson MW, Malone FJ, Becker TM, Marks SN: Comparison of oral cephalexin, topical mupirocin and topical bacitracin for treatment of impetigo. Pediatr Infect Dis J. 1997, 16: 708-710. 10.1097/00006454-199707000-00013. · doi:10.1097/00006454-199707000-00013
- Koranyi KI, Burech DL, Haynes RE: Evaluation of bacitracin ointment in the treatment of impetigo. Ohio State Medical Journal. 1976, 72: 368-370.
- Moraes-Barbosa AD: Comparative study between topical 2% sodium fusidate and oral association of chloranphenicol/neomycin/bacitracin in the treatment of staphylococcic impetigo in new-born. Arq Bras Med. 1986, 60: 509-511.
- Park SW, Wang HY, Sung HS: A study for the isolation of the causative organism, antimicrobial susceptibility tests and therapeutic aspects in patients with impetigo. Korean J Dermatol. 1993, 31: 312-319.
- Pruksachatkunakorn C, Vaniyapongs T, Pruksakorn S: Impetigo: an assessment of etiology and appropriate therapy in infants and children. J Med Assoc Thai. 1993, 76: 222-229.
- Sutton JB: Efficacy and acceptability of fusidic acid cream and mupirocin ointment in facial impetigo. Curr Ther Res. 1992, 51: 673-678.
- Tamayo L, De la Luz OM, Sosa de Martinez MC: Rifamycin and mupirocin in the treatment of impetigo. Dermatol Rev Mex. 1991, 35: 99-103.
- Gabriel M, Gagnon JP, Bryan CK: Improved patients compliance through use of a daily drug reminder chart. Am J Public Health. 1977, 67: 968-969. · DOI · Paper page
- Hamilton GA, Roberts SJ, Johnson JM, Tropp JR, Anthony-Odgren D, Johnson BF: Increasing adherence in patients with primary hypertension: an intervention. Health Value. 1993, 17: 3-11.
- Kerr JA: Adherence and self-care. Heart Lung. 1985, 14: 24-31.
- Morisky DE, DeMuth NM, Field-Fass M, Green LW, Levine DM: Evaluation of family health education to build social support for long-terms control of high blood pressure. Health Education Quarterly. 1985, 12: 35-50. · DOI · Paper page
- Rehder TL, McCoy LK, Blackwell B, Whitehead W, Robinson A: Improving medication compliance by counseling and special prescription container. Am J Hosp Pharm. 1980, 37: 379-385.
- Dou ZY, Wang JY, Liu YP: Preventive efficiency of low-dose IVIgc on infection in nephrotic synrome. Chin J Biologicals. 2000, 13: 160-
- Li RH, Peng ZP, Wei YL, Liu CH: Clinical observation on Chinese medicinal herbs combined with predisone for reducing the risks of infection in children with nephrotic syndrome. Inf J Chin Med. 2000, 7: 60-61.
- Zhang YJ, Wang Y, Yang ZW, Li XT: Clinical investigation of thymosin for preventing infection in children with primary nephrotic syndrome. Chin J Contemp Pediatr. 2000, 2: 197-198.
- Tong LZ, Mi LZ: Preventive efficiency of IVIgG on secondary nosocomial in nephrotic syndrome. Mod Rehabil. 1998, 2: 236-
- Sugita T, Togawa M: Efficacy of Lactobacillus preparation biolactis powder in children with rotavirus enteritis. Jpn J Pediatr. 1994, 47: 2755-2762.
- Gallacher JE, Hopkinson CA, Bennett P, Burr ML, Elwood PC: Effect of stress management on angina. Psychol Health. 1997, 12: 523-532. · DOI · Paper page
- Mitsibounas DN, Tsouma-Hadjis ED, Rotas VR, Sideris DA: Effect of group psychosocial intervention on coronary risk factors. Psychother Psychosom. 1992, 58: 97-102. · DOI
- Siebenhofer A, Plank J, Berghold A, Narath M, Gfrerer R, Pieber TR: Short acting insulin analogues versus regular human insulin in patients with diabetes mellitus. Cochrane Database Syst Rev. 2004, 2: CD003287-
- Iwamoto Y, Akanuma Y, Niimi H, Sasaki N, Tajima N, Kawamori R: Comparison between insulin aspart and soluble human insulin in type 1 diabetes (IDDM) patients treated with basal-bolus insulin therapy - Phase III clinical trial in Japan. J Japan Diab Soc. 2001, 44: 799-811.
- Duhmke RM, Cornblath DD, Hollingshead JR: Tramadol for neuropathic pain. Cochrane Database Syst Rev. 2004, 2: CD003726-
- Leppert W: Analgesic efficacy and side effects of oral tramadol and morphine administered orally in the treatment of cancer pain. Nowotwory. 2001, 51: 257-266.
Cited by
GELLATLY, J., BOWER, P., HENNESSY, S., RICHARDS, D., GILBODY, S., & LOVELL, K. (2007) · Psychological Medicine · doi:10.1017/s0033291707000062 · Cited by 419
Luberto, C. M., Shinday, N., Song, R., Philpotts, L. L., Park, E. R., Fricchione, G. L., & Yeh, G. Y. (2018) · Mindfulness · doi:10.1007/s12671-017-0841-8 · Cited by 346
Aylett, E., Small, N., & Bower, P. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3313-5 · Cited by 242
Coventry, P. A., Hudson, J. L., Kontopantelis, E., Archer, J., Richards, D. A., Gilbody, S., Lovell, K., Dickens, C., Gask, L., Waheed, W., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108114 · Cited by 221
Harkness, E., Macdonald, W., Valderas, J., Coventry, P., Gask, L., & Bower, P. (2010) · Diabetes Care · doi:10.2337/dc09-1519 · Cited by 188
Metadata
- Authors
- Royle, P., & Waugh, N.
- Venue
- BMC Medical Research Methodology
- Published
- 2005-07-23
- Volume
- 5
- Issue
- 1
- Pages
- 23-23
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2110595041
- Cited by
- 55
- References
- 6
- FWCI
- 0.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A simplified search strategy for identifying randomised controlled trials for systematic reviews of health care interventions: a comparison with more exhaustive strategies. https://app.cochat.ai/papers/10.1186/1471-2288-5-23
- The paper
- Royle, P., & Waugh, N. (2005). A simplified search strategy for identifying randomised controlled trials for systematic reviews of health care interventions: a comparison with more exhaustive strategies. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-5-23
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.