The comprehensiveness of Medline and Embase computer searches: Searches for controlled trials of homoeopathy, ascorbic acid for common cold and ginkgo biloba for cerebral insufficiency and intermittent claudication
The DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
Objective To assess the comprehensiveness of Medline and Embase computer searches for controlled trials.Design Comparison of articles found after an exhaustive search of the literature with the yield of a Medline or Embase search. This was performed for controlled clinical trials on the efficacy of three interventions: homoeopathy, ascorbic acid for common cold, and ginkgo biloba for intermittent claudication and cerebral insufficiency. The number of controlled trials found by exhaustive search of the literature was 107, 61 and 45, respectively.Results For homoeopathy, ascorbic acid and ginkgo the proportion of all trials found by Medline was 17%, 36% and 31% respectively and for Embase 13%, 25% and 58% respectively. After checking of the references in the Medline articles 44%, 79% and 76% of all trials were identified. After checking of the references in the Embase articles 42%, 72% and 93% of all trials were identified. About 20% of the articles was not correctly indexed. Of the best trials 68%, 91% and 83% could be found with Medline and 55%, 82% and 92% of the best trials were identified through Embase.Conclusions For the topics mentioned, Medline and Embase searches are sufficient to get an impression of the evidence from controlled trials, but only if references in the articles are followed for further evidence. If one wants to get a more complete picture, additional search strategies make sense. Of course, this picture may be different for other topics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Journal overlap can vary from 10% to 75% [ 9 , 10 , 8 , 11 , 12 ] depending on medical speciality.”
From Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module (2015) · cites this paper as [9]
Citations
Cites
Arzneimittelforschung: Eine Zukunftsoption für Ärzte?
Bethke, T. D. (2012) · Der Pneumologe · doi:10.1007/s10405-012-0601-3 · Cited by 3,261
Clinical trials of homoeopathy.
Kleijnen, J., Knipschild, P., & ter Riet, G. (1991) · BMJ · doi:10.1136/bmj.302.6772.316 · Cited by 604
Self-citationVitamin C and the Common Cold.
(1972) · Annals of Internal Medicine · doi:10.7326/0003-4819-76-2-352_9 · Cited by 216
Effect of homeopathic treatment on fibrositis (primary fibromyalgia)
Fisher, P., Greenwood, A., Huskisson, E. C., Turner, P., & Belon, P. (1989) · BMJ · doi:10.1136/bmj.299.6695.365 · Cited by 182
Perusing the literature: Comparison of MEDLINE searching with a perinatal trials database
Dickersin, K., Hewitt, P., Mutch, L., Chalmers, I., & Chalmers, T. C. (1985) · Controlled Clinical Trials · doi:10.1016/0197-2456(85)90106-0 · Cited by 167
ASCORBIC ACID AND THE COMMON COLD
(2009) · Nutrition Reviews · doi:10.1111/j.1753-4887.1967.tb05634.x · Cited by 128
Vitamin C Prophylaxis in a Boarding School
Coulehan, J. L., Reisinger, K. S., Rogers, K. D., & Bradley, D. W. (1974) · New England Journal of Medicine · doi:10.1056/nejm197401032900102 · Cited by 107
Wesnes, K., Simmons, D., Rook, M., & Simpson, P. (1987) · Human Psychopharmacology: Clinical and Experimental · doi:10.1002/hup.470020305 · Cited by 98
HOW TO LIVE LONGER AND FEEL BETTER
Tully, M. (1986) · AJN American Journal of Nursing · doi:10.1097/00000446-198607000-00039 · Cited by 90
ASCORBIC ACID AND THE COMMON COLD
Charleston, S., & Clegg, K. M. (1972) · The Lancet · doi:10.1016/s0140-6736(72)91143-9 · Cited by 87
Research works printed but not linked: 18
- Kleijnen J, Knipschild P. Ginkgo biloba for intermittent claudication and cerebral insufficiency. In: Kleijnen J. Food supplements and their efficacy [dissertation]. Maastricht: University of Limburg, 1991.
- Hofmans EA. De opbrengst van een Medline-search. De toegankelijkheid van onderzoek naar de effectiviteit van acupunctuur II [The results of a Medline search. The accessibility of research on the effectiveness of acupuncture II]. Huisarts Wetensch 1990;33(3):103–6.
- Rahlfs WV, Mössinger P. Zur Behandlung des Colon irritabile. Arzneimittelforschung 1976;26:2230–4.
- Gassinger CA, Wünstel G, Netter P. Klinische Pr:ufung zum Nachweis der therapeutischen Wirksamkeit des homöpathischen Arzneimittels Eupatorium perfoliatum D 2 (Wasserhanf composite) bei der Diagnose “Grippaler Infekt”. Arzneimittelforschung 1981;31:732–6.
- Wiesenauer M, Häussler S, Gaus W. Pollinosis-Therapie mit Galphimia glauca. Fortschr Med 1983;101:811–4.
- Maiwald L, Weinfurtner T, Mau J, Connert WD. Therapie des grippalen Infekts mit einem homöopathischen Kombinationspräparat im Vergleich zu Acetylsalicylsäure. Kontrollierte, randomisierte Einfachblindstudie. Arzneimittelforschung 1988;38:578–82.
- Wiesenauer M, Gaus W, Bohnacker U, Häussler S. Wirksamkeitsprüfung von homöopathische Kombinationspräparaten bei Sinusitis. Ergebnisse einer randomisierten Doppelblindstudie unter Praxisbedingungen. Arzneimittelforschung 1989;39:620–5.
- Chevrel JP, Saglier J, DesTable MD. Reprise du transit intestinal en chirurgie digestive. Action homéopathique de l'Opium. Presse Med 1984;13:833.
- Wiesenauer M, Gaus W. Orthostatische Dysregulation. Kontrollierter Wirkungsvergleich zwischen Etilefrin 5 mg und dem homöopathischen Arzneimittel Haplopappus D2. Z Allgemeinmed 1987;63:18–23.
- Lewith G, Brown PK, Tyrell DAJ. Controlled study of the effects of a homoeopathic dilution of influenza vaccine on antibody titres in man. Complement Med Res 1989;3:22–4.
- Halama P, Bartsch G, Meng G. Hirnleistungsstörungen vaskulärer Genese. Randomisierte Doppelblindstudie zur Wirksamkeit von Gingko-biloba-Extrakt. Fortschr Med 1988;106:408–13.
- Moreau P. Un nouveau stimulant circulatoire cérébral. Presse Med 1975;4:2401–2.
- Eckmann F, Schlag H. Kontrollierte Doppelblind-Studie zum Wirksamkeitsnachweis von Tebonin forte bei Patienten mit zerebrovaskulärer Insuffizienz. Fortschr Med 1982;100:1474–8.
- Ambrosi C, Bourde C. Nouveauté thérapeutique médicale dans les artériopathies des membres inférieurs: Tanakan. Essai clinique et étude par les cristaux liquides. Gazette Med France. 1975;82:628–32.
- Bastide G, Montsarrat M. Artérite des membres inférieurs. Intérêt du traitement médical après intervention chirurgicale. Analyse factorielle. Gaz Med Fr 1978;85:4523–6.
- Augustin P. Le Tanakan en gériatrie. Étude clinique et psychométrique chez 189 malades d'hospice. Psychol Méd 1976;8:123–30.
- Israël L, Ohlman T, Delomier Y, Hugonot R. Étude psychométrique de l'activité d'un extrait végétal au cours des états d'involution sénile. Lyon Méditerranée Médical 1977;13:1197–9.
- Ter Riet G, Kleijnen J, Knipschild P. De effectiviteit van acupunctuur [The effectiveness of acupuncture]. Huisarts Wet 1989;32:170–5, 176–81, 223–7, 228–9, 230–8, 258–63, 272, 264–6, 267–72, 299–303, 304–7, 308–12.
Cited by
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Vitamin C for preventing and treating the common cold
Hemilä, H., & Chalker, E. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000980.pub4 · Cited by 869
Royle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693
“Previous research relevant to this study has compared the comprehensiveness of MEDLINE with hand searching (1;17) or with searches of other databases, including Embase, CINAHL, BIOSIS, PsychLit, and LILACS (2;3;4;9;16;19;24).”
MethodChecking reference lists to find additional studies for systematic reviews
Horsley, T., Dingwall, O., & Sampson, M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000026.pub2 · Cited by 443
Metadata
- Authors
- Kleijnen, J., & Knipschild, P.
- Affiliations
- Maastricht University (NL)
- ORCID
- Kleijnen, Jos
- Venue
- Pharmaceutisch Weekblad Scientific Edition
- Published
- 1992-10
- Volume
- 14
- Issue
- 5
- Pages
- 316-320
- ISSN
- 0167-6555 (ISSN-L)
- 1573-739X
- OpenAlex
- W2921750634
- Cited by
- 89
- References
- 35
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 1 · 2019: 1 · 2017: 1 · 2016: 1 · 2015: 2 · 2014: 1 · 2013: 2 · 2012: 3
- FWCI
- 5.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Pharmacy World & Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- MEDLINE, Embase, literature search comprehensiveness, homeopathy, vitamin C, common cold, Ginkgo biloba, intermittent claudication, cerebrovascular insufficiency, bibliographic database indexing, search strategies
- MeSH terms
- Abstracting and Indexing, Ascorbic Acid, Brain Ischemia, Clinical Trials as Topic, Common Cold, Homeopathy, Humans, Information Systems, Intermittent Claudication, Plants, Medicinal, MEDLINE
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The comprehensiveness of Medline and Embase computer searches: Searches for controlled trials of homoeopathy, ascorbic acid for common cold and ginkgo biloba for cerebral insufficiency and intermittent claudication. https://app.cochat.ai/papers/10.1007/bf01977620
- The paper
- Kleijnen, J., & Knipschild, P. (1992). The comprehensiveness of Medline and Embase computer searches: Searches for controlled trials of homoeopathy, ascorbic acid for common cold and ginkgo biloba for cerebral insufficiency and intermittent claudication. Pharmaceutisch Weekblad Scientific Edition. https://doi.org/10.1007/bf01977620
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.