VALUE OF DATABASES OTHER THAN MEDLINE FOR RAPID HEALTH TECHNOLOGY ASSESSMENTS
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Objectives:The objective of this study was to explore the degree to which databases other than MEDLINE contribute studies relevant for inclusion in rapid health technology assessments (HTA). Methods:We determined the extent to which the clinical, economic, and social studies included in twenty-one full and four rapid HTAs published by three Canadian HTA agencies from 2007 to 2012 were indexed in MEDLINE. Other electronic databases, including EMBASE, were then searched, in sequence, to assess whether or not they indexed studies not found in MEDLINE. Assessment topics ranged from purely clinical (e.g., drug-eluting stents) to those with broader social implications (e.g., spousal violence). Results:MEDLINE contributed the majority of studies in all but two HTA reports, indexing a mean of 89.6 percent of clinical studies across all HTAs, and 88.3 percent of all clinical, economic, and social studies in twenty-four of twenty-five HTAs. While EMBASE contributed unique studies to twenty-two of twenty-five HTAs, three rapid HTAs did not include any EMBASE studies. In some instances, PsycINFO and CINAHL contributed as many, if not more, non-MEDLINE studies than EMBASE. Conclusions:Our findings highlight the importance of assessing the topic-specific relative value of including EMBASE, or more specialized databases, in HTA search protocols. Although MEDLINE continues to be a key resource for HTAs, the time and resource limitations inherent in the production of rapid HTAs require that researchers carefully consider the value and limitations of other information sources to identify relevant studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Prior research on database importance for systematic reviews has looked primarily at whether included references could have theoretically been found in a certain database, but most have been unable to ascertain whether the researchers actually found the articles in those databases [10, 12, 16, 17, 26].”
From Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study (2017) · cites this paper as [12]
In the citing paper
“When conducting exhaustive searches for systematic reviews, information professionals search multiple databases with overlapping content [1-4].”
From De-duplication of database search results for systematic reviews in EndNote (2016) · cites this paper as [3]
Citations
Cites
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Although “there is no universally accepted definition of what constitutes a rapid review” (6), they are usually narrower in scope and intended to inform the more immediate information needs of policy and healthcare decision makers (5–8).”
BackgroundEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752 · cited 3×
“There is and will likely remain a need for rapid access to current information to inform immediate healthcare decision making (5).”
BackgroundMethodRoyle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693 · cited 1×
“Overlapping content, reported in comparisons between MEDLINE and EMBASE as ranging from 10 percent to 87 percent, and inadequate indexing of studies in individual databases can significantly impact the precision of a literature search, increasing the time required to identify studies and, ultimately, complete a rapid…”
BackgroundThe STM Report: An overview of scientific and scholarly journal publishing
Ware, M., & Mabe, M. A. (2015) · Lincoln (University of Nebraska) · Cited by 528
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226 · cited 1×
“extraction, and searching techniques than are typical of full HTAs (4;5;7;8).”
MethodShould meta-analysts search Embase in addition to Medline?
Sampson, M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00110-0 · Cited by 160 · cited 2×
“their prevalence seems low enough that the risk may be slight, provided the rest of the search is comprehensive” (17).”
BackgroundA nursing qualitative systematic review required MEDLINE and CINAHL for study identification
Subirana‐Casacuberta, M., Solà, I., García, J. M., Gich, I. J., & Urrútia, G. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.06.001 · Cited by 156
Searching multiple databases for systematic reviews: added value or diminishing returns?
Stevinson, C., & Lawlor, D. A. (2004) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2004.09.003 · Cited by 143
STM report : an overview of scientific and scholarly journal publishing
urfistinfo (2009) · OpenEdition (OpenEdition) · doi:10.58079/v4as · Cited by 138
Research works printed but not linked: 1
- Leclercq, 2005, Indexing of a clinical paper by EMBASE and MEDLINE, CILIP Health Libr Group Newsletter, 22, 10
Cited by
Bramer, W. M., Rethlefsen, M. L., Kleijnen, J., & Franco, O. H. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0644-y · Cited by 2,114
“Prior research on database importance for systematic reviews has looked primarily at whether included references could have theoretically been found in a certain database, but most have been unable to ascertain whether the researchers actually found the articles in those databases [10, 12, 16, 17, 26].”
BackgroundDe-duplication of database search results for systematic reviews in EndNote
Bramer, W. M., Giustini, D., de Jonge, G. B., Holland, L., & Bekhuis, T. (2016) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.104.3.014 · Cited by 2,103
Searching for and selecting studies
Lefebvre, C., Glanville, J., Briscoe, S., Littlewood, A., Marshall, C., Metzendorf, M., Noel‐Storr, A., Rader, T., Shokraneh, F., Thomas, J., et al. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch4 · Cited by 647
Halladay, C. W., Trikalinos, T. A., Schmid, I. T., Schmid, C. H., & Dahabreh, I. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.017 · Cited by 166
The contribution of databases to the results of systematic reviews: a cross-sectional study
Hartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0232-1 · Cited by 118
Metadata
- Authors
- Lorenzetti, D. L., Topfer, L.-A., Dennett, L., & Clement, F.
- Affiliations
- University of Calgary (CA)
- University of Alberta (CA)
- Venue
- International Journal of Technology Assessment in Health Care
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014-04
- Volume
- 30
- Issue
- 2
- Pages
- 173-178
- ISSN
- 0266-4623 (ISSN-L)
- 1471-6348
- OpenAlex
- W2102586220
- Cited by
- 30
- References
- 26
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 5 · 2022: 2 · 2021: 4 · 2020: 2 · 2019: 2 · 2018: 1 · 2017: 1 · 2016: 4 · 2015: 1 · 2014: 1
- FWCI
- 2.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Technology Assessment in Health Care (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- MEDLINE, Embase, PsycINFO, CINAHL, search strategies, bibliographic database indexing
- MeSH terms
- Technology Assessment, Biomedical, Time Factors, Databases, Factual, MEDLINE
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: VALUE OF DATABASES OTHER THAN MEDLINE FOR RAPID HEALTH TECHNOLOGY ASSESSMENTS. https://app.cochat.ai/papers/10.1017/s0266462314000166
- The paper
- Lorenzetti, D. L., Topfer, L.-A., Dennett, L., & Clement, F. (2014). VALUE OF DATABASES OTHER THAN MEDLINE FOR RAPID HEALTH TECHNOLOGY ASSESSMENTS. International Journal of Technology Assessment in Health Care. https://doi.org/10.1017/s0266462314000166
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.