The contribution of different information sources for adverse effects data
Abstract
OBJECTIVES: The aim of this study is to determine the relative value and contribution of searching different sources to identify adverse effects data. METHODS: The process of updating a systematic review and meta-analysis of thiazolidinedione-related fractures in patients with type 2 diabetes mellitus was used as a case study. For each source searched, a record was made for each relevant reference included in the review noting whether it was retrieved with the search strategy used and whether it was available but not retrieved. The sensitivity, precision, and number needed to read from searching each source and from different combinations of sources were also calculated. RESULTS: There were 58 relevant references which presented sufficient numerical data to be included in a meta-analysis of fractures and bone mineral density. The highest number of relevant references were retrieved from Science Citation Index (SCI) (35), followed by BIOSIS Previews (27) and EMBASE (24). The precision of the searches varied from 0.88% (Scirus) to 41.67% (CENTRAL). With the search strategies used, the minimum combination of sources required to retrieve all the relevant references was; the GlaxoSmithKline (GSK) website, Science Citation Index (SCI), EMBASE, BIOSIS Previews, British Library Direct, Medscape DrugInfo, handsearching and reference checking, AHFS First, and Thomson Reuters Integrity or Conference Papers Index (CPI). CONCLUSIONS: In order to identify all the relevant references for this case study a number of different sources needed to be searched. The minimum combination of sources required to identify all the relevant references did not include MEDLINE.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Existing case studies of coverage find highly varying coverage, ranging from less than 50% to over 90%.
“These case studies of coverage find highly varying coverage ranging from less than 50% (34,39,40) to over 90% (15,28,37,38,41).”
From PubMed coverage varied across specialties and over time: a large-scale study of included studies in Cochrane reviews (2019) · cites this paper as [34]
Cites
How are we searching the World Wide Web? A comparison of nine search engine transaction logs
Jansen, B. J., & Spink, A. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2004.10.007 · Cited by 801 · see citing works
Long-term use of thiazolidinediones and fractures in type 2 diabetes: a meta-analysis
Loke, Y. K., Singh, S., & Furberg, C. D. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080486 · Cited by 553 · see citing works
Self-citationPoor reporting and inadequate searches were apparent in systematic reviews of adverse effects
Golder, S., Loke, Y. K., & McIntosh, H. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.06.005 · Cited by 99 · see citing works
Self-citationRoom for improvement? A survey of the methods used in systematic reviews of adverse effects
Golder, S., Loke, Y. K., & McIntosh, H. M. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-3 · Cited by 73 · see citing works
Self-citationPatient safety and systematic reviews: finding papers indexed in MEDLINE, EMBASE and CINAHL
Tanon, A., Champagne, F., Contandriopoulos, A., Pomey, M., Vadeboncœur, A., & Nguyen, H. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2008.031401 · Cited by 29 · see citing works
Sources of information on adverse effects: a systematic review
Golder, S., & Loke, Y. K. (2010) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2010.00901.x · Cited by 17 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
PRISMA harms checklist: improving harms reporting in systematic reviews
Zorzela, L., Loke, Y. K., Ioannidis, J. P., Golder, S., Santaguida, P., Altman, D. G., Moher, D., Vohra, S., & PRISMA harms group (2016) · BMJ · doi:10.1136/bmj.i157 · Cited by 557 · see citing works
Self-citationThe contribution of databases to the results of systematic reviews: a cross-sectional study
Hartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0232-1 · Cited by 118 · see citing works
Frandsen, T. F., Eriksen, M. B., Hammer, D. M. G., & Christensen, J. B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.04.015 · Cited by 44 · see citing works
- Authors
- Golder, S., & Loke, Y. K.
- Affiliations
- University of York (GB)
- University of East Anglia (GB)
- Venue
- International Journal of Technology Assessment in Health Care
- Publisher
- Cambridge University Press (CUP)
- Published
- 2012-04
- Volume
- 28
- Issue
- 2
- Pages
- 133-137
- ISSN
- 0266-4623 (ISSN-L)
- 1471-6348
- OpenAlex
- W2119579450
- Cited by
- 22
- References
- 6
- Citations by year
- 2021: 3 · 2019: 3 · 2018: 3 · 2017: 2 · 2016: 4 · 2015: 1 · 2014: 3 · 2013: 2 · 2012: 1
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Technology Assessment in Health Care (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Keywords
- adverse drug reactions, literature search strategies, information sources, thiazolidinediones, fracture, type 2 diabetes, bone mineral density, search sensitivity, search precision, reference retrieval, systematic reviews
- MeSH terms
- Data Collection, Diabetes Mellitus, Type 2, Humans, United States, Meta-Analysis as Topic, Bone Density, Databases, Factual, Information Dissemination, Thiazolidinediones, Fractures, Bone, Drug-Related Side Effects and Adverse Reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review