The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Searching for observational studies: what does citation tracking add to PubMed? A case study in depression and coronary heart disease
Open accessAbstract
Background: PubMed is the most widely used method for searches of the medical literature, but fails to identify many relevant articles. Electronic citation tracking offers an alternative search method. Methods: Articles investigating the role of depression in the aetiology and prognosis of coronary heart disease were sought through two methods: a) PubMed, and b) citation tracking where Science Citation Index was searched for all articles which cited ("forward citation tracking") or were cited by ("backward citation tracking") any of the articles in an index review. The number and quality of eligible articles identified by the two methods were compared. Results: 50 articles that were not already included in the index review met our inclusion criteria; 11 were identified through Science Citation Index alone, 8 through PubMed alone, and 31 through both methods. Articles identified by Science Citation Index alone were published in higher impact factor journals, were larger and were less likely to show a positive association. Conclusion: Science Citation Index identified more eligible articles than PubMed, and these differed qualitatively. Failing to use citation tracking in a systematic review of observational studies may result in bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As many relevant studies may be identified in sources other than electronic databases [29,30], searches that extend beyond the standard electronic databases should be considered.”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Hemingway, H., & Marmot, M. (1999) · BMJ · doi:10.1136/bmj.318.7196.1460 · Cited by 1,340
Self-citationDepression as a predictor for coronary heart disease
Rugulies, R. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00439-7 · Cited by 1,110
Wulsin, L. R., & Singal, B. M. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000058371.50240.e3 · Cited by 730
Kuper, H., Marmot, M., & Hemingway, H. (2002) · Seminars in Vascular Medicine · doi:10.1055/s-2002-35401 · Cited by 415
Self-citationDepression as a Risk Factor for Coronary Heart Disease Mortality
Carney, R. M., Freedland, K. E., & Jaffe, A. S. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.3.229 · Cited by 68
Wieland, L. S., & Dickersin, K. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.11.018 · Cited by 60
Borsody, M. K., & Yamada, C. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-7 · Cited by 3
Cited by
Nicholson, A., Kuper, H., & Hemingway, H. (2006) · European Heart Journal · doi:10.1093/eurheartj/ehl338 · Cited by 1,353
Self-citationSmith, M., Hosking, J., Woodward, A., Witten, K., MacMillan, A., Field, A., Baas, P., & Mackie, H. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0613-9 · Cited by 888
Smoking cessation reduces postoperative complications: A systematic review and meta-analysis
Mills, E., Eyawo, O., Lockhart, I., Kelly, S., Wu, P., & Ebbert, J. O. (2011) · The American Journal of Medicine · doi:10.1016/j.amjmed.2010.09.013 · Cited by 599
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Systematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472
Metadata
- Authors
- Kuper, H., Nicholson, A., & Hemingway, H.
- Affiliations
- London School of Hygiene & Tropical Medicine (GB)
- University College London (GB)
- Corresponding author
- Kuper, Hannah
- Venue
- BMC Medical Research Methodology
- Published
- 2006-02-16
- Volume
- 6
- Issue
- 1
- Pages
- 4-4
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC1403794
- OpenAlex
- W1823135002
- Cited by
- 36
- References
- 10
- Citations by year
- 2023: 2 · 2022: 1 · 2021: 1 · 2020: 2 · 2019: 1 · 2018: 2 · 2017: 5 · 2016: 4 · 2014: 4 · 2012: 5
- FWCI
- 1.14
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- citation tracking, PubMed, Science Citation Index, depression, coronary artery disease, observational studies, systematic review search strategy, search bias, bibliographic database searching
- MeSH terms
- Abstracting and Indexing, Coronary Disease, Depressive Disorder, Humans, Periodicals as Topic, Prognosis, Prospective Studies, Bibliometrics, Information Storage and Retrieval, Outcome Assessment, Health Care, Observation, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Searching for observational studies: what does citation tracking add to PubMed? A case study in depression and coronary heart disease. https://app.cochat.ai/papers/10.1186/1471-2288-6-4
- The paper
- Kuper, H., Nicholson, A., & Hemingway, H. (2006). Searching for observational studies: what does citation tracking add to PubMed? A case study in depression and coronary heart disease. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-6-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.