Find Duplicates among the PubMed, EMBASE, and Cochrane Library Databases in Systematic Review
Open accessThe DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Finding duplicates is an important phase of systematic review. However, no consensus regarding the methods to find duplicates has been provided. This study aims to describe a pragmatic strategy of combining auto- and hand-searching duplicates in systematic review and to evaluate the prevalence and characteristics of duplicates. METHODS AND FINDINGS: Literatures regarding portal vein thrombosis (PVT) and Budd-Chiari syndrome (BCS) were searched by the PubMed, EMBASE, and Cochrane library databases. Duplicates included one index paper and one or more redundant papers. They were divided into type-I (duplicates among different databases) and type-II (duplicate publications in different journals/issues) duplicates. For type-I duplicates, reference items were further compared between index and redundant papers. Of 10936 papers regarding PVT, 2399 and 1307 were identified as auto- and hand-searched duplicates, respectively. The prevalence of auto- and hand-searched redundant papers was 11.0% (1201/10936) and 6.1% (665/10936), respectively. They included 3431 type-I and 275 type-II duplicates. Of 11403 papers regarding BCS, 3275 and 2064 were identified as auto- and hand-searched duplicates, respectively. The prevalence of auto- and hand-searched redundant papers was 14.4% (1640/11403) and 9.1% (1039/11403), respectively. They included 5053 type-I and 286 type-II duplicates. Most of type-I duplicates were identified by auto-searching method (69.5%, 2385/3431 in PVT literatures; 64.6%, 3263/5053 in BCS literatures). Nearly all type-II duplicates were identified by hand-searching method (94.9%, 261/275 in PVT literatures; 95.8%, 274/286 in BCS literatures). Compared with those identified by auto-searching method, type-I duplicates identified by hand-searching method had a significantly higher prevalence of wrong items (47/2385 versus 498/1046, p<0.0001 in PVT literatures; 30/3263 versus 778/1790, p<0.0001 in BCS literatures). Most of wrong items originated from EMBASE database. CONCLUSION: Given the inadequacy of a single strategy of auto-searching method, a combined strategy of auto- and hand-searching methods should be employed to find duplicates in systematic review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The deduplication process involves long manual procedures, potentially leading to quality-affecting outcome errors [ 6 , 17 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“When searching in multiple databases and additional information sources, as is necessary for a systematic review, authors often employ a variety of techniques to reduce the number of duplicates within their results prior to screening [135 -138].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [135]
The cited source says what the claim attributes to it.
In the citing paper
“Typically, auto-deduplication is only partially successful [ 18 ]”
From Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module (2015) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“A recent study by Qi [ 18 ] examined the content of undetected duplicate records in EndNote and found that errors often occurred due to missing or wrong data in the fields, especially for records retrieved from EMBASE database.”
From Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module (2015) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,171
Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions
Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00006 · Cited by 2,184 · cited 1×
“It provides the top level of evidence for clinical decision [3,4].”
BackgroundEpidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 13×
“In conclusions, a high prevalence of duplicates could be identified among the PubMed, EMBASE, and Cochrane Library databases in systematic review.”
BackgroundInfluentialThe Relation between Systematic Reviews and Practice Guidelines
Cook, D. J., Greengold, N. L., Ellrodt, A. G., & Weingarten, S. R. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-3-199708010-00006 · Cited by 413 · cited 1×
“It provides the top level of evidence for clinical decision [3,4].”
BackgroundDifferent Patterns of Duplicate Publication: An Analysis of Articles Used in Systematic Reviews
von Elm, E., Poglia, G., Walder, B., & Tramèr, M. R. (2004) · JAMA · doi:10.1001/jama.291.8.974 · Cited by 290
Qi, X., De Stefano, V., Wang, J., Bai, M., Yang, Z., Han, G., & Fan, D. (2013) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.12085 · Cited by 84 · cited 3×
“The selection of the two fields was primarily attributed to our research interests in the two vascular disorders of the liver [6,7,8,9,10,11].”
BackgroundResultSelf-citation
Cited by
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714
De-duplication of database search results for systematic reviews in EndNote
Bramer, W. M., Giustini, D., de Jonge, G. B., Holland, L., & Bekhuis, T. (2016) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.104.3.014 · Cited by 2,103
Daskalopoulou, C., Stubbs, B., Kralj, C., Koukounari, A., Prince, M., & Prina, A. M. (2017) · Ageing Research Reviews · doi:10.1016/j.arr.2017.06.003 · Cited by 501
Systematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472
“, EndNote [82], ProCite [83]) already have automatic search for duplicate records to semi-automate citation deduplication quite accurately [78,79].”
Background
Metadata
- Authors
- Qi, X., Yang, M., Ren, W., Jia, J., Wang, J., Han, G., & Fan, D.
- Affiliations
- Hospital 463 People's Liberation Army (CN)
- Xijing Hospital (CN)
- Corresponding author
- Qi, Xingshun
- Han, Guohong
- Fan, Daiming
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-08-20
- Volume
- 8
- Issue
- 8
- Pages
- e71838
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3748039
- OpenAlex
- W1995586849
- Cited by
- 98
- References
- 17
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 14 · 2023: 7 · 2022: 11 · 2021: 8 · 2020: 3 · 2019: 4 · 2018: 5 · 2017: 7 · 2016: 12 · 2015: 11 · 2014: 4 · 2013: 3
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- duplicate detection, systematic reviews, duplicate publication, hand searching, portal vein thrombosis, Budd-Chiari syndrome, literature search strategies, bibliographic databases, Cochrane Library, Embase, PubMed
- MeSH terms
- Systematic Reviews as Topic, Budd-Chiari Syndrome, Humans, Portal Vein, Thrombosis, Duplicate Publications as Topic, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Find Duplicates among the PubMed, EMBASE, and Cochrane Library Databases in Systematic Review. https://app.cochat.ai/papers/10.1371/journal.pone.0071838
- The paper
- Qi, X., Yang, M., Ren, W., Jia, J., Wang, J., Han, G., & Fan, D. (2013). Find Duplicates among the PubMed, EMBASE, and Cochrane Library Databases in Systematic Review. PLoS ONE. https://doi.org/10.1371/journal.pone.0071838
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.