Cited by 2,103Meta-analysis and systematic reviewsData Quality and Managementscientometrics and bibliometrics research

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index; 1 of the 7 sources its claims cite were checked for support.

De-duplication of database search results for systematic reviews in EndNote

Open access
Bramer, Wichor M., Giustini, Dean, de Jonge, Gerdien B., Holland, Leslie, Bekhuis, Tanja·2016·Journal of the Medical Library Association : JMLA

Abstract

When conducting exhaustive searches for systematic reviews, information professionals search multiple databases with overlapping content [1][2][3][4].They typically remove duplicate records to reduce the reviewers' workload associated with screening titles and abstracts; sometimes the reviewers remove the duplicates.Several articles have been published recently on de-duplication methods.In the authors' opinion, these methods are either very time consuming [5] or impractical, as they require uploading large files to an online platform [6,7].A recent overview article compared existing software programs but found that none was truly satisfactory [8].Unique identifiers for journal articles are digital object identifiers (DOIs) and PubMed IDs (PMIDs).However, these identifiers are not present in every database.When they are present, they often cannot be exported easily.Thus, they cannot be relied upon to identify duplicates.An alternative involves using pagination, because the often large page numbers in scientific journals, in combination with other fields, can serve as a type of unique identifier.However, this is complicated by variations in the way page numbers are stored.Most biomedical databases use a long format (e.g.,

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This paper describes a detailed EndNote-based method for de-duplicating search results in systematic reviews, using page-number normalization and multiple field-comparison passes. The authors argue it is more systematic and reproducible than other approaches, with reduced manual checking and lower error rates, but it is tailored to EndNote and still fairly complex.

Key findings

  • The method has three stages: change field/display settings, import records through a temporary library and adapted export/import filters, then run several duplicate-detection passes with different field settings and remove probable duplicates.
  • The authors state that the time spent de-duplicating references and the error rate are “significantly reduced” because only a small subset of records needs manual assessment.
  • The method relies on pagination because DOIs and PMIDs are not present in every database and often cannot be exported easily; the paper notes that most biomedical databases use long page-number formats (e.g., 1008-1012) while MEDLINE and the Cochrane Library use abbreviated formats (e.g., 1008-12).
  • Table 1 lays out multiple duplicate-removal settings, including field combinations such as Author | Year | Title | Secondary (Journal) | Press, Delete, and other combinations involving Pages, Volume, and Issue.

Methods

  • Design: A methods/tool article describing an EndNote workflow for de-duplication; the method was previously presented in a brief conference paper and is here described in detail for EndNote X7.
  • Data/sample: Not an empirical sample; the paper discusses importing references from databases including PubMed, Ovid MEDLINE, and the Cochrane Library, and notes customized import filters for Embase.com, Web of Science, CINAHL, and Scopus.
  • Main analysis: The workflow compares records across multiple field combinations in EndNote, after normalizing page-number formats via custom export/import filters, and uses repeated duplicate-finding steps plus manual checking of subsets to remove false duplicates.

Limitations

  • The paper states the method is tuned to EndNote; it notes that Reference Manager was tried but “failed” because too many false duplicates were removed, and Reference Manager is no longer sold/support is likely discontinued.
  • The paper says the method is “rather complicated” and has a “steep” learning curve. This is a limitation stated by the authors.
  • Evident from the text: the method depends on databases exporting usable page numbers and journal-title formats, and the authors note that differences across databases and changes such as Cochrane’s switch to abbreviated page numbers and CINAHL’s page-length suffixes complicate the workflow.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3163/1536-5050.104.3.014

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

11 Own interpretation · 3 Sources not found · 2 No basis given · 1 Supported so far · 1 Own result

Show all 6 claims

  • Probably not a substantial claim. 10
  • It may state two separate claims as one. 5
12 of 12
  • The paper relies on this without support.

    Information professionals typically remove duplicate records to reduce the reviewers' workload associated with screening titles and abstracts; sometimes the reviewers remove the duplicates.

    “They typically remove duplicate records to reduce the reviewers' workload associated with screening titles and abstracts; sometimes the reviewers remove the duplicates.”
  • The paper relies on this without support.

    DOIs and PMIDs are not present in every database.

    “However, these identifiers are not present in every database.”
  • The paper relies on this without support.

    When DOIs and PMIDs are present, they often cannot be exported easily.

    “When they are present, they often cannot be exported easily.”
  • The paper relies on this without support.

    Page numbers, in combination with other fields, can serve as a type of unique identifier.

    “An alternative involves using pagination, because the often large page numbers in scientific journals, in combination with other fields, can serve as a type of unique identifier.”
  • The paper relies on this without support.

    Variations in the way page numbers are stored complicate using pagination.

    “However, this is complicated by variations in the way page numbers are stored.”
  • The paper relies on this without support.

    Most biomedical databases use a long page number format (e.g., 1008-1012).

    “Most biomedical databases use a long format (e.g., 1008-1012)”
  • The paper relies on this without support.

    MEDLINE and the Cochrane Library use an abbreviated page number format (e.g., 1008-12).

    “two important databases (MEDLINE and the Cochrane Library) use an abbreviated one (e.g., 1008-12).”
  • The paper relies on this without support.

    The de-duplication method designed for EndNote is more systematic, rigorous, and reproducible than procedures regularly carried out by other information professionals.

    “Although the de-duplication method that we designed for EndNote resembles procedures regularly carried out by other information professionals, it is more systematic, rigorous, and reproducible.”
  • The paper relies on this without support.

    EndNote is commonly used to manage bibliographic records.

    “however, EndNote is commonly used to manage bibliographic records.”
  • The paper relies on this without support.

    Reference Manager is no longer for sale, and support for Reference Manager will likely be discontinued.

    “Additionally, Reference Manager is no longer for sale, and support for Reference Manager will likely be discontinued.”
  • The paper relies on this without support.

    Databases differ in the format of the exported journal titles.

    “Databases also differ in the format of the exported journal titles.”
  • The paper relies on this without support.

    Some databases use abbreviations, while others provide full journal titles.

    “Some databases use abbreviations, while others provide full journal titles.”
  • The paper relies on this without support.

    Cochrane recently switched from exporting full page numbers to abbreviated page numbers.

    “Cochrane recently switched from exporting full page numbers to abbreviated page numbers”
  • The paper relies on this without support.

    CINAHL recently appended the length of the article in the fields for page numbers (e.g., in the format 1008-1012 5p).

    “CINAHL recently appended the length of the article in the fields for page numbers (e.g., in the format 1008-1012 5p).”
14 of 14

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 8 references

Research works printed but not linked: 5

  1. [2]2. search techniques to NICE public health guidance. Evid Based Libr Inf Pract. 2015;10(1):50-68.
  2. [9]9. Bramer WM, Holland L, Mollema J, Hannon T, Bekhuis - T. Removing duplicates in retrieval sets from electronic databases: comparing the efficiency and accuracy of the Bramer-method with other methods and software packages. Proceedings of the 14th European Association for Health Information and Libraries (EAHIL) Conference, 57-9; Rome, Italy; 11-13 Jun 2014.
  3. [11]11. National Library of Medicine. PubMed [Internet]. The Library; 2016 [cited 4 Feb 2016]. , http://www.ncbi.nlm. nih.gov/pubmed/ . .
  4. [12]12. Ovid MEDLINE [Internet]. Wolters Kluwer; 2016 [cited 4 Feb 2016]. , http://site.ovid.com/pdf/ OvidMedline\_fs.pdf . .
  5. [13]13. Cochrane. Cochrane Library [Internet]. John Wiley & Sons; 2016 [cited 4 Feb 2016]. , http://www. cochranelibrary.com . .

Cited by

Sorted by citations

Items 901–1,000 of 1,918

Metadata

Authors
Bramer, W. M., Giustini, D., de Jonge, G. B., Holland, L., & Bekhuis, T.
Affiliations
  • Erasmus MC (NL)
  • University of British Columbia (CA)
  • Southern College of Optometry (US)
  • University of Pittsburgh (US)
Venue
Journal of the Medical Library Association : JMLA
Published
2016-07
Volume
104
Issue
3
Pages
240-243
ISSN
  • 1536-5050 (ISSN-L)
  • 1558-9439
OpenAlex
W2471940872
Cited by
2,103
References
8
Citations by year
2026: 346 · 2025: 333 · 2024: 419 · 2023: 340 · 2022: 252 · 2021: 218 · 2020: 113 · 2019: 48 · 2018: 18 · 2017: 13 · 2016: 2
FWCI
5.54
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of the Medical Library Association JMLA (publishedVersion, cc-by)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Computer Science › Information Systems › Data Quality and Management
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
data deduplication, duplicate records, database search results, systematic reviews, EndNote, information professionals, bibliographic databases
MeSH terms
Review Literature as Topic, Databases, Bibliographic, Information Storage and Retrieval

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review