CoChat

PubMed related articles: a probabilistic topic-based model for content similarity

Open access
Lin, Jimmy, Wilbur, W John · 2007 · BMC Bioinformatics

The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.

Abstract

BACKGROUND: We present a probabilistic topic-based model for content similarity called pmra that underlies the related article search feature in PubMed. Whether or not a document is about a particular topic is computed from term frequencies, modeled as Poisson distributions. Unlike previous probabilistic retrieval models, we do not attempt to estimate relevance-but rather our focus is "relatedness", the probability that a user would want to examine a particular document given known interest in another. We also describe a novel technique for estimating parameters that does not require human relevance judgments; instead, the process is based on the existence of MeSH in MEDLINE. RESULTS: The pmra retrieval model was compared against bm25, a competitive probabilistic model that shares theoretical similarities. Experiments using the test collection from the TREC 2005 genomics track shows a small but statistically significant improvement of pmra over bm25 in terms of precision. CONCLUSION: Our experiments suggest that the pmra model provides an effective ranking algorithm for related article search.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-2105-8-423

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 A typical view in the PubMed search interface showing an abstract in detail. The "Related Links" panel on the right is populated with titles of articles that may be of interest.
Figure 1 A typical view in the PubMed search interface showing an abstract in detail. The "Related Links" panel on the right is populated with titles of articles that may be of interest.CC BY · PubMed Central
Figure 2 P5 for the bm25 model given different settings of the parameters k1 and b. This plot was generated by exhaustively trying all k1 values 0.5 to 3.0 (in 0.1 increments) and b values 0.6 to 1.0 (in 0.05 increments). Notice that except for low values of k1 and b, P5 performance is relatively insensitive to parameter settings.
Figure 2 P5 for the bm25 model given different settings of the parameters k1 and b. This plot was generated by exhaustively trying all k1 values 0.5 to 3.0 (in 0.1 increments) and b values 0.6 to 1.0 (in 0.05 increments). Notice that except for low values of k1 and b, P5 performance is relatively insensitive to parameter settings.CC BY · PubMed Central
Figure 3 P5 for the pmra model given different settings of the parameters λ (Poisson parameter for the elite distribution) and μ (Poisson parameter for the non-elite distribution). Notice that the parameter settings resulting in high P5 values lie along a "ridge" in the parameter space.
Figure 3 P5 for the pmra model given different settings of the parameters λ (Poisson parameter for the elite distribution) and μ (Poisson parameter for the non-elite distribution). Notice that the parameter settings resulting in high P5 values lie along a "ridge" in the parameter space.CC BY · PubMed Central
Figure 4 Optimal μ (Poisson parameter for the non-elite distribution) for each λ value (Poisson parameter for the elite distribution) in the pmra model. Regression line shows a linear relationship between these two parameters, corresponding to the "ridge" in Figure 3.
Figure 4 Optimal μ (Poisson parameter for the non-elite distribution) for each λ value (Poisson parameter for the elite distribution) in the pmra model. Regression line shows a linear relationship between these two parameters, corresponding to the "ridge" in Figure 3.CC BY · PubMed Central
Figure 5 P5 at optimal and interpolated values of μ for each λ in the pmra model. Squares represent optimal μ at each λ, corresponding to the squares in Figure 4. Diamonds represent interpolated μ at each λ, corresponding to the regression line in Figure 4. P5 of the globally optimal parameter setting is shown as the dotted line. The filled square and diamond represent points at which P5 is significantly lower than the globally optimal setting.
Figure 5 P5 at optimal and interpolated values of μ for each λ in the pmra model. Squares represent optimal μ at each λ, corresponding to the squares in Figure 4. Diamonds represent interpolated μ at each λ, corresponding to the regression line in Figure 4. P5 of the globally optimal parameter setting is shown as the dotted line. The filled square and diamond represent points at which P5 is significantly lower than the globally optimal setting.CC BY · PubMed Central
Figure 6 Distribution of original ranks for reranked run: pmra (λ = 0.022, μ = 0.013). The bar graph divides the original rank positions into ten bins and tallies the fraction of hits that were brought into the top five by pmra; for example, approximately 80% of the top five pmra results came from the top ten results in the original ranked list. The line graph shows the cumulative distribution.
Figure 6 Distribution of original ranks for reranked run: pmra (λ = 0.022, μ = 0.013). The bar graph divides the original rank positions into ten bins and tallies the fraction of hits that were brought into the top five by pmra; for example, approximately 80% of the top five pmra results came from the top ten results in the original ranked list. The line graph shows the cumulative distribution.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 1

  1. Lin J, DiCuccio M, Grigoryan V, Wilbur WJ: Exploring the Effectiveness of Related Article Search in PubMed. In Tech. Rep. LAMP-TR-145/CS-TR-4877/UMIACS-TR-2007–36/HCIL-2007–10. University of Maryland, College Park, Maryland; 2007.

Cited by

See all 243

Metadata

Authors
Lin, J., & Wilbur, W. J.
Affiliations
  • National Center for Biotechnology Information (US)
  • National Institutes of Health (US)
Corresponding author
Lin, Jimmy
Venue
BMC Bioinformatics
Published
2007-10-30
Volume
8
Issue
1
Pages
423-423
ISSN
1471-2105 (ISSN-L)
OpenAlex
W2061172803
Cited by
243
References
29
Citations by year
2025: 9 · 2024: 15 · 2023: 13 · 2022: 11 · 2021: 10 · 2020: 24 · 2019: 19 · 2018: 8 · 2017: 18 · 2016: 12 · 2015: 17 · 2014: 22 · 2013: 11 · 2012: 14
FWCI
25.83
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/2.0 (tdm)
Locations
  • BMC Bioinformatics (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • University Libraries (University of Maryland) (submittedVersion)
  • Digital Repository at the University of Maryland (University of Maryland College Park)
Funders
  • National Institutes of Health
  • U.S. National Library of Medicine
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
  • Physical Sciences › Mathematics › Theoretical Computer Science › Algorithms and Data Compression
Keywords
PubMed, probabilistic retrieval models, content similarity, relatedness, mesh, MEDLINE, BM25, document ranking
MeSH terms
Algorithms, Artificial Intelligence, Data Interpretation, Statistical, Natural Language Processing, Periodicals as Topic, Models, Statistical, Bibliometrics, Vocabulary, Controlled, PubMed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: PubMed related articles: a probabilistic topic-based model for content similarity. https://app.cochat.ai/papers/10.1186/1471-2105-8-423
The paper
Lin, J., & Wilbur, W. J. (2007). PubMed related articles: a probabilistic topic-based model for content similarity. BMC Bioinformatics. https://doi.org/10.1186/1471-2105-8-423

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.