Cited by 117Recommender Systems and TechniquesInformation Retrieval and Search BehaviorAdvanced Bandit Algorithms Research

Popularity Bias is not Always Evil: Disentangling Benign and Harmful Bias for Recommendation

Open access
Zhao, Zihao, Chen, Jiawei, Zhou, Sheng, He, Xiangnan, Cao, Xuezhi, Zhang, Fuzheng, Wu, Wei·2023·IEEE Transactions on Knowledge and Data Engineering

Abstract

Recommender system usually suffers from severepopularity bias— the collected interaction data usually exhibits quite imbalanced or even long-tailed distribution over items. Such skewed distribution may result from the users’conformityto the group, which deviates from reflecting users’ true preference. Existing efforts for tackling this issue mainly focus on completely eliminating popularity bias. However, we argue that not all popularity bias is evil. Popularity bias not only results from conformity but alsoitem quality, which is usually ignored by existing methods. Some items exhibit higher popularity as they have intrinsic better property. Blindly removing the popularity bias would lose such important signal, and further deteriorate model performance. To sufficiently exploit such important information for recommendation, it is essential to disentangle the benign popularity bias caused by item quality from the harmful popularity bias caused by conformity. Although important, it is quite challenging as we lack an explicit signal to differentiate the two factors of popularity bias. In this paper, we propose to leverage temporal information as the two factors exhibit quite different patterns along the time: item quality revealing item inherent property is stable and static while conformity that depends on items’ recent clicks is highly time-sensitive. Correspondingly, we further propose a novelTime-awareDisEntangled framework (TIDE), where a click is generated from three components namely the static item quality, the dynamic conformity effect, as well as the user-item matching score returned by any recommendation model. Lastly, we conduct interventional inference so that the recommendation can benefit from the benign popularity bias while circumvent the harmful one. Extensive experiments on four real-world datasets demonstrated the effectiveness of TIDE.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tkde.2022.3218994

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • An appropriate proportion of popularity bias in the system can improve performance and user satisfaction.

    “An appropriate proportion of popularity bias in the system can improve performance and user satisfaction [183].”

    From A Deep Dive into Fairness, Bias, Threats, and Privacy in Recommender Systems: Insights and Future Research (2024) · cites this paper as [183]

    The Introduction and §2.1 say that popularity bias arising from item quality can benefit recommendations, while bias arising from conformity is harmful; the Popularity Bias in recommendation section says leveraging the quality signal can boost performance. §2.2 treats higher ratings as suggesting greater satisfaction with an item, but the paper does not establish that a particular proportion of popularity bias improves user satisfaction. Its proposed distinction is between benign and harmful sources of bias, not an optimal amount of bias. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Popularity bias can act as a double-edged sword.

    “Moreover, popularity bias can act as a double-edged sword [182, 183].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 48 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Zhao, Z., Chen, J., Zhou, S., He, X., Cao, X., Zhang, F., & Wu, W.
Affiliations
  • University of Science and Technology of China (CN)
  • Zhejiang University (CN)
  • Meituan (China) (CN)
Venue
IEEE Transactions on Knowledge and Data Engineering
Published
2023-10-01
Volume
35
Issue
10
Pages
9920-9931
ISSN
  • 1041-4347 (ISSN-L)
  • 1558-2191
  • 2326-3865
OpenAlex
W4312551924
Cited by
117
References
48
Citations by year
2026: 21 · 2025: 36 · 2024: 35 · 2023: 21 · 2022: 4
FWCI
23.75
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Key Research and Development Program of China (2021ZD0111802)
  • National Natural Science Foundation of China (62102382, 61972372, U21B2026)
  • Meituan Inc.
  • CCCD Key Lab of Ministry of Culture and Tourism
  • Starry Night Science Fund of Zhejiang University Shanghai Institute for Advanced Study (SN-ZJU-SIAS-001)
Topics
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
Keywords
popularity bias, recommender systems, item quality, temporal modeling, disentangled representations, click data

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review