The DOI matches its Crossref record; 26 of the 28 references it cites were found in a registry or an index.
The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation
Open accessAbstract
Recently there has been a growing interest in fairness-aware recommender systems including fairness in providing consistent performance across different users or groups of users. A recommender system could be considered unfair if the recommendations do not fairly represent the tastes of a certain group of users while other groups receive recommendations that are consistent with their preferences. In this paper, we use a metric called miscalibration for measuring how a recommendation algorithm is responsive to users’ true preferences and we consider how various algorithms may result in different degrees of miscalibration for different users. In particular, we conjecture that popularity bias which is a well-known phenomenon in recommendation is one important factor leading to miscalibration in recommendation. Our experimental results using two real-world datasets show that there is a connection between how different user groups are affected by algorithmic popularity bias and their level of interest in popular items. Moreover, we show that the more a group is affected by the algorithmic popularity bias, the more their recommendations are miscalibrated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current recommendation systems appear to disproportionately amplify high-popularity accounts, creating inequality in exposure that may result in less personalized and miscalibrated recommendations for certain user groups [1].”
From Auditing Political Exposure Bias: Algorithmic Amplification on Twitter/X During the 2024 U.S. Presidential Election (2025) · cites this paper as [1]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matrix Factorization Techniques for Recommender Systems
Koren, Y., Bell, R. M., & Volinsky, C. (2009) · Computer · doi:10.1109/mc.2009.263 · Cited by 11,232
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135
The MovieLens Datasets: History and Context
Harper, F., & Konstan, J. (2016) · TIIS · doi:10.1145/2827872 · Cited by 5,938
Factorization meets the neighborhood
Koren, Y. (2008) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401944 · Cited by 3,959
Resnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Evaluating Recommendation Systems
Shani, G., & Gunawardana, A. (2010) · Springer eBooks · doi:10.1007/978-0-387-85820-3_8 · Cited by 1,430
Fairness-Aware Classifier with Prejudice Remover Regularizer
Kamishima, T., Akaho, S., Asoh, H., & Sakuma, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_3 · Cited by 694
Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques
Adomavičius, G., & Kwon, Y. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.15 · Cited by 674
Fairness of Exposure in Rankings
Singh, A., & Joachims, T. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220088 · Cited by 673
Flagged first, then by citations
2 of the 28 references couldn’t be matched to a known paper.
Research works printed but not linked: 11
- Abdollahpouri Himan, 2019, The Thirty-Second International Flairs Conference.
- Bozdag Engin, 2013, Bias in algorithmic filtering and personalization. Ethics and information technology 15, 3
- Erik Brynjolfsson Yu Jeffrey Hu and Michael D Smith. 2006. From niches to riches: Anatomy of the long tail. Sloan Management Review(2006) 67–71. Erik Brynjolfsson Yu Jeffrey Hu and Michael D Smith. 2006. From niches to riches: Anatomy of the long tail. Sloan Management Review(2006) 67–71.
- Ekstrand D, 2018, Conference on Fairness, Accountability and Transparency. 172–186
- Guo Guibing, 2015, UMAP Workshops.
- Kamishima Toshihiro, 2014, Poster Proceedings of the 8th ACM Conference on Recommender Systems, RecSys 2014
- Liu Weiwen, 2018, 2nd FATRec Workshop held at RecSys
- Mansoury Masoud, 2020, Investigating Potential Factors Associated with Gender Discrimination in Collaborative Recommender Systems. In The Thirty-Third International Flairs Conference.
- Narayanan Arvind, 2018, Proc. Conf. Fairness Accountability Transp.
- Shani Guy, Recommender systems handbook
- Zafar Muhammad Bilal, 2017, Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. arXiv preprint arXiv:1507
Cited by
Sorted by citations
Items 101–184 of 184
Treuillier, C., Castagnos, S., Dufraisse, E., Özgöbek, Ö., & Brun, A. (2026) · ACM Transactions on Recommender Systems · doi:10.1145/3790097 · Cited by 3
Hess, L., & Häusermann, S. (2026) · Platforms & Society · doi:10.1177/29768624261427203 · Cited by 3
The MovieLens Beliefs Dataset: Collecting Pre-Choice Data for Online Recommender Systems
Aridor, G., Gonçalves, D., Kong, R., Kluver, D., & Konstan, J. A. (2024) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3640457.3688158 · Cited by 3
Interactive Counterfactual Exploration of Algorithmic Harms in Recommender Systems
Ahn, Y., Wolter, Q. K., Dick, J., Dick, J., & Lin, Y.-R. (2024) · IEEE Visualization in Data Science (VDS) · doi:10.1109/vds63897.2024.00009 · Cited by 4
CSLP: Collaborative Solution to Long-Tail Problem and Popularity Bias in Sequential Recommendation
Huang, Y., Yang, Z., Hu, W., Xu, B., & Zhang, Z. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831683 · Cited by 3
Do Calibrated Recommendations Affect Explanations? A Study on Post-Hoc Adjustments
Atauchi, P. D. F., Zanon, A. L., da Rocha, L. C. D., & Manzato, M. G. (2025) · Journal on Interactive Systems · doi:10.5753/jis.2025.5563 · Cited by 3
İşbirlikçi Filtreleme Algoritmalarının Çok-Beğenilen Ürünlere Yönelik Yanlılığı
Yalçın, E. (2021) · Bilecik Şeyh Edebali Üniversitesi Fen Bilimleri Dergisi · doi:10.35193/bseufbd.884634 · Cited by 3
Considering Time and Feature Entropy in Calibrated Recommendations
da Silva, D. C., Jannach, D., & Dur�ão, F. A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3716858 · Cited by 3
Alleviating Sparsity Problem of Recommender System with No Extra Input Data
Wang, H. (2022) · International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE) · doi:10.1109/aemcse55572.2022.00139 · Cited by 3
Temporal Extraction and Retrieval
Alonso, O., & Spaniol, M. (2024) · ACM eBooks · doi:10.1145/3674127.3674137 · Cited by 2
Tonellotto, N. (2024) · ACM eBooks · doi:10.1145/3674127.3674130 · Cited by 3
Kullanıcı Eğilimlerinin Göreceli Modellenmesinin Popülerlik Yanlılığına Etkisi
Balli, N., & Kaya, T. T. (2025) · Çukurova Üniversitesi Mühendislik Fakültesi Dergisi · doi:10.21605/cukurovaumfd.1748924 · Cited by 2
da Silva, D. C., Pires, J. M., & Dur�ão, F. A. (2025) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2025.247026 · Cited by 2
CALISSTA: Calibrated Candidate Retrieval Using Sparse Autoencoders and Top-k Aggregation
Dokoupil, P., Boratto, L., & Peška, L. (2026) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3774935.3806154 · Cited by 2
Valluru, S. L., Widener, M., Srivastava, B., & Gangopadhyay, S. (2024) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3632410.3632503 · Cited by 2
Verberne, S. (2024) · ACM eBooks · doi:10.1145/3674127.3674141 · Cited by 5
Ferro, N., & Maistro, M. (2024) · ACM eBooks · doi:10.1145/3674127.3674132 · Cited by 3
Privacy in Information Retrieval
Soboroff, I. M. (2024) · ACM eBooks · doi:10.1145/3674127.3674139 · Cited by 2
Effects of Representation Nudges on the Perception of Playlist Recommendations
Khan, S. N., Herder, E., & Kaya, D. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-87654-7_14 · Cited by 2
Unbiased, Effective, and Efficient Distillation from Heterogeneous Models for Recommender Systems
Kang, S., Kweon, W., Lee, D., Lian, J., Xie, X., & Yu, H. (2024) · ACM Transactions on Recommender Systems · doi:10.1145/3649443 · Cited by 2
Misztal-Radecka, J., & Indurkhya, B. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78818-6_9 · Cited by 2
eCommerce Search and Discovery
Kallumadi, S. T., & King, T. H. (2024) · ACM eBooks · doi:10.1145/3674127.3674140 · Cited by 1
The Challenges of Graph Neural Networks
Vetrivel, S. C., Vidhyapriya, P., & Arun, V. P. (2025) · Springer eBooks · doi:10.1007/978-3-031-88538-9_5 · Cited by 1
Single-Branch Network Architectures to Close the Modality Gap in Multimodal Recommendation
Ganhör, C., Moscati, M., Hausberger, A., Nawaz, S., & Schedl, M. (2025) · ACM Transactions on Recommender Systems · doi:10.1145/3769430 · Cited by 1
Aprimorando a Personalização de Sistemas de Recomendação por Calibração Multicategoria
Atauchi, P. D. F., Zanon, A. L., Rocha, L., & Manzato, M. G. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.16145 · Cited by 1
Mitigating Popularity Bias for Two-Sided Fairness via Dual-Teacher Distillation in Recommendation
Guo, C., Wang, X., Zhu, C., Liang, J., Yang, H., & Chang, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-0363-5_10 · Cited by 1
Aligning Recommendations with User Popularity Preferences
Schirmer, M., Thielmann, A., Schwöbel, P., Martynec, T., Benedetto, G. D., London, B., & Stein, Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806483 · Cited by 1
Explorando Justiça em Sistemas de Recomendação
da Silva, D. C., & Dur�ão, F. A. (2022) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia_estendido.2022.225303 · Cited by 1
Fairness in Graph-based Recommendation: Methods Overview
Čutura, L., Vladimir, K., Delač, G., & Šilić, M. (2024) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro60963.2024.10569148 · Cited by 2
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_2 · Cited by 1
Galuščáková, P., Oard, D. W., & Nair, S. (2024) · ACM eBooks · doi:10.1145/3674127.3674136 · Cited by 2
Gómez, E., Cuesta, H., Gkiokas, A., Gómez-Cañón, J. S., Porcaro, L., & Yesiler, F. (2024) · ACM eBooks · doi:10.1145/3674127.3702959 · Cited by 1
Baeza-Yates, R. A., Murgai, L., & Dudy, S. (2024) · ACM eBooks · doi:10.1145/3674127.3674138 · Cited by 1
Bias disparity in graph-based collaborative filtering recommenders
Boltsis, G., & Pitoura, E. (2022) · ACM Symposium on Applied Computing · doi:10.1145/3477314.3507209 · Cited by 1
Tackling the RecSys Side Effects via Deep Learning Approaches
Coppolillo, E. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-42941-5_57 · Cited by 1
Zipf Matrix Factorization : Matrix Factorization with Matthew Effect ReductionPreprint
Wang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07347 · Cited by 1
Elimination of Popularity Bias Based on Improved Counterfactual Inference Model
王, 磊. (2023) · Computer Science and Application · doi:10.12677/csa.2023.1310194
Debiasing Recommenders Through Personalized Popularity-Aware Margins
Yu, R., Chen, Y., Zhao, M., Yu, J., Xu, T., Yu, M., & Li, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447541
Conclusions and Open Challenges
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_6
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_5
Biases, Fairness, and Non-discrimination
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_3
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_1
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_4
Alonso, O., & Baeza-Yates, R. (2024) · ACM eBooks · doi:10.1145/3674127.3674128
Searching Personal Collections
Bendersky, M., Metzler, D., Najork, M., & Wang, X. (2024) · ACM eBooks · doi:10.1145/3674127.3674142
Query-driven Search Functionality
Li, L. (2024) · ACM eBooks · doi:10.1145/3674127.3674133
Alonso, O., & Baeza-Yates, R. (2024) · ACM eBooks · doi:10.1145/3674127.3702962
Alonso, O., & Baeza-Yates, R. (2024) · ACM eBooks · doi:10.1145/3674127.3674129
Alonso, O., & Baeza-Yates, R. (2024) · ACM eBooks · doi:10.1145/3674127.3702961
Hersh, W., & Roberts, K. E. (2024) · ACM eBooks · doi:10.1145/3674127.3702960
Bast, H., Kalmbach, J., Klumpp, T., & Korzen, C. (2024) · ACM eBooks · doi:10.1145/3674127.3674134
Exploring and Exploiting Data Heterogeneity in Recommendation
Wang, Z., Liu, J., Zou, H., Zhang, X., He, Y., Liang, D., & Cui, P. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3737290 · Cited by 1
Bedoya, D., Henry, A., Sørensen, J. K., Holm, R., & Hernández, S. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5290737
Disentangled Interest and Popularity Modeling with Causal Intervention for Sequential Recommendation
Zhou, J., Wen, W., & Ye, G. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9812-7_34
A Non-Parametric Choice Model That Learns How Users Choose Between Recommended Options
Krause, T., & Oosterhuis, H. (2025) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3705328.3748090
On Inherited Popularity Bias in Cold-Start Item Recommendation
Meehan, G., & Pauwels, J. (2025) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3705328.3748035
Gender-aware fairness in iterative recommender systems: A simulation study on popularity bias
Zoralioğlu, Y., & Yalçın, E. (2025) · Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.28948/ngumuh.1667487
Han, Y., Xu, B., Wang, Y., & Gao, S. (2025) · Omega · doi:10.1016/j.omega.2025.103475
Compound quality model for recommender system evaluation
Tsyplov, A. M., & Boukhanovsky, A. V. (2025) · Scientific and technical journal of information technologies mechanics and optics · doi:10.17586/2226-1494-2025-25-6-1117-1124
EDGE++: Enhanced Direction Attention via Top-k Refinement for Long-Tail Recommendation
Nguyen, T.-H., Le, M.-K., & Le, D.-T. (2025) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse68178.2025.11309660
Bias in Book Recommendation: A Case Study on the Danish Public Libraries
Daniil, S., Mollerup, S. H., & Laura Hollink, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21324-2_22
Differentially Private and Fair Algorithmic Hiring for Recruiters
Davidopoulos, S., Sacharidis, D., & Symeonidis, P. (2026) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3774935.3806147
Value-Aware Recommender Systems for Strategic Intelligence in Digital Cultural Ecosystems
Cekuls, A., Marfia, G., & Cascarano, P. (2026) · Journal of Intelligence Studies in Business · doi:10.37380/jisib.v16i1.3136
Amanov, D., Faria, S. R., Hossain, M. N., Islam, M. M., & Uddin, M. M. (2026) · Research Square · doi:10.21203/rs.3.rs-9903457/v1
Justiça, Responsabilidade, Transparência e Ética (FATE) em sistemas de recomendação na educação:
dos Santos, R. A., Beni, P. F., Reategui, E. B., & Barone, D. A. C. (2026) · Revista Ibero-Americana de Ciência da Informação · doi:10.26512/rici.v19.n2.2026.60555
Calibrate Your Items! Train CTR Models in Two Steps for Robust Recommendations
Han, Y., & Fleischman, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808407
Calibrated Recommendations with Dynamic User Preferences
Lin, K., Mansoury, M., Eskandanian, F., Sabouri, M., & Mobasher, B. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-30552-7_20
Self-citationAdaptive Autoguidance for Item-Side Fairness in Diffusion Recommender Systems
Li, Z., Escobedo, G., Moscati, M., Lesota, O., & Schedl, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809912
Sun, R., Zent, M., Zhao, M., Li, X., Boyapati, T., & Konstan, J. A. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809534
Yu, Y., Zheng, S., Wang, T., & Shi, Y. (2026) · Springer eBooks · doi:10.1007/978-981-95-9965-3_1
PILA'26: Personal Intelligence in Agentic AI Era
Zhao, X., Zhang, Y., Li, M., Gao, C., Shao, P., Wang, W., Cheng, H., Feng, F., Zhang, Y., & Song, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818258
Kaya, T. T. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116804
DualPop: User Popularity Preference-Aware Debiasing Recommendation
Li, Z., Chi, Y., Shi, Y., Wang, J., Chen, Z., & Li, H. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3833876
Ju, Y., Lee, J., & Park, S. (2026) · Electronics · doi:10.3390/electronics15173917
Jia, S., Du, J. T., & Yan, H. (2026) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70114
When reach and loyalty scale together: a digital music benchmark for marketing analytics
Šulik, M. (2026) · Journal of Marketing Analytics · doi:10.1057/s41270-026-00541-8
Fairness-Accuracy Trade-Offs in Group Recommendations: A Nash Bargaining Approach
Faruqui, T. B., Stratigi, M., & Stefanidis, K. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39823-9_38
Davidopoulos, S., Symeonidis, P., Sacharidis, D., & Manolopoulos, Y. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01321-4
Roy, F., Ding, X., Choo, K. K. R., & Zhou, P. (2024) · arXiv · doi:10.48550/arxiv.2409.12651 · Cited by 7
Metadata
- Authors
- Abdollahpouri, H., Mansoury, M., Burke, R., & Mobasher, B.
- Affiliations
- University of Colorado Boulder (US)
- Eindhoven University of Technology (NL)
- DePaul University (US)
- Venue
- Fourteenth ACM Conference on Recommender Systems
- Publisher
- ACM
- Published
- 2020-09-22
- Pages
- 726-731
- OpenAlex
- W3080925373
- Cited by
- 183
- References
- 28
- Citations by year
- 2026: 24 · 2025: 27 · 2024: 56 · 2023: 34 · 2022: 25 · 2021: 17
- FWCI
- 14.41
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Conference on Recommender Systems (RecSys) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National science foundation (1911025)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Game Theory and Voting Systems
- Keywords
- popularity bias, calibration error, recommendation fairness, recommender systems, user preference representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
