The DOI matches its Crossref record.
The MovieLens Datasets: History and Context
Abstract
The MovieLens datasets are widely used in education, research, and industry. They are downloaded hundreds of thousands of times each year, reflecting their use in popular press programming books, traditional and online courses, and software. These datasets are a product of member activity in the MovieLens movie recommendation system, an active research platform that has hosted many experiments since its launch in 1997. This article documents the history of MovieLens and the MovieLens datasets. We include a discussion of lessons learned from running a long-standing, live research platform from the perspective of a research organization. We document best practices and limitations of using the MovieLens datasets in new research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Deep Interest Network for Click-Through Rate Prediction
Zhou, G., Zhu, X., Song, C., Fan, Y., Zhu, H., Ma, X., Yan, Y., Jin, J., Li, H., & Gai, K. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219823 · Cited by 2,128
Machine Learning Testing: Survey, Landscapes and Horizons
Zhang, J. M., Harman, M., Ma, L., & Liu, Y. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2962027 · Cited by 897
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
Martínez Beltrán, E. T., Pérez, M. Q., Sánchez, P. M. S., Bernal, S. L., Bovet, G., Pérez, M. G., Pérez, G. M., & Celdrán, A. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315746 · Cited by 625
“[20] 2020 Proactive caching scheme where vehicles are trained from sparse data, mitigating privacy risks Cross-device Decentralized Real CF-VAE FedAvg Asynchronous Random MovieLens [195]”
MethodBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Six Human-Centered Artificial Intelligence Grand Challenges
Ozmen Garibay, O., Winslow, B., Andolina, S., Antona, M., Bodenschatz, A., Coursaris, C., Falco, G., Fiore, S. M., Garibay, I., Grieman, K., et al. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2153320 · Cited by 501
Self-citationDisentangling User Interest and Conformity for Recommendation with Causal Embedding
Zheng, Y., Gao, C., Li, X., He, X., Li, Y., & Jin, D. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449788 · Cited by 356
Representation learning for dynamic graphs: A survey
Kazemi, S. M., Goel, R., Jain, K., Kobyzev, I., Sethi, A., Forsyth, P., & Poupart, P. (2019) · arXiv · doi:10.48550/arxiv.1905.11485 · Cited by 338
Mobility-Aware Proactive Edge Caching for Connected Vehicles Using Federated Learning
Yu, Z., Hu, J., Min, G., Zhao, Z., Miao, W., & Hossain, M. S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3017474 · Cited by 332
Large Language Models are Zero-Shot Rankers for Recommender Systems
Hou, Y., Zhang, J., Lin, Z., Lu, H., Xie, R., McAuley, J., & Zhao, W. X. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-56060-6_24 · Cited by 327
Predictability and Surprise in Large Generative Models
Ganguli, D., Hernandez, D., Lovitt, L., DasSarma, N., Henighan, T., Jones, A., Joseph, N., Kernion, J., Mann, B., Askell, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.07785 · Cited by 324
A Survey of Privacy Attacks in Machine Learning
Rigaki, M., & Garcia, S. (2024) · ACM Computing Surveys · doi:10.1145/3624010 · Cited by 285
Predictability and Surprise in Large Generative Models
Ganguli, D., Hernandez, D., Lovitt, L., Askell, A., Bai, Y., Chen, A., Conerly, T., Dassarma, N., Drain, D., Elhage, N., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533229 · Cited by 207
“specific algorithms [34], but are not typically studied with large scale generative models (yet).”
BackgroundHam, T. J., Lee, Y., Seo, S. H., Kim, S., Choi, H., Jung, S. J., & Lee, J. W. (2021) · 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca52012.2021.00060 · Cited by 192
Wu, Q., Zhao, Y., Fan, Q., Fan, P., Wang, J., & Zhang, C. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3221271 · Cited by 191
“MovieLens 1M contains 1 , 000 , 209 rating values for 3 , 883 movies from 6 , 040 anonymous VUs with movie ratings ranging from 0 to 1 , where each VU rates at least 20 movies [42].”
The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation
Abdollahpouri, H., Mansoury, M., Burke, R., & Mobasher, B. (2020) · Fourteenth ACM Conference on Recommender Systems · doi:10.1145/3383313.3418487 · Cited by 183
Effective Techniques for Multimodal Data Fusion: A Comparative Analysis
Pawłowski, M., Wróblewska, A., & Sysko-Romańczuk, S. (2023) · Sensors · doi:10.3390/s23052381 · Cited by 180
Ernala, S. K., Burke, M., Leavitt, A., & Ellison, N. B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376435 · Cited by 179
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramer, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2017) · 2017 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2017.29 · Cited by 171
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramèr, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2015) · arXiv · doi:10.48550/arxiv.1510.02377 · Cited by 171
Beyond Parity: Fairness Objectives for Collaborative Filtering
Yao, S., & Huang, B. (2017) · arXiv · doi:10.48550/arxiv.1705.08804 · Cited by 169
Automated Crowdturfing Attacks and Defenses in Online Review Systems
Yao, Y., Viswanath, B., Cryan, J., Zheng, H., & Zhao, B. Y. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133990 · Cited by 150
Cui, L., Su, X., Ming, Z., Chen, Z., Yang, S., Zhou, Y., & Xiao, W. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3014370 · Cited by 146
Federated Learning Based Proactive Content Caching in Edge Computing
Yu, Z., Hu, J., Min, G., Lu, H., Zhao, Z., Wang, H., & Georgalas, N. (2018) · 2018 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2018.8647616 · Cited by 140
Generative Adversarial Networks for Spatio-temporal Data: A Survey
Gao, N., Xue, H., Shao, W., Zhao, S., Qin, K. K., Prabowo, A., Rahaman, M. S., & Salim, F. D. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3474838 · Cited by 127
Evolution and impact of bias in human and machine learning algorithm interaction
Sun, W., Nasraoui, O., & Shafto, P. (2020) · PLOS ONE · doi:10.1371/journal.pone.0235502 · Cited by 116
LaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2023) · arXiv · doi:10.48550/arxiv.2304.11406 · Cited by 109
Adversarial attacks on an oblivious recommender
Christakopoulou, K., & Banerjee, A. (2019) · Proceedings of the 13th ACM Conference on Recommender Systems · doi:10.1145/3298689.3347031 · Cited by 105
Comprehensive Privacy Analysis on Federated Recommender System Against Attribute Inference Attacks
Zhang, S., Yuan, W., & Yin, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3295601 · Cited by 97
Online Content Popularity Prediction and Learning in Wireless Edge Caching
Garg, N., Sellathurai, M., Bhatia, V., Bharath, B. N., & Ratnarajah, T. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2956041 · Cited by 89
Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
Tseng, Y.-M., Huang, Y.-C., Hsiao, T.-Y., Chen, W.-L., Huang, C.-W., Meng, Y., & Chen, Y.-N. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.969 · Cited by 87
Popularity Bias in Dynamic Recommendation
Zhu, Z., He, Y., Zhao, X., & Caverlee, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467376 · Cited by 82
Privacy-Aware Recommendation with Private-Attribute Protection using Adversarial Learning
Beigi, G., Mosallanezhad, A., Guo, R., Alvari, H., Nou, A., & Liu, H. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371832 · Cited by 80
Privacy Preserving User-Based Recommender System
Badsha, S., Yi, X., Khalil, I., & Bertino, E. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.248 · Cited by 72
A Survey of Machine Unlearning
Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H. (2022) · arXiv · doi:10.48550/arxiv.2209.02299 · Cited by 193
“Movielens [63] comprises movie ratings from MovieLens, a website that provides movie recommendations.”
Fairness metrics and bias mitigation strategies for rating predictions
Ashokan, A., & Haas, C. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102646 · Cited by 47
Dehghani, M., Tay, Y., Gritsenko, A. A., Zhao, Z., Houlsby, N., Diaz, F., Metzler, D., & Vinyals, O. (2021) · arXiv · doi:10.48550/arxiv.2107.07002 · Cited by 48
Unlearning Protected User Attributes in Recommendations with Adversarial Training
Ganhör, C., Penz, D., Rekabsaz, N., Lesota, O., & Schedl, M. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531820 · Cited by 47
A Generic Federated Recommendation Framework via Fake Marks and Secret Sharing
Lin, Z., Pan, W., Yang, Q., & Ming, Z. (2023) · ACM Transactions on Information Systems · doi:10.1145/3548456 · Cited by 44
Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV
Jiang, K., Cao, Y., Song, Y., Zhou, H., Wan, S., & Zhang, X. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3349255 · Cited by 43
Neera, J., Chen, X., Aslam, N., Wang, K., & Shu, Z. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3126577 · Cited by 42
LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods
Li, H., Dong, Q., Chen, J., Su, H., Zhou, Y., Ai, Q., Ye, Z., & Liu, Y. (2024) · arXiv · doi:10.48550/arxiv.2412.05579 · Cited by 40
A Ubiquitous Machine Learning Accelerator with Automatic Parallelization on FPGA
Wang, C., Gong, L., Li, X., & Zhou, X. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2990924 · Cited by 37
SecRec: A Privacy-Preserving Method for the Context-Aware Recommendation System
Chen, J., Liu, L., Chen, R., Peng, W., & Huang, X. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3085562 · Cited by 32
Slokom, M., Hanjalic, A., & Larson, M. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102722 · Cited by 31
Deep Learning Models for Serendipity Recommendations: A Survey and New Perspectives
Fu, Z., Niu, X., & Maher, M. L. (2024) · ACM Computing Surveys · doi:10.1145/3605145 · Cited by 30
Content Popularity Prediction in Fog Radio Access Networks: A Federated Learning Based Approach
Wu, Y., Jiang, Y., Bennis, M., Zheng, F., Gao, X., & You, X. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148697 · Cited by 29
Misztal-Radecka, J., & Indurkhya, B. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102519 · Cited by 29
ReuseKNN: Neighborhood Reuse for Differentially Private KNN-Based Recommendations
Müllner, P., Lex, E., Schedl, M., & Kowald, D. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3608481 · Cited by 27
Bayesian Personalized Feature Interaction Selection for Factorization Machines
Chen, Y., Ren, P., Wang, Y., & de Rijke, M. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331196 · Cited by 26
A Survey on LLM-powered Agents for Recommender Systems
Peng, Q., Liu, H., Huang, H., Yang, J., Yang, Q., & Shao, M. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.620 · Cited by 31
Shifted and Squeezed 8-bit Floating Point format for Low-Precision Training of Deep Neural Networks
Cambier, L., Bhiwandiwalla, A., Gong, T., Nekuii, M., Elibol, O. H., & Tang, H. (2020) · arXiv · doi:10.48550/arxiv.2001.05674 · Cited by 23
On the Detection of Shilling Attacks in Federated Collaborative Filtering
Jiang, Y., Zhou, Y., Wu, D., Li, C., & Wang, Y. (2020) · 2020 International Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00026 · Cited by 22
Privacy-Preserving Collaborative Filtering Using Fully Homomorphic Encryption
Jumonji, S., Sakai, K., Sun, M.-T., & Ku, W.-S. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3115776 · Cited by 19
User Consented Federated Recommender System Against Personalized Attribute Inference Attack
Hu, Q., & Song, Y. (2024) · Proceedings of the 17th ACM International Conference on Web Search and Data Mining · doi:10.1145/3616855.3635830 · Cited by 17
Making Recommender Systems Forget: Learning and Unlearning for Erasable Recommendation
Li, Y., Zheng, X., Chen, C., & Liu, J. (2022) · arXiv · doi:10.48550/arxiv.2203.11491 · Cited by 43
“The ML and AM datasets are widely used to evaluate CF algorithms [Harper and Konstan, 2015; He and McAuley, 2016].”
MethodLocal Factor Models for Large-Scale Inductive Recommendation
Yang, L., Schnabel, T., Bennett, P. N., & Dumais, S. (2021) · Fifteenth ACM Conference on Recommender Systems · doi:10.1145/3460231.3474276 · Cited by 6
EANA: Reducing Privacy Risk on Large-scale Recommendation Models
Ning, L., Chien, S., Song, S., Chen, M., Xue, Y., & Berlowitz, D. (2022) · Proceedings of the 16th ACM Conference on Recommender Systems · doi:10.1145/3523227.3546769 · Cited by 5
A bias detection tree approach for detecting disparities in a recommendation model’s errors
Misztal-Radecka, J., & Indurkhya, B. (2023) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-022-09334-x · Cited by 4
MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
Tan, H., Zhang, Z., Ma, C., Chen, X., Dai, Q., & Dong, Z. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.989 · Cited by 7
Titans Revisited: A Lightweight Reimplementation and Critical Analysis of a Test-Time Memory Model
Di Nepi, G., Siciliano, F., & Silvestri, F. (2025) · arXiv · doi:10.48550/arxiv.2510.09551
“For the recommendation task, we use the Movie-Lens 1M (Harper and Konstan, 2015) dataset with a next-item prediction setup, in which the model predicts the next movie based on the user history.”
Reinforcement Learning with History-Dependent Dynamic Contexts
Tennenholtz, G., Merlis, N., Shani, L., Mladenov, M., & Boutilier, C. (2023) · arXiv · doi:10.48550/arxiv.2302.02061
“To evaluate the effectiveness of DCZero, we develop a movie recommendation environment based on the MovieLens dataset (Harper and Konstan, 2015).”
Method
Metadata
- Authors
- Harper, F. M., & Konstan, J. A.
- Venue
- ACM Transactions on Interactive Intelligent Systems
- Published
- 2015-12-22
- Volume
- 5
- Issue
- 4
- Pages
- 1-19
- ISSN
- 2160-6455 (ISSN-L)
- 2160-6463
- OpenAlex
- W2219888463
- Cited by
- 3,907
- References
- 0
- FWCI
- 572.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
