The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Are we really making much progress? A worrying analysis of recent neural recommendation approaches
Open accessAbstract
Deep learning techniques have become the method of choice for researchers working on algorithmic aspects of recommender systems. With the strongly increased interest in machine learning in general, it has, as a result, become difficult to keep track of what represents the state-of-the-art at the moment, e.g., for top-n recommendation tasks. At the same time, several recent publications point out problems in today's research practice in applied machine learning, e.g., in terms of the reproducibility of the results or the choice of the baselines when proposing new models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135 · cited 12×
“ItemKNN-CBF: Aneighborhoodcontent-based-filtering (CBF)approach with item similarities computed by using item content features (attributes) where vectors f i , f j ∈ R | F | describe the features of items i and j , respectively, and | F | is the number of features.”
InfluentialNeural Collaborative Filtering
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T.-S. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052569 · Cited by 6,652
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
Collaborative Filtering for Implicit Feedback Datasets
Hu, Y., Koren, Y., & Volinsky, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.22 · Cited by 3,170
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657
Collaborative topic modeling for recommending scientific articles
Wang, C., & Blei, D. M. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020480 · Cited by 1,527
Variational Autoencoders for Collaborative Filtering
Liang, D., Krishnan, R. G., Hoffman, M. D., & Jebara, T. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186150 · Cited by 1,338
Collaborative Denoising Auto-Encoders for Top-N Recommender Systems
Wu, Y., DuBois, C., Zheng, A. X., & Ester, M. (2016) · Proceedings of the Ninth ACM International Conference on Web Search and Data Mining · doi:10.1145/2835776.2835837 · Cited by 1,001
Chen, J., Zhang, H., He, X., Nie, L., Liu, W., & Chua, T.-S. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080797 · Cited by 851
Unifying user-based and item-based collaborative filtering approaches by similarity fusion
Wang, J., de Vries, A. P., & Reinders, M. J. T. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148257 · Cited by 847
Convolutional Matrix Factorization for Document Context-Aware Recommendation
Kim, D., Park, C., Oh, J., Lee, S., & Yu, H. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959165 · Cited by 769
Recommender systems: from algorithms to user experience
Konstan, J. A., & Riedl, J. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9112-x · Cited by 762
SLIM: Sparse Linear Methods for Top-N Recommender Systems
Ning, X., & Karypis, G. (2011) · 2011 IEEE 11th International Conference on Data Mining · doi:10.1109/icdm.2011.134 · Cited by 714
A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Elkahky, A. M., Song, Y., & He, X. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741667 · Cited by 704
Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model
Hu, B., Shi, C., Zhao, W. X., & Yu, P. S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219965 · Cited by 674
Sequence-Aware Recommender Systems
Quadrana, M., Cremonesi, P., & Jannach, D. (2019) · ACM Computing Surveys · doi:10.1145/3190616 · Cited by 504
Self-citationWhen Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation
Jannach, D., & Ludewig, M. (2017) · Proceedings of the Eleventh ACM Conference on Recommender Systems · doi:10.1145/3109859.3109872 · Cited by 490
Self-citationCollaborative Variational Autoencoder for Recommender Systems
Li, X., & She, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098077 · Cited by 442
Recurrent knowledge graph embedding for effective recommendation
Sun, Z., Yang, J., Zhang, J., Bozzon, A., Huang, L.-K., & Xu, C. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240361 · Cited by 367
Evaluation of session-based recommendation algorithms
Ludewig, M., & Jannach, D. (2018) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-018-9209-6 · Cited by 336
Self-citationCollaborative Memory Network for Recommendation Systems
Ebesu, T., Shen, B., & Fang, Y. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3209991 · Cited by 275
Improvements that don't add up: ad-hoc retrieval results since 1998
Armstrong, T. G., Moffat, A., Webber, W., & Zobel, J. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646031 · Cited by 234
Multi-Pointer Co-Attention Networks for Recommendation
Tay, Y., Luu, A. T., & Hui, S. C. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220086 · Cited by 233
Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking
Tay, Y., Anh Tuan, L., & Hui, S. C. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186154 · Cited by 221
3D Convolutional Networks for Session-based Recommendation with Content Features
Tuan, T. X., & Phuong, T. M. (2017) · Proceedings of the Eleventh ACM Conference on Recommender Systems · doi:10.1145/3109859.3109900 · Cited by 196
Spectral collaborative filtering
Zheng, L., Lu, C.-T., Jiang, F., Zhang, J., & Yu, P. S. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240343 · Cited by 186
Recommender systems — beyond matrix completion
Jannach, D., Resnick, P., Tuzhilin, A., & Zanker, M. (2016) · Communications of the ACM · doi:10.1145/2891406 · Cited by 178
Self-citationOffline and online evaluation of news recommender systems at swissinfo.ch
Garcin, F., Faltings, B., Donatsch, O., Alazzawi, A., Bruttin, C., & Huber, A. (2014) · Proceedings of the 8th ACM Conference on Recommender systems · doi:10.1145/2645710.2645745 · Cited by 177
Meta-Prod2Vec: Product Embeddings Using Side-Information for Recommendation
Vasile, F., Smirnova, E., & Conneau, A. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959160 · Cited by 177
The Neural Hype and Comparisons Against Weak Baselines
Lin, J. (2019) · SIGIR Forum · doi:10.1145/3308774.3308781 · Cited by 163
Beel, J., & Langer, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24592-8_12 · Cited by 153
Cremonesi, P., Garzotto, F., & Turrin, R. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2209310.2209314 · Cited by 143
Self-citationA Contextual Attention Recurrent Architecture for Context-Aware Venue Recommendation
Manotumruksa, J., Macdonald, C., & Ounis, I. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210042 · Cited by 126
Contrasting Offline and Online Results when Evaluating Recommendation Algorithms
Rossetti, M., Stella, F. A., & Zanker, M. (2016) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2959100.2959176 · Cited by 120
Predicting Online Performance of News Recommender Systems Through Richer Evaluation Metrics
Maksai, A., Garcin, F., & Faltings, B. V. (2015) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2792838.2800184 · Cited by 113
Towards reproducibility in recommender-systems research
Beel, J., Breitinger, C., Langer, S., Lommatzsch, A., & Gipp, B. (2016) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9174-x · Cited by 109
Updatable, Accurate, Diverse, and Scalable Recommendations for Interactive Applications
Paudel, B., Christoffel, F., Newell, C., & Bernstein, A. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2955101 · Cited by 107
Random walks in recommender systems: exact computation and simulations
Cooper, C., Lee, S. H., Radzik, T., & Siantos, Y. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2567948.2579244 · Cited by 87
E-commerce product recommendation agents
Xiaobo, & BenbasatIzak (2007) · MIS Quarterly · doi:10.5555/2017327.2017335 · Cited by 85
Probabilistic relevance ranking for collaborative filtering
Wang, Y.-X., Robertson, S. E., de Vries, A. P., & Reinders, M. J. T. (2008) · Information Retrieval · doi:10.1007/s10791-008-9060-1 · Cited by 58
Attentive neural architecture incorporating song features for music recommendation
Sachdeva, N., Gupta, K., & Pudi, V. (2018) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3240323.3240397 · Cited by 40
Cited by
e-Tourism beyond COVID-19: a call for transformative research
Gretzel, U., Fuchs, M., Baggio, R., Hoepken, W., Law, R., Neidhardt, J., Pesonen, J., Zanker, M., & Xiang, Z. (2020) · Information Technology & Tourism · doi:10.1007/s40558-020-00181-3 · Cited by 607
Big-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems
Wang, R., Shivanna, R., Cheng, D., Jain, S., Lin, D., Hong, L., & Chi, E. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450078 · Cited by 568
The Computational Limits of Deep Learning
Thompson, N. C., Greenewald, K., Lee, K., & Manso, G. F. (2020) · arXiv · doi:10.48550/arxiv.2007.05558 · Cited by 538
Wu, L., He, X., Wang, X., Zhang, K., & Wang, M. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3145690 · Cited by 413
Metadata
- Authors
- Ferrari Dacrema, M., Cremonesi, P., & Jannach, D.
- Venue
- Proceedings of the 13th ACM Conference on Recommender Systems
- Publisher
- ACM
- Published
- 2019-09-10
- Pages
- 101-109
- OpenAlex
- W2957191877
- Cited by
- 431
- References
- 41
- FWCI
- 45.79
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.