The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Recommendation Systems: Algorithms, Challenges, Metrics, and Business Opportunities
Open accessAbstract
Recommender systems are widely used to provide users with recommendations based on their preferences. With the ever-growing volume of information online, recommender systems have been a useful tool to overcome information overload. The utilization of recommender systems cannot be overstated, given its potential influence to ameliorate many over-choice challenges. There are many types of recommendation systems with different methodologies and concepts. Various applications have adopted recommendation systems, including e-commerce, healthcare, transportation, agriculture, and media. This paper provides the current landscape of recommender systems research and identifies directions in the field in various applications. This article provides an overview of the current state of the art in recommendation systems, their types, challenges, limitations, and business adoptions. To assess the quality of a recommendation system, qualitative evaluation metrics are discussed in the paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135
Evaluating collaborative filtering recommender systems
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963772 · Cited by 5,798
Resnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
(2011) · Springer eBooks · doi:10.1007/978-0-387-85820-3 · Cited by 3,761
Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.03.012 · Cited by 3,158
Collaborative Filtering Recommender Systems
Schafer, J. B., Frankowski, D., Herlocker, J., & Sen, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_9 · Cited by 2,120
Methods and metrics for cold-start recommendations
Schein, A. I., Popescul, A., Ungar, L. H., & Pennock, D. M. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564421 · Cited by 1,780
Recommender system application developments: A survey
Lu, J., Wu, D., Mao, M., Wang, W., & Zhang, G. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.03.008 · Cited by 1,578
(2015) · Springer eBooks · doi:10.1007/978-1-4899-7637-6 · Cited by 1,550
E-Commerce Recommendation Applications
Schafer, J. B., Konstan, J. A., & Riedl, J. (2001) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009804230409 · Cited by 1,530
Solving the apparent diversity-accuracy dilemma of recommender systems
Zhou, T., Kuscsik, Z., Liu, J.-G., Medo, M., Wakeling, J. R., & Zhang, Y.-C. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000488107 · Cited by 972
Aggarwal, C. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-29659-3 · Cited by 931
O'Donovan, J., & Smyth, B. (2005) · Proceedings of the 10th international conference on Intelligent user interfaces · doi:10.1145/1040830.1040870 · Cited by 865
Recommender Systems: Introduction and Challenges
Ricci, F., Rokach, L., & Shapira, B. (2015) · Recommender Systems Handbook · doi:10.1007/978-1-4899-7637-6_1 · Cited by 846
Knowledge-based recommender systems
Burke, R. (2000) · Cited by 782
Beyond accuracy: evaluating recommender systems by coverage and serendipity
Ge, M., Delgado-Battenfeld, C., & Jannach, D. (2010) · Proceedings of the fourth ACM conference on Recommender systems · doi:10.1145/1864708.1864761 · Cited by 663
Two Decades of Recommender Systems at Amazon.com
Smith, B., & Linden, G. (2017) · IEEE Internet Computing · doi:10.1109/mic.2017.72 · Cited by 653
Exploring temporal effects for location recommendation on location-based social networks
Gao, H., Tang, J., Hu, X., & Liu, H. (2013) · Proceedings of the 7th ACM conference on Recommender systems · doi:10.1145/2507157.2507182 · Cited by 513
A survey of collaborative filtering based social recommender systems
Yang, X., Guo, Y., Liu, Y., & Steck, H. (2014) · Computer Communications · doi:10.1016/j.comcom.2013.06.009 · Cited by 475
Scalable Collaborative Filtering Approaches for Large Recommender Systems
Takács, G., Pilászy, I., Németh, B., & Tikk, D. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577091 · Cited by 464
Location-Based Recommendation System Using Bayesian User’s Preference Model in Mobile Devices
Park, M.-H., Hong, J.-H., & Cho, S.-B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-73549-6_110 · Cited by 381
LCARS: a location-content-aware recommender system
Yin, H., Sun, Y., Cui, B., Hu, Z., & Chen, L. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487608 · Cited by 331
A Survey of Accuracy Evaluation Metrics of Recommendation Tasks
GunawardanaAsela, & ShaniGuy (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755883 · Cited by 314
Ricci, F. (2010) · Information Technology & Tourism · doi:10.3727/109830511x12978702284390 · Cited by 267
Evaluation of recommender systems: A new approach
Hernández del Olmo, F., & Gaudioso, E. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.07.047 · Cited by 238
Iwendi, C., Khan, S., Anajemba, J. H., Bashir, A. K., & Noor, F. (2020) · IEEE Access · doi:10.1109/access.2020.2968537 · Cited by 231
An Introduction to Recommender Systems
Aggarwal, C. C. (2016) · Recommender Systems · doi:10.1007/978-3-319-29659-3_1 · Cited by 229
Using location for personalized POI recommendations in mobile environments
Horozov, T., Narasimhan, N., & Vasudevan, V. (2006) · International Symposium on Applications and the Internet (SAINT'06) · doi:10.1109/saint.2006.55 · Cited by 214
DeepReco: Deep Learning Based Health Recommender System Using Collaborative Filtering
Sahoo, A. K., Pradhan, C., Barik, R. K., & Dubey, H. (2019) · Computation · doi:10.3390/computation7020025 · Cited by 183
Improving Crop Productivity Through A Crop Recommendation System Using Ensembling Technique
Kulkarni, N. H., Srinivasan, G. N., Sagar, B. M., & Cauvery, N. K. (2018) · 2018 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS) · doi:10.1109/csitss.2018.8768790 · Cited by 176
Research paper recommender system evaluation: a quantitative literature survey
Beel, J., Langer, S., Genzmehr, M., Gipp, B., Breitinger, C., & Nürnberger, A. (2013) · Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation · doi:10.1145/2532508.2532512 · Cited by 159
Recommender Systems Based on Collaborative Filtering Using Review Texts—A Survey
Srifi, M., Oussous, A., Lahcen, A. A., & Mouline, S. (2020) · Information · doi:10.3390/info11060317 · Cited by 146
Kardan, A. A., & Ebrahimi, M. (2012) · Information Sciences · doi:10.1016/j.ins.2012.07.011 · Cited by 126
An Emotional Recommender System for Music
Moscato, V., Picariello, A., & Sperlí, G. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.3026000 · Cited by 110
An Edge Intelligence Empowered Recommender System Enabling Cultural Heritage Applications
Su, X., Sperlí, G., Moscato, V., Picariello, A., Esposito, C., & Choi, C. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2908056 · Cited by 108
An Evaluation Methodology for Collaborative Recommender Systems
Cremonesi, P., Turrin, R., Lentini, E., & Matteucci, M. (2008) · International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution · doi:10.1109/axmedis.2008.13 · Cited by 100
Sharing the square: Collaborative Leisure in the City Streets
Brown, B. A. T., Chalmers, M., Bell, M., Hall, M., MacColl, I., & Rudman, P. D. (2006) · Springer eBooks · doi:10.1007/1-4020-4023-7_22 · Cited by 97
A systematic literature review on Health Recommender Systems
Sezgın, E., & Özkan, S. (2013) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb.2013.6707249 · Cited by 81
Agricultural recommendation system for crop protection
Lacasta, J., Lopez-Pellicer, F. J., Espejo-García, B., Nogueras-Iso, J., & Zarazaga-Soria, F. J. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.06.049 · Cited by 79
A modular cluster based collaborative recommender system for cardiac patients
Mustaqeem, A., Anwar, S. M., & Majid, M. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101761 · Cited by 74
Recommender systems, cultural heritage applications, and the way forward
Pavlidis, G. P. (2018) · Journal of Cultural Heritage · doi:10.1016/j.culher.2018.06.003 · Cited by 71
A framework for configuring collaborative filtering-based recommendations derived from purchase data
Geuens, S., Coussement, K., & Bock, K. W. D. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.07.005 · Cited by 69
Social recommendation service for cultural heritage
Hong, M., Jung, J. J., Piccialli, F., & Chianese, A. (2016) · Personal and Ubiquitous Computing · doi:10.1007/s00779-016-0985-x · Cited by 68
Enhancing recommendation diversity with organization interfaces
Hu, R. J., & Pu, P. (2011) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1943403.1943462 · Cited by 67
Solving the Sparsity Problem in Recommender Systems Using Association Retrieval
Chen, Y., Wu, C., Xie, M., & Guo, X. (2011) · Journal of Computers · doi:10.4304/jcp.6.9.1896-1902 · Cited by 67
The effect of repetition in Internet banner ads and the moderating role of animation
Lee, J.-W., Ahn, J., & Park, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.008 · Cited by 66
Ma, X., Ma, J., Li, H., Jiang, Q. G., & Gao, S. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2017.09.060 · Cited by 66
Objectives and State-of-the-Art of Location-Based Social Network Recommender Systems
Ding, Z., Li, X., Jiang, C., & Zhou, M. (2018) · ACM Computing Surveys · doi:10.1145/3154526 · Cited by 63
Gyrard, A., & Sheth, A. (2019) · Smart Health · doi:10.1016/j.smhl.2019.100083 · Cited by 63
Framework for smart city applications based on participatory sensing
Szabó, R., Farkas, K., Ispány, M., et al. (2013) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2013.6719260 · Cited by 62
Multimedia recommendation and transmission system based on cloud platform
Yang, J., Wang, H., Lv, Z., Wei, W., Song, H., Erol‐Kantarci, M., Kantarcı, B., & He, S. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2016.06.015 · Cited by 61
Jankowski, J., Hamari, J., & Wątróbski, J. (2018) · Internet Research · doi:10.1108/intr-09-2016-0271 · Cited by 61
Sulikowski, P., & Zdziebko, T. (2020) · Electronics · doi:10.3390/electronics9020266 · Cited by 52
Collaborative Recommendation System For Agriculture Sector
Jaiswal, S., Kharade, T., Kotambe, N., & Shinde, S. (2020) · ITM Web of Conferences · doi:10.1051/itmconf/20203203034 · Cited by 42
Study of LZ-Based Location Prediction and Its Application to Transportation Recommender Systems
Rodríguez-Carrión, A., García-Rubio, C., Campo, C., Cortés, A. S., Garcia-Lozano, E., & Noriega-Vivas, P. (2012) · Sensors · doi:10.3390/s120607496 · Cited by 32
Fuzzy optimization to improve mobile health and wellness recommendation systems
Mezei, J., & Nikou, S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.11.030 · Cited by 23
Personalized Healthcare System Based on Ontologies
Benfares, C., Idrissi, Y. E. B. E., & Hamid, K. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-11884-6_18 · Cited by 18
A Recommender System to Help Discovering Cohorts in Rare Diseases
Almeida, J. R., Monteiro, E., Silva, L. A. B., Pazos, A., & Oliveira, J. L. (2020) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms49503.2020.00012 · Cited by 17
Lillegraven, T. N., & Wolden, A. C. (2010) · Cited by 16
A Social Media Recommender System
Sperlí, G., Amato, F., Mercorio, F., Mezzanzanica, M., Moscato, V., & Picariello, A. (2017) · International Journal of Multimedia Data Engineering and Management · doi:10.4018/ijmdem.2018010103 · Cited by 14
Intelligent Mobile-Based Recommender System Framework for Smart Freight Transport
Gheraibia, M. Y., & Gouin-Vallerand, C. (2019) · EAI International Conference on Smart Objects and Technologies for Social Good (GOODTECHS) · doi:10.1145/3342428.3342697 · Cited by 12
SuperOrder: Provider order recommendation system for outpatient clinics
Sung, Y.-S., Dravenstott, R. W., Darer, J. D., Devapriya, P., & Kumara, S. R. T. (2019) · Health Informatics Journal · doi:10.1177/1460458219857383 · Cited by 3
An Architecture for e-Health Recommender Systems Based on Similarity of Patients’ Symptoms
Frittelli, V., & Diván, M. J. (2020) · Blockchain technologies · doi:10.1007/978-981-15-2205-5_8 · Cited by 3
Tackling the problems of diversity in recommender systems
Karanam, M. B. (2010) · K-State Research Exchange (Kansas State University) · Cited by 2
Cited by
A Survey of Recommendation Systems: Recommendation Models, Techniques, and Application Fields
Ko, H., Lee, S., Park, Y., & Choi, A. (2022) · Electronics · doi:10.3390/electronics11010141 · Cited by 658
Theodorakopoulos, L., & Theodoropoulou, A. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/3641502 · Cited by 153
Beyari, H., & Hashem, T. (2025) · Behavioral Sciences · doi:10.3390/bs15050700 · Cited by 53
Metadata
- Authors
- Fayyaz, Z., Ebrahimian, M., Nawara, D., Ibrahim, A., & Kashef, R.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2020-11-02
- Volume
- 10
- Issue
- 21
- Pages
- 7748
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3097103183
- Cited by
- 427
- References
- 65
- FWCI
- 39.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.