Neuro-Fuzzy Aggregation for Multi-Criteria Recommender Systems: Comparative Study with Fixed-Weight Averaging
Open accessAbstract
Recommender systems have proved effective in handling information overload by providing personalized predictions. However, most of these systems are single-criterion recommenders that rely on a single rating. Multi-criteria recommender systems have gained popularity recently because they provide more effective recommendations than single-criterion models. This paper presents a comparative analysis of two aggregation techniques: standard fixed-weight averaging and a novel neuro-fuzzy aggregation framework. The proposed method combines fuzzy linguistic representations with a neural-network-based aggregator to model complex, nonlinear relationships among criteria. To generate criterion-level predictions, we use various collaborative filtering techniques, including User-based Collaborative Filtering (UserCF), Item-based Collaborative Filtering (ItemCF), Singular Value Decomposition (SVD), SVD++ (SVD with implicit-feedback extension), Probabilistic Matrix Factorization (PMF), and Deep Matrix Factorization (DeepMF). These predictions are then processed through both aggregation strategies. Evaluation on two benchmark datasets—TripAdvisor and Yahoo! Movies—demonstrates that the neuro-fuzzy method consistently achieves lower RMSE and MAE, underscoring its capability to enhance predictive performance in multi-criteria recommendation settings.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper compares fixed-weight averaging with a neuro-fuzzy aggregation framework for multi-criteria recommender systems, using six collaborative filtering models to predict per-criterion ratings before aggregation. Across TripAdvisor and Yahoo!Movies, the neuro-fuzzy method generally achieves lower RMSE and MAE, with the largest gains on TripAdvisor.
Key findings
- On TripAdvisor, neuro-fuzzy aggregation improved RMSE and MAE for all six CF models. User-based CF dropped from RMSE 2.1223 to 1.6387 and MAE 1.7276 to 1.3702; Item-based CF dropped from RMSE 2.2634 to 1.6406 and MAE 1.7768 to 1.3594; DeepMF dropped from RMSE 2.1767 to 1.6910 and MAE 1.9104 to 1.4133.
- The paper reports that User-based CF and Item-based CF showed the largest TripAdvisor gains, with RMSE improvements up to 0.62 and MAE reductions over 0.40.
- On Yahoo!Movies, gains were less dramatic but neuro-fuzzy aggregation remained superior in most scenarios: SVD++ improved from RMSE 2.9205 to 2.7841 and MAE 2.2520 to 2.1468; PMF improved from RMSE 3.1864 to 2.9856 and MAE 2.6459 to 2.3351.
- DeepMF was slightly worse on Yahoo!Movies under neuro-fuzzy aggregation: RMSE 3.1389 vs. 3.1369 fixed, and MAE 2.5149 vs. 2.4964 fixed.
Methods
- Six collaborative filtering models—UserCF, ItemCF, SVD, SVD++, PMF, and DeepMF—were trained to predict per-criterion ratings for each user-item pair. Predicted criterion scores were min-max scaled to [0,1], converted into Low/Medium/High fuzzy membership degrees using triangular membership functions, and concatenated into a fuzzy feature vector.
- A multilayer perceptron aggregator with two hidden layers (64 units, ReLU, dropout 0.2) was trained to predict the overall rating by minimizing MSE, with early stopping on validation RMSE.
- Experiments used TripAdvisor (7,504 ratings, 7,313 users, 75 items, 4 criteria, 98.63% sparsity) and Yahoo!Movies (62,156 ratings, 6,078 users, 976 items, 4 criteria, 98.95% sparsity), with an 80/20 train-test split repeated five times and evaluation by RMSE and MAE.
Limitations
- The paper does not include a dedicated limitations section.
- Stated in the discussion: Yahoo!Movies gains were less dramatic due to greater scale and sparsity, and DeepMF was slightly worse there, which the authors suggest could indicate overfitting or diminished generalizability in the movie-based multi-criteria domain.
- Evident from the text: the comparative evaluation is limited to two datasets and six CF models, and no statistical significance testing is reported for the observed differences.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
- Findingreasoning
On the TripAdvisor dataset, DeepMF exhibits a significant performance boost with neuro-fuzzy aggregation.
“DeepMF also exhibits a significant performance boost, indicating that fuzzy inference complements deep latent feature learning.”
Quote in the paperNot a substantial claim - Findingreasoning
On the Yahoo!Movies dataset, DeepMF is slightly worse with neuro-fuzzy aggregation.
“DeepMF is slightly worse in this scenario, which could be an indication of overfitting or diminished generalizability in the movie-based multi-criteria domain.”
Quote in the paperNot a substantial claim - Findingown data
The neuro-fuzzy method consistently achieves lower RMSE and MAE than fixed weighting across multiple models and datasets.
“Evaluation on two benchmark datasets-TripAdvisor and Yahoo!Movies-demonstrates that the neuro-fuzzy method consistently achieves lower RMSE and MAE, underscoring its capability to enhance predictive performance in multi-criteria recommendation settings.”
- Also stated in: § 1. Introduction · boosted
“Experimental results verify that our suggested method consistently achieves lower RMSE and MAE than fixed weighting across multiple models and datasets, validating its effectiveness and generalizability.”
- Also stated in: § 6. Conclusion and Future Scope · boosted
“Large-scale experiments on two real-world datasets-TripAdvisor and Yahoo!Movies demonstrate that the introduced neuro-fuzzy aggregation uniformly improves RMSE and MAE over fixed-weight baselines for all models.”
Quote in the paperSubstantial claim - Also stated in: § 1. Introduction · boosted
- Findingown data
On the Yahoo!Movies dataset, fuzzy aggregation remains superior in most scenarios.
“While gains are less dramatic here-due to greater scale and sparsity-fuzzy aggregation remains superior in most scenarios.”
Quote in the paperSubstantial claim - Findingown data
Across both datasets and models, the neuro-fuzzy aggregation approach matches or outperforms fixed-weighting performance.
“Across both data sets and models, the neuro-fuzzy aggregation approach matches or outperforms fixed-weighting performance.”
Quote in the paperSubstantial claim
- Interpretationnone given
The proposed neuro-fuzzy aggregation framework combines fuzzy linguistic representations with a neural-network-based aggregator to model complex, nonlinear relationships among criteria.
“The proposed method combines fuzzy linguistic representations with a neural-network-based aggregator to model complex, nonlinear relationships among criteria.”
- Also stated in: § 1. Introduction · plain
“we introduce a neuro-fuzzy aggregation framework that uses fuzzy logic to represent uncertainty and human-like reasoning and a learnable neural network to capture non-linear criterion relationships.”
Quote in the paperSubstantial claim- Rests on an assumption: Fixed-weight averaging assumes linearity and fixed criterion importance, which may not reflect real user behavior.
- Also stated in: § 1. Introduction · plain
- Interpretationown data
The highest gains from neuro-fuzzy aggregation emerge for neighborhood-based approaches (UserCF, ItemCF) and deep factorization (DeepMF).
“The highest gains seem to emerge for neighborhood-based approaches (UserCF, ItemCF) and deep factorization (DeepMF), validating the strong robustness and generality of the solution.”
Quote in the paperSubstantial claim - Interpretationnone given
The neuro-fuzzy architecture offers explainable recommendations.
“The architecture captures nonlinear patterns between criteria, is able to learn from contextual heterogeneity, and offers explainable recommendations.”
Quote in the paperNot a substantial claim - Interpretationown data
Fuzzy inference complements deep latent feature learning.
“indicating that fuzzy inference complements deep latent feature learning.”
Quote in the paperSubstantial claim - Interpretationnone given
The neuro-fuzzy architecture is able to learn from contextual heterogeneity.
“The architecture captures nonlinear patterns between criteria, is able to learn from contextual heterogeneity, and offers explainable recommendations.”
Quote in the paperNot a substantial claim - Interpretationnone given
The neuro-fuzzy architecture captures nonlinear patterns between criteria.
“The architecture captures nonlinear patterns between criteria, is able to learn from contextual heterogeneity, and offers explainable recommendations.”
Quote in the paperSubstantial claim
- May combine two claims. 5
- The quote only partly states this claim. 1
- Classified as probably not a substantial claim. 5
May combine two claims.
Findingown dataOn the Yahoo!Movies dataset, SVD++, PMF, and Item-based CF perform better with MAE reduction under neuro-fuzzy aggregation.
“SVD++, PMF, and Item-based CF perform better with MAE reduction.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataOn the TripAdvisor dataset, the neuro-fuzzy model shows consistent improvements in RMSE and MAE for all six collaborative filtering models.
“TripAdvisor dataset: The neuro-fuzzy model shows consistent improvements in RMSE and MAE for all models.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn the TripAdvisor dataset, User-based CF and Item-based CF exhibit the largest gains, with RMSE improvements of up to 0.62 and MAE reductions over 0.40.
“Notably, User-based CF and Item-based CF exhibit the largest gains, with RMSE improvements of up to 0.62 and MAE reductions over 0.40.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe study ensured that every user and item appearing in the test set appears at least once in the training set to avoid cold-start leakage.
“We also ensure that every user and item appearing in the test set appears at least once in the training set to avoid cold-start leakage.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenTraining settings were kept the same across datasets unless noted.
“Training settings are kept the same across datasets unless noted.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe study repeated the 80/20 train-test split five times with different random splits to reduce the effect of randomness.
“To reduce the effect of randomness, we repeat the 80/20 split five times with different random splits.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenThe proposed neuro-fuzzy aggregation method is model-agnostic and can be inserted into a variety of collaborative filtering models, including UserCF, ItemCF, SVD, SVD++, PMF, and DeepMF.
“In contrast with current methods, the technique is model-agnostic and can be inserted into a variety of collaborative filtering models, including User-based CF, Item-based CF, SVD, SVD++, PMF, and DeepMF.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe neuro-fuzzy solution has strong robustness and generality.
“validating the strong robustness and generality of the solution.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenEarly stopping on validation RMSE with patience of 10 epochs was used.
“We use Adam as the optimizer and early stopping on validation RMSE with patience of 10 epochs, with the main hyperparameters listed in Table 3.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe neuro-fuzzy aggregation approach enhances the accuracy of overall-rating prediction while offering an interpretable and adaptable alternative to traditional aggregation techniques.
“The findings demonstrate that the neuro-fuzzy aggregation approach enhances the accuracy of overall-rating prediction while offering an interpretable and adaptable alternative to traditional aggregation techniques.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Fixed-weight averaging assumes linearity and fixed criterion importance, which may not reflect real user behavior.
“While simple and efficient, this assumes linearity and fixed criterion importance, which may not reflect real user behavior.”
The paper relies on this without support.
The key problem in MCRS is how to merge several criterion ratings into one overall score for ranking; the choice of aggregation strongly influences accuracy and transparency.
“The key problem in MCRS is how to merge several criterion ratings into one overall score for ranking; the choice of aggregation strongly influences accuracy and transparency.”
The paper relies on this without support.
The majority of methods adopt static aggregation and use hand-crafted or fixed weights to merge criterion-level ratings.
“Firstly, the majority of methods adopt static aggregation and use hand-crafted or fixed weights to merge criterion-level ratings.”
The paper relies on this without support.
A majority of models using deep learning or evolutionary optimization is inadequate in interpretability.
“Secondly, a majority of models using deep learning or evolutionary optimization is inadequate in interpretability.”
The paper relies on this without support.
Many aggregation techniques are strongly linked to specific model architectures, limiting generalizability and flexibility when aggregating with larger families of recommendation algorithms.
“Lastly, many aggregation techniques are strongly linked to specific model architectures, limiting generalizability and flexibility when aggregating with larger families of recommendation algorithms.”
The paper relies on this without support.
Multi-criteria recommender systems provide more effective recommendations than single-criterion models.
“Multi-criteria recommender systems have gained popularity recently because they provide more effective recommendations than single-criterion models.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Claim of uniform improvement conflicts with Yahoo!Movies results
MajorThe conclusion says neuro-fuzzy aggregation improves both metrics for every model, but Yahoo!Movies DeepMF has a higher RMSE and MAE with neuro-fuzzy aggregation than with fixed weighting.
“the introduced neuro-fuzzy aggregation uniformly improves RMSE and MAE over fixed-weight baselines for all models.”
“| DeepMF | 3.1369 | 2.4964 | 3.1389 | 2.5149 |”
Item-based CF does not have a Yahoo!Movies MAE reduction
MinorThe Yahoo!Movies table shows Item-based CF MAE increasing from 2.1642 with fixed weighting to 2.1810 with neuro-fuzzy aggregation.
“SVD++, PMF, and Item-based CF perform better with MAE reduction.”
“| Item-based CF | 3.0462 | 2.1642 | 2.8049 | 2.1810 |”
Low fuzzy set violates the stated triangle definition
MinorThe definition requires a < b < c, but the specified Low triangle has a = b = 0.0.
“For a triangular set tri(a, b, c) with a < b < c and input x ∈ [0, 1],”
“Low (0.0, 0.0, 0.5), Medium (0.25, 0.5, 0.75), High (0.5, 0.75, 1.0).”
Cites
Multi-Criteria Recommender Systems
Adomavičius, G., Manouselis, N., & Kwon, Y. (2010) · Springer eBooks · doi:10.1007/978-0-387-85820-3_24 · Cited by 178 · see citing works
Review-based Recommender Systems: A Survey of Approaches, Challenges and Future Perspectives
Hasan, E., Rahman, M., Ding, C., Huang, J. X., & Raza, S. (2025) · ACM Computing Surveys · doi:10.1145/3742421 · Cited by 90 · see citing works
A Neural Networks Approach for Improving the Accuracy of Multi-Criteria Recommender Systems
Hassan, M., & Hamada, M. (2017) · Applied Sciences · doi:10.3390/app7090868 · Cited by 62 · see citing works
Sinha, B. B., & Dhanalakshmi, R. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07012-y · Cited by 54 · see citing works
Lakiotaki, K., Tsafarakis, S., & Matsatsinis, N. F. (2008) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1454008.1454043 · Cited by 53 · see citing works
Genetic Algorithm Approaches for Improving Prediction Accuracy of Multi-criteria Recommender Systems
Hassan, M., & Hamada, M. (2017) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.11.1.12 · Cited by 38 · see citing works
Spillo, G., Musto, C., de Gemmis, M., et al. (2024) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-024-09417-x · Cited by 24 · see citing works
Singh, R., Dwivedi, P., & Kant, V. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18164-5 · Cited by 22 · see citing works
Self-citationDeep learning-based multi-criteria recommender system for technology-enhanced learning
Salau, L., Hamada, M., Abdulsalam, Y. S., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-97407-3 · Cited by 16 · see citing works
Neuro-symbolic recommendation model based on logic query
Wu, M., Chen, B., Zhu, S., et al. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111311 · Cited by 9 · see citing works
The Synergy of Fuzzy Logic and Multi-Criteria Decision-Making: Application Areas and Global Trends
Demir, G. (2025) · Journal of Intelligent Decision Making and Information Science · doi:10.59543/jidmis.v2i.14157 · Cited by 5 · see citing works
Rafique, Y., Wu, J., Muzaffar, A. W., et al. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2529 · Cited by 4 · see citing works
Khan, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.08691
Differentiable Fuzzy Neural Networks for Recommender Systems
Bartl, S., Innerebner, K., & Lex, E. (2025) · Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3708319.3734174
Visualization for Recommendation Explainability: A Survey and New Perspectives
Chatti, M. A., Guesmi, M., & Muslim, A. (2023) · arXiv · doi:10.48550/arxiv.2305.11755
Flagged first, then by citations
Research works printed but not linked: 1
- Zhai, 2020, A survey on fuzzy recommender systems, Information Sciences, 509, 255
- Authors
- Singh, R., Pinheiro, G., Ajagalla, M., & Patel, T.
- Affiliations
- Bennett University (IN)
- Corresponding author
- Singh, Reetu
- Pinheiro, Greetta
- Ajagalla, Mahadev
- Patel, Tanya
- ORCID
- Ajagalla, Mahadev
- Venue
- Procedia Computer Science
- Publisher
- Elsevier BV
- Published
- 2026
- Volume
- 283
- Pages
- 3925-3933
- ISSN
- 1877-0509 (ISSN-L)
- OpenAlex
- W7167732030
- Cited by
- 0
- References
- 10
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Procedia Computer Science (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- multi-criteria recommender systems, collaborative filtering, implicit feedback, probabilistic matrix factorization, deep matrix factorization, SVD, user-based collaborative filtering, item-based collaborative filtering, personalized recommendation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review