The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Sentiment Analysis of Students’ Feedback with NLP and Deep Learning: A Systematic Mapping Study
Open accessAbstract
In the last decade, sentiment analysis has been widely applied in many domains, including business, social networks and education. Particularly in the education domain, where dealing with and processing students’ opinions is a complicated task due to the nature of the language used by students and the large volume of information, the application of sentiment analysis is growing yet remains challenging. Several literature reviews reveal the state of the application of sentiment analysis in this domain from different perspectives and contexts. However, the body of literature is lacking a review that systematically classifies the research and results of the application of natural language processing (NLP), deep learning (DL), and machine learning (ML) solutions for sentiment analysis in the education domain. In this article, we present the results of a systematic mapping study to structure the published information available. We used a stepwise PRISMA framework to guide the search process and searched for studies conducted between 2015 and 2020 in the electronic research databases of the scientific literature. We identified 92 relevant studies out of 612 that were initially found on the sentiment analysis of students’ feedback in learning platform environments. The mapping results showed that, despite the identified challenges, the field is rapidly growing, especially regarding the application of DL, which is the most recent trend. We identified various aspects that need to be considered in order to contribute to the maturity of research and development in the field. Among these aspects, we highlighted the need of having structured datasets, standardized solutions and increased focus on emotional expression and detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Sangeetha, K., & Prabha, D. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-01791-9 · Cited by 103
RetractedPreferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Utilization of the PICO framework to improve searching PubMed for clinical questions
Schardt, C., Adams, M. B., Owens, T., Keitz, S., & Fontelo, P. (2007) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-7-16 · Cited by 3,053
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
Techniques and applications for sentiment analysis
Feldman, R. (2013) · Communications of the ACM · doi:10.1145/2436256.2436274 · Cited by 1,489
Plutchik, R. (2001) · American Scientist · doi:10.1511/2001.4.344 · Cited by 1,419
New Avenues in Opinion Mining and Sentiment Analysis
Cambria, E., Schuller, B., Xia, Y., & Havasi, C. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.30 · Cited by 1,285
Plutchik, R. (2001) · American Scientist · doi:10.1511/2001.28.344 · Cited by 666
Yang, L., Li, Y., Wang, J., & Sherratt, R. S. (2020) · IEEE Access · doi:10.1109/access.2020.2969854 · Cited by 573
Text‐based emotion detection: Advances, challenges, and opportunities
Acheampong, F. A., Wenyu, C., & Nunoo‐Mensah, H. (2020) · Engineering Reports · doi:10.1002/eng2.12189 · Cited by 367
Hew, K. F., Hu, X., Qiao, C., & Tang, Y. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103724 · Cited by 366
Imran, A. S., Daudpota, S. M., Kastrati, Z., & Batra, R. (2020) · IEEE Access · doi:10.1109/access.2020.3027350 · Cited by 343
Self-citationSentiment Analysis in MOOC Discussion Forums: What does it tell us?
Wen, M., Yang, D., & Rosé, C. P. (2014) · Educational Data Mining · Cited by 288
SemEval-2019 Task 3: EmoContext Contextual Emotion Detection in Text
Chatterjee, A., Narahari, K. N., Joshi, M., & Agrawal, P. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2005 · Cited by 283
Mining opinions from instructor evaluation reviews: a deep learning approach
Onan, A. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22179 · Cited by 270
The emergence of social media data and sentiment analysis in election prediction
Chauhan, P., Sharma, N., & Sikka, G. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02423-y · Cited by 224
Sentiment analysis in education research: a review of journal publications
Zhou, J., & Ye, J.-M. (2020) · Interactive Learning Environments · doi:10.1080/10494820.2020.1826985 · Cited by 179
Weakly Supervised Framework for Aspect-Based Sentiment Analysis on Students’ Reviews of MOOCs
Kastrati, Z., Imran, A. S., & Kurti, A. (2020) · IEEE Access · doi:10.1109/access.2020.3000739 · Cited by 173
Self-citationA Sentiment Analysis System to Improve Teaching and Learning
Rani, S., & Kumar, P. (2017) · Computer · doi:10.1109/mc.2017.133 · Cited by 157
Aspect-Based Opinion Mining on Student’s Feedback for Faculty Teaching Performance Evaluation
Sindhu, I., Daudpota, S. M., Badar, K., Bakhtyar, M., Baber, J., & Nurunnabi, M. (2019) · IEEE Access · doi:10.1109/access.2019.2928872 · Cited by 150
Sentiment analysis of students' comment using lexicon based approach
Aung, K. Z., & Myo, N. N. (2017) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2017.7959985 · Cited by 146
Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks.
Chaplot, D. S., Rhim, E., & Kim, J. (2015) · AIED Workshops · Cited by 135
Opinion mining and emotion recognition applied to learning environments
Estrada, M. L. B., Cabada, R. Z., Bustillos, R. O., & Graff, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113265 · Cited by 135
Lexicon-Based Sentiment Analysis of Teachers’ Evaluation
Rajput, Q., Haider, S., & Ghani, S. (2016) · Applied Computational Intelligence and Soft Computing · doi:10.1155/2016/2385429 · Cited by 115
Sentiment analysis of student feedback using machine learning and lexicon based approaches
Nasim, Z., Rajput, Q., & Haider, S. (2017) · International Conference on Research and Innovation in Information Systems · doi:10.1109/icriis.2017.8002475 · Cited by 115
Assessing learners’ satisfaction in collaborative online courses through a big data approach
Elia, G., Solazzo, G., Lorenzo, G., & Passıante, G. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.04.033 · Cited by 108
Opinion mining from student feedback data using supervised learning algorithms
Dhanalakshmi, V., Bino, D., & Saravanan, A. (2016) · MEC International Conference on Big Data and Smart City (ICBDSC) · doi:10.1109/icbdsc.2016.7460390 · Cited by 104
Improving early prediction of academic failure using sentiment analysis on self‐evaluated comments
Yu, L.-C., Lee, C. W., Pan, H. I., Chou, C., Chao, P.-Y., Chen, Z., Tseng, S. F., Chan, C., & Lai, K.-H. R. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12247 · Cited by 95
Sentiment analysis in MOOCs: A case study
Moreno-Marcos, P. M., Alario‐Hoyos, C., Muñoz‐Merino, P. J., Ayres, I. E., & Kloos, C. D. (2018) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2018.8363409 · Cited by 87
Sentiment analysis for customer relationship management: an incremental learning approach
Capuano, N., Greco, L., Ritrovato, P., & Vento, M. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01984-x · Cited by 87
Aspect-Based Sentiment Analysis of Students’ Feedback to Improve Teaching–Learning Process
Chauhan, G. S., Agrawal, P., & Meena, Y. K. (2018) · Smart innovation, systems and technologies · doi:10.1007/978-981-13-1747-7_25 · Cited by 86
Topic-based knowledge mining of online student reviews for strategic planning in universities
Srinivas, S., & Rajendran, S. (2018) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.06.034 · Cited by 83
Analyzing the Brazilian Financial Market through Portuguese Sentiment Analysis in Social Media
Carosia, A. E. D. O., Coelho, G. P., & da Silva, A. E. A. (2019) · Applied Artificial Intelligence · doi:10.1080/08839514.2019.1673037 · Cited by 82
UIT-VSFC: Vietnamese Students’ Feedback Corpus for Sentiment Analysis
Nguyen, K. V., Nguyen, D.-V., Nguyen, P. X. V., et al. (2018) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse.2018.8573337 · Cited by 78
Teacher's performance evaluation tool using opinion mining with sentiment analysis
Balahadia, F. F., Fernando, M. C. G., & Juanatas, I. C. (2016) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tenconspring.2016.7519384 · Cited by 77
Visualizing Student Opinion Through Text Analysis
Cunningham-Nelson, S., Baktashmotlagh, M., & Boles, W. (2019) · IEEE Transactions on Education · doi:10.1109/te.2019.2924385 · Cited by 75 · cited 1×
“…from online social networking and micro-blogging sites, discussion forums etc. such as Facebook and Twitter Survey/questionnaire [13,15,32,33,41,51,57,60,62,65,71,77,79, 83,89,94,96,100] Here, the data were mostly collected by conducting surveys among students and teachers or by providing…”
MethodSentiment Analysis of Student Evaluations of Teaching
Newman, H., & Joyner, D. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_45 · Cited by 71
The impact of deep learning on document classification using semantically rich representations
Kastrati, Z., Imran, A. S., & Yayilgan, S. Y. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.003 · Cited by 71
Self-citationAspect-based sentiment analysis of reviews in the domain of higher education
Nikolić, N., Grljević, O., & Kovačević, A. (2020) · The Electronic Library · doi:10.1108/el-06-2019-0140 · Cited by 69
Aspect based sentiment analysis of students opinion using machine learning techniques
Sivakumar, M., & Reddy, U. S. (2017) · International Conference on Inventive Computing and Informatics (ICICI) · doi:10.1109/icici.2017.8365231 · Cited by 68
Esparza, G. G., de-Luna, A., Zezzatti, A. O., Hernandez, A., Ponce, J., Álvarez, M., Cossio, E., & de Jesus Nava, J. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-62410-5_19 · Cited by 65
Santos, C. L., Rita, P., & Guerreiro, J. (2018) · International Journal of Educational Management · doi:10.1108/ijem-01-2017-0027 · Cited by 63
Evaluation of Student Feedback Within a MOOC Using Sentiment Analysis and Target Groups
Lundqvist, K. Ø., Liyanagunawardena, T. R., & Starkey, L. (2020) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v21i3.4783 · Cited by 60
SENSE: a Student Performance Quantifier using Sentiment Analysis
Watkins, J., Fabielli, M., & Mahmud, M. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207721 · Cited by 57
Prediction of Sentiment Analysis on Educational Data based on Deep Learning Approach
Sultana, J., Sultana, N., Yadav, K., & Alfayez, F. (2018) · Saudi Computer Society National Computer Conference (NCC) · doi:10.1109/ncg.2018.8593108 · Cited by 54
Sentiment analysis and Feedback Evaluation
Kumar, A., & Jain, R. (2015) · IEEE International Conference on MOOCs, Innovation and Technology in Education (MITE) · doi:10.1109/mite.2015.7375359 · Cited by 52
Shuang, K., Zhang, Z., Loo, J., & Su, S. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.06.009 · Cited by 52
A review on sentiment discovery and analysis of educational big‐data
Han, Z., Wu, J., Huang, C., Huang, Q., & Zhao, M. (2019) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1328 · Cited by 50
Cobos, R., Jurado, F., & Blázquez-Herranz, A. (2019) · IEEE Revista Iberoamericana de Tecnologias del Aprendizaje · doi:10.1109/rita.2019.2952298 · Cited by 50
Deep Learning versus Traditional Classifiers on Vietnamese Students’ Feedback Corpus
Nguyen, P. X. V., Hong, T. T. T., Nguyen, K. V., & Nguyen, N. L.-T. (2018) · NAFOSTED Conference on Information and Computer Science (NICS) · doi:10.1109/nics.2018.8606837 · Cited by 47
Effective lexicon-based approach for Urdu sentiment analysis
Mukhtar, N., & Khan, M. A. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-019-09740-5 · Cited by 47
Sentiment detection in social networks and in collaborative learning environments
Colace, F., Casaburi, L., Santo, M. D., & Greco, L. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.11.090 · Cited by 46
Kastrati, Z., Imran, A. S., & Kurti, A. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.08.019 · Cited by 45
Self-citationPong-inwong, C., & Songpan, W. (2018) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0800-2 · Cited by 42
A Sentiment Analysis Model for Faculty Comment Evaluation Using Ensemble Machine Learning Algorithms
Lalata, J.-A. P., Gerardo, B. D., & Medina, R. P. (2019) · doi:10.1145/3341620.3341638 · Cited by 39
Variants of Long Short-Term Memory for Sentiment Analysis on Vietnamese Students’ Feedback Corpus
Nguyen, D.-V., Nguyen, K. V., & Nguyen, N. L.-T. (2018) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse.2018.8573351 · Cited by 38
Sentiment Analysis in an Affective Intelligent Tutoring System
Barron-Estrada, M. L., Zatarain-Cabada, R., Oramas-Bustillos, R., & Gonzalez-Hernandez, F. (2017) · 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2017.137 · Cited by 32
Balachandran, L., & Kirupananda, A. (2017) · International Conference on Software, Knowledge, Information Management and Applications (SKIMA) · doi:10.1109/skima.2017.8294118 · Cited by 29
Analyzing educational comments for topics and sentiments: A text analytics approach
Nitin, G. I., Gottipati, S., & Shankararaman, V. (2015) · 2022 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2015.7344296 · Cited by 27
Sentiment Analysis of Teachers Using Social Information in Educational Platform Environments
Spatiotis, N., Perikos, I., Mporas, I., & Paraskevas, M. (2020) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213020400047 · Cited by 27
Feedback Analysis in Outcome Base Education Using Machine Learning
Lwin, H. H., Oo, S., Ye, K. Z., Lin, K. K., Aung, W. P., & Ko, P. P. (2020) · International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) · doi:10.1109/ecti-con49241.2020.9158328 · Cited by 27
SUFAT - An Analytics Tool for Gaining Insights from Student Feedback Comments
Pyasi, S., Gottipati, S., & Shankararaman, V. (2018) · 2022 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2018.8658457 · Cited by 26
Feature Based Sentiment Analysis for Evaluating the Mobile Pedagogical Affordances of Apps
Bano, M., Zowghi, D., & Kearney, M. (2017) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-74310-3_30 · Cited by 17
Student Sentiment Analysis Using Gamification for Education Context
Mostafa, L. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-31129-2_30 · Cited by 17
Sentiment Research on Student Feedback to Improve Experiences in Blended Learning Environments
(2019) · International Journal of Innovative Technology and Exploring Engineering · doi:10.35940/ijitee.k1034.09811s19 · Cited by 17
e-Learning Recommender System for Teachers using Opinion Mining
Tewari, A. S., Saroj, A., & Barman, A. G. (2015) · Lecture notes in electrical engineering · doi:10.1007/978-3-662-46578-3_122 · Cited by 13
Sentiment Analysis from Students’ Feedback : A Romanian High School Case Study
Marcu, D., & Danubianu, M. (2020) · International Conference on Development and Application Systems (DAS) · doi:10.1109/das49615.2020.9108927 · Cited by 13
Haryani, C. A., Hidayanto, A. N., Fitriah, N., Abidin, Z., & Wati, T. (2019) · International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE) · doi:10.1109/icitisee48480.2019.9003818 · Cited by 9
Sentiment Analysis of Student’s Facebook Posts
Iram, A. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-6052-7_8 · Cited by 8
Lalata, J.-A. P., Gerardo, B. D., & Medina, R. P. (2019) · doi:10.1145/3357254.3357287 · Cited by 8
Accuracy' Measures of Sentiment Analysis Algorithms for Spanish Corpus generated in Peer Assessment
Pinargote-Ortega, M., Bowen-Mendoza, L. E., Meza, J., & Soto, S. V. (2020) · International Conference on Engineering & MIS (ICEMIS) · doi:10.1145/3410352.3410838 · Cited by 8
Sentiment analysis and visualisation in a backchannel system
Jiranantanagorn, P., & Shen, H. (2016) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3010915.3010992 · Cited by 5
Sentiment analysis on university satisfaction in social media
Korkmaz, M. (2018) · Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT) · doi:10.1109/ebbt.2018.8391463 · Cited by 4
A data mining framework for analyzing students’ feedback of assessment
Ibrahim, Z. M., Bader-El-Den, M. B., & Cocea, M. (2018) · European Conference on Technology Enhanced Learning · Cited by 4
Cited by
Shaik, T., Tao, X., Li, Y., Dann, C., McDonald, J., Redmond, P., & Galligan, L. (2022) · IEEE Access · doi:10.1109/access.2022.3177752 · Cited by 286
Lampropoulos, G., Keramopoulos, E., Diamantaras, K., & Evangelidis, G. (2022) · Education Sciences · doi:10.3390/educsci12110798 · Cited by 119
Personalized Feedback Enhanced by Natural Language Processing in Intelligent Tutoring Systems
Troussas, C., Papakostas, C., Krouska, A., Mylonas, P., & Sgouropoulou, C. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-32883-1_58 · Cited by 47
Metadata
- Authors
- Kastrati, Z., Dalipi, F., Imran, A. S., Pireva Nuci, K., & Wani, M. A.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2021-04-28
- Volume
- 11
- Issue
- 9
- Pages
- 3986
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3159506165
- Cited by
- 256
- References
- 75
- FWCI
- 13.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.