The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Sentiment analysis on massive open online course evaluations: A text mining and deep learning approach
Abstract
Massive open online courses (MOOCs) are recent innovative approaches in distance education, which provide learning content to participants without age‐, gender‐, race‐, or geography‐related barriers. The purpose of our research is to present an efficient sentiment classification scheme with high predictive performance in MOOC reviews, by pursuing the paradigms of ensemble learning and deep learning. In this contribution, we seek to answer several research questions on sentiment analysis on educational data. First, the predictive performance of conventional supervised learning methods, ensemble learning methods and deep learning methods has been evaluated. Besides, the efficiency of text representation schemes and word‐embedding schemes has been evaluated for sentiment analysis on MOOC evaluations. For the evaluation task, we have analyzed a corpus containing 66,000 MOOC reviews, with the use of machine learning, ensemble learning, and deep learning methods. The empirical analysis indicate that deep learning‐based architectures outperform ensemble learning methods and supervised learning methods for the task of sentiment analysis on educational data mining. For all the compared configurations, the highest predictive performance has been achieved by long short‐term memory networks in conjunction with GloVe word‐embedding scheme‐based representation, with a classification accuracy of 95.80%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Sentiment analysis algorithms and applications: A survey
Medhat, W., Hassan, A., & Korashy, H. (2014) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2014.04.011 · Cited by 3,248
A neural probabilistic language model
BengioYoshua, DucharmeRéjean, VincentPascal, & JanvinChristian (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944966 · Cited by 2,644
Instance-based learning algorithms
Aha, D. W., Kibler, D., & Albert, M. K. (1991) · Machine Learning · doi:10.1007/bf00153759 · Cited by 2,163
Naive (Bayes) at forty: The independence assumption in information retrieval
Lewis, D. D. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026666 · Cited by 2,104
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,566
Learning analytics and educational data mining: towards communication and collaboration
Siemens, G., & Baker, R. S. J. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330661 · Cited by 1,075
(2013) · Research & Practice in Assessment · Cited by 920
FastText.zip: Compressing text classification models
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1612.03651 · Cited by 887
NLTK: The Natural Language Toolkit
Bird, S. (2006) · Proceedings of the COLING/ACL on Interactive presentation sessions - · doi:10.3115/1225403.1225421 · Cited by 841
Kaplan, A. M., & Haenlein, M. (2016) · Business Horizons · doi:10.1016/j.bushor.2016.03.008 · Cited by 813
Sentiment analysis: A combined approach
Prabowo, R., & Thelwall, M. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.01.003 · Cited by 803
Educational data mining: A survey and a data mining-based analysis of recent works
Peña-Ayala, A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.042 · Cited by 660
Ensemble of keyword extraction methods and classifiers in text classification
Onan, A., Korukoğlu, S., & Bulut, H. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.03.045 · Cited by 630
Self-citationAldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564
Pfeifer, R., Soulié, F. F., Steels, L., & Schreter, Z. (1989) · Elsevier eBooks · Cited by 514
Onan, A., Korukoğlu, S., & Bulut, H. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.06.005 · Cited by 367
Self-citationSentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
HarvardX and MITx: The First Year of Open Online Courses, Fall 2012-Summer 2013
Ho, A. D., Reich, J., Nesterko, S. O., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2381263 · Cited by 299
Sentiment analysis on Twitter: A text mining approach to the Syrian refugee crisis
Öztürk, N., & Ayvaz, S. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2017.10.006 · Cited by 290
Onan, A. (2018) · Journal of Information Science · doi:10.1177/0165551516677911 · Cited by 283
Self-citationKhan, I. U., Hameed, Z., Yu, Y., Islam, T., Sheikh, Z., & Khan, S. U. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2017.09.009 · Cited by 282
Mining opinions from instructor evaluation reviews: a deep learning approach
Onan, A. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22179 · Cited by 270
What Makes a Great MOOC? An Interdisciplinary Analysis of Student Retention in Online Courses
Adamopoulos, P. (2013) · Cited by 251
Using data mining as a strategy for assessing asynchronous discussion forums
Dringus, L. P., & Ellis, T. (2005) · Computers & Education · doi:10.1016/j.compedu.2004.05.003 · Cited by 241
Mastering Machine Learning With scikit-learn
Hackeling, G. (2014) · CERN Document Server (European Organization for Nuclear Research) · Cited by 238
Al-Smadi, M., Al-Ayyoub, M., Jararweh, Y., & Qawasmeh, O. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.01.006 · Cited by 189
Assessing the helpfulness of online hotel reviews: A classification-based approach
Lee, P.-J., Hu, Y.-H., & Lu, K.-T. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2018.01.001 · Cited by 169
Using a stacked residual LSTM model for sentiment intensity prediction
Wang, J., Peng, B., & Zhang, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.049 · Cited by 158
Text Mining and Analysis: Practical Methods, Examples, and Case Studies Using SAS
Chakraborty, G., Pagolu, M., & Garla, S. (2013) · Cited by 151
Deep learning for sentiment analysis
Rojas-Barahona, L. M. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12228 · Cited by 141
Exploring communities of inquiry in Massive Open Online Courses
Kovanović, V., Joksimovíc, S., Poquet, O., Hennis, T., Čukić, I., de Vries, P., Hatala, M., Dawson, S., Siemens, G., & Gašević, D. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.11.010 · Cited by 122
Rodger, J. A. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.080 · Cited by 119
Muñoz‐Merino, P. J., Ruipérez‐Valiente, J. A., Alario‐Hoyos, C., Pérez‐Sanagustín, M., & Kloos, C. D. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.003 · Cited by 113
Alami, N., Meknassi, M., & En-Nahnahi, N. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.01.037 · Cited by 112
Tian, F., Gao, P., Li, L., Zhang, W., Liang, H., Qian, Y., & Zhao, R. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.10.019 · Cited by 87
Sentiment analysis in MOOCs: A case study
Moreno-Marcos, P. M., Alario‐Hoyos, C., Muñoz‐Merino, P. J., Ayres, I. E., & Kloos, C. D. (2018) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2018.8363409 · Cited by 87
Lexical based automated teaching evaluation via students’ short reviews
Lin, Q., Zhu, Y., Zhang, S., Shi, P., Guo, Q., & Niu, Z. (2018) · Computer Applications in Engineering Education · doi:10.1002/cae.22068 · Cited by 77
Rodger, J. A. (2015) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2016.01.002 · Cited by 71
Santos, C. L., Rita, P., & Guerreiro, J. (2018) · International Journal of Educational Management · doi:10.1108/ijem-01-2017-0027 · Cited by 63
Maxwell, W. D., Fabel, P. H., Díaz, V., Walkow, J. C., Kwiek, N. C., Kanchanaraksa, S., Wamsley, M. A., Chen, A., & Bookstaver, P. B. (2018) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2018.03.013 · Cited by 58
QMOS: Query-based multi-documents opinion-oriented summarization
Abdi, A., Shamsuddin, S. M., & Aliguliyev, R. M. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2017.12.002 · Cited by 55
Multilingual opinion mining on YouTube – A convolutional N-gram BiLSTM word embedding
Nguyen, H. T., & Nguyen, L.-M. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.02.001 · Cited by 52
Who can benefit more from massive open online courses? A prospective cohort study
Jia, M., Gong, D., Luo, J., Zhao, J., Zheng, J., & Li, K. (2019) · Nurse Education Today · doi:10.1016/j.nedt.2019.02.004 · Cited by 46
Massive open online courses as a knowledge base for teachers
Donitsa‐Schmidt, S., & Topaz, B. (2018) · Journal of Education for Teaching International Research and Pedagogy · doi:10.1080/02607476.2018.1516350 · Cited by 45
Opinion mining and emotion recognition in an intelligent learning environment
Bustillos, R. O., Cabada, R. Z., Estrada, M. L. B., & Hernández, Y. (2018) · Computer Applications in Engineering Education · doi:10.1002/cae.22059 · Cited by 41
Valakunde, N. D., & Patwardhan, M. S. (2013) · International Conference on Cloud & Ubiquitous Computing & Emerging Technologies (CUBE) · doi:10.1109/cube.2013.42 · Cited by 35
Sentiment Analysis to Evaluate Teaching Performance
Adinolfi, P., D’Avanzo, E., Lytras, M. D., Novo‐Corti, I., & Picatoste, X. (2016) · International Journal of Knowledge Society Research · doi:10.4018/ijksr.2016100108 · Cited by 29
Mining: Students Comments about Teacher Performance Assessment using Machine Learning Algorithms
Gutiérrez, G., Canul-Reich, J., Zezzatti, A. O., Margain, L., & Ponce, J. (2018) · International Journal of Combinatorial Optimization Problems and Informatics. · Cited by 24
Mining of Educational Opinions with Deep Learning
Estrada, M. L. B., Cabada, R. Z., & Bustillos, R. O. (2018) · JUCS - Journal of Universal Computer Science · doi:10.3217/jucs-024-11-1604 · Cited by 16
Using language models to improve opinion detection
Belbachir, F., & Boughanem, M. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.07.001 · Cited by 15
EduRP: an Educational Resources Platform based on Opinion Mining and Semantic Web.
Bustos-López, M., Alor‐Hernández, G., Sánchez-Cervantes, J. L., Salas‐Zárate, M. D. P., & Paredes‐Valverde, M. A. (2018) · JUCS - Journal of Universal Computer Science · Cited by 15
(1996)
Cited by
Systematic reviews in sentiment analysis: a tertiary study
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09973-3 · Cited by 303
Liu, S., Liu, S., Liu, Z., Peng, X., & Yang, Z. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104461 · Cited by 269
Sentiment analysis and opinion mining on educational data: A survey
Shaik, T., Tao, X., Dann, C., Xie, H., Li, Y., & Galligan, L. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2022.100003 · Cited by 215
A Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204
Qu, Z., Liu, X., & Zheng, M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3203791 · Cited by 140
Metadata
- Authors
- ONAN, A.
- Venue
- Computer Applications in Engineering Education
- Publisher
- Wiley
- Published
- 2020-05-04
- Volume
- 29
- Issue
- 3
- Pages
- 572-589
- ISSN
- 1061-3773 (ISSN-L)
- 1099-0542
- OpenAlex
- W3022935508
- Cited by
- 382
- References
- 66
- FWCI
- 22.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.