Combining click-stream data with NLP tools to better understand MOOC completion
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Completion rates for massive open online classes (MOOCs) are notoriously low. Identifying student patterns related to course completion may help to develop interventions that can improve retention and learning outcomes in MOOCs. Previous research predicting MOOC completion has focused on click-stream data, student demographics, and natural language processing (NLP) analyses. However, most of these analyses have not taken full advantage of the multiple types of data available. This study combines click-stream data and NLP approaches to examine if students' on-line activity and the language they produce in the online discussion forum is predictive of successful class completion. We study this analysis in the context of a subsample of 320 students who completed at least one graded assignment and produced at least 50 words in discussion forums, in a MOOC on educational data mining. The findings indicate that a mix of click-stream data and NLP indices can predict with substantial accuracy (78%) whether students complete the MOOC. This predictive power suggests that student interaction data and language data within a MOOC can help us both to understand student retention in MOOCs and to develop automated signals of student success.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
What are emotions? And how can they be measured?
Scherer, K. R. (2005) · Social Science Information · doi:10.1177/0539018405058216 · Cited by 4,264
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
“Predicting MOOC dropout over weeks using machine learning methods,”
Kloft, M., Stiehler, F., Zheng, Z., & Pinkwart, N. (2014) · Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs · doi:10.3115/v1/w14-4111 · Cited by 325
Discourse cohesion: a signature of collaboration
Dascalu, M., Trausan-Matu, S., Dessus, P., & McNamara, D. S. (2015) · Proceedings of the Fifth International Conference on Learning Analytics And Knowledge · doi:10.1145/2723576.2723578 · Cited by 20
Self-citation
Cited by
Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies
Cope, B., Kalantzis, M., & Searsmith, D. (2021) · Educational Philosophy and Theory · doi:10.1080/00131857.2020.1728732 · Cited by 518
“…intelligent tutoring systems (Carbonell, 1970; Mark & Greer, 1995; VanLehn, 2011); log file and clickstream analyses that predict learner success (Crossley, Paquette, Dascalu, McNamara, & Baker, 2016); games and simulations that capture and interpret incremental moves on-the-fly (Mislevy et al.,…”
BackgroundDropout Prediction in MOOCs: Using Deep Learning for Personalized Intervention
Xing, W., & Du, D. (2019) · Journal of Educational Computing Research · doi:10.1177/0735633118757015 · Cited by 321
Understanding user perception toward artificial intelligence (AI) enabled e-learning
Kashive, N., Powale, L., & Kashive, K. (2020) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-05-2020-0090 · Cited by 181
Equity Beyond Bias in Language Technologies for Education
Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4446 · Cited by 62
“In text-only settings online, sentiment has been a key part of prediction of attrition rates in MOOCs (Yang et al., 2013; Wen et al., 2014), especially when combined with micro-level instantaneous data like clickstream events (Crossley et al., 2016).”
BackgroundPredicting Student Dropout in a MOOC: An Evaluation of a Deep Neural Network Model
Imran, A. S., Dalipi, F., & Kastrati, Z. (2019) · Proceedings of the 2019 5th International Conference on Computing and Artificial Intelligence · doi:10.1145/3330482.3330514 · Cited by 36
Metadata
- Authors
- Crossley, S., Paquette, L., Dascalu, M., McNamara, D. S., & Baker, R. S.
- Venue
- Proceedings of the Sixth International Conference on Learning Analytics & Knowledge
- Publisher
- ACM
- Published
- 2016-04-25
- Pages
- 6-14
- OpenAlex
- W2339386532
- Cited by
- 157
- References
- 6
- FWCI
- 13.11
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Combining click-stream data with NLP tools to better understand MOOC completion. https://app.cochat.ai/papers/10.1145/2883851.2883931
- The paper
- Crossley, S., Paquette, L., Dascalu, M., McNamara, D. S., & Baker, R. S. (2016). Combining click-stream data with NLP tools to better understand MOOC completion. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. https://doi.org/10.1145/2883851.2883931
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.