Learning about Social Learning in MOOCs: From Statistical Analysis to Generative Model
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
We study user behavior in the courses offered by a major massive online open course (MOOC) provider during the summer of 2013. Since social learning is a key element of scalable education on MOOC and is done via online discussion forums, our main focus is on understanding forum activities. Two salient features of these activities drive our research: (1) high decline rate: for each course studied, the volume of discussion declined continuously throughout the duration of the course; (2) high-volume, noisy discussions: at least 30 percent of the courses produced new threads at rates that are infeasible for students or teaching staff to read through. Further, a substantial portion of these discussions are not directly course-related. In our analysis, we investigate factors that are associated with the decline of activity on MOOC forums, and we find effective strategies to classify threads and rank their relevance. Specifically, we first use linear regression models to analyze the forum activity count data over time, and make a number of observations; for instance, the teaching staff's active participation in the discussions is correlated with an increase in the discussion volume but does not slow down the decline rate. We then propose a unified generative model for the discussion threads, which allows us both to choose efficient thread classifiers and to design an effective algorithm for ranking thread relevance. Further, our algorithm is compared against two baselines using human evaluation from Amazon Mechanical Turk.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Measuring user influence in twitter: The million follower fallacy
Cha, M., Haddadi, H., Benevenuto, F., & Gummadi, K. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14033 · Cited by 3,022 · cited 1×
“Categories and Subject Descriptors G.1.6 [Mathematics of Computing]: Least squares methods; I.2.6 [Computing Methodologies]: Concept Learning”
MethodInfluentialDeconstructing disengagement: analyzing learner subpopulations in massive open online courses
Kizilcec, R. F., Piech, C., & Schneider, E. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460330 · Cited by 984
Tuned Models of Peer Assessment in MOOCs
Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., & Koller, D. (2013) · arXiv · doi:10.48550/arxiv.1307.2579 · Cited by 262 · cited 1×
“Categories and Subject Descriptors G.1.6 [Mathematics of Computing]: Least squares methods; I.2.6 [Computing Methodologies]: Concept Learning”
MethodInfluential
Cited by
Wu, B., & Chen, X. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.10.028 · Cited by 1,130
Xing, W., Chen, X., Stein, J., & Marcinkowski, M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.007 · Cited by 256
Interactivity in online discussions and learning outcomes
Kent, C., Laslo, E., & Rafaeli, S. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.03.002 · Cited by 225
Sinha, T., Jermann, P., Li, N., & Dillenbourg, P. (2014) · Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs · doi:10.3115/v1/w14-4102 · Cited by 187
“While substantial research has been done on studying MOOC discussion forums (Ramesh et al., 2013; Brinton et al., 2013; Anderson et al., 2014; Sinha, 2014b), grading strategies for assignments (Tillmann et al.”
BackgroundFerreira‐Mello, R., André, M., Pinheiro, A., Costa, E., & Romero, C. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1332 · Cited by 193
“The student participation in an educational environment, mainly using tools such as forum, can be decisive for the completion of the course, especially in distance education (Brinton et al., 2014).”
BackgroundCohen, S. S., Madsen, J., Touchan, G., Robles, D., Lima, S. F. A., Henin, S., & Parra, L. C. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.06.011 · Cited by 116
“(Koller, Ng, Do, & Chen, 2013), participation in online discussion forums (Brinton et al., 2014; Kizilcec, Piech, & Schneider, 2013), or by the length of viewing time (Guo, Kim, & Rubin, 2014; Kim et al.”
Okoye, K., Arrona-Palacios, A., Camacho-Zuñiga, C., Achem, J. A. G., Escamilla, J., & Hosseini, S. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10751-5 · Cited by 112
Charitopoulos, A., Rangoussi, M., & Koulouriotis, D. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00200-8 · Cited by 89
Design and application of automatic feedback scaffolding in forums to promote learning
Wang, Q., Rose, C. P., Ma, N., Jiang, S., Bao, H., & Li, Y. (2022) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3156914 · Cited by 15
Incentive Design in Peer Review: Rating and Repeated Endogenous Matching
Xiao, Y., Dorfler, F., & Schaar, M. V. D. (2019) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2018.2877578 · Cited by 10
OP-DCI: A Riskless K-Means Clustering for Influential User Identification in MOOC Forum
Hou, X., Lei, C.-U., & Kwok, Y.-K. (2017) · 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2017.00-34 · Cited by 7
“However, communication is so limited in MOOC that discussion forum becomes the dominant channel for communications among enrolled learners and course team [1].”
BackgroundCommunity TAs scale high-touch learning, provide student-staff brokering, and build esprit de corps
Papadopoulos, K., Sritanyaratana, L., & Klemmer, S. R. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2567860 · Cited by 7
Metadata
- Authors
- Brinton, C. G., Chiang, M., Jain, S., Lam, H., Liu, Z., & Wong, F. M. F.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2014-10-01
- Volume
- 7
- Issue
- 4
- Pages
- 346-359
- ISSN
- 1939-1382 (ISSN-L)
- OpenAlex
- W1981976566
- Cited by
- 247
- References
- 5
- FWCI
- 55.34
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.