Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Thousands of students enroll in Massive Open Online Courses~(MOOCs) to seek opportunities for learning and self-improvement. However, the learning process often involves struggles with confusion, which may have an adverse effect on the course participation experience, leading to dropout along the way. In this paper, we quantify that effect. We describe a classification model using discussion forum behavior and clickstream data to automatically identify posts that express confusion. We then apply survival analysis to quantify the impact of confusion on student dropout. The results demonstrate that the more confusion students express or are exposed to, the lower the probability of their retention. Receiving support and resolution of confusion helps mitigate this effect. We explore the differential effects of confusion expressed in different contexts and related to different aspects of courses. We conclude with implications for design of interventions towards improving the retention of students in MOOCs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · cited 1×
“Such interaction could play an important role in maintaining student engagement because of its directive, facilitative and motivational functions [18].”
BackgroundPekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002) · Educational Psychologist · doi:10.1207/s15326985ep3702_4 · Cited by 3,931 · cited 1×
“Researchers have been investigating student affect changes, including confusion, over extended periods of time by developing models using approaches such as classification or knowledge engineering [14].”
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
Affect-aware tutors: recognising and responding to student affect
Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., & Picard, R. (2009) · International Journal of Learning Technology · doi:10.1504/ijlt.2009.028804 · Cited by 371
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328 · cited 1×
“Similarly, Conati [5], developed a detector based on a combination of questionnaire and log data to predict self-reported student affect.”
BackgroundWang, Y.-C., Kraut, R., & Levine, J. M. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145329 · Cited by 282
Self-citation
Cited by
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018) · Review of Educational Research · doi:10.3102/0034654317740335 · Cited by 182
Factors influencing peer learning and performance in MOOC asynchronous online discussion forum
Chiu, T. K. F., & Hew, T. K. F. (2018) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3240 · Cited by 171
“MOOC learners are voluntary (Alraimi et al., 2015) and self-regulated (Kop & Fournier, 2011; Yang et al., 2015), and do not know most of their peers (DeBoer et al., 2013; Gillani & Eynon, 2014).”
BackgroundInfluentialPlanning prompts increase and forecast course completion in massive open online courses
Yeomans, M., & Reich, J. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027416 · Cited by 61
How Widely Can Prediction Models Be Generalized? Performance Prediction in Blended Courses
Gitinabard, N., Xu, Y., Heckman, S., Barnes, T., & Lynch, C. F. (2019) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2019.2911832 · Cited by 60
“Other researchers have analyzed informative metrics based upon students’ general study habits such as: the number of posts made or read, time spent online, when they joined the course, the number of videos watched in a week, the number of quizzes or assignments they attempted, the number of forum posts made per week a…”
BackgroundAssessing Algorithmic Fairness in Automatic Classifiers of Educational Forum Posts
Sha, L., Rakovic, M., Whitelock-Wainwright, A., Carroll, D., Yew, V. M., Gasevic, D., & Chen, G. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-78292-4_31 · Cited by 34
Metadata
- Authors
- Yang, D., Wen, M., Howley, I., Kraut, R., & Rose, C.
- Venue
- Proceedings of the Second (2015) ACM Conference on Learning @ Scale
- Publisher
- ACM
- Published
- 2015-03-14
- Pages
- 121-130
- OpenAlex
- W2028111024
- Cited by
- 114
- References
- 8
- FWCI
- 8.38
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.