Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Thousands of students enroll in Massive Open Online Courses~(MOOCs) to seek opportunities for learning and self-improvement. However, the learning process often involves struggles with confusion, which may have an adverse effect on the course participation experience, leading to dropout along the way. In this paper, we quantify that effect. We describe a classification model using discussion forum behavior and clickstream data to automatically identify posts that express confusion. We then apply survival analysis to quantify the impact of confusion on student dropout. The results demonstrate that the more confusion students express or are exposed to, the lower the probability of their retention. Receiving support and resolution of confusion helps mitigate this effect. We explore the differential effects of confusion expressed in different contexts and related to different aspects of courses. We conclude with implications for design of interventions towards improving the retention of students in MOOCs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · cited 1×
“Such interaction could play an important role in maintaining student engagement because of its directive, facilitative and motivational functions [18].”
BackgroundPekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002) · Educational Psychologist · doi:10.1207/s15326985ep3702_4 · Cited by 3,931
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
Affect-aware tutors: recognising and responding to student affect
Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., & Picard, R. (2009) · International Journal of Learning Technology · doi:10.1504/ijlt.2009.028804 · Cited by 371
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328 · cited 1×
“Similarly, Conati [5], developed a detector based on a combination of questionnaire and log data to predict self-reported student affect.”
BackgroundWang, Y.-C., Kraut, R., & Levine, J. M. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145329 · Cited by 282
Self-citation
Cited by
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018) · Review of Educational Research · doi:10.3102/0034654317740335 · Cited by 182
Planning prompts increase and forecast course completion in massive open online courses
Yeomans, M., & Reich, J. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027416 · Cited by 61
How Widely Can Prediction Models Be Generalized? Performance Prediction in Blended Courses
Gitinabard, N., Xu, Y., Heckman, S., Barnes, T., & Lynch, C. F. (2019) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2019.2911832 · Cited by 60
Assessing Algorithmic Fairness in Automatic Classifiers of Educational Forum Posts
Sha, L., Rakovic, M., Whitelock-Wainwright, A., Carroll, D., Yew, V. M., Gasevic, D., & Chen, G. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-78292-4_31 · Cited by 34
MOOCs Meet Measurement Theory: A Topic-Modelling Approach
He, J., Rubinstein, B., Bailey, J., Zhang, R., Milligan, S., & Chan, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10151 · Cited by 10
“Yang et al. (2015) predict students’ confusion with learning activities as expressed in the discussion forums using discussion behaviour and clickstream data, and explore the impact of confusion on student dropout.”
Background
Metadata
- Authors
- Yang, D., Wen, M., Howley, I., Kraut, R., & Rose, C.
- Venue
- Proceedings of the Second (2015) ACM Conference on Learning @ Scale
- Publisher
- ACM
- Published
- 2015-03-14
- Pages
- 121-130
- OpenAlex
- W2028111024
- Cited by
- 114
- References
- 7
- FWCI
- 8.38
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses. https://app.cochat.ai/papers/10.1145/2724660.2724677
- The paper
- Yang, D., Wen, M., Howley, I., Kraut, R., & Rose, C. (2015). Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses. Proceedings of the Second (2015) ACM Conference on Learning @ Scale. https://doi.org/10.1145/2724660.2724677
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.