How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Open accessThe DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
Despite a surge of empirical work on student participation in online learning environments, the causal links between the learning-related factors and processes with the desired learning outcomes remain unexplored. This study presents a systematic literature review of approaches to model learning in Massive Open Online Courses offering an analysis of learning-related constructs used in the prediction and measurement of student engagement and learning outcome. Based on our literature review, we identify current gaps in the research, including a lack of solid frameworks to explain learning in open online setting. Finally, we put forward a novel framework suitable for open online contexts based on a well-established model of student engagement. Our model is intended to guide future work studying the association between contextual factors (i.e., demographic, classroom, and individual needs), student engagement (i.e., academic, behavioral, cognitive, and affective engagement metrics), and learning outcomes (i.e., academic, social, and affective). The proposed model affords further interstudy comparisons as well as comparative studies with more traditional education models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The lower numbers of affective and cognitive engagement found in the studies in the corpus, reflect a wider call to the field to increase research on these two domains”
From Mapping research in student engagement and educational technology in higher education: a systematic evidence map (2020) · cites this paper as Joksimović et al., 2018
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 2×
“Third, cognitive engagement usually refers to students’ motivational goals and self-regulated learning skills (Christenson et al., 2012; Fredricks et al., 2004; Reschly & Christenson, 2012).”
BackgroundThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 2×
“However, in detecting different confusion states, Yang et al. (2015) relied on psychologically meaningful categories of words, extracted from online discussions using the Linguistic Inquiry and Word Count tool (Tausczik & Pennebaker, 2010), as one of the classification features.”
BackgroundMethodLexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Handbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050 · cited 2×
“As noted in the Christenson et al. (2012) review, researchers most commonly refer to two subtypes (i.e., participatory and affective) or include a cognitive engagement as a third subtype.”
BackgroundDouglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Metacognition in Educational Theory and Practice
(1998) · Routledge eBooks · doi:10.4324/9781410602350 · Cited by 2,119
Self-citationNon‐formal learning and tacit knowledge in professional work
Eraut, M. (2000) · British Journal of Educational Psychology · doi:10.1348/000709900158001 · Cited by 2,013
Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2006.04.002 · Cited by 1,858 · cited 3×
“Finally, failing to account for contextual determinants of learning in general (Appleton et al., 2006) or the contextual factors for online and distance education in particular (Gašević et al.”
BackgroundInfluentialActive‐Constructive‐Interactive: A Conceptual Framework for Differentiating Learning Activities
Chi, M. T. H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01005.x · Cited by 1,597
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Self-citationAn argument-based approach to validity.
Kane, M. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.3.527 · Cited by 901
Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.10.002 · Cited by 683
Self-citationRodriguez, C. O. (2012) · European Journal of Open Distance and E-Learning · Cited by 593
Argument-Based Approach to Validity
(2022) · The SAGE Encyclopedia of Research Design · doi:10.4135/9781071812082.n28 · Cited by 556
Massive open online course completion rates revisited: Assessment, length and attrition
Jordan, K. (2015) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v16i3.2112 · Cited by 508
Greene, J. A., & Azevedo, R. (2007) · Review of Educational Research · doi:10.3102/003465430303953 · Cited by 486
How We Learn: Learning and Non-Learning in School and Beyond
Illeris, K. (2007) · Cited by 429
Azevedo, R. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1004069 · Cited by 418 · cited 3×
“Recent advances in the (multimodal) learning analytics research field provide a promising venue for investigation of students’ cognition, metacognition, emotion, and motivation using multimodal data, such as eye gaze behaviors, facial expressions of emotions, heart rate, and electrodermal activity, to name a few (Azev…”
BackgroundResultAdvanced, Analytic, Automated (AAA) Measurement of Engagement During Learning
D'Mello, S., Dieterle, E., & Duckworth, A. (2017) · Educational Psychologist · doi:10.1080/00461520.2017.1281747 · Cited by 350
Hartnett, M., St. George, A., & Dron, J. (2011) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v12i6.1030 · Cited by 329
Illeris, K. (2007) · Routledge eBooks · doi:10.4324/9780203939895 · Cited by 323
What Makes a Great MOOC? An Interdisciplinary Analysis of Student Retention in Online Courses
Adamopoulos, P. (2013) · International Conference on Information Systems · Cited by 320
The Rhetoric and Reality of Gap Closing: When the "Have-Nots" Gain but the "Haves" Gain Even More.
Ceci, S. J., & Papierno, P. B. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.149 · Cited by 310
Attrition and Achievement Gaps in Online Learning
Kizilcec, R. F., & Halawa, S. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724680 · Cited by 307
Reich, J. (2015) · Science · doi:10.1126/science.1261627 · Cited by 294 · cited 17×
“According to Reich, introducing assessment at multiple time points, relying on the assessment methods validated in prior research, and making a better integration of assessment in the course design in general, are important steps in understanding learning in MOOCs (Reich, 2015).”
BackgroundMethodInfluentialNetworked Learning: Perspectives and Issues
(2002) · Computer Supported Cooperative Work · doi:10.1007/978-1-4471-0181-9 · Cited by 285
Changing “Course”: Reconceptualizing Educational Variables for Massive Open Online Courses
DeBoer, J., Ho, A. D., Stump, G. S., & Breslow, L. (2014) · Educational Researcher · doi:10.3102/0013189x14523038 · Cited by 276
Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC
Koedinger, K. R., Kim, J., Jia, J. Z., McLaughlin, E. A., & Bier, N. L. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724681 · Cited by 271
Communication patterns in massively open online courses
Gillani, N., & Eynon, R. (2014) · The Internet and Higher Education · doi:10.1016/j.iheduc.2014.05.004 · Cited by 256
Motivation as a Lens to Understand Online Learners: Toward Data-Driven Design with the OLEI Scale
Kizilcec, R. F., & Schneider, E. (2015) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2699735 · Cited by 249
Why Theory Matters More than Ever in the Age of Big Data
Wise, A. F., & Shaffer, D. W. (2015) · Journal of Learning Analytics · doi:10.18608/jla.2015.22.2 · Cited by 241
Chapter 4: Validity in Educational Assessment
Moss, P., Girard, B. J., & Haniford, L. C. (2006) · Review of Research in Education · doi:10.3102/0091732x030001109 · Cited by 230
Predictors of Retention and Achievement in a Massive Open Online Course
Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015) · American Educational Research Journal · doi:10.3102/0002831215584621 · Cited by 222
Visualizing patterns of student engagement and performance in MOOCs
Coffrin, C., Corrin, L., de Barba, P., & Kennedy, G. (2014) · Proceedings of the Fourth International Conference on Learning Analytics And Knowledge · doi:10.1145/2567574.2567586 · Cited by 216
Persistence Patterns in Massive Open Online Courses (MOOCs)
Evans, B. J., Baker, R. B., & Dee, T. S. (2016) · The Journal of Higher Education · doi:10.1080/00221546.2016.11777400 · Cited by 164
Predicting MOOC performance with Week 1 Behavior
Jiang, S., Williams, A. E., Schenke, K., Warschauer, M., & O’Dowd, D. K. (2014) · Cited by 133
“Learning latent engagement patterns of students in online courses,”
Ramesh, A., Goldwasser, D., Huang, B., Daume III, H., & Getoor, L. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8920 · Cited by 123 · cited 3×
“Ramesh et al. (2014a, 2014b), as well as, Sinha and Cassell (2015) also considered students’ interaction with other course resources (e.g., quizzes, videos, or lectures).”
BackgroundTransfer Learning for Predictive Models in Massive Open Online Courses
Boyer, S., & Veeramachaneni, K. K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_6 · Cited by 122
Penetrating the black box of time-on-task estimation
Kovanović, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M. (2015) · Proceedings of the Fifth International Conference on Learning Analytics And Knowledge · doi:10.1145/2723576.2723623 · Cited by 120
Self-citationPredicting success: how learners' prior knowledge, skills and activities predict MOOC performance
Kennedy, G., Coffrin, C., de Barba, P., & Corrin, L. (2015) · Proceedings of the Fifth International Conference on Learning Analytics And Knowledge · doi:10.1145/2723576.2723593 · Cited by 116
Goldberg, L. R., Bell, E., King, C., O’Mara, C., McInerney, F., Robinson, A., & Vickers, J. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0344-z · Cited by 116
Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses
Yang, D., Wen, M., Howley, I., Kraut, R., & Rose, C. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724677 · Cited by 114
Relational event models for social learning in MOOCs
Vu, D. Q., Pattison, P. E., & Robins, G. L. (2015) · Social Networks · doi:10.1016/j.socnet.2015.05.001 · Cited by 105
Linguistic Reflections of Student Engagement in Massive Open Online Courses
Wen, M., Yang, D., & Rose, C. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14512 · Cited by 104
Beyond Prediction: First Steps Toward Automatic Intervention in MOOC Student Stopout
Whitehill, J., Williams, J. J., Lopez, G., Coleman, C. A., & Reich, J. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2611750 · Cited by 94
Learning through engagement: MOOCs as an emergent form of provision
Walji, S., Deacon, A., Small, J., & Czerniewicz, L. (2016) · Distance Education · doi:10.1080/01587919.2016.1184400 · Cited by 93
Engle, D. L., Mankoff, C., & Carbrey, J. M. (2015) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v16i2.2010 · Cited by 90
Methodological approaches in MOOC research: Retracing the myth of Proteus
Raffaghelli, J. E., Cucchiara, S., & Persico, D. (2015) · British Journal of Educational Technology · doi:10.1111/bjet.12279 · Cited by 87
Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, V., & de Kereki, I. F. (2016) · Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK '16 · doi:10.1145/2883851.2883928 · Cited by 84
Self-citationGlass, C. R., Shiokawa, M. S., & Saltarelli, A. J. (2016) · New Directions for Institutional Research · doi:10.1002/ir.20153 · Cited by 84
M assive O pen O nline C hange? Exploring the Discursive Construction of the ‘ MOOC ’ in Newspapers
Selwyn, N., Bulfin, S., & Pangrazio, L. (2015) · Higher Education Quarterly · doi:10.1111/hequ.12061 · Cited by 72
Language to Completion: Success in an Educational Data Mining Massive Open Online Class
Crossley, S. A., McNamara, D. S., Baker, R. S., Wang, Y., Paquette, L., Barnes, T. M., & Bergner, Y. (2015) · Educational Data Mining · Cited by 66
Modeling Learners' Social Centrality and Performance through Language and Discourse.
Dowell, N., Poquet, O., Joksimovíc, S., Graesser, A. C., Dawson, S., Gašević, D., Hennis, T., de Vries, P., & Kovanović, V. (2015) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 65
Self-citationTucker, C., Pursel, B., & Divinsky, A. (2020) · 2014 ASEE Annual Conference & Exposition Proceedings · doi:10.18260/1-2--22840 · Cited by 62
Yang, D., Wen, M., Kumar, A., Xing, E. P., & Rosé, C. P. (2014) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v15i5.1853 · Cited by 53
Success, activity and drop-outs in MOOCs an exploratory study on the UNED COMA courses
Santos, J. L., Klerkx, J., Duval, E., Gago, D., & Rodríguez, L. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567627 · Cited by 52
Halatchliyski, I., Moskaliuk, J., Kimmerle, J., & Creß, U. (2013) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-013-9182-3 · Cited by 50
Correlating skill and improvement in 2 MOOCs with a student's time on tasks
Champaign, J., Colvin, K. F., Liu, A., Fredericks, C., Seaton, D., & Pritchard, D. E. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566250 · Cited by 50
Brooks, C. A., Thompson, C. D. S., & Teasley, S. D. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2728668 · Cited by 49
Self-citationHow do you connect? analysis of social capital accumulation in connectivist MOOCs
Joksimovíc, S., Dowell, N., Poquet, O., Kovanović, V., Gašević, D., Dawson, S., & Graesser, A. C. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723604 · Cited by 47
Self-citationProceedings of the Third (2016) ACM Conference on Learning @ Scale
(2016) · doi:10.1145/2876034 · Cited by 47
Teaching recommender systems at large scale: evaluation and lessons learned from a hybrid MOOC
Konstan, J. A., Walker, J. D., Brooks, D., Brown, K., & Ekstrand, M. D. (2014) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2556325.2566244 · Cited by 46
Bergner, Y., Kerr, D., & Pritchard, D. E. (2015) · Educational Data Mining · Cited by 42
Cohesion Relationships in Tutorial Dialogue as Predictors of Affective States
Sidney, D., Nia, D., & Art, G. (2009) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-60750-028-5-9 · Cited by 39
Self-citationSocial Positioning and Performance in MOOCs.
Jiang, S., Fitzhugh, S. M., & Warschauer, M. (2014) · Cited by 39
Teaching Recommender Systems at Large Scale: Evaluation and Lessons Learned from a Hybrid MOOC
Konstan, J. A., Walker, J. D., Brooks, D. C., Brown, K., & Ekstrand, M. D. (2015) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2728171 · Cited by 38
Uncovering hidden engagement patterns for predicting learner performance in MOOCs
Ramesh, A., Goldwasser, D., Huang, B., Daumé, H., & Getoor, L. C. (2014) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2556325.2567857 · Cited by 36
Conscientious Behaviour, Flexibility and Learning in Massive Open On-Line Courses
Loya, A. P. C., Gopal, A. D., Shukla, I., Jermann, P., & Tormey, R. (2015) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2015.04.686 · Cited by 34
Behavior Prediction in MOOCs using Higher Granularity Temporal Information
Ye, C., Kinnebrew, J. S., Biswas, G., Evans, B. J., Fisher, D., Narasimham, G., & Brady, K. A. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2728687 · Cited by 31
Importance of Theory in Learning Analytics in Formal and Workplace Settings
Dawson, S., Mirriahi, N., & Gašević, D. (2015) · Journal of Learning Analytics · doi:10.18608/jla.2015.22.1 · Cited by 31
Self-citationThe Civic Mission of MOOCs: Measuring Engagement across Political Differences in Forums
Reich, J., Stewart, B., Mavon, K., & Tingley, D. H. (2016) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2876034.2876045 · Cited by 30
Sinha, T., & Cassell, J. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2728669 · Cited by 24
Effects of sequences of socially regulated learning on group performance
Molenaar, I., & Chiu, M. M. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723586 · Cited by 19
Heutte, J., Kaplan, J. E., Fenouillet, F., Caron, P.-A., & Rosselle, M. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-10671-7_2 · Cited by 15
Brooks, C. A., Stalburg, C. M., Dillahunt, T. R., & Robert, L. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2728667 · Cited by 15
Self-citationChallenging Assumptions in Learning Analytics
Dawson, S., Gašević, D., & Mirriahi, N. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2015.23.1 · Cited by 13
Self-citationNetworked Learning - A social practice perspective
Jones, C. (2008) · Open Research Online (The Open University) · Cited by 12
Research works printed but not linked: 12
- 10.1016/j.jsp.2006.04.0020 · doi:10.1016/j.jsp.2006.04.0020
- 10.1353/jhe.2016.0006 · doi:10.1353/jhe.2016.0006 · Paper page
- 10.1007/978-1-4471-0181-9-4 · doi:10.1007/978-1-4471-0181-9-4
- 10.1007/978-3-319-24258-3-15 · doi:10.1007/978-3-319-24258-3-15
- 10.1007/978-1-4614-2018-7-1 · doi:10.1007/978-1-4614-2018-7-1
- Sharma K., Jermann P., Dillenbourg P. (2015). Identifying styles and path towards success in MOOCs. In Proceedings of the 8th International Conference on Educational Data Mining (EDM’15) (pp. 408–411). Retrieved from http://www.educationaldatamining.org/EDM2015/uploads/papers/paper_88.pdf
- Shirky C. (2013, July 8). MOOCs and economic reality. Chronicle of Higher Education, 59(42), B2. Retrieved from http://www.chronicle.com/blogs/conversation/2013/07/08/moocs-and-economic-reality/
- Siemens G., 2005, International Journal of Instructional Technology & Distance Learning, 2, 3
- Siemens G., Gašević D., Dawson S. (2015). Preparing for the digital university: A review of the history and current state of distance, blended, and online learning (Research report). Retrieved from http://linkresearchlab.org/PreparingDigitalUniversity.pdf
- Wang E. Y., Baker R. (2015). Content or platform: Why do students complete MOOCs? Journal of Online Learning and Teaching, 11(1), 17–30. Retrieved from http://jolt.merlot.org/vol11no1/Wang_0315.pdf
- Wang X., Yang D., Wen M., Koedinger K., Rosé C. P. (2015). Investigating how student’s cognitive behavior in MOOC discussion forums affect learning gains. In Proceedings of the 8th International Conference on Educational Data Mining (EDM’15) (pp. 226–233). Retrieved from http://www.educationaldatamining.org/EDM2015/uploads/papers/paper_89.pdf
- Wen M., Yang D., Rose C. P. (2014b). Sentiment analysis in MOOC discussion forums: What does it tell us? In Proceedings of the 7th International Conference on Educational Data Mining (EDM’14) (pp. 130–137). Retrieved from http://educationaldatamining.org/EDM2014/uploads/procs2014/long%20papers/130_EDM-2014-Full.pdf
Cited by
Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0176-8 · Cited by 1,097
Systematic Reviews in Educational Research: Methodology, Perspectives and Application
Newman, M., & Gough, D. (2020) · Systematic Reviews in Educational Research · doi:10.1007/978-3-658-27602-7_1 · Cited by 591
Facilitating Student Engagement Through Educational Technology: Towards a Conceptual Framework
Bond, M., & Bedenlier, S. (2019) · Journal of Interactive Media in Education · doi:10.5334/jime.528 · Cited by 374
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Transformation of the mathematics classroom with the internet
Engelbrecht, J., Llinares, S., & Borba, M. C. (2020) · ZDM · doi:10.1007/s11858-020-01176-4 · Cited by 274
Metadata
- Authors
- Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C.
- Affiliations
- University of South Australia (AU)
- University of Michigan (US)
- University of Notre Dame (US)
- University of Edinburgh (GB)
- University of Memphis (US)
- ORCID
- Venue
- Review of Educational Research
- Published
- 2017-11-14
- Volume
- 88
- Issue
- 1
- Pages
- 43-86
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2769669737
- Cited by
- 182
- References
- 77
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 12 · 2023: 23 · 2022: 42 · 2021: 28 · 2020: 26 · 2019: 24 · 2018: 4
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, other-oa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- UniSA Research Outputs Repository (University of South Australia) (submittedVersion)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Open Education and E-Learning
- Keywords
- MOOCs, massive open online courses, learning at scale, student engagement, learning outcomes, online learning, engagement model, emotional engagement, academic engagement, behavioral engagement, cognitive engagement, learning outcome prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.