The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Open accessAbstract
Despite a surge of empirical work on student participation in online learning environments, the causal links between the learning-related factors and processes with the desired learning outcomes remain unexplored. This study presents a systematic literature review of approaches to model learning in Massive Open Online Courses offering an analysis of learning-related constructs used in the prediction and measurement of student engagement and learning outcome. Based on our literature review, we identify current gaps in the research, including a lack of solid frameworks to explain learning in open online setting. Finally, we put forward a novel framework suitable for open online contexts based on a well-established model of student engagement. Our model is intended to guide future work studying the association between contextual factors (i.e., demographic, classroom, and individual needs), student engagement (i.e., academic, behavioral, cognitive, and affective engagement metrics), and learning outcomes (i.e., academic, social, and affective). The proposed model affords further interstudy comparisons as well as comparative studies with more traditional education models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The lower numbers of affective and cognitive engagement found in the studies in the corpus, reflect a wider call to the field to increase research on these two domains”
From Mapping research in student engagement and educational technology in higher education: a systematic evidence map (2020) · cites this paper as Joksimović et al., 2018
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 2×
“Third, cognitive engagement usually refers to students’ motivational goals and self-regulated learning skills (Christenson et al., 2012; Fredricks et al., 2004; Reschly & Christenson, 2012).”
BackgroundThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 2×
“However, in detecting different confusion states, Yang et al. (2015) relied on psychologically meaningful categories of words, extracted from online discussions using the Linguistic Inquiry and Word Count tool (Tausczik & Pennebaker, 2010), as one of the classification features.”
BackgroundMethodLexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Handbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050 · cited 2×
“As noted in the Christenson et al. (2012) review, researchers most commonly refer to two subtypes (i.e., participatory and affective) or include a cognitive engagement as a third subtype.”
BackgroundDouglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Metacognition in Educational Theory and Practice
(1998) · Routledge eBooks · doi:10.4324/9781410602350 · Cited by 2,119
Self-citationNon‐formal learning and tacit knowledge in professional work
Eraut, M. (2000) · British Journal of Educational Psychology · doi:10.1348/000709900158001 · Cited by 2,013
Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2006.04.002 · Cited by 1,858
Active‐Constructive‐Interactive: A Conceptual Framework for Differentiating Learning Activities
Chi, M. T. H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01005.x · Cited by 1,597
Research works printed but not linked: 12
- 10.1016/j.jsp.2006.04.0020 · doi:10.1016/j.jsp.2006.04.0020
- 10.1353/jhe.2016.0006 · doi:10.1353/jhe.2016.0006 · Paper page
- 10.1007/978-1-4471-0181-9-4 · doi:10.1007/978-1-4471-0181-9-4
- 10.1007/978-3-319-24258-3-15 · doi:10.1007/978-3-319-24258-3-15
- 10.1007/978-1-4614-2018-7-1 · doi:10.1007/978-1-4614-2018-7-1
- Sharma K., Jermann P., Dillenbourg P. (2015). Identifying styles and path towards success in MOOCs. In Proceedings of the 8th International Conference on Educational Data Mining (EDM’15) (pp. 408–411). Retrieved from http://www.educationaldatamining.org/EDM2015/uploads/papers/paper_88.pdf
- Shirky C. (2013, July 8). MOOCs and economic reality. Chronicle of Higher Education, 59(42), B2. Retrieved from http://www.chronicle.com/blogs/conversation/2013/07/08/moocs-and-economic-reality/
- Siemens G., 2005, International Journal of Instructional Technology & Distance Learning, 2, 3
- Siemens G., Gašević D., Dawson S. (2015). Preparing for the digital university: A review of the history and current state of distance, blended, and online learning (Research report). Retrieved from http://linkresearchlab.org/PreparingDigitalUniversity.pdf
- Wang E. Y., Baker R. (2015). Content or platform: Why do students complete MOOCs? Journal of Online Learning and Teaching, 11(1), 17–30. Retrieved from http://jolt.merlot.org/vol11no1/Wang_0315.pdf
- Wang X., Yang D., Wen M., Koedinger K., Rosé C. P. (2015). Investigating how student’s cognitive behavior in MOOC discussion forums affect learning gains. In Proceedings of the 8th International Conference on Educational Data Mining (EDM’15) (pp. 226–233). Retrieved from http://www.educationaldatamining.org/EDM2015/uploads/papers/paper_89.pdf
- Wen M., Yang D., Rose C. P. (2014b). Sentiment analysis in MOOC discussion forums: What does it tell us? In Proceedings of the 7th International Conference on Educational Data Mining (EDM’14) (pp. 130–137). Retrieved from http://educationaldatamining.org/EDM2014/uploads/procs2014/long%20papers/130_EDM-2014-Full.pdf
Cited by
Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0176-8 · Cited by 1,097
Systematic Reviews in Educational Research: Methodology, Perspectives and Application
Newman, M., & Gough, D. (2020) · Systematic Reviews in Educational Research · doi:10.1007/978-3-658-27602-7_1 · Cited by 591
Facilitating Student Engagement Through Educational Technology: Towards a Conceptual Framework
Bond, M., & Bedenlier, S. (2019) · Journal of Interactive Media in Education · doi:10.5334/jime.528 · Cited by 374
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Transformation of the mathematics classroom with the internet
Engelbrecht, J., Llinares, S., & Borba, M. C. (2020) · ZDM · doi:10.1007/s11858-020-01176-4 · Cited by 274
Metadata
- Authors
- Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C.
- Affiliations
- University of South Australia (AU)
- University of Michigan (US)
- University of Notre Dame (US)
- University of Edinburgh (GB)
- University of Memphis (US)
- ORCID
- Venue
- Review of Educational Research
- Published
- 2017-11-14
- Volume
- 88
- Issue
- 1
- Pages
- 43-86
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2769669737
- Cited by
- 182
- References
- 77
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 12 · 2023: 23 · 2022: 42 · 2021: 28 · 2020: 26 · 2019: 24 · 2018: 4
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, other-oa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- UniSA Research Outputs Repository (University of South Australia) (submittedVersion)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Open Education and E-Learning
- Keywords
- MOOCs, massive open online courses, learning at scale, student engagement, learning outcomes, online learning, engagement model, emotional engagement, academic engagement, behavioral engagement, cognitive engagement, learning outcome prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs. https://app.cochat.ai/papers/10.3102/0034654317740335
- The paper
- Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018). How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs. Review of Educational Research. https://doi.org/10.3102/0034654317740335
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.