The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Mining Big Data in Education: Affordances and Challenges
Open accessAbstract
The emergence of big data in educational contexts has led to new data-driven approaches to support informed decision making and efforts to improve educational effectiveness. Digital traces of student behavior promise more scalable and finer-grained understanding and support of learning processes, which were previously too costly to obtain with traditional data sources and methodologies. This synthetic review describes the affordances and applications of microlevel (e.g., clickstream data), mesolevel (e.g., text data), and macrolevel (e.g., institutional data) big data. For instance, clickstream data are often used to operationalize and understand knowledge, cognitive strategies, and behavioral processes in order to personalize and enhance instruction and learning. Corpora of student writing are often analyzed with natural language processing techniques to relate linguistic features to cognitive, social, behavioral, and affective processes. Institutional data are often used to improve student and administrational decision making through course guidance systems and early-warning systems. Furthermore, this chapter outlines current challenges of accessing, analyzing, and using big data. Such challenges include balancing data privacy and protection with data sharing and research, training researchers in educational data science methodologies, and navigating the tensions between explanation and prediction. We argue that addressing these challenges is worthwhile given the potential benefits of mining big data in education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359
Self-citationDeconstructing disengagement: analyzing learner subpopulations in massive open online courses
Kizilcec, R. F., Piech, C., & Schneider, E. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460330 · Cited by 984
Educational Data Mining and Learning Analytics
Baker, R., & Siemens, G. (2014) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9781139519526.016 · Cited by 490
Self-citationEarly Alert of Academically At-Risk Students: An Open Source Analytics Initiative
Jayaprakash, S. M., Moody, E. W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2014.11.3 · Cited by 414
Addressing two problems in deep knowledge tracing via prediction-consistent regularization
Yeung, C.-K., & Yeung, D.-Y. (2018) · Proceedings of the Fifth Annual ACM Conference on Learning at Scale · doi:10.1145/3231644.3231647 · Cited by 330
Demographic differences in how students navigate through MOOCs
Guo, P. J., & Reinecke, K. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566247 · Cited by 318
Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems
Aleven, V., Roll, I., McLaren, B. M., & Koedinger, K. R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0089-1 · Cited by 255
Understanding, evaluating, and supporting self-regulated learning using learning analytics
Roll, I., & Winne, P. H. (2015) · Journal of Learning Analytics · doi:10.18608/jla.2015.21.2 · Cited by 232
How deep is knowledge tracing?Preprint
Khajah, M. M., Lindsey, R., & Mozer, M. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.02416 · Cited by 219
Gasevic, D., Jovanovic, J., Pardo, A., & Dawson, S. (2017) · Journal of Learning Analytics · doi:10.18608/jla.2017.42.10 · Cited by 218
Content Based Lecture Video Retrieval Using Speech and Video Text Information
Yang, H., & Meinel, C. (2014) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2014.2307305 · Cited by 194
Pardos, Z. A., Baker, R. S. J. D., San Pedro, M., Gowda, S. M., & Gowda, S. M. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2014.11.6 · Cited by 190
Self-citationInvestigating How Student's Cognitive Behavior in MOOC Discussion Forums Affect Learning Gains.
Wang, X., Yang, D., Wen, M., Koedinger, K. R., & Rosé, C. P. (2015) · Educational Data Mining · Cited by 179
From Design to Implementation to Practice a Learning by Teaching System: Betty’s Brain
Biswas, G., Segedy, J. R., & Bunchongchit, K. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0057-9 · Cited by 167
Does Predictive Policing Lead to Biased Arrests? Results From a Randomized Controlled Trial
Brantingham, P. J., Valasik, M., & Mohler, G. O. (2018) · Statistics and Public Policy · doi:10.1080/2330443x.2018.1438940 · Cited by 161
Dzikovska, M. O., Steinhauser, N. B., Farrow, E., Moore, J. D., & Campbell, G. E. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0017-9 · Cited by 154
Editorial: Augmenting Learning Analytics with Multimodal Sensory Data
Ochôa, X., & Worsley, M. B. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.32.10 · Cited by 151
Coh-Metrix: An Automated Tool for Theoretical and Applied Natural Language Processing
McNamara, D. S., & Graesser, A. C. (2012) · IGI Global eBooks · doi:10.4018/978-1-60960-741-8.ch011 · Cited by 149
Writing Reusable Code Feedback at Scale with Mixed-Initiative Program Synthesis
Head, A., Glassman, E. L., Soares, G., Suzuki, R., Figueredo, L., D’Antoni, L., & Hartmann, B. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3051467 · Cited by 134
Goal-based Course Recommendation
Jiang, W., Pardos, Z. A., & Wei, Q. (2019) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3303772.3303814 · Cited by 133
Self-citationModeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks
Sabourin, J. L., Mott, B., & Lester, J. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_32 · Cited by 128
Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology
Beck, J. E., Chang, K.-M. K., Mostow, J., & Corbett, A. T. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_42 · Cited by 126
Gobert, J. D., Sao Pedro, M. A., Baker, R. S. J. D., Toto, E., & Montalvo, O. (2012) · Zenodo · doi:10.5281/zenodo.3554645 · Cited by 122
Self-citationBeyond Prediction: First Steps Toward Automatic Intervention in MOOC Student StopoutPreprint
Whitehill, J., Williams, J. J., Lopez, G., Coleman, C., & Reich, J. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2611750 · Cited by 122
Self-citationDetecting and Addressing Frustration in a Serious Game for Military Training
DeFalco, J. A., Rowe, J., Paquette, L., Georgoulas‐Sherry, V., Brawner, K., Mott, B., Baker, R. S., & Lester, J. C. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0152-1 · Cited by 113
Self-citationHuang, Y., González-Brenes, J. P., & Brusilovsky, P. L. (2014) · Cited by 111
Improving Sensor-Free Affect Detection Using Deep Learning
Botelho, A. F., Baker, R. S., & Heffernan, N. T. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61425-0_4 · Cited by 111
Self-citationChen, Y., Johri, A., & Rangwala, H. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170410 · Cited by 111
DocuViz: Visualizing Collaborative Writing
Wang, D., Olson, J. S., Zhang, J., Nguyen, T. T., & Olson, G. M. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702517 · Cited by 108
Segedy, J. R., Kinnebrew, J. S., & Biswas, G. (2015) · Journal of Learning Analytics · doi:10.18608/jla.2015.21.3 · Cited by 104
Enabling Real-Time Adaptivity in MOOCs with a Personalized Next-Step Recommendation Framework
Pardos, Z. A., Tang, S., Davis, D., & Le, C. V. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3051471 · Cited by 96
Self-citationComputer-Assisted Reading and Discovery for Student Generated Text in Massive Open Online Courses
Reich, J., Tingley, D. H., Leder-Luis, J., Roberts, M. E., & Stewart, B. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2015.21.8 · Cited by 91
Towards Understanding How to Assess Help-Seeking Behavior Across Cultures
Ogan, A., Walker, E., Baker, R. S., Rodrigo, M. M. T., Soriano, J. C. A., & Jiménez-Castro, M. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0034-8 · Cited by 78
Self-citationQG-net: a data-driven question generation model for educational content
Wang, Z., Lan, A., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3231644.3231654 · Cited by 77
Pardos, Z. A., Fan, Z., & Jiang, W. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09218-7 · Cited by 75
Self-citationUsing Technology and Assessment to Personalize Instruction: Preventing Reading Problems
Connor, C. M. (2017) · Prevention Science · doi:10.1007/s11121-017-0842-9 · Cited by 71
Aguiar, E., Chawla, N. V., Brockman, J., Ambrose, G. A., & Goodrich, V. (2014) · Proceedings of the Fourth International Conference on Learning Analytics And Knowledge · doi:10.1145/2567574.2567583 · Cited by 69
Lan, A. S., Vats, D., Waters, A. E., & Baraniuk, R. G. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724664 · Cited by 60 · cited 3×
“Numerous studies demonstrate that evaluation of student writing can be automated to substantially reduce human effort in grading essays in a range of subjects (e.g., Allen et al., 2018; Allen & McNamara, 2015; Head et al., 2017; Lan et al., 2015).”
BackgroundUnderstanding Student Procrastination via Mixture Models.
Park, J. H., Yu, R., Rodriguez, F., Baker, R. B., Smyth, P., & Warschauer, M. (2018) · Educational Data Mining · Cited by 60
Self-citationDetecting changes in student behavior from clickstream data
Park, J. H., Denaro, K., Rodriguez, F., et al. (2017) · International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027430 · Cited by 55
Allen, L. K., Mills, C., Jacovina, M. E., Crossley, S. A., D’Mello, S. K., & McNamara, D. S. (2016) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2883851.2883939 · Cited by 52
Techniques for data-driven curriculum analysis
Méndez, G. G., Ochôa, X., & Chiluiza, K. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567591 · Cited by 49
Hutt, S. J., Grafsgaard, J. F., & D’Mello, S. K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300726 · Cited by 46
Trading Off Scientific Knowledge and User Learning with Multi-Armed Bandits
Liu, Y.-E., Mandel, T., Brunskill, E., & Popović, Z. (2014) · Cited by 44
Move Your Lamp Post: Recent Data Reflects Learner Knowledge Better Than Older Data
Galyardt, A., & Goldin, I. M. (2015) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554671 · Cited by 43
Learning Factor Models of Students at Risk of Failing in the Early Stage of Tertiary Education
Gray, G., McGuinness, C., Owende, P. M. O., & Hofmann, M. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.32.20 · Cited by 42
An Exploration of Automated Grading of Complex Assignments
Geigle, C., Zhai, C., & Ferguson, D. C. (2016) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2876034.2876049 · Cited by 41
Generating Data-Driven Hints for Open-Ended Programming.
Price, T., Dong, Y., & Barnes, T. M. (2016) · Educational Data Mining · Cited by 41
Atapattu, T., & Falkner, K. E. K. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.12 · Cited by 41
What do cMOOC participants talk about in social media?
Joksimovíc, S., Kovanović, V., Jovanović, J., Zouaq, A., Gašević, D., & Hatala, M. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723609 · Cited by 39
Big data in education and the models that love them
Pardos, Z. A. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.11.006 · Cited by 38
Self-citationText as Data Methods for Education Research
Fesler, L., Dee, T. S., Baker, R. B., & Evans, B. J. (2019) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2019.1634168 · Cited by 38
Self-citationLiu, R., & Koedinger, K. R. (2017) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554625 · Cited by 37
Prospectively predicting 4-year college graduation from student applications
Hutt, S. J., Gardener, M., Kamentz, D., Duckworth, A. L., & D’Mello, S. K. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170395 · Cited by 35
Decision Making for Student Success
Castleman, B. (2015) · Routledge eBooks · doi:10.4324/9781315767932 · Cited by 31
Chaturapruek, S., Dee, T. S., Johari, R., Kizilcec, R. F., & Stevens, M. L. (2018) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3231644.3231668 · Cited by 30
A Sequence Data Model for Analyzing Temporal Patterns of Student Data
Mahzoon, M. J., Maher, M. L., ElTayeby, O., Dou, W., & Grace, K. S. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.51.5 · Cited by 29
Revising Learner Misconceptions Without Feedback: Prompting for Reflection on Anomalies
Williams, J. J., Lombrozo, T., Hsu, A., Huber, B., & Kim, J. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858361 · Cited by 27
Self-citationCommunication at Scale in a MOOC Using Predictive Engagement Analytics
Le, C. V., Pardos, Z. A., Meyer, S. D., & Thorp, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93843-1_18 · Cited by 26
Self-citationData-Assistive Course-to-Course Articulation Using Machine Translation
Pardos, Z. A., Chau, H., & Zhao, H. (2019) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3330430.3333622 · Cited by 25
Self-citationEarly Identification of At-Risk Students Using Iterative Logistic Regression
Zhang, L., & Rangwala, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93843-1_45 · Cited by 24
Improving Student Modeling Through Partial Credit and Problem Difficulty
Ostrow, K., Donnelly, C. M., Adjei, S., & Heffernan, N. T. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2724667 · Cited by 23
Käser, T., Klingler, S., & Groß, M. H. (2016) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2883851.2883961 · Cited by 23
Predicting Question Quality Using Recurrent Neural Networks
Ruşeţi, Ş., Dascălu, M., Johnson, A. M., Balyan, R., Kopp, K. J., McNamara, D. S., Crossley, S. A., & Trăușan-Matu, Ș. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93843-1_36 · Cited by 22
Student Ability Best Predicts Final Grade in a College Algebra Course
O’Connell, K. A., Wostl, E., Crosslin, M., Berry, T. L., & Grover, J. P. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.11 · Cited by 21
#BigData: Discrimination in data-supported decision making
(2019) · Human Rights Documents online · doi:10.1163/2210-7975_hrd-9992-20180020 · Cited by 21
Semantic Features of Math Problems: Relationships to Student Learning and Engagement.
Slater, S., Ocumpaugh, J. L., Baker, R. S., Scupelli, P. G., Inventado, P. S., & Heffernan, N. T. (2016) · Educational Data Mining · Cited by 20
Self-citationLiu, R., & Koedinger, K. R. (2015) · Educational Data Mining · Cited by 19
Talk with Me: Student Pronoun Use as an Indicator of Discourse Health
Epp, C. D., Phirangee, K., & Hewitt, J. (2017) · Journal of Learning Analytics · doi:10.18608/jla.2017.43.4 · Cited by 18
Bandit Assignment for Educational Experiments: Benefits to Students Versus Statistical Power
Rafferty, A. N., Ying, H., & Williams, J. J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_53 · Cited by 17
Self-citationModeling Math Identity and Math Success through Sentiment Analysis and Linguistic Features.
Crossley, S. A., Ocumpaugh, J. L., Labrum, M. J., Bradfield, F., Dascălu, M., & Baker, R. S. (2018) · Educational Data Mining · Cited by 16
Self-citationYou Are Your Words: Modeling Students' Vocabulary Knowledge with Natural Language Processing Tools.
Allen, L. K., & McNamara, D. S. (2015) · Educational Data Mining · Cited by 15
Profiling students from their questions in a blended learning environment
Harrak, F., Bouchet, F., Luengo, V., & Gillois, P. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170389 · Cited by 15
(2016) · doi:10.1145/2876034.2876052 · Cited by 14
Raczynski, K. R., & Cohen, A. S. (2018) · Applied Measurement in Education · doi:10.1080/08957347.2018.1464449 · Cited by 14
Intelligent Instructional Hand Offs.
Fancsali, S. E., Yudelson, M. V., Berman, S., & RITTER, S. (2018) · Educational Data Mining · Cited by 13
A multi-dimensional analysis of writing flexibility in an automated writing evaluation system
Allen, L. K., Likens, A. D., & McNamara, D. S. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170404 · Cited by 11
Pedro, M. S., Jiang, Y., Paquette, L., Baker, R. S., & Gobert, J. D. (2014) · International Conference of Learning Sciences · Cited by 8
Self-citationAnalysis of Problem-Solving Behavior in Open-Ended Scientific-Discovery Game Challenges.
Bauer, A., Flatten, J., & Popović, Z. (2017) · Educational Data Mining · Cited by 7
NeCamp, T., Gardner, J., & Brooks, C. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11185 · Cited by 7
Cook, C. P., Olney, A. M., Kelly, S., & D’Mello, S. K. (2018) · Educational Data Mining · Cited by 5
Building a transcript of the future
Koester, B. P., Fogel, J., Murdock, W., Гром, Г., & McKay, T. A. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027418 · Cited by 3
Scheihing, E., Vernier, M., Guerra, J., Born, J., & Ulloa, L. R. C. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2714163 · Cited by 3
Cited by
Historical threads, missing links, and future directions in AI in education
Williamson, B., & Eynon, R. (2020) · Learning, Media and Technology · doi:10.1080/17439884.2020.1798995 · Cited by 981
Data-Driven Artificial Intelligence in Education: A Comprehensive Review
Ahmad, K., Iqbal, W., El-Hassan, A., Qadir, J., Benhaddou, D., Ayyash, M., & Al-Fuqaha, A. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3314610 · Cited by 347
ChatGPT in education: global reactions to AI innovations
Fütterer, T., Fischer, C., Alekseeva, A., Chen, X., Tate, T., Warschauer, M., & Gerjets, P. (2023) · Scientific Reports · doi:10.1038/s41598-023-42227-6 · Cited by 242
Self-citationThe cyclical ethical effects of using artificial intelligence in education
Dieterle, E., Dede, C., & Walker, M. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01497-w · Cited by 142
“…learners and educators engaging with digital tools and learning platforms is extraordinarily large amounts of micro-, meso-, and macro-data formats (Fischer et al. 2020) that vary by (a) volume , the size and scale of data and data sets; (b) variety , the production of data from different data…”
AI and the Future of Learning: Expert Panel Report
Roschelle, J., Lester, J., & Fusco, J. (2020) · doi:10.51388/20.500.12265/106 · Cited by 76
Metadata
- Authors
- Fischer, C., Pardos, Z. A., Baker, R. S., Williams, J. J., Smyth, P., Yu, R., Slater, S., Baker, R., & Warschauer, M.
- Venue
- Review of Research in Education
- Published
- 2020-03
- Volume
- 44
- Issue
- 1
- Pages
- 130-160
- ISSN
- 0091-732X (ISSN-L)
- 1935-1038
- OpenAlex
- W3018063079
- Cited by
- 412
- References
- 85
- FWCI
- 50.97
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.