The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Designing educational technologies in the age of AI: A learning sciences‐driven approach
Open accessAbstract
Interdisciplinary research from the learning sciences has helped us understand a great deal about the way that humans learn, and as a result we now have an improved understanding about how best to teach and train people. This same body of research must now be used to better inform the development of Artificial Intelligence (AI) technologies for use in education and training. In this paper, we use three case studies to illustrate how learning sciences research can inform the judicious analysis, of rich, varied and multimodal data, so that it can be used to help us scaffold students and support teachers. Based on this increased understanding of how best to inform the analysis of data through the application of learning sciences research, we are better placed to design AI algorithms that can analyse rich educational data at speed. Such AI algorithms and technology can then help us to leverage faster, more nuanced and individualised scaffolding for learners. However, most commercial AI developers know little about learning sciences research, indeed they often know little about learning or teaching. We therefore argue that in order to ensure that AI technologies for use in education and training embody such judicious analysis and learn in a learning sciences informed manner, we must develop inter‐stakeholder partnerships between AI developers, educators and researchers. Here, we exemplify our approach to such partnerships through the EDUCATE Educational Technology (EdTech) programme. Practitioner Notes: What is already known about this topic? The progress of AI Technology and learning analytics lags behind the adoption of these approaches and technologies in other fields such as medicine or finance. Data are central to the empirical work conducted in the learning sciences and to the development of machine learning Artificial Intelligence (AI). Education is full of doubts about the value that any technology can bring to the teaching and learning process. What this paper adds? We argue that the learning sciences have an important role to play in the design of educational AI, through their provision of theories that can be operationalised and advanced. Through case studies, we illustrate that the analysis of data appropriately informed by interdisciplinary learning sciences research can be used to power AI educational technology. We provide a framework for inter‐stakeholder, interdisciplinary partnerships that can help educators better understand AI, and AI developers better understand education. Implications for practice and/or policy? AI is here to stay and that it will have an increasing impact on the design of technology for use in education and training. Data, which is the power behind machine learning AI, can enable analysis that can vastly increase our understanding of when and how the teaching and learning process is progressing positively. Inter‐stakeholder, interdisciplinary partnerships must be used to make sure that AI provides some of the educational benefits its application in other areas promise us.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888 · cited 2×
“…of AI technology to support collaborative, project-based learning, the second case study exemplifies the implementation of spaced practice (Cepeda, Pashler, Vul, Wixted, & Rohrer, 2006), and the last case study uses emotion prediction algorithms on audio data to support students in debate…”
BackgroundMethodLearning analytics: drivers, developments and challenges
Ferguson, R. (2012) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2012.051816 · Cited by 1,354
High Access and Low Use of Technologies in High School Classrooms: Explaining an Apparent Paradox
Cuban, L., Kirkpatrick, H., & Peck, C. (2001) · American Educational Research Journal · doi:10.3102/00028312038004813 · Cited by 1,232
Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis
Klassen, R. M., & Tze, V. M. C. (2014) · Educational Research Review · doi:10.1016/j.edurev.2014.06.001 · Cited by 1,221
Educational Data Mining and Learning Analytics
Baker, R. S., & Inventado, P. S. (2014) · Learning Analytics · doi:10.1007/978-1-4614-3305-7_4 · Cited by 1,029
Koedinger, K. R., Corbett, A. T., & Perfetti, C. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2012.01245.x · Cited by 772 · cited 1×
“…instructional strategies such as optimal scheduling and feedback provision to provide foundational knowledge components, such as facts and rules, they are less effective at the provision of more complex instructions such as collaboration or self-explanations (Koedinger, Corbett, & Perfetti, 2012).”
BackgroundArgumentation in Science Education
(2007) · Science & Technology Education Library · doi:10.1007/978-1-4020-6670-2 · Cited by 699
Bienkowski, M. A., Feng, M., & Means, B. (2012) · Cited by 586
Critical distinctions among three approaches to peer education
Damon, W., & Phelps, E. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90013-x · Cited by 538
Educational Data Mining and Learning Analytics
Baker, R., & Siemens, G. (2014) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9781139519526.016 · Cited by 490
Cognitive Tutor: Applied research in mathematics education
Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194060 · Cited by 483
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425
Learning analytics: envisioning a research discipline and a domain of practice
Siemens, G. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330605 · Cited by 389
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317 · cited 2×
“…have been shown to have statistically significant positive impacts on student learning including, for example, OLI learning course (Lovett et al., 2008), SQL-Tutor (Mitrovic, & Ohlsson 1999), ALEKS (Craig et al. 2013), Cognitive Tutor (Pane et al. 2014), and ASSISTments (Koedinger et al. 2010).”
BackgroundLakens, D., & Stel, M. (2011) · Social Cognition · doi:10.1521/soco.2011.29.1.1 · Cited by 304
Blikstein, P. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460316 · Cited by 274
Trends and Issues in Instructional Design and Technology
合田, 美., 椿本, 弥., 渡辺, 雄., & 山田, 政. (2012) · Institutional Repositories DataBase (IRDB) · Cited by 274
Movement synchrony and perceived entitativity
Lakens, D. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2010.03.015 · Cited by 222
Evaluation of a Constraint-Based Tutor for a Database Language
Mitrović, A., & Ohlsson, S. (1999) · Cited by 222
Effects of the Child Development Project on Students' Drug Use and Other Problem Behaviors
Battistich, V., Schaps, E., Watson, M., Solomon, D., & Lewis, C. (2000) · Journal of Primary Prevention · doi:10.1023/a:1007057414994 · Cited by 208
Lovett, M., Meyer, O., & Thille, C. (2008) · Journal of Interactive Media in Education · doi:10.5334/2008-14 · Cited by 208
Interactive whiteboards: Real beauty or just “lipstick”?
Slay, H., Siebörger, I., & Hodgkinson-Williams, C. (2008) · Computers & Education · doi:10.1016/j.compedu.2007.12.006 · Cited by 187
Spikol, D., Ruffaldi, E., Dabisias, G., & Cukurova, M. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12263 · Cited by 180
Self-citationReal-time mutual gaze perception enhances collaborative learning and collaboration quality
Schneider, B., & Pea, R. (2013) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-013-9181-4 · Cited by 173
The NISPI framework: Analysing collaborative problem-solving from students' physical interactions
Cukurova, M., Luckin, R., Millán, E., & Mavrikis, M. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.08.007 · Cited by 135
Self-citationA Quasi-Experimental Evaluation of An On-Line Formative Assessment and Tutoring System
Koedinger, K. R., McLaughlin, E. A., & Heffernan, N. T. (2010) · Journal of Educational Computing Research · doi:10.2190/ec.43.4.d · Cited by 130
Classroom orchestration : The third circle of usability
Dillenbourg, P., Zufferey, G., Alavi, H. S., Jermann, P., Do-Lenh, S., Bonnard, Q., Cuendet, S., & Kaplan, F. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.22318/cscl2011.510 · Cited by 122
Craig, S. D., Hu, X., Graesser, A. C., Bargagliotti, A. E., Sterbinsky, A., Cheney, K. R., & Okwumabua, T. M. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.06.010 · Cited by 106
Unraveling Students' Interaction Around a Tangible Interface using Multimodal Learning Analytics
Schneider, B., & Blikstein, P. (2015) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554729 · Cited by 105
Significance of Big Data and Analytics in Higher Education
Tulasi, B. (2013) · International Journal of Computer Applications · doi:10.5120/11648-7142 · Cited by 99
What Do We Teach When We Teach the Learning Sciences? A Document Analysis of 75 Graduate Programs
Sommerhoff, D., Szameitat, A., Vogel, F., Chernikova, O., Stockinger, K., & Fischer, F. (2018) · Journal of the Learning Sciences · doi:10.1080/10508406.2018.1440353 · Cited by 98
Creating the golden triangle of evidence‐informed education technology with EDUCATE
Cukurova, M., Luckin, R., & Clark‐Wilson, A. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12727 · Cited by 79
Self-citationThe Fourth Education Revolution: Will Artificial Intelligence Liberate or Infantilise Humanity
Seldon, S. A., & Adiboye, O. (2018) · Cited by 72
Technology and Education—Why It’s Crucial to be Critical
Selwyn, N. (2015) · Palgrave Macmillan US eBooks · doi:10.1057/9781137385451_14 · Cited by 53
Martínez‐Maldonado, R., Pardo, A., Mirriahi, N., Yacef, K., Kay, J., & Clayphan, A. J. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723583 · Cited by 50
Teaching with Social Media: Disrupting Present Day Public Education
Bartow, S. L. M. (2014) · Educational Studies · doi:10.1080/00131946.2013.866954 · Cited by 49
Argumentation in the Teaching of Science
Evagorou, M., & Dillon, J. S. (2011) · Springer eBooks · doi:10.1007/978-90-481-3927-9_11 · Cited by 43
Katterfeldt, E.-S., Cukurova, M., Spikol, D., & Cuartielles, D. J. (2018) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2018.03.002 · Cited by 42
Self-citationEvaluation of the Design and Development of IT Tools in Education
Reeves, T. C. (2008) · Springer eBooks · doi:10.1007/978-0-387-73315-9_65 · Cited by 18
Measuring the Impact of Information Technology on Students’ Learning
Pilkington, R. M. (2008) · Springer eBooks · doi:10.1007/978-0-387-73315-9_63 · Cited by 15
A Syllogism for Designing Collaborative Learning Technologies in the Age of AI and Multimodal Data
Cukurova, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-98572-5_22 · Cited by 9
Self-citationThe Value of Multimodal Data in Classification of Social and Emotional Aspects of Tutoring
Cukurova, M., Kent, C., & Luckin, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23207-8_9 · Cited by 5
Self-citationCukurova, M., Mavrikis, M., & Luckin, R. (2017) · UCL Discovery (University College London) · Cited by 2
Self-citation
Research works printed but not linked: 10
- Bienkowski M., 2012, Proceedings of Conference on Advanced Technology for Education, 1
- Coalition for Evidence‐Based Policy, 2013, Randomized controlled trials commissioned by the institute of education sciences since 2002: How many found positive versus weak or no effects
- Dillenbourg P., 2011, International Conference on Computer Supported Collaborative Learning 2011, 510
- EEF Blog – Stringer E, 2019, Teacher training—The challenge of change
- 10.1145/2883851.2883943 · doi:10.1145/2883851.2883943
- Kay J., 2018, 13th International Conference of the Learning Sciences (ICLS) Volume 1, 1
- 10.1016/j.sbspro.2014.01.359 · doi:10.1016/j.sbspro.2014.01.359
- Luckin R., 2018, Machine learning and human intelligence
- Luckin R. &Issroff K.(in press). AI and personalised learning and assessment New South Wales Department for Education Publication.
- Manches A., 2010, CAPITAL‐curriculum and pedagogy in technology assisted learning
Cited by
A Review of Artificial Intelligence (AI) in Education from 2010 to 2020
Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J.-B., Yuan, J., & Li, Y. (2021) · Complexity · doi:10.1155/2021/8812542 · Cited by 1,364
“54 Kitto and Knight [73] Investigating three tensions in ethics when applying artificial intelligence and data analysis (AIDA) in education 55 Luckin and Cukurova [74] REA Learning sciencesdriven AI Problem-solving, learning data, and debating Data in one case from high school EXP,INT OUT∗”
BackgroundChiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
The promises and challenges of artificial intelligence for teachers: A systematic review of research
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022) · TechTrends · doi:10.1007/s11528-022-00715-y · Cited by 984
“For example, the data may help researchers to understand when and how teaching is effectively progressing (Luckin & Cukurova, 2019; Luckin et al., 2016).”
BackgroundInfluentialTeacher support and student motivation to learn with Artificial Intelligence (AI) based chatbot
Chiu, T. K. F., Moorhouse, B. L., Chai, C. S., & Ismailov, M. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2172044 · Cited by 707
Metadata
- Authors
- Luckin, R., & Cukurova, M.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2019-07-21
- Volume
- 50
- Issue
- 6
- Pages
- 2824-2838
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W2962798420
- Cited by
- 481
- References
- 44
- FWCI
- 23.74
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.