Learnersourcing in the age of AI: Student, educator and machine partnerships for content creation
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Engaging students in creating novel content, also referred to as learnersourcing, is increasingly recognised as an effective approach to promoting higher-order learning, deeply engaging students with course material and developing large repositories of content suitable for personalized learning. Despite these benefits, some common concerns and criticisms are associated with learnersourcing (e.g., the quality of resources created by students, challenges in incentivising engagement and lack of availability of reliable learnersourcing systems), which have limited its adoption. This paper presents a framework that considers the existing learnersourcing literature, the latest insights from the learning sciences and advances in AI to offer promising future directions for developing learnersourcing systems. The framework is designed around important questions and human-AI partnerships relating to four key aspects: (1) creating novel content, (2) evaluating the quality of the created content, (3) utilising learnersourced contributions of students and (4) enabling instructors to support students in the learnersourcing process. We then present two comprehensive case studies that illustrate the application of the proposed framework in relation to two existing popular learnersourcing systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A revision of bloom's taxonomy: an overview
Krathwohl, D. R. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4104_2 · Cited by 8,132
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
(2020) · doi:10.1145/3313831 · Cited by 1,951
The generation effect: delineation of a phenomenon
Slamecka, N. J., & Graf, P. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.6.592 · Cited by 1,659
The Zone of Proximal Development in Vygotsky's Analysis of Learning and Instruction
Chaiklin, S. (2003) · Vygotsky's Educational Theory in Cultural Context · doi:10.1017/cbo9780511840975.004 · Cited by 1,055 · cited 2×
“These included a content-neutral quiz to familiarise students with the terminology of an MCQ (e.g., stem, options, distractors), a self-diagnosis quiz to guide students towards a learning-orientation rather than being performance focused, a representation of Vygotsky’s “Zone of Proximal Development” (Chaiklin, 2003) t…”
BackgroundRethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863 · cited 1×
“In practice, assessment and review materials such as questions and exercises form a popular category of learnersourced resources (Moore, Stamper, Brooks, Denny and Khosravi, 2022d).”
BackgroundSelf-citationTo give is better than to receive: The benefits of peer review to the reviewer's own writing
Lundstrom, K., & Baker, W. (2009) · Journal of Second Language Writing · doi:10.1016/j.jslw.2008.06.002 · Cited by 843 · cited 1×
“These include enabling them to improve their comprehension of the content (Li, Liu and Steckelberg, 2010), develop evaluative judgement (Tai, Ajjawi, Boud, Dawson and Panadero, 2018; Gyamfi, Hanna and Khosravi, 2021b; Khosravi, Gyamfi, Hanna, Lodge and Abdi, 2021b) and a sense of accountability (Kao, 2013), and improv…”
BackgroundDeveloping evaluative judgement: enabling students to make decisions about the quality of work
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018) · Higher Education · doi:10.1007/s10734-017-0220-3 · Cited by 810
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
(2023) · doi:10.1145/3544548 · Cited by 735
Heffernan, N. T., & Heffernan, C. L. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0024-x · Cited by 616
A Systematic Review of Automatic Question Generation for Educational Purposes
Kurdi, G., Leo, J., Parsia, B., Sattler, U., & Al-Emari, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00186-y · Cited by 514
Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models
Sarsa, S., Denny, P., Hellas, A., & Leinonen, J. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3501385.3543957 · Cited by 497
Self-citationTruth inference in crowdsourcing: is the problem solved?
Zheng, Y., Li, G., Li, Y., Shan, C., & Cheng, R. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3055540.3055547 · Cited by 421
Jeong, H., Hmelo-Silver, C. E., & Jo, K. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.100284 · Cited by 339
Feedback loops and the longer-term: towards feedback spirals
Carless, D. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1531108 · Cited by 328 · cited 1×
“In the case of using peer review, an interesting future direction is to study how best practices from feedback literacy in terms of engaging authors and evaluators in dialogue (Ajjawi and Boud, 2017) and feedback loops (Carless, 2019) can be applied in learnersourcing.”
BackgroundA model of the self-explanation effect.
VanLehn, K., Jones, R. M., & Chi, M. T. H. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0201_1 · Cited by 305
Trust, distrust and their impact on assessment reform
Carless, D. (2009) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930801895786 · Cited by 212
Comparing Code Explanations Created by Students and Large Language Models
Leinonen, J., Denny, P., MacNeil, S., Sarsa, S., Bernstein, S., Kim, J., Tran, A., & Hellas, A. (2023) · Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 · doi:10.1145/3587102.3588785 · Cited by 210
Self-citationDrori, I., Zhang, S., Shuttleworth, R., Tang, L., Lu, A., Ke, E., Liu, K., Chen, L., Tran, S., Cheng, N., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2123433119 · Cited by 187
New Potentials for Data‐Driven Intelligent Tutoring System Development and Optimization
Koedinger, K. R., Brunskill, E., Baker, R. S. J. D., McLaughlin, E. A., & Stamper, J. (2013) · AI Magazine · doi:10.1609/aimag.v34i3.2484 · Cited by 178 · cited 1×
“They are a core component of adaptive educational systems that provide students with customized learning paths and adaptive feedback based on their learning process (Koedinger et al., 2013).”
BackgroundSelf-citationChan, A. (2023) · AI and Ethics · doi:10.1007/s43681-022-00148-6 · Cited by 155 · cited 1×
“Large language models are trained on broad data produced by humans, and thus are known to suffer from biases similar to humans (Chan, 2023).”
BackgroundEmpirical Support for a Causal Relationship Between Gamification and Learning Outcomes
Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173885 · Cited by 135
Self-citationIncorporating AI and learning analytics to build trustworthy peer assessment systems
Darvishi, A., Khosravi, H., Sadiq, S., & Gašević, D. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13233 · Cited by 120
Self-citationStudent-Generated Content: Enhancing learning through sharing multiple-choice questions
Hardy, J., Bates, S. P., Casey, M. M., Galloway, K. W., Galloway, R. K., Kay, A. E., Kirsop, P., & McQueen, H. A. (2014) · International Journal of Science Education · doi:10.1080/09500693.2014.916831 · Cited by 119
Social Constructivism—Jerome Bruner
Rannikmäe, M., Holbrook, J., & Soobard, R. (2020) · Springer Texts in Education · doi:10.1007/978-3-030-43620-9_18 · Cited by 105
Assessing the quality of student-generated short answer questions using GPT-3
Moore, S., Nguyen, H. A., Bier, N., Domadia, T., & Stamper, J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-16290-9_18 · Cited by 93
Self-citationRiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities
Khosravi, H., Kitto, K., & Williams, J. J. (2019) · arXiv · doi:10.48550/arxiv.1910.05522 · Cited by 81
Self-citationComplementing educational recommender systems with open learner models
Abdi, S., Khosravi, H., Sadiq, S., & Gasevic, D. (2020) · Proceedings of the Tenth International Conference on Learning Analytics & Knowledge · doi:10.1145/3375462.3375520 · Cited by 68
Self-citationAssessing the quality of a student-generated question repository
Bates, S. P., Galloway, R. K., Riise, J., & Homer, D. (2014) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.10.020105 · Cited by 55
Doyle, E., Buckley, P., & Whelan, J. (2019) · Teaching in Higher Education · doi:10.1080/13562517.2018.1498077 · Cited by 50
(2009) · doi:10.5555/1862712.1862724 · Cited by 49
Self-citationDoing it for themselves: students creating a high quality peer-learning environment
Galloway, K. W., & Burns, S. (2015) · Chemistry Education Research and Practice · doi:10.1039/c4rp00209a · Cited by 47 · cited 2×
“While strong evidence from previous work suggests that a large portion of the SGC is of a high-quality and meets rigorous judgmental and statistical criteria (Walsh et al., 2018; Galloway and Burns, 2015), it also suggests that students commonly create resources that are ineffective, inappropriate, or incorrect (Tacke…”
BackgroundEvaluating the Quality of Learning Resources: A Learnersourcing Approach
Abdi, S., Khosravi, H., Sadiq, S., & Demartini, G. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3058644 · Cited by 40 · cited 1×
“…develop evaluative judgement (Tai, Ajjawi, Boud, Dawson and Panadero, 2018; Gyamfi, Hanna and Khosravi, 2021b; Khosravi, Gyamfi, Hanna, Lodge and Abdi, 2021b) and a sense of accountability (Kao, 2013), and improve their writing (Polisda, 2017) and ability to provide constructive feedback…”
BackgroundSelf-citationIncorporating Training, Self-monitoring and AI-Assistance to Improve Peer Feedback Quality
Darvishi, A., Khosravi, H., Abdi, S., Sadiq, S., & Gašević, D. (2022) · Proceedings of the Ninth ACM Conference on Learning @ Scale · doi:10.1145/3491140.3528265 · Cited by 31
Self-citationQAScore—An Unsupervised Unreferenced Metric for the Question Generation Evaluation
Ji, T., Lyu, C., Jones, G., Zhou, L., & Graham, Y. (2022) · Entropy · doi:10.3390/e24111514 · Cited by 12
Cited by
Bewersdorff, A., Seßler, K., Baur, A., Kasneci, E., & Nerdel, C. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100177 · Cited by 76
“, 2022), intelligent tutoring systems (Marmo, 2022), and supporting content generation (Khosravi et al., 2023).”
BackgroundLarge language models meet user interfaces: The case of provisioning feedback
Pozdniakov, S., Brazil, J., Abdi, S., Bakharia, A., Sadiq, S., Gašević, D., Denny, P., & Khosravi, H. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100289 · Cited by 43
Self-citationLahza, H. F., Demartini, G., Noroozi, O., Gašević, D., Sadiq, S., & Khosravi, H. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105260 · Cited by 16
Self-citationAI assistance in peer feedback provision: Pedagogically sound, but minimally adopted
Pozdniakov, S., Brazil, J., Banihashem, S. K., Noroozi, O., Gašević, D., Sadiq, S., & Khosravi, H. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105591 · Cited by 11
Self-citationEmpowering Children’s AI Literacy Through Co-Creating Stories with LLM
Han, A., & Han, S. (2025) · Proceedings of the 24th Interaction Design and Children · doi:10.1145/3713043.3731520 · Cited by 8
Metadata
- Authors
- Khosravi, H., Denny, P., Moore, S., & Stamper, J.
- Venue
- Computers and Education: Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2023
- Volume
- 5
- Pages
- 100151
- ISSN
- 2666-920X (ISSN-L)
- OpenAlex
- W4381951307
- Cited by
- 53
- References
- 39
- FWCI
- 12.24
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.