Assessing Efficiency of Prompts Based on Learner Characteristics
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Personalized prompting research has shown the significant learning benefit of prompting. The current paper outlines and examines a personalized prompting approach aimed at eliminating performance differences on the basis of a number of learner characteristics (capturing learning strategies and traits). The learner characteristics of interest were the need for cognition, work effort, computer self-efficacy, the use of surface learning, and the learner’s confidence in their learning. The approach was tested in two e-modules, using similar assessment forms (experimental n = 413; control group n = 243). Several prompts which corresponded to the learner characteristics were implemented, including an explanation prompt, a motivation prompt, a strategy prompt, and an assessment prompt. All learning characteristics were significant correlates of at least one of the outcome measures (test performance, errors, and omissions). However, only the assessment prompt increased test performance. On this basis, and drawing upon the testing effect, this prompt may be a particularly promising option to increase performance in e-learning and similar personalized systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, delivering personalised scaffolds automatically during the student task requires the formulation of rules that map insights from LA to actionable suggestions for specific learning tasks (Backhaus et al., 2017; Schumacher and Ifenthaler, 2021; Li et al., 2023; Liu et al., 2024b; Gunawardena et al., 2024; Li et al., 2025).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Backhaus et al., 2017
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Computer Self-Efficacy: Development of a Measure and Initial Test
Compeau, D. R., & Higgins, C. A. (1995) · MIS Quarterly · doi:10.2307/249688 · Cited by 6,553
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 5×
“The ARI and the FRERF are formulae to measure the understandability of texts.”
InfluentialThe Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173 · cited 1×
“Prompts can serve multiple functions and can focus on cognitive learning processes, metacognitive self-regulation, and resource management [17].”
BackgroundThe Efficient Assessment of Need for Cognition
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4803_13 · Cited by 2,913
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Cacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.197 · Cited by 2,517 · cited 1×
“Greater need for cognition means the learner is motivated to try to understand new information [8], while those with lower scores are not driven to learn for the sake of gaining new insight—in which case a prompt may be helpful.”
The revised two‐factor Study Process Questionnaire: R‐SPQ‐2F
Biggs, J., Kember, D., & Leung, D. Y. P. (2001) · British Journal of Educational Psychology · doi:10.1348/000709901158433 · Cited by 2,122 · cited 1×
“Surface strategy was measured using three items of the two-factor Study Process Questionnaire [9].”
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564 · cited 1×
“learning characteristic reduces variance [43].”
Self-regulated learning : from teaching to self-reflective practice
Schunk, D. H., & Zimmerman, B. J. (1998) · Cited by 1,426
Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001) · Cognition and Instruction · doi:10.1207/s1532690xci1902_02 · Cited by 912 · cited 1×
“Moreno, Mayer, Spires, and Lester employed a prompt that required students to feedback how much the learning material presented to them also helped them understand the link between plant design and the environment [19].”
Research works printed but not linked: 3
- Dunnette, M.D., and Hough, L.M. (1991). Handbook of Industrial and Organizational Psychology, Consulting Psychologists Press.
- Stevens, R., Beal, C.R., and Sprang, M. (2013). International Handbook of Metacognition and Learning Technologies, Springer.
- Gigerenzer, G., Krauss, S., and Vitouch, O. (2004). The Sage Handbook of Quantitative Methodology for the Social Sciences, Sage Publications.
Cited by
Guo, L. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12650 · Cited by 141
Schumacher, C., & Ifenthaler, D. (2021) · The Internet and Higher Education · doi:10.1016/j.iheduc.2020.100791 · Cited by 109
The Relation Between Need for Cognition and Academic Achievement: A Meta-Analysis
Liu, Q., & Nesbit, J. C. (2023) · Review of Educational Research · doi:10.3102/00346543231160474 · Cited by 88
Li, T., Nath, D., Cheng, Y., Fan, Y., Li, X., Raković, M., Khosravi, H., Swiecki, Z., Tsai, Y., & Gašević, D. (2025) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3706468.3706559 · Cited by 50
Backhaus, J., Huth, K., Entwistle, A., Homayounfar, K., & Koenig, S. (2019) · Journal of surgical education · doi:10.1016/j.jsurg.2018.12.001 · Cited by 43
Self-citationThomann, H., & Deutscher, V. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100686 · Cited by 40
Qian, K., Liu, S., Li, T., Raković, M., Li, X., Guan, R., Molenaar, I., Nawaz, S., Swiecki, Z., Yan, L., et al. (2026) · Computers & Education · doi:10.1016/j.compedu.2025.105448 · Cited by 39
FLoRA: An advanced AI-powered engine to facilitate hybrid human-AI regulated learning
Li, X., Li, T., Yan, L., Li, Y., Zhao, L., Raković, M., Molenaar, I., Gašević, D., & Fan, Y. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105527 · Cited by 33
“Since rule-based systems require all potential messages to be predefined, addressing multiple learning conditions simultaneously becomes unwieldy and impractical due to the sheer complexity of enumerating possible rule combinations (Backhaus et al., 2017).”
Smith, D., Zheng, R. Z., Metz, A. J., Morrow, S., Pompa, J., Hill, J. B., & Rupper, R. (2019) · Educational Gerontology · doi:10.1080/03601277.2019.1580442 · Cited by 14
Zipper, C., Friedrich, U., Backhaus, J., Koenig, S., Mavroveli, S., Wiegering, A., Olbrecht, S., Puppe, F., Günster, S. A., & Dietz, U. A. (2019) · Hernia · doi:10.1007/s10029-019-02094-5 · Cited by 14
Self-citationOoko, P. A., & Aloka, P. J. O. (2021) · African Journal of Disability · doi:10.4102/ajod.v10i0.707 · Cited by 9
Requirements and modalities of ensuring success in academic learning
Mogonea, F., & Mogonea, F. R. (2018) · Educatia 21 · doi:10.24193/ed21.2018.16.06 · Cited by 3
Current and Alternate Approaches to Personalization in Online Learning
Jeske, D., Bagher, M., & Pantidi, N. (2017) · International Symposium on Open Collaboration · doi:10.1145/3125433.3125449 · Cited by 2
“modules [2], assess competence [12] and support language learning [10].”
BackgroundSelf-citationElSayary, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-7332-3.ch006 · Cited by 1
Personalizing alternatives for diverse learner groups: readability tools
Jeske, D., Pantidi, N., & Bagher, M. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823410-5.00003-6 · Cited by 1
Self-citationOoko, P. A., Aloka, P. J. O., & Koweru, R. A. (2019) · International Journal of Brain and Cognitive Sciences
Nieland, K. (2020) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-8123
Patiño-Alarcón, D. R., Patiño-Alarcón, F. A., Lorente-Leyva, L. L., & Peluffo-Ordóñez, D. H. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-62833-8_7
Akakpo, M. G. (2019) · Online Publication Service of Würzburg University (Würzburg University) · doi:10.25972/opus-18593
Zipper, C. T. (2021) · Online Publication Service of Würzburg University (Würzburg University) · doi:10.25972/opus-21964
Schumacher, C., & Ifenthaler, D. (2026) · Interactive Technology and Smart Education · doi:10.1108/itse-06-2026-0241
Derin, A., & Er, E. (2026) · Interpersona An International Journal on Personal Relationships · doi:10.54899/iij.v20i1.1797
Metadata
- Authors
- Backhaus, J., Jeske, D., Poinstingl, H., & Koenig, S.
- Affiliations
- Universitätsklinikum Würzburg (DE)
- University College Cork (IE)
- University of Vienna (AT)
- Corresponding author
- Backhaus, Joy
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2017-02-10
- Volume
- 6
- Issue
- 1
- Pages
- 7
- ISSN
- 2073-431X (ISSN-L)
- OpenAlex
- W2587652368
- Cited by
- 18
- References
- 49
- Citations by year
- 2026: 1 · 2025: 4 · 2023: 1 · 2022: 1 · 2021: 2 · 2020: 3 · 2019: 4 · 2018: 1 · 2017: 1
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Computers (publishedVersion, cc-by)
- Arrow@dit (Dublin Institute of Technology) (acceptedVersion)
- Cork Open Research Archive (University College Cork, Ireland) (acceptedVersion, cc-by)
- Cork Open Research Archive (University College Cork, Ireland) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Bundesministerium für Bildung und Forschung
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Psychology › Developmental and Educational Psychology › Learning Styles and Cognitive Differences
- Keywords
- learner characteristics, need for cognition, work effort, computer self-efficacy, surface learning, learner confidence, e-module, test performance, online learning, personalized learning systems, testing effect
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.