Assistance and Feedback Mechanism in an Intelligent Tutoring System for Teaching Conversion of Natural Language into Logic
Open accessThe DOI matches its Crossref record; 71 of the 73 references it cites were found in a registry or an index.
Abstract
Logic as a knowledge representation and reasoning language is a fundamental topic of an Artificial Intelligence (AI) course and includes a number of sub-topics. One of them, which brings difficulties to students to deal with, is converting natural language (NL) sentences into first-order logic (FOL) formulas. To assist students to overcome those difficulties, we developed the NLtoFOL system and equipped it with a strong assistance and feedback mechanism. In this work, first, we present that feedback mechanism. The mechanism can provide assistance before an answer is submitted, if requested, but mainly it provides assistance after an answer is submitted. To that end, it characterizes the answer in terms of completeness and accuracy to determine the level of incorrectness, based on an answer categorization scheme, introduced in this paper. The automatically generated natural language feedback sequences grow from general to specific and can include statements on a student’s metacognitive state. Feedback is provided as natural language sentences automatically generated through a template-based natural language generation mechanism. Second, we present an extensive evaluation of the effectiveness of the assistance and feedback mechanism on students’ learning. The evaluation of feedback with students showed that full feedback sequences lead to greater learning gains than sequences consisting of only flag feedback and bottom-out hints ( n = 226), and that generic, template-based feedback sequences are comparable to the utility of problem-specific hints generated by human tutors ( n = 120).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As already mentioned, the main uses of AI applied to education are related to tutoring and assessment [40], although we also find other examples of use such as personalization [22,41,46] or quality assessment [20,37,39].”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [40]
In the citing paper
“one of the works determines that error detection is essential to achieve a better understanding and for pedagogical decision-making [40]”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [40]
In the citing paper
“As already mentioned, the main uses of AI applied to education are related to tutoring and assessment [40], although we also find other examples of use such as personalization [22,41,46] or quality assessment [20,37,39].”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [40]
In the citing paper
“Selected studies suggest that survey data-based LA can foster predictive feedback (Broos et al., 2020), recommendation (Perikos et al., 2017), reflective feedback (Smith, 2020; Tsai et al., 2021), and assessment (Dalla Valle et al., 2018).”
From A systematic review of the role of learning analytics in enhancing feedback practices in higher education (2022) · cites this paper as Perikos et al., 2017
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Research works printed but not linked: 1
- Moreno, A., & Budesca, N. (2000). Mathematical logic tutor-propositional calculus. In Proceedings of the First International Congress on Tools for Teaching Logic (pp. 99–106).
Cited by
Lin, C.-C., Huang, A. Y. Q., & Lu, O. H. T. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00260-y · Cited by 669
“…Yang et al., 2021a, b) from Asia, 9 papers (Afzaal et al., 2021; Corrigan et al., 2015a, b; Guerrero-Higueras et al., 2018; Llurba et al., 2022; Perikos et al., 2017; Ruipé-rez-Valiente et al., 2021; Serrano-Laguna et al., 2018; Tobarra et al., 2021) from Europe, 5 papers (Montpetit &…”
Artificial Intelligence for Student Assessment: A Systematic Review
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021) · Applied Sciences · doi:10.3390/app11125467 · Cited by 503
Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104094 · Cited by 289
Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100489 · Cited by 246
Ferreira‐Mello, R., André, M., Pinheiro, A., Costa, E., & Romero, C. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1332 · Cited by 193
“Moreover, there are a few works that aid the instructor to monitor students within this tools (Scheuer and McLaren, 2008; Perikos et al., 2017).”
Background
Metadata
- Authors
- Perikos, I., Grivokostopoulou, F., & Hatzilygeroudis, I.
- Affiliations
- University of Patras (GR)
- Corresponding author
- Perikos, Isidoros
- Venue
- International Journal of Artificial Intelligence in Education
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 27
- Issue
- 3
- Pages
- 475-514
- ISSN
- 1560-4292 (ISSN-L)
- OpenAlex
- W2590947568
- Cited by
- 44
- References
- 73
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 9 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 4 · 2019: 5 · 2018: 2 · 2017: 3
- FWCI
- 2.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 3162 d)
- Locations
- International Journal of Artificial Intelligence in Education (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Edcuational Technology Systems
- Keywords
- intelligent tutoring systems, automated feedback, hint generation, artificial intelligence in education, knowledge representation, learning gains
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assistance and Feedback Mechanism in an Intelligent Tutoring System for Teaching Conversion of Natural Language into Logic. https://app.cochat.ai/papers/10.1007/s40593-017-0139-y
- The paper
- Perikos, I., Grivokostopoulou, F., & Hatzilygeroudis, I. (2017). Assistance and Feedback Mechanism in an Intelligent Tutoring System for Teaching Conversion of Natural Language into Logic. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-017-0139-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.