The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Statistical Techniques to Explore the Quality of Constraints in Constraint-Based Modeling Environments
Open accessAbstract
One of the most popular student modeling approaches is Constraint-Based Modeling (CBM). It is an efficient approach that can be easily applied inside an Intelligent Tutoring System (ITS). Even with these characteristics, building new ITSs requires carefully designing the domain model to be taught because different sources of errors could affect the efficiency of the system. In this paper a novel mechanism for studying the quality of the elements in the domain model of CBM systems is presented. This mechanism combines CBM with the Item Response Theory (IRT), a data-driven technique for automatic assessment. The goal is to improve the quality of the elements that are used in problem solving environments for assessment or instruction. In this paper we propose a set of statistical techniques, i.e., the analysis of the point-biserial correlation, the Cronbach’s alpha and the information function, to explore the quality of constraints. Two different tools have been used to test this approach: a problem solving environment designed to assess students in project investment analysis; and an independent component that performs assessments using CBM and IRT. Results suggest that the three methods produce consistent diagnosis and may be complementary in some cases. In the experiments we have carried out they were able to detect faulty, bad and good quality constraints.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures













Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There is only one study [18] that clearly addresses aspects related to pedagogical models that support the work to be developed subsequently.”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Only one study [18] makes clear the use of the pedagogical model behind the choice of activities that AI will then evaluate.”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 2×
“Cronbach ' s Alpha ( Cronbach 1951 ) is a measure of the internal consistency of a set of items .”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022 · cited 10×
“(4), where A(i,θ) represents the area of the IIF of the item i with respect to the knowledge.”
InfluentialRozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,014
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 1×
“The system interface tries to reduce the cognitive overload (Sweller et al. 1998), otherwise calculus inherent in these kinds of problems would affect the student’s working memory.”
BackgroundFundamentals of item response theory
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4185 · Cited by 3,414
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324 · cited 2×
“Knowledge Tracing ( KT ) ( Corbett and Anderson 1995 ) is a technique to model student knowledge and learning over time that have been primarily included in CT .”
Method(1968) · Addison-Wesley eBooks · Cited by 2,001
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 1×
“CT (Anderson et al. 1995) are based on a theory that claims that there are two long-term memory stores: declarative and procedural.”
BackgroundThe basics of item response theory
Baker, F. B. (1985) · Cited by 1,362
“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572 · cited 3×
“Learning Factor Analysis (Cen et al. 2006), propose a semi-automated method combining a multiple logistic regression model of learning with combinatory techniques to calculate the parameters of the model.”
Method
Research works printed but not linked: 2
- Khan, M. & Jain, P. (1999). Theory and Problems in Financial Management. McGraw Hill Education.
- Pavlik, P. I., Cen, H. & Koedinger, K. R. (2009). Performance factors analysis - a new alternative to knowledge tracing. In Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 531–538.
Cited by
Artificial Intelligence for Student Assessment: A Systematic Review
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021) · Applied Sciences · doi:10.3390/app11125467 · Cited by 503
“Only one study [18] makes clear the use of the pedagogical model behind the choice of activities that AI will then evaluate.”
BackgroundInfluentialThe SIETTE Automatic Assessment Environment
Conejo, R., Guzmán, E., & Trella, M. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0078-4 · Cited by 34
“Furthermore, we have recently added composite items which, in combination with external items and CBM techniques, have allowed us to assess declarative knowledge (Gálvez 2009, 2012; Gálvez et al. 2009a, b, c, 2010, 2012, 2013) in problem-solving items.”
MethodInfluentialSelf-citationGalindo‐Domínguez, H., Delgado, N., de la Maza, M. S., & Expósito, E. (2024) · Edutec Revista Electrónica de Tecnología Educativa · doi:10.21556/edutec.2024.89.3509 · Cited by 18
Improving student model for individualized learning
Chen, Y. (2015) · theses.fr (ABES) · doi:10.70675/d7c5845dzb4eez4709z9979z4964b5e5ca91 · Cited by 1
“Gálvez et al. (2013) combined an IRT model with Constraint-Based Modeling (CBM) for student modeling.”
A Study of Possible AI Applications within Childhood Educations
Kubde, B. R., & Dekate, M. V. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-27160-0_6
Metadata
- Authors
- Gálvez, J., Conejo, R., & Guzmán, E.
- Affiliations
- Universidad de Málaga (ES)
- Corresponding author
- Gálvez, Jaime
- Venue
- International Journal of Artificial Intelligence in Education
- Publisher
- Elsevier BV
- Published
- 2013-11
- Volume
- 23
- Issue
- 1-4
- Pages
- 22-49
- ISSN
- 1560-4292 (ISSN-L)
- OpenAlex
- W2028383195
- Cited by
- 6
- References
- 42
- Citations by year
- 2026: 1 · 2024: 1 · 2021: 1 · 2015: 3
- FWCI
- 1.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 4555 d)
- Locations
- International Journal of Artificial Intelligence in Education (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- constraint-based modeling, student modeling, intelligent tutoring systems, item response theory, point-biserial correlation, Cronbach's alpha, information function, problem solving environments, automated assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical Techniques to Explore the Quality of Constraints in Constraint-Based Modeling Environments. https://app.cochat.ai/papers/10.1007/s40593-013-0008-2
- The paper
- Gálvez, J., Conejo, R., & Guzmán, E. (2013). Statistical Techniques to Explore the Quality of Constraints in Constraint-Based Modeling Environments. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-013-0008-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.