Involving Users to Improve the Collaborative Logical Framework
Open accessThe DOI matches its Crossref record; 51 of the 53 references it cites were found in a registry or an index.
Abstract
In order to support collaboration in web-based learning, there is a need for an intelligent support that facilitates its management during the design, development, and analysis of the collaborative learning experience and supports both students and instructors. At aDeNu research group we have proposed the Collaborative Logical Framework (CLF) to create effective scenarios that support learning through interaction, exploration, discussion, and collaborative knowledge construction. This approach draws on artificial intelligence techniques to support and foster an effective involvement of students to collaborate. At the same time, the instructors’ workload is reduced as some of their tasks—especially those related to the monitoring of the students behavior—are automated. After introducing the CLF approach, in this paper, we present two formative evaluations with users carried out to improve the design of this collaborative tool and thus enrich the personalized support provided. In the first one, we analyze, following the layered evaluation approach, the results of an observational study with 56 participants. In the second one, we tested the infrastructure to gather emotional data when carrying out another observational study with 17 participants.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Three more articles mention pedagogical models on which the instruction is based: two use collaboration as a method of student work [21,38] and the third uses argument maps [39].”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [21]
The cited source says what the claim attributes to it.
In the citing paper
“Three other studies [21,38,39] also hint at their pedagogical rationale, which is mainly based on collaboration.”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [21]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“As for the papers that focus on formative assessment, it is clear that the idea of using AI for this task lies in the help that this technology can provide to teachers when they have a large number of students [41], or based on the idea that learning improves the more immediate the feedback given to students [21].”
From Artificial Intelligence for Student Assessment: A Systematic Review (2021) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · cited 1×
“…such as the Big Five Inventory (BFI) [61], the General Self-Efficacy Scale (GSE) [62], and the Positive and Negative Affect Schedule (PANAS) [63], (2) subjective reports such as explicit emotional reports written in natural language by the participants and the Self Assessment Manikin (SAM)…”
BackgroundAxelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“…measuring two distinct dimensions of emotions (valence and arousal) by means of graphic representations of mood in the form of manikins, based on the circumplex model of affect [44] to evaluate the influence of an emotion representation tool in different collaborative work environments [45].”
BackgroundBreiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · cited 1×
“…tree algorithms are a standard technique to classify instances and we did not use other techniques that can offer similar results (e.g., bagging [54]), because the purpose was to obtain metrics with explicit relationships between the dataset statistical indicators and student collaboration…”
MethodMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 2×
“…Five Inventory (BFI) [61], the General Self-Efficacy Scale (GSE) [62], and the Positive and Negative Affect Schedule (PANAS) [63], (2) subjective reports such as explicit emotional reports written in natural language by the participants and the Self Assessment Manikin (SAM) [43] graphical scale.”
BackgroundMethodSUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
(2005) · CTIT technical reports series · Cited by 5,307
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-109890-2.x5027-6 · Cited by 4,409 · cited 1×
“…(4) variety of source data and inference methods involved [24], (5) difficulties involved in evaluating collaborative learning processes [25], (6) self-regulation role in managing social and collaborative activities [26], and especially (7) lack of consensus on how to model collaboration [27].”
BackgroundContext and consciousness: activity theory and human-computer interaction
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5756 · Cited by 2,511
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251 · cited 2×
“In order to describe the management of the intelligent support, as implemented in the CLF [3], we follow the distinctions suggested elsewhere [24] and analyze thus the source of data used (data acquisition), the inference method (modeling the collaborative behavior), and the adaptation processes.”
BackgroundMethod
Research works printed but not linked: 7
- 2005, International Journal of Artificial Intelligence in Education, 15, 261
- 2007, International Journal of Artificial Intelligence in Education Archive, 17, 3
- 1999, Introduction, what do you mean by collaborative learning?
- 1996, Paradigms shift and instructional technology
- 2003, United States Distance Learning Association Journal, 17, 19
- 2001, Anuarion de Psicología, 32, 77
- 1996, Machine Learning, 24, 123
Cited by
Artificial Intelligence for Student Assessment: A Systematic Review
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021) · Applied Sciences · doi:10.3390/app11125467 · Cited by 503
“In the case of Santos and Boticario [21], they are based on formative assessment through collaboration using a system called dotLRN.”
BackgroundMethodInfluentialMartínez-Comesaña, M., Rigueira, X., Larrañaga, A., Martínez, J. M., Ocarranza-Prado, I., & Kreibel, D. (2023) · Revista de Psicodidáctica · doi:10.1016/j.psicod.2023.06.001 · Cited by 194
Martínez-Comesaña, M., Rigueira-Díaz, X., Larrañaga-Janeiro, A., Martínez-Torres, J., Ocarranza-Prado, I., & Kreibel, D. (2023) · Revista de Psicodidáctica (English ed.) · doi:10.1016/j.psicoe.2023.06.002 · Cited by 79
Saneiro, M., Santos, O. C., Salmeron-Majadas, S., & Boticario, J. G. (2014) · The Scientific World Journal · doi:10.1155/2014/484873 · Cited by 91
“The other one followed a collaborative approach [48].”
BackgroundSelf-citationSantos, O. C., Boticario, J. G., & Pérez-Marín, D. (2013) · Science of Computer Programming · doi:10.1016/j.scico.2013.12.004 · Cited by 94
“Moreover, affective issues in collaborative learning scenarios are also being addressed [145].”
BackgroundSelf-citation
Metadata
- Authors
- Santos, O. C., & Boticario, J. G.
- Affiliations
- Universidad Nacional de Educación a Distancia (ES)
- aDeNu Research Group, Computer Science School, UNED, Calle Juan del Rosal 16, 28040 Madrid, Spain
- Corresponding author
- Santos, Olga C.
- Venue
- The Scientific World Journal
- Publisher
- Wiley
- Published
- 2014
- Volume
- 2014
- Pages
- 1-15
- ISSN
- 1537-744X (ISSN-L)
- 2356-6140
- PMC
- PMC3921980
- OpenAlex
- W2058924303
- Cited by
- 25
- References
- 53
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 6 · 2022: 1 · 2021: 1 · 2020: 1 · 2016: 5 · 2015: 2 · 2014: 2
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- The Scientific World JOURNAL (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministerio de Economía y Competitividad
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- online collaborative learning, user participation, collaborative knowledge construction, teacher workload reduction, student behavior monitoring, personalized learning support, formative assessment, observational studies
- MeSH terms
- Adolescent, Adult, Aged, Artificial Intelligence, Computer-Assisted Instruction, Computer Communication Networks, Cooperative Behavior, Humans, Middle Aged, Software, Education, Distance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Involving Users to Improve the Collaborative Logical Framework. https://app.cochat.ai/papers/10.1155/2014/893525
- The paper
- Santos, O. C., & Boticario, J. G. (2014). Involving Users to Improve the Collaborative Logical Framework. The Scientific World Journal. https://doi.org/10.1155/2014/893525
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.