CoChat
Sign Up
Cited by 112Online Learning and AnalyticsEducational Technology and PedagogySentiment Analysis and Opinion Mining

Towards teaching analytics: a contextual model for analysis of students' evaluation of teaching through text mining and machine learning classification

Open access
Okoye, Kingsley, Arrona-Palacios, Arturo, Camacho-Zuñiga, Claudia, Achem, Joaquín Alejandro Guerra, Escamilla, Jose, Hosseini, Samira·2022·Education and Information Technologies
DOI 10.1007/s10639-021-10751-5PMC PMC8503388
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent trends in educational technology have led to emergence of methods such as teaching analytics (TA) in understanding and management of the teaching–learning processes. Didactically, teaching analytics is one of the promising and emerging methods within the Education domain that have proved to be useful, towards scholastic ways to make use of substantial pieces of evidence drawn from educational data to improve the teaching–learning processes and quality of performance. For this purpose, this study proposed an educational process and data mining plus machine learning (EPDM + ML) model applied to contextually analyze the teachers’ performances and recommendations based on data derived from students’ evaluation of teaching (SET). The EPDM + ML model was designed and implemented based on amalgamation of the Text mining and Machine learning technologies that builds on the descriptive decision theory, which studies the rationality behind decisions the learners are disposed to make based on the textual data quantification and statistical analysis. To this effect, the study determines pedagogical factors that influences the students' recommendations for their teachers, what role the sentiment and emotions expressed by the students in the SET play in the way they evaluate the teachers by taking into account the gender of the teachers. This includes how to automatically predict what a student’s recommendation for the teachers may be based on information about the students’ gender, average sentiment, and emotional valence they have shown in the SET. Practically, we applied the Text mining technique to extract the different sentiments and emotions (intensities of the comments) expressed by the students in the SET, and then utilized the quantified data (average sentiment and emotional valence) to conduct an analysis of covariance and Kruskal Wallis Test to determine the influential factors, as well as, how the students’ recommendation for the teachers differ by considering the gender constructs, respectively. While a large proportion of the comments that we analyzed (n = 85,378) was classified to be neutral and predominantly interpreted to be positive in nature considering the sentiments (76.4%), and emotional valence (88.2%) expressed by the students. The results of our analysis shows that for the students’ comments which contain some kind of positive or negative sentiment (23.6%) and emotional valence (11.8%); that females students recommended the teachers taking into account the sentiments (p = .000). While the males appear to be slightly borderline in terms of emotions (p = .056) and sentiment (p = .077). Also, the EPDM + ML model showed to be a good predictor and efficient method in determining what the students’ recommendation scores for the teachers would be, going by the high and acceptable values of the precision (1.00), recall (1.00), specificity (1.00), accuracy (1.00), F1-score (1.00) and zero error-rate (0.00) which we validated using the k-fold cross-validation method, with 63.6% of optimal k-values observed. In theory, we note that not only does the proposed method (EPDM + ML) proves to be useful towards effective analysis of SET and its implications within the educational domain. But can be utilized to determine prominent factors that influences the students’ evaluation and recommendation of the teachers, as well as helps provide solutions to the ever-increasingly need to advance and support the teaching–learning processes and/or students’ learning experiences in a rapidly changing educational environment or ecosystem.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10639-021-10751-5

Cites

132 of 132 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Quantified sentiments and emotional valence scores have been used to predict students' recommendation scores for teachers in order to determine prominent factors that influence student evaluations.

    “Further, such quantified sentiments and emotional valence scores have been used to predict students' recommendation scores for teachers in order to determine prominent factors that influence student evaluations (Okoye et al., 2022).”

    From Proactive and reactive engagement of artificial intelligence methods for education: a review (2023) · cites this paper as Okoye et al., 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

1 retracted

Flagged first, then by citations

Research works printed but not linked: 4

  1. IEEE. (2020a). Active data is fueling cities’ responses to COVID-19. IEEE Transmitter. Retrieved from https://transmitter.ieee.org/how-active-data-is-fueling-cities-responses-to-covid-19/
  2. IEEE. (2020b). How COVID-19 is affecting industry 4.0 and innovation. IEEE Transmitter. Retrieved from https://transmitter.ieee.org/how-covid-19-is-affecting-industry-4-0-and-the-future-of-innovation/
  3. Montemayor-Gallegos, J. E. (2002). Reliability and validity of the opinion survey carried out to the students to evaluate and provide feedback on the performance of the ITESM-Single Edition teachers. Instituto Tecnológico y de Estudios Superiores de Monterrey. Retrieved from http://hdl.handle.net/11285/567554
  4. Payne A Achieving excellence in customer management. Handbook of CRM 2006 Elsevier BH

Cited by

Sorted by citations

Related

Authors
Okoye, K., Arrona-Palacios, A., Camacho-Zuñiga, C., Achem, J. A. G., Escamilla, J., & Hosseini, S.
Affiliations
Tecnológico de Monterrey (MX)
Corresponding author
Hosseini, Samira
ORCID
Venue
Education and Information Technologies
Publisher
Springer Science and Business Media LLC
Published
2021-10-11
Volume
27
Issue
3
Pages
3891-3933
ISSN
  • 1360-2357 (ISSN-L)
  • 1573-7608
DOI
10.1007/s10639-021-10751-5
PMC
PMC8503388
OpenAlex
W3205442269
Cited by
112
References
132
Citations by year
2026: 22 · 2025: 25 · 2024: 34 · 2023: 19 · 2022: 11 · 2020: 1
FWCI
13.54
Type
journal article
Language
en
Open access
Licence
Locations
  • Education and Information Technologies (publishedVersion, other-oa)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Physical Sciences › Computer Science › Artificial Intelligence › Educational Technology and Pedagogy
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Keywords
teaching analytics, student evaluation of teaching, teacher performance, student recommendations, sentiment analysis, emotional valence, gender differences, text mining, machine learning classification, educational data mining, descriptive decision theory, contextual model, teacher gender, student comments, teaching and learning improvement, performance quality, Kruskal-Wallis test, covariance analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review