CoChat

Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence

Open access
Álvarez-Álvarez, Carmen, Falcon, Samuel · 2023 · Educational technology research and development
Cited by 47

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

University teaching practices impact student interest, engagement, and academic performance. This paper presents a study that uses artificial intelligence (AI) to examine students’ preferences for university teaching practices. We asked students in various fields open-ended questions about the best teaching practices they had experienced. Due to the large amount of data obtained, we used the AI-based language model Generative Pretrained Transformer-3 (GPT-3) to analyse the responses. With this model, we sorted students’ testimonies into nine theory-based categories regarding teaching practices. After analysing the reliability of the classifications conducted by GPT-3, we found that the agreement between humans was similar to that observed between humans and the AI model, which supported its reliability. Regarding students’ preferences for teaching practices, the results showed that students prefer practices that focus on (1) clarity and (2) interaction and relationships. These results enable the use of AI-based tools that facilitate the analysis of large amounts of information collected through open methods. At the didactic level, students’ preferences and demand for clear teaching practices (in which ideas and activities are stated and shown without ambiguity) that are based on interaction and relationships (between teachers and students and among students themselves) are demonstrable.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11423-023-10239-8

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 42

  1. Alegre, O. M., & Villar, L. M. (2017). Indicadores y control estadístico para el seguimiento y evaluación de preferencias de aprendizaje de estudiantes universitarios. Revista De Educación a Distancia (RED). https://doi.org/10.6018/red/55/2 · DOI
  2. Álvarez-Álvarez, C., Sánchez-Ruiz, L., Sarabia Cobo, C., & Montoya-del Corte, J. (2022). Validación de un cuestionario para la evaluación de la interacción en la enseñanza universitaria. REDU. Revista De Docencia Universitaria, 20(1), 145–160. https://doi.org/10.4995/redu.2022.15918 · DOI
  3. Ambrose, S. A., Bridges, M. W., Dipietro, M., Lovett, M. C., Norman, M. K., & Mayer, R. E. (2010). 7 research-based principles for smart teaching (1st ed.). John Wiley.
  4. Aridah, A., Atmowardoyo, H., & Salija, K. (2017). Teacher practices and students’ preferences for written corrective feedback and their implications on writing instruction. International Journal of English Linguistics, 7(1), 112. https://doi.org/10.5539/ijel.v7n1p112 · doi:10.5539/ijel.v7n1p112
  5. Brownell, C. A., Svetlova, M., Anderson, R., Nichols, S. R., & Drummond, J. (2013). Socialization of early prosocial behavior: parents’ talk about emotions is associated with sharing and helping in toddlers. Infancy, 18(1), 91–119. https://doi.org/10.1111/j.1532-7078.2012.00125.x · DOI · Paper page
  6. Callaway, E. (2022). What’s next for AlphaFold and the AI protein-folding revolution. Nature, 604, 234–238. · DOI · Paper page
  7. Carr, R., Palmer, S., & Hagel, P. (2015). Active learning: The importance of developing a comprehensive measure. Active Learning in Higher Education, 16(3), 173–186. https://doi.org/10.1177/1469787415589529 · DOI · Paper page
  8. Chalmers, C., Mowat, E., & Chapman, M. (2018). Marking and providing feedback face-to-face: Staff and student perspectives. Active Learning in Higher Education, 19(1), 35–45. https://doi.org/10.1177/1469787417721363 · DOI
  9. Cohen, L., Manion, L., & Morrison, K. (2000). Research methods in education (5th ed.). Routledge.
  10. Falcon, S., Admiraal, W., & Leon, J. (2023). Teachers’ engaging messages and the relationship with students’ performance and teachers’ enthusiasm. Learning and Instruction, 86, 101750. https://doi.org/10.1016/j.learninstruc.2023.101750 · DOI
  11. Freelon, D. G. (2010). ReCal: Intercoder reliability calculation as a web service. International Journal of Internet Science, 1, 20–33.
  12. Geng, S., Niu, B., Feng, Y., & Huang, M. (2020). Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach. British Journal of Educational Technology, 51(5), 1785–1803. https://doi.org/10.1111/bjet.12999 · DOI
  13. Harbour, K. E., Evanovich, L. L., Sweigart, C. A., & Hughes, L. E. (2015). A brief review of effective teaching practices that maximize student engagement. Preventing School Failure, 59(1), 5–13. https://doi.org/10.1080/1045988X.2014.919136 · DOI
  14. Hardman, J. (2016). Tutor–student interaction in seminar teaching: Implications for professional development. Active Learning in Higher Education, 17(1), 63–76. https://doi.org/10.1177/1469787415616728 · DOI
  15. Hills, C., Levett-Jones, T., Warren-Forward, H., & Lapkin, S. (2016). Teaching and learning preferences of ‘Generation Y’ occupational therapy students in practice education. International Journal of Therapy and Rehabilitation, 23(8), 371–379. https://doi.org/10.12968/ijtr.2016.23.8.371 · doi:10.12968/ijtr.2016.23.8.371
  16. Hynninen, T., Knutas, A., Hujala, M., & Arminen, H. (2019). Distinguishing the themes emerging from masses of open student feedback. 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2019 - Proceedings, 557–561. https://doi.org/10.23919/MIPRO.2019.8756781 · DOI
  17. King, E., & La Paro, K. (2015). Teachers’ language in interactions: An exploratory examination of mental state talk in early childhood education classrooms. Early Education and Development, 26(2), 245–263. https://doi.org/10.1080/10409289.2015.989029 · DOI
  18. Könings, K. D., Brand-Gruwel, S., & van Merriënboer, J. J. G. (2011). The match between students’ lesson perceptions and preferences: Relations with student characteristics and the importance of motivation. Educational Research, 53(4), 439–457. https://doi.org/10.1080/00131881.2011.625155 · DOI
  19. Leong, C. K., Lee, Y. H., & Mak, W. K. (2012). Mining sentiments in SMS texts for teaching evaluation. Expert System Application, 39, 2584–2589. https://doi.org/10.1016/j.eswa.2011.08.113 · DOI
  20. Lodico, M. G., Spaulding, D. T., & Voegtle, K. H. (2010). Methods in educational research: From theory to practice (Vol. 28). John Wiley.
  21. Macfayden, L. P., Chase, M. M., Reeder, K., & Roche, J. (2003). Matches and mismatches in intercultural learning: design and facilitation of an online intercultural course. UNESCO Conference on Intercultural Education, 15–18.
  22. Marsh, H. W. (1994). Sport motivation orientations: Beware of jingle-jangle fallacies. Journal of Sport & Exercise Psychology, 16(4), 365–380. · DOI · Paper page
  23. Marsh, H. W., Craven, R. G., Hinkley, J. W., & Debus, R. L. (2003). Evaluation of the Big-Two-Factor theory of academic motivation orientations: An evaluation of jingle-jangle fallacies. Multivariate Behavioral Research, 38(2), 189–224. https://doi.org/10.1207/S15327906MBR3802_3 · DOI · Paper page
  24. Minhas, P. S., Ghosh, A., & Swanzy, L. (2012). The effects of passive and active learning on student preference and performance in an undergraduate basic science course. Anatomical Sciences Education, 5(4), 200–207. https://doi.org/10.1002/ase.1274 · DOI
  25. Moliní Fernández, F., & Sánchez-González, D. (2019). Fomentar la participación en clase de los estudiantes universitarios y evaluarla. REDU. Revista De Docencia Universitaria, 17(1), 211. https://doi.org/10.4995/redu.2019.10702 · DOI
  26. Opdecam, E., Everaert, P., Van Keer, H., & Buysschaert, F. (2014). Preferences for team learning and lecture-based learning among first-year undergraduate accounting students. Research in Higher Education, 55(4), 400–432. https://doi.org/10.1007/s11162-013-9315-6 · DOI
  27. Pong-inwong, C., & Songpan, W. (2019). Sentiment analysis in teaching evaluations using sentiment phrase pattern matching (SPPM) based on association mining. International Journal of Machine Learning and Cybernetics, 10(8), 2177–2186. https://doi.org/10.1007/s13042-018-0800-2 · DOI
  28. Rahman, M. S. (2016). The advantages and disadvantages of using qualitative and quantitative approaches and methods in language “testing and assessment” research: A literature review. Journal of Education and Learning, 6(1), 102. https://doi.org/10.5539/jel.v6n1p102 · DOI · Paper page
  29. Rani, S., & Kumar, P. (2017). A sentiment analysis system to improve teaching and learning. Advances in Learning Technologies. https://doi.org/10.1109/MC.2017.133 · DOI · Paper page
  30. Roberts, D. (2019). Higher education lectures: From passive to active learning via imagery? Active Learning in Higher Education, 20(1), 63–77. https://doi.org/10.1177/1469787417731198 · DOI
  31. Rodgers, W. J., Kennedy, M. J., VanUitert, V. J., & Myers, A. M. (2019). Delivering performance feedback to teachers using technology-based observation and coaching tools. Intervention in School and Clinic, 55(2), 103–112. https://doi.org/10.1177/1053451219837640 · DOI
  32. Russ, R. S. (2018). Characterizing teacher attention to student thinking: A role for epistemological messages. Journal of Research in Science Teaching, 55(1), 94–120. https://doi.org/10.1002/tea.21414 · DOI
  33. Rybinski, K., & Kopciuszewska, E. (2021). Will artificial intelligence revolutionise the student evaluation of teaching? A big data study of 1.6 million student reviews. Assessment and Evaluation in Higher Education, 46, 1127–1139. https://doi.org/10.1080/02602938.2020.1844866 · DOI
  34. Slater, D. R., & Davies, R. (2020). Student preferences for learning resources on a land-based postgraduate online degree programme. Online Learning Journal, 24(1), 140–161.
  35. Slavin, R. E., & Lake, C. (2008). Effective programs in elementary mathematics: A best-evidence synthesis. Review of Educational Research, 78(3), 427–515. https://doi.org/10.3102/0034654308317473 · DOI · Paper page
  36. Smith, C. D., & Baik, C. (2021). High-impact teaching practices in higher education: A best evidence review. Studies in Higher Education, 46(8), 1696–1713. https://doi.org/10.1080/03075079.2019.1698539 · DOI
  37. Steen-Utheim, A., & Wittek, A. L. (2017). Dialogic feedback and potentialities for student learning. Learning, Culture and Social Interaction, 15, 18–30. https://doi.org/10.1016/j.lcsi.2017.06.002 · DOI
  38. Tronchoni, H., Izquierdo, C., & Anguera, M. T. (2021). Regulación de la interacción participativa en clases universitarias expositivas. Propuesta formativa co-constructiva basada en la metodología observacional como estrategia mixed methods. Publicaciones, 52(2), 89–110. https://doi.org/10.30827/publicaciones.v52i2.20751 · doi:10.30827/publicaciones.v52i2.20751
  39. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit Jakob and Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention Is All You Need. In I. Guyon, U. V Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017) (Vol. 30).
  40. Vercellotti, M. L. (2018). Do interactive learning spaces increase student achievement? A comparison of classroom context. Active Learning in Higher Education, 19(3), 197–210. https://doi.org/10.1177/1469787417735606 · DOI
  41. Yang, F. Y., & Tsai, C. C. (2008). Investigating university student preferences and beliefs about learning in the web-based context. Computers and Education, 50(4), 1284–1303. https://doi.org/10.1016/j.compedu.2006.12.009 · DOI
  42. Zhou, J., & Ye, J. M. (2020). Sentiment analysis in education research: a review of journal publications. Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1826985 · DOI · Paper page

Cited by

See all 47

Metadata

Authors
Álvarez-Álvarez, C., & Falcon, S.
Venue
Educational technology research and development
Published
2023-05-16
Volume
71
Issue
4
Pages
1709-1724
ISSN
  • 1042-1629 (ISSN-L)
  • 1556-6501
OpenAlex
W4376891311
Cited by
47
References
11
FWCI
34.84
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
  • Universidad de Cantabria
  • Universidad de las Palmas de Gran Canaria

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence. https://app.cochat.ai/papers/10.1007/s11423-023-10239-8
The paper
Álvarez-Álvarez, C., & Falcon, S. (2023). Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence. Educational technology research and development. https://doi.org/10.1007/s11423-023-10239-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.