Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
University teaching practices impact student interest, engagement, and academic performance. This paper presents a study that uses artificial intelligence (AI) to examine students’ preferences for university teaching practices. We asked students in various fields open-ended questions about the best teaching practices they had experienced. Due to the large amount of data obtained, we used the AI-based language model Generative Pretrained Transformer-3 (GPT-3) to analyse the responses. With this model, we sorted students’ testimonies into nine theory-based categories regarding teaching practices. After analysing the reliability of the classifications conducted by GPT-3, we found that the agreement between humans was similar to that observed between humans and the AI model, which supported its reliability. Regarding students’ preferences for teaching practices, the results showed that students prefer practices that focus on (1) clarity and (2) interaction and relationships. These results enable the use of AI-based tools that facilitate the analysis of large amounts of information collected through open methods. At the didactic level, students’ preferences and demand for clear teaching practices (in which ideas and activities are stated and shown without ambiguity) that are based on interaction and relationships (between teachers and students and among students themselves) are demonstrable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“We used the GPT-3 model (Brown et al., 2020) to code the responses to our open-ended question.”
MethodMixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 2×
“Between these two approaches, the use of open collection methods such as open-ended questions or interviews facilitates a better expression of ideas among students, allowing researchers to gain a deeper understanding of the relevant issue (Johnson & Onwuegbuzie, 2004).”
BackgroundToward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines
O’Connor, C., & Joffe, H. (2020) · International Journal of Qualitative Methods · doi:10.1177/1609406919899220 · Cited by 3,871
Hattie, J. (2008) · doi:10.4324/9780203887332 · Cited by 3,051
GPT-3: Its Nature, Scope, Limits, and Consequences
Floridi, L., & Chiriatti, M. (2020) · Minds and Machines · doi:10.1007/s11023-020-09548-1 · Cited by 2,519
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591 · cited 3×
“Despite the novelty of these models, several authors have already expressed a need to use them in the execution of tasks such as the coding of large amounts of information to then study their reliability (Qiu et al., 2020).”
BackgroundInfluential‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures
Callaway, E. (2020) · Nature · doi:10.1038/d41586-020-03348-4 · Cited by 499 · cited 1×
“This is especially notable in biology, where the development of AlphaFold 2, an AI-based tool capable of predicting the three-dimensional structure of proteins, has been a milestone (Callaway, 2020; Jumper et al., 2021).”
Background
Research works printed but not linked: 42
- Alegre, O. M., & Villar, L. M. (2017). Indicadores y control estadístico para el seguimiento y evaluación de preferencias de aprendizaje de estudiantes universitarios. Revista De Educación a Distancia (RED). https://doi.org/10.6018/red/55/2 · DOI
- Álvarez-Álvarez, C., Sánchez-Ruiz, L., Sarabia Cobo, C., & Montoya-del Corte, J. (2022). Validación de un cuestionario para la evaluación de la interacción en la enseñanza universitaria. REDU. Revista De Docencia Universitaria, 20(1), 145–160. https://doi.org/10.4995/redu.2022.15918 · DOI
- Ambrose, S. A., Bridges, M. W., Dipietro, M., Lovett, M. C., Norman, M. K., & Mayer, R. E. (2010). 7 research-based principles for smart teaching (1st ed.). John Wiley.
- Aridah, A., Atmowardoyo, H., & Salija, K. (2017). Teacher practices and students’ preferences for written corrective feedback and their implications on writing instruction. International Journal of English Linguistics, 7(1), 112. https://doi.org/10.5539/ijel.v7n1p112 · doi:10.5539/ijel.v7n1p112
- Brownell, C. A., Svetlova, M., Anderson, R., Nichols, S. R., & Drummond, J. (2013). Socialization of early prosocial behavior: parents’ talk about emotions is associated with sharing and helping in toddlers. Infancy, 18(1), 91–119. https://doi.org/10.1111/j.1532-7078.2012.00125.x · DOI · Paper page
- Callaway, E. (2022). What’s next for AlphaFold and the AI protein-folding revolution. Nature, 604, 234–238. · DOI · Paper page
- Carr, R., Palmer, S., & Hagel, P. (2015). Active learning: The importance of developing a comprehensive measure. Active Learning in Higher Education, 16(3), 173–186. https://doi.org/10.1177/1469787415589529 · DOI · Paper page
- Chalmers, C., Mowat, E., & Chapman, M. (2018). Marking and providing feedback face-to-face: Staff and student perspectives. Active Learning in Higher Education, 19(1), 35–45. https://doi.org/10.1177/1469787417721363 · DOI
- Cohen, L., Manion, L., & Morrison, K. (2000). Research methods in education (5th ed.). Routledge.
- Falcon, S., Admiraal, W., & Leon, J. (2023). Teachers’ engaging messages and the relationship with students’ performance and teachers’ enthusiasm. Learning and Instruction, 86, 101750. https://doi.org/10.1016/j.learninstruc.2023.101750 · DOI
- Freelon, D. G. (2010). ReCal: Intercoder reliability calculation as a web service. International Journal of Internet Science, 1, 20–33.
- Geng, S., Niu, B., Feng, Y., & Huang, M. (2020). Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach. British Journal of Educational Technology, 51(5), 1785–1803. https://doi.org/10.1111/bjet.12999 · DOI
- Harbour, K. E., Evanovich, L. L., Sweigart, C. A., & Hughes, L. E. (2015). A brief review of effective teaching practices that maximize student engagement. Preventing School Failure, 59(1), 5–13. https://doi.org/10.1080/1045988X.2014.919136 · DOI
- Hardman, J. (2016). Tutor–student interaction in seminar teaching: Implications for professional development. Active Learning in Higher Education, 17(1), 63–76. https://doi.org/10.1177/1469787415616728 · DOI
- Hills, C., Levett-Jones, T., Warren-Forward, H., & Lapkin, S. (2016). Teaching and learning preferences of ‘Generation Y’ occupational therapy students in practice education. International Journal of Therapy and Rehabilitation, 23(8), 371–379. https://doi.org/10.12968/ijtr.2016.23.8.371 · doi:10.12968/ijtr.2016.23.8.371
- Hynninen, T., Knutas, A., Hujala, M., & Arminen, H. (2019). Distinguishing the themes emerging from masses of open student feedback. 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2019 - Proceedings, 557–561. https://doi.org/10.23919/MIPRO.2019.8756781 · DOI
- King, E., & La Paro, K. (2015). Teachers’ language in interactions: An exploratory examination of mental state talk in early childhood education classrooms. Early Education and Development, 26(2), 245–263. https://doi.org/10.1080/10409289.2015.989029 · DOI
- Könings, K. D., Brand-Gruwel, S., & van Merriënboer, J. J. G. (2011). The match between students’ lesson perceptions and preferences: Relations with student characteristics and the importance of motivation. Educational Research, 53(4), 439–457. https://doi.org/10.1080/00131881.2011.625155 · DOI
- Leong, C. K., Lee, Y. H., & Mak, W. K. (2012). Mining sentiments in SMS texts for teaching evaluation. Expert System Application, 39, 2584–2589. https://doi.org/10.1016/j.eswa.2011.08.113 · DOI
- Lodico, M. G., Spaulding, D. T., & Voegtle, K. H. (2010). Methods in educational research: From theory to practice (Vol. 28). John Wiley.
- Macfayden, L. P., Chase, M. M., Reeder, K., & Roche, J. (2003). Matches and mismatches in intercultural learning: design and facilitation of an online intercultural course. UNESCO Conference on Intercultural Education, 15–18.
- Marsh, H. W. (1994). Sport motivation orientations: Beware of jingle-jangle fallacies. Journal of Sport & Exercise Psychology, 16(4), 365–380. · DOI · Paper page
- Marsh, H. W., Craven, R. G., Hinkley, J. W., & Debus, R. L. (2003). Evaluation of the Big-Two-Factor theory of academic motivation orientations: An evaluation of jingle-jangle fallacies. Multivariate Behavioral Research, 38(2), 189–224. https://doi.org/10.1207/S15327906MBR3802_3 · DOI · Paper page
- Minhas, P. S., Ghosh, A., & Swanzy, L. (2012). The effects of passive and active learning on student preference and performance in an undergraduate basic science course. Anatomical Sciences Education, 5(4), 200–207. https://doi.org/10.1002/ase.1274 · DOI
- Moliní Fernández, F., & Sánchez-González, D. (2019). Fomentar la participación en clase de los estudiantes universitarios y evaluarla. REDU. Revista De Docencia Universitaria, 17(1), 211. https://doi.org/10.4995/redu.2019.10702 · DOI
- Opdecam, E., Everaert, P., Van Keer, H., & Buysschaert, F. (2014). Preferences for team learning and lecture-based learning among first-year undergraduate accounting students. Research in Higher Education, 55(4), 400–432. https://doi.org/10.1007/s11162-013-9315-6 · DOI
- Pong-inwong, C., & Songpan, W. (2019). Sentiment analysis in teaching evaluations using sentiment phrase pattern matching (SPPM) based on association mining. International Journal of Machine Learning and Cybernetics, 10(8), 2177–2186. https://doi.org/10.1007/s13042-018-0800-2 · DOI
- Rahman, M. S. (2016). The advantages and disadvantages of using qualitative and quantitative approaches and methods in language “testing and assessment” research: A literature review. Journal of Education and Learning, 6(1), 102. https://doi.org/10.5539/jel.v6n1p102 · DOI · Paper page
- Rani, S., & Kumar, P. (2017). A sentiment analysis system to improve teaching and learning. Advances in Learning Technologies. https://doi.org/10.1109/MC.2017.133 · DOI · Paper page
- Roberts, D. (2019). Higher education lectures: From passive to active learning via imagery? Active Learning in Higher Education, 20(1), 63–77. https://doi.org/10.1177/1469787417731198 · DOI
- Rodgers, W. J., Kennedy, M. J., VanUitert, V. J., & Myers, A. M. (2019). Delivering performance feedback to teachers using technology-based observation and coaching tools. Intervention in School and Clinic, 55(2), 103–112. https://doi.org/10.1177/1053451219837640 · DOI
- Russ, R. S. (2018). Characterizing teacher attention to student thinking: A role for epistemological messages. Journal of Research in Science Teaching, 55(1), 94–120. https://doi.org/10.1002/tea.21414 · DOI
- Rybinski, K., & Kopciuszewska, E. (2021). Will artificial intelligence revolutionise the student evaluation of teaching? A big data study of 1.6 million student reviews. Assessment and Evaluation in Higher Education, 46, 1127–1139. https://doi.org/10.1080/02602938.2020.1844866 · DOI
- Slater, D. R., & Davies, R. (2020). Student preferences for learning resources on a land-based postgraduate online degree programme. Online Learning Journal, 24(1), 140–161.
- Slavin, R. E., & Lake, C. (2008). Effective programs in elementary mathematics: A best-evidence synthesis. Review of Educational Research, 78(3), 427–515. https://doi.org/10.3102/0034654308317473 · DOI · Paper page
- Smith, C. D., & Baik, C. (2021). High-impact teaching practices in higher education: A best evidence review. Studies in Higher Education, 46(8), 1696–1713. https://doi.org/10.1080/03075079.2019.1698539 · DOI
- Steen-Utheim, A., & Wittek, A. L. (2017). Dialogic feedback and potentialities for student learning. Learning, Culture and Social Interaction, 15, 18–30. https://doi.org/10.1016/j.lcsi.2017.06.002 · DOI
- Tronchoni, H., Izquierdo, C., & Anguera, M. T. (2021). Regulación de la interacción participativa en clases universitarias expositivas. Propuesta formativa co-constructiva basada en la metodología observacional como estrategia mixed methods. Publicaciones, 52(2), 89–110. https://doi.org/10.30827/publicaciones.v52i2.20751 · doi:10.30827/publicaciones.v52i2.20751
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit Jakob and Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention Is All You Need. In I. Guyon, U. V Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017) (Vol. 30).
- Vercellotti, M. L. (2018). Do interactive learning spaces increase student achievement? A comparison of classroom context. Active Learning in Higher Education, 19(3), 197–210. https://doi.org/10.1177/1469787417735606 · DOI
- Yang, F. Y., & Tsai, C. C. (2008). Investigating university student preferences and beliefs about learning in the web-based context. Computers and Education, 50(4), 1284–1303. https://doi.org/10.1016/j.compedu.2006.12.009 · DOI
- Zhou, J., & Ye, J. M. (2020). Sentiment analysis in education research: a review of journal publications. Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1826985 · DOI · Paper page
Cited by
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023) · Sustainability · doi:10.3390/su151712983 · Cited by 784
“Karaali (2023) [147], Lawrie (2023) [148], Robertson and Muirhead (2022) [149], Á lvarez-Á lvarez and Falcon (2023) [150].”
BackgroundCai, L., Msafiri, M. M., & Kangwa, D. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13112-0 · Cited by 104
The Impact of AI on the Personal and Collaborative Learning Environments in Higher Education
Msambwa, M. M., Wen, Z., & Daniel, K. (2025) · European Journal of Education · doi:10.1111/ejed.12909 · Cited by 76
Daniel, K., Msambwa, M. M., & Wen, Z. (2025) · European Journal of Education · doi:10.1111/ejed.70036 · Cited by 71
Marchena Sekli, G., Godo, A., & Carlos Véliz, J. (2024) · Journal of Information Technology Education: Research · doi:10.28945/5304 · Cited by 53
Metadata
- Authors
- Álvarez-Álvarez, C., & Falcon, S.
- Venue
- Educational technology research and development
- Published
- 2023-05-16
- Volume
- 71
- Issue
- 4
- Pages
- 1709-1724
- ISSN
- 1042-1629 (ISSN-L)
- 1556-6501
- OpenAlex
- W4376891311
- Cited by
- 47
- References
- 11
- FWCI
- 34.84
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Universidad de Cantabria
- Universidad de las Palmas de Gran Canaria
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence. https://app.cochat.ai/papers/10.1007/s11423-023-10239-8
- The paper
- Álvarez-Álvarez, C., & Falcon, S. (2023). Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence. Educational technology research and development. https://doi.org/10.1007/s11423-023-10239-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.