The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective
Open accessAbstract
By collecting longitudinal learner and learning data from a range of resources, predictive learning analytics (PLA) are used to identify learners who may not complete a course, typically described as being at risk. Mixed effects are observed as to how teachers perceive, use, and interpret PLA data, necessitating further research in this direction. The aim of this study is to evaluate whether providing teachers in a distance learning higher education institution with PLA data predicts students’ performance and empowers teachers to identify and assist students at risk. Using principles of Technology Acceptance and Academic Resistance models, a university-wide, multi-methods study with 59 teachers, nine courses, and 1325 students revealed that teachers can positively affect students’ performance when engaged with PLA. Follow-up semi-structured interviews illuminated teachers’ actual uses of the predictive data and revealed its impact on teaching practices and intervention strategies to support students at risk.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Piderit, S. K. (2000) · The Academy of Management Review · doi:10.5465/amr.2000.3707722 · Cited by 1,873
The current landscape of learning analytics in higher education
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.027 · Cited by 766
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449
Self-citationDesigning Randomised Trials in Health, Education and the Social Sciences
Torgerson, D. J., & Torgerson, C. J. (2008) · doi:10.1057/9780230583993 · Cited by 366
Bodily, R., & Verbert, K. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2740172 · Cited by 306
Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.028 · Cited by 147
Self-citation
Research works printed but not linked: 52
- Ali, L., Asadi, M., Gašević, D., Jovanović, J., & Hatala, M. (2013). Factors influencing beliefs for adoption of a learning analytics tool: An empirical study. Computers & Education, 62, 130–148. https://doi.org/10.1016/j.compedu.2012.10.023 . · DOI
- Ali, L., Hatala, M., Gašević, D., & Jovanović, J. (2012). A qualitative evaluation of evolution of a learning analytics tool. Computers & Education, 58(1), 470–489. https://doi.org/10.1016/j.compedu.2011.08.030 . · DOI · Paper page
- Arbaugh, J. B. (2014). System, scholar, or students? Which most influences online MBA course effectiveness? Journal of Computer Assisted Learning, 30(4), 349–362. https://doi.org/10.1111/jcal.12048 . · DOI
- Boyatzis, R. E. (1998). Transforming qualitative information: Thematic analysis and code development. Thousand Oaks: Sage.
- Calvert, C. (2014). Developing a model and applications for probabilities of student success: A case study of predictive analytics. Open Learning: The Journal of Open, Distance and e-Learning, 29(2), 160–173. https://doi.org/10.1080/02680513.2014.931805 . · DOI
- Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1002. · DOI · Paper page
- Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and implementation of a learning analytics toolkit for teachers. Journal of Educational Technology & Society, 15(3), 58–76.
- Ferguson, R., & Buckingham Shum, S. (2012). Social learning analytics: Five approaches. Paper presented at the 2nd International Conference on learning analytics and knowledge, Vancouver, British Columbia. · DOI · Paper page
- Gasevic, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicating learning success. Internet and Higher Education, 28, 68–84. https://doi.org/10.1016/j.iheduc.2015.10.002 . · DOI · Paper page
- Gasevic, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. https://doi.org/10.1007/s11528-014-0822-x . · DOI · Paper page
- Gliner, J. A., Morgan, G. A., & Leech, N. L. (2011). Research methods in applied settings: An integrated approach to design and analysis. London: Routledge. · DOI
- González-Torres, A., García-Peñalvo, F. J., & Therón, R. (2013). Human–computer interaction in evolutionary visual software analytics. Computers in Human Behavior, 29(2), 486–495. https://doi.org/10.1016/j.chb.2012.01.013 . · DOI
- Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology and Society, 15(3), 42.
- Gutiérrez, F., Seipp, K., Ochoa, X., Chiluiza, K., Laet, T. De, & Verbert, K. (2018). LADA: A learning analytics dashboard for academic advising. Computers in Human Behavior. https://doi.org/10.1016/j.chb.2018.12.004 . · DOI
- Hachey, A. C., Wladis, C. W., & Conway, K. M. (2014). Do prior online course outcomes provide more information than G.P.A. alone in predicting subsequent online course grades and retention? An observational study at an urban community college. Computers & Education, 72, 59–67. https://doi.org/10.1016/j.compedu.2013.10.012 . · DOI
- Hanson, J. (2009). Displaced but not replaced: The impact of e-learning on academic identities in higher education. Teaching in Higher Education, 14(5), 553–564. https://doi.org/10.1080/13562510903186774 . · DOI
- Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., Hlosta, M., & Naydenova, G. (2017). Implementing predictive learning analytics on a large scale: The teacher’s perspective. Paper presented at the Proceedings of the Seventh International learning analytics & knowledge conference, Vancouver, British Columbia. · DOI
- Herodotou, C., Rienties, B., Verdin, B., & Boroowa, A. (2019). Predictive learning analytics ‘at scale’: Guidelines to successful implementation in higher education. Journal of Learning Analytics, 6(1), 85–95. · DOI
- Joksimović, S., Gašević, D., Loughin, T. M., Kovanović, V., & Hatala, M. (2015). Learning at distance: Effects of interaction traces on academic achievement. Computers & Education, 87, 204–217. https://doi.org/10.1016/j.compedu.2015.07.002 . · DOI · Paper page
- Kuzilek, J., Hlosta, M., Herrmannova, D., Zdrahal, Z., & Wolff, A. (2015). OU analyse: Analysing at-risk students at The Open University. Learning Analytics Review, LAK15–1, pp. 1–16.
- Kvale, S. (1996). Interviews: An introduction to qualitative research interviewing. London: SAGE Publications.
- Liu, F., & Cavanaugh, C. (2012). Factors influencing student academic performance in online high school algebra. Open Learning: The Journal of Open, Distance and e-Learning, 27(2), 149–167. https://doi.org/10.1080/02680513.2012.678613 . · DOI
- Ma, J., Han, X., Yang, J., & Cheng, J. (2015). Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor. The Internet and Higher Education, 24, 26–34. https://doi.org/10.1016/j.iheduc.2014.09.005 . · DOI · Paper page
- Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008 . · DOI · Paper page
- Mazzolini, M., & Maddison, S. (2003). Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums. Computers & Education, 40(3), 237–253. · DOI · Paper page
- McKenney, S., & Mor, Y. (2015). Supporting teachers in data-informed educational design. British Journal of Educational Technology, 46(2), 265–279. https://doi.org/10.1111/bjet.12262 . · DOI
- Mor, Y., Ferguson, R., & Wasson, B. (2015). Editorial: Learning design, teacher inquiry into student learning and learning analytics: A call for action. British Journal of Educational Technology, 46(2), 221–229. https://doi.org/10.1111/bjet.12273 . · DOI · Paper page
- Norton, L., Richardson, T., Hartley, J., Newstead, S., & Mayes, J. (2005). Teachers’ beliefs and intentions concerning teaching in higher education. Higher Education, 50(4), 537–571. · DOI · Paper page
- Papamitsiou, Z., & Economides, A. (2014). Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence. Educational Technology & Society, 17(4), 49–64.
- Pituch, K. A., & Lee, Y.-K. (2006). The influence of system characteristics on e-learning use. Computers & Education, 47(2), 222–244. https://doi.org/10.1016/j.compedu.2004.10.007 . · DOI · Paper page
- Pynoo, B., Devolder, P., Tondeur, J., van Braak, J., Duyck, W., & Duyck, P. (2011). Predicting secondary school teachers’ acceptance and use of a digital learning environment: A cross-sectional study. Computers in Human Behavior, 27(1), 568–575. https://doi.org/10.1016/j.chb.2010.10.005 . · DOI · Paper page
- Richardson, J. T. E. (2013). Approaches to studying across the adult life span: Evidence from distance education. Learning and Individual Differences, 26, 74–80. https://doi.org/10.1016/j.lindif.2013.04.012 . · DOI
- Rienties, B. (2014). Understanding academics’ resistance towards (online) student evaluation. Assessment & Evaluation in Higher Education, 39(8), 987–1001. https://doi.org/10.1080/02602938.2014.880777 . · DOI
- Rienties, B., Boroowa, A., Cross, S., Kubiak, C., Mayles, K., & Murphy, S. (2016a). Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at Open University UK. Journal of Interactive Media in Education, 1(2), 1–12. https://doi.org/10.5334/jime.394 . · DOI
- Rienties, B., Brouwer, N., & Lygo-Baker, S. (2013). The effects of online professional development on higher education teachers’ beliefs and intentions towards learning facilitation and technology. Teaching and Teacher Education, 29, 122–131. https://doi.org/10.1016/j.tate.2012.09.002 . · DOI · Paper page
- Rienties, B., Cross, S., & Zdrahal, Z. (2016b). Implementing a learning analytics intervention and evaluation framework: What works? In B. K. Daniel (Ed.), Big data and learning analytics in higher education: Current theory and practice (pp. 147–166). Heidelberg: Springer.
- Rienties, B., Giesbers, S., Lygo-Baker, S., Ma, S., & Rees, R. (2016c). Why some teachers easily learn to use a new virtual learning environment: A technology acceptance perspective. Interactive Learning Environments, 24(3), 539–552. https://doi.org/10.1080/10494820.2014.881394 . · DOI
- Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. The International Review of Research in Open and Distributed Learning. https://doi.org/10.19173/irrodl.v19i5.3493 . · DOI
- Rienties, B., & Toetenel, L. (2016). The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules. Computers in Human Behavior, 60, 333–341. https://doi.org/10.1016/j.chb.2016.02.074 . · DOI · Paper page
- Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013). Predicting students’ final performance from participation in on-line discussion forums. Computers & Education, 68, 458–472. https://doi.org/10.1016/j.compedu.2013.06.009 . · DOI · Paper page
- Sanchez-Franco, M. J. (2010). WebCT—The quasimoderating effect of perceived affective quality on an extending technology acceptance model. Computers & Education, 54(1), 37–46. https://doi.org/10.1016/j.compedu.2009.07.005 . · DOI · Paper page
- Simpson, O. (2013). Supporting students for success in online and distance education. New York: Routledge. · DOI
- Šumak, B., Heričko, M., & Pušnik, M. (2011). A meta-analysis of e-learning technology acceptance: The role of user types and e-learning technology types. Computers in Human Behavior, 27(6), 2067–2077. https://doi.org/10.1016/j.chb.2011.08.005 . · DOI · Paper page
- Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414–2422. https://doi.org/10.1016/j.compedu.2011.05.016 . · DOI
- Teo, T. (2010). A path analysis of pre-service teachers’ attitudes to computer use: Applying and extending the technology acceptance model in an educational context. Interactive Learning Environments, 18(1), 65–79. https://doi.org/10.1080/10494820802231327 . · DOI · Paper page
- Teo, T., & Zhou, M. (2016). The influence of teachers’ conceptions of teaching and learning on their technology acceptance. Interactive Learning Environments. https://doi.org/10.1080/10494820.2016.1143844 . · DOI
- van Leeuwen, A. (2018). Teachers’ perceptions of the usability of learning analytics reports in a flipped university course: When and how does information become actionable knowledge? Educational Technology Research and Development. https://doi.org/10.1007/s11423-018-09639-y . · DOI
- van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education, 79, 28–39. https://doi.org/10.1016/j.compedu.2014.07.007 . · DOI
- van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education, 90, 80–94. https://doi.org/10.1016/j.compedu.2015.09.006 . · DOI
- Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500–1509. https://doi.org/10.1177/0002764213479363 . · DOI · Paper page
- Wolff, A., Zdrahal, Z., Herrmannova, D., Kuzilek, J., & Hlosta, M. (2014). Developing predictive models for early detection of at-risk students on distance learning modules, Workshop: machine learning and learning analytics. Paper presented at the learning analytics and knowledge (2014), Indianapolis.
- Wolff, A., Zdrahal, Z., Nikolov, A., & Pantucek, M. (2013). Improving retention: Predicting at-risk students by analysing clicking behaviour in a virtual learning environment. Paper presented at the Proceedings of the Third International Conference on learning analytics and knowledge, Indianapolis. · DOI · Paper page
Cited by
Rane, N. L. (2026) · Journal of Artificial Intelligence and Robotics · doi:10.61577/jaiar.2024.100006 · Cited by 278
Learning analytics in European higher education—Trends and barriers
Tsai, Y.-S., Rates, D., Moreno-Marcos, P. M., Muñoz-Merino, P. J., Jivet, I., Scheffel, M., Drachsler, H., Delgado Kloos, C., & Gašević, D. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103933 · Cited by 192
Okoye, K., Arrona-Palacios, A., Camacho-Zuñiga, C., Achem, J. A. G., Escamilla, J., & Hosseini, S. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10751-5 · Cited by 112
The equalizing effect of teacher dashboards on feedback in K-12 classrooms
Knoop-van Campen, C. A. N., Wise, A., & Molenaar, I. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1931346 · Cited by 58
Pozdniakov, S., Martinez-Maldonado, R., Tsai, Y.-S., Echeverria, V., Srivastava, N., & Gasevic, D. (2023) · LAK23: 13th International Learning Analytics and Knowledge Conference · doi:10.1145/3576050.3576063 · Cited by 44
Metadata
- Authors
- Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M.
- Venue
- Educational Technology Research and Development
- Published
- 2019-07-02
- Volume
- 67
- Issue
- 5
- Pages
- 1273-1306
- ISSN
- 1042-1629 (ISSN-L)
- 1556-6501
- OpenAlex
- W2954911846
- Cited by
- 186
- References
- 8
- FWCI
- 20.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective. https://app.cochat.ai/papers/10.1007/s11423-019-09685-0
- The paper
- Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective. Educational Technology Research and Development. https://doi.org/10.1007/s11423-019-09685-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.