Neurophysiological Measurements in Higher Education: A Systematic Literature Review
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
The use of neurophysiological measurements to advance the design, development, use, acceptance, influence and adaptivity of information systems is receiving increasing attention. Within the field of education, neurophysiological measurements have commonly been used to capture a learner’s psychological constructs such as cognitive load, attention and emotion, which play an important role in student learning. This paper systematically examines the literature on the use of neurophysiological measurements in higher education. In particular, using a well-established Systematic Literature Review (SLR) method, we identified 83 papers reporting empirical evidence about the outcome of employing neurophysiological measurements within educational technologies in higher education. The findings of the SLR are divided into three main themes discussing the employed measurements, experimental settings and constructs and outcomes. Our findings identify that (1) electroencephalography and facial expression recognition are the dominantly employed types of measurement, (2) the majority of the experiments used a pre-experimental design, (3) attention and emotion are the two foremost cognitive and non-cognitive constructs under investigation, while less emphasis is paid to meta-cognitive constructs and (4) the reported results mostly focus on monitoring learners’ states, which are not always the same as the intended purpose, such as developing an adaptive system. On a broader term, the review of the literature provides evidence of the effective use of neurophysiological measurements by educational technologies to enhance learning; however, a number of challenges and concerns related to the accuracy and validity of the captured construct, the intrusiveness of the employed instruments as well as ethical and privacy considerations have surfaced, that need to be addressed before such technologies can be employed and adopted at scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 1×
“Thesnowballing approach of Wohlin (2014), was applied to the remaining 57 papers.”
MethodA manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Scherer, R., Siddiq, F., & Tondeur, J. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.09.009 · Cited by 1,923
So, H.-J., & Brush, T. A. (2008) · Computers & Education · doi:10.1016/j.compedu.2007.05.009 · Cited by 1,221
Let’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049
Measuring student engagement in technology-mediated learning: A review
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.09.005 · Cited by 1,010
Modelling technology acceptance in education: A study of pre-service teachers
Teo, T. (2009) · Computers & Education · doi:10.1016/j.compedu.2008.08.006 · Cited by 1,009 · cited 2×
“…with the intrusiveness and the influence of technical support on students’ satisfaction, as an important variable in technology acceptance model (Teo 2009), would promote the perceived ease of use whereas the ethical consideration and privacy would enhance the attitudes toward neuro…”
BackgroundBeldarrain, Y. (2006) · Distance Education · doi:10.1080/01587910600789498 · Cited by 866 · cited 1×
“In particular, educational technologies have been used to promote collaboration (Beldarrain 2006; Money and Dean 2019; So and Brush 2008), introduce gamification to education (Dicheva et al. 2015), provide better access and inquiry to learning resources (Hill and Hannafin 2001; MacKay 2019),…”
MethodXie, H., Chu, H.-C., Hwang, G.-J., & Wang, C.-C. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103599 · Cited by 713 · cited 1×
“Xie et al. (2019) highlight that using wearable devices in learning environments is not common due to the lack of up-to-date IT skills and knowledge.”
BackgroundBanaee, H., Ahmed, M., & Loutfi, A. (2013) · Sensors · doi:10.3390/s131217472 · Cited by 452
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449
Using learning analytics to scale the provision of personalised feedback
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12592 · Cited by 425
A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity
Hardeman, W., Houghton, J., Lane, K., Jones, A., & Naughton, F. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0792-7 · Cited by 396
Just-in-the-Moment Adaptive Interventions (JITAI): A Meta-Analytical Review
Wang, L., & Miller, L. C. (2020) · Health Communication · doi:10.1080/10410236.2019.1652388 · Cited by 264
Getting Off the “Gold Standard”: Randomized Controlled Trials and Education Research
Sullivan, G. M. (2011) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-11-00147.1 · Cited by 243
Yuksel, B. F., Oleson, K. B., Harrison, L., Peck, E. M., Afergan, D., Chang, R., & Jacob, R. J. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858388 · Cited by 137 · cited 2×
“In addition, studies that have used terms such as cognitive states (*Hubbard et al. 2017; *Pham and Wang 2015), cognitive activity (*Qu et al. 2018a; *Zlokazov et al. 2017), and cognitive workload (*Harrison et al. 2014; *Mannaru et al. 2016; *Yuksel et al. 2016) are grouped in this category.”
BackgroundRiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities
Khosravi, H., Kitto, K., & Williams, J. J. (2019) · arXiv · doi:10.48550/arxiv.1910.05522 · Cited by 81
Self-citationHarrison, J., Izzetoglu, K., Ayaz, H., Willems, B., Hah, S., Ahlstrom, U., Woo, H., Shewokis, P. A., Bunce, S. C., & Onaral, B. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2014.2319822 · Cited by 71
Money, W. H., & Dean, B. P. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.03.013 · Cited by 53
Zhai, X., Fang, Q., Dong, Y., Wei, Z., Yuan, J., Cacciolatti, L., & Yang, Y. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12284 · Cited by 26 · cited 4×
“For example, *Zhai et al. (2018) recruited 106 participants; however, the number of participants is just reported for the experimental group with 54 students that neuro measurement was administered.”
BackgroundInfluential
Cited by
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852
“…with persistent challenges and new dilemmas such as ensuring ethical use (Holmes et al., 2021), enhancing system transparency and explainability (Khosravi et al., 2022), and navigating the pedagogical implications of increasingly autonomous AI systems in educational settings (Han et al., 2023).”
BackgroundSelf-citationImpact of AI assistance on student agency
Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104967 · Cited by 548
Self-citationIncorporating AI and learning analytics to build trustworthy peer assessment systems
Darvishi, A., Khosravi, H., Sadiq, S., & Gašević, D. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13233 · Cited by 120
Self-citationIncorporating Training, Self-monitoring and AI-Assistance to Improve Peer Feedback Quality
Darvishi, A., Khosravi, H., Abdi, S., Sadiq, S., & Gašević, D. (2022) · Proceedings of the Ninth ACM Conference on Learning @ Scale · doi:10.1145/3491140.3528265 · Cited by 31
Self-citation
Metadata
- Authors
- Darvishi, A., Khosravi, H., Sadiq, S., & Weber, B.
- Venue
- International Journal of Artificial Intelligence in Education
- Published
- 2021-06-16
- Volume
- 32
- Issue
- 2
- Pages
- 413-453
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W3172063946
- Cited by
- 37
- References
- 24
- FWCI
- 0.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.