Instruction, Student Engagement, and Learning Outcomes: A Case Study Using Anonymous Social Media in a Face-to-Face Classroom
Open accessThe DOI matches its Crossref record; 69 of the 87 references it cites were found in a registry or an index.
Abstract
With the wide availability of mobile devices and the growing interest in social media, numerous applications have emerged to support student engagement in the classroom. There is conflicting evidence, however, on whether the engagement benefits of such applications outweigh their potential cost as a source of disaffection. To investigate these issues, this article presents a case study on the usage of a social media app (SpeakUp) during a semester-long face-to-face university course, and its relations with the context and the learning outcomes. In this mixed-methods study, we gathered data from multiple sources (video recordings of the lessons, SpeakUp logs and messages, student questionnaires, and course assessments) in order to extract self-reported and observable behavioral and emotional indicators. Our findings reveal that simple measures of behavioral engagement were insufficient to predict academic performance. Nevertheless, our models significantly improved using relatively simple and unobtrusive indicators of both behavioral and emotional engagement and disaffection. This article also indicates that the mere introduction of social media in educational settings does not guarantee a positive impact on learning. To promote an effective use of social media in the classroom (raising engagement while avoiding disaffection), teachers need to design the learning activities aligning the use of social media with the learning goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Art of Case Study Research
Johnson, K. E., & Stake, R. E. (1996) · The Modern Language Journal · doi:10.2307/329758 · Cited by 15,826
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 6×
“6) Engagement and disaffection are multidimensional constructs that require thorough analysis [15], [19], [28], [29]: This study extracts indicators related to behavioral and emotional dimensions of engagement and disaffection that go beyond single behavior variables (see Fig.”
BackgroundResultInfluentialMixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1×
“A. Informants, Data Gathering, and Data Sources Aligned with the trends in technology-enhanced learning research [61] and the case-study methodology [21], we used mixed methods [62], [63] in order to look at our questions from different perspectives.”
MethodCriteria for assessing the trustworthiness of naturalistic inquiries
Guba, E. G. (1981) · ECTJ · doi:10.1007/bf02766777 · Cited by 5,527
Student Involvement: A Developmental Theory for Higher Education
Astin, A. W. (2014) · Routledge eBooks · doi:10.4324/9781315051888-15 · Cited by 5,265
Social media? Get serious! Understanding the functional building blocks of social media
Kietzmann, J. H., Hermkens, K., McCarthy, I. P., & Silvestre, B. S. (2011) · Business Horizons · doi:10.1016/j.bushor.2011.01.005 · Cited by 4,970
Engagement and disaffection in the classroom: Part of a larger motivational dynamic?
Skinner, E., Furrer, C., Marchand, G., & Kindermann, T. (2008) · Journal of Educational Psychology · doi:10.1037/a0012840 · Cited by 2,037
Student engagement literature review
Trowler, V. (2010) · Cited by 1,809
Kreijns, K., Kirschner, P. A., & Jochems, W. (2003) · Computers in Human Behavior · doi:10.1016/s0747-5632(02)00057-2 · Cited by 1,607
Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.008 · Cited by 1,574 · cited 1×
“On the other hand, a recent meta-analysis on the use of mobile devices in the classroom nuances these claims, and shows moderate positive learning effects [39].”
Background
Research works printed but not linked: 5
- creswell, 2003, Advanced mixed methods research designs, Handbook of Mixed Methods in Social and Behavioral Research, 209
- ha, 2018, Using mobile-based slido for effective management of a university english reading class, Multimedia Assisted Language Learning, 21, 37
- bergstrom, 0, Encouraging initiative in the classroom with anonymous feedback, Proc Int Conf Human Computer Interaction, 6946, 627
- harry, 0, Backchan.nl: Integrating backchannels with physical space, Proc Conf Human Factors Comput Syst, 2751
- yardi, 0, The role of the backchannel in collaborative learning environments, Proc 7th Int Conf Learning Sci, 852
Cited by
Yu, Z., Yu, L., Xu, Q., Xu, W., & Wu, P. (2022) · Technology, Pedagogy and Education · doi:10.1080/1475939x.2022.2045215 · Cited by 164
Al-Rahmi, A. M., Shamsuddin, A., Wahab, E., Al-Rahmi, W. M., Alyoussef, I. Y., & Crawford, J. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1003007 · Cited by 102
Adeshola, I., & Agoyi, M. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2029493 · Cited by 54
Anzar, S. M., Subheesh, N. P., Panthakkan, A., Malayil, S., & Al-Ahmad, H. (2021) · IEEE Access · doi:10.1109/access.2021.3092260 · Cited by 24
Huang, L.-Z., Wang, K., Li, S., & Guo, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1098585 · Cited by 25
Metadata
- Authors
- Rodriguez-Triana, M. J., Prieto, L. P., Holzer, A., & Gillet, D.
- Affiliations
- Tallinn University (EE)
- University of Neuchâtel (CH)
- École Polytechnique Fédérale de Lausanne (CH)
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2020-10-01
- Volume
- 13
- Issue
- 4
- Pages
- 718-733
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W3028326094
- Cited by
- 33
- References
- 87
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 9 · 2023: 11 · 2022: 6 · 2021: 3
- FWCI
- 4.70
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- European Commission (731685, 669074)
- Topics
- Social Sciences › Education › Educational Technology in Learning
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Online and Blended Learning
- Keywords
- social media in education, student engagement, learning outcomes, disaffection, behavioral engagement, emotional engagement, face-to-face classroom, student performance prediction, mobile learning, learning activity design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Instruction, Student Engagement, and Learning Outcomes: A Case Study Using Anonymous Social Media in a Face-to-Face Classroom. https://app.cochat.ai/papers/10.1109/tlt.2020.2995557
- The paper
- Rodriguez-Triana, M. J., Prieto, L. P., Holzer, A., & Gillet, D. (2020). Instruction, Student Engagement, and Learning Outcomes: A Case Study Using Anonymous Social Media in a Face-to-Face Classroom. IEEE Transactions on Learning Technologies. https://doi.org/10.1109/tlt.2020.2995557
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.