A systematic literature review of student engagement in software visualization: a theoretical perspective
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
Background and Context: In spite of the decades spent developing software visualization (SV), doubts still remain regarding their effectiveness. Furthermore, student engagement plays an important role in improving SV effectiveness as it is correlated with many positive academic outcomes. It has been shown that the existing SV has failed to engage students effectively.Objective: Therefore, there is a need to understand the theories behind SV design from the engagement perspective to produce a roadmap for future tool construction. The aim of this study was to identify the theories have been used in literature to explain or construct student engage- ment with SV in computer science courses for novices.Method: We performed a systematic literature review that identified a total of 58 articles published between 2011 and 2017, which were then selected for the study. However, among them, only 18 articles had discussed their theoretical framework.Findings: The results of this study show a richness in the theoretical framework obtained from different disciplines, however, constructivism is still dominant in the computing education research (CER) domain. It is evidently clear from the findings that the theories generated from the CER domain are needed to enhance the effectiveness of SV.Implications: As a result of this review, we suggest several design principles and engagement attributes to be considered while creating an engaging SV.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Linked to this, educational technology research has, however, lacked theoretical guidance (Al-Sakkaf, Omar, & Ahmad, 2019; Hew, Lan, Tang, Jia, & Lo, 2019; Lundin, Bergviken Rensfeldt, Hillman, Lantz-Andersson, & Peterson, 2018).”
From Mapping research in student engagement and educational technology in higher education: a systematic evidence map (2020) · cites this paper as Al-Sakkaf, Omar, & Ahmad, 2019
Citations
Cites
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 2×
“Furthermore, the Fredricks et al. (2004) ” s de fi nition received increased attention in recent studies, due to its broad scope, and incorporating di ff erent types of engagement that help to capture a wider range of student experiences (Reschly & Christenson, 2012; Schindler et al., 2017).”
BackgroundThe Nature of Theory in Information Systems1
Gregor, S. (2006) · MIS Quarterly · doi:10.2307/25148742 · Cited by 3,306 · cited 5×
“However, Table 8 indicates the type of theory based on Gregor (2006)’s taxonomy of theory types in information systems.”
BackgroundMethodInfluentialMotivation and Education: The Self-Determination Perspective
Deci, E. L., Vallerand, R. J., Pelletier, L. G., & Ryan, R. M. (1991) · Educational Psychologist · doi:10.1080/00461520.1991.9653137 · Cited by 2,731
Framing student engagement in higher education
Kahu, E. R. (2013) · Studies in Higher Education · doi:10.1080/03075079.2011.598505 · Cited by 2,103 · cited 2×
“The roles of engagement in education have been studied extensively in order to handle educational problems such as the high student drop-out rate, low academic achievement and high rates of student boredom and alienation (Fredricks, Filsecker, & Lawson, 2016; Kahu, 2013; Schindler et al., 2017).”
BackgroundSocial Cognitive Theory: An Agentic Perspective
Bandura, A. (1999) · Asian Journal of Social Psychology · doi:10.1111/1467-839x.00024 · Cited by 2,050
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
The national survey of student engagement: Conceptual and empirical foundations
Kuh, G. D. (2009) · New Directions for Institutional Research · doi:10.1002/ir.283 · Cited by 1,096
Students’ engagement in first‐year university
Krause, K., & Coates, H. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930701698892 · Cited by 1,075 · cited 1×
“In addition, engagement is de fi ned as “ the extent to which students are engaging in activities that higher education research has shown to be linked with high-quality learning outcomes ’ (Krause & Coates, 2008).”
BackgroundJingle, Jangle, and Conceptual Haziness: Evolution and Future Directions of the Engagement Construct
Reschly, A. L., & Christenson, S. L. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_1 · Cited by 980 · cited 2×
“Furthermore, the Fredricks et al. (2004) ” s de fi nition received increased attention in recent studies, due to its broad scope, and incorporating di ff erent types of engagement that help to capture a wider range of student experiences (Reschly & Christenson, 2012; Schindler et al., 2017).”
BackgroundFredricks, J. A., Filsecker, M., & Lawson, M. A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.02.002 · Cited by 851 · cited 2×
“Despite its common usage, engagement is used in di ff erent disciplines to mean di ff erent things (Fredricks et al., 2016; Schindler et al., 2017).”
BackgroundEvidence-Based Software Engineering and Systematic Reviews
Kitchenham, B. A., Budgen, D., & Brereton, P. (2015) · Chapman & Hall/CRC eBooks · doi:10.1201/b19467 · Cited by 759
What makes things fun to learn? heuristics for designing instructional computer games
Malone, T. W. (1980) · Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems - SIGSMALL '80 · doi:10.1145/800088.802839 · Cited by 758
A Meta-Study of Algorithm Visualization Effectiveness
HUNDHAUSEN, C. D., DOUGLAS, S. A., & STASKO, J. T. (2002) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.2002.0237 · Cited by 719
Exploring the role of visualization and engagement in computer science education
Naps, T. L., Rößling, G., Almstrum, V., Dann, W., Fleischer, R., Hundhausen, C., Korhonen, A., Malmi, L., McNally, M., Rodger, S., et al. (2003) · ACM SIGCSE Bulletin · doi:10.1145/782941.782998 · Cited by 641
A Principled Taxonomy of Software Visualization
Price, B. A., Baecker, R. M., & Small, I. S. (1993) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1993.1015 · Cited by 476
Computer-based technology and student engagement: a critical review of the literature
Schindler, L. A., Burkholder, G. J., Morad, O. A., & Marsh, C. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0063-0 · Cited by 475 · cited 10×
“Several models or frameworks were proposed to explain engagement with technology (e.g. Gunuc & Kuzu, 2015; O ’ Brien & Toms, 2008; Schindler et al., 2017).”
BackgroundInfluentialCsikszentmihalyi, M. (2014) · Springer eBooks · doi:10.1007/978-94-017-9094-9 · Cited by 416
A Review of Generic Program Visualization Systems for Introductory Programming Education
Sorva, J., Karavirta, V., & Malmi, L. (2013) · ACM Transactions on Computing Education · doi:10.1145/2490822 · Cited by 366
Making Differences:A Table of Learning
Shulman, L. S. (2002) · Change: The Magazine of Higher Learning · doi:10.1080/00091380209605567 · Cited by 309
A Systematic Review of Theory Use in Software Engineering Experiments
Hannay, J. E., Sjoberg, D. I. K., & Dyba, T. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.12 · Cited by 226
Vihavainen, A., Airaksinen, J., & Watson, C. (2014) · Proceedings of the tenth annual conference on International computing education research · doi:10.1145/2632320.2632349 · Cited by 223
Computer Science Education Research
(2005) · Taylor & Francis eBooks · doi:10.1201/9781482287325 · Cited by 222
Algorithm Visualization: The State of the Field
Shaffer, C. A., Cooper, M. L., Alon, A. J. D., Akbar, M., Stewart, M., Ponce, S., & Edwards, S. H. (2010) · ACM Transactions on Computing Education · doi:10.1145/1821996.1821997 · Cited by 197
Using a gamified mobile app to increase student engagement, retention and academic achievement
Pechenkina, E., Laurence, D., Oates, G., Eldridge, D., & Hunter, D. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0069-7 · Cited by 167
A decade of research and development on program animation: The Jeliot experience
Ben‐Ari, M., Bednarik, R., Levy, R. B.-B., Ebel, G., Moreno, A., Myller, N., & Sutinen, E. (2011) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2011.04.004 · Cited by 116
The Role of Visualization in Computer Science Education
Fouh, E., Akbar, M., & Shaffer, C. A. (2012) · Computers in the Schools · doi:10.1080/07380569.2012.651422 · Cited by 108
Design and architecture of an interactive eTextbook – The OpenDSA system
Fouh, E., Karavirta, V., Breakiron, D. A., Hamouda, S., Hall, S., Naps, T. L., & Shaffer, C. A. (2013) · Science of Computer Programming · doi:10.1016/j.scico.2013.11.040 · Cited by 106
Networking of Theories—An Approach for Exploiting the Diversity of Theoretical Approaches
Bikner‐Ahsbahs, A., & Prediger, S. (2009) · Springer eBooks · doi:10.1007/978-3-642-00742-2_46 · Cited by 104
Analysis of Interactive Features Designed to Enhance Learning in an Ebook
Ericson, B. J., Guzdial, M. J., & Morrison, B. B. (2015) · Proceedings of the eleventh annual International Conference on International Computing Education Research · doi:10.1145/2787622.2787731 · Cited by 101
Characterizing research in computing education: a preliminary analysis of the literature
Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Korhonen, A., Myller, N., Sorva, J., & Taherkhani, A. (2010) · Proceedings of the Sixth international workshop on Computing education research · doi:10.1145/1839594.1839597 · Cited by 89
Methodological Rigor and Theoretical Foundations of CS Education Research
Lishinski, A., Good, J., Sands, P., & Yadav, A. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960328 · Cited by 78
Codepourri: Creating visual coding tutorials using a volunteer crowd of learners
Gordon, M., & Guo, P. J. (2015) · 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2015.7357193 · Cited by 60
Confirmation of Campus-Class-Technology Model in student engagement: A path analysis
Günüç, S., & Kuzu, A. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.041 · Cited by 51
Evaluating the Effect of Program Visualization on Student Motivation
Velázquez‐Iturbide, J. Á., Losada, I. H., & Velasco, M. P. (2017) · IEEE Transactions on Education · doi:10.1109/te.2017.2648781 · Cited by 45
Urquiza-Fuentes, J., & Velázquez-Iturbide, J. Á. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.02.013 · Cited by 41
Getting algorithm visualizations into the classroom
Shaffer, C., Akbar, M., Alon, A. J. D., Stewart, M., & Edwards, S. (2011) · Technical Symposium on Computer Science Education · doi:10.1145/1953163.1953204 · Cited by 41
Guo, J., & Pang, M. F. (2011) · European Journal of Psychology of Education · doi:10.1007/s10212-011-0060-y · Cited by 40
A social construction approach to computer science education
Machanick, P. (2007) · Computer Science Education · doi:10.1080/08993400600971067 · Cited by 36
Are visualization tools used in programming education?
Isohanni, E., & Järvinen, H.-M. (2014) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2674683.2674688 · Cited by 31
Effect of active learning using program visualization in technology-constrained college classrooms
Banerjee, G., Murthy, S., & Iyer, S. R. (2015) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-015-0014-0 · Cited by 30
Learning principles in program visualizations: A systematic literature review
Hidalgo‐Céspedes, J., Marín‐Raventós, G., & Villagrán, V. L. (2016) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757692 · Cited by 30
Learning sorting algorithms through visualization construction
Cetin, I., & Andrews-Larson, C. (2016) · Computer Science Education · doi:10.1080/08993408.2016.1160664 · Cited by 28
How Do Students Use Program Visualizations within an Interactive Ebook?
Sirkiä, T., & Sorva, J. (2015) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2787622.2787719 · Cited by 27
Effect of a 2-week scratch intervention in CS1 on learners with varying prior knowledge
Mishra, S., Sudeesh, B., Iyer, S. R., & Murthy, S. (2014) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2591708.2591733 · Cited by 26
Sort Attack: Visualization and Gamification of Sorting Algorithm Learning
Yohannis, A., & Prabowo, Y. D. (2015) · International Conference on Games and Virtual Worlds for Serious Applications · doi:10.1109/vs-games.2015.7295785 · Cited by 23
Effects of visualizing roles of variables with animation and IDE in novice program construction
Shi, N., Min, Z., & Zhang, P. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.02.005 · Cited by 23
Defining and evaluating conflictive animations for programming education: the case of jeliot ConAn
Moreno, A., Sutinen, E., & Joy, M. S. (2014) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2538862.2538888 · Cited by 22
Animated Examples as Practice Content in a Java Programming Course
Hosseini, R., Sirkiä, T., Guerra, J., Brusilovsky, P. L., & Malmi, L. (2016) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2839509.2844639 · Cited by 21
The reasons might be different: why students and teachers do not use visualization tools
Knobelsdorf, M., Isohanni, E., & Tenenberg, J. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401797 · Cited by 15
Students' long-term engagement with the visualization tool VIP
Isohanni, E., & Knobelsdorf, M. (2011) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2094131.2094138 · Cited by 11
Odisho, O., Aziz, M., & Giacaman, N. (2016) · Computer Applications in Engineering Education · doi:10.1002/cae.21768 · Cited by 11
Open source software and the algorithm visualization community
Cooper, M. L., Shaffer, C. A., Edwards, S. H., & Ponce, S. (2014) · Science of Computer Programming · doi:10.1016/j.scico.2013.12.008 · Cited by 9
A "Multiple Executions" Technique of Visualization
Velázquez‐Iturbide, J. Á., Losada, I. H., & Pérez-Carrasco, A. (2016) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2899415.2899451 · Cited by 9
Experiences in Usability Evaluation of Educational Programming Tools
Velázquez‐Iturbide, J. Á., Pérez-Carrasco, A., & Debdi, O. (2015) · STEM Education · doi:10.4018/978-1-4666-7363-2.ch025 · Cited by 8
Végh, L., & Takáč, O. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-46535-7_25 · Cited by 8
Comparing the effectiveness of different educational uses of program animations
Urquiza‐Fuentes, J., & Velázquez‐Iturbide, J. Á. (2012) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2325296.2325340 · Cited by 7
Constructivist and Constructionist Approaches to Constructing Algorithm Visualizations: A Proposal
Lee, M.-H., & Rößling, G. (2011) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2011.56 · Cited by 6
Evaluating Online Tutorials for Data Structures and Algorithms Courses
Hall, S., Shaffer, C. A., Fouh, E., Elshehaly, M., & Breakiron, D. A. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--19563 · Cited by 5
Malmi, L. (2014) · ACM Inroads · doi:10.1145/2663357 · Cited by 3
Improving Engagement in Hypermedia Learning: A Design for Navigation Support
Katuk, N., Omar, M. B., & Halim, N. A. (2014) · International Conference on Information Integration and Web-based Applications & Services (iiWAS) · doi:10.1145/2684200.2684316 · Cited by 2
Self-citationEffectiveness of Integrated Algorithm-Program Visualization: A Case Study with the 3De-AlProV
Affandy, Suryana, N., & Hussin, B. (2013) · Advanced Science Letters · doi:10.1166/asl.2014.5271 · Cited by 1
Research works printed but not linked: 5
- Banerjee G., 2013, Proceedings of the 21st international conference on computers in education
- Buchanan S., 2014, Transaction on Computer Education, 14
- Malmi L., 2014, Proceedings of the 10th annual conference on international computing education research, 27
- Myller N., 2009, Transaction on Computer Education, 9
- Urquiza-Fuentes J., 2009, Transaction on Computer Education, 9
Cited by
Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0176-8 · Cited by 1,097
“These findings also reflect the state of the field in general (Al-Sakkaf et al., 2019; Bond, 2019b; Hennessy, Girvan, Mavrikis, Price, & Winters, 2018).”
BackgroundStudent Engagement with Technology-Enhanced Resources in Mathematics in Higher Education: A Review
Shé, C. N., Fhloinn, E. N., & Bhaird, C. M. A. (2023) · Mathematics · doi:10.3390/math11030787 · Cited by 77
A Tertiary Systematic Literature Review on Software Visualization
Bedu, L., Olivier, T., & Petrillo, F. D. S. (2019) · IEEE Working Conference on Software Visualization (VISSOFT) · doi:10.1109/vissoft.2019.00013 · Cited by 32
“Furthermore, the nature of some developed tools is a worrying matter in this field: they are often short-lived research prototypes, suffering a low adoption rate [4], [9].”
BackgroundInfluentialTeaching Loops Concept through Visualization Construction
Çetin, İ. (2020) · Informatics in Education · doi:10.15388/infedu.2020.26 · Cited by 24
“The computing teachers or instructors stated that they believe visualization is useful in teaching their courses but at the same time they are not willing to use it in their courses (Baker and O’Neil Jr, 2002; Shaffer et al. , 2010).”
BackgroundAkkaya, A., & Akpınar, Y. (2022) · Computer Science Education · doi:10.1080/08993408.2022.2044673 · Cited by 29
“…in understanding and analyzing a problem, building step-by-step algorithmic solution designs for problems (Guenaga et al., 2021; Xinogalos, 2016) and visualizing the programming concepts from a problem situation (Al-Sakkaf et al., 2019; Mladenovic et al., 2021) which result in demotivation.”
Background
Metadata
- Authors
- Al-Sakkaf, A., Omar, M., & Ahmad, M.
- Affiliations
- Universiti Utara Malaysia (MY)
- Corresponding author
- Al-Sakkaf, Abdullah
- Venue
- Computer Science Education
- Publisher
- Informa UK Limited
- Published
- 2019-01-11
- Volume
- 29
- Issue
- 2-3
- Pages
- 283-309
- ISSN
- 0899-3408 (ISSN-L)
- 1744-5175
- OpenAlex
- W2911020451
- Cited by
- 19
- References
- 62
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 2 · 2019: 1
- FWCI
- 0.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Science Education (publishedVersion)
- Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) (acceptedVersion)
- Funders
- Ministry of Higher Education of Malaysia (S/O code:13581)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- software visualization, student engagement, constructivism, theoretical framework, novice programmers, design principles
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.