Using CodeBrowser to seek differences between novice programmers
Abstract
A large body of systems that gather data on students' programming process exists, and with the increase of massive open online courses in programming, the amount of gathered data is growing even at a higher rate. A common issue for data analysis is the lack of common tools for visualizing source code snapshots. We have created a browser-side snapshot analysis tool called CodeBrowser that provides a clean REST API that anyone can integrate their snapshot data into. In this article, we describe CodeBrowser and as an example, discuss how it has been used to seek differences between novice programmers that have passed (n=10) or failed (n=10) an introductory programming course.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some work has used fine-grained programming process logs from instrumented IDEs to uncover student work patterns and to visualize student programming processes.
“Some work has looked into using fine-grained programming process logs gathered from instrumented IDEs to uncover student work patterns [21-23, 26, 40] and to visualize student programming processes [10,14,35,38].”
From Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study (2024) · cites this paper as [14]
Cites
Review of recent systems for automatic assessment of programming assignments
Ihantola, P., Ahoniemi, T., Karavirta, V., & Seppälä, O. (2010) · Koli Calling International Conference on Computing Education Research · doi:10.1145/1930464.1930480 · Cited by 561 · see citing works
A Survey of Automated Assessment Approaches for Programming Assignments
Ala-Mutka, K. (2005) · Computer Science Education · doi:10.1080/08993400500150747 · Cited by 550 · see citing works
The BlueJ System and its Pedagogy
Kölling, M., Quig, B., Patterson, A., & Rosenberg, J. (2003) · Computer Science Education · doi:10.1076/csed.13.4.249.17496 · Cited by 484 · see citing works
Automatic test-based assessment of programming
Douce, C., Livingstone, D., & Orwell, J. (2005) · Journal on Educational Resources in Computing · doi:10.1145/1163405.1163409 · Cited by 416 · see citing works
Methods and tools for exploring novice compilation behaviour
Jadud, M. C. (2006) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/1151588.1151600 · Cited by 297 · see citing works
Using learning analytics to assess students' behavior in open-ended programming tasks
Blikstein, P. (2011) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2090116.2090132 · Cited by 294 · see citing works
Visualizing programs with Jeliot 3
Moreno, A., Myller, N., Sutinen, E., & Ben‐Ari, M. (2004) · Working Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/989863.989928 · Cited by 257 · see citing works
Scaffolding students' learning using test my code
Vihavainen, A., Vikberg, T., Luukkainen, M., & Pärtel, M. (2013) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2462476.2462501 · Cited by 135 · see citing works
Self-citationMurphy, C., Kaiser, G. E., Loveland, K., et al. (2009) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1508865.1508929 · Cited by 62 · see citing works
Norris, C., Barry, F. E., Fenwick, J. B., et al. (2008) · Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1384271.1384284 · Cited by 48 · see citing works
Software repository mining with Marmoset
Spacco, J., Strecker, J., Hovemeyer, D., et al. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1082983.1083149 · Cited by 48 · see citing works
Norris, C., Barry, F. E., Fenwick, J. B., Reid, K., & Rountree, J. (2008) · ACM SIGCSE Bulletin · doi:10.1145/1597849.1384284 · Cited by 46 · see citing works
Software repository mining with Marmoset
Spacco, J., Strecker, J., Hovemeyer, D., et al. (2005) · doi:10.1145/1083142.1083149 · Cited by 32 · see citing works
A comprehensive taxonomy of algorithm animation languages
Karavirta, V., Korhonen, A., Malmi, L., et al. (2009) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2009.09.001 · Cited by 17 · see citing works
Web-scale data gathering with BlueJ
Utting, I., Brown, N. C. C., Kölling, M., McCall, D., & Stevens, P. (2012) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2361276.2361278 · Cited by 17 · see citing works
Programming process visualizer
Matsuzawa, Y., Okada, K., & Sakai, S. (2013) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2462476.2462493 · Cited by 15 · see citing works
Eclipse plug-in to monitor the programmer behaviour
McKeogh, J., & Exton, C. (2004) · doi:10.1145/1066129.1066148 · Cited by 15 · see citing works
Balzuweit, E., & Spacco, J. (2013) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2462476.2465615 · Cited by 7 · see citing works
Using the SCORE software package to analyse novice computer graphics programming
Wittmann, M. R. A., Bower, M., & Kavakli, M. (2011) · doi:10.1145/1999747.1999782 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study
Sheard, J., Denny, P., Hellas, A., Leinonen, J., Malmi, L., & Simon (2024) · Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3626252.3630880 · Cited by 54 · see citing works
Lehtinen, T., Haaranen, L., & Leinonen, J. (2023) · Proceedings of the 25th Australasian Computing Education Conference · doi:10.1145/3576123.3576129 · Cited by 17 · see citing works
- Authors
- Heinonen, K., Hirvikoski, K., Luukkainen, M., & Vihavainen, A.
- Affiliations
- University of Helsinki (FI)
- ORCID
- Luukkainen, Matti
- Venue
- Proceedings of the 45th ACM technical symposium on Computer science education
- Publisher
- ACM
- Published
- 2014-03-05
- Pages
- 229-234
- OpenAlex
- W1993992063
- Cited by
- 22
- References
- 19
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 5 · 2022: 2 · 2021: 2 · 2020: 1 · 2019: 2 · 2018: 3 · 2017: 1 · 2014: 3
- FWCI
- 0.85
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Technical Symposium on Computer Science Education (SIGCSE) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- novice programmers, programming education, introductory programming courses, student performance differences, REST API, massive open online courses
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
