The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
The boss online submission and assessment system
Abstract
Computer programming lends itself to automated assessment. With appropriate software tools, program correctness can be measured, along with an indication of quality according to a set of metrics. Furthermore, the regularity of program code allows plagiarism detection to be an integral part of the tools that support assessment. In this paper, we describe a submission and assessment system, called BOSS, that supports coursework assessment through collecting submissions, performing automatic tests for correctness and quality, checking for plagiarism, and providing an interface for marking and delivering feedback. We describe how automated assessment is incorporated into BOSS such that it supports, rather than constrains, assessment. The pedagogic and administrative issues that are affected by the assessment process are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956) · Cited by 9,342
(1956) · Medical Entomology and Zoology · Cited by 4,596
(1987) · Andalas University Repository (Andalas University) · Cited by 1,584
Knuth, D. E. (1984) · The Computer Journal · doi:10.1093/comjnl/27.2.97 · Cited by 1,467
(1992) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 451
Pangalos, G. J. (1993) · Computers in Industry · doi:10.1016/0166-3615(93)90066-a · Cited by 350
Entwistle, N. J. (2000) · Cited by 335
Plagiarism in programming assignments
Joy, M., & Luck, M. (1999) · IEEE Transactions on Education · doi:10.1109/13.762946 · Cited by 299
Self-citationA Blueprint for Computer-Assisted Assessment
Bull, J., & McKenna, C. (2003) · Routledge eBooks · doi:10.4324/9780203464687 · Cited by 249
On automated grading of programming assignments in an academic institution
Cheang, B., Kurnia, A., Lim, A., & Oon, W.-C. (2003) · Computers & Education · doi:10.1016/s0360-1315(03)00030-7 · Cited by 227
Fully automatic assessment of programming exercises
Saikkonen, R., Malmi, L., & Korhonen, A. (2001) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/377435.377666 · Cited by 152
A fast software one-way hash function
Merkle, R. C. (1990) · Journal of Cryptology · doi:10.1007/bf00203968 · Cited by 132
Fully automatic assessment of programming exercises
Saikkonen, R., Malmi, L., & Korhonen, A. (2001) · ACM SIGCSE Bulletin · doi:10.1145/507758.377666 · Cited by 96
Effective peer assessment for learning computer programming
Sitthiworachart, J., & Joy, M. S. (2004) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1007996.1008030 · Cited by 84
Self-citationSentence-based natural language plagiarism detection
White, D., & Joy, M. S. (2004) · Journal on Educational Resources in Computing · doi:10.1145/1086339.1086341 · Cited by 63
Self-citationBlueprint for Computer‐Assisted Assessment
(2004) · British Journal of Educational Technology · doi:10.1111/j.0007-1013.2004.397_1.x · Cited by 61
Automatic submission and administration of programming assignments
Dawson‐Howe, K. (1995) · ACM SIGCSE Bulletin · doi:10.1145/216511.216539 · Cited by 42
GAME: a Generic Automated Marking Environment for programming assessment
Blumenstein, M., Green, S., Nguyen, A. T. A., & Muthukkumarasamy, V. (2004) · International Conference on Information Technology: Coding and Computing (ITCC) · doi:10.1109/itcc.2004.1286454 · Cited by 36
An Automatic Assessment Marking and Plagiarism Detection System
Ghosh, M. R., Verma, B., & Nguyen, A. T. A. (2002) · Griffith Research Online · Cited by 15
Cited by
Review of recent systems for automatic assessment of programming assignments
Ihantola, P., Ahoniemi, T., Karavirta, V., & Seppälä, O. (2010) · Proceedings of the 10th Koli Calling International Conference on Computing Education Research · doi:10.1145/1930464.1930480 · Cited by 554
A survey of literature on the teaching of introductory programming
Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., & Paterson, J. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1345375.1345441 · Cited by 481
A comparison of code similarity analysers
Ragkhitwetsagul, C., Krinke, J., & Clark, D. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9564-7 · Cited by 122
“Tools that rely on tokens include Sherlock (Joy and Luck 1999), BOSS (Joy et al. 2005), Sim (Gitchell and Tran 1999), YAP3 (Wise 1996), JPlag (Prechelt et al. 2002), CCFinder (Kamiya et al. 2002), CP-Miner (Li et al. 2006), MOSS (Schleimer et al. 2003), Burrows et al. (2007), and the Source Code Similarity Detector Sy…”
MethodAn Educational System for Learning Search Algorithms and Automatically Assessing Student Performance
Grivokostopoulou, F., Perikos, I., & Hatzilygeroudis, I. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0116-x · Cited by 71
Jutge.org: Characteristics and Experiences
Petit, J., Roura, S., Carmona, J., Cortadella, J., Duch, J., Gimenez, O., Mani, A., Mas, J., Rodriguez-Carbonell, E., Rubio, E., et al. (2018) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2723389 · Cited by 33
“Reviews on automatic assessment of programming problems can be found in [1], [2] and recent experiences include [3], [4], [5].”
Background
Metadata
- Authors
- Joy, M., Griffiths, N., & Boyatt, R.
- Venue
- Journal on Educational Resources in Computing
- Published
- 2005-09
- Volume
- 5
- Issue
- 3
- Pages
- 2
- ISSN
- 1531-4278 (ISSN-L)
- OpenAlex
- W1991140109
- Cited by
- 282
- References
- 20
- FWCI
- 13.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.