The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Review of computer‐based assessment for learning in elementary and secondary education
Abstract
In this paper, we review computer‐based assessment for learning (CBAfL), in elementary and secondary education, as a viable way to merge instruction and assessment of students' developing proficiencies. We begin by contextualizing our topic relative to summative and formative assessment before presenting the current literature, which we categorized into the following: (a) supplementary use in classrooms, (b) web‐based, and (c) data‐driven, continuous CBAfL. Examples of research studies per category are provided. Findings show that using CBAfL in the classroom, via the Internet, or embedded in a game, generally enhances learning and other outcomes across a range of content areas (e.g. biology, math, and programming). One conclusion is that feedback, to be most beneficial to learning, should not be overly complex and must be used to be effective. Findings also showed that the quality of the assessment (i.e. validity, reliability, and efficiency) is unimpaired by the inclusion of feedback. The possibilities created by advances in the learning sciences, measurement, and technology have paved the way toward new assessment approaches that will support personalized learning and that can accurately measure and support complex competencies. The next steps involve evaluating the new assessments regarding their psychometric properties and support of learning. Lay Description: What is currently known about computer‐based assessment for learning (CBAfL)? Early CBAfL systems were divided into linear and branching programs with no diagnostics and evolved into systems possessing more personalized/adaptive remediation with AI. Current CBAfL can support a range of competencies in various digital environments. Advanced learning analytic methods include learning analytics and stealth assessment. What our paper adds to what is already known about CBA for learning? Trends in our review suggest CBAs will improve in personalizing learning in a variety of contexts. Innovative CBAfL techniques will move beyond the laboratory and into the mainstream. Boundaries between instruction, learning and assessment will eventually become blurred, thus removing the need for high‐stake tests of learning. What are the implications of our topic for practitioners? With CBAfL advances, teachers will have more time to provide targeted support to learners. Students would not need to worry about taking exams if CBAfL is continuous and formative. Educators will be able to provide personalized learning experiences for diverse students. Students will be equipped with the knowledge and skills needed to succeed in the 21st century.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Learning: Legitimate Peripheral Participation.
Bloch, M., Lave, J., & Wenger, E. (1994) · Man · doi:10.2307/2804509 · Cited by 39,454
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
National Council of Teachers of Mathematics
(1979) · The Mathematics Teacher · doi:10.5951/mt.72.8.0637 · Cited by 8,499
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 2×
“…are usually administered more frequently than summative assessment and have shown potential for supporting learning in different content areas and for diverse audiences (e.g. Black & Wiliam, 1998; Hindo, Rose & Gomez, 2004; Schwartz, Bransford & Sears, 2005; Shute, Hansen & Almond, 2008).”
BackgroundShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Self-citationDeveloping the theory of formative assessment
Black, P., & Wiliam, D. (2009) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-008-9068-5 · Cited by 3,301 · cited 2×
“In general, formative assessment provides helpful information to teachers about their students’ learning progress and to students so that they know where they are, where they are going and how to get there in terms of their knowledge and skills (Black & Wiliam, 2009; Brown, 2004; Lin & Dwyer, 2006).”
BackgroundKnowing What Students Know: The Science and Design of Educational Assessment
Pellegrino, J. W., Chudowsky, N., & Glaser, R. A. (2013) · Cited by 2,402
Formative assessment: a critical review
Bennett, R. E. (2011) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2010.513678 · Cited by 1,498
Educational data mining: A survey from 1995 to 2005
Romero, C., & Ventura, S. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.005 · Cited by 1,482
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359
Online formative assessment in higher education: A review of the literature
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.06.004 · Cited by 1,260
Learning analytics and educational data mining: towards communication and collaboration
Siemens, G., & Baker, R. S. J. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330661 · Cited by 1,075
Handbook of Research on Learning and Instruction
(2011) · Routledge eBooks · doi:10.4324/9780203839089 · Cited by 916
Transfer of Learning from a Modern Multidisciplinary Perspective
(2000) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-673-5 · Cited by 905
International encyclopedia of education
Peterson, P. L. (2010) · Cited by 728
Van der Kleij, F. M., Feskens, R. C. W., & Eggen, T. J. H. M. (2015) · Review of Educational Research · doi:10.3102/0034654314564881 · Cited by 714
Lohr, L., & Chang, S. L. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504860 · Cited by 714
Heffernan, N. T., & Heffernan, C. L. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0024-x · Cited by 616
(2014) · Educational Technology & Society · Cited by 598
Brown, S. A. (2005) · Research Repository (University of Gloucestershire) · Cited by 579
Proceedings of the 6th international conference on Learning sciences
Kafai, Y. B., Sandoval, W. A., & Enyedy, N. (2004) · Cited by 483
Community Development Among Distance Learners: Temporal and Technological Dimensions
Haythornthwaite, C., Kazmer, M. M., Robins, J., & Shoemaker, S. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2000.tb00114.x · Cited by 475
Feedback in Higher and Professional Education: Understanding it and doing it well
(2012) · Routledge eBooks · doi:10.4324/9780203074336 · Cited by 452
Stealth Assessment: Measuring and Supporting Learning in Video Games
Shute, V., & Ventura, M. (2013) · doi:10.7551/mitpress/9589.001.0001 · Cited by 406
Self-citationSTANDARDIZATION OF PROGRESSIVE MATRICES, 1938
RAVEN, J. C. (1941) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1941.tb00316.x · Cited by 389
Meystel, A. (2001) · Cited by 388
Assessment in Special and Inclusive Education
Salvia, Ysseldyke, & Bolt (2010) · Cited by 353
Assessment in Special and Inclusive Education
(2012) · Encyclopedia of Diversity in Education · doi:10.4135/9781452218533.n57 · Cited by 325
A systematic review of prerequisites for implementing assessment for learning in classroom practice
Heitink, M. C., Van der Kleij, F. M., Veldkamp, B. P., Schildkamp, K., & Kippers, W. B. (2016) · Educational Research Review · doi:10.1016/j.edurev.2015.12.002 · Cited by 277
Measuring problem solving skills via stealth assessment in an engaging video game
Shute, V. J., Wang, L., Greiff, S., Zhao, W., & Moore, G. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.047 · Cited by 271
Self-citationRethinking assessment in a digital age: opportunities, challenges and risks
Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016) · British Educational Research Journal · doi:10.1002/berj.3215 · Cited by 265
Effects of feedback in a computer-based assessment for learning
van der Kleij, F. M., Eggen, T. J. H. M., Timmers, C. F., & Veldkamp, B. P. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.07.020 · Cited by 239
"APPLICATION OF BIG DATA IN EDUCATION DATA MINING AND LEARNING ANALYTICS – A LITERATURE REVIEW "
Open University Malaysia, Sin, K., Muthu, L., & Bharathiyar University (2015) · ICTACT Journal on Soft Computing · doi:10.21917/ijsc.2015.0145 · Cited by 239
Computer-based assessment: a versatile educational tool
Thelwall, M. (2000) · Computers & Education · doi:10.1016/s0360-1315(99)00037-8 · Cited by 220
Complex problem solving — More than reasoning?
Wüstenberg, S., Greiff, S., & Funke, J. (2012) · Intelligence · doi:10.1016/j.intell.2011.11.003 · Cited by 219
Wang, K. H., Wang, T. H., Wang, W. L., & Huang, S. C. (2006) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2006.00166.x · Cited by 202
Self-regulated Learning with MetaTutor: Advancing the Science of Learning with MetaCognitive Tools
Azevedo, R., Johnson, A., Chauncey, A., & Burkett, C. (2010) · New Science of Learning · doi:10.1007/978-1-4419-5716-0_11 · Cited by 189
Wang, T. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.01.003 · Cited by 189
Birenbaum, M., DeLuca, C., Earl, L., Heritage, M., Klenowski, V., Looney, A., Smith, K., Timperley, H., Volante, L., & Wyatt-Smith, C. (2015) · Policy Futures in Education · doi:10.1177/1478210314566733 · Cited by 182
Formative e-assessment: Practitioner cases
Pachler, N., Daly, C., Mor, Y., & Mellar, H. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.032 · Cited by 178
Some factors in the programming of conceptual learning.
Gagn?, R. M., & Brown, L. T. (1961) · Journal of Experimental Psychology · doi:10.1037/h0049210 · Cited by 167
Maier, U., Wolf, N., & Randler, C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.12.002 · Cited by 148
Advances in the Science of Assessment
Shute, V. J., Leighton, J. P., Jang, E. E., & Chu, M.-W. (2016) · Educational Assessment · doi:10.1080/10627197.2015.1127752 · Cited by 146
Self-citationRaymond, C., & Usherwood, S. (2013) · Journal of Political Science Education · doi:10.1080/15512169.2013.770984 · Cited by 140
A Quasi-Experimental Evaluation of An On-Line Formative Assessment and Tutoring System
Koedinger, K. R., McLaughlin, E. A., & Heffernan, N. T. (2010) · Journal of Educational Computing Research · doi:10.2190/ec.43.4.d · Cited by 132
What strategies are effective for formative assessment in an e‐learning environment?
Wang, T. (2007) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2006.00211.x · Cited by 126
Computer-based assessment of problem solving
Baker, E. L., & Mayer, R. E. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00023-0 · Cited by 116
Wang, T.-H. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.11.001 · Cited by 112
Do teachers’ own learning behaviors influence their classroom goal orientation and control ideology?
Gordon, S. C., Dembo, M. H., & Hocevar, D. (2006) · Teaching and Teacher Education · doi:10.1016/j.tate.2004.08.002 · Cited by 105
A Literature Review of Gaming in Education. Research Report.
McClarty, K. L., Orr, A., Frey, P., Dolan, R., Vassileva, V., & McVay, A. (2012) · Cited by 104
Shute, V. J., Hansen, E. G., & Almond, R. G. (2008) · doi:10.5555/1497124.1497126 · Cited by 100
Self-citationThomas, S. (2016) · Cited by 98
Kim, Y. J., Almond, R. G., & Shute, V. J. (2015) · International Journal of Testing · doi:10.1080/15305058.2015.1108322 · Cited by 85
Self-citationA system for formative assessment and monitoring of students' progress
Rodrigues, F., & Oliveira, P. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.03.001 · Cited by 79
Formative assessment and learning analytics
Tempelaar, D. T., Heck, A., Cuypers, H., van der Kooij, H., & van de Vrie, E. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460337 · Cited by 75
Hewson, C. (2012) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2011.00473.x · Cited by 74
AMOEBA: Designing for collaboration in computer science classrooms through live learning analytics
Berland, M., Davis, D., & Smith, C. P. (2015) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-015-9217-z · Cited by 71
de Klerk, S., Veldkamp, B. P., & Eggen, T. J. H. M. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.020 · Cited by 65
der Kleij, F. M. V., Timmers, C. F., & Eggen, T. J. H. M. (2011) · CADMO · doi:10.3280/cad2011-001004 · Cited by 62
Schacter, J., Herl, H. E., Chung, G. K. W. K., Dennis, R. A., & O’Neil, H. F. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00029-1 · Cited by 61
Perspectives on computer-based performance assessment of problem solving
O’Neil, H. F. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00022-9 · Cited by 59
Effects of a Learning Information System on Mathematics Achievement and Classroom Structure
Ysseldyke, J., Spicuzza, R. J., Kosciolek, S., & Boys, C. J. (2003) · The Journal of Educational Research · doi:10.1080/00220670309598804 · Cited by 52
Advances in learning analytics and educational data mining
Vahdat, M., Ghio, A., Oneto, L., Anguita, D., Funk, M., & Rauterberg, M. (2015) · TU/e Research Portal · Cited by 45
Republicans May Waver over NCLB.
Klein, A. (2008) · Education week · Cited by 41
Assessing and Supporting Hard-to-Measure Constructs in Video Games
Shute, V. J., & Wang, L. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch22 · Cited by 39
Self-citationAssessment using new technology
McGuire, L. (2005) · Innovations in Education and Teaching International · doi:10.1080/01587910500168025 · Cited by 36
The Fingertip Effects of Computer-based Assessment in Education
Lin, H., & Dwyer, F. M. (2006) · TechTrends · doi:10.1007/s11528-006-7615-9 · Cited by 27
Shute, V. J., & Zapata‐Rivera, D. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-044894-7.00247-5 · Cited by 26
Self-citationUsing Technology Tools to Monitor Response to Intervention
Ysseldyke, J. E., & McLeod, S. (2007) · Springer eBooks · doi:10.1007/978-0-387-49053-3_29 · Cited by 20
Editorial. Assessment for the Digital Age
McFarlane, A. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000148127 · Cited by 20
Kim, J. S., Vanderwood, M. L., & Lee, C. Y. (2016) · Educational Assessment · doi:10.1080/10627197.2015.1127750 · Cited by 19
INTELLIGENCE AND COMPUTER SIMULATION
Green, B. F. (1964) · Transactions of the New York Academy of Sciences · doi:10.1111/j.2164-0947.1964.tb03486.x · Cited by 14
Using Accelerated Math To Enhance Student Achievement in High School Mathematics Courses.
Gaeddert, T. J. (2001) · Cited by 13
An Analysis of Web-Based Formative Assessment Systems Used in E-Learning Environment
Mahroeian, H., & Chin, W. M. (2013) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2013.28 · Cited by 8
Computer-Assisted Instruction: Performance and Attitudes
Dyke, B. F. V., & Newton, J. M. (1972) · The Journal of Educational Research · doi:10.1080/00220671.1972.10884321 · Cited by 8
Effects of Progress Monitoring on Math Performance of At-Risk Students
Lambert, R. J. (2014) · Journal of Education Society and Behavioural Science · doi:10.9734/bjesbs/2014/7259 · Cited by 6
Tsai, F.-H. (2013) · Journal of Curriculum and Teaching · doi:10.5430/jct.v2n2p94 · Cited by 5
Blanchard, E. G., Wiseman, J., Naismith, L. M., & Lajoie, S. P. (2012) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2012.44 · Cited by 4
Cited by
Scherer, R., Siddiq, F., & Tondeur, J. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.09.009 · Cited by 1,923
A systematic literature review of personalized learning terms
Shemshack, A., & Spector, J. M. (2020) · Smart Learning Environments · doi:10.1186/s40561-020-00140-9 · Cited by 740
“instructional strategies, and instructional content (Shute and Rahimi, 2017) may differ depending on learner needs.”
BackgroundDifferentiated Instruction in Secondary Education: A Systematic Review of Research Evidence
Smale-Jacobse, A. E., Meijer, A., Helms-Lorenz, M., & Maulana, R. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02366 · Cited by 404
Mobile-based assessment: Investigating the factors that influence behavioral intention to use
Nikou, S. A., & Economides, A. A. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.02.005 · Cited by 388
The use of AI in education: Practicalities and ethical considerations
Reiss, M. J. (2021) · London Review of Education · doi:10.14324/lre.19.1.05 · Cited by 211
Metadata
- Authors
- Shute, V. J., & Rahimi, S.
- Venue
- Journal of Computer Assisted Learning
- Publisher
- Wiley
- Published
- 2017-01-20
- Volume
- 33
- Issue
- 1
- Pages
- 1-19
- ISSN
- 0266-4909 (ISSN-L)
- 1365-2729
- OpenAlex
- W2576265988
- Cited by
- 282
- References
- 80
- FWCI
- 11.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.