The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking assessment in a digital age: opportunities, challenges and risks
Open accessAbstract
While it is frequently argued that assessment sits at the heart of the learning process, in practice assessment often remains narrowly focused on qualifications and reporting achievements, driven by institutional and societal aspirations and tensions such as accountability and economic well being. Yet, the need for assessment to account for the knowledge, skills, dispositions and attitudes necessary to equip young people for a changing and increasingly digital world is also increasingly acknowledged. Based on our recent research review, this article critically examines the role of technology enhanced assessment (or TEA). We argue that while technology offers many potentially creative opportunities for innovation and for rethinking assessment purposes, there are also numerous risks and challenges. In particular we highlight ethical concerns over social exclusion and new forms of digital dividedness and the increasing risks associated with big data and the rise of learning analytics. Finally, we note that much research and innovation happens in silos, where policy, research and practice on assessment, technology enhanced assessment and ethical and political concerns are not linked up. We conclude that there needs to be a much more wide‐ranging, critical and nuanced discussion in educational and policy circles so that debates about the potential of technology can be linked to improving assessment in the light of the range of social and political challenges that such progress presents. We end with some critical questions for policy, practice and research communities, which we offer as a starting point for future thinking and ways forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Inside the Black Box: Raising Standards through Classroom Assessment
Black, P., & Wiliam, D. (2010) · Phi Delta Kappan · doi:10.1177/003172171009200119 · Cited by 4,231
Confronting the challenges of participatory cultures (media education for the 21st century)
Jenkins, H., Purushotma, R., Weigel, M., Clinton, K., & Robison, A. J. (2009) · Cited by 1,563
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170
Rethinking Assessment in Higher Education: Learning for the Longer Term
(2007) · doi:10.4324/9780203964309 · Cited by 1,049
Factors Affecting Technology Uses in Schools: An Ecological Perspective
Zhao, Y., & Frank, K. A. (2003) · American Educational Research Journal · doi:10.3102/00028312040004807 · Cited by 947
Säljö, R. (2010) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2009.00341.x · Cited by 514
Blin, F., & Munro, M. (2008) · Computers & Education · doi:10.1016/j.compedu.2007.09.017 · Cited by 482
Beyond Technology: Children's Learning in the Age of Digital Culture
Buckingham, D. J. (2007) · Cited by 472
Feedback in Higher and Professional Education: Understanding it and doing it well
(2012) · Routledge eBooks · doi:10.4324/9780203074336 · Cited by 452
Black, P., & Wiliam, D. (2006) · Sage eBooks · Cited by 396
Learning analytics: envisioning a research discipline and a domain of practice
Siemens, G. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330605 · Cited by 389
Facer, K. (2011) · Routledge eBooks · doi:10.4324/9780203817308 · Cited by 363
British Educational Research Association
Stones, E. (1975) · British Journal of Teacher Education · doi:10.1080/0260747750010113 · Cited by 330
What's the matter with ‘technology-enhanced learning’?
Bayne, S. (2015) · Learning, Media and Technology · doi:10.1080/17439884.2014.915851 · Cited by 326
Feedback in Higher and Professional Education: Understanding it and Doing it Well
Merry, S. P. (2016) · Innovative practice in higher education · Cited by 289
Quellmalz, E. S., & Pellegrino, J. W. (2009) · Science · doi:10.1126/science.1168046 · Cited by 254
A Blueprint for Computer-Assisted Assessment
Bull, J., & McKenna, C. (2003) · Routledge eBooks · doi:10.4324/9780203464687 · Cited by 249
Assessment for Learning in the Classroom
Black, P., & Wiliam, D. (2012) · Assessment and Learning · doi:10.4135/9781446250808.n2 · Cited by 239
Dawson, S. (2010) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2009.00970.x · Cited by 233
Student-Directed Assessment of Knowledge Building Using Electronic Portfolios
van Aalst, J., & Chan, C. K. K. (2007) · Journal of the Learning Sciences · doi:10.1080/10508400701193697 · Cited by 221
Learning Futures: Education, Technology and Social Change
Facer, K. (2011) · Cited by 214
Web 2.0: Inherent tensions and evident challenges for education
Dohn, N. B. (2009) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-009-9066-8 · Cited by 212
Formative peer assessment in a CSCL environment: a case study
Prins, F. J., Sluijsmans, D. M. A., Kirschner, P. A., & Strijbos, J. (2005) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930500099219 · Cited by 192
A research review of e-assessment
Stödberg, U. (2012) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2011.557496 · Cited by 179
Catalytic assessment: understanding how MCQs and EVS can foster deep learning
DRAPER, S. W. (2009) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2008.00920.x · Cited by 164
Perspectives on the Integration of Technology and Assessment
Pellegrino, J. W., & Quellmalz, E. S. (2010) · Journal of Research on Technology in Education · doi:10.1080/15391523.2010.10782565 · Cited by 162
Formative and Stealth Assessment
Shute, V. J., & Kim, Y. J. (2013) · Springer eBooks · doi:10.1007/978-1-4614-3185-5_25 · Cited by 157
Designing Assessments and Assessing Designs in Virtual Educational Environments
Hickey, D. T., Ingram-Goble, A. A., & Jameson, E. (2009) · Journal of Science Education and Technology · doi:10.1007/s10956-008-9143-1 · Cited by 141
Mutual feedback in e‐portfolio assessment: an approach to the netfolio system
Barberà, E. (2008) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00803.x · Cited by 123
Patterns of resistance in managing assessment change
Deneen, C. C., & Boud, D. J. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.859654 · Cited by 122
Towards Co-production in research with communities
Richardson, J., Durose, C., Beebeejaun, Y., Rees, J., & Richardson, L. (2011) · DMU Open Research Archive (De Montfort University) · Cited by 100
de Alfaro, L., & Shavlovsky, M. (2014) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2538862.2538900 · Cited by 97
A Roadmap for Education Technology
Woolf, B. P. (2010) · HAL · Cited by 97
(2012) · Child and Adolescent Mental Health · doi:10.1201/b13357-22 · Cited by 92
The Quest Atlantis Project: A Socially-Responsive Play Space for Learning
Barab, S. A., Dodge, T., Tüzün, H., Job-Sluder, K., Jackson, C., Arici, A., Job-Sluder, L., Carteaux, R., Gilbertson, J., & Heiselt, C. (2007) · BRILL eBooks · doi:10.1163/9789087903121_011 · Cited by 91
The journey so far: assessment for learning in Scotland
Hutchinson, C., & Hayward, L. (2005) · The Curriculum Journal · doi:10.1080/09585170500136184 · Cited by 88
Personal Inquiry: Orchestrating Science Investigations Within and Beyond the Classroom
Sharples, M., Eileen Scanlon, A., Ainsworth, S. E., Anastopoulou, S., Collins, T., Crook, C. K., Jones, A. C., Kerawalla, L., Littleton, K., Mulholland, P., et al. (2014) · Journal of the Learning Sciences · doi:10.1080/10508406.2014.944642 · Cited by 88
Activating Assessment for Learning
Whitelock, D. M. (2010) · IGI Global eBooks · doi:10.4018/978-1-60566-294-7.ch017 · Cited by 80
What are learners actually regulating when given feedback?
DRAPER, S. W. (2009) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2008.00930.x · Cited by 80
Educational Theories, Cultures and Learning: A Critical Perspective
Daniels, H., Lauder, H., & Porter, J. (2018) · Cited by 77
Student Standardised Testing: Current Practices in OECD Countries and a Literature Review
Morris, A. (2011) · OECD education working papers · doi:10.1787/5kg3rp9qbnr6-en · Cited by 64
Baillie, S., Crossan, A., Brewster, S. A., May, S. A., & Mellor, D. J. (2010) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3181e369bf · Cited by 59
Hattie, J., & Brown, G. (2007) · Journal of Educational Technology Systems · doi:10.2190/et.36.2.g · Cited by 55
James, D. (2013) · Higher Education · doi:10.1007/s10734-013-9652-6 · Cited by 48
Reframing e‐assessment: adopting new media and adapting old frameworks
Whitelock, D. M., & Watt, S. N. K. (2008) · Learning Media and Technology · doi:10.1080/17439880802447391 · Cited by 48
An eportfolio design theory supporting ownership, social learning, and ease of use
Garrett, N. (2009) · Educational Technology & Society · Cited by 45
Use of audience response systems for summative assessment in large classes
Hancock, T. M. (2010) · Australasian Journal of Educational Technology · doi:10.14742/ajet.1092 · Cited by 41
Hamer, J., Kell, C., & Spence, F. (2007) · Australasian Computing Education Conference · Cited by 40
The DIAGNOSER project: Combining assessment and learning
Thissen-Roe, A., Hunt, E. B., & Minstrell, J. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195568 · Cited by 37
Social software: new opportunities for challenging social inequalities in learning?
Hughes, G. (2009) · Learning Media and Technology · doi:10.1080/17439880903338580 · Cited by 37
Wilson, H. K., & Braaten, E. B. (2018) · Current clinical psychiatry · doi:10.1007/978-3-319-98643-2_1 · Cited by 26
CrowdGrader: Crowdsourcing the Evaluation of Homework AssignmentsPreprint
de Alfaro, L., & Shavlovsky, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.5273 · Cited by 25
Barton, M. D., & Heiman, J. (2011) · Technical Communication Quarterly · doi:10.1080/10572252.2012.626391 · Cited by 22
Timmis, S., Joubert, M., Manuel, A., & Barnes, S. (2010) · Learning Media and Technology · doi:10.1080/17439884.2010.509354 · Cited by 9
Self-citationBarker, T., & Bennett, S. (2012) · University of Hertfordshire Research Archive (University of Hertfordshire) · Cited by 8
Cited by
Sahu, P. (2020) · Cureus · doi:10.7759/cureus.7541 · Cited by 2,353
Spante, M., Hashemi, S. S., Lundin, M., & Algers, A. (2018) · Cogent Education · doi:10.1080/2331186x.2018.1519143 · Cited by 832
Learning analytics in higher education: a preponderance of analytics but very little learning?
Guzmán-Valenzuela, C., Gómez-González, C., Rojas-Murphy Tagle, A., & Lorca-Vyhmeister, A. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00258-x · Cited by 131
Ethical issues in learning analytics: a review of the field
Tzimas, D., & Demetriadis, S. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-09977-4 · Cited by 119
Rise of the Machines? The Evolving Role of AI Technologies in High-Stakes Assessment
Richardson, M., & Clesham, R. (2021) · London Review of Education · doi:10.14324/lre.19.1.09 · Cited by 48
Metadata
- Authors
- Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A.
- Venue
- British Educational Research Journal
- Publisher
- Wiley
- Published
- 2015-12-19
- Volume
- 42
- Issue
- 3
- Pages
- 454-476
- ISSN
- 0141-1926 (ISSN-L)
- 1469-3518
- OpenAlex
- W2436493763
- Cited by
- 265
- References
- 58
- FWCI
- 12.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.