The DOI matches its Crossref record.
Goodhart’s law and performance indicators in higher education
Abstract
After describing the historical development of performance indicators in higher education and the illustrations that they provide for Goodhart's law, the paper discusses the difference between outcome and process indicators. It is suggested that, as long as the latter refer to underlying processes, and not to those immediately accessible, they can be used with less risk of abuse. This suggestion is exemplified in terms of standards of academic professionalism, and a set of appropriate processes is suggested for formal audit. The ‘underlying processes’ are anchored in the concepts of ‘organised anarchy’ or ‘complex adaptive systems’. It is hypothesised that they can be influenced by common professional principles of those engaged in them, so as to favour a creatively organised anarchy which develops excellence through true professionalism ‘bottom up’, in contrast to less successful managerial attempts to create excellence ‘top down’. Finally, attention is drawn to the fact that traditional examinations also constitute an abuse of performance indicators.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In such cases, completeness no longer reflects accuracy, which illustrates Goodhart's Law: once a measure becomes the target, it loses its validity as a measure (Elton, 2004).”
From Geographic Variation in LLM DOI Fabrication: Cross-Country Analysis of Citation Accuracy Across Four Large Language Models (2025) · cites this paper as Elton, 2004
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 52
- 10.1080/0305498880140109 · DOI
- Bassey M., 2003, Research Intelligence, 84, 26
- Baty P., 2003, Times Higher, 3
- Baume D., 2001, A briefing on assessment of portfolios
- 2002, Higher Education: Easing the Burden
- Biggs J., 2000, Teaching for Quality Learning at University
- Billing D., 1979, Indicators of Performance
- Boyer E. L., 1990, Scholarship Reconsidered: Priorities of the Professoriate
- Carvell J., 2003, Guardian, 9
- Cave M., 1991, Use of Performance Indicators in Higher Education
- Cave M., 1997, Use of Performance Indicators in Higher Education
- Clark P., 1994, A commentary
- Cohen M. D., 1986, Leadership and Ambiguity: The American College President
- 10.1080/13562510220144770 · DOI
- 1985, Efficiency Studies in Universities (Jarratt Report)
- 1986, Performance Indicators in Universities : 1st and 2nd statement
- Ehrenberg V., 1968, From Solon to Socrates
- Elton L., 1987, Teaching in Higher Education: Appraisal and Training
- 10.1007/BF00139535 · DOI
- 10.1111/j.1468-2273.1988.tb01818.x · DOI
- Elton L., 1991, Zeitschrift für Hochschuldidaktik, 1, 102
- Elton L., 1993, Quality Assurance for University Teaching
- 10.1080/1360144980030102 · DOI
- 10.1111/1468-2273.00160 · DOI
- 10.1080/13562510020029590 · DOI
- Elton L., 1993, Teaching Standards and Excellence in Higher Education
- Fitz-Gibbon C. T., 1990, Performance Indicators. BERA Dialogues 2
- Goodhart C., 1975, Inflation, Depression and Economic Policy in the West
- Hall S., 2003, Guardian, 20
- 10.1177/1469787400001001003 · DOI
- Johnes J., 1990, Performance Indicators in Higher Education
- Knight P. T., 2003, Assessment, Learning and Employability
- Loder C., 1990, Quality Assurance and Accountability in Higher Education
- 10.2304/plat.2002.2.2.134 · DOI
- McIntyre M. E., 1999, Audit, Education and Goodhart's Law or, Taking Rigidity Seriously
- McNay I., 1997, The impact of the research assessment exercise on individual and institutional behaviour in English higher education
- McNay I., 1999, Changing Relations between Higher Education and the State
- 10.1111/j.1468-2273.1995.tb01671.x · DOI
- Nisbet J., 1986, Appraising Appraisal
- Perry A., 2000, The New Learning Market
- 10.1080/03075078712331378290 · DOI
- 2002, Handbook for Institutional Audit
- 10.1080/03075070050193406 · DOI
- 2003, Professional Development Framework (PDF)
- Shaw G. B., 1946, The Doctor's Dilemma. Act I
- Snyder B. R., 1971, The Hidden Curriculum
- Tobin A., 1996, Times Higher, 11
- Tooley J., 2003, Research Intelligence, 84, 24
- Trow M., 1994, Managerialism and the academic profession: Quality and control
- 1997, Research Assessment: Future Perfect?
- 10.1080/1470329031000088978 · DOI
- 10.1108/09684889410071078 · DOI
Cited by
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
Speeding up to keep up: exploring the use of AI in the research process
Chubb, J., Cowling, P., & Reed, D. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01259-0 · Cited by 218
How do we start? An approach to learning analytics adoption in higher education
Gasevic, D., Tsai, Y.-S., Dawson, S., & Pardo, A. (2019) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-02-2019-0024 · Cited by 103
Kim, E., Kipchumba, F., & Min, S. (2025) · Publications · doi:10.3390/publications13040049 · Cited by 7
Metadata
- Authors
- Elton, L.
- Venue
- Evaluation & Research in Education
- Publisher
- Informa UK Limited
- Published
- 2004-02-15
- Volume
- 18
- Issue
- 1-2
- Pages
- 120-128
- ISSN
- 0950-0790
- 1747-7514
- Cited by
- 50
- References
- 0
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Goodhart’s law and performance indicators in higher education. https://app.cochat.ai/papers/10.1080/09500790408668312
- The paper
- Elton, L. (2004). Goodhart’s law and performance indicators in higher education. Evaluation & Research in Education. https://doi.org/10.1080/09500790408668312
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.