The DOI matches its Crossref record.
Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability
Abstract
Summary. In a previous article the distinction is made between objectivity and objectification. Objectivity is considered a generic goal of measurement, marked by freedom of subjective influences in general, whereas the latter term is used to describe strategies to reduce measurement error. A survey of several studies indicated that objectified methods are not intrinsically more reliable than subjective measures. In this paper the consequences of objectification are analysed for issues related to validity, efficiency, transparency, and effect of these methods on students and teachers. Several studies comparing objectified and subjective methods are surveyed for this propose. The studies indicate that — as in the previous article on reliability — objectification and objectivity are not identical, and that there are many pitfalls in the objectification of measurement procedures. As a consequence, it is argued that objectified methods should not exclusively be chosen on the basis of their unconditional appeal to objectivity, but that the application of measurement methods should follow the specific purpose of the testing situation. In the context of the testing situation, arguments against and in favour of objectification should be weighted, and trade‐offs are to be evaluated. The outcome of this evaluation may vary from situation to situation, and from institution to institution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781
Ilgen, J. S., Ma, I. W. Y., Hatala, R., & Cook, D. A. (2015) · Medical Education · doi:10.1111/medu.12621 · Cited by 337
Metadata
- Authors
- NORMAN, G. R., VAN DER VLEUTEN, C. P. M., & DE GRAAFF, E.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 1991-03
- Volume
- 25
- Issue
- 2
- Pages
- 119-126
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2059582218
- Cited by
- 170
- References
- 0
- FWCI
- 4.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. https://app.cochat.ai/papers/10.1111/j.1365-2923.1991.tb00037.x
- The paper
- NORMAN, G. R., VAN DER VLEUTEN, C. P. M., & DE GRAAFF, E. (1991). Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Medical Education. https://doi.org/10.1111/j.1365-2923.1991.tb00037.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.