The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Pitfalls in the pursuit of objectivity: issues of reliability
Abstract
Summary. Objectivity has been one of the hallmarks in the assessment of clinical competence in recent decades. A consistent shift can be noticed in which subjective measures are being replaced by objective measurement methods. In the transition from subjective to objective methods trade‐offs are involved, both in the effort expended and in the range of behaviours assessed. The issue of the presumed superiority of objective measures is addressed in two successive papers. In this paper a distinction is made between objectivity as a goal of measurement, marked by freedom of subjective influences in general, and objectivity as a set of strategies designed to reduce measurement error. The latter has been termed objectification. The central claim of this paper is that these two approaches to assessment do not necessarily coincide. By reviewing a number of studies comparing subjective and objectified measurement methods, the claim of the supremacy of the latter with respect to reliability is discussed. The results of these studies indicate that objectified methods do not inherently provide more reliable scores. Objectified methods may even provide unwanted outcomes, such as negative effects on study behaviour and triviality of the content being measured. The latter issues, related to validity, efficiency and acceptability, are discussed in a second paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
Medical Problem Solving: An Analysis of Clinical Reasoning
Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1978) · doi:10.4159/harvard.9780674189089 · Cited by 1,377
Assessment of clinical skills with standardized patients: State of the art
van der Vleuten, C. P. M., & Swanson, D. B. (1990) · Teaching and Learning in Medicine · doi:10.1080/10401339009539432 · Cited by 572
Self-citationAssessing Clinical Competence.
(1985) · Annals of Internal Medicine · doi:10.7326/0003-4819-102-4-569_2 · Cited by 306
Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability
NORMAN, G. R., VAN DER VLEUTEN, C. P. M., & DE GRAAFF, E. (1991) · Medical Education · doi:10.1111/j.1365-2923.1991.tb00037.x · Cited by 170
Self-citationMethodology: Foundations of inference and research in the behavioral sciences
De Groot, A. D., & J. A. A., S. (1969) · De Gruyter eBooks · doi:10.1515/9783112313121 · Cited by 168
SIMULATION TECHNIQUE IN THE MEASUREMENT OF PROBLEM‐SOLVING SKILLS1
McGUIRE, C. H., & Babbott, D. (1967) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1967.tb00562.x · Cited by 151
A comparison of multiple‐choice tests and free‐response tests in examinations of clinical competence
Newble, D. I., BAXTER, A., & Elmslie, R. G. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb01511.x · Cited by 109
The Use of Paraprofessionals To Teach Interviewing Skills
Stillman, P. L., Sabers, D. L., & Redfield, D. L. (1976) · PEDIATRICS · doi:10.1542/peds.57.5.769 · Cited by 81
Reliability and validity studies on modified essay questions
Feletti, G. I. (1980) · Academic Medicine · doi:10.1097/00001888-198011000-00006 · Cited by 49
Cited by
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,107
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Programmatic assessment: From assessment of learning to assessment for learning
Schuwirth, L. W. T., & Van der Vleuten, C. P. M. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.565828 · Cited by 902
Metadata
- Authors
- VAN DER VLEUTEN, C. P. M., NORMAN, G. R., & DE GRAAFF, E.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 1991-03
- Volume
- 25
- Issue
- 2
- Pages
- 110-118
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2037827178
- Cited by
- 283
- References
- 12
- FWCI
- 5.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pitfalls in the pursuit of objectivity: issues of reliability. https://app.cochat.ai/papers/10.1111/j.1365-2923.1991.tb00036.x
- The paper
- VAN DER VLEUTEN, C. P. M., NORMAN, G. R., & DE GRAAFF, E. (1991). Pitfalls in the pursuit of objectivity: issues of reliability. Medical Education. https://doi.org/10.1111/j.1365-2923.1991.tb00036.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.