The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Setting standards on educational tests
Abstract
Objective This instalment in the series on professional assessment provides an introduction to methods of setting standards. Method A standard is a special score that serves as a boundary between those who perform well enough and those who do not. The practical steps in selecting it include: deciding on the type of standard; deciding the method for setting it; selecting the judges; holding the meeting; calculating the cutpoint, and deciding what to do afterwards. Four of the more popular methods are illustrated for both written and clinical examinations. Results The most important criteria for selecting a method for setting standards are whether it is consistent with the purpose of the test, based on expert judgement, informed by data, supported by research, transparent, and requires due diligence. The credibility of the standard will rely largely on the nature of the standard setters and the selection of a broadly representative and knowledgeable group is essential. After the standard has been set, it is important to ensure that stakeholders view the results as credible and that the pass rates have sensible relationships with other markers of competence. Conclusions A standard is an expression of professional values in the context of a test's purpose and content, the ability of the examinees, and the wider social or educational setting. Because standards are an expression of values, methods for setting them are systematic ways of gathering value judgements, reaching consensus and expressing that consensus as a single score on a test.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Passing Scores: A Manual for Setting Standards of Performance on Educational and Occupational Tests.
Livingston, S. A., & Zieky, M. J. (1982) · Cited by 314
Validating the Performance Standards Associated with Passing Scores
Kane, M. (1994) · Review of Educational Research · doi:10.2307/1170678 · Cited by 288
A Consumer's Guide to Setting Performance Standards on Criterion-Referenced Tests
Berk, R. A. (1986) · Review of Educational Research · doi:10.2307/1170289 · Cited by 230
Standard setting in medical education
Cusimano, M. D. (1996) · Academic Medicine · doi:10.1097/00001888-199610000-00062 · Cited by 175
The Credibility and Comparability of Standards
Norcini, J. J., & Shea, J. A. (1997) · Applied Measurement in Education · doi:10.1207/s15324818ame1001_3 · Cited by 115
Self-citationEvaluation Models for Criterion-Referenced Testing: Views Regarding Mastery and Standard-Setting
Meskauskas, J. A. (1976) · Review of Educational Research · doi:10.3102/00346543046001133 · Cited by 89
Dauphinée, W. D., Blackmore, D. E., Smee, S. M., Rothman, A. I., & Reznick, R. K. (1997) · Advances in Health Sciences Education · doi:10.1023/a:1009768127620 · Cited by 58
Cited by
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434
Techniques for measuring clinical competence: objective structured clinical examinations
Newble, D. (2004) · Medical Education · doi:10.1111/j.1365-2923.2004.01755.x · Cited by 483
The promise of competency-based education in the health professions for improving global health
Gruppen, L. D., Mangrulkar, R. S., & Kolars, J. C. (2012) · Human Resources for Health · doi:10.1186/1478-4491-10-43 · Cited by 356
Validity threats: overcoming interference with proposed interpretations of assessment data
Downing, S. M., & Haladyna, T. M. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01777.x · Cited by 282
How to measure the quality of the OSCE: a review of metrics—AMEE guide no. 49.
Pell, G., Fuller, R., Homer, M., & Roberts, T. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.507716 · Cited by 229
Metadata
- Authors
- Norcini, J. J.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2003-04-22
- Volume
- 37
- Issue
- 5
- Pages
- 464-469
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2100173888
- Cited by
- 312
- References
- 7
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Setting standards on educational tests. https://app.cochat.ai/papers/10.1046/j.1365-2923.2003.01495.x
- The paper
- Norcini, J. J. (2003). Setting standards on educational tests. Medical Education. https://doi.org/10.1046/j.1365-2923.2003.01495.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.