The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
2018 Consensus framework for good assessment
Open accessAbstract
Introduction: In 2010, the Ottawa Conference produced a set of consensus criteria for good assessment. These were well received and since then the working group monitored their use. As part of the 2010 report, it was recommended that consideration be given in the future to preparing similar criteria for systems of assessment. Recent developments in the field suggest that it would be timely to undertake that task and so the working group was reconvened, with changes in membership to reflect broad global representation.Methods: Consideration was given to whether the initially proposed criteria continued to be appropriate for single assessments and the group believed that they were. Consequently, we reiterate the criteria that apply to individual assessments and duplicate relevant portions of the 2010 report.Results and discussion: This paper also presents a new set of criteria that apply to systems of assessment and, recognizing the challenges of implementation, offers several issues for further consideration. Among these issues are the increasing diversity of candidates and programs, the importance of legal defensibility in high stakes assessments, globalization and the interest in portable recognition of medical training, and the interest among employers and patients in how medical education is delivered and how progression decisions are made.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697 · cited 1×
“…to technology and artificial intelligence (AI) The costs and the return on investment of assessment methods The interaction of assessments with educational and health care systems The relationship between these frameworks and others reported in the literature (for example Michie et al. 2011).”
BackgroundThe standards for educational and psychological testing.
Eignor, D. R. (2013) · APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. · doi:10.1037/14047-013 · Cited by 6,988
Knowing What Students Know: The Science and Design of Educational Assessment
Pellegrino, J. W., Chudowsky, N., & Glaser, R. A. (2013) · Cited by 2,402
Programmatic assessment: From assessment of learning to assessment for learning
Schuwirth, L. W. T., & Van der Vleuten, C. P. M. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.565828 · Cited by 902
Norcini, J., Anderson, B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., Galbraith, R., Hays, R., Kent, A., Perrott, V., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551559 · Cited by 574
Self-citationConstructive alignment in university teaching
Kandlbinder, P. (2014) · Cited by 479
Twelve Tips for programmatic assessment
Van Der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Govaerts, M. J. B., & Heeneman, S. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.973388 · Cited by 333
Analytic global OSCE ratings are sensitive to level of training
Hodges, B., & McIlroy, J. H. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01674.x · Cited by 232
Prideaux, D., Roberts, C., Eva, K., Centeno, A., Mccrorie, P., Mcmanus, C., Patterson, F., Powis, D., Tekian, A., & Wilkinson, D. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551560 · Cited by 221
Developing the role of big data and analytics in health professional education
Ellaway, R. H., Pusic, M. V., Galbraith, R. M., & Cameron, T. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.874553 · Cited by 182
Cited by
AMEE Consensus Statement: Planetary health and education for sustainable healthcare
Shaw, E., Walpole, S., McLean, M., Alvarez-Nieto, C., Barna, S., Bazin, K., Behrens, G., Chase, H., Duane, B., El Omrani, O., et al. (2021) · Medical Teacher · doi:10.1080/0142159x.2020.1860207 · Cited by 381
Entrustment decision making: extending miller’s pyramid.
ten Cate, O., Carraccio, C., Damodaran, A., Gofton, W., Hamstra, S. J., Hart, D. E., Richardson, D., Ross, S., Schultz, K., Warm, E. J., et al. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003800 · Cited by 160
Mukurunge, E., Nyoni, C. N., & Hugo, L. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05264-x · Cited by 16
Expert Consensus Guidelines for Assessing Students on the Social Determinants of Health
Mangold, K. A., Williams, A.-L., Ngongo, W., Liveris, M., Caruso Brown, A. E., Adler, M. D., & Campbell, M. (2023) · Teaching and Learning in Medicine · doi:10.1080/10401334.2022.2045490 · Cited by 9
Ba, H., Zhang, L., He, X., & Li, S. (2024) · JMIR Medical Education · doi:10.2196/57772 · Cited by 6
Metadata
- Authors
- Norcini, J., Anderson, M. B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., Hays, R., Palacios Mackay, M. F., Roberts, T., & Swanson, D.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2018-10-09
- Volume
- 40
- Issue
- 11
- Pages
- 1102-1109
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2896892568
- Cited by
- 327
- References
- 14
- FWCI
- 24.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: 2018 Consensus framework for good assessment. https://app.cochat.ai/papers/10.1080/0142159x.2018.1500016
- The paper
- Norcini, J., Anderson, M. B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., Hays, R., Palacios Mackay, M. F., Roberts, T., & Swanson, D. (2018). 2018 Consensus framework for good assessment. Medical Teacher. https://doi.org/10.1080/0142159x.2018.1500016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.