Barriers and facilitators to writing quality items for medical school assessments – a scoping review
Open accessThe DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Producing a sufficient quantity of quality items for use in medical school examinations is a continuing challenge in medical education. We conducted this scoping review to identify barriers and facilitators to writing good quality items and note gaps in the literature that are yet to be addressed. METHODS: We conducted searches of three databases (ERIC, Medline and Scopus) as well as Google Scholar for empirical studies on the barriers and facilitators for writing good quality items for medical school examinations. RESULTS: The initial search yielded 1997 articles. After applying pre-determined criteria, 13 articles were selected for the scoping review. Included studies could be broadly categorised into studies that attempted to directly investigate the barriers and facilitators and studies that provided implicit evidence. Key findings were that faculty development and quality assurance were facilitators of good quality item writing while barriers at both an individual and institutional level include motivation, time constraints and scheduling. CONCLUSIONS: Although studies identified factors that may improve or negatively impact on the quality of items written by faculty and clinicians, there was limited research investigating the barriers and facilitators for individual item writers. Investigating these challenges could lead to more targeted and effective interventions to improve both the quality and quantity of assessment items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A recent scoping review evaluating the barriers to writing quality test items based on 13 studies has concluded that motivation, time constraints, and scheduling were the most common [19].”
From Artificial intelligence and medical education: application in classroom instruction and student assessment using a pharmacology & therapeutics case study (2024) · cites this paper as [19]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Steinert, Y., Mann, K., Centeno, A., Dolmans, D., Spencer, J., Gelula, M., & Prideaux, D. (2006) · Medical Teacher · doi:10.1080/01421590600902976 · Cited by 1,417
AMEE Guide No 20: The good teacher is more than a lecturer - the twelve roles of the teacher
Crosby, R. M. H. (2000) · Medical Teacher · doi:10.1080/014215900409429 · Cited by 885 · cited 1×
“Time constraints and scheduling The challenges of allocating time for item writing, item writing training and committee review meetings for academics and clinicians who may have other roles and commitments are obvious [42, 43].”
BackgroundLane, S. (2015) · Routledge eBooks · doi:10.4324/9780203102961 · Cited by 728
Strategies for improving teaching practices: a comprehensive approach to faculty development
Wilkerson, L., & Irby, D. M. (1998) · Academic Medicine · doi:10.1097/00001888-199804000-00011 · Cited by 567
A contemporary approach to validity arguments: a practical guide to Kane's framework
Cook, D. A., Brydges, R., Ginsburg, S., & Hatala, R. (2015) · Medical Education · doi:10.1111/medu.12678 · Cited by 554
Improving the fairness of multiple-choice questions: a literature review
McCoubrie, P. (2004) · Medical Teacher · doi:10.1080/01421590400013495 · Cited by 313
Research works printed but not linked: 2
- Case SM Swanson DB Constructing written test questions for the basic and clinical sciences 1998 3 Philadelphia National Board of Medical Examiners
- Iramaneerat C The impact of item writer training on item statistics of multiple-choice items for medical student examination Siriraj Med J 2012 64 6 178 182
Cited by
Law, A. K.-K., So, J. L. T., Lui, C. T., Choi, Y. F., Cheung, K. H., Hung, K. K. C., & Graham, C. A. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06796-6 · Cited by 127
Sridharan, K., & Sequeira, R. P. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05365-7 · Cited by 114
“A recent scoping review evaluating the barriers to writing quality test items based on 13 studies has concluded that motivation, time constraints, and scheduling were the most common [19].”
BackgroundScoping reviews in medical education: A scoping review
Maggio, L. A., Larsen, K., Thomas, A., Costello, J. A., & Artino, A. R. (2021) · Medical Education · doi:10.1111/medu.14431 · Cited by 104
Bacterial lifestyle shapes pangenomes
Dewar, A. E., Hao, C., Belcher, L. J., Ghoul, M., & West, S. A. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320170121 · Cited by 57
Filho, P. T. H., & Bicudo, A. M. (2020) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v44.1-20190130.ing · Cited by 17
Metadata
- Authors
- Karthikeyan, S., O’Connor, E., & Hu, W.
- Affiliations
- Western Sydney University (AU)
- Corresponding author
- O’Connor, Elizabeth
- Venue
- BMC Medical Education
- Published
- 2019-05-02
- Volume
- 19
- Issue
- 1
- Pages
- 123-123
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC6498649
- OpenAlex
- W2947096276
- Cited by
- 41
- References
- 49
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 13 · 2023: 3 · 2022: 5 · 2021: 1 · 2020: 5
- FWCI
- 2.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Western Sydney University
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Education › Medical Education and Admissions
- Keywords
- item writing, medical school examinations, barriers and facilitators, faculty development, quality assurance, exam question design, medical education assessment, time constraints, motivation
- MeSH terms
- Clinical Clerkship, Curriculum, Education, Medical, Undergraduate, Educational Measurement, Humans, Schools, Medical, Writing, Program Evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Barriers and facilitators to writing quality items for medical school assessments – a scoping review. https://app.cochat.ai/papers/10.1186/s12909-019-1544-8
- The paper
- Karthikeyan, S., O’Connor, E., & Hu, W. (2019). Barriers and facilitators to writing quality items for medical school assessments – a scoping review. BMC Medical Education. https://doi.org/10.1186/s12909-019-1544-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
