The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Impact of item‐writing flaws in multiple‐choice questions on student achievement in high‐stakes nursing assessments
Abstract
Context Multiple‐choice questions (MCQs) are frequently used to assess students in health science disciplines. However, few educators have formal instruction in writing MCQs and MCQ items often have item‐writing flaws. The purpose of this study was to examine the impact of item‐writing flaws on student achievement in high‐stakes assessments in a nursing programme in an English‐language university in Hong Kong. Methods From a larger sample, we selected 10 summative test papers that were administered to undergraduate nursing students in 1 nursing department. All test items were reviewed for item‐writing flaws by a 4‐person consensus panel. Items were classified as ‘flawed’ if they contained ≥ 1 flaw. Items not containing item‐writing violations were classified as ‘standard’. For each paper, 2 separate scales were computed: a total scale which reflected the characteristics of the assessment as administered and a standard scale which reflected the characteristics of a hypothetical assessment including only unflawed items. Results The proportion of flawed items on the 10 test papers ranged from 28–75%; 47.3% of all items were flawed. Fewer examinees passed the standard scale than the total scale (748 [90.6%] versus 779 [94.3%]). Conversely, the proportion of examinees obtaining a score ≥ 80% was higher on the standard scale than the total scale (173 [20.9%] versus 120 [14.5%]). Conclusions Flawed MCQ items were common in high‐stakes nursing assessments but did not disadvantage borderline students, as has been previously demonstrated. Conversely, high‐achieving students were more likely than borderline students to be penalised by flawed items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The results of this study showed that the frequency of items with negative discrimination index ranged from 1 to 18 which means students with low achievement in the total score answered such items more correctly than those with higher achievement [19].”
From Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia (2025) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1503_5 · Cited by 973
Reliability: on the reproducibility of assessment data
Downing, S. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01932.x · Cited by 721
Different written assessment methods: what can be said about their strengths and weaknesses?
Schuwirth, L. W. T., & Van Der Vleuten, C. P. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01916.x · Cited by 309
Cited by
Barriers and facilitators to writing quality items for medical school assessments – a scoping review
Karthikeyan, S., O’Connor, E., & Hu, W. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1544-8 · Cited by 41
Gebremichael, M. W., Baraki, B., Mehari, M.-A., & Assalfew, B. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06904-6 · Cited by 11
Metadata
- Authors
- Tarrant, M., & Ware, J.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2008-01-08
- Volume
- 42
- Issue
- 2
- Pages
- 198-206
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W1596610711
- Cited by
- 197
- References
- 3
- FWCI
- 4.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of item‐writing flaws in multiple‐choice questions on student achievement in high‐stakes nursing assessments. https://app.cochat.ai/papers/10.1111/j.1365-2923.2007.02957.x
- The paper
- Tarrant, M., & Ware, J. (2008). Impact of item‐writing flaws in multiple‐choice questions on student achievement in high‐stakes nursing assessments. Medical Education. https://doi.org/10.1111/j.1365-2923.2007.02957.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.