The DOI matches its Crossref record; 76 of the 80 references it cites were found in a registry or an index.
A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment
Abstract
A taxonomy of 31 multiple-choice item-writing guidelines was validated through a logical process that included two sources of evidence: the consensus achieved from reviewing what was found in 27 textbooks on educational testing and the results of 27 research studies and reviews published since 1990. This taxonomy is mainly intended for classroom assessment. Because textbooks have potential to educate teachers and future teachers, textbook writers are encouraged to consider these findings in future editions of their textbooks. This taxonomy may also have usefulness for developing test items for large-scale assessments. Finally, research on multiple-choice item writing is discussed both from substantive and methodological viewpoints.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Complex questions: Also known as K-type questions, options would consist of combinations, either of a set of options inside the very stem, or of other neighboring options. Such questions evaluate rather logical skills than content knowledge.”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [11]
In the citing paper
“There is a consensus in literature regarding the good and bad practices when it comes to creating assessment items such as MCQs, often reported in item writing guidelines [10,11,12].”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [11]
In the citing paper
“Key too long: A key can be more easily identified if it is more detailed than the distractors.”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [11]
In the citing paper
“Grammar hint: If the stem gives a grammar hint that would exclude several distractors, the key can be more easily guessed.”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [11]
In the citing paper
“No key: An MCQ needs at least one key, otherwise it will be impossible to distinguish it from a non-answered question.”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [11]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The standards for educational and psychological testing.
Eignor, D. R. (2013) · APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. · doi:10.1037/14047-013 · Cited by 6,988
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,882
Essentials of Educational Measurement
Garvin, A. D., & Ebel, R. L. (1980) · Educational Researcher · doi:10.2307/1175572 · Cited by 1,481
The Impact of Classroom Evaluation Practices on Students
Crooks, T. J. (1988) · Review of Educational Research · doi:10.3102/00346543058004438 · Cited by 1,369
Measurement and Assessment in Teaching
Linn, R. L., & Gronlund, N. E. (1994) · Medical Entomology and Zoology · Cited by 1,275
Measurement and Evaluation in Psychology and Education.
S., R., Thorndike, R. L., & Hagen, E. (1961) · Journal of the American Statistical Association · doi:10.2307/2282039 · Cited by 1,230
Educational Assessment of Students
Nitko, A. J. (1996) · Cited by 1,033
Classroom Assessment: What Teachers Need to Know
Popham, W. J. (1995) · Cited by 815
Item Clusters and Computerized Adaptive Testing: A Case for Testlets
Wainer, H., & Kiely, G. L. (1987) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1987.tb00274.x · Cited by 630
Journal of Educational Measurement
(2014) · Journal of Educational Measurement · doi:10.1111/(issn)1745-3984 · Cited by 563
Research works printed but not linked: 4
- Cronbach L. J., 1970, Psychometrika, 35, 509
- Ebel, R. L. (1951). Writing the test item. In E. F. Lindquist (Ed.), Educational Measurement (1st ed., pp. 185-249). Washington, DC: American Council on Education.
- Rodriguez, M. C. (2002). Choosing an item format. In G. A. Tindal and T. M. Haladyna (Eds.), Large-scale assessment programs for all students: Development, implementation, and analysis (pp. 211-229). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
- Ryan, J. M. & Demark, S. (2002). Variation in achievement scores related to gender, item format and content area tested. In G. A. Tindal and T. M. Haladyna (Eds.), Large-scale assessment programs for all students: Development, implementation, and analysis (pp. 67-88). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Cited by
The use of flipped classrooms in higher education: A scoping review
O'Flaherty, J., & Phillips, C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.002 · Cited by 2,152
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434
Self-citationGarfield, J., & Ben‐Zvi, D. (2007) · International Statistical Review · doi:10.1111/j.1751-5823.2007.00029.x · Cited by 549
Using reversed items in Likert scales: A questionable practice
Suárez-Álvarez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018) · Psicothema · doi:10.7334/psicothema2018.33 · Cited by 422
Construct‐Irrelevant Variance in High‐Stakes Testing
Haladyna, T. M., & Downing, S. M. (2004) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2004.tb00149.x · Cited by 386
Self-citation
Metadata
- Authors
- Haladyna, T. M., Downing, S. M., & Rodriguez, M. C.
- Affiliations
- Arizona State University (US)
- University of Illinois Chicago (US)
- University of Minnesota (US)
- Venue
- Applied Measurement in Education
- Publisher
- Informa UK Limited
- Published
- 2002-07
- Volume
- 15
- Issue
- 3
- Pages
- 309-333
- ISSN
- 0895-7347 (ISSN-L)
- 1532-4818
- OpenAlex
- W2112630006
- Cited by
- 973
- References
- 80
- Citations by year
- 2026: 90 · 2025: 65 · 2024: 50 · 2023: 56 · 2022: 41 · 2021: 50 · 2020: 69 · 2019: 55 · 2018: 51 · 2017: 62 · 2016: 54 · 2015: 53 · 2014: 59 · 2013: 48 · 2012: 39
- FWCI
- 42.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Applied Measurement in Education (publishedVersion)
- Topics
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- item writing guidelines, classroom assessment, large-scale assessment, exam question design, teacher professional development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. https://app.cochat.ai/papers/10.1207/s15324818ame1503_5
- The paper
- Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. Applied Measurement in Education. https://doi.org/10.1207/s15324818ame1503_5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.