The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index; none of the 21 sources its claims cite is checked for support yet.
Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia
Open accessAbstract
BACKGROUND: Rapid expansion of higher education and graduation rate in Ethiopia, doesn't tell much about quality of core processes like teaching and learning. Despite the fact that preparation of a good item is essential, little attention has been paid to examining characteristics of exam items such as difficulty, discrimination, and distractor efficiency. Unless these characters are examined results may lead to biased evaluation. To address the current issue, this study aimed to carry out item analysis of multiple choice questions (MCQs) in undergraduate health sciences students of Mekelle University, Tigray, Ethiopia in order to evaluate correlations between item difficulty, item discrimination and distraction efficiency. METHODS: Institution based cross sectional study was conducted from March to April 2020. A total of 189 exam papers with 539 multiple choice items and 2224 distracters were analyzed in terms of difficulty, discrimination, distractor efficiency and internal consistency reliability. SPSS version 25 was used for analysis & findings presented using tables & figures. Pearson's correlation & one-way analysis of variance were used. RESULTS: In this study mean difficulty ranged from 0.57-0.81, and discrimination from 0.27-0.52. Difficulty and discrimination were negatively correlated. Six departments achieved excellent reliability, indicating r>0.9. However, the reliability score of Medicine and Pharmacy departments was poor (r<0.5), suggesting areas for improvement. The remaining two departments exhibited acceptable reliability. More than three fourth of the items had non-functional distractors. CONCLUSIONS: The internal consistency of the exams from six departments demonstrated excellent reliability. However, the exams from the Medicine and Pharmacy departments showed areas for improvement. In order to enhance assessment effectiveness, it's crucial to incorporate items that exhibit both desirable difficulty and high discrimination along with functionally realistic distracters. This approach ensures assessments accuracy.
Overview
CoChat Summary
TL;DR
This cross-sectional item analysis of 189 exam papers, 539 MCQs, and 2,224 distractors from Mekelle University health sciences exams found generally acceptable difficulty and discrimination but substantial non-functional distractors. Reliability was excellent in six departments but poor in Medicine and Pharmacy.
Key findings
- Mean difficulty ranged from 0.57–0.81 and mean discrimination from 0.27–0.52; difficulty and discrimination were negatively correlated.
- Six departments achieved excellent reliability (KR-20 > 0.9), while Medicine (0.39) and Pharmacy (0.47) had poor reliability; Physiotherapy was highest at 0.96.
- 425 items (78.8%) contained non-functional distractors, and 751 of 2,224 distractors (33.8%) were non-functional; overall mean distractor efficiency was 58%.
- Significant negative DIF–DI correlations occurred in Environmental health (r = −0.3, P = 0.04) and Health informatics (r = −0.48, P = 0.008); Dentistry showed significant DI differences by difficulty level, F(2, 157) = 7.01, P = 0.001, with difficult items having lower mean DI (0.1443) than acceptable (0.3316) or easy (0.4181) items.
Methods
- Institution-based cross-sectional study conducted March–April 2020 at Mekelle University’s College of Health Sciences, using the 2018/19 summative Human Anatomy exam as the data source.
- Analyzed 189 exam papers, 539 MCQs, and 2,224 distractors from ten departments, selected by stratified random sampling with proportionate allocation; Nursing exams (n = 17) were unavailable.
- Data entered into SPSS version 25; calculated difficulty index, discrimination index, distractor efficiency, and KR-20 reliability; used Pearson correlation and one-way ANOVA with P < 0.05.
Limitations
- Stated: exams were written in English while examinees and instructors spoke English as a second language, but ESL issues were not considered; Nursing exams were unavailable, limiting generalizability.
- Evident from the text: the analysis is confined to a single prerequisite course (Human Anatomy) and ten departments, so findings may not extend to other courses or institutions.
- Evident from the text: the study used total items rather than post-validation item analysis, which the authors note may explain differences from prior distractor-efficiency findings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
0 Valid · 0 Not valid · 16 Not checked · 39 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this study mean difficulty ranged from 0.57–0.81, and discrimination from 0.27–0.52.”
- Also stated in: § Discussion · plain
“Looking at each department’s mean DI in this study ranged from 0.27 to 0.52.”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The DE was significantly correlated to the DIF and DIs for three department exams: Midwifery, Environmental health and Health informatics with higher DEs for difficult and acceptable items than easy items.”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Correlation r between DIF and DI with distractor efficiency
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The DE was higher for items with excellent and acceptable DIs compared to items with poor discrimination.”
- Also stated in: § Discussion · plain
“The current study showed that DE was higher for items with excellent and acceptable DIs compared to items with poor discrimination.”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Correlation r between DIF and DI with distractor efficiency
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was a significant negative correlation between DIFI and DI for two department exams: Environmental health and Health informatics (r = −0.3 and −0.48; P = 0.04 and 0.008).”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Correlation between difficulty index and discrimination index
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The DE was significantly correlated to the DIF and DIs for three department exams: Midwifery, Environmental health and Health informatics with higher DEs for difficult and acceptable items than easy items.”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Correlation r between DIF and DI with distractor efficiency
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 55 claims and to verify the 18 references still open.
- It may state two separate claims as one. 13
- The quote only partly states this claim. 4
- Probably not a substantial claim. 7
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(2, 157) = 7.01reported p = .001 · recomputed p = .001
“F(2, 157) = 7.01, p = .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Methods and materials > Sample size determination
“andN= source population (366).”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Methods and materials > Sample size determination
“since the College of Health Sciences has a finite number of exams approximately 2,575 (less than 10,000), population correction formula was applied.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Interpretation and implication
“Then the Post hoc analysis (Tukey's HSD) showed that difficult items had a significantly lower discrimination index compared to acceptable and easy items.”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Mean comparison of difficulty index and discrimination
“| Tukey HSD | Accebtable | Difficult | .18731 | .08813 | .088 | -.0212 | .3958 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Info | - | 7(26.3) | 11(36.7) | 11(36.7) | 1(3.3) | 30(100) |”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Distractor efficiency
Reported 26.3 · recomputed 23.333333
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Mean comparison of difficulty index and discrimination
“| Tukey HSD | Difficult | Easy | -.18731 | .08813 | .088 | -.3958 | .0212 |”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Mean comparison of difficulty index and discrimination
“| Tukey HSD | Difficult | Easy | -.27387* | .07688 | .001 | -.4558 | -.0920 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Results > Distractor efficiency
“the highest percentage was observed in Anesthesia exam 73.6% (with SD of 25.2)”
§ Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia > Discussion
“Regarding mean distractor efficiency the present study showed the range of 30.1%.−73.9%.”
1 more finding
Create a free account to see every finding of this check.
Citations
Cites
IOSR Journal of Dental and Medical Sciences
(2025) · IOSR Journal of Dental and Medical Sciences · doi:10.9790/0853 · Cited by 830
Federal Democratic Republic of Ethiopia: Political Reforms and Federalism
Kefale, A. (2020) · The Forum of Federations Handbook of Federal Countries 2020 · doi:10.1007/978-3-030-42088-8_11 · Cited by 733
Post-examination analysis of objective tests
Tavakol, M., & Dennick, R. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.564682 · Cited by 198
Tarrant, M., & Ware, J. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02957.x · Cited by 197
Quaigrain, K., & Arhin, A. K. (2017) · Cogent Education · doi:10.1080/2331186x.2017.1301013 · Cited by 169
Kumar, P., Gajjar, S., Sharma, R., & Rana, M. (2014) · Indian Journal of Community Medicine · doi:10.4103/0970-0218.126347 · Cited by 140
Quality of Education in Private Higher Institutions in Ethiopia: The Role of Governance
Yirdaw, A. (2016) · SAGE Open · doi:10.1177/2158244015624950 · Cited by 84
Item Analysis for Criterion-Referenced Tests.
McCowan, R. J., & McCowan, S. C. (1999) · Cited by 81
Internal Quality Assurance of Academic Programs: A Case Study in Vietnamese Higher Education
Pham, N. T. T., Nguyen, C., Pham, H. T., & Ta, H. T. T. (2022) · SAGE Open · doi:10.1177/21582440221144419 · Cited by 47
The Use Of Item Analysis For The Improvement Of Objective Examinations
Siri, A., & Freddano, M. (2011) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2011.11.224 · Cited by 44
Research works printed but not linked: 2
- Ashagre E. Improving Test Construction Skills through Item Analysis. Addis Ababa, Ethiopia: UN Conference Center; August 29, 2009. 2009.
- Musa A, Shaheen S, Ahmed A. Distractor analysis of multiple choice questions: a descriptive study of physiology examinations at the Faculty of Medicine. University of Khartoum Khartoum Medical Journal. 2021;11(1):1444–53.
Cited by
Augeard, N., Miller, J., Bostick, G. P., St‐Onge, C., Tousignant‐Laflamme, Y., Hudon, A., Walton, D. M., Singer, L. N., Cooper, L., Bussières, A., et al. (2025) · Canadian Journal of Pain · doi:10.1080/24740527.2025.2512728 · Cited by 3
Development and validation of curriculum-based problem-solving MCQ classroom tests in mathematics
Mata, P. V., Abao, Q. R. H., Bihasa, R. K. S., Kiamco, G. N., & Neiz, A. M. C. (2026) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v15i1.35698 · Cited by 3
Novan, A., & Kamalia, P. U. (2025) · ASATIZA Jurnal Pendidikan · doi:10.46963/asatiza.v6i3.3168 · Cited by 2
Saputro, H. T., Nurhasan, U., & Wijayaningrum, V. N. (2025) · Journal of Applied Informatics and Computing · doi:10.30871/jaic.v9i6.10901
Belle, V. S., Rao, A., Shetty, P. P., & Nayak, K. P. (2025) · Journal of Datta Meghe Institute of Medical Sciences University · doi:10.4103/jdmimsu.jdmimsu_554_25
Metadata
- Authors
- Gebremichael, M. W., Baraki, B., Mehari, M.-A., & Assalfew, B.
- Affiliations
- Mekelle University (ET)
- Dire Dawa University (ET)
- Corresponding author
- Gebremichael, Mengistu Welday
- Venue
- BMC Medical Education
- Published
- 2025-03-26
- Volume
- 25
- Issue
- 1
- Pages
- 441-441
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC11938641
- OpenAlex
- W4408875265
- Semantic Scholar
- 46c56d7ee99ddf579c51b002745d2e2df2b30385
- Cited by
- 11
- References
- 16
- Citations by year
- 2026: 7 · 2025: 4
- FWCI
- 8.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- BMC Medical Education (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Mekelle University
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- item analysis, multiple-choice questions, item difficulty, item discrimination, distractor efficiency, internal consistency, health sciences education, undergraduate assessment, medical education, pharmacy education, Mekelle University
- MeSH terms
- Cross-Sectional Studies, Educational Measurement, Ethiopia, Female, Humans, Male, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia. https://app.cochat.ai/papers/10.1186/s12909-025-06904-6
- The paper
- Gebremichael, M. W., Baraki, B., Mehari, M.-A., & Assalfew, B. (2025). Item analysis of multiple choice questions from assessment of health sciences students, Tigray, Ethiopia. BMC Medical Education. https://doi.org/10.1186/s12909-025-06904-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.