Constructing Multiple Choice Questions as a Method for Learning
Open accessAbstract
Introduction: Many different strategies exist to try and encourage students to increase their knowledge and understanding of a subject. This study was undertaken to measure the effect of student-based construction of multiple choice questions (MCQs) as a stimulus for the learning and understanding of topics in clinical surgery. Materials and Methods: The study was carried out at the University of Adelaide, Australia and had 2 components. Fourth-year students were required to provide a case study during a surgical attachment and half of the group was asked to supplement this with MCQs. These students were pre- and post-tested and the effect of the additional intervention (MCQ-construction) measured. Fifth-year students were polled on their preferred methods of learning before and after a learning exercise in which they were asked to undertake a case presentation and create some MCQs. Results: The MCQ questions designed by the students were of a high standard and clearly displayed an understanding of the topic concerned. The 4th-year students in the MCQ construction group showed equivalent outcomes as the case study control group. Students initially ranked MCQ-construction amongst the least stimulating methods of learning, but after the exercise their opinion was significantly more favourable, although still much less than traditional learning methodologies (tutorials, books). Conclusions: Construction of MCQs as a learning tool is an unfamiliar exercise to most students and is an unpopular learning strategy. However, students are capable of producing high quality questions, and the challenge for medical faculties is how best to use this initiative to the students’ advantage. Key words: Educational measurement, Educational models, Medical students
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Student-generated multiple choice questions can enhance higher-order cognitive and metacognitive skills in disciplines such as medicine, biochemistry, and engineering.
“student-generated multiple choice questions (MCQs) can enhance higher-order cognitive and metacognitive skills in disciplines such as medicine, biochemistry, and engineering (Bottomley & Denny, 2011; Palmer & Devitt, 2006; Yu & Liu, 2008).”
From Assessment design through co-creation (2025) · cites this paper as Palmer & Devitt, 2006
Cites
Taxonomy of Educational Objectives. Handbook I: Cognitive Domain
Bloom, B., & Krathwohl, D. R. (1966) · Cited by 4,624 · see citing works
Learning styles and approaches: implications for medical education
Newble, D. I., & Entwistle, N. J. (1986) · Medical Education · doi:10.1111/j.1365-2923.1986.tb01163.x · Cited by 564 · see citing works
Marijuana Craving Questionnaire: development and initial validation of a self‐report instrument
Heishman, S. J., Singleton, E. G., & Liguori, A. (2001) · Addiction · doi:10.1046/j.1360-0443.2001.967102312.x · Cited by 232 · see citing works
Multiple‐choice testing in anatomy
Nnodim, J. O. (1992) · Medical Education · doi:10.1111/j.1365-2923.1992.tb00173.x · Cited by 40 · see citing works
Involving students in question writing: a unique feedback with fringe benefits.
Sircar, S., & Tandon, O. P. (1999) · AJP Advances in Physiology Education · doi:10.1152/advances.1999.277.6.s84 · Cited by 18 · see citing works
Student Exam Creation as a Learning Tool.
Brink, J., Capps, E., & Sutko, A. A. (2004) · College student journal · Cited by 14 · see citing works
The multiple choice tutorial: its use in the reinforcement of fundamentals in medical education
Fox, J. (1983) · Medical Education · doi:10.1111/j.1365-2923.1983.tb01106.x · Cited by 11 · see citing works
Sriram, T. G., Chandrashekar, C. R., Moily, S., Kumar, K. V. K., Raghuram, A., Isaac, M., & Murthy, R. S. (1989) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/bf01788037 · Cited by 10 · see citing works
To Learn is to Teach is to Create the Final Exam
Brown, I. W. (1991) · College Teaching · doi:10.1080/87567555.1991.9933419 · Cited by 9 · see citing works
A trial of multiple choice examination in pharmacology
Gandhi, I. S., & Ghosh, M. N. (1978) · Medical Education · doi:10.1111/j.1365-2923.1978.tb00352.x · Cited by 5 · see citing works
Use of a multiple choice questionnaire to stimulate TB officers to read the TB manual in Malawi.
Salaniponi, F. M. L., Kwanjana, J. H., Gondwe, M., & Harries, A. D. (2004) · PubMed · Cited by 1 · see citing works
MCQ assessment of introductory clinical course for fourth year medical students.
Gp, D., McDougall, J. A., & Fj, R. (1978) · PubMed · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Palmer, E. J., & Devitt, P. G. (2007) · BMC Medical Education · doi:10.1186/1472-6920-7-49 · Cited by 294 · see citing works
Self-citationThe modified essay question: Its exit from the exit examination?
Palmer, E., Duggan, P., Devitt, P. G., & Russell, R. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.488705 · Cited by 58 · see citing works
Self-citationThe impact of content co-creation on academic achievement
Doyle, E., Buckley, P. G., & McCarthy, B. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1782832 · Cited by 53 · see citing works
Constructive evaluation: a pedagogy of student-contributed assessment
Luxton-Reilly, A., & Denny, P. C. (2010) · Computer Science Education · doi:10.1080/08993408.2010.486275 · Cited by 51 · see citing works
Doyle, E., Buckley, P., & Whelan, J. (2019) · Teaching in Higher Education · doi:10.1080/13562517.2018.1498077 · Cited by 50 · see citing works
Does developing multiple-choice Questions Improve Medical Students’ Learning? A Systematic Review
Touissi, Y., Hjiej, G., Hajjioui, A., Ibrahimi, A., & Fourtassi, M. (2022) · Medical Education Online · doi:10.1080/10872981.2021.2005505 · Cited by 46 · see citing works
Kurtz, J. B., Lourie, M. A., Holman, E. G., Grob, K. L., & Monrad, S. U. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1630239 · Cited by 48 · see citing works
Question-writing as a learning tool for students – outcomes from curricular exams
Jobs, A., Twesten, C., Göbel, A., Bonnemeier, H., Lehnert, H., & Weitz, G. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-89 · Cited by 36 · see citing works
Zhang, Q., Huang, Z., Huang, Y., Wang, G., Zhang, R., Yang, J., Cheng, Y., Chen, B., Wang, H., Qiu, K., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08085-8 · Cited by 35 · see citing works
Quality assurance and validity of AI-generated single best answer questions
Ahmed, A., Kerr, E., & O’Malley, A. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06881-w · Cited by 39 · see citing works
Student use of PeerWise: A multi‐institutional, multidisciplinary evaluation
Kay, A. E., Hardy, J., & Galloway, R. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12754 · Cited by 29 · see citing works
Doyle, E., & Buckley, P. G. (2020) · Interactive Learning Environments · doi:10.1080/10494820.2020.1777166 · Cited by 26 · see citing works
Guilding, C., Pye, R. E., Butler, S., Atkinson, M., & Field, E. (2021) · Pharmacology Research & Perspectives · doi:10.1002/prp2.833 · Cited by 26 · see citing works
Tiemeier, A. M., Stacy, Z. A., & Burke, J. M. (2011) · INNOVATIONS in pharmacy · doi:10.24926/iip.v2i2.224 · Cited by 26 · see citing works
Student‐written single‐best answer questions predict performance in finals
Walsh, J. L., Harris, B. H. L., Tayyaba, S., Harris, D. A., & Smith, P. (2015) · The Clinical Teacher · doi:10.1111/tct.12445 · Cited by 24 · see citing works
Herrero, J. I., Lucena, F., & Quiroga, J. A. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1469-2 · Cited by 23 · see citing works
Crowdsourcing for assessment items to support adaptive learning
Tackett, S. A., Raymond, M. R., Desai, R., Haist, S. A., Morales, A., Gaglani, S. M., & Clyman, S. G. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1490704 · Cited by 22 · see citing works
Bobby, Z., Radhika, M., Nandeesha, H., Balasubramanian, A., Prerna, S., Nimesh, A., & Thippeswamy, D. N. (2012) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20611 · Cited by 22 · see citing works
The effect of question generation activity on students' learning and perception.
Shakurnia, A., Aslami, M., & Bijanzadeh, M. (2018) · PubMed Central · Cited by 20 · see citing works
Wagener, S., Möltner, A., Tımbıl, S., Gornostayeva, M., Schultz, J., Brüstle, P., Mohr, D., Beken, A. V., Better, J., Fries, M., et al. (2015) · Europe PMC (PubMed Central) · doi:10.3205/zma000988 · Cited by 20 · see citing works
Students generate items for an online formative assessment: Is it motivating?
Poot, R., de Kleijn, R. A. M., van Rijen, H. V. M., & van Tartwijk, J. (2016) · Medical Teacher · doi:10.1080/0142159x.2017.1270428 · Cited by 20 · see citing works
Kay, A. E., Hardy, J., & Galloway, R. (2018) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.14.010119 · Cited by 19 · see citing works
Mamaklı, S., Alimoğlu, M. K., & Daloglu, M. U. (2023) · AJP Advances in Physiology Education · doi:10.1152/advan.00122.2022 · Cited by 26 · see citing works
Yu, F., & Wu, C. P. (2012) · Tamkang University Institutional Repository (TKUIR) · doi:10.3966/2073753x2012125704005 · Cited by 18 · see citing works
Learning through Osmosis: A collaborative platform for medical education
Haynes, M. R., Gaglani, S. M., Wilcox, M. V., Mitchell, T., DeLeon, V. B., & Goldberg, H. R. (2014) · Innovations in Global Medical and Health Education · doi:10.5339/igmhe.2014.2 · Cited by 18 · see citing works
Hutchinson, D., & Wells, J. (2013) · Creative Education · doi:10.4236/ce.2013.47a2014 · Cited by 17 · see citing works
Chandrasekar, H., Gesundheit, N., Nevins, A., Pompei, P., Bruce, J. S., & Merrell, S. B. (2018) · Advances in Medical Education and Practice · doi:10.2147/amep.s155481 · Cited by 17 · see citing works
Mutlu, A. (2017) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21097 · Cited by 15 · see citing works
Automated multiple-choice question generation in Spanish using neural language models
de-Fitero-Dominguez, D., García‐Cabot, A., & García‐López, E. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10076-7 · Cited by 14 · see citing works
Supporting student-generated free-response questions
Luxton-Reilly, A., Denny, P. C., Plimmer, B., & Bertinshaw, D. (2011) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1999747.1999792 · Cited by 12 · see citing works
Witte, B. D., Reynaert, V., Hutain, J., Kieken, D., Jabbour, J., & Possik, J. (2024) · Computers & Education X Reality · doi:10.1016/j.cexr.2024.100085 · Cited by 12 · see citing works
Ali, R., Sultan, A. S., & Zahid, N. (2020) · Journal of the Pakistan Medical Association · doi:10.47391/jpma.1068 · Cited by 8 · see citing works
Assessing the Benefit of Student Self-Generated Multiple-Choice Questions on Examination Performance
Geiger, M. A., Middleton, M. M., & Tahseen, M. (2020) · Issues in Accounting Education · doi:10.2308/issues-19-110 · Cited by 7 · see citing works
Khan, J. S., Mukhtar, O., Tabasum, S., Shaheen, N., Farooq, M. U., Irfan, M., Sattar, A., Nabeel, M., Imran, M., Rafique, S., et al. (2010) · PubMed · Cited by 7 · see citing works
La evaluación del conocimiento en medicina
Carranza, R. R. (2008) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 6 · see citing works
Sibomana, I., Karenzi, I. D., Niyongombwa, I., Byiringiro, J. C., Gashegu, J. K., & Ntirenganya, F. (2020) · Advances in Medical Education and Practice · doi:10.2147/amep.s274298 · Cited by 6 · see citing works
McTaggart, S., & Hortsch, M. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2472 · Cited by 5 · see citing works
Er, H. M. (2014) · International e-Journal of Science Medicine & Education · doi:10.56026/imu.8.3.9 · Cited by 5 · see citing works
Role of Effective Feed Back in Multiple Choice Questions (MCQs) Designing for Faculty Development
Danish, K. F. (2010) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 5 · see citing works
MCQ-construction improves Quality of Essay Assessment among undergraduate dental students
Pan, P. Y. T., Wei, W. W. C., Loh, P. L., Shen, L., & Yu, V. S. H. (2016) · Singapore Dental Journal · doi:10.1016/j.sdj.2016.04.001 · Cited by 4 · see citing works
Educational benefits of writing multiple-choice questions (MCQs) with evidence-based explanation
Tuma, F. (2021) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2021-139876 · Cited by 4 · see citing works
Assessment design through co-creation
Williams, A., & Ingle, E. (2025) · International Journal for Students as Partners · doi:10.15173/ijsap.v9i1.5802 · Cited by 3 · see citing works
Less is more? A systematic review and network meta-analysis on MCQ option numbers
Sridharan, K., & Sivaramakrishnan, G. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08026-5 · Cited by 3 · see citing works
Qi, J., Zhao, H., Xiang, R., Zhang, Y., Zhang, X., Wang, C., Jian, L., & Ji, F. (2026) · Journal of Research on Technology in Education · doi:10.1080/15391523.2025.2601067 · Cited by 7 · see citing works
Practice it to ace it: students writing practice questions for tests
Choi, Y., Jenkins, L. D., & Crowther, G. J. (2025) · AJP Advances in Physiology Education · doi:10.1152/advan.00172.2024 · Cited by 3 · see citing works
Hasan, M. M., Adnan, M. M., & Waheed, B. (2021) · Advances in Medical Education and Practice · doi:10.2147/amep.s299759 · Cited by 3 · see citing works
Evaluation of MCQs for Judgement of Higher Levels of Cognitive Learning
Mukhopadhyay, M., Bhowmick, K., Chakraborty, S., Roy, D., Sen, P. K., & Chakraborty, I. (2010) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 3 · see citing works
Rajappa, M., Bobby, Z., Nandeesha, H., Rajendran, S., Ragul, A., Yuvaraj, B., Revathy, G., & Priyadarssini, M. (2016) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20944 · Cited by 3 · see citing works
Multiple Choice Questions As A Teaching Learning Tool In Addition To Assessment Method
Appaji, A., & Kulkarni, R. (2012) · National journal of integrated research in medicine · Cited by 3 · see citing works
Wrzesińska, M. A., Rakoczy, J., Binder-Olibrowska, K. W., Kostyła, M., Allott, V. E. S., Harris, S. R. L., Walsh, J. L., Handa, A. I., & Harris, B. H. L. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08272-7 · Cited by 2 · see citing works
Learning Outcomes From Health Professions Students Who Generate Multiple-Choice Questions
Griffith, P. B., & Pawlow, P. C. (2025) · Nurse Educator · doi:10.1097/nne.0000000000001926 · Cited by 1 · see citing works
Beedimani, R. S., & Shetkar, S. (2014) · International Journal of Basic & Clinical Pharmacology · doi:10.5455/2319-2003.ijbcp20141025 · Cited by 1 · see citing works
Zahoor, A.-W., Farooqui, S. I., Khan, A., Kazmi, S. A. M., Qamar, N., & Rizvi, J. (2022) · Journal of Health and Allied Sciences NU · doi:10.1055/s-0042-1755447 · Cited by 2 · see citing works
Khoo, H., Amin, Z., & Chong, Y. S. (2006) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.v35n9p597 · Cited by 1 · see citing works
Learning through Osmosis: A collaborative platform for medical
Haynes, R., Gaglani, S. M., Wilcox, M. V., Mitchell, T. R., DeLeon, V. B., & Goldberg, H. R. (2014)
Deeper Learning by Putting Students in Charge of the Problem Lifecycle
Bieber, M. P. (2018)
Mustafa, N., Tufail, S., Ahmad, M., Mushtaq, Q. U. A., Aslam, P., & Sarwar, R. (2021) · Life and Science · doi:10.37185/lns.1.1.212
(2008) · Elsevier eBooks · doi:10.1016/b978-0-7295-3827-5.50011-6
Osawa, G., Kato, T., & Nakaya, H. (2022) · 日本歯周病学会会誌 · doi:10.2329/perio.64.192
Quality of multiple choice question items: item analysis
Alemu, A. T., Tesfa, H., Mulugeta, A., Fenta, E. T., & Belay, M. A. (2024) · International Journal of Scientific Reports · doi:10.18203/issn.2454-2156.intjscirep20241316
- Authors
- Palmer, E., & Devitt, P.
- Affiliations
- The University of Adelaide (AU)
- Corresponding author
- Palmer, Edward
- ORCID
- Palmer, Edward
- Venue
- Annals of the Academy of Medicine, Singapore
- Publisher
- Academy of Medicine, Singapore
- Published
- 2006-09-15
- Volume
- 35
- Issue
- 9
- Pages
- 604-608
- ISSN
- 0304-4602 (ISSN-L)
- OpenAlex
- W67149822
- Cited by
- 60
- References
- 12
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 4 · 2023: 1 · 2022: 2 · 2021: 5 · 2020: 5 · 2019: 3 · 2018: 6 · 2017: 1 · 2016: 3 · 2015: 2 · 2014: 4 · 2013: 2 · 2012: 3
- FWCI
- 1.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annals of the Academy of Medicine Singapore (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Education › Innovative Teaching Methods
- Social Sciences › Education › Problem and Project Based Learning
- Keywords
- student-generated questions, medical students, case-based learning, case presentation
- MeSH terms
- Australia, Educational Measurement, Educational Status, Humans, Learning, Surveys and Questionnaires, Students, Medical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
