The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Developing questionnaires for educational research: AMEE Guide No. 87
Open accessAbstract
In this AMEE Guide, we consider the design and development of self-administered surveys, commonly called questionnaires. Questionnaires are widely employed in medical education research. Unfortunately, the processes used to develop such questionnaires vary in quality and lack consistent, rigorous standards. Consequently, the quality of the questionnaires used in medical education research is highly variable. To address this problem, this AMEE Guide presents a systematic, seven-step process for designing high-quality questionnaires, with particular emphasis on developing survey scales. These seven steps do not address all aspects of survey design, nor do they represent the only way to develop a high-quality questionnaire. Instead, these steps synthesize multiple survey design techniques and organize them into a cohesive process for questionnaire developers of all levels. Addressing each of these steps systematically will improve the probabilities that survey designers will accurately measure what they intend to measure.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 1×
“Using experts to systematically review the survey’s content can substantially improve the overall quality and representativeness of the scale items (Polit & Beck 2006).”
BackgroundThe Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Yin, R. K. (2009). Case study research: Design and methods (4th Ed.). Thousand Oaks, CA: Sage.
Aberdeen, T. (2013) · The Canadian Journal of Action Research · doi:10.33524/cjar.v14i1.73 · Cited by 3,250
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
Willis, G. (2005) · doi:10.4135/9781412983655 · Cited by 1,778 · cited 2×
“One means of collecting such evidence is achieved through a process known as cognitive interviewing or cognitive pre-testing (Willis 2005).”
MethodFabrigar, L. R., & Wegener, D. T. (2011) · doi:10.1093/acprof:osobl/9780199734177.001.0001 · Cited by 1,408
Cognitive interviewing: verbal data in the design and pretesting of questionnaires
Drennan, J. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02579.x · Cited by 769
Research works printed but not linked: 26
- American Educational Research Association (AERA), American Psychological Association (APA) & National Council on Measurement in Education (NCME), 1999, Standards for education and psychological testing
- Artino AR, 2011, Acad Med, 86, 1327, 10.1097/ACM.0b013e31822f77cc · DOI
- Artino AR, 2012, Acad Med, 87, 1452, 10.1097/ACM.0b013e31826a06b2 · DOI
- Beck CT, 2001, J Nurs Meas, 9, 201, 10.1891/1061-3749.9.2.201 · DOI
- Colliver JA, 2010, Acad Med, 85, 588, 10.1097/ACM.0b013e3181d281dc · DOI · Paper page
- Cook DA, 2006, Am J Med, 119, 166.e7, 10.1016/j.amjmed.2005.10.036 · DOI · Paper page
- Dillman D, 2009, Internet, mail, and mixed-mode surveys: The tailored design method
- Gehlbach H, 2010, Acad Med, 85, 925, 10.1097/ACM.0b013e3181dd3e88 · DOI
- Gehlbach H, 2011, Rev Gen Psychol, 15, 380, 10.1037/a0025704 · DOI · Paper page
- Kane MT, 2006, Validation in educational measurement
- 10.1080/00461520701416231 · DOI · Paper page
- Magee C, 2013, J Grad Med Educ, 5, 1, 10.4300/JGME-D-12-00364.1 · DOI
- McCoach DB, 2013, Instrument development in the affective domain: School and corporate applications, 10.1007/978-1-4614-7135-6 · DOI · Paper page
- McIver JP, 1981, Unidimensional scaling, 10.4135/9781412986441 · DOI · Paper page
- McKenzie JF, 1999, Am J Health Behav, 23, 311, 10.5993/AJHB.23.4.9 · DOI
- Napoles-Springer AM, 2006, Med Care, 44, s21, 10.1097/01.mlr.0000245425.65905.1d · DOI
- Pett MA, 2003, Making sense of factor analysis: The use of factor analysis for instrument development in health care research, 10.4135/9781412984898 · DOI · Paper page
- 10.1080/08098131.2011.648653 · DOI · Paper page
- Rickards G, 2012, J Grad Med Educ, 4, 407, 10.4300/JGME-D-12-00239.1 · DOI
- Rubio DM, 2003, Soc Work Res, 27, 94, 10.1093/swr/27.2.94 · DOI · Paper page
- Schmitt N, 1996, Psychol Assess, 8, 350, 10.1037/1040-3590.8.4.350 · DOI · Paper page
- Sullivan G, 2011, J Grad Med Educ, 3, 119, 10.4300/JGME-D-11-00075.1 · DOI · Paper page
- Sullivan GM, 2013, J Grad Med Educ, 5, 541, 10.4300/JGME-5-4-18 · DOI · Paper page
- Waltz CF, 2005, Measurement in nursing and health research
- Watt T, 2008, Quality of Life Research, 17, 1009, 10.1007/s11136-008-9364-z · DOI
- Willis GB, 2013, J Grad Med Educ, 5, 353, 10.4300/JGME-D-13-00154.1 · DOI · Paper page
Cited by
Tsang, S., Royse, C., & Terkawi, A. (2017) · Saudi Journal of Anaesthesia · doi:10.4103/sja.sja_203_17 · Cited by 1,692
Al-Adwan, A. S., Li, N., Al-Adwan, A., Abbasi, G. A., Albelbisi, N. A., & Habibi, A. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11816-3 · Cited by 637
“Furthermore, a panel of experts consisting of five academics with a significant experience in educational technology and information systems was recruited to assess the content validity of the questionnaire (Artino et al., 2014).”
BackgroundValidation of educational assessments: a primer for simulation and beyond
Cook, D. A., & Hatala, R. (2016) · Advances in Simulation · doi:10.1186/s41077-016-0033-y · Cited by 304
Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study
Sallam, M., Salim, N. A., Barakat, M., Al-Mahzoum, K., Al-Tammemi, A. B., Malaeb, D., Hallit, R., & Hallit, S. (2023) · JMIR Medical Education · doi:10.2196/48254 · Cited by 234
“The survey instrument development process involved an extensive literature review and expert validation, followed by item development and pilot testing to ensure clarity [25,26,45-49].”
Busch, F., Hoffmann, L., Truhn, D., Ortiz-Prado, E., Makowski, M. R., Bressem, K. K., Adams, L. C., COMFORT Consortium, Abdala, N., Navarro, Á. A., et al. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06035-4 · Cited by 108
Busch, F., Hoffmann, L., Truhn, D., Palaian, S., Alomar, M., Shpati, K., Makowski, M. R., Bressem, K. K., & Adams, L. C. (2024) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15911 · Cited by 80
Schwarz (1999) · doi:10.1097/acm.0000000000002002 · Cited by 67
Measuring cognitive load during procedural skills training with colonoscopy as an exemplar
Sewell, J. L., Boscardin, C. K., Young, J. Q., ten Cate, O., & O'Sullivan, P. S. (2016) · Medical Education · doi:10.1111/medu.12965 · Cited by 64
Hauer, K. E., Iverson, N., Quach, A., Yuan, P., Kaner, S., & Boscardin, C. (2018) · Perspectives on Medical Education · doi:10.1007/s40037-018-0449-2 · Cited by 49
Examining the educational impact of the mini-CEX: a randomised controlled study
Martinsen, S. S. S., Espeland, T., Berg, E. A. R., Samstad, E., Lillebo, B., & Slørdahl, T. S. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02670-3 · Cited by 45
Elster, M. J., O’Sullivan, P. S., Muller-Juge, V., Sheu, L., Kaiser, S. V., & Hauer, K. E. (2021) · Perspectives on Medical Education · doi:10.1007/s40037-021-00676-7 · Cited by 20
Medical students’ perceptions of an artificial intelligence (AI) assisted diagnosing program
Robleto, E., Habashi, A., Kaplan, M.-A. B., Riley, R. L., Zhang, C., Bianchi, L., & Shehadeh, L. A. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2305369 · Cited by 19
Selling, S. K., Rooholamini, S. N., Grow, H. M., McPhillips, H., Hoang, K., Blankenburg, R., & Rassbach, C. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005011 · Cited by 15
Nandapalan, K., Smallwood, A., Gething, K., & Alberti, H. (2025) · Cureus · doi:10.7759/cureus.91007 · Cited by 1
Medical students' use of large language models: a national survey
Barr, A. A., Rozman, R. C., Liu, K., Pham, M., Klarenbach, Z., Chinna-Meyyappan, A., Hassan, A. Y., Zarychta, M., Ferri, O. E., Al-Khaz’Aly, A., et al. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106589 · Cited by 1
Metadata
- Authors
- Artino, A. R., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2014-03-24
- Volume
- 36
- Issue
- 6
- Pages
- 463-474
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2152448854
- Cited by
- 1,450
- References
- 7
- FWCI
- 73.50
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.