A Comparison of Behavioral and Multiple Mini-Interview Formats in Physician Assistant Program Admissions
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
PURPOSE: The interview remains a widely used tool in health professions program admissions. The purpose of this study was to compare the use of a behavioral interview format with the multiple mini-interview format in measuring desired noncognitive behaviors. METHODS: This dual cohort, observational, comparative study used a polytomous rating-scale model to analyze the results from two homogeneous groups of physician assistant (PA) program applicants (total N = 176). One group (n = 93) participated in two 20-minute behavioral interviews conducted by two raters per interviewee. The behavioral format included questions related to past behaviors and performance as a way to identify latent professionalism characteristics. The second group (n = 83) completed ten separate 7-minute stations with one rater per station. Each of the mini-stations assigned a specific topic and/or task to be completed. The score distributions related to applicant performance and station difficulty were plotted using Rasch analysis software. RESULTS: The behavioral interview format and multiple mini-interview had similar model fit. The behavioral interview did not adequately measure differences in applicant characteristics. In contrast, the multiple mini-interview measured more variation in noncognitive traits and identified better matching of station difficulty and person ability. CONCLUSIONS: In this study the multiple mini-interview format was a more reliable admissions tool in detecting latent professionalism attributes among PA program applicants. The multiple mini-interview format appeared to measure professional potential and organizational fit better than the behavioral interview format. A larger study across several programs may provide additional support for these findings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Person reliability was 0.72 for 85 non-extreme scoring persons behavioral interview as compared to 0.57 for 83 in MMI”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Jones, P. E. & Forister, J. G., (28)2011
In the citing paper
“BI and MMI had similar model fit.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Jones, P. E. & Forister, J. G., (28)2011
In the citing paper
“BI did not adequately measure differences in applicant characteristics but MMI measured more variation in non-cognitive traits.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Jones, P. E. & Forister, J. G., (28)2011
In the citing paper
“Item reliability for four behavioral interviews was 0.64 compared to 0.77 for ten MMI stations”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Jones, P. E. & Forister, J. G., (28)2011
Citations
Cites
Applying the Rasch Model: Fundamental Measurement in the Human Sciences
Bond, T. G., & Fox, C. M. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01103.x · Cited by 4,492
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617
Rasch fit statistics and sample size considerations for polytomous data
Smith, A. B., Rush, R., Fallowfield, L. J., Velikova, G., & Sharpe, M. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-33 · Cited by 375
Predictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267
Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., et al. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed442b · Cited by 98
Multiple mini-interviews: opinions of candidates and interviewers
Humphrey, S., Dowson, S., Wall, D., Diwakar, V., & Goodyear, H. M. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02972.x · Cited by 74
Interviewer bias in medical student selection
Griffin, B. N., & Wilson, I. G. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb04015.x · Cited by 25
Cited by
Eva, K. W., Reiter, H. I., Rosenfeld, J., Trinh, K., Wood, T. J., & Norman, G. R. (2012) · JAMA · doi:10.1001/jama.2012.36914 · Cited by 130
“In the United States, systematic data are not available, but use of the MMI has been reported in dentistry(20) and physician assistant programs.(21) According to records kept by the Association for American Medical Colleges and ProFitHR, it appears that at least 22 US medical schools are known to be using the MMI or a…”
BackgroundMultiple mini-interviews: same concept, different approaches
Knorr, M., & Hissbach, J. (2014) · Medical Education · doi:10.1111/medu.12535 · Cited by 110
Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review
Yusoff, M. S. B. (2019) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2019.03.006 · Cited by 57
“, (21) 2009 University of Calgary and University of Alberta N 1⁄4 71 International medical graduate Family Medicine Residency Develop and assess the evidence for the validity and reliability of the MMI in the assessment of professionalism in IMG candidates for family medicine residency education at the Universities of…”
BackgroundCallwood, A., Jeevaratnam, K., Kotronoulas, G., Schneider, A., Lewis, L. S., & Nadarajah, V. D. (2018) · Nurse Education Today · doi:10.1016/j.nedt.2018.01.016 · Cited by 186
“…Hofmeister et al., 2009; Hopson et al., 2014; Humphrey et al., 2008; Husbands and Dowell, 2013; Jerant et al., 2012; Jerant et al., 2015, 2017; Jones and Forister, 2011; Kelly et al., 2014; Kim et al., 2017; Kulasegaram et al., 2010; Kumar et al., 2009; Leduc et al., 2017; Lee et al., 2016;…”
Noncognitive Attributes in Physician Assistant Education
Brenneman, A., Goldgar, C. M., Hills, K. J., Snyder, J. H., VanderMeulen, S. P., & Lane, S. (2018) · The Journal of Physician Assistant Education · doi:10.1097/jpa.0000000000000187 · Cited by 27
“One study in PA education compared standard behavioral interviews withMMIs for 2 cohorts of students applying to one Texas program and found that the MMI, using structured scenarios specific to the particular program, was more reliable in detecting “latent professional potential” among PA applicants.(29) We are aware…”
Background
Metadata
- Authors
- Jones, P. E., & Forister, G. J.
- Affiliations
- University of Iowa (US)
- ORCID
- Jones, P. Eugene
- Venue
- The Journal of Physician Assistant Education
- Published
- 2011
- Volume
- 22
- Issue
- 1
- Pages
- 36-40
- ISSN
- 1941-9430 (ISSN-L)
- OpenAlex
- W2025939657
- Cited by
- 24
- References
- 7
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2021: 3 · 2019: 3 · 2018: 4 · 2017: 2 · 2016: 2 · 2015: 1 · 2014: 3 · 2012: 1
- FWCI
- 1.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Physician Assistant Education (publishedVersion)
- PubMed (publishedVersion)
- Funders
- McMaster University
- Topics
- Social Sciences › Education › Medical Education and Admissions
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- multiple mini-interviews, behavioral interview, non-cognitive traits, professionalism, applicant selection, organizational fit
- MeSH terms
- Humans, Interviews as Topic, Physician Assistants, School Admission Criteria
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Comparison of Behavioral and Multiple Mini-Interview Formats in Physician Assistant Program Admissions. https://app.cochat.ai/papers/10.1097/01367895-201122010-00006
- The paper
- Jones, P. E., & Forister, G. J. (2011). A Comparison of Behavioral and Multiple Mini-Interview Formats in Physician Assistant Program Admissions. The Journal of Physician Assistant Education. https://doi.org/10.1097/01367895-201122010-00006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.