Factors associated with success in medical school: systematic review of the literature
Open accessAbstract
Previous academic performance is a good, but not perfect, predictor of achievement in medical training It accounts for 23% of the variance in performance in undergraduate medical training and 6% of that in postgraduate competency Long term prospective cohort studies or case-control studies are needed to examine predictors of success after qualification, and reliable, valid, and fair models of medical job competence need to be developed Relatively little research has been done into the importance of learning styles, interviews, ethnicity, sex, personal statements, and references, but a strategic learning style, white ethnicity, and female sex are associated with success in medical training
AI snapshot
Written from the paper’s full text.
TL;DR
Previous academic performance is a moderate predictor of undergraduate medical success and a small predictor of postgraduate competence; after correction it explains 23% and 6% of variance respectively. Strategic learning style, white ethnicity, and female sex are associated with success, while evidence on interviews, personality, personal statements, and references is limited or mixed.
Key findings
- Previous academic performance had an uncorrected average effect size of 0.30 for undergraduate medical success and 0.14 for postgraduate competence. After correction for unreliability and range restriction, these rose to 0.48 and 0.24, accounting for 23% and 6% of variance respectively.
- Strategic learning was consistently positively associated with final marks (uncorrected r 0.178 to 0.26), and “convergers” tended to perform better than other Kolb learning styles. Deep learning showed positive associations in some studies (0.157 to 0.262), while surface learning showed a negative association in one study (−0.204) but was not consistently replicated.
- Women tended to perform better than men in medical training and clinical assessments, though some early assessment differences favoured men and were small. Ethnic minority students were more likely to fail a medical examination than white students, but non-UK ethnic minority students in the UK may perform better than white UK students; previous academic performance tended to overpredict for ethnic minorities and underpredict for white students.
- Personality findings included conscientiousness as a positive predictor of preclinical achievement (standardised regression coefficient = 0.58) even after controlling for A level grades, extraversion predicting success in paediatric objective examinations (0.51), and state anxiety weakly negatively associated with performance (3% of variance), while trait anxiety was not significantly related. Interviews may add predictive information, but the academic reference had no predictive value and personal statements had too few data for conclusions.
Methods
- Systematic review conducted June to August 2000, searching Medline OVID, Web of Science, and PsycLIT, plus hand-searching Medical Education, Journal of Medical Education, and Academic Medicine and reference lists. Inclusion required clear predictors and outcomes, acceptable statistical analysis, medicine-specific studies, and validated indices for non-academic predictors.
- Meta-analysis used hierarchical linear modelling with correlation coefficients as level 1 variables and sample sizes as level 2 variables; correlations were Fisher r-to-Z transformed, and effect sizes were corrected for unreliability and range restriction. Cohen’s calibration was used for interpretation.
- The review identified 62 papers on previous academic performance, 31 on personality, 16 on sex, 14 on ethnicity, 11 on motivation or study habits, 16 on interviews, 2 on personal statements, and 1 on references. The undergraduate meta-analysis included 753 usable correlation coefficients from 21,905 participants; the postgraduate meta-analysis included 32 coefficients from 2,487 participants across 5 studies.
Limitations
- Stated: few comparative analyses exist; more research is needed on learning styles, interviews, personal statements, and references; long-term prospective cohort or case-control studies are needed for predictors of success after qualification; reliable, valid, and fair models of medical job competence are needed; the “criterion problem” complicates assessing postgraduate clinical performance; personality measures were too varied for meta-analysis; insufficient data prevented meta-analysis for ethnicity, sex, learning styles, and personal statements; interview studies had small cohorts (23–113), selection biases, and limited outcome measures.
- Stated: no studies examined whether differential experiences of medical training contribute to ethnic differences in performance.
- Evident from the text: the search was limited to three databases and three journals plus reference checking, no assessment of publication bias is mentioned, and the meta-analysis combined diverse academic indicators despite wide variability in effect sizes that was not explained by sample size.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 77 cited sources checked · 0 supported · 0 flagged
- Findingcitation
State anxiety is significantly but weakly (3% of variance) negatively associated with aspects of medical performance.
“Results of state-trait anxiety studies have shown that state anxiety (anxiety in relation to a specific event, in this case examinations) is significantly, but weakly (3% of the variance), negatively associated with aspects of medical performance”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w63,w84
Not checked in the free run.
- Findingown data
This variability in effect sizes was not significantly associated with sample size for either the undergraduate or postgraduate analysis.
“This variability was not significantly associated with sample size for either the undergraduate analysis or the postgraduate analysis.”
Quote in the paperNot a substantial claim - Findingreasoning
A meta-analysis of personality measures was not possible owing to the wide variety of measures used.
“A meta-analysis of the personality measures was not possible owing to the wide variety of measures used”
Quote in the paperSubstantial claim - Findingown data
Previous academic performance accounts for 23% of the variance in performance in undergraduate medical training after correction for unreliability and range restriction.
“It accounts for 23% of the variance in performance in undergraduate medical training”
- Also stated in: § Tests of previous academic performance · hedged
“This corrected coefficient indicates that 23% of variance in medical school performance can be explained by previous academic performance.”
Quote in the paperSubstantial claim - Also stated in: § Tests of previous academic performance · hedged
- Findingcitation
Trait anxiety is not significantly related to medical performance.
“but that trait anxiety (non-specific anxiety) is not significantly related to performance.w63,w84”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w63,w84
Not checked in the free run.
- Findingown data
The 95% confidence intervals and ranges indicate wide variability in effect sizes across studies for previous academic performance.
“The 95% confidence intervals and ranges indicate a wide variability in effect sizes across the studies.”
Quote in the paperNot a substantial claim - Findingown data
Previous academic performance accounts for 6% of the variance in postgraduate medical competency after correction for unreliability and range restriction.
“and 6% of that in postgraduate competency”
- Also stated in: § Tests of previous academic performance · hedged
“This corrected coefficient indicates that 6% of variance in postgraduate performance can be explained by previous academic performance.”
Quote in the paperSubstantial claim - Also stated in: § Tests of previous academic performance · hedged
- Findingcitation
Dominance is correlated with undergraduate multiple choice question scores (uncorrected r -0.26).
“Dominance has been shown to be correlated with undergraduate multiple choice question scores (uncorrected r -0.26)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w79
Not checked in the free run.
- Findingcitation
Eight subscales of the California personality inventory have emerged consistently as predictors of success in medical training: dominance, tolerance, sociability, self acceptance, well being, responsibility, achievement via conformance, and achievement via independence.
“With this measure, eight subscales have emerged consistently as predictors of success in medical training: “dominance,” “tolerance,” “sociability,” “self acceptance,” “well being,” “responsibility,” “achievement via conformance,” and “achievement via independence.”w69,w79”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w69,w79
Not checked in the free run.
- Findingcitation
Extraversion predicted success in paediatric objective examinations (0.51).
“Within medicine, extraversion predicted success in paediatric objective examinations (0.51).w83”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w83
Not checked in the free run.
- Findingcitation
There is some evidence that medical students express more external beliefs as they progress through medical school.
“There is also some evidence that medical students express more external beliefs as they progress through medical school.w48”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w48
Not checked in the free run.
- Findingcitation
Conscientiousness is a positive predictor of preclinical achievement (standardised regression coefficient =0.58), even with control for previous academic performance (A level grades).
“A recent study using the Big 5 has shown that conscientiousness is a positive predictor of preclinical achievement (standardised regression coefficient, =0.58), even with control for previous academic performance (A level grades).w10”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w10
Not checked in the free run.
- Findingcitation
Medical students with high preclinical and clinical grade point averages were more likely to express an external orientation on Rotter's locus of control (0.51 and 0.31).
“Medical students with high preclinical and clinical grade point averages were, surprisingly, more likely to express an external orientation (0.51 and 0.31).w74”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w74
Not checked in the free run.
- Findingcitation
Tolerance is correlated with the ability to use numerical data and make calculations (uncorrected r -0.25).
“tolerance with the ability to use numerical data and make calculations ( -0.25)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w79
Not checked in the free run.
- Findingown data
Correction for unreliability increased the undergraduate effect size correlation from 0.30 to 0.36 (95% CI 0.31 to 0.39).
“Correction for unreliability in both the predictor (pre-vious academic ability) and outcome (medical training success) variables increased the effect size correlation from 0.30 to 0.36 (95% confidence interval 0.31 to 0.39).”
Quote in the paperSubstantial claim - Findingown data
Further correction for restriction of range increased the undergraduate effect size coefficient to 0.48 (95% CI 0.40 to 0.51).
“Further correction for restriction of range increased the coefficient to 0.48 (0.40 to 0.51).”
Quote in the paperSubstantial claim - Findingown data
In the prediction of postgraduate medical competence, the average uncorrected effect size for previous academic performance was 0.14 (SE 0.05, 95% CI 0.05 to 0.23, P < 0.05).
“In the prediction of postgraduate medical competence the average effect size was 0.14 (SE 0.05, range -0.34 to 0.41, 95% confidence interval 0.05 to 0.23, P < 0.05).”
Quote in the paperSubstantial claim - Findingcitation
Levels of academic anxiety may show an inverted U shaped association with first year performance, with students with extremes of anxiety tending to do worse than those in the mid-range.
“Furthermore, levels of academic anxiety may show an inverted U shaped association with first year performance, in that students with extremes of anxiety tend to do worse than those in the mid-range.w48”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w48
Not checked in the free run.
- Findingreasoning
On average, previous academic performance accounts for less than 3% of the variance in postgraduate medical performance (uncorrected).
“Thus, on average, previous academic performance accounts for less than 3% of the variance in postgraduate medical performance.”
Quote in the paperSubstantial claim - Findingreasoning
On average, previous academic performance accounts for 9% of the variance in overall performance at medical school (uncorrected).
“This means that, on average, previous academic performance accounts for 9% of the variance in overall performance at medical school.”
Quote in the paperSubstantial claim - Findingcitation
Women tend to perform better in clinical assessments.
“Women also tend to perform better in clinical assessments.w86,w87”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w86,w87
Not checked in the free run.
- Findingcitation
Surface, deep, and strategic learning styles show some degree of trait stability (0.33 to 0.42).
“Surface, deep, and strategic learning styles seem to show some degree of trait stability (0.33 to 0.42).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w28
Not checked in the free run.
- Findingcitation
Women tend to perform better than men in their medical training.
“A consistent finding in the literature is that women tend to perform better than men in their medical training w1,w10,w27,w85,w91”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w1,w10,w27,w85,w91
Not checked in the free run.
- Findingcitation
Some evidence indicates that the admission test underpredicts for women.
“Some evidence indicates that the admission test underpredicts for women.w94”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w94
Not checked in the free run.
- Findingcitation
Traditional cognitive selection measures (medical college admission test, grade point average) show significant predictive power for ethnic minority groups.
“A common finding across several studies is that traditional cognitive selection measures (medical college admission test, grade point average) show significant predictive power for ethnic minority groups.w34,w45,w46,w55,w96,w97”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w34,w45,w46,w55,w96,w97
Not checked in the free run.
- Findingcitation
Non-UK ethnic minority students in the United Kingdom may perform better than white UK students.
“However, non-UK ethnic minority students in the United Kingdom may perform better than white UK students.w1”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w1
Not checked in the free run.
- Findingcitation
Some evidence indicates that in the United Kingdom, as well as in the United States, students from ethnic minority groups are more likely to fail a medical examination than are white students.
“Some evidence indicates that in the United Kingdom, as well as in the United States, students from ethnic minority groups are more likely to fail a medical examination than are white students.w1,w55”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w1,w55
Not checked in the free run.
- Findingcitation
Richards et al showed that only 10% (one) of the associations between previous academic performance and intern performance rating were significant (0.20).
“For example, Richards et al showed that 60% (9/15) of the associations between previous academic ability and undergraduate success were significant (r range 0.17 to 0.34) but that only 10% (one) of the associations between previous academic performance and intern performance rating were significant (0.20).w47”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w47
Not checked in the free run.
- Findingcitation
One study found no evidence that the content of candidates' actual personal statements predicted early preclinical success.
“One study analysed the content of candidates' actual statements and found no evidence that they predicted early preclinical success.w10”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w10
Not checked in the free run.
- Findingcitation
Only two studies have compared the predictive power of both admissions criteria (grade point average and medical college admission test) and scores in medical school examinations in relation to postgraduate competence.
“Only two studies have compared the predictive power of both admissions criteria (grade point average and medical college admission test) and scores in medical school examinations in relation to postgraduate competence.w47,w64”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites w47
Not checked in the free run.
- cites w64
Not checked in the free run.
- Findingcitation
Richards et al showed that 60% (9/15) of the associations between previous academic ability and undergraduate success were significant (r range 0.17 to 0.34).
“For example, Richards et al showed that 60% (9/15) of the associations between previous academic ability and undergraduate success were significant (r range 0.17 to 0.34) but that only 10% (one) of the associations between previous academic performance and intern performance rating were significant (0.20).w47”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w47
Not checked in the free run.
- Findingcitation
Another study using weighted proforma information about cultural skills (not candidates' actual statements) found a small negative association with outcome (β = -0.184).
“The other study used weighted proforma information about cultural skills (not candidates' actual statements) and found a small negative association with outcome ( = -0.184).w27”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w27
Not checked in the free run.
- Findingreasoning
Too few data on personal statements are available to allow definitive conclusions to be drawn.
“Thus too few data on personal statements are available to allow definitive conclusions to be drawn.”
Quote in the paperSubstantial claim - Findingcitation
Cognitive factors can account for up to 51% of the variance in NBME part III grade.
“These studies show that cognitive factors can account for up to 51% of the variance in NBME part III grade.26”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] Markert, 1993, The relationship of academic measures in medical school to performance after graduation., Acad Med source
Not checked in the free run.
- Findingcitation
Sufficient preliminary data indicating an impact of personality on medical school progression exist to warrant further research.
“Sufficient preliminary data indicating an impact of personality on medical school progression exist to warrant further research.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w10
Not checked in the free run.
- Findingcitation
Interview ratings were independently associated with success in early training after controlling for grade point average (for example, 0.11).
“Interview ratings were independently associated with success in early training after controlling for grade point average (for example, 0.11).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w117
Not checked in the free run.
- Findingcitation
The academic reference has no predictive value in subsequent achievement.
“The only study on the value of references suggested that the academic reference had no predictive value in subsequent achievement.w110”
- Also stated in: § Discussion and conclusions · hedged
“The academic reference seems to have no predictive power.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w110
Not checked in the free run.
- Also stated in: § Discussion and conclusions · hedged
- Findingnone given
Previous academic performance is a predictor with a small effect (0.14 uncorrected, 0.24 corrected) for postgraduate medical competence.
“Previous academic performance, however, would be classified as a predictor with a small effect (0.14 uncorrected, 0.24 corrected) for postgraduate medical competence.”
Quote in the paperSubstantial claim - Findingcitation
Academic or cognitive ability was a moderate predictor of success in undergraduate medical training (0.30 uncorrected, becoming large 0.48 after correction).
“Consistent with reviews in other occupational areas, academic or cognitive ability was a moderate predictor of success in undergraduate medical training.29”
- Also stated in: § Discussion and conclusions · plain
“The strength of this association before corrections was moderate (0.30) in terms of Cohen's calibration, becoming large (0.48) after correction.12”
Quote in the paperSubstantial claim0 of 2 sources checked - Also stated in: § Discussion and conclusions · plain
- Findingcitation
Pre-medical scores show a weak relation to internship competence.
“The evidence from these comparative studies indicates that the pre-medical scores show a weak relation to internship competence.”
Quote in the paperSubstantial claim - Findingcitation
Overall interview rating correlated with grade point average (0.08 to 0.14).
“and grade point average (0.08 to 0.14).w117”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w117
Not checked in the free run.
- Findingcitation
Overall interview rating correlated with a Dean's letter of recommendation (0.33).
“For example, overall interview rating correlated with a Dean's letter of recommendation (0.33) w111”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w111
Not checked in the free run.
- Findingreasoning
Fewer studies have examined pre-admission criteria as predictors of postgraduate medical competence.
“Fewer studies have examined pre-admission criteria as predictors of postgraduate medical competence.”
Quote in the paperNot a substantial claim - Premisecitation
Complete independence of predictors and outcomes is not necessary for the meta-analysis to be valid.
“Although neither the predictors nor the outcomes are likely to be statistically independent, complete independence is not necessary for the meta-analysis to be valid.11”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [11] Tracz, 1992, Correlational meta-analysis: independent and nonindependent cases., Educ Psychol Measure source
Not checked in the free run.
- Interpretationnone given
A strategic learning style is associated with success in medical training.
“a strategic learning style, white ethnicity, and female sex are associated with success in medical training”
Quote in the paperSubstantial claim - Interpretationnone given
Female sex is associated with success in medical training.
“a strategic learning style, white ethnicity, and female sex are associated with success in medical training”
Quote in the paperSubstantial claim - Interpretationnone given
White ethnicity is associated with success in medical training.
“a strategic learning style, white ethnicity, and female sex are associated with success in medical training”
Quote in the paperSubstantial claim - Premisereasoning
Measures of previous academic performance and assessments in medical school are associated with some degree of unreliability.
“Measures of previous academic performance and assessments in medical school are associated with some degree of unreliability for a variety of reasons related to the candidate and the assessor (for example, illness, tiredness, environmental factors).”
Quote in the paperSubstantial claim - Interpretationcitation
The inverted U shaped association between academic anxiety and first year performance is consistent with arousal theory.
“This is consistent with arousal theory, which postulates that people perform best at an optimal level of arousal.15”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] Yerkes, 1908, The relation of strength of stimulus to rapidity of habit-formation., J Compar Neurol Psychol source
Not checked in the free run.
- Study design and conductreasoning
The effect sizes were corrected for error due to unreliability and range restriction.
“We therefore corrected the effect sizes reported in this paper, calculated using HLM-5 software, 7 9 for error due to unreliability and range restriction.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [7] Bryk A Raudenbush S .Hierarchical linear models. London:Sage,1992.
Not checked in the free run.
- cites [9] Raudenbush S Bryk A Cheong Y Congdon R .HLM5: hierarchical linear and nonlinear modelling. Lincolnwood, IL:Scientific Software International,2000.
Not checked in the free run.
- Rests on an assumption: Students entering medical school are likely to be at the top end of the potential range of scores for previous academic performance and are also likely to do well in their medical school training.
- Premisecitation
Good evidence exists that diverse measures of cognitive ability are all statistically related to general intelligence.
“Finally, good evidence exists that diverse measures of cognitive ability are all statistically related to general intelligence.6”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [6] Deary IJ .Intelligence: a very short introduction. Oxford:Oxford University Press,2001. source
Not checked in the free run.
- Study design and conductown data
Sufficient data were available on measures of previous academic performance to perform a meta-analysis.
“Sufficient data were available on measures of previous academic performance for us to be able to perform a meta-analysis”
Quote in the paperSubstantial claim - Interpretationcitation
Useful additional information that has predictive power for outcome can probably be collected from an interview.
“Thus useful additional information that has predictive power for outcome can probably be collected from an interview.”
Quote in the paperSubstantial claim - Premisecitation
A main problem with studying postgraduate clinical performance is establishing a comparable scoring system for assessing competency in different specialties.
“One of the main problems with studying postgraduate clinical performance is establishing a comparable scoring system for assessing competency in different specialties.”
Quote in the paperNot a substantial claim0 of 2 sources checked
- The quote only partly states this claim. 4
- May combine two claims. 23
- Classified as probably not a substantial claim. 21
The quote only partly states this claim.
Findingown dataIn the prediction of undergraduate medical success, the average uncorrected effect size for previous academic performance was 0.30 (SE 0.016, 95% CI 0.27 to 0.33, P < 0.00001).
“In the prediction of undergraduate medical success, the average effect size was 0.30 (SE 0.016, range -0.22 to 0.74, 95% confidence interval 0.27 to 0.33, P < 0.00001).”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationWell being and achievement via conformance are correlated with success in oral examinations (0.22 and 0.32).
“well being and achievement via conformance with success in oral examinations (0.22 and 0.32).w79”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w79
Not checked in the free run.
May combine two claims.
FindingreasoningCorrection for unreliability increased the postgraduate effect size correlation to 0.17 (95% CI 0.06 to 0.27), and further correction for restriction of range increased it to 0.24 (95% CI 0.08 to 0.37).
“Correction for unreliability increased the effect size correlation to 0.17 (95% confidence interval 0.06 to 0.27), and further correction for restriction of range increased it to 0.24 (0.08 to 0.37).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenRelatively little research has been done into the importance of learning styles, interviews, ethnicity, sex, personal statements, and references.
“Relatively little research has been done into the importance of learning styles, interviews, ethnicity, sex, personal statements, and references”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationSome evidence shows that deep learning has a positive association with performance in examinations (0.157 to 0.262), but other studies have failed to replicate this finding.
“However, although some evidence shows that deep learning has a positive association with performance in examinations (0.157 to 0.262), w28,w104 other studies have failed to replicate this finding.w101,w103”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites w28
Not checked in the free run.
- cites w104
Not checked in the free run.
- cites w101
Not checked in the free run.
Classified as probably not a substantial claim.
Findingnone givenThe indicators of previous academic performance ranged widely in the types of assessment and the response formats used.
“The indicators of previous academic performance ranged widely in the types of assessment and the response formats used.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenThese sex differences were small and reached significance only when the sample sizes were large.
“However, these differences were small and reached significance only when the sample sizes were large.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenNo studies have examined whether differential experiences of training in medical schools contribute to the difference in prediction for ethnic minorities and white students.
“No studies have examined whether differential experiences of training in medical schools contribute to this difference.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
FindingcitationWomen are more likely to attain an honours degree.
“and are more likely to attain an honours degree.w2”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w2
Not checked in the free run.
May combine two claims.
FindingcitationA significant negative association has been reported between surface learning and examination performance (for example, -0.204), but several studies have failed to replicate this effect.
“Similarly, although a significant negative association has been reported between surface learning and examination performance (for example, -0.204), w28 several studies have failed to replicate this effect.w91,w101,w103”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites w28
Not checked in the free run.
- cites w91
Not checked in the free run.
- cites w101
Not checked in the free run.
May combine two claims.
FindingcitationIn medical students, the use of strategic learning has a significant positive association with final marks (uncorrected r 0.178 to 0.26), with only one study failing to replicate this effect.
“The studies examining the tripartite model in medical students have shown a relatively consistent finding of a significant positive association between the use of strategic learning and final marks (uncorrected r 0.178 to 0.26) w28,w99,w103-w105 ; only one study failed to replicate this effect.w101”
Quote in the paperSubstantial claim0 of 3 sources checked- cites w28
Not checked in the free run.
- cites w99
Not checked in the free run.
- cites w103-w105
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe most commonly used personality test has been the California personality inventory.
“The most commonly used test has been the California personality inventory.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationTwo studies suggested that men slightly outperformed women on early assessments (e.g., NBME part I) but that these differences disappeared later (NBME part II).
“Two studies suggested that men slightly outperformed women on early assessments (for example, National Board of Medical Examiners (NBME) part I) but that these differences disappeared later (NBME part II).w85,w86”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w85,w86
Not checked in the free run.
May combine two claims.
FindingcitationIn one study, "service quality variables" (such as "helping others") predicted women's clinical grades and "individual mastery variables" (such as "intellectual growth") predicted men's clinical grades.
“For example, in one study, “service quality variables” (such as “helping others”) predicted women's clinical grades and “individual mastery variables” (such as “intellectual growth”) predicted men's clinical grades.w89”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w89
Not checked in the free run.
May combine two claims.
FindingcitationMeasures of previous academic performance tend to overpredict for ethnic minorities but to underpredict for white students.
“However, measures of previous academic performance tend to overpredict for ethnic minorities but to underpredict for white students.w94,w95”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w94,w95
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationA significant difference was reported between men and women in NBME part II paediatrics scores, with men scoring 82.13 and women 82.70.
“For example, a significant difference was reported between men and women in NBME part II paediatrics scores, with men scoring 82.13 and women 82.70.w86”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w86
Not checked in the free run.
Classified as probably not a substantial claim.
Findingnone givenThe research that has been undertaken has mainly concentrated on measures of previous academic ability as a predictor of undergraduate achievement.
“The research that has been undertaken has mainly concentrated on measures of previous academic ability as a predictor of undergraduate achievement.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationStudies comparing medical students who were interviewed and accepted with those accepted without interview or rejected by one school but accepted at another showed no differences and concluded that the interview added little to the selection process.
“These studies showed no differences and concluded that the interview added little to the selection process.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites w113
Not checked in the free run.
- cites w114
Not checked in the free run.
- cites w107
Not checked in the free run.
The quote only partly states this claim.
FindingcitationStudies relating interviewers' ratings to interviewees' early preclinical success, withdrawal, dropout rates, and overall rating of graduate physicians' potential competency reported evidence that interview scores were able to predict future success.
“These studies reported evidence that interview scores were able to predict future success.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites w27
Not checked in the free run.
- cites w30
Not checked in the free run.
- cites w111
Not checked in the free run.
Classified as probably not a substantial claim.
Findingnone givenRelatively few studies provide comparative analyses of the predictive power of the wide variety of factors used in combination for selecting medical students (interview, grade point average, learning styles, personality).
“Relatively few studies provide comparative analyses of the predictive power of the wide variety of factors used in combination for selecting medical students (interview, grade point average, learning styles, personality).”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataOur meta-analysis confirms the pattern that pre-medical scores show a weak relation to internship competence and that previous academic performance has a weaker relation to intern performance than to undergraduate success.
“This pattern of findings is confirmed by our meta-analysis.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenVirtually no research has examined the predictive power of personal statements.
“Virtually no research has examined the predictive power of personal statements.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
FindingcitationLittle is known about the impact of inter-interviewer variation, whether any systematic biases exist, and the effect of training for interviewers.
“However, little is known about factors such as the impact of inter-interviewer variation, whether any systematic biases exist, and the effect of training for interviewers.w117”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites w117
Not checked in the free run.
Classified as probably not a substantial claim.
Findingnone givenFew studies have examined the effects of learning styles, interviews, personal statements, and references in relation to achievement in medical training.
“Few studies have examined the effects of learning styles, interviews, personal statements, and references in relation to achievement in medical training.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCohen's calibration classes effect size 0.10 as small, 0.30 as moderate, and 0.50 or greater as large.
“Cohen argues that an effect size of 0.10 should be classed as “small,” 0.30 as “moderate,” and 0.50 or greater as “large.””
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe uncorrected correlation coefficient for undergraduate performance would be classed as moderate, and the final corrected coefficient approaches a large effect.
“The uncorrected correlation coefficient would be classed as moderate in size according to Cohen's calibration, and the final corrected coefficient approaches a large effect.12”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
May combine two claims.
PremisecitationBoth unreliability and restriction of range statistically limit the size of correlations between predictors and outcomes.
“Both these factors (unreliability and restriction of range) statistically limit the size of the correlations between predictors and outcomes.8”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8] Hunter JE Schmidt FL .Methods of meta-analysis. London:Sage,1990.
Not checked in the free run.
May combine two claims.
InterpretationreasoningPrevious academic performance is a good, but not perfect, predictor of achievement in medical training.
“Previous academic performance is a good, but not perfect, predictor of achievement in medical training”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationcitationBoth the uncorrected and corrected coefficients for postgraduate performance are classed as small.
“Both the uncorrected and corrected coefficients are classed as small according to Cohen's calibration.12”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe criteria medical schools use to select future doctors are similar across the country.
“The criteria medical schools use to select future doctors are similar across the country.4”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4] McManus, 1998, Factors affecting likelihood of applicants being offered a place in medical schools in the United Kingdom in 1996 and 1997: retrospective study., BMJ source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationDifferent aspects of previous academic performance might be differentially predictive at different stages of training.
“Different aspects of previous academic performance might be differentially predictive at different stages of training, w26”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w26
Not checked in the free run.
May combine two claims.
InterpretationcitationThe finding that medical students with high preclinical and clinical GPAs were more likely to express an external orientation seems at variance with studies showing higher internal beliefs are associated with academic success.
“This seems to be at variance with studies showing that higher levels of internal beliefs are associated with academic success.13”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationConscientiousness has been shown in previous research to be related to success in a variety of occupational settings, and extraversion has been correlated with success in jobs that involve a social dimension (for example, sales).
“Conscientiousness has been shown in previous research to be related to success in a variety of occupational settings, and extraversion has been correlated with success in jobs that involve a social dimension (for example, sales).18”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] Tett, 1991, Personality measures as predictors of job performance: a meta-analytic review., Pers Psychol source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenSome subscales of the California personality inventory, especially the achievement subscales, may relate to conscientiousness in the Big 5.
“Some of the subscales of the California personality inventory, especially the achievement subscales, may relate to conscientiousness in the Big 5.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).
PremisecitationHigher levels of internal beliefs are associated with academic success.
“This seems to be at variance with studies showing that higher levels of internal beliefs are associated with academic success.13”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationArousal theory postulates that people perform best at an optimal level of arousal.
“This is consistent with arousal theory, which postulates that people perform best at an optimal level of arousal.15”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] Yerkes, 1908, The relation of strength of stimulus to rapidity of habit-formation., J Compar Neurol Psychol source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe Big 5 factors underlie normal personality and can be found in previously reported measures of personality.
“Recent developments in personality theory have suggested that five factors underlie normal personality and that these can be found in previously reported measures of personality.16 17”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDefensive externals act much like internals but endorse an external orientation as a verbal defence against failure.
“Defensive externals act much like internals but endorse an external orientation as a verbal defence against failure.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] source
Not checked in the free run.
May combine two claims.
InterpretationcitationThe trait stability of learning styles is only a moderate effect, suggesting that learning styles can change.
“However, this is only a moderate effect, suggesting that learning styles can change.w28”
Quote in the paperSubstantial claim0 of 1 sources checked- cites w28
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOne solution to the criterion problem has been to develop competency based models of core and specific skills through detailed job analyses of individual medical specialties.
“One solution to this problem has been to develop competency based models of core and specific skills, through detailed job analyses of individual medical specialties.30”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] Patterson, 2000, A competency model for general practice: implications for selection, training and development., Br J Gen Pract
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe finding that academic reference has no predictive value is consistent with conclusions from studies of the value of references in other occupations.
“This is consistent with the conclusions from studies of the value of references in other occupations.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe interview studies had methodological limitations, including small numbers (cohort range 23-113), a failure to eliminate selection biases, and a limited range of outcome measures.
“However, the studies had methodological limitations, including the use of small numbers (cohort range 23-113), a failure to eliminate selection biases, and a limited range of outcome measures.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationPredictors are likely to be intercorrelated, as are outcome measures.
“Predictors are likely to be intercorrelated, 31,w10 as are outcome measures.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [31] source
Not checked in the free run.
- cites w10
Not checked in the free run.
The paper relies on this without support.
Students entering medical school are likely to be at the top end of the potential range of scores for previous academic performance and are also likely to do well in their medical school training.
“In addition, students entering medical school are likely to be at the top end of the potential range of scores for previous academic performance and are also likely to do well in their medical school training.”
The paper relies on this without support.
Previous academic ability, personal statements, references, and interviews are traditionally used in selection, while personality and learning styles are not traditionally used.
“Previous academic ability, personal statements, references, and interviews are all traditionally used in selection, but how good are they at predicting future performance?Personality and learning styles are not traditionally used, but should they be?”
The paper relies on this without support.
Learning across the medical degree (and postgraduate learning) occurs over time.
“Furthermore, learning across the medical degree (and indeed postgraduate learning) occurs over time, and time series analyses and models that allow for prediction of change over time would also be a useful approach.”
The paper relies on this without support.
The personal statement forms an important part of the current selection process in the United Kingdom.
“This is an important area for future research, as the personal statement forms an important part of the current selection process in the United Kingdom.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
GPA and MCAT strongly account for the variance in test performance in medical school.
“GPA and MCAT are known to strongly account for the variance in test performance in medical school 12 .”
From Effect of repeated/spaced formative assessments on medical school final exam performance (2017) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
A correlation of 0.48 is called large despite the stated cutoff
MinorThe paper defines a large effect size as 0.50 or greater, but later calls the corrected correlation of 0.48 large.
“The strength of this association before corrections was moderate (0.30) in terms of Cohen's calibration, becoming large (0.48) after correction.”
“Cohen argues that an effect size of 0.10 should be classed as "small," 0.30 as "moderate," and 0.50 or greater as "large."”
Cites
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771 · see citing works
PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL
Digman, J. M. (1990) · Annual Review of Psychology · doi:10.1146/annurev.ps.41.020190.002221 · Cited by 6,960 · see citing works
The relation of strength of stimulus to rapidity of habit formation
Yerkes, R. M., & Dodson, J. D. (1908) · Journal of Comparative Neurology and Psychology · doi:10.1002/cne.920180503 · Cited by 6,911 · see citing works
Personality trait structure as a human universal.
McCrae, R. R., & Costa, P. T. (1997) · American Psychologist · doi:10.1037/0003-066x.52.5.509 · Cited by 4,234 · see citing works
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · see citing works
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023 · see citing works
Intelligence, personality, and interests: Evidence for overlapping traits
Ackerman, P. L., & Heggestad, E. D. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.2.219 · Cited by 1,719 · see citing works
PERSONALITY MEASURES AS PREDICTORS OF JOB PERFORMANCE: A META‐ANALYTIC REVIEW
Tett, R. P., Jackson, D. N., & Rothstein, M. G. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00696.x · Cited by 1,481 · see citing works
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013) · Chapman & Hall/CRC eBooks · doi:10.1201/b16018-21 · Cited by 631 · see citing works
Locus of control and academic achievement: A literature review.
Findley, M. J., & Cooper, H. M. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.2.419 · Cited by 568 · see citing works
Learning styles and approaches: implications for medical education
Newble, D. I., & Entwistle, N. J. (1986) · Medical Education · doi:10.1111/j.1365-2923.1986.tb01163.x · Cited by 564 · see citing works
Meta-analyzing the relationship between grades and job performance.
Roth, P. L., BeVier, C. A., Switzer, F. S., & Schippmann, J. S. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.548 · Cited by 259 · see citing works
Intelligence: A Very Short Introduction
Deary, I. J. (2020) · doi:10.1093/actrade/9780198796206.001.0001 · Cited by 258 · see citing works
"Stupidity or worms": Do intestinal worms impair mental performance?
Watkins, W. E., & Pollitt, E. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.2.171 · Cited by 143 · see citing works
McManus, I. C., Esmail, A., & Demetriou, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7166.1111 · Cited by 115 · see citing works
A competency model for general practice: implications for selection, training, and development.
Patterson, F., Ferguson, E., Lane, P., Farrell, K., Martlew, J., & Wells, A. (2000) · Europe PMC (PubMed Central) · Cited by 114 · see citing works
Self-citationIntelligence: A Very Short Introduction
Deary, I. J. (2001) · doi:10.1093/actrade/9780192893215.001.0001 · Cited by 107 · see citing works
McManus, I. C., Richards, P., Winder, B., Sproston, K. A., & STYLES, V. A. (1995) · BMJ · doi:10.1136/bmj.310.6978.496 · Cited by 100 · see citing works
Oddone, E. Z., Guarisco, S. A., & Simel, D. L. (1993) · Academic Medicine · doi:10.1097/00001888-199311000-00016 · Cited by 64 · see citing works
Medical shcool evaluation and internship performance
Korman, M., & Stubblefield, R. L. (1971) · Academic Medicine · doi:10.1097/00001888-197108000-00005 · Cited by 60 · see citing works
Correlational meta-analysis: independent and nonindependent cases.
Tracz, S. M., Elmore, P. B., & Pohlmann, J. T. (1992) · Educational and Psychological Measurement · doi:10.1177/0013164492052004007 · Cited by 56 · see citing works
Comparison of Pediatric Resident and Faculty Learning Styles: Implications for Medical Education
Kosower, E., & Berman, N. (1996) · The American Journal of the Medical Sciences · doi:10.1016/s0002-9629(15)41818-x · Cited by 54 · see citing works
The relationship of academic measures in medical school to performance after graduation.
Markert, R. J. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00027 · Cited by 51 · see citing works
Hojat, M., Borenstein, B. D., & Veloski, J. J. (1988) · Academic Medicine · doi:10.1097/00001888-198804000-00009 · Cited by 44 · see citing works
Relationship between performance in medical school and postgraduate competence
Gonnella, J. S., & Hojat, M. (1983) · Academic Medicine · doi:10.1097/00001888-198309000-00001 · Cited by 41 · see citing works
Acceptance into medical school and racial discrimination
Esmail, A., Nelson, P., Primarolo, D., & Toma, T. P. (1995) · BMJ · doi:10.1136/bmj.310.6978.501 · Cited by 39 · see citing works
Iputo, J. (1999) · PubMed · Cited by 24 · see citing works
An investigation of the criterion problem for one group of medical specialists.
Richards, J. M., Taylor, C. W., Price, P. B., & Jacobsen, T. L. (1965) · Journal of Applied Psychology · doi:10.1037/h0021960 · Cited by 19 · see citing works
Reactions to threat by defensive and congruent internals and externals: A self-esteem analysis
Evans, R. G. (1980) · Journal of Research in Personality · doi:10.1016/0092-6566(80)90042-2 · Cited by 17 · see citing works
Comparison of Pediatric Resident and Faculty Learning Styles: Implications for Medical Education
Kosower, E., & Berman, N. (1996) · The American Journal of the Medical Sciences · doi:10.1097/00000441-199611000-00004 · Cited by 14 · see citing works
Admission for medicine in the United Kingdom: a structural model of background factors
McManus, I. C., & Richards, P. (1986) · Medical Education · doi:10.1111/j.1365-2923.1986.tb01165.x · Cited by 12 · see citing works
Kennedy, S. W., & Wilkerson, L. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00037 · Cited by 9 · see citing works
British Medical Journal Publishing Group (1999) · BMJ · doi:10.1136/bmj.318.7176.94p · Cited by 9 · see citing works
Correlation between performance in medical school and in residencuy training.
Johnson, J. R., Rd, M., & Rp, G. (1963) · PubMed · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Prat, 1993, Predicting the first-year performance of international medical graduates in an internal medicine residency., Acad Med, 11, 856
Cited by
Sorted by citations
Tsugawa, Y., Jena, A. B., Figueroa, J. F., Orav, E. J., Blumenthal, D. M., & Jha, A. K. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.7875 · Cited by 1,069 · see citing works
Factors influencing death at home in terminally ill patients with cancer: systematic review
Gomes, B., & Higginson, I. J. (2006) · BMJ · doi:10.1136/bmj.38740.614954.55 · Cited by 976 · see citing works
The Big Five personality traits, learning styles, and academic achievement
Komarraju, M., Karau, S. J., Schmeck, R. R., & Avdic, A. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2011.04.019 · Cited by 733 · see citing works
McManus, I. C., Keeling, A. N., & PAICE, E. W. (2004) · BMC Medicine · doi:10.1186/1741-7015-2-29 · Cited by 558 · see citing works
How effective are selection methods in medical education? A systematic review
Patterson, F., Knight, A., Dowell, J. S., Nicholson, S., Cousans, F., & Cleland, J. (2015) · Medical Education · doi:10.1111/medu.12817 · Cited by 489 · see citing works
Learning styles and approaches to learning among medical undergraduates and postgraduates
Samarakoon, L. B., Fernando, T., Rodrigo, C., & Rajapakse, S. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-42 · Cited by 352 · see citing works
Hardiness commitment, gender, and age differentiate university academic performance
Sheard, M. (2008) · British Journal of Educational Psychology · doi:10.1348/000709908x304406 · Cited by 307 · see citing works
Woolf, K., POTTS, H. W. W., & McManus, I. C. (2011) · BMJ · doi:10.1136/bmj.d901 · Cited by 303 · see citing works
McParland, M., Noble, L., & Livingston, G. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01818.x · Cited by 301 · see citing works
Donnon, T., Paolucci, E. O., & Violato, C. (2006) · Academic Medicine · doi:10.1097/01.acm.0000249878.25186.b7 · Cited by 294 · see citing works
Second‐year medical students’ motivational beliefs, emotions, and achievement
Artino, A. R., LaRochelle, J. S., & Durning, S. J. (2010) · Medical Education · doi:10.1111/j.1365-2923.2010.03712.x · Cited by 296 · see citing works
Chew, B., Zain, A. M., & Hassan, F. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-44 · Cited by 294 · see citing works
Medical student gender and issues of confidence
Blanch‐Hartigan, D., Hall, J. A., ROTER, D. L., & Frankel, R. M. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.05.021 · Cited by 277 · see citing works
Austin, E. J., Evans, P., Goldwater, R., & Potter, V. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.04.014 · Cited by 276 · see citing works
A levels and intelligence as predictors of medical careers in UK doctors: 20 year prospective study
McManus, I. C., Smithers, E., Partridge, P., Keeling, A., & Fleming, P. R. (2003) · BMJ · doi:10.1136/bmj.327.7407.139 · Cited by 276 · see citing works
Racial/Ethnic Disparities in Clinical Grading in Medical School
Low, D. K., Pollack, S. W., Liao, Z. C., Maestas, R. R., Kirven, L. E., Eacker, A. M., & Morales, L. S. (2019) · Teaching and Learning in Medicine · doi:10.1080/10401334.2019.1597724 · Cited by 239 · see citing works
Ferguson, E., McManus, I. C., James, D. K., O'Hehir, F., & Sanders, A. (2003) · BMJ · doi:10.1136/bmj.326.7386.429 · Cited by 238 · see citing works
Self-citationA preliminary study of empathy, emotional intelligence and examination performance in MBChB students
Austin, E. J., Evans, P., Magnus, B., & O'Hanlon, K. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02795.x · Cited by 240 · see citing works
Patterson, F., Zibarras, L., & Ashworth, V. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1072619 · Cited by 236 · see citing works
Eley, D. S., Cloninger, C. R., Walters, L., Laurence, C., Synnott, R., & Wilkinson, D. (2013) · PeerJ · doi:10.7717/peerj.216 · Cited by 230 · see citing works
Ferguson, E. (2011) · Health Psychology Review · doi:10.1080/17437199.2010.547985 · Cited by 209 · see citing works
Self-citationHolzinger, A., Kickmeier-Rust, M., Wassertheurer, S., & Hessinger, M. (2008) · Computers & Education · doi:10.1016/j.compedu.2008.08.008 · Cited by 193 · see citing works
Aboalshamat, K., Hou, X.-Y., & Strodl, E. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1006612 · Cited by 180 · see citing works
Factors associated with dropout in medical education: a literature review
O’Neill, L. D., Wallstedt, B., Εika, B., & Hartvigsen, J. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03898.x · Cited by 186 · see citing works
Hamdy, H., Prasad, K., Anderson, M. B., Scherpbier, A. J. J. A., Williams, R. G., Zwierstra, R. P., & Cuddihy, H. L. (2006) · Medical Teacher · doi:10.1080/01421590600622723 · Cited by 185 · see citing works
Hübscher, M., Moloney, N. A., Leaver, A. M., Rebbeck, T. J., McAuley, J. H., & Refshauge, K. M. (2013) · Pain · doi:10.1016/j.pain.2013.05.031 · Cited by 181 · see citing works
Personality factors and medical training: a review of the literature
Doherty, E. M., & Nugent, E. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03760.x · Cited by 178 · see citing works
McManus, I. C., Livingston, G., & Katona, C. (2006) · BMC Medical Education · doi:10.1186/1472-6920-6-11 · Cited by 151 · see citing works
Hojat, M., Erdmann, J. B., & Gonnella, J. S. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.785654 · Cited by 151 · see citing works
Evaluating the Impact of the Humanities in Medical Education
Schwartz, A. W., Abramson, J. S., Wojnowich, I., Accordino, R. E., Ronan, E. J., & Rifkin, M. R. (2009) · Mount Sinai Journal of Medicine A Journal of Translational and Personalized Medicine · doi:10.1002/msj.20126 · Cited by 139 · see citing works
Fair admissions to higher education : recommendations for good practice
Schwartz, S. S. (2004) · Digital Education Resource Archive (University College London) · Cited by 144 · see citing works
Yates, J., & James, D. K. (2006) · BMJ · doi:10.1136/bmj.38730.678310.63 · Cited by 143 · see citing works
Self-citationIntellectual aptitude tests and A levels for selecting UK school leaver entrants for medical school
McManus, I. C., POWIS, D. A., Wakeford, R. E., Ferguson, E., James, D. K., & Richards, P. (2005) · BMJ · doi:10.1136/bmj.331.7516.555 · Cited by 135 · see citing works
Self-citationFerguson, E., Semper, H., Yates, J., Fitzgerald, J. E. F., Skatova, A., & James, D. K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088606 · Cited by 131 · see citing works
Self-citationMedical school selection criteria and the prediction of academic performance
Wilkinson, D., Zhang, J., Byrne, G. J., Luke, H., Ozolins, I., Parker, M., & Peterson, R. F. (2008) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2008.tb01653.x · Cited by 129 · see citing works
2018 Ottawa consensus statement: Selection and recruitment to the healthcare professions
Patterson, F., Roberts, C., Hanson, M. D., Hampe, W., Eva, K. W., Ponnamperuma, G. G., Magzoub, M. E., Tekian, A. S., & Cleland, J. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1498589 · Cited by 123 · see citing works
Patients' Satisfaction With Male Versus Female Physicians: A Meta-analysis
Hall, J. A., Blanch-Hartigan, D., & Roter, D. (2011) · Medical Care · doi:10.1097/mlr.0b013e318213c03f · Cited by 107 · see citing works
McManus, I. C., Dewberry, C., Nicholson, S., & Dowell, J. S. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-244 · Cited by 120 · see citing works
Effects of age, gender and educational background on strength of motivation for medical school
Kusurkar, R. A., Kruitwagen, C. L. J. J., ten Cate, O., & Croiset, G. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9198-7 · Cited by 120 · see citing works
Woolf, K., Cave, J., Greenhalgh, T., & Dacre, J. E. (2008) · BMJ · doi:10.1136/bmj.a1220 · Cited by 116 · see citing works
Hernández, D., Ali, S., & Chan, C. (2017) · BMC Medical Education · doi:10.1186/s12909-017-0965-5 · Cited by 114 · see citing works
Factors potentially influencing academic performance among medical students
Ahmad, A. R., Abulaban, A., Shawwa, L. A., Merdad, A., Baghlaf, S. S., Abu-shanab, J., Algethami, A., & Balkhoyor, A. (2015) · Advances in Medical Education and Practice · doi:10.2147/amep.s69304 · Cited by 110 · see citing works
Student views of research training programmes in medical schools
de Oliveira, N. A., da Luz, M. R. M. P., Saraiva, R. M., & Alves, L. A. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.03986.x · Cited by 106 · see citing works
Admissions processes for five year medical courses at English schools: review
Parry, J. M., Mathers, J. M., Stevens, A. J., Parsons, A., Lilford, R. J., Spurgeon, P. C., & Thomas, H. (2006) · BMJ · doi:10.1136/bmj.38768.590174.55 · Cited by 101 · see citing works
“Problem Residents”: Prevalence, Problems and Remediation in the Era of Core Competencies
Dupras, D. M., Edson, R. S., Halvorsen, A. J., HOPKINS, R. H., & McDonald, F. S. (2012) · The American Journal of Medicine · doi:10.1016/j.amjmed.2011.12.008 · Cited by 104 · see citing works
Returns to physician human capital: Evidence from patients randomized to physician teams
Doyle, J. J., Ewer, S. M., & Wagner, T. H. (2010) · Journal of Health Economics · doi:10.1016/j.jhealeco.2010.08.004 · Cited by 103 · see citing works
Feeley, A.-M., & Biggerstaff, D. L. (2015) · Teaching and Learning in Medicine · doi:10.1080/10401334.2015.1046734 · Cited by 101 · see citing works
A comprehensive model for the selection of medical students
Bore, M. R., Munro, D., & POWIS, D. A. (2009) · Medical Teacher · doi:10.3109/01421590903095510 · Cited by 101 · see citing works
Yu, J., & Chae, S. J. (2020) · Korean journal of medical education · doi:10.3946/kjme.2020.149 · Cited by 101 · see citing works
Seeking inclusion in an exclusive process: discourses of medical school student selection
Razack, S., Hodges, B. D., Steinert, Y., & Maguire, M. (2014) · Medical Education · doi:10.1111/medu.12547 · Cited by 100 · see citing works
Evers, A., & Sieverding, M. (2013) · Psychology of Women Quarterly · doi:10.1177/0361684313498071 · Cited by 101 · see citing works
Mullola, S., Hakulinen, C., Presseau, J., de Porras, D. G. R., Jokela, M., Hintsa, T., & Elovainio, M. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1155-9 · Cited by 80 · see citing works
Selvig, D., Holaday, L. W., Purkiss, J. A., & Hortsch, M. (2014) · Anatomical Sciences Education · doi:10.1002/ase.1449 · Cited by 96 · see citing works
Lumb, A. B., & Vail, A. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01912.x · Cited by 93 · see citing works
Learning strategies, study habits and social networking activity of undergraduate medical students
Bickerdike, A., O'Deasmhunaigh, C., O’Flynn, S., & O’Tuathaigh, C. M. P. (2016) · International Journal of Medical Education · doi:10.5116/ijme.576f.d074 · Cited by 92 · see citing works
The mediators of minority ethnic underperformance in final medical school examinations
Woolf, K., McManus, I. C., POTTS, H. W. W., & Dacre, J. E. (2011) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.2011.02060.x · Cited by 93 · see citing works
Dore, K. L., Reiter, H., Kreuger, S., & Norman, G. R. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9739-9 · Cited by 91 · see citing works
Yusoff, M. S. B., Esa, A. R., Pa, M. N. M., Mey, S. C., Aziz, R. A., & Rahim, A. A. (2013) · Education for Health · doi:10.4103/1357-6283.112800 · Cited by 89 · see citing works
Uncertainties in the selection of applicants for medical school
Benbassat, J., & Baumal, R. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-007-9076-0 · Cited by 89 · see citing works
Haight, S. J., Chibnall, J. T., Schindler, D. L., & Slavin, S. J. (2012) · Academic Medicine · doi:10.1097/acm.0b013e318248e9d0 · Cited by 89 · see citing works
Woolf, K., POTTS, H. W. W., Patel, S., & McManus, I. C. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.669082 · Cited by 88 · see citing works
Patterson, F., Ferguson, E., & Thomas, S. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03174.x · Cited by 87 · see citing works
Self-citationCohen‐Schotanus, J., Muijtjens, A. M. M., Schönrock-Adema, J., Geertsma, J., & van der Vleuten, C. P. M. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02959.x · Cited by 84 · see citing works
Schmidmaier, R., Eiber, S., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-28 · Cited by 87 · see citing works
Koczwara, A., Patterson, F., Zibarras, L., Kerrin, M., Irish, B., & Wilkinson, M. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04195.x · Cited by 85 · see citing works
Predictive validity of the Dundee multiple mini-interview
Husbands, A., & Dowell, J. (2013) · Medical Education · doi:10.1111/medu.12193 · Cited by 83 · see citing works
Mercer, A., & Puddey, I. B. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.577123 · Cited by 84 · see citing works
Factors associated with academic success at Vienna Medical School: prospective survey.
Frischenschlager, O., Haidinger, G., & Mitterauer, L. (2005) · PubMed · Cited by 82 · see citing works
Selection of medical students: a controlled experiment
Urlings‐Strop, L. C., Stijnen, T., Themmen, A. P. N., & Splinter, T. A. W. (2009) · Medical Education · doi:10.1111/j.1365-2923.2008.03267.x · Cited by 82 · see citing works
Selecting medical students: An unresolved challenge
POWIS, D. A. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.993600 · Cited by 81 · see citing works
Are differences between graduates and undergraduates in a medical course due to age or prior degree?
WILKINSON, T. J., Wells, J. E., & Bushnell, J. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01981.x · Cited by 81 · see citing works
Patterson, F., Ferguson, E., Norfolk, T., & Lane, P. (2005) · BMJ · doi:10.1136/bmj.330.7493.711 · Cited by 81 · see citing works
Self-citationHughes, R., & Desbrow, B. (2005) · Nutrition & Dietetics · doi:10.1111/j.1747-0080.2005.00015.x · Cited by 80 · see citing works
Ferguson, E., & Lievens, F. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9751-0 · Cited by 80 · see citing works
Self-citationPrevalence and Predictors of Anxiety in Healthcare Professions Students
Macauley, K., Plummer, L. S., Bemis, C., Brock, G., Larson, C., & Spangler, J. (2018) · Health Professions Education · doi:10.1016/j.hpe.2018.01.001 · Cited by 80 · see citing works
Learning styles and approaches: Can reflective strategies encourage deep learning?
Tsingos, C., Bosnic-Anticevich, S. Z., & Smith, L. D. (2015) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2015.04.006 · Cited by 80 · see citing works
Hosford, C. C., & Siders, W. A. (2010) · Teaching and Learning in Medicine · doi:10.1080/10401334.2010.512832 · Cited by 80 · see citing works
Böckers, A., Mayer, C., & Böckers, T. M. (2013) · Anatomical Sciences Education · doi:10.1002/ase.1375 · Cited by 78 · see citing works
Self-reported extracurricular activity, academic success, and quality of life in UK medical students
Lumley, S., Ward, P. J., Roberts, L. M., & Mann, J. P. (2015) · International Journal of Medical Education · doi:10.5116/ijme.55f8.5f04 · Cited by 77 · see citing works
Widening participation in medicine
Garlick, P., & Brown, G. (2008) · British medical journal · doi:10.1136/bmj.39508.606157.be · Cited by 36 · see citing works
Kumwenda, B., Cleland, J., Walker, K. A., Lee, A. J., & Greatrix, R. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016291 · Cited by 81 · see citing works
Effectiveness of medical school admissions criteria in predicting residency ranking four years later
Peskun, C. J., Detsky, A. S., & Shandling, M. R. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02647.x · Cited by 76 · see citing works
Aldosari, M., Aljabaa, A., Al-Sehaibany, F. S., & Albarakati, S. F. (2018) · Advances in Medical Education and Practice · doi:10.2147/amep.s157686 · Cited by 75 · see citing works
Stienen, M. N., Scholtes, F., Samuel, R., Weil, A. G., Weyerbrock, A., & Surbeck, W. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-021310 · Cited by 75 · see citing works
Study-related health and behavior patterns of medical students: A longitudinal study
Voltmer, E., Rosta, J., Aasland, O. G., & Spahn, C. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.496008 · Cited by 74 · see citing works
Griffin, B., Harding, D. W., Wilson, I. G., & Yeomans, N. D. (2008) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2008.tb02024.x · Cited by 74 · see citing works
James, D. K., Yates, J., & Nicholson, S. (2010) · BMJ · doi:10.1136/bmj.c478 · Cited by 73 · see citing works
Self-citationPredicting performance: relative importance of students’ background and past performance
Stegers‐Jager, K. M., Themmen, A. P. N., Cohen‐Schotanus, J., & Steyerberg, E. W. (2015) · Medical Education · doi:10.1111/medu.12779 · Cited by 71 · see citing works
Diversification of U.S. medical schools via affirmative action implementation
Lakhan, S. E. (2003) · BMC Medical Education · doi:10.1186/1472-6920-3-6 · Cited by 70 · see citing works
Austin, Z., Simpson, S., & Reynen, E. (2005) · Teaching in Higher Education · doi:10.1080/1356251042000337918 · Cited by 70 · see citing works
Patterson, F., Lievens, F., Kerrin, M., Munro, N. M., & Irish, B. (2013) · British Journal of General Practice · doi:10.3399/bjgp13x674413 · Cited by 69 · see citing works
Patterson, F., Rowett, E., Hale, R., GRANT, M. M., Roberts, C., Cousans, F., & Martin, S. (2016) · BMC Medical Education · doi:10.1186/s12909-016-0606-4 · Cited by 68 · see citing works
Yates, J. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-95 · Cited by 67 · see citing works
Comparison of UMAT scores and GPA in prediction of performance in medical school: a national study
Poole, P., Shulruf, B., Rudland, J., & WILKINSON, T. J. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04078.x · Cited by 66 · see citing works
Does the UKCAT predict Year 1 performance in medical school?
Lynch, B., MacKenzie, R., Dowell, J. S., Cleland, J., & Prescott, G. J. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03535.x · Cited by 66 · see citing works
Factores asociados al rendimiento académico en estudiantes de medicina
Vélez-van-Meerbeke, A., & González, C. N. R. (2005) · Educación Médica · doi:10.4321/s1575-18132005000200005 · Cited by 66 · see citing works
Ethnic disparities in undergraduate pre‐clinical and clinical performance
Stegers‐Jager, K. M., Steyerberg, E. W., Cohen‐Schotanus, J., & Themmen, A. P. N. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04265.x · Cited by 66 · see citing works
Widening access by changing the criteria for selecting medical students
POWIS, D. A., Hamilton, J. D., & McManus, I. C. (2007) · Teaching and Teacher Education · doi:10.1016/j.tate.2007.06.001 · Cited by 65 · see citing works
Predicting academic outcomes in an Australian graduate entry medical programme
Puddey, I. B., & Mercer, A. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-31 · Cited by 65 · see citing works
Recruiting for values in healthcare: a preliminary review of the evidence
Patterson, F., Prescott‐Clements, L., Zibarras, L., Edwards, H., Kerrin, M., & Cousans, F. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9579-4 · Cited by 65 · see citing works
- Authors
- Ferguson, E., James, D., & Madeley, L.
- Affiliations
- University of Nottingham (GB)
- Corresponding author
- Ferguson, Eamonn
- ORCID
- Ferguson, Eamonn
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2002-04-20
- Volume
- 324
- Issue
- 7343
- Pages
- 952-957
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC102330
- OpenAlex
- W2085677016
- Cited by
- 811
- References
- 35
- Citations by year
- 2026: 18 · 2025: 13 · 2024: 21 · 2023: 25 · 2022: 37 · 2021: 37 · 2020: 42 · 2019: 41 · 2018: 53 · 2017: 37 · 2016: 56 · 2015: 55 · 2014: 53 · 2013: 48 · 2012: 55
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
- Locations
- BMJ (publishedVersion)
- PubMed Central (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Keywords
- predictors of academic performance, undergraduate medical education, graduate medical education, prior academic achievement, learning styles, job interviews, ethnicity, sex differences, personal statements, reference
- MeSH terms
- Clinical Competence, Education, Medical, Educational Status, Ethnicity, Humans, Interviews as Topic, Learning, Personality Tests, School Admission Criteria, Sex Factors, Linear Models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review