The relationship between criteria used to select residents and performance during residency
Abstract
Purpose Can data available at time of interview and evaluation predict level of performance during residency? Methods General surgery residents were studied. Applicant information available prior to admission was used to predict performance during residency as measured by faculty judgment of residents' knowledge, technical skill, maturity and judgment, and overall ability. Results No relationship was found between admission data and final evaluation (using Spearman's coefficient r(s) = 0.27; p = 0.13). We could not distinguish between the top 10 and the bottom 10 ranked residents on admission variables. Nine of the top 10 and 3 of the bottom 10 residents remained in general surgery. Performance on the American Board of Surgery In-Training Examination accounted for 37% of the variance in faculty grading (F(5,28;.05) = 3.26; P = 0.02). Conclusions Residents' interpersonal and technical skills and qualities of character may have a significant role in faculty perception of success during surgical residency. These qualities are not well reflected in candidates' credentials at admission.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Academic achievements prior to entry to residency have not shown a definitive role on either attrition or retention to postgraduate specialty programs.
“Academic achievements prior to entry to residency have not shown a definitive role on either attrition or retention to postgraduate specialty programs.”
Kron and colleagues found that honors performance in medical school predicted retention in their surgical residency program, but Papp et al. showed no correlation between medical school academic records and subsequent performance evaluations among surgical residents.
“Kron and colleagues found that an honors performance in medical school predicted retention in their surgical residency program,37 but Papp et al. showed no correlation between medical school academic records and subsequent performance evaluations among surgical residents38.”
Cites
Resident selection: applicant selection criteria compared with performance.
Erlandson, E. E., Calhoun, J. G., Barrack, F. M., Hull, A. L., Youmans, L. C., Davis, W. K., & Bartlett, R. H. (1982) · PubMed · Cited by 57 · see citing works
Case, S. M., & Swanson, D. B. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00031 · Cited by 57 · see citing works
The relationship of academic measures in medical school to performance after graduation.
Markert, R. J. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00027 · Cited by 51 · see citing works
Fincher, R. M. E., Lewis, L. A., & Kuske, T. T. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00030 · Cited by 37 · see citing works
Can Success in the Surgical Residency Be Predicted from Preresidency Evaluation?
KRON, I. L., KAISER, D. L., NOLAN, S. P., RUDOLF, L. E., MULLER, W. H., & JONES, R. S. (1985) · Annals of Surgery · doi:10.1097/00000658-198512000-00005 · Cited by 35 · see citing works
Comparing medical school graduates who perform poorly in residency with graduates who perform well
Brown, E., Rosinski, E. F., & Altman, D. F. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00022 · Cited by 26 · see citing works
Evaluation of a system designed to enhance the resident selection process.
DaRosa, D. A., & Folse, R. (1991) · PubMed · Cited by 22 · see citing works
The empirical association between student and resident physician performances
Arnold, L., & Willoughby, T. L. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00028 · Cited by 18 · see citing works
Measuring and predicting the performances of practicing physicians
Taylor, C., & Albo, D. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00034 · Cited by 15 · see citing works
Surgical residency: On-the-job training or education?
Griffen, W. O. (1980) · The American Journal of Surgery · doi:10.1016/0002-9610(80)90103-8 · Cited by 13 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A systematic review of the factors affecting choice of surgery as a career
Peel, J. K., Schlachta, C. M., & Alkhamesi, N. A. (2018) · Canadian Journal of Surgery · doi:10.1503/cjs.008217 · Cited by 240 · see citing works
Teaching the surgical craft: From selection to certification
Wanzel, K. R., Ward, M., & Reznick, R. K. (2002) · Current Problems in Surgery · doi:10.1067/mog.2002.123481 · Cited by 239 · see citing works
Visual-spatial ability correlates with efficiency of hand motion and successful surgical performance
Wanzel, K. R., Hamstra, S. J., Caminiti, M. F., Anastakis, D. J., Grober, E. D., & Reznick, R. K. (2003) · Surgery · doi:10.1016/s0039-6060(03)00248-4 · Cited by 197 · see citing works
Expertise in Medicine and Surgery
Norman, G. R., Eva, K. W., Brooks, L. R., & Hamstra, S. J. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796.019 · Cited by 186 · see citing works
Why do residents leave general surgery? The hidden problem in today's programs
Dodson, T. F., & Webb, A. L. B. (2005) · Current Surgery · doi:10.1016/j.cursur.2004.07.009 · Cited by 137 · see citing works
Importance of the Faculty Interview During the Resident Application Process
Brothers, T. E., & Wetherholt, S. (2007) · Journal of surgical education · doi:10.1016/j.jsurg.2007.05.003 · Cited by 136 · see citing works
Systematic review of predictors of surgical performance
Maan, Z. N., Maan, I., Darzi, A. W., & Aggarwal, R. K. (2012) · British journal of surgery · doi:10.1002/bjs.8893 · Cited by 117 · see citing works
Associations between residency selection strategies and doctor performance: a meta‐analysis
Kenny, S. A., McInnes, M. D. F., & Singh, V. (2013) · Medical Education · doi:10.1111/medu.12234 · Cited by 114 · see citing works
Does Residency Selection Criteria Predict Performance in Orthopaedic Surgery Residency?
Raman, T., Alrabaa, R. G., Sood, A., Maloof, P., Benevenia, J., & Berberian, W. S. (2015) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-015-4317-7 · Cited by 108 · see citing works
Information Collected During the Residency Match Process Does Not Predict Clinical Performance
Borowitz, S. M., Saulsbury, F. T., & Wilson, W. G. (2000) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.154.3.256 · Cited by 103 · see citing works
Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., et al. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed442b · Cited by 98 · see citing works
Factors related to attrition in surgery residency based on application data.
Naylor, R. A. (2008) · Archives of Surgery · doi:10.1001/archsurg.143.7.647 · Cited by 98 · see citing works
Haight, S. J., Chibnall, J. T., Schindler, D. L., & Slavin, S. J. (2012) · Academic Medicine · doi:10.1097/acm.0b013e318248e9d0 · Cited by 89 · see citing works
Predictors of Future Success in Otolaryngology Residency Applicants
Chole, R. A., & Ogden, M. A. (2012) · Archives of Otolaryngology - Head and Neck Surgery · doi:10.1001/archoto.2012.1374 · Cited by 87 · see citing works
The Predictive Value of General Surgery Application Data for Future Resident Performance
Alterman, D. M., Jones, T. M., Heidel, R. E., Daley, B. J., & Goldman, M. H. (2011) · Journal of surgical education · doi:10.1016/j.jsurg.2011.07.007 · Cited by 84 · see citing works
Messner, A. H., & Shimahara, E. (2008) · The Laryngoscope · doi:10.1097/mlg.0b013e318175337e · Cited by 74 · see citing works
Personality differences between surgery residents, nonsurgery residents, and medical students
Hoffman, B. M., Coons, M. J., & Kuo, P. C. (2010) · Surgery · doi:10.1016/j.surg.2010.04.005 · Cited by 73 · see citing works
Kwakwa, F., & JONASSON, O. M. (1999) · Journal of the American College of Surgeons · doi:10.1016/s1072-7515(99)00198-2 · Cited by 71 · see citing works
Harfmann, K. L., & Zirwas, M. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.07.034 · Cited by 67 · see citing works
Sex is not everything: the role of gender in early performance of a fundamental laparoscopic skill
Kolozsvari, N. O., Andalib, A., Kaneva, P. A., Cao, J., Vassiliou, M. C., Fried, G. M., & Feldman, L. S. (2010) · Surgical Endoscopy · doi:10.1007/s00464-010-1311-8 · Cited by 67 · see citing works
Personality Testing May Identify Applicants Who Will Become Successful in General Surgery Residency
Hughes, B. D., Perone, J. A., Cummins, C. B., Sommerhalder, C., Tyler, D. S., Bowen, K. A., & Radhakrishnan, R. S. (2018) · Journal of Surgical Research · doi:10.1016/j.jss.2018.08.003 · Cited by 65 · see citing works
Thordarson, D. B., Ebramzadeh, E., Sangiorgio, S. N., Schnall, S. B., & Patzakis, M. J. (2007) · Clinical Orthopaedics and Related Research · doi:10.1097/blo.0b013e31805d7eda · Cited by 64 · see citing works
Can We Predict “Problem Residents”?
Brenner, A. M., Mathai, S., Jain, S., & Mohl, P. C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181e1a85d · Cited by 58 · see citing works
Zuckerman, S. L., Kelly, P. D., Dewan, M. C., Morone, P. J., Yengo-Kahn, A. M., Magarik, J. A., Baticulon, R. E., Zusman, E. E., Solomon, G. S., & Wellons, J. C. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.11.078 · Cited by 54 · see citing works
Wagner, J. G., Schneberk, T. W., Zobrist, M., Hern, H. G., Jordan, J. L., Boysen‐Osborn, M., & Menchine, M. D. (2016) · Journal of Emergency Medicine · doi:10.1016/j.jemermed.2016.11.008 · Cited by 50 · see citing works
Lipman, J. M., Colbert, C. Y., Ashton, R. W., French, J. C., Warren, C., Yepes-Rios, M., King, R. S., Bierer, S. B., Kline, T., & Stoller, J. K. (2023) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-22-00955.1 · Cited by 43 · see citing works
Luk, L., Maher, M. D., Desperito, E., Weintraub, J. L., Amin, S., & Ayyala, R. S. (2018) · Academic Radiology · doi:10.1016/j.acra.2018.05.001 · Cited by 43 · see citing works
Consultant supervision of surgical trainees: an objective assessment of how much actually occurs.
Dikki, P. E., Crofts, T. J., Nixon, S. J., & Aitken, R. J. (1999) · PubMed Central · Cited by 37 · see citing works
The Utility of Pre-Residency Standardized Tests for Anesthesiology Resident Selection
Guffey, R. C., Rusin, K., Chidiac, E. J., & Marsh, H. W. (2010) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e3181fcfacd · Cited by 36 · see citing works
Tabby, D. S., Majeed, M. H., & Schwartzman, R. J. (2011) · Neurology · doi:10.1212/wnl.0b013e31821f4636 · Cited by 33 · see citing works
Correlation of Manual Dexterity With USMLE Scores and Medical Student Class Rank
Goldberg, A. E., Neifeld, J. P., Wolfe, L. G., & Goldberg, S. R. (2008) · Journal of Surgical Research · doi:10.1016/j.jss.2008.02.050 · Cited by 33 · see citing works
Under the microscope: Assessing surgical aptitude of otolaryngology residency applicants
Carlson, M. L., Archibald, D. J., Sorom, A. J., & Moore, E. J. (2010) · The Laryngoscope · doi:10.1002/lary.20914 · Cited by 33 · see citing works
Standardized letter of recommendation for pediatric fellowship selection
Prager, J. D., Perkins, J. N., McFann, K., Myer, C. M., Pensak, M. L., & Chan, K. H. (2011) · The Laryngoscope · doi:10.1002/lary.22394 · Cited by 32 · see citing works
Nagasawa, D. T., Beckett, J. S., Lagman, C., Chung, L. K., Schmidt, B., Safaee, M., Bergsneider, M., Martin, N. A., Gaonkar, B., Macyszyn, L. J., et al. (2016) · World Neurosurgery · doi:10.1016/j.wneu.2016.11.091 · Cited by 31 · see citing works
A Psychological Profile of Surgeons and Surgical Residents
Foster, K. N., Neidert, G. P. M., Brubaker-Rimmer, R., Artalejo, D., & Caruso, D. M. (2010) · Journal of Surgical Education · doi:10.1016/j.jsurg.2010.07.007 · Cited by 30 · see citing works
The Impact of the Interview in Pediatric Residency Selection
Swanson, W. S., Harris, M. C., Master, C. L., Gallagher, P. R., Mauro, A. E., & Ludwig, S. (2005) · Ambulatory Pediatrics · doi:10.1367/a04-149r1.1 · Cited by 30 · see citing works
Objective assessment, selection, and certification in surgery
Vassiliou, M. C., & Feldman, L. S. (2010) · Surgical Oncology · doi:10.1016/j.suronc.2010.09.004 · Cited by 29 · see citing works
Surgical Residency Market Research-What Are Applicants Looking for?
Parker, A. M., Petroze, R. T., Schirmer, B. D., & Calland, J. F. (2012) · Journal of surgical education · doi:10.1016/j.jsurg.2012.09.002 · Cited by 29 · see citing works
Can Admissions Interviews Predict Performance in Residency?
Dubovsky, S. L., Gendel, M. H., Dubovsky, A. N., Levin, R., Rosse, J. G., & House, R. M. (2008) · Academic Psychiatry · doi:10.1176/appi.ap.32.6.498 · Cited by 29 · see citing works
Predicting success: What medical student measures predict resident performance in neurology?
Burish, M. J., Fredericks, C. A., Engstrom, J. W., Tateo, V. L., & Josephson, S. A. (2015) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2015.05.007 · Cited by 28 · see citing works
Ayers, W. R., & Boulet, J. R. (2001) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1304_01 · Cited by 27 · see citing works
Improving methods of resident selection
Prager, J. D., Myer, C. M., Hayes, K. M., Myer, C. M., & Pensak, M. L. (2010) · The Laryngoscope · doi:10.1002/lary.21022 · Cited by 27 · see citing works
Increasing the Number of Trainees in General Surgery Residencies: Is There Capacity?
Charles, A. G., Walker, E. G., Poley, S., Sheldon, G. F., Ricketts, T. C., & Meyer, A. A. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318212eb17 · Cited by 26 · see citing works
Mainthia, R., Tarpley, M. J., Davidson, M., & Tarpley, J. L. (2013) · Journal of surgical education · doi:10.1016/j.jsurg.2013.07.012 · Cited by 23 · see citing works
Caldwell, K. E., Rodríguez, J., Hess, A., Han, B. J., Awad, M. M., & Sacks, B. C. (2021) · Surgery · doi:10.1016/j.surg.2021.11.005 · Cited by 19 · see citing works
Otolaryngology Resident Selection
Bent, J. P., Colley, P. M., Zahtz, G. D., Smith, R. V., Parikh, S. R., Schiff, B. A., & Fried, M. P. (2011) · Otolaryngology · doi:10.1177/0194599810396604 · Cited by 19 · see citing works
Using the CanMEDS roles when interviewing for an ophthalmology residency program
Hamel, P., Boisjoly, H., Corriveau, C., Fallaha, N., Lahoud, S., Luneau, K., Olivier, S., Rouleau, J., & Toffoli, D. (2007) · Canadian Journal of Ophthalmology · doi:10.1139/i07-006 · Cited by 17 · see citing works
Clayton, B., Lypek, D. J., & Connelly, L. (2000) · PubMed · Cited by 15 · see citing works
Bajwa, N. M., Yudkowsky, R., Belli, D. C., Vu, N. V., & Park, Y. S. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9683-8 · Cited by 14 · see citing works
Resident Selection: The Role of Assessment of Emotional Intelligence and Grit
Luce, E. A. (2021) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000008382 · Cited by 13 · see citing works
Predicting residents' performance: A prospective study
Ozuah, P. O. (2002) · BMC Medical Education · doi:10.1186/1472-6920-2-7 · Cited by 13 · see citing works
Role of the interview in admissions at the University of Toronto ophthalmology program
Christakis, P. G., Christakis, T. J., Dziura, J., & Christakis, J. T. (2010) · Canadian Journal of Ophthalmology · doi:10.3129/i10-041 · Cited by 12 · see citing works
The Effect of Blinded Versus Nonblinded Interviews in the Resident Selection Process
Brustman, L. E., Williams, F. L., Carroll, K., Lurie, H., Ganz, E., & Langer, O. (2010) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-10-00051.1 · Cited by 12 · see citing works
Wall, J. J., Votey, S. R., Solomon, T., & Schriger, D. L. (2019) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2019.4.40602 · Cited by 11 · see citing works
Performing Under Pressure: Varsity Athletes Excel in Medical School
Strowd, L. C., Gao, H., O’Brien, M. C., Reynolds, P. S., Grier, D. D., & Peters, T. R. (2019) · Medical Science Educator · doi:10.1007/s40670-019-00730-4 · Cited by 11 · see citing works
Faculty Characteristics Affect Interview Scores During Residency Recruitment
Oyler, J. L., Thompson, K., Arora, V. M., Krishnan, J. A., & Woodruff, J. N. (2015) · The American Journal of Medicine · doi:10.1016/j.amjmed.2015.01.025 · Cited by 10 · see citing works
VanOrder, T., Robbins, W. K., & Zemper, E. D. (2017) · The Journal of the American Osteopathic Association · doi:10.7556/jaoa.2017.040 · Cited by 10 · see citing works
Minorities and the Orthopaedic Profession
Ayers, C. E.-E. (1999) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-199905000-00010 · Cited by 10 · see citing works
Burkhardt, R., Hämmerle, C. H. F., & Lang, N. P. (2018) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.13028 · Cited by 9 · see citing works
Aggregate Interview Method of Ranking Orthopedic Applicants Predicts Future Performance
Geissler, J. A., Heest, A. E. V., Tatman, P. J., & Gioe, T. J. (2013) · Orthopedics · doi:10.3928/01477447-20130624-30 · Cited by 9 · see citing works
Predicting the Technical Competence of Surgical Residents
Hamstra, S. J. (2006) · Clinical Orthopaedics and Related Research · doi:10.1097/01.blo.0000224060.55237.c8 · Cited by 9 · see citing works
Mastering the Match: Recruiting a Successful Surgery Resident
Dudas, L. M., Khan, U. S., & Borgstrom, D. C. (2021) · Current Surgery Reports · doi:10.1007/s40137-021-00304-7 · Cited by 7 · see citing works
A step ahead--evaluating the clinical judgment skills of incoming interns.
Wendling, A. L., & Baty, P. J. (2009) · PubMed · Cited by 7 · see citing works
National Resident Matching Program Rank Order and Performance in an Internal Medicine Residency
Everett, G. D., Maharam, E. R., & Yi, F. (2021) · Southern Medical Journal · doi:10.14423/smj.0000000000001301 · Cited by 6 · see citing works
Chen, J. H., Costa, P. L., & Gardner, A. K. (2023) · Journal of surgical education · doi:10.1016/j.jsurg.2023.05.024 · Cited by 4 · see citing works
Fysh, T. (2012) · Journal of surgical education · doi:10.1016/j.jsurg.2011.10.003 · Cited by 3 · see citing works
National Selection into General Surgery: A Pilot Study
Lamont, P., Griffiths, G., & Cochrane, L. (2011) · Bulletin of The Royal College of Surgeons of England · doi:10.1308/147363511x580394 · Cited by 3 · see citing works
Tabuñar, S. M. S., & Parreño Sacdalan, M. D. (2025) · PubMed · doi:10.47895/amp.vi0.9376 · Cited by 2 · see citing works
Shaffrey, E. C., Edalatpour, A., Nicksic, P. J., Nkana, Z. H., Michelotti, B. F., & Afifi, A. M. (2023) · Aesthetic Plastic Surgery · doi:10.1007/s00266-023-03513-w · Cited by 2 · see citing works
Barlow, T., Wight, A. G., & Barlow, D. E. (2012) · JRSM Short Reports · doi:10.1258/shorts.2012.012074 · Cited by 2 · see citing works
Meier, A. H., Gorman, P. J., & Krummel, T. M. (2001) · Elsevier eBooks · doi:10.1016/b978-012655330-7/50092-7 · Cited by 2 · see citing works
Wood, F. C., Lin, M. J., Stewart, K. E., Sarwar, Z., & Lees, J. S. (2025) · Journal of surgical education · doi:10.1016/j.jsurg.2025.103795 · Cited by 1 · see citing works
Identification of Factors that May Predict Career Trajectory Among Neuro-Ophthalmology Fellows
Patel, A. N., Tian, J., & Henderson, A. D. (2023) · Journal of Neuro-Ophthalmology · doi:10.1097/wno.0000000000001836 · Cited by 1 · see citing works
Optimising the acquisition of laparoscopic skill
Torkington, J., Smith, S., Rees, B. W., & Darzi, A. W. (2000) · Minimally Invasive Therapy & Allied Technologies · doi:10.3109/13645700009061450
Menjivar, N. S. (2014) · University of Minnesota Digital Conservancy (University of Minnesota)
Naftalovich, R., Siddiqui, B., Gubenko, Y. A., Rimal, J., Li, D., & Aziz, R. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-21-00431.1
Psychological assessment of medical school applicants for general surgery residencies
Geno, C. E., Skinner, C., Gregg, J. B., Wallace, J. C., Harrell, A. G., Taylor, G., Bell, G., & Avery, D. M. (2018) · International Journal of Innovative Surgery · doi:10.33582/2639-9229/1004
Silvestri, C. J., Nwigwe, V., Krishnamoorthy, S., & Aarons, C. B. (2025) · Journal of surgical education · doi:10.1016/j.jsurg.2025.103580
Ramula, M., Shanmugapriya, M., Joslin Pratheeja, J., Dharani, S., Nithyakalki, S. P., Anish, S., Kiruthika, G., Jeneta, J., ., H., & Kavisaravanan, S. N. (2026) · International Journal of Surgery Science · doi:10.33545/surgery.2026.v10.i6.a.1327
- Authors
- Papp, K. K., Polk, H. C., & David Richardson, J.
- Affiliations
- University of Louisville (US)
- Corresponding author
- Papp, Klara K.
- Venue
- The American Journal of Surgery
- Publisher
- Elsevier BV
- Published
- 1997-04
- Volume
- 173
- Issue
- 4
- Pages
- 326-329
- ISSN
- 0002-9610 (ISSN-L)
- OpenAlex
- W2040300425
- Cited by
- 78
- References
- 10
- Citations by year
- 2025: 3 · 2023: 4 · 2021: 5 · 2019: 2 · 2018: 5 · 2017: 2 · 2016: 3 · 2015: 3 · 2014: 1 · 2013: 3 · 2012: 6
- FWCI
- 2.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Journal of Surgery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- resident performance prediction, general surgery residents, faculty evaluation, in-training examination, social skills, technical skills, graduate medical education
- MeSH terms
- Career Choice, Clinical Competence, Faculty, Medical, Humans, Internship and Residency, School Admission Criteria, General Surgery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review