The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Exploring family physicians' reactions to multisource feedback: perceptions of credibility and usefulness
Abstract
Purpose Physician performance is comprised of several domains of professional competence. Multisource feedback (MSF) or 360‐degree feedback is an approach used to assess these, particularly the humanistic and relational competencies. Research studying responses to performance assessment shows that reactions vary and can influence how performance feedback is used. Improvement does not always result, especially when feedback is perceived as negative. This small qualitative study undertook preliminary exploration of physicians' reactions to MSF, and perceptions influencing these and the acceptance and use of their feedback. Methods We held focus groups with 15 family physicians participating in an MSF pilot study. Qualitative analyses included content and constant comparative analyses. Results Participants agreed that the purpose of MSF assessment should be to enhance practice and generally agreed with their patients' feedback. However, responses to medical colleague and co‐worker feedback ranged from positive to negative. Several participants who responded negatively did not agree with their feedback nor were inclined to use it for practice improvement. Reactions were influenced by perceptions of accuracy, credibility and usefulness of feedback. Factors shaping these perceptions included: recruiting credible reviewers, ability of reviewers to make objective assessments, use of the assessment tool and specificity of the feedback. Conclusion Physicians' perceptions of the MSF process and feedback can influence how and if they use the feedback for practice improvement. These findings are important, raising the concern that feedback perceived as negative and not useful will have no or negative results, and highlight questions for further study.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Do recognize that trainees must perceive feedback as credible in order for it to be influential.”
From Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. (2015) · cites this paper as [8]
In the citing paper
“Other factors -such as the emotional reaction of the learner, the credibility of the educator, or the time interval within which feedback is given -may all affect how learners perceive and interpret the feedback message. 14,18-21”
From Medical student perceptions of feedback and feedback behaviors within the context of the “educational alliance.” (2017) · cites this paper as [19]
Citations
Cites
(1998) · Sage eBooks · Cited by 38,631
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
(2021) · Edward Elgar Publishing eBooks · doi:10.4337/9781788976954.00014 · Cited by 4,031
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,114
360° feedback: Accuracy, reactions, and perceptions of usefulness.
Brett, J. F., & ATWATER, L. E. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.5.930 · Cited by 505
SELF‐OTHER AGREEMENT: DOES IT REALLY MATTER?
ATWATER, L. E., Ostroff, C. L., Yammarino, F. J., & Fleenor, J. W. (1998) · Personnel Psychology · doi:10.1111/j.1744-6570.1998.tb00252.x · Cited by 455
Use of Peer Ratings to Evaluate Physician Performance
Ramsey, P. G. (1993) · JAMA · doi:10.1001/jama.1993.03500130069034 · Cited by 368
Off the Track: Why and How Successful Executives Get Derailed
McCall, M. W., & Lombardo, M. M. (1983) · doi:10.35613/ccl.1983.1083 · Cited by 340
Multisource feedback in the assessment of physician competencies
Lockyer, J. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230103 · Cited by 284
Employee responses to formal performance appraisal feedback.
Pearce, J. L., & Porter, L. W. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.2.211 · Cited by 268
Research works printed but not linked: 7
- Bracken DW, 2001, The Handbook for Multisource Feedback
- Thompson PH, 1970, Performance appraisal: managers beware, Harvard Business Rev, 48, 149
- 10.1037//0033-2909.119.2.254 · DOI · Paper page
- Alberta's Physician Achievement Review (PAR) Program: A review of the first three years.College of Physicians and Surgeons of Alberta.Available at:http://www.cpsa.ab.ca/collegeprograms/attachments/par_evaluation.pdf. Accessed 30 April 2004.
- Alberta's Physician Achievement Review (PAR) Program.College of Physicians and Surgeons of Alberta. Available at:http://www.cpsa.ab.ca/collegeprograms/par_program.asp. Accessed 28 April 2004.
- Nova Scotia Physician Achievement Review (NSPAR) Program.College of Physician and Surgeons of Nova Scotia.Available at:http://www.nspar.ca/. Accessed 28 April 2004.
- 10.1093/sw/46.2.125 · DOI · Paper page
Cited by
Sorted by citations
Items 101–173 of 173
Effect of field notes on confidence and perceived competence: survey of faculty and residents.
Laughlin, T., Brennan, A., & Brailovsky, C. (2012) · Europe PMC (PubMed Central) · Cited by 14
Sehlbach, C., Bosveld, M. H., Romme, S., Nijhuis, M. A., Govaerts, M., & Smeenk, F. W. J. M. (2024) · Medical Education · doi:10.1111/medu.15313 · Cited by 13
“16 The transfer of previous findings regarding engagement with feedback 17 – 19 to inviting patients into feedback conversations and to structurally link patient feedback to learning in a workplace setting thus seems equally valuable and challenging.”
Arabsky, S., Castro, N., Murray, M. D., Bisca, I., & Eva, K. W. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003642 · Cited by 13
Moreau, K. A., Eady, K., & Jabbour, M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1460658 · Cited by 13
“Previous research has shown that residents agree with such feedback and use it to improve their practices when they receive it (Bing-You et al. 1997; Sargeant et al. 2005; Sargeant et al. 2008; Eady and Moreau 2018).”
BackgroundResultAffecting Change: Enhancing Feedback Interactions with Radiology Trainees
Burns, J., Chetlen, A. L., Morgan, D. E., Catanzano, T. M., McLoud, T. C., Slanetz, P. J., & Jay, A. K. (2021) · Academic Radiology · doi:10.1016/j.acra.2021.05.018 · Cited by 13
Thammasitboon, S., Mariscalco, M. M., Yudkowsky, R., Hetland, M. D., Noronha, P. A., & Mrtek, R. G. (2008) · Teaching and Learning in Medicine · doi:10.1080/10401330802384680 · Cited by 13
Resident Teachers and Feedback: Time to Raise the Bar
Watling, C. (2014) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-14-00493.1 · Cited by 13
Zhou, A. Y., & Baker, P. (2014) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2014.11.17 · Cited by 12
“A lack of trust and cynicism was not an uncommon finding in both medical [45,53,55,58,137,142,144-147] and non-medical feedback [5,9,15-17,21,26,38-40,52,61,67,70,71,75 81,82, 91,148-150].”
Acceptability and educational impact of a peer feedback model for significant event analysis
McKay, J., Shepherd, A., Bowie, P., & Lough, M. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03235.x · Cited by 12
The assessment of medical competencies
Sureda, E., Palmer, C. R., & Sesé, A. (2017) · Revista Clínica Española (English Edition) · doi:10.1016/j.rceng.2017.05.004 · Cited by 11
Validating written feedback in clinical formative assessment
Page, M., Gardner, J., & Booth, J. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1691974 · Cited by 10
“For various reasons, (see, for example, Sargeant, Mann, and Ferrier 2005; Sargeant et al. 2007; Archer, McGraw, and Davies 2010; Burford et al. 2010) the receipt of good feedback cannot in itself guarantee improved learning or performance, but the ideal situation is that feedback should be…”
BackgroundRoberts, M. J., Campbell, J. L., Richards, S. H., & Wright, C. (2013) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21162 · Cited by 12
Feedback literacy as a model to explore how learners respond to feedback
Spooner, M., & Pawlikowska, T. R. B. (2023) · British Journal of Hospital Medicine · doi:10.12968/hmed.2022.0446 · Cited by 9
van Leijen‐Zeelenberg, J. E., van Raak, A., Duimel-Peeters, I. G. P., Kroese, M., Brink, P. R. G., Ruwaard, D., & Vrijhoef, H. J. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-149 · Cited by 11
“Literature on information transfer and feedback [11-14] combined with input from healthcare providers working in acute care chains served as input for the redesign.”
BackgroundSource–Target Relationship and Information Specificity
Rui, J. R. (2017) · Social Science Computer Review · doi:10.1177/0894439317717196 · Cited by 10
“For example, research on online health information provides consistent evidence that specific health information is viewed more credible (Sargeant, Mann, & Ferrier, 2005; Webb & Eves, 2007).”
BackgroundStroud, L. F., Sibbald, M., Richardson, D. L., McDonald-Blumer, H., & Cavalcanti, R. B. (2018) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-17-00578.1 · Cited by 10
Bruce, D. (2007) · BMJ · doi:10.1136/bmj.39135.619410.80 · Cited by 9
“Care will be needed to ensure that the valued developmental aspect of appraisal is not lost and that new 360o feedback tools have a positive effect on clinicians’ practices.((8))”
BackgroundBergum, S. K., Canaan, T., DeLemos, C., Gall, E. F., McCracken, B., Rowen, D., Salvemini, S., & Wiens, K. (2017) · Journal of the American Association of Nurse Practitioners · doi:10.1002/2327-6924.12471 · Cited by 9
Impact of implementing multisource feedback on behaviors of young doctors
Ahmad, N., Sethi, A., & Khan, R. A. (2021) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.37.7.4155 · Cited by 9
Nikels, S. M., Guiton, G., Loeb, D. F., & Brandenburg, S. L. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-11-00315.1 · Cited by 9
Seeing is believing: an exploration of what residents value when they receive feedback
Beaulieu, A. M., Kim, B., Topor, D. R., & Dickey, C. C. (2019) · Academic Psychiatry · doi:10.1007/s40596-019-01071-5 · Cited by 8
Sorg, J. C., Wilson, R. D., Perzynski, A. T., Tran, D., & Vargo, M. M. (2012) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e3182645e63 · Cited by 7
Olsson, J.-E., Ekblad, S., Bertilson, B. C., & Toth-Pal, E. (2018) · International Journal of Medical Education · doi:10.5116/ijme.5af6.c209 · Cited by 6
Patients as Feedback Providers: Exploring Medical Students’ Credibility Judgments
Eijkelboom, C., de Kleijn, R. A. M., van Diemen, W. J. M., Maljaars, C. D. N., van der Schaaf, M. F., & Frenkel, J. (2023) · Perspectives on Medical Education · doi:10.5334/pme.842 · Cited by 10
McGinness, A. K., Wamsley, M. A., & Rivera, J. A. (2019) · Journal of Interprofessional Education & Practice · doi:10.1016/j.xjep.2019.03.012 · Cited by 6
DeStephano, C. C., Crawford, K. A., Jashi, M., & Wold, J. L. (2014) · The Journal of Continuing Education in Nursing · doi:10.3928/00220124-20140528-03 · Cited by 5
Fostering “Reflection-On-Practice” Through a Multisource Feedback and Peer Coaching Pilot Program
Curran, V. R., Fleet, L. J., & Whitton, C. (2022) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000483 · Cited by 5
Sinclair, A. M., Gunendran, T., Archer, J. C., Bridgewater, B., O’Flynn, K. J., & Pearce, I. (2009) · British Journal of Medical and Surgical Urology · doi:10.1016/j.bjmsu.2008.12.011 · Cited by 5
van Es, J. M., Visser, M. R. M., & Waard, M. W. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.670327 · Cited by 5
“Adding narrative comments to rating scores (Sargeant et al. 2005; Overeem et al. 2010), linking questionnaires to a desired standard of assessed job skills (Dolmans et al. 2002; Lockyer 2003; Wood et al. 2006), ensuring credibility of feedback sources (Veloski et al. 2006; Wood et al., 2006; Berk…”
BackgroundWentlandt, K., Bracaglia, A., Drummond, J., Handren, L. M., McCann, J., Clarke, C., Degendorfer, N., & Chan, C. K. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0511-2 · Cited by 5
“These include participant’s emotional reactions to the feedback, the congruence between the feedback and their personal beliefs about themselves, and the nature and characteristics of the feedback itself [15, 16].”
A review of multi-source feedback focusing on psychometrics, pitfalls and some possible solutions
Ashworth, N. L., Champlain, A. F. D., & Kain, N. A. (2021) · SN Social Sciences · doi:10.1007/s43545-020-00033-1 · Cited by 5
van der Meulen, M. W., Arah, O. A., Heeneman, S., Egbrink, M. G. A. O., van der Vleuten, C. P. M., & Lombarts, K. M. J. M. H. (2021) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000347 · Cited by 5
Bowie, P., McKay, J., Murray, L. S., & Lough, M. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00941.x · Cited by 4
Management of breast cancer in women with BRCA gene mutation
Kell, M., & Burke, J. P. (2007) · BMJ · doi:10.1136/bmj.39114.354248.80 · Cited by 4
“will involve an annual appraisal, which will now contain a summative element, and any concerns raised by the medical director or GMC affiliate will need to be resolved. A 360� feedback tool (to give feedback on performance from several sources) will be piloted to support the process. Care will be needed to ensure that…”
Interpreting multisource feedback: online study of consensus and variation among GP appraisers
Wright, C., Campbell, J., McGowan, L. D., Roberts, M. J., Jelley, D., & Chatterjee, A. (2016) · British Journal of General Practice · doi:10.3399/bjgp16x684373 · Cited by 4
“Repeat the colleague survey only 7 (7) 0 (0) 17 (18) 2 (2) 0 (0) 2 (2) 20 (23) 0 (0)”
Pardhan, K., Jones, L., & Watling, C. (2022) · Canadian Journal of Emergency Medicine · doi:10.1007/s43678-022-00435-5 · Cited by 4
“This differs from previous findings by Sargeant [12], Watling [17], Ashford [34], and their colleagues who note that where feedback is ego dystonic or threatens professional identity as it is likely to be discarded.”
ResultEffective Feedback Conversations in Clinical Practice
Johnson, C., Watling, C., Keating, J. L., & Molloy, E. (2020) · Springer eBooks · doi:10.1007/978-981-13-6106-7_53-1 · Cited by 6
Yang, A., Newhook, D., Sutherland, S., Moreau, K. A., Eady, K., Barrowman, N., & Writer, H. (2022) · Medical Teacher · doi:10.1080/0142159x.2022.2152661 · Cited by 3
“When provided with assessment and feedback from patients and families, residents use it to inform positive changes to their practice (Sargeant et al. 2005; Sargeant et al. 2008), and to develop greater awareness of their own behaviors as well as a better understanding of parent/ patient needs…”
BackgroundSchmidt, M., Seifried-Dübon, T., Göbel, J., Degen, L., Werners, B., Grot, M., Rind, E., Pieper, C., Jöckel, K., Minder, K., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066298 · Cited by 3
Evaluation of Residency Programs: A Novel Approach Using Simulation
Doyle, K. A., Young, M. E., & Meterissian, S. H. (2014) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00026.1 · Cited by 3
Providing Feedback to Residents
Sabesan, V. J., & Whaley, J. D. (2017) · Springer eBooks · doi:10.1007/978-3-319-62944-5_8 · Cited by 3
Alansari, R. A., Lim, P., Ramani, S., & Palaganas, J. C. (2023) · The Clinical Teacher · doi:10.1111/tct.13696 · Cited by 2
“25 Moreover, participants tended to perceive feedback as a personal affront, deeply intertwined with their self-concept.”
Backgroundvan der Leeuw, R. M., Bouwmeester, N. H., Eva, K. W., Hiligsmann, M., & Teunissen, P. W. (2024) · Medical Education · doi:10.1111/medu.15541 · Cited by 2
“12,14,16 Further work will also be required to determine if our focus on elderly care medicine in the ‘ Global North ’ influenced the feedback preferences expressed.”
The assessment of doctors' performance: Tools and techniques
Collett, A., & Starke, I. D. (2008) · Journal of Management & Marketing in Healthcare · doi:10.1179/175330308791011308 · Cited by 2
Ansari, A. A., Agab, A. W., Sayed, S. D. A., & Fudhala, N. J. A. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0311-2 · Cited by 2
Eijkelboom, C., de Kleijn, R. A. M., Frenkel, J., & van der Schaaf, M. F. (2024) · Perspectives on Medical Education · doi:10.5334/pme.1261 · Cited by 2
Fornells-Vallés, J. M., Julià, X., Arnau, J., & Carretero, J. M. M. (2008) · Educación Médica · doi:10.33588/fem.111.274 · Cited by 2
Clarifying observation and assessment feedback in workplace-based learning
Pelgrim, E. A. M. (2013) · Radboud Repository (Radboud University) · Cited by 2
Study manager' evaluation form according to teachers and managers
Bahrami, A. (2013) · Cited by 1
Effect of field notes on confidence and perceived competence
Laughlin, T., Brennan, A., & Brailovsky, C. (2012) · Canadian Family Physician · Cited by 1
Perera, D. P., Andrades, M., & Wass, V. (2017) · BMC Medical Education · doi:10.1186/s12909-017-1090-1 · Cited by 1
“Peer feedback in various settings has revealed conflicting evidence of usefulness, or acceptance [9].”
BackgroundRational medicine prescription interventions in countries of the world: a systematic review
Moradi, F., Seyedin, H., & Soleymani, F. (2019) · Family Medicine & Primary Care Review · doi:10.5114/fmpcr.2019.88389 · Cited by 1
Effective Feedback Conversations in Clinical Practice
Johnson, C., Watling, C., Keating, J. L., & Molloy, E. (2023) · Springer eBooks · doi:10.1007/978-981-15-3344-0_53 · Cited by 1
Proceedings of the XVI European meeting of trainees in obstetrics and gynaecology
Sommer, E. M. (2007) · European Clinics in Obstetrics and Gynaecology · doi:10.1007/s11296-007-0060-2 · Cited by 1
Co-worker Assessment and Physician Multisource Feedback
Trueman, G. (2013) · doi:10.11575/prism/25478 · Cited by 1
“49) 129 (86) 14 (9) 7 (5) 150 (100) 0 150 Episodic Medicine 47 (31) 103 (69) 127 (85) 23 (15) 19 (9.”
Workplace-based assessment in clinical radiology in the UK - a validity study
Page, M. (2016) · Stirling Online Research Repository (University of Stirling) · Cited by 1
Amoomo, A. (2014) · Ounongo Repository
Patient feedback in general practice training.
Reinders, M. E. (2010) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam)
Multi Source Feedback Among Physicians, is it Effective? A Rapid Evidence AssessmentPreprint
Rombout, Y. L., & Bosman, M. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2553352
Feedback perceptions and attributions in three feedback conditions
Wassenaar, B. (2016) · Utrecht University Repository (Utrecht University)
Swinging the Pendulum from Recipes to Relationships
Ramani (2018) · Research Publications (Maastricht University) · doi:10.26481/dis.20181031sr · Cited by 1
Instructional Feedback in Medical Education
Sargeant, J. M., & Watling, C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316832134.015 · Cited by 1
Self-citationUK palliative medicine trainees and multisource communication skills feedback: an educational tool?
Webber, K., & Selman, R. (2020) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2019-002133
عبدالبر, ع. م. ع. (2020) · مجلة كلية التربية جامعة بنها · doi:10.21608/jfeb.2020.122524
Murton, C., Spowart, L., & Anderson, M. (2022) · MedEdPublish · doi:10.12688/mep.17531.1
Healthcare quality improvement by redesign
van Leijen‐Zeelenberg, J. E. (2015) · doi:10.26481/dis.20151218jl
Co-Worker Assessment and Physician Multisource Feedback
(2016) · ARC Journal of Nursing and Healthcare · doi:10.20431/2455-4324.0201001
Feedback Culture Among Nigerian Orthodontic Medical Educators
Etim, S. S., & ARIGBEDE, A. O. (2023) · Journal of West African College of Surgeons · doi:10.4103/jwas.jwas_176_22
“It was reported[23] that feedback among colleagues do have maximum impact and are useful especially when given by people who understand the work they are doing.”
BackgroundEijkelboom, C. (2023) · doi:10.33540/1853
Additional file 1 of Examining the educational impact of the mini-CEX: a randomised controlled study
Martinsen, S. S. S., Espeland, T., Berg, E. A. R., Samstad, E. O., Lillebo, B., & Slørdahl, T. S. (2021) · Figshare · doi:10.6084/m9.figshare.14462538
Final-year dental students’ perceptions of verbal feedback in the clinical setting
Peck, C. W., Mohamed, N., & McNamee, L. (2025) · South African Dental Journal · doi:10.17159/sadj.v80i06.21318
Giglio, A., Ferre, A., Pedreros, C., Vuletin, V., & Rivera, S. A. (2026) · Revista Médica Clínica Las Condes · doi:10.1016/j.rmclc.2026.03.005
Sudarso, S., Purnamasari, C. B., Suhoyo, Y., & Emilia, O. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-125017
“24 Finally, although the impact of MSF on learning and professional development has been explored among practising physicians, 25 26 evidence regarding its effect on student learning, professional development and clinical clerkship performance remains limited and requires dedicated synthesis.”
Metadata
- Authors
- Sargeant, J., Mann, K., & Ferrier, S.
- Affiliations
- Dalhousie University (CA)
- Corresponding author
- Sargeant, Joan
- ORCID
- Sargeant, Joan
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2005-04-04
- Volume
- 39
- Issue
- 5
- Pages
- 497-504
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2158642891
- Cited by
- 174
- References
- 30
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 7 · 2022: 6 · 2021: 7 · 2020: 8 · 2019: 10 · 2018: 10 · 2017: 10 · 2016: 12 · 2015: 4 · 2014: 19 · 2013: 12 · 2012: 13
- FWCI
- 11.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Education (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- multisource feedback, 360-degree feedback, general practitioners, feedback credibility, perceived usefulness, performance evaluation (human resources), peer feedback, patient feedback, practice improvement
- MeSH terms
- Attitude of Health Personnel, Clinical Competence, Female, Humans, Male, Nova Scotia, Perception, Physicians, Family, Pilot Projects, Rural Health, Sensitivity and Specificity, Urban Health, Focus Groups, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review