Cited by 58Health Policy Implementation ScienceHealth Sciences Research and EducationInnovations in Medical Education

Facilitators, barriers and considerations for the implementation of healthcare innovation: A qualitative rapid systematic review

Open access
Parmar, Jasneet, Sacrey, Lori Ann, Anderson, Sharon, Charles, Lesley, Dobbs, Bonnie, McGhan, Gwen, Shapkin, Kimberley, Tian, Peter +1 more·2022·Health & Social Care in the Community

Abstract

Family caregiving scholars recommend that health providers receive competency-based education to partner with and support family caregivers to care and to maintain their own health. While it may be relatively easy to develop competency-based education for healthcare providers, ensuring widespread uptake and spread and scale of healthcare education is critical to ensuring consistent person-centered support for all family caregivers (FCGs) throughout the care trajectory. The development of novel healthcare innovations requires implementation strategies for uptake and spread, with implementation involving the use of strategies to integrate a novel innovation into healthcare. Research suggests that there are many factors involved in successful implementation and a synthesis of potential factors is warranted. The purpose of this review is to provide an in-depth examination of facilitators, barriers and considerations for implementation of a novel healthcare innovation that will be used to develop an implementation plan for spread and scale of our competency-based education for health providers to learn about person-centered care for FCGs. A systematic review of published and grey literature was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA [Moher et al., 2015]) guidelines. The systematic review involved searching four databases for original research articles that described barriers, facilitators and/or other considerations when implementing innovations. Twenty-eight articles were included in the qualitative thematic analyses and described three areas of implementation research: barriers, facilitators and recommendations. There were major and parallel themes that emerged under facilitators and barriers. There were a wide variety of strategies that were identified as recommendations. The findings were synthesised into five considerations for implementation: Research and information sharing, intentional implementation planning, organisational underpinnings, creating the clinical context and facilitative training. This review provides an integrative overview of identified facilitators, barriers and recommendations for implementation that may aid in developing implementation strategies that can be tailored to the local context or innovation being implemented.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/hsc.13578

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 64

  1. S Addis, S., Holland-Hart, D., Edwards, A., Neal, R. D., & Wood, F. (2019). Implementing Prudent Healthcare in the NHS in Wales; what are the barriers and enablers for clinicians? Journal of Evaluation in Clinical Practice, 25(1), 104-110. https://doi.org/10.1111/ jep.13023 · DOI
  2. Ahmed, S., Zidarov, D., Eilayyan, O., & Visca, R. (2020). Prospective ap- plication of implementation science theories and frameworks to in- form use of PROMs in routine clinical care within an integrated pain network. Quality of Life Research, https://doi.org/10.1007/s1113 6-020-02600 -8 · DOI
  3. Alessi, J., de Oliveira, G. B., Feiden, G., Schaan, B. D., & Telo, G. H. (2021). Caring for caregivers: The impact of the COVID-19 pandemic on those responsible for children and adolescents with type 1 diabe- tes. Scientific Reports, 11(1), 6812. https://doi.org/10.1038/s4159 8-021-85874 -3 · DOI
  4. Badovinac, L. M., Nicolaysen, L., & Harvath, T. A. (2019). Are we ready for the CARE Act?: Family caregiving education for health care providers. Journal of Gerontological Nursing, 45(3), 7-11. https://doi. org/10.3928/00989 134-20190 211-02 · DOI
  5. Barnett, J., Vasileiou, K., Djemil, F., Brooks, L., & Young, T. (2011). Understanding innovators' experiences of barriers and facilitators in implementation and diffusion of healthcare service innovations: A qualitative study. BMC Health Services Research, 11, 342. https:// doi.org/10.1186/1472-6963-11-342 · DOI
  6. Berwick, D. M. (2003). Disseminating innovations in health care. Journal of the American Medical Association, 289(15), 1969-1975. https:// doi.org/10.1001/jama.289.15.1969 · DOI · Paper page
  7. Birken, S. A., DiMartino, L. D., Kirk, M. A., Lee, S. Y. D., McClelland, M., & Albert, N. M. (2016). Elaborating on theory with middle man- agers' experience implementing healthcare innovations in prac- tice. Implementation Science, 11(2), https://doi.org/10.1186/s1301 2-015-0362-6 · DOI
  8. Boland, L., Graham, I. D., Légaré, F., Lewis, K., Jull, J., Shephard, A., Lawson, M. L., Davis, A., Yameogo, A., & Stacey, D. (2019). Barriers and facilitators of pediatric shared decision-making: A systematic review. Implementation Science, 14(1), 7. https://doi.org/10.1186/ s1301 2-018-0851-5 · DOI
  9. Bonder, R., Provvidenza, C. F., Hubley, D., & McPherson, A. C. (2020). Putting positive weight-related conversations into practice: The pilot implementation of a Knowledge Translation Casebook. Child: Care, Health and Development, 46(3), 360-368. https://doi. org/10.1111/cch.12762 · DOI
  10. Chaudoir, S. R., Dugan, A. G., & Barr, C. H. I. (2013). Measuring factors affecting implementation of health innovations: A systematic re- view of structural, organizational, provider, patient, and innova- tion level measures. Implementation Science, 8(1), 22. https://doi. org/10.1186/1748-5908-8-22 · DOI · Paper page
  11. Colquhoun, H. L., Levac, D., O'Brien, K. K., Straus, S., Tricco, A. C., Perrier, L., Kastner, M., & Moher, D. (2014). Scoping reviews: Time for clarity in definition, methods, and reporting. Journal of Clinical Epidemiology, 67(12), 1291-1294. https://doi.org/10.1016/j.jclin epi.2014.03.013 · DOI · Paper page
  12. Conway, A., Dowling, M., & Devane, D. (2019). Implementing an initia- tive promote evidence-informed practice: Part 2-healthcare pro- fessionals' perspectives of the evidence rounds programme. BMC Medical Education, 19(1), 75-92. https://doi.org/10.1186/s1290 9-019-1488-z · DOI
  13. Cook, C., & Rockwood, K. (2013). Knowledge translation: An over- view and recommendations in relation to the Fourth Canadian Consensus Conference on the Diagnosis and Treatment of Dementia. Alzheimer's Research and Therapy, 5(Suppl 1), S6. https:// doi.org/10.1186/alz194 · DOI
  14. Cowie, J., Nicoll, A., Dimova, E. D., Campbell, P., & Duncan, E. A. (2020). The barriers and facilitators influencing the sustainability of hospital-based interventions: A systematic review. BMC Health Services Research, 20(1), https://doi.org/10.1186/s1291 3-020- 05434 -9 · DOI
  15. Devries, J., Rafie, S., & Polston, G. (2017). Implementing an overdose education and naloxone distribution program in a health system. Journal of the American Pharmacists Association, 57(2S), S154-S160. https://doi.org/10.1016/j.japh.2017.01.002 · DOI
  16. Dopson, S., & Fitzgerald, L. (2006). The role of the middle man- ager in the implementation of evidence-based health care. Journal of Nursing Management, 14(1), 43-51. https://doi. org/10.1111/j.1365-2934.2005.00612.x · DOI
  17. Fitzgerald, L., & Dopson, S. (2007). Knowledge to action: Evidence-based health care in context. Oxford University Press.
  18. Hermes, E. D. A., Burrone, L., Heapy, A., Martino, S., Perez, E., Rosenheck, R., Rowe, M., Ruzek, J. I., & Greene, C. (2019). Beliefs and attitudes about the dissemination and implementation of internet-based self-care programs in a large integrated healthcare system. Administration and Policy in Mental Health and Mental Health Services Research, 46(3), 311-320. https://doi.org/10.1007/s1048 8-018-0913-7 · DOI
  19. Ho, M., Livingston, P., Bould, M. D., Nyandwi, J. D., Nizeyimana, F., Uwineza, J. B., & Urquart, R. (2019). Barriers and facilitators to implementing a regional anesthesia service in a low-income coun- try: A qualitative study. Pan African Medical Journal, 32, https://doi. org/10.11604/ pamj.2019.32.152.17246 · DOI
  20. Hunter, S. C., Kim, B., Mudge, A., Hall, L., Young, A., McRae, P., & Kitson, A. L. (2020). Experiences of using the i-PARIHS framework: A co- designed case study of four multi-site implementation projects. BMC Health Service Research, 20(1), 573. https://doi.org/10.1186/ s1291 3-020-05354 -8 · DOI
  21. Hunter, S. C., Young, J. A., Lawless, M. T., Kitson, A. L., & Feo, R. (2020). Introducing an interactional approach to exploring facilitation as an implementation intervention: Examining the utility of conversa- tion analysis. Implementation Science Communications, 1(1), 98-109. https://doi.org/10.1186/s4305 8-020-00071 -z · DOI
  22. Jack-Waugh, A., Ritchie, L., & MacRae, R. (2018). Assessing the educa- tional impact of the dementia champions programme in Scotland: Implications for evaluating professional dementia education. Nurse Education Today, 71, 205-210. https://doi.org/10.1016/j. nedt.2018.09.019 · DOI
  23. Katzman, J. G., Galloway, K., Olivas, C., McCoy-Stafford, K., Duhigg, D., Comerci, G., Kalishman, S., Buckenmaier, C. C., McGhee, L., Joltes, K., Bradford, A., Shelley, B., Hernandez, J., & Arora, S. (2016). Expanding health care access through education: Dissemination and implementation of the ECHO model. Military Medicine, 181(3), 227-235. https://doi.org/10.7205/milme d-d-15-00044 · DOI
  24. Keddem, S., Agha, A. Z., Long, J. A., Shasha, B., Hausmann, L. R. M., & Shea, J. A. (2020). The gears of knowledge translation: Process evaluation of the dissemination and implementation of a patient engagement toolkit. Journal of General Internal Medicine, 35(Suppl 2), 808-814. https://doi.org/10.1007/s1160 6-020-06099 -0 · DOI
  25. Kelly, K., Reinhard, S. C., & Brooks-Danso, A. (2008). Professional part- ners supporting family caregivers. American Journal of Nursing, 108(9 Suppl), 6-12. https://doi.org/10.1097/01.NAJ.00003 36400.76635.db · DOI
  26. Li, S. A., Jeffs, L., Barwick, M., & Stevens, B. (2018). Organizational con- textual features that influence the implementation of evidence- based practices across healthcare settings: A systematic integrative review. Systematic Reviews, 7(1), 72. https://doi.org/10.1186/s1364 3-018-0734-5 · DOI · Paper page
  27. Licskai, C., Sands, T., Ong, M., Paolatto, L., & Nicoletti, I. (2012). Using a knowledge translation framework to implement asthma clinical practice guidelines in primary care. International Journal of Quality in Health Care, 24(5), 538-546. https://doi.org/10.1093/intqh c/ mzs043 · DOI
  28. Lillo-Crespo, M., Riquelme, J., Macrae, R., De Abreu, W., Hanson, E., Holmerova, I., Cabañero, M. J., Ferrer, R., & Tolson, D. (2018). Experiences of advanced dementia care in seven European coun- tries: Implications for educating the workforce. Global Health Action, 11(1), https://doi.org/10.1080/16549 716.2018.1478686 · DOI
  29. Lipsitz, L. A. (2012). Understanding health care as a complex system: The foundation for unintended consequences. JAMA, 308(3), 243-244. https://doi.org/10.1001/jama.2012.7551 · DOI
  30. Locock, L., Dopson, S., Chambers, D., & Gabbay, J. (2001). Understanding the role of opinion leaders in improving clinical effectiveness. Social Science and Medicine, 53(6), 745-757. https://doi.org/10.1016/ S0277 -9536(00)00387 -7 · DOI
  31. Magnaye, A., Fast, J., Eales, J., Stolow, M., & Leslie, M. (2020). Caregivers' failure to thrive: A case for health and continuing care systems transformation. Healthcare Management Forum, 33(5), 214-219. https://doi.org/10.1177/08404 70420 921907 · DOI
  32. Medves, J., Godfrey, C., Turner, C., Paterson, M., Harrison, M., MacKenzie, L., & Durando, P. (2010). Systematic review of prac- tice guideline dissemination and implementation strategies for healthcare teams and team-based practice. International Journal of Evidence-Based Healthcare, 8(2), 79-89. https://doi. org/10.1111/j.1744-1609.2010.00166.x · DOI
  33. Melo, S., & Bishop, S. (2020). Translating healthcare research evidence into practice: The role of linked boundary objects. Social Science and Medicine, 246, 112731. https://doi.org/10.1016/j.socsc imed.2019.112731 · DOI
  34. Memel, D. S., Scott, J. P., McMillan, D. R., Easton, S. M., Donelson, S. M., Campbell, G., Sheehan, M., & Ewing, T. N. (2001). Development and implementation of an information management and information technology strategy for improving healthcare services: A case study. Journal of Healthcare Information Management : JHIM, 15(3), 261-285.
  35. Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med, 6(7), e1000097. https://doi. org/10.1371/journ al.pmed.1000097 · DOI · Paper page
  36. Morris, J. L., Bernhardsson, S., Bird, M.-L., Connell, L., Lynch, E., Jarvis, K., Kayes, N. M., Miller, K., Mudge, S., & Fisher, R. (2020). Implementation in rehabilitation: A roadmap for practitioners and researchers. Disability and Rehabilitation, 42(22), 3265-3274. https://doi.org/10.1080/09638 288.2019.1587013 · DOI
  37. Newhouse, R. P., & White, K. M. (2011). Guiding implementation: Frameworks and resources for evidence translation. The Journal of Nursing Administration, 41(12), 513-516. https://doi.org/10.1097/ NNA.0b013 e3182 378bb0 · DOI
  38. Parmar, J., Anderson, S., Duggleby, W., Holroyd-Leduc, J., Pollard, C., & Brémault-Phillips, S. (2020). Developing person-centred care com- petencies for the healthcare workforce to support family caregiv- ers: Caregiver centred care. Health and Social Care in the Community, 29(5), 1327-1338. https://doi.org/10.1111/hsc.13173 · DOI
  39. Pilapil, M., Coletti, D. J., Rabey, C., & DeLaet, D. (2017). Caring for the caregiver: Supporting families of youth with special health care needs. Current Problems in Pediatric and Adolescent Health Care, 47(8), 190-199. https://doi.org/10.1016/j.cppeds.2017.07.003 · DOI
  40. Pruchno, R., & Gitlin, L. N. (2012). Family caregiving in later life: Shifting paradigms. In R. Blieszner, & V. Hildevich Bedford (Eds.), The hand- book of families and aging (2nd ed., pp. 567-580). Praeger.
  41. Puga, F., Stevens, K. R., & Patel, D. I. (2013). Adopting best practices from team science in a healthcare improvement research network: The impact on dissemination and implementation. Nursing Research and Practice, 2013, 814360. https://doi.org/10.1155/2013/814360 · DOI
  42. Ray, J. M., Ratwani, R. M., Sinsky, C. A., Frankel, R. M., Friedberg, M. W., Powsner, S. M., Rosenthal, D. I., Wachter, R. M., & Melnick, E. R. (2019). Six habits of highly successful health information tech- nology: Powerful strategies for design and implementation. Journal of the American Medical Informatics Association, 26(10), 1109-1114. https://doi.org/10.1093/jamia/ ocz098 · DOI · Paper page
  43. Rogers, E. M. (2002). Diffusion of preventive innovations. Addictive Behaviors, 27(6), 989-993. https://doi.org/10.1016/S0306 -4603(02)00300 -3 · DOI
  44. Rogers, E. M. (2003). Diffusion of innovations, 5th ed. Free Press.
  45. Ross, J., Stevenson, F., Dack, C., Pal, K., May, C., Michie, S., Barnard, M., & Murray, E. (2018). Developing an implementation strategy for a digital health intervention: An example in routine healthcare. BMC Health Services Research, 18(1), 794. https://doi.org/10.1186/s1291 3-018-3615-7 · DOI
  46. Santiago de Araújo Pio, C., Gagliardi, A., Suskin, N., Ahmad, F., & Grace, S. L. (2020). Implementing recommendations for inpatient health- care provider encouragement of cardiac rehabilitation participation: Development and evaluation of an online course. BMC Health Services Research, 20(1), 768. https://doi.org/10.1186/s1291 3-020-05619 -2 · DOI
  47. Schulz, R., Beach, S. R., Czaja, S. J., Martire, L. M., & Monin, J. K. (2020). Family caregiving for older adults. Annual Review of Psychology, 71, 635-659. https://doi.org/10.1146/annur ev-psych -01041 9-050754 · DOI · Paper page
  48. Schulz, R., Beach, S. R., Friedman, E. M., Martsolf, G. R., Rodakowski, J., & Everette James, A. (2018). Changing structures and processes to support family caregivers of seriously ill patients. Journal of Palliative Medicine, 21(S2), S36-S42. https://doi.org/10.1089/jpm.2017.0437 · DOI
  49. Shrubsole, K. (2021). Implementation of an integrated multidisciplinary Movement Disorders Clinic: applying a knowledge translation framework to improve multidisciplinary care. Disability and Rehabilitation, 43(14), 2071-2083. https://doi.org/10.1080/09638 288.2019.1691666 · DOI
  50. Sinha, S., & Ageing, N. I. O. (2018). Why Canada needs to better care for its working caregivers: National Institute on Ageing white paper (pp. 88). https://www.ryers on.ca/conte nt/dam/nia/white -paper s/worki ng- careg ivers.pdf
  51. Spoon, D., Rietbergen, T., Huis, A., Heinen, M., van Dijk, M., van Bodegom-Vos, L., & Ista, E. (2020). Implementation strategies used to implement nursing guidelines in daily practice: A systematic re- view. International Journal of Nursing Studies, 111, 103748. https:// doi.org/10.1016/j.ijnur stu.2020.103748 · DOI
  52. Srivastava, S., Datta, V., Garde, R., Singh, M., Sooden, A., Pemde, H., Jain, M., Shivkumar, P., Bang, A., Kumari, P., Makhija, S., Ravi, T., Mehta, S., Garg, B. S., & Mehta, R. (2020). Development of a hub and spoke model for quality improvement in rural and urban healthcare settings in India: A pilot study. BMJ Open Quality, 9(3), e000908. https://doi.org/10.1136/bmjoq -2019-000908 · DOI
  53. Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., Hagedorn, H., Pineros, S., & Wallace, C. M. (2006). Role of 'external facilitation' in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1(1), 1-23. https:// doi.org/10.1186/1748-5908-1-23 · DOI
  54. Straus, S., Tetroe, J., & Graham, I. (2013). Knowledge translation in health care: Moving from evidence to practice. Wiley Blackwell.
  55. Studts, C. R., Merritt, A. S., Pilar, M. R., Bundy, H., Bardach, S. H., Jacobs, J. A., & Feltner, F. J. (2020). Parent and provider preferences for par- enting intervention delivery in rural Appalachia: A qualitative analysis guiding adaptation. Journal of Health Care for the Poor and Underserved, 31(3), 1399-1426. https://doi.org/10.1353/hpu.2020.0102 · DOI
  56. Svensson, B., Hansson, L., Markström, U., & Lexén, A. (2017). What mat- ters when implementing Flexible Assertive Community Treatment in a Swedish healthcare context: A two-year implementation study. International Journal of Mental Health, 46(4), 284-298. https://doi. org/10.1080/00207 411.2017.1345041 · DOI
  57. Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014). Systematic review of the application of the plan-do-study- act method to improve quality in healthcare. BMJ Quality and Safety, 23(4), 290-298. https://doi.org/10.1136/bmjqs -2013-001862 · DOI · Paper page
  58. Teixeira, M., Cook, D. A., Heale, B., & Del Fiol, G. (2017). Optimization of infobut- ton design and Implementation: A systematic review. Journal of Biomedical Informatics, 74, 10-19. https://doi.org/10.1016/j.jbi.2017.08.010 · DOI
  59. Vogel, J. P., Moore, J. E., Timmings, C., Khan, S., Khan, D. N., Defar, A., Hadush, A., Minwyelet Terefe, M., Teshome, L., Ba-Thike, K., Than, K. K., Makuwani, A., Mbaruku, G., Mrisho, M., Mugerwa, K. Y., Puchalski Ritchie, L. M., Rashid, S., Straus, S. E., & Gülmezoglu, A. M. (2016). Barriers, facilitators and priorities for implementation of WHO Maternal and perinatal health guidelines in four lower- income countries: A great network research activity. PLoS One, 11(11), https://doi.org/10.1371/journ al.pone.0160020 · DOI
  60. Walston, S. L., & Chou, A. F. (2006). Healthcare restructuring and hier- archical alignment: Why do staff and managers perceive change outcomes differently? Medical Care, 44(9), 879-889. https://doi. org/10.1097/01.mlr.00002 20692.39762. · DOI
  61. bf · DOI
  62. Wiecha, J. L., El Ayadi, A. M., Fuemmeler, B. F., Carter, J. E., Handler, S., Johnson, S., Strunk, N., Korzec-Ramirez, D., & Gortmaker, S. L. (2004). Diffusion of an integrated health education program in an urban school system: Planet health. Journal of Pediatric Psychology, 29(6), 467-474. https://doi.org/10.1093/jpeps y/jsh050 · DOI
  63. Williams, L. B., Shelton, B. J., Gomez, M. L., Al-Mrayat, Y. D., & Studts, J. L. (2021). Using Implementation science to disseminate a lung can- cer screening education intervention through community health workers. Journal of Community Health, 46, 165-173. https://doi. org/10.1007/s1090 0-020-00864 -2 · DOI
  64. Wolfe, D. L., Walia, S., Burns, A. S., Flett, H., Guy, S., Knox, J., Koning, C., Laramée, M.-T., O'Connell, C., Scovil, C. Y., & Wallace, M.; SCI KMN Group. (2019). Development of an implementation-focused network to improve healthcare delivery as informed by the experiences of the SCI knowledge mobilization network. The Journal of Spinal Cord Medicine, 42(sup1), 34-42. https://doi.org/10.1080/10790 268.2019.1649343 · DOI

Cited by

Sorted by citations

Authors
Parmar, J., Sacrey, L. A., Anderson, S., Charles, L., Dobbs, B., McGhan, G., Shapkin, K., Tian, P., & Triscott, J.
Affiliations
  • Alberta Health Services (CA)
  • University of Alberta (CA)
  • University of Calgary (CA)
  • Faculty of Nursing University of Calgary Alberta Canada
Corresponding author
Anderson, Sharon
Venue
Health & Social Care in the Community
Publisher
Wiley
Published
2021-09-23
Volume
30
Issue
3
Pages
856-868
ISSN
  • 0966-0410 (ISSN-L)
  • 1365-2524
OpenAlex
W3199808747
Cited by
58
References
11
Citations by year
2026: 14 · 2025: 20 · 2024: 12 · 2023: 8 · 2022: 4
FWCI
1.24
Type
journal article
Language
en
Open access
Locations
  • Health & Social Care in the Community (publishedVersion)
  • PubMed (publishedVersion)
Funders
University of Alberta
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
Keywords
implementation barriers, implementation facilitators, competency-based education, family caregivers, person-centred care, implementation planning, organizational context, clinical context
MeSH terms
Delivery of Health Care, Health Facilities, Health Personnel, Humans

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review