The DOI matches its Crossref record; 19 of the 20 references it cites were found in a registry or an index; 9 of the 34 sources its claims cite were checked for support.
National Health Policy Leadership Program for General Internists
Open accessAbstract
Introduction Early or mid-career physicians have few opportunities to participate in career development programs in health policy and advocacy with experiential and mentored training that can be incorporated into their busy lives. Aim The Society of General Internal Medicine (SGIM) created the Leadership in Health Policy (LEAHP) program, a year-long career development program, to prepare participants with a sufficient depth of knowledge, skills, attitudes, and behaviors to continue to build mastery and effectiveness as leaders, advocates, and educators in health policy. We sought to evaluate the program's impact on participants' self-efficacy in the core skills targeted in the curriculum. Setting/participants Fifty-five junior faculty and trainees across three scholar cohorts from 2017 to 2021. Program description Activities included workshops and exercises at an annual meeting, one-on-one mentorship, monthly webinars and journal clubs, interaction with policy makers, and completion of capstone projects. Program evaluation Self-administered, electronic surveys conducted before and following the year-long program showed a significant improvement in mean self-efficacy scores for the total score and for each of the six domains in general knowledge, teaching, research, and advocacy in health policy. Compared to the baseline scores, after the program the total mean score increased from 3.1 to 4.1, an increase of 1.1 points on a 5-point Likert scale (95% CI: 0.9-1.3; Cohen's D: 1.7), with 61.4% of respondents increasing their mean score by at least 1 point. Responses to open-ended questions indicated that the program met scholars' stated needs to improve their knowledge base in health policy and advocacy skills. Discussion The LEAHP program provides an opportunity for mentored, experiential training in health policy and advocacy, can build the knowledge and amplify the scale of physicians engaged in health policy, and help move physicians from individual patient advocacy in the clinic to that of populations.
Overview
CoChat Summary
TL;DR
The Society of General Internal Medicine’s year-long Leadership in Health Policy (LEAHP) program provided mentored, experiential health policy and advocacy training to 55 junior faculty and trainees across three cohorts. Evaluation showed significant improvements in participants’ self-efficacy across all six domains, with total mean score rising from 3.1 to 4.1 on a 5-point scale.
Key findings
- Among 44 participants completing both pre- and post-program surveys, total mean self-efficacy increased from 3.1 to 4.1 (mean change 1.1; 95% CI 0.9–1.3; p<0.001; Cohen’s D 1.7), and 61.4% increased their mean score by at least 1 point.
- All six domains improved significantly: research policy improved most (2.3 to 3.8; mean change 1.4; 95% CI 1.2–1.7; Cohen’s D 1.6), while teaching health policy improved least (3.5 to 4.4; mean change 0.9; 95% CI 0.7–1.1; Cohen’s D 1.0); domain Cronbach’s alphas ranged from 0.73 to 0.92.
- Open-ended responses showed pre-program needs were advocacy skills (63/157, 40%), health policy knowledge (45/157, 29%), teaching (32/157, 20%), and publications/writing (13/157, 8%); post-program enduring value included health policy process (31/130, 24%), payment/reimbursement (29/130, 22%), and networking (15/130, 12%).
- Most meaningful elements were mentorship (22/78, 28%) and collaboration with colleagues (22/78, 28%), followed by didactics/instructional strategies (19/78, 24%) and advocacy in action (12/78, 15%); improvement suggestions included more connectivity/meet-ups (11/30, 37%) and collaborative projects (5/30, 17%).
Methods
- Design: evaluation of LEAHP, a year-long career development program with annual meeting workshops, one-on-one mentorship, monthly webinars and journal clubs, policy-maker interaction, subcommittee work, and capstone projects; three cohorts ran in 2017–2018, 2018–2019, and 2020–2021 (2019–2020 skipped).
- Sample: 55 junior faculty and trainees enrolled; 54 completed the pre-program survey, 52 completed the program, and 44 completed both pre- and post-program surveys; scholars resided in 21 states and the District of Columbia, 65.5% were female, 14.5% were URiM, and 85.5% were faculty.
- Analysis: self-administered electronic pre/post surveys with 38 self-efficacy items in six domains rated on a 5-point Likert scale; paired samples t tests, Cohen’s D, and percentage improving ≥1 point were calculated, and open-ended responses were coded iteratively with thematic frequency counts.
Limitations
- Stated: short-term follow-up only; no objective knowledge measurement using exam scores; no unexposed control group; participants were a self-selected group of academic general internal medicine physicians and trainees, so application to other physician groups is uncertain.
- Evident from the text: small paired sample (44), reliance on self-report/self-efficacy rather than observed behavior or career outcomes, and possible selection or social desirability bias; these are not framed as limitations by the authors beyond the stated points.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 2 Not valid · 6 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Fellowship programs with experiential work often require physical relocation. 16 -18”
What the sources say
- Not matchedcites [16] Robert Wood Johnson Foundation Health Policy Fellows. https://www.healthpolicyfellows.org/. Accessed October 4, 2021.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [17] American College of Physicians. ACP Health Policy Internship Program. https://www.acponline.org/advocacy/advocacy-in-action/acp-health-policy-internship-program. Accessed October 4, 2021.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [18] Heiman HJ, Smith LL, Respress E, Bayer CR. Health policy training for health equity leaders. Ethnicity & disease. 2019;29(Suppl 2):405. sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes a fellowship with policy-leadership shadowing, experiential learning, and two eight-week practica. It does not say fellows had to relocate or establish that relocation is often required by such programs. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, these curricula are largely focused on basic health policy knowledge and advocacy skills.”
What the sources say
- Not checked — no full text of the sourcecites [1] Mou D, Sarma A, Sethi R, Merryman R. The state of health policy education in US medical schools. N Engl J Med. 2011;364(10):e19. source
- Partly supportedcites [8] Heiman HJ, Smith LL, McKool M, Mitchell DN, Roth Bayer C. Health policy training: a review of the literature. International journal of environmental research and public health. 2016;13(1):20. sourceExperimental — accuracy not yet measured
The Results (§3.4.2; page not provided) identify policy-process fundamentals, financing, organization, and quality as common curricular content, supporting the health-policy-knowledge portion. They list policy communication and advocacy in only three articles, while §3.4.1 says only some programs emphasized policy-related skill-building. The review therefore does not establish that the curricula were largely focused on advocacy skills. (LLM, conf=0.84)
- Partly supportedcites [9] Howell BA, Kristal RB, Whitmire LR, Gentry M, Rabin TL, Rosenbaum J. A systematic review of advocacy curricula in graduate medical education. Journal of general internal medicine. 2019;34(11):2592-2601. sourceExperimental — accuracy not yet measured
The Methods section says the reviewed curricula aimed to improve trainees’ advocacy knowledge and skills. But Educational Content says most included community partnerships and projects, while others focused exclusively on health policy or legislative advocacy. It does not support describing the curricula as largely focused on basic health policy knowledge. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [10] McDonald M, Lavelle C, Wen M, Sherbino J, Hulme J. The state of health advocacy training in postgraduate medical education: a scoping review. Medical education. 2019;53(12):1209-1220. source
- Not checked — no full text of the sourcecites [11] Scott MD, McQueen S, Richardson L. Teaching health advocacy: a systematic review of educational interventions for postgraduate medical trainees. Academic Medicine. 2020;95(4):644-656. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“With the exception of a few programs, 12 -15 they do not include experiential or mentored training which is vital for promoting ongoing engagement and leadership in policy and advocacy.”
What the sources say
- Not checked — no full text of the sourcecites [12] Andrews J, Jones C, Tetrault J, Coontz K. Advocacy training for residents: insights from Tulane’s internal medicine residency program. Academic Medicine. 2019;94(2):204-207. source
- Not checked — no full text of the sourcecites [13] Basu G, Pels RJ, Stark RL, Jain P, Bor DH, McCormick D. Training internal medicine residents in social medicine and research-based health advocacy: a novel, in-depth curriculum. Academic Medicine. 2017;92(4):515-520. source
- Supportedcites [14] Greysen SR, Wassermann T, Payne P, Mullan F. Teaching health policy to residents—three-year experience with a multi-specialty curriculum. Journal of general internal medicine. 2009;24(12):1322-1326. source
The Program Description (page not provided) describes site visits with policy analysts and policymakers and explicitly calls them experiential activities. This supports citing the paper as an example of a program that includes experiential training; it does not need to establish how common such programs are. (LLM, conf=0.90)
- Not checked — no full text of the sourcecites [15] Strelnick AH, Swiderski D, Fornari A, et al. The residency program in social medicine of Montefiore Medical Center: 37 years of mission-driven, interdisciplinary training in primary care, population health, and social medicine. Academic Medicine. 2008;83(4):378-389. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Before the program, the overall score was 3.1, approximately neutral on the 5-point scale.”
plainn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For each of the six domains, there was a significant and meaningful improvement in mean self-efficacy scores of about 1 point.”
plainn = 4 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 73 claims and every source verdict.
- Probably not a substantial claim. 29
- It may state two separate claims as one. 20
- The quote only partly states this claim. 10
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Program Evaluation · p. 4
“Scholars were asked to rate the degree to which they agreed with each statement on a 5-point Likert scale from 1 = strongly disagreed through 5 = strongly agreed with 3=neutral.”
§ Self-efficacy in Health Policy · p. 4
“(1 = Strongly disagree; 2 = Disagree; 3 = Neutral; 4 = Agree; and 5 = Strongly disagree)”
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 1×
“We conducted scale reliability analysis on the pre-program survey data to calculate the Cronbach alpha coefficient for the set of self-efficacy items within each of the six domains, and to determine each scale’s alpha coefficient after each item comprising the scale was removed, one at a time, to assess the reliabilit…”
MethodInternational Journal of Environmental Research and Public Health
(2013) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph · Cited by 7,753
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199 · cited 1×
“We calculated Cohen’sD for the change in each mean score to estimate the effect size.(26) We also determined the percentage of respondents who improved ≥ 1 point on the 5-point scale from the pre- to post-program surveys, reflecting a change in response categories (e.”
MethodMedical Professionalism in the New Millennium: A Physician Charter
Project of the ABIM Foundation, A. F. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-3-200202050-00012 · Cited by 1,624
Perspective: Physician Advocacy: What Is It and How Do We Do It?
Earnest, M. A., Wong, S. L., & Federico, S. G. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181c40d40 · Cited by 301
Milestones 2.0: A Step Forward
Edgar, L., Roberts, S., & Holmboe, E. (2018) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-18-00372.1 · Cited by 241 · cited 1×
“The Accreditation Council for Graduate Medical Education has recently introduced health policy and advocacy requirements across all specialties.(6,7)”
BackgroundMedical Professionalism in the New Millennium : A Physician Charter
Koizumi, S. (2005) · General Medicine · doi:10.14442/general2000.6.33 · Cited by 178
Viewing Clinical Research Career Development Through the Lens of Social Cognitive Career Theory
Bakken, L. L., Byars-Winston, A., & Wang, M.-F. (2006) · Advances in Health Sciences Education · doi:10.1007/s10459-005-3138-y · Cited by 127 · cited 1×
“We did not objectively measure knowledge using exam scores, although self-efficacy is predictive of career choice, persistence, and achievement.(29) Another limitation is Table 4 Themes Identified in Open-Ended Questions with Representative Quotations”
BackgroundA Systematic Review of Advocacy Curricula in Graduate Medical Education
Howell, B. A., Kristal, R. B., Whitmire, L. R., Gentry, M., Rabin, T. L., & Rosenbaum, J. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05184-3 · Cited by 88
Advancing Medical Education by Teaching Health Policy
Patel, M. S., Davis, M. M., & Lypson, M. L. (2011) · New England Journal of Medicine · doi:10.1056/nejmp1009202 · Cited by 81 · cited 1×
“However, most have not had sufficient training and experience in health policy and advocacy to be optimally effective in this vital role.(1,2) The American Board of Internal Medicine, American College of Physicians, and American Medical Association, among other organizations, have called for a commitment to advocacy f…”
Background
Research works printed but not linked: 4
- American Medical Association. AMA Declaration of Professional Responsibility. https://www.ama-assn.org/delivering-care/public-health/ama-declaration-professional-responsibility. Accessed October 4, 2021.
- Schwartz M, Staiger T. New SGIM career development initiative: Leadership in Health Policy (LEAHP) program. SGIM Forum. 2016;39(10):1, 10.
- Schwartz M, Staiger T. Leadership in Health Policy (LEAHP) program initiated at the 2017 annual meeting. SGIM Forum. 2017;40(8):8, 13.
- Chen A, Cowart J, Riddle-Jones L, Candler S. 2020: the next LEAHP (Leadership in Health Policy) year. SGIM Forum. 2019;42(11):10, 15.
Cited by
A Model of Advocacy to Inform Action
Earnest, M. A., Wong, S. L., Federico, S. G., & Cervantes, L. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07866-x · Cited by 32
Davis, C. M., Akin, C., Bahna, S. L., Blatman, K. S. H., Carr, T. F., Chang, C., Chong, H., Ciaccio, C. E., Davis, B. P., Fadugba, O., et al. (2025) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2025.05.013 · Cited by 3
Tseng, Z., Beltran, C. P., Eldam, A., & Ramani, S. (2025) · Teaching and Learning in Medicine · doi:10.1080/10401334.2025.2540847 · Cited by 2
“17,32 While it has been incorporated in a few advocacy training programs for trainees, mentorship is limited for faculty.”
Burnett, J. R., Lima, B. D., Manley, K., Wang, E. S., McGarry, K., Henry, T. L., Kisielewski, M., Kim, D. I., & Desai, S. S. (2025) · Journal of Health Advocacy · doi:10.70440/001c.142995 · Cited by 1
Ruiz-Chaves, W., & Sánchez, F. Z. (2024) · Revista Digital de Investigación en Docencia Universitaria · doi:10.19083/ridu.2024.1801 · Cited by 3
Metadata
- Authors
- Kyanko, K. A., Fisher, M. A., Riddle-Jones, L., Chen, A., Jetton, F., Staiger, T., & Schwartz, M. D.
- Affiliations
- NYU Langone Health (US)
- Allegheny Health Network (US)
- University of Washington (US)
- Society of General Internal Medicine (US)
- Corresponding author
- Kyanko, Kelly A.
- Venue
- Journal of General Internal Medicine
- Published
- 2022-02-23
- Volume
- 37
- Issue
- 16
- Pages
- 4137-4143
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- PMC
- PMC8865497
- OpenAlex
- W4212940202
- Cited by
- 6
- References
- 20
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2022: 1
- FWCI
- 1.10
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Journal of General Internal Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- NYU Grossman School of Medicine
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- health policy leadership, health policy advocacy, physician career development, self-efficacy, mentoring, experiential training, general internists, early-career physicians, Society of General Internal Medicine, health policy education
- MeSH terms
- Curriculum, Faculty, Medical, Health Policy, Humans, Leadership, Physicians, Program Evaluation, Program Development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: National Health Policy Leadership Program for General Internists. https://app.cochat.ai/papers/10.1007/s11606-022-07455-y
- The paper
- Kyanko, K. A., Fisher, M. A., Riddle-Jones, L., Chen, A., Jetton, F., Staiger, T., & Schwartz, M. D. (2022). National Health Policy Leadership Program for General Internists. Journal of General Internal Medicine. https://doi.org/10.1007/s11606-022-07455-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.