The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index; 6 of the 12 sources its claims cite were checked for support.
The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI
Open accessAbstract
Introduction: The COVID-19 pandemic highlighted significant failures in United States public health communications, which were often perceived as unclear and biased, particularly among racialized and marginalized groups. As generative artificial intelligence (genAI) becomes integrated into public health practice, there is an urgent need to train the workforce to recognize and mitigate the societal biases these tools can reproduce. This study describes the development and classroom testing of a tool designed to teach these critical evaluation skills. Methods: We developed the “Health Communications Assessment Checklist,” a 14-question pedagogical tool based on the CommunicateHealth Framework for Equity-Centered Health Communication and the CDC’s Guiding Principles for health equity. The checklist was tested during the 2024–2025 academic year in two graduate-level courses ( n = 55 students) at a large public university. The single-lesson exercise required students to use ChatGPT-4o to generate health communication content and then apply the checklist to critique the output for clarity, relatability, actionability, and inclusivity. Results: Post-exercise surveys and classroom discussions indicated positive student engagement and self-reported skill-building in critical assessment. A key finding was that students leaned heavily on their diverse individual identities and lived experiences to identify subtle biases that the AI generated. Furthermore, the checklist acted as a self-assessment tool, helping students identify gaps in their own knowledge of communication implementation. Feedback led to iterative improvements of the tool. Conclusion: The Health Communications Assessment Checklist is a simple, modifiable, and promising pedagogical tool for public health education. By centering equity and reflexivity, it helps prepare the future workforce to critically manage AI-generated content, ensuring health communications are inclusive and effective in promoting health equity.
Overview
CoChat Summary
TL;DR
The paper describes the development and classroom testing of the Health Communications Assessment Checklist, a 14-question pedagogical tool for teaching students to critique AI-generated health communications for bias. Tested in two graduate public health courses, it was associated with positive engagement, self-reported skill-building, and iterative refinement of the checklist.
Key findings
- The checklist was developed as a 14-question tool based on CommunicateHealth’s Framework for Equity-Centered Health Communication and the CDC’s Guiding Principles, focused on communications that are clear, relatable, actionable, and inclusive.
- In testing during the 2024–2025 academic year across two graduate courses (n = 55 students; 49 eligible survey responses), students leaned heavily on their diverse identities and lived experiences to identify subtle biases in AI-generated content.
- Student feedback indicated the checklist also acted as a self-assessment tool, helping them identify gaps in their own knowledge of communication implementation; suggestions focused more on how to implement recommended actions than on whether bias was present.
- Students suggested adding an explicit accuracy and fact-checking prompt, and some expressed concern about others using generative AI without critical assessment skills.
Methods
- The checklist was developed in the 2024–25 academic year from a review of existing tools, primarily CommunicateHealth’s equity-centered framework and CDC’s equity-centered communication principles.
- It was tested in two graduate public health courses: Social and Behavioral Sciences in Health, with two in-person sections (n = 40), and Culminating Seminar, with one online section (n = 15), totaling n = 55 students.
- The single-lesson exercise had students use ChatGPT-4o to generate health communication content, then apply the checklist to critique output for clarity, relatability, actionability, and inclusivity; post-exercise online questionnaire responses were analyzed using Braun and Clarke’s thematic analysis framework in Dedoose, with two coders independently reviewing responses and resolving discrepancies through consensus.
Limitations
- The paper states a relatively small sample size in a single institution, addressed by assessing students on the same activity in different classroom settings and courses.
- The paper states use of a single AI model—ChatGPT, specifically the free version—was intentional to compare output and student interaction with one model, not to analyze bias across different AI models.
- The paper states the analysis relies on self-reported student questionnaire responses and classroom discussions rather than objective assessment of skill improvement; it also notes future evaluation could include pre- and post-surveys and longer-term follow-up.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 3 Not checked · 36 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unchecked bias in health communications can also contribute to widening health disparities (10, 15, 16).”
§ The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI > Introduction
What the sources say
- Partly supportedcites [10] Cooks, 2022, What did the pandemic teach us about effective health communication? Unpacking the COVID-19 infodemic, BMC Public Health sourceExperimental — accuracy not yet measured
The Information-seeking section says racial and ethnic discrimination can be amplified through media, making health information-seeking difficult for some groups. It also describes unequal access to and benefits from communication technologies. These passages support a concern about inequitable health communication, but do not say that unchecked bias widens health disparities. (LLM, conf=0.82)
- Partly supportedcites [15] Kim, 2024, Development and preliminary testing of health equity across the AI lifecycle (HEAAL): a framework for healthcare delivery organizations to mitigate the risk of AI solutions worsening health inequities, PLoS Digital Health sourceExperimental — accuracy not yet measured
The Results section (‘Decoupling algorithmic fairness from health equity’; page unavailable) says an AI solution that performs poorly for a disadvantaged subgroup can widen a health inequity. The paper also calls for communication about AI-related harms in ‘Five domains of assessment,’ but it does not say that bias in health communications causes disparities; its claim concerns AI solutions. (LLM, conf=0.82)
- Partly supportedcites [16] Kisa, 2024, A comprehensive analysis of COVID-19 misinformation, public health impacts, and communication strategies: scoping review, J Med Internet Res sourceExperimental — accuracy not yet measured
The Results (Misinformation Themes and Sources; Impacts of Misinformation on Public Health Outcomes, pages unavailable) report that some vulnerable groups were particularly affected by misinformation and that misinformation disrupted health communication. The Discussion (Principal Findings, page unavailable) identifies cognitive biases as a factor in its spread. These passages do not establish that unchecked bias in health communications widens health disparities. (LLM, conf=0.78)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We developed the “Health Communications Assessment Checklist,” a 14-question pedagogical tool based on the CommunicateHealth Framework for Equity-Centered Health Communication and the CDC’s Guiding Principles for health equity.”
§ The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI > Abstract > Methods
What the sources say
- Not matchedcites [17] 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [18] Calanan, 2023, CDC’S guiding principles to promote an equity-centered approach to public health communication, Prev Chronic Dis source
The Abstract and “Development and Dissemination of a Communication Resource” describe CDC’s Health Equity Guiding Principles for Inclusive Communication, the resource the citing authors identify as one basis for their checklist. The checklist’s development is stated as the citing authors’ own work, not attributed to this source. Page numbers were not supplied for these passages. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students recognized the value of their own diverse identities through the exercise.”
§ The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI > Results and discussion > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“because student responses revealed that identifying bias is easier than knowing how to implement inclusive revisions (e.g., transitioning to neutral, person-first terminology or representing varied family structures)”
§ The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI > Results and discussion > Discussion and recommendations
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the checklist acted as a self-assessment tool, helping students identify gaps in their own knowledge of communication implementation.”
- Also stated in: § Results · plain
“A second finding was how the use of an explicit checklist prompted students to assess their own skills and identify gaps in their knowledge of communications principles.”
§ The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI > Abstract > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Results · plain
6 more claims
Create a free account to see all 42 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 23
- It may state two separate claims as one. 21
Citations
Cites
Braun, V., & Clarke, V. (2022) · Encyclopedia of Quality of Life and Well-Being Research · doi:10.1007/978-3-319-69909-7_3470-2 · Cited by 5,890
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Role of Mass Media and Public Health Communications in the COVID-19 Pandemic
Anwar, A., Malik, M., Raees, V., & Anwar, A. (2020) · Cureus · doi:10.7759/cureus.10453 · Cited by 431 · cited 1×
“As we seek to restore faith and trust in public health, it is critical to proactively recognize and remove bias in health communications (9, 10).”
Eruchalu, C. N., Pichardo, M. S., Bharadwaj, M., Rodriguez, C. B., Rodriguez, J. A., Bergmark, R. W., Bates, D. W., & Ortega, G. (2021) · Journal of Urban Health · doi:10.1007/s11524-020-00508-9 · Cited by 245 · cited 1×
“Racialized and marginalized groups bore the greatest burden of COVID-19, replicating and some-times widening the health disparities that were already evident pre-pandemic (7, 8).”
Dankwa-Mullan, I. (2024) · Preventing Chronic Disease · doi:10.5888/pcd21.240245 · Cited by 197 · cited 1×
“For the current generation of public health graduate students, it is now important to obtain skills in critically evaluating health communications - including genAI output - for bias as well as accuracy (13).”
Public Health Messaging during the COVID-19 Pandemic and Beyond: Lessons from Communication Science
Nan, X., Iles, I. A., Yang, B., & Ma, Z. (2022) · Health Communication · doi:10.1080/10410236.2021.1994910 · Cited by 182
Karinshak, E., Liu, S. X., Park, J. S., & Hancock, J. T. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579592 · Cited by 167
Kisa, S., & Kisa, A. (2024) · Journal of Medical Internet Research · doi:10.2196/56931 · Cited by 132
Lim, S., & Schmälzle, R. (2023) · Frontiers in Communication · doi:10.3389/fcomm.2023.1129082 · Cited by 105
Kim, J. Y., Hasan, A., Kellogg, K. C., Ratliff, W., Murray, S. G., Suresh, H., Valladares, A., Shaw, K., Tobey, D., Vidal, D. E., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000390 · Cited by 61 · cited 1×
“Unchecked bias in health communications can also contribute to widening health disparities (10, 15, 16).”
Research works printed but not linked: 1
- 2025, 5 Years Later: America Looks Back at the Impact of COVID-19
Metadata
- Authors
- Ofrane, R. H., Canada, T., & Birnbaum, A. S.
- Affiliations
- Montclair State University (US)
- Corresponding author
- Ofrane, Rebecca H.
- Venue
- Frontiers in Public Health
- Publisher
- Frontiers Media SA
- Published
- 2026-08-27
- Volume
- 14
- Pages
- 1872506-1872506
- ISSN
- 2296-2565 (ISSN-L)
- PMC
- PMC13558193
- OpenAlex
- W7204463223
- Cited by
- 0
- References
- 15
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Health Sciences › Health Professions › General Health Professions › Health and Medical Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- generative AI, algorithmic bias, public health education, critical evaluation skills, GPT-4o, inclusivity, health equity, reflexivity, marginalized communities, employee training
- MeSH terms
- COVID-19, SARS-CoV-2, Generative Artificial Intelligence, Humans, Public Health, United States, Checklist, Health Communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI. https://app.cochat.ai/papers/10.3389/fpubh.2026.1872506
- The paper
- Ofrane, R. H., Canada, T., & Birnbaum, A. S. (2026). The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI. Frontiers in Public Health. https://doi.org/10.3389/fpubh.2026.1872506
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.