Cited by 24Evaluation and Performance AssessmentPublic Health Policies and EducationHealth Policy Implementation Science

Health Intervention Evaluation Using Semantic Explainability and Causal Reasoning

Open access
Brenas, Jon Hael, Shaban-Nejad, Arash·2020·IEEE Access

Abstract

As serious public health problems require complex responses, health interventions often involve multiple components implemented by groups including policy experts, social workers, and health practitioners. The success or failure of an intervention depends on many different factors, ranging from available resources to characteristics of the targeted public health issue and community to the complex mechanics relating cause and effects of the actions performed. In this paper, we present a novel formal methodology to evaluate public health interventions, policies, and programs. Our method uses the theory of change (TOC) approach along with logic models that define the intervention under consideration to generate a causal diagram and an ontology-based inference model for causal description. The resulting causal diagram will then be compared to existing knowledge and data to determine whether the intervention is coherent, internally consistent and its goals are achievable in the allotted time with the resources provided. The contextual knowledge and semantics provided by the ontology will generate a more explainable, understandable, and trustworthy approach to compare and assess different interventions based on their shared goals. Depending upon the quality and quantity of data available we perform a mix of qualitative and quantitative evaluation of the interventions. This study uses smoking cessation interventions to showcase the proposed methodology in action.

Integrity signals

Registry

Crossref · 10.1109/access.2020.2964802

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Pairing implementation outcomes with theory-informed, causally grounded evaluation approaches can help assess not only acceptability, but whether proposed mechanisms (eg, improved coordination leading to fewer delays) are supported by observed data rather than usability proxies alone.

    “Pairing implementation outcomes with theory-informed, causally grounded evaluation approaches can help assess not only acceptability, but whether proposed mechanisms (eg, improved coordination leading to fewer delays) are supported by observed data rather than usability proxies alone [58].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Brenas, J. H., & Shaban-Nejad, A.
Venue
IEEE Access
Published
2020
Volume
8
Pages
9942-9952
ISSN
2169-3536 (ISSN-L)
OpenAlex
W3000079853
Cited by
24
References
3
Citations by year
2026: 4 · 2025: 1 · 2024: 6 · 2023: 1 · 2022: 6 · 2021: 5 · 2020: 1
FWCI
2.07
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Health Science Center, University of Tennessee
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
  • Health Sciences › Health Professions › General Health Professions › Public Health Policies and Education
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords
health intervention evaluation, public health interventions, theory of change, logic model, causal graphs, ontology reasoning, causal reasoning, intervention coherence, smoking cessation interventions, public health policy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review