A Systems Approach to Evaluate One Health Initiatives
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
Challenges calling for integrated approaches to health, such as the One Health (OH) approach, typically arise from the intertwined spheres of humans, animals, and ecosystems constituting their environment. Initiatives addressing such wicked problems commonly consist of complex structures and dynamics. As a result of the EU COST Action (TD 1404) "Network for Evaluation of One Health" (NEOH), we propose an evaluation framework anchored in systems theory to address the intrinsic complexity of OH initiatives and regard them as subsystems of the context within which they operate. Typically, they intend to influence a system with a view to improve human, animal, and environmental health. The NEOH evaluation framework consists of four overarching elements, namely: (1) the definition of the initiative and its context, (2) the description of the theory of change with an assessment of expected and unexpected outcomes, (3) the process evaluation of operational and supporting infrastructures (the "OH-ness"), and (4) an assessment of the association(s) between the process evaluation and the outcomes produced. It relies on a mixed methods approach by combining a descriptive and qualitative assessment with a semi-quantitative scoring for the evaluation of the degree and structural balance of "OH-ness" (summarised in an OH-index and OH-ratio, respectively) and conventional metrics for different outcomes in a multi-criteria-decision-analysis. Here, we focus on the methodology for Elements (1) and (3) including ready-to-use Microsoft Excel spreadsheets for the assessment of the "OH-ness". We also provide an overview of Element (2), and refer to the NEOH handbook for further details, also regarding Element (4) (http://neoh.onehealthglobal.net). The presented approach helps researchers, practitioners, and evaluators to conceptualise and conduct evaluations of integrated approaches to health and facilitates comparison and learning across different OH activities thereby facilitating decisions on resource allocation. The application of the framework has been described in eight case studies in the same Frontiers research topic and provides first data on OH-index and OH-ratio, which is an important step towards their validation and the creation of a dataset for future benchmarking, and to demonstrate under which circumstances OH initiatives provide added value compared to disciplinary or conventional health initiatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1×
“Identifying and developing a theoretical understanding of the likely process of change is critical when evaluating complex initiatives (32).”
BackgroundA General Framework for Analyzing Sustainability of Social-Ecological Systems
Ostrom, E. (2009) · Science · doi:10.1126/science.1172133 · Cited by 8,656
Global trends in emerging infectious diseases
Jones, K. E., Patel, N. G., Levy, M. A., Storeygard, A., Balk, D., Gittleman, J. L., & Daszak, P. (2008) · Nature · doi:10.1038/nature06536 · Cited by 8,338 · cited 1×
“…environmental pollutants, antimicrobial resistance, climate or market-driven food system changes with consequences on food and feed supplies, malnutrition including obesity and many more arise from the intertwined spheres of humans, animals, and the ecosystems constituting their environment (1, 2).”
BackgroundLevitt, B., & March, J. G. (1988) · Annual Review of Sociology · doi:10.1146/annurev.so.14.080188.001535 · Cited by 6,447
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · cited 1×
“…and the quantity and quality of what is delivered); mechanisms of impact (i.e., how activities, and participants’ interactions with them, trigger change); and context (i.e., how external factors influence the delivery and functioning of activities) are examined through process evaluation (51, 52).”
BackgroundFiol, C. M., & Lyles, M. A. (1985) · The Academy of Management Review · doi:10.5465/amr.1985.4279103 · Cited by 3,385
(2009) · Choice Reviews Online · doi:10.5860/choice.46-6156 · Cited by 3,071
Whitmee, S., Haines, A., Beyrer, C., Boltz, F., Capon, A. G., de Souza Dias, B. F., Ezeh, A., Frumkin, H., Gong, P., Head, P., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60901-1 · Cited by 2,998
Transdisciplinary research in sustainability science: Practice, principles, and challenges
Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., Swilling, M., & Thomas, C. J. (2012) · Sustainability Science · doi:10.1007/s11625-011-0149-x · Cited by 2,925 · cited 1×
“In a transdisciplinary process, the outcomes are situated in societal and scientific practice and can be of multiple natures (e.g., technical, economic, social, sanitary, and political) (33).”
BackgroundDeveloping and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Data Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
Effective leadership behavior: What we know and what questions need more attention
Yukl, G. (2012) · Academy of Management Perspectives · doi:10.5465/amp.2012.0088 · Cited by 1,264 · cited 6×
“Yukl emphasises that all leadership behaviours and particularly their flexible applications are relevant for effective leadership.”
BackgroundInfluentialFrom “one medicine” to “one health” and systemic approaches to health and well-being
Zinsstag, J., Schelling, E., Waltner-Toews, D., & Tanner, M. (2011) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2010.07.003 · Cited by 1,168 · cited 1×
“They also bring together the scientific and non-scientific communities, influencing, or influenced by, the challenge and their combined know-how and resources (6–8).”
BackgroundHandbook of Transdisciplinary Research
(2008) · Springer eBooks · doi:10.1007/978-1-4020-6699-3 · Cited by 1,168
Systems thinking for health systems strengthening.
de Savigny, D., & Adam, T. (2009) · Cited by 1,072
Tsang, E. W. K. (1997) · Human Relations · doi:10.1177/001872679705000104 · Cited by 933
Sharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881 · cited 2×
“In a broad sense, data and information sharing is a catalyser of knowledge generation (80).”
BackgroundSculpting the Learning Organization: Lessons in the Art and Science of Systemic Change
Watkins, K. E., & Marsick, V. J. (1993) · Medical Entomology and Zoology · Cited by 712
Ten principles of good interdisciplinary team work
Nancarrow, S. A., Booth, A., Ariss, S., Smith, T., Enderby, P., & Roots, A. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-19 · Cited by 681 · cited 2×
“It must be emphasised that such transdisciplinary work demands a high level of commitment and collaboration of all participants to establish personal relationships founded within a climate of trust (9, 42, 59).”
BackgroundLearning in Action: A Guide to Putting the Learning Organization to Work
Garvin, D. A. (2000) · UCLA - Biblioteca de Administración y Contaduría · Cited by 560
Connecting Global Priorities: Biodiversity and Human Health, a State of Knowledge Review
Romanelli, C., Cooper, D., Campbell-Lendrum, D. H., Maiero, M., Karesh, W. B., Hunter, D., & Golden, C. D. W. (2015) · CGSPace A Repository of Agricultural Research Outputs (Consultative Group for International Agricultural Research) · doi:10.13140/rg.2.1.3679.6565 · Cited by 408
Practical Challenges of Systems Thinking and Modeling in Public Health
Trochim, W. M., Cabrera, D. A., Milstein, B., Gallagher, R. S., & Leischow, S. J. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.066001 · Cited by 405 · cited 2×
“It is recommended that the evaluator is comfortable with systems thinking (14, 22) to approach the complex structures and dynamics of OH initiatives and their context.”
BackgroundHow to solve the world's biggest problems
Ledford, H. (2015) · Nature · doi:10.1038/525308a · Cited by 395
7 transformations of leadership.
Rooke, D., & Torbert, W. R. (2005) · PubMed · Cited by 376
Lerner, H., & Berg, C. (2015) · Infection Ecology & Epidemiology · doi:10.3402/iee.v5.25300 · Cited by 367 · cited 1×
“Three such grades or levels can be identified at which OH outcomes are usually measured: individual level of health, population level of health, and ecosystem level of health (30).”
BackgroundPracticing Interdisciplinarity
LÉLÉ, S., & NORGAARD, R. B. (2005) · BioScience · doi:10.1641/0006-3568(2005)055[0967:pi]2.0.co;2 · Cited by 334 · cited 3×
“It must be emphasised that such transdisciplinary work demands a high level of commitment and collaboration of all participants to establish personal relationships founded within a climate of trust (9, 42, 59).”
BackgroundEvaluating transdisciplinary science
Stokols, D., Fuqua, J., Gress, J., Harvey, R., Phillips, K., Baezconde-Garbanati, L., Unger, J., Palmer, P., Clark, M., Colby, S., et al. (2003) · Nicotine & Tobacco Research · doi:10.1080/14622200310001625555 · Cited by 328 · cited 1×
“There is a need to provide evidence on the added value of these integrated and transdisciplinary approaches to governments, researchers, funding bodies, and stakeholders (9–11).”
BackgroundWalter, A. I., Helgenberger, S., Wiek, A., & Scholz, R. W. (2007) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2007.08.002 · Cited by 323
Organizational Learning and the Learning Organization: Developments in Theory and Practice
Easterby-Smith, M., Araujo, L., & Burgoyne, J. (1999) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218297 · Cited by 290
Bio Science: Genetic Genealogy Testing and the Pursuit of African Ancestry
Nelson, A. (2008) · Social Studies of Science · doi:10.1177/0306312708091929 · Cited by 279
Seven transformations of leadership
Rooke, D., & Torbert, W. R. (2005) · Harvard business review · Cited by 274
Navigating the adaptive cycle: an approach to managing the resilience of social systems
Fath, B. D., Dean, C. A., & Katzmair, H. (2015) · Ecology and Society · doi:10.5751/es-07467-200224 · Cited by 267
Hierarchy in Natural and Social Sciences
(2006) · Springer eBooks · doi:10.1007/1-4020-4127-6 · Cited by 259
The State of Food and Agriculture 2013: Food Systems for Better Nutrition
Food and Agriculture Organization of the United Nations (2013) · The State of Food and Agriculture · doi:10.18356/b50734e7-en · Cited by 188
Toward Proof of Concept of a One Health Approach to Disease Prediction and Control
Rabinowitz, P. M., Kock, R., Kachani, M., Kunkel, R., Thomas, J., Gilbert, J., Wallace, R., Blackmore, C., Wong, D., Karesh, W., et al. (2013) · Emerging Infectious Diseases · doi:10.3201/eid1912.130265 · Cited by 174
A Blueprint to Evaluate One Health
Rüegg, S. R., McMahon, B. J., Häsler, B., Esposito, R., Nielsen, L. R., Speranza, C. I., Ehlinger, T. J., Peyre, M., Aragrande, M., Zinsstag, J., et al. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00020 · Cited by 169
Self-citation(2000) · Missing Organizational Linkages: Tools for Cross-Level Research · doi:10.4135/9781452220451.n8 · Cited by 165
Evaluating one health: Are we demonstrating effectiveness?
Baum, S. E., Machalaba, C. C., Daszak, P., Salerno, R. H., & Karesh, W. B. (2016) · One Health · doi:10.1016/j.onehlt.2016.10.004 · Cited by 162
Towards a Data Sharing Culture: Recommendations for Leadership from Academic Health Centers
Piwowar, H. A., Becich, M. J., Bilofsky, H., Crowley, R. S., & Workspace, O. B. O. T. C. D. S. A. I. C. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050183 · Cited by 155 · cited 1×
“…to the data owners themselves, as the analysis of others might lead them to further develop their knowledge on the systems the data originated from or the strengths and limitations of their datasets, as well as raising the awareness of the existence of the data in the wider community (80, 84, 85).”
BackgroundPublic sharing of research datasets: A pilot study of associations
Piwowar, H. A., & Chapman, W. W. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2009.11.010 · Cited by 144 · cited 1×
“…to the data owners themselves, as the analysis of others might lead them to further develop their knowledge on the systems the data originated from or the strengths and limitations of their datasets, as well as raising the awareness of the existence of the data in the wider community (80, 84, 85).”
BackgroundHäsler, B., Cornelsen, L., Bennani, H., & Rushton, J. (2014) · Scientific and Technical Review (World Organisation for Animal Health) · doi:10.20506/rst.33.2.2294 · Cited by 125 · cited 1×
“Given the diversity of OH initiatives, there is no single outcome that summarises OH endeavours, but rather a wide range of different outcomes (37–39).”
BackgroundSelf-citationComplex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship
Mowles, C. (2014) · Evaluation · doi:10.1177/1356389014527885 · Cited by 124 · cited 1×
“If unexpected outcomes are not captured, evaluation fails in informing adaptive management that seeks to improve outcomes in complex dynamic environments (47).”
BackgroundBalancing Biases: A Critical Review of the Literature on Organizational Learning
Huysman, M. (1999) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218297.n4 · Cited by 118 · cited 1×
“It is important to assess how knowledge is gathered, stored, and distributed within an OH initiative (76), and if and how it provides working environments, technology, rewards, systems, structures, and policies that will support learning (73).”
BackgroundThygeson, N. M., Morrissey, L., & Ulstad, V. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01533.x · Cited by 110 · cited 1×
“In many complex settings, change-oriented leadership has helped to overcome the fallacies of conventions, norms, and traditions (61, 62).”
BackgroundSharing is caring: Toward a model of proactive caring through shared leadership
Houghton, J. D., Pearce, C. L., Manz, C. C., Courtright, S. H., & Stewart, G. L. (2014) · Human Resource Management Review · doi:10.1016/j.hrmr.2014.12.001 · Cited by 99 · cited 1×
“To ensure that disciplines are effectively engaged and involved in decision-making from the planning to the implementation stages of projects, shared/distributed leadership, and governance should be implemented involving all stakeholders (64, 65).”
BackgroundPathways of Interdisciplinary Cognition
Nikitina, S. (2005) · Cognition and Instruction · doi:10.1207/s1532690xci2303_3 · Cited by 90 · cited 1×
“Appreciating potential contributions of multiple disciplines requires examining the limits imposed by a discipline, and rejecting or accepting different disciplinary theories based on their relevance and credibility in order to gain a new understanding about the defined challenge (12, 58).”
BackgroundTransitioning to the Learning Organization
Giesecke, J. R., & McNeil, B. (2004) · Lincoln (University of Nebraska) · Cited by 83
Adaptive governance of riverine and wetland ecosystem goods and services
Gunderson, L., Cosens, B. A., & Garmestani, A. S. (2016) · Journal of Environmental Management · doi:10.1016/j.jenvman.2016.05.024 · Cited by 82 · cited 1×
“Due to the complex and trans-domain characteristics of OH challenges, another important aspect of OH initiatives is the ability to self-assess, learn, reflect, and adapt to new knowledge and changing conditions, constraints, and opportunities over time (55).”
BackgroundLearning organisation review – a “good” theory perspective
Santa, M. (2015) · The Learning Organization · doi:10.1108/tlo-12-2014-0067 · Cited by 79
Self-citationChokshi, D. A. (2006) · Bulletin of the World Health Organization · doi:10.2471/blt.06.029843 · Cited by 76 · cited 1×
“Despite these benefits, data and information sharing often lead to barriers for establishing collaborations (86) and are hampered by confidentiality issues, time delays, and even mistrust in established collaborations.”
BackgroundDeveloping a Measure of Interdisciplinary Competence for Engineers
Lattuca, L. R., Knight, D. B., & Bergom, I. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--21173 · Cited by 62
Becoming a learning organisation: A social work example
Gould, N. (2000) · Social Work Education · doi:10.1080/02615470020002317 · Cited by 53 · cited 2×
“Teams enable the interplay between individual and organisational learning, because they can better share the knowledge (72–74) and include more people in the learning process.”
BackgroundGoing Beyond Mixed Methods to Mixed Approaches: A Systems Perspective for Asking the Right Questions
Garcia, J. R., & Zazueta, A. E. (2015) · IDS Bulletin · doi:10.1111/1759-5436.12119 · Cited by 50
Quantitative Outcomes of a One Health approach to Study Global Health Challenges
Falzon, L. C., Lechner, I., Chantziaras, I., Collineau, L., Courcoul, A., Filippitzi, M., Laukkanen‐Ninios, R., Peroz, C., Ferreira, J. P., Postma, M., et al. (2018) · EcoHealth · doi:10.1007/s10393-017-1310-5 · Cited by 46
Self-citationSystems Thinking About Systems Thinking A Proposal for a Common Language
Whitehead, P., Scherer, W. T., & Smith, M. C. (2014) · IEEE Systems Journal · doi:10.1109/jsyst.2014.2332494 · Cited by 45
El‐Jardali, F., Adam, T., Ataya, N., Jamal, D., & Jaafar, M. (2014) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2014.124 · Cited by 36
Houe, H., Gardner, I. A., & Nielsen, L. R. (2011) · Acta veterinaria Scandinavica · doi:10.1186/1751-0147-53-s1-s7 · Cited by 35 · cited 1×
“Moreover, fees and technical constraints may arise (87), and often too little resources are set aside to for data extraction from databases.”
BackgroundSelf-citationLaing, G., Aragrande, M., Canali, M., Savić, S., & Meneghi, D. D. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00045 · Cited by 29
Self-citationA One Health Evaluation of the Southern African Centre for Infectious Disease Surveillance
Hanin, M. C. E., Queenan, K., Savić, S., Karimuribo, E. D., Rüegg, S. R., & Häsler, B. (2018) · Frontiers in Veterinary Science · doi:10.3389/fvets.2018.00033 · Cited by 28
Self-citationWallace, R. G., & Wallace, R. (2016) · Springer eBooks · doi:10.1007/978-3-319-40940-5 · Cited by 25
Introduction - Towards Systemic Approaches to Evaluation and Impact
Befani, B., Ramalingam, B., & Stern, E. (2015) · IDS Bulletin · doi:10.1111/1759-5436.12116 · Cited by 18
Boriani, E., Esposito, R., Frazzoli, C., Fantke, P., Hald, T., & Rüegg, S. R. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00182 · Cited by 16 · cited 1×
“In Table 2 , we adapted the tabular system description by Boriani et al. (31) for a broader application.”
MethodSelf-citationQuantifying the quality of a systems approach
Whitehead, P., & Scherer, W. T. (2015) · IEEE International Systems Conference (SysCon) · doi:10.1109/syscon.2015.7116727 · Cited by 4 · cited 1×
“To assess systems thinking in written documents, e.g., in a retrospective evaluation or in a proposal, we refer to a method based on statistical semantics proposed by Whitehead and Scherer (54).”
Method
Cited by
Soil microbiomes and one health
Banerjee, S., & van der Heijden, M. G. A. (2023) · Nature Reviews Microbiology · doi:10.1038/s41579-022-00779-w · Cited by 905
One Digital Health: A Unified Framework for Future Health Ecosystems
Benis, A., Tamburis, O., Chronaki, C., & Moen, A. (2021) · Journal of Medical Internet Research · doi:10.2196/22189 · Cited by 177
Metadata
- Authors
- Rüegg, S. R., Nielsen, L. R., Buttigieg, S. C., Santa, M., Aragrande, M., Canali, M., Ehlinger, T., Chantziaras, I., Boriani, E., Radeski, M., Bruce, M., Queenan, K., & Häsler, B.
- Venue
- Frontiers in Veterinary Science
- Publisher
- Frontiers Media SA
- Published
- 2018-03-09
- Volume
- 5
- Pages
- 23-23
- ISSN
- 2297-1769 (ISSN-L)
- OpenAlex
- W2792137248
- Cited by
- 178
- References
- 63
- FWCI
- 10.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.