CoChat

Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia

Open access
Abayneh, Sisay, Lempp, Heidi, Alem, Atalay, Kohrt, Brandon A., Fekadu, Abebaw, Hanlon, Charlotte · 2020 · International Journal of Mental Health Systems
Cited by 67

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

Background: The involvement of service users and caregivers is recommended as a strategy to strengthen health systems and scale up quality mental healthcare equitably, particularly in low-and-middle-income countries. Service user and caregiver involvement is complex, and its meaningful implementation seems to be a worldwide challenge. Theory of Change (ToC) has been recommended to guide the development, implementation and evaluation of such complex interventions. This paper aims to describe a ToC model for service user and caregiver involvement in a primary mental health care in rural Ethiopia. Methods: The ToC was developed in two workshops conducted in (i) Addis Ababa with purposively selected psychiatrists (n = 4) and multidisciplinary researchers (n = 3), and (ii) a rural district in south-central Ethiopia (Sodo), with community stakeholders (n = 24). Information from the workshops (provisional ToC maps, minutes, audio recordings), and inputs from a previous qualitative study were triangulated to develop the detailed ToC map. This ToC map was further refined with written feedback and further consultative meetings with the research team (n = 6) and community stakeholders (n = 35). Results: The experiential knowledge and professional expertise of ToC participants combined to produce a ToC map that incorporated key components (community, health organisation, service user and caregiver), necessary interventions, preconditions, assumptions and indicators towards the long-term outcomes. The participatory nature of ToC by itself raised awareness of the possibilities for servicer user and caregiver involvement, promoted co-working and stimulated immediate commitments to mobilise support for a grass roots service user organization. Conclusions: The ToC workshops provided an opportunity to co-produce a ToC for service user and caregiver involvement in mental health system strengthening linked to the planned model for scale-up of mental health care in Ethiopia. The next steps will be to pilot a multi-faceted intervention based on the ToC and link locally generated evidence to published evidence and theories to refine the ToC for broader transferability to other mental health settings.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13033-020-00383-6

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 27 references

Research works printed but not linked: 80

  1. Tambuyzer E, Pieters G, Van Audenhove C. Patient involvement in mental health care: one size does not fit all. Health Expect. 2011;17(1):138–50. · DOI · Paper page
  2. Wallcraft J, Amering M, Freidin J, Davar B, Froggatt D, Jafri H, et al. Partnerships for better mental health worldwide: WPA recommendations on best practices in working with service users and family carers. World Psychiatry. 2011;10(3):229–36. · DOI · Paper page
  3. Bee P, Price O, Baker J, Lovell K. Systematic synthesis of barriers and facilitators to service user-led care planning. Br J Psychiatry. 2015;207(2):104–14. · DOI · Paper page
  4. Gallivan J, Kovacs Burns K, Bellows M, Eigenseher C. The many faces of patient engagement. J Participat Med. 2012;4:e32.
  5. Millar SL, Chambers M, Giles M. Service user involvement in mental health care: an evolutionary concept analysis. Health Expect. 2016;19(2):209–21. · DOI · Paper page
  6. Hickey G, Kipping C. Exploring the concept of user involvement in mental health through a participation continuum. J Clin Nurs. 1998;7(1):83–8. · DOI · Paper page
  7. Saxena S, Funk M, Chisholm D. World health assembly adopts comprehensive mental health action plan 2013–2020. Lancet. 2013;381(9882):1970–1. · DOI · Paper page
  8. Lloyd M. Participation in practice a review of service user involvement in mental health nursing. Ment Health Learn Disabil Res Pract. 2010;7(2):195–206. · DOI
  9. Simpson EL, House AO. Involving users in the delivery and evaluation of mental health services: systematic review. Br J Psychiatry. 2002;325(7375):1265.
  10. Crawford MJ, Rutter D, Manley C, Weaver T, Bhui K, Fulop N, et al. Systematic review of involving patients in the planning and development of health care. BMJ. 2002;325(7375):1263. · DOI · Paper page
  11. McDaid S. An equality of condition framework for user involvement in mental health policy and planning: evidence from participatory action research. Disabil Soc. 2009;24(4):461–74. · DOI
  12. Linhorst DM. Empowering people with severe mental illness: a practical guide. Oxford: Oxford University Press; 2006.
  13. Patel V, Bloch S. The ethical imperative to scale up health care services for people with severe mental disorders in low and middle income countries. Postgrad Med J. 2009;85(1008):509–13. · DOI
  14. Alloh FT, Regmi P, Onche I, Van Teijlingen E, Trenoweth S. Mental Health in low-and middle income countries (LMICs): going beyond the need for funding. Health Prospect: J Public Health. 2018;17(1):12–7. · DOI
  15. Drew N, Funk M, Tang S, Lamichhane J, Chávez E, Katontoka S, et al. Human rights violations of people with mental and psychosocial disabilities: an unresolved global crisis. Lancet. 2011;378(9803):1664–75. · DOI · Paper page
  16. Asher L, Fekadu A, Teferra S, Silva M, Pathare S, Hanlon C. “I cry every day and night, I have my son tied in chains”: physical restraint of people with schizophrenia in community settings in Ethiopia. Glob Health. 2017;13(1):47. · DOI · Paper page
  17. Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 2013;32(2):223–31. · DOI · Paper page
  18. Pomey M-P, Morin E, Neault C, Biron V, Houle L, Lavigueur L, et al. Patient Advisors: how to implement a process for involvement at all levels of governance in a healthcare organization. Patient Exp J. 2016;3(2):99–112. · DOI
  19. Semrau M, Lempp H, Keynejad R, Evans-Lacko S, Mugisha J, Raja S, et al. Service user and caregiver involvement in mental health system strengthening in low-and middle-income countries: systematic review. BMC Health Serv Res. 2016;16(1):79. · DOI · Paper page
  20. Carman KL, Workman TA. Engaging patients and consumers in research evidence: applying the conceptual model of patient and family engagement. Patient Educ Couns. 2017;100(1):25–9. · DOI · Paper page
  21. James C. Theory of change review. A report commissioned by Comic Relief, London. 2011.
  22. Hanlon C, Fekadu A, Jordans M, Kigozi F, Petersen I, Shidhaye R, et al. District mental healthcare plans for five low-and middle-income countries: commonalities, variations and evidence gaps. Br J Psychiatry. 2015;208. · DOI · Paper page
  23. Asher L, Hanlon C, Birhane R, Habtamu A, Eaton J, Weiss HA, et al. Community-based rehabilitation intervention for people with schizophrenia in Ethiopia (RISE): a 12 month mixed methods pilot study. BMC Psychiatry. 2018;18(1):250. · DOI · Paper page
  24. Weiss CH. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. New approaches to evaluating community initiatives: concepts, methods, and contexts. New Approaches Eval Community Initiat Concepts. 1995;1:65–92.
  25. Chen HT. Practical program evaluation: theory-driven evaluation and the integrated evaluation perspective. London: Sage Publications; 2014.
  26. Montague S. Does your implementation fit your theory of change? Can J Program Eval. 2019;33(3):316–35. · doi:10.3138/cjpe.53008
  27. Arensman B, Van Waegeningh C, Van Wessel M. Twinning, “practices of change” with “theory of change” room for emergence in advocacy evaluation. Am J Eval. 2018;39(2):221–36. · DOI
  28. Emerald. Emerald: Emerging mental health systems in low- and middle-income countries. https://www.emerald-project.eu.
  29. Fekadu A, Hanlon C, Medhin G, Alem A, Selamu M, Giorgis TW, et al. Development of a scalable mental healthcare plan for a rural district in Ethiopia. Br J Psychiatry. 2015;1:s9.
  30. CSA. Summary and statistical report of the 2007 population and housing census: Federal Democratic Republic of Ethiopia Population census commission. Addis Ababa: CSA; 2008.
  31. Federal Ministry of Health. HSTP: Health Sector Transformation Plan—2015/16–2019/20(2008–2012 EFY). Addis Ababa: Federal Democratic Republic of Ethiopia; Ministry of Health; 2015.
  32. Wang H, Tesfaye R, Ramana GN, Chekagn CT. Ethiopia health extension program: an institutionalized community approach for universal health coverage. Washington DC: World Bank Publications; 2016. · DOI · Paper page
  33. Hailemariam M, Fekadu A, Prince M, Hanlon C. Engaging and staying engaged: a phenomenological study of barriers to equitable access to mental healthcare for people with severe mental disorders in a rural African setting. Int J Equity Health. 2017;16(1):156. · DOI
  34. Ritchie J, Lewis J, Nicholls CM, Ormston R. Qualitative research practice: a guide for social science students and researchers. London: Sage Publications; 2013.
  35. Abayneh S, Lempp H, Alem A, Alemayehu D, Eshetu T, Lund C, et al. Service user involvement in mental health system strengthening in a rural African setting: qualitative study. BMC Psychiatry. 2017;17(1):187. · DOI · Paper page
  36. Eriksson M, Ghazinour M, Hammarström A. Different uses of Bronfenbrenner’s ecological theory in public mental health research: what is their value for guiding public mental health policy and practice? Soc Theory Health. 2018;16(4):414–33. · DOI · Paper page
  37. Pope MA, Malla AK, Iyer SN. Who should be responsible for supporting individuals with mental health problems? A critical literature review. Int J Soc Psychiatry. 2018;64:293–302. · DOI
  38. George AS, Scott K, Mehra V, Sriram V. Synergies, strengths and challenges: findings on community capability from a systematic health systems research literature review. BMC Health Serv Res. 2016;16(7):623. · DOI
  39. Asher L, Patel V, De Silva MJ. Community-based psychosocial interventions for people with schizophrenia in low and middle-income countries: systematic review and meta-analysis. BMC Psychiatry. 2017;17(1):355. · DOI · Paper page
  40. Bilodeau A, Galarneau M, Lefebvre C, Potvin L. Linking process and effects of intersectoral action on local neighbourhoods: systemic modelling based on Actor-Network Theory. Sociol Health Illn. 2019;41(1):165–79. · DOI
  41. Koleros A, Mulkerne S, Oldenbeuving M, Stein D. The actor-based change framework: a pragmatic approach to developing program theory for interventions in complex systems. Am J Eval. 2018;41(1):34–53. · DOI
  42. Selamu M, Asher L, Hanlon C, Medhin G, Hailemariam M, Patel V, et al. Beyond the biomedical: community resources for mental health care in rural Ethiopia. PLoS ONE. 2015;10(5):e0126666. · DOI · Paper page
  43. Concannon TW, Fuster M, Saunders T, Patel K, Wong JB, Leslie LK, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. J Gen Intern Med. 2014;29(12):1692–701. · DOI · Paper page
  44. Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011.
  45. Montague S, Porteous NL. The case for including reach as a key element of program theory. Evaluation and Program Planning. 2013;36(1):177–83. · DOI
  46. Weiss CH. Theory-based evaluation: past, present, and future. New Direct Eval. 1997;1997(76):41–55. · DOI · Paper page
  47. van Tulder R, Keen N. Capturing collaborative challenges: designing complexity-sensitive theories of change for cross-sector partnerships. J Bus Ethics. 2018;150(2):315–32. · DOI · Paper page
  48. Wicks PG, Reason P. Initiating action research: challenges and paradoxes of opening communicative space. London: Sage Publications; 2009.
  49. Federal Ministry of Health. National Mental Health Strategy, 2012/13–2015/16. Addis Ababa: Federal Democratic Republic of Ethiopia; Ministry of Health; 2012.
  50. Shibre T, Medhin G, Alem A, Kebede D, Teferra S, Jacobsson L, et al. Long-term clinical course and outcome of schizophrenia in rural Ethiopia: 10-year follow-up of a population-based cohort. Schizophr Res. 2015;161(2):414–20. · DOI
  51. Fekadu A, Medhin G, Kebede D, Alem A, Cleare AJ, Prince M, et al. Excess mortality in severe mental illness: 10-year population-based cohort study in rural Ethiopia. Br J Psychiatry. 2015;206:289–96. · DOI · Paper page
  52. Raja S, Underhill C, Shrestha P, Sunder U, Mannarath S, Wood SK, et al. Integrating mental health and development: a case study of the BasicNeeds Model in Nepal. PLoS Med. 2012;9(7):e1001261. · DOI · Paper page
  53. Lund C, Waruguru M, Kingori J, Kippen-Wood S, Breuer E, Mannarath S, et al. Outcomes of the mental health and development model in rural Kenya: a 2-year prospective cohort intervention study. Int Health. 2013;5(1):43–50. · DOI · Paper page
  54. Tritter JQ, McCallum A. The snakes and ladders of user involvement: moving beyond Arnstein. Health Policy. 2006;76(2):156–68. · DOI · Paper page
  55. World Health Organization. Mental health atlas: Ethiopia. Geneva: WHO; 2011.
  56. Federal Democratic Republic of Ethiopia. The constitution of the federal democratic republic of Ethiopia. Ethiopia: Addis Ababa; 1995.
  57. Federal Ministry of Health. Health policy of the Transitional government of Ethiopia. Addis Ababa: Federal Minstry of Health; 1993.
  58. Thornicroft G, Alem A, Santos RA, Barley E, Drake RE, Gregorio G, et al. WPA guidance on steps, obstacles and mistakes to avoid in the implementation of community mental health care. World Psychiatry. 2010;9(2):67–77. · DOI · Paper page
  59. Petersen I, Lund C, Stein DJ. Optimizing mental health services in low-income and middle-income countries. Current Opinion in Psychiatry. 2011;24(4):318–23. · DOI · Paper page
  60. Patel V, Saxena S. Transforming lives, enhancing communities—innovations in global mental health. N Engl J Med. 2014;370(6):498–501. · DOI · Paper page
  61. George A, Scott K, Garimella S, Mondal S, Ved R, Sheikh K. Anchoring contextual analysis in health policy and systems research: a narrative review of contextual factors influencing health committees in low and middle income countries. Soc Sci Med. 2015;133:159–67. · DOI
  62. McCoy DC, Hall JA, Ridge M. A systematic review of the literature for evidence on health facility committees in low-and middle-income countries. Health Policy Plann. 2011;27(6):449–66. · DOI · Paper page
  63. Lodenstein E, Mafuta E, Kpatchavi AC, Servais J, Dieleman M, Broerse JE, et al. Social accountability in primary health care in West and Central Africa: exploring the role of health facility committees. BMC Health Serv Res. 2017;17(1):403. · DOI
  64. Hanlon C, Wondimagegn D, Alem A. Lessons learned in developing community mental health care in Africa. World Psychiatry. 2010;9(3):185–9. · DOI · Paper page
  65. Kleintjes S, Lund C, Swartz L. Organising for self-advocacy in mental health: experiences from seven African countries. Afr J Psychiatry. 2013;16(3):187–95.
  66. Scholz B, Gordon S, Happell B. Consumers in mental health service leadership: a systematic review. Int J Ment Health Nurs. 2017;26(1):20–31. · DOI
  67. Linhorst DM, Eckert A. Conditions for empowering people with severe mental illness. Social Serv Rev. 2003;77(2):279–305. · DOI
  68. Scholz B, Gordon S, Happell B. Consumers in mental health service leadership: a systematic review. Int J Ment Health Nurs. 2016;26:20–31. · DOI
  69. Ryan GK, Semrau M, Nkurunungi E, Mpango RS. Service user involvement in global mental health: what have we learned from recent research in low and middle-income countries? Curr opin Psychiatry. 2019;32:355–60. · DOI
  70. Nieminen I, Kylmä J, Åstedt-Kurki P, Kulmala A, Kaunonen M. Mental health service users’ experiences of training focused on empowerment: training environment and the benefits of training. Arch Psychiatr Nurs. 2016;30(3):309–15. · DOI
  71. Burns JK. Mental health and inequity: a human rights approach to inequality, discrimination, and mental disability. Health Hum Rights. 2009;1:19–31.
  72. Chatterjee S, Pillai A, Jain S, Cohen A, Patel V. Outcomes of people with psychotic disorders in a community-based rehabilitation programme in rural India. Br J Psychiatry. 2009;195(5):433–9. · DOI · Paper page
  73. Cohen A, Raja S, Underhill C, Yaro BP, Dokurugu AY, De Silva M, et al. Sitting with others: mental health self-help groups in northern Ghana. Int J Ment Health Syst. 2012;6(1):1. · DOI · Paper page
  74. Hewstone M, Swart H. Fifty-odd years of inter-group contact: from hypothesis to integrated theory. Br J Soc Psychol. 2011;50(3):374–86. · DOI · Paper page
  75. Becker K, Reiser M, Lambert S, Covello C. Photovoice: conducting community-based participatory research and advocacy in mental health. J Creat Ment Health. 2014;9(2):188–209. · DOI
  76. Russinova Z, Mizock L, Bloch P. Photovoice as a tool to understand the experience of stigma among individuals with serious mental illnesses. Stigma Health. 2018;3(3):171. · DOI
  77. Tang JPS, Tse S, Davidson L. The big picture unfolds: using photovoice to study user participation in mental health services. Int J Soc Psychiatry. 2016;62(8):696–707. · DOI
  78. Evans-Lacko S, London J, Japhet S, Rüsch N, Flach C, Corker E, et al. Mass social contact interventions and their effect on mental health related stigma and intended discrimination. BMC Public Health. 2012;12(1):489. · DOI · Paper page
  79. Mayston R, Alem A, Habtamu A, Shibre T, Fekadu A, Hanlon C. Participatory planning of a primary care service for people with severe mental disorders in rural Ethiopia. Health Policy Plann. 2015;31(3):367–76. · DOI · Paper page
  80. Hailemariam M, Fekadu A, Selamu M, Alem A, Medhin G, Giorgis TW, et al. Developing a mental health care plan in a low resource setting: the theory of change approach. BMC Health Serv Res. 2015;15(1):429. · DOI

Cited by

See all 67

Metadata

Authors
Abayneh, S., Lempp, H., Alem, A., Kohrt, B. A., Fekadu, A., & Hanlon, C.
Venue
International Journal of Mental Health Systems
Published
2020-07-23
Volume
14
Issue
1
Pages
51-51
ISSN
1752-4458 (ISSN-L)
OpenAlex
W3043958961
Cited by
67
References
27
FWCI
12.95
Type
journal article
Language
en
Open access
gold
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia. https://app.cochat.ai/papers/10.1186/s13033-020-00383-6
The paper
Abayneh, S., Lempp, H., Alem, A., Kohrt, B. A., Fekadu, A., & Hanlon, C. (2020). Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia. International Journal of Mental Health Systems. https://doi.org/10.1186/s13033-020-00383-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.