Innovation in evaluating the impact of Integrated Service-Delivery: the Integra indexes of HIV and Reproductive Health integration
Open accessAbstract
BACKGROUND: The body of knowledge on evaluating complex interventions for integrated healthcare lacks both common definitions of 'integrated service delivery' and standard measures of impact. Using multiple data sources in combination with statistical modelling the aim of this study is to develop a measure of HIV-reproductive health (HIV-RH) service integration that can be used to assess the degree of service integration, and the degree to which integration may have health benefits to clients, or reduce service costs. METHODS AND FINDINGS: Data were drawn from the Integra Initiative's client flow (8,263 clients in Swaziland and 25,539 in Kenya) and costing tools implemented between 2008-2012 in 40 clinics providing RH services in Kenya and Swaziland. We used latent variable measurement models to derive dimensions of HIV-RH integration using these data, which quantified the extent and type of integration between HIV and RH services in Kenya and Swaziland. The modelling produced two clear and uncorrelated dimensions of integration at facility level leading to the development of two sub-indexes: a Structural Integration Index (integrated physical and human resource infrastructure) and a Functional Integration Index (integrated delivery of services to clients). The findings highlight the importance of multi-dimensional assessments of integration, suggesting that structural integration is not sufficient to achieve the integrated delivery of care to clients--i.e. "functional integration". CONCLUSIONS: These Indexes are an important methodological contribution for evaluating complex multi-service interventions. They help address the need to broaden traditional evaluations of integrated HIV-RH care through the incorporation of a functional integration measure, to avoid misleading conclusions on its 'impact' on health outcomes. This is particularly important for decision-makers seeking to promote integration in resource constrained environments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The structural realities of girls' and women's lives in many low and middle-income countries create a gap in information through minimum media exposure to health messages, lack of accessible reproductive health clinics, low rates of secondary and tertiary education, lower access to internet and media compared with boys and men, and health clinic staff who may be insufficiently trained to conduct差分
“The structural realities of girls and women’s lives in many LMICs create a gap in information through, for example, minimum media exposure to health messages, the lack of accessible health clinics that are focused on reproductive health43; the low rates of secondary and tertiary education persisting in many countries,44 45 the lower access to internet and media that girls and women have in compar”
From Beyond menstrual hygiene: addressing vaginal bleeding throughout the life course in low and middle-income countries (2017) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · see citing works
The Delphi method as a research tool: an example, design considerations and applications
Okoli, C., & Pawlowski, S. D. (2004) · Information & Management · doi:10.1016/j.im.2003.11.002 · Cited by 4,771 · see citing works
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · see citing works
Habicht, J. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.1.10 · Cited by 729 · see citing works
Atun, R., de Jongh, T., Secci, F., Ohiri, K., & Adeyi, O. (2010) · Health Policy and Planning · doi:10.1093/heapol/czp055 · Cited by 427 · see citing works
Clinical and service integration. The route to improved outcomes
Juhnke, C. (2012) · International Journal of Integrated Care · doi:10.5334/ijic.1065 · Cited by 237 · see citing works
Atun, R. A., de Jongh, T. E., Secci, F., Ohiri, K., & Adeyi, O. (2009) · Health Policy and Planning · doi:10.1093/heapol/czp053 · Cited by 227 · see citing works
Okello, D. R. O., & Gilson, L. (2015) · Human Resources for Health · doi:10.1186/s12960-015-0007-5 · Cited by 209 · see citing works
People-centred science: strengthening the practice of health policy and systems research
Sheikh, K., George, A. S., & Gilson, L. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-19 · Cited by 183 · see citing works
Mislevy, R. J., Johnson, E. G., & Muraki, E. (1992) · Journal of Educational Statistics · doi:10.2307/1165166 · Cited by 167 · see citing works
Dudley, L., & Garner, P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003318.pub3 · Cited by 165 · see citing works
Classical latent variable models for medical research
Rabe‐Hesketh, S., & Skrondal, A. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280207081236 · Cited by 142 · see citing works
Sweeney, S., Obure, C. D., Maier, C. B., Greener, R., Dehne, K. L., & Vassall, A. (2011) · Sexually Transmitted Infections · doi:10.1136/sextrans-2011-050199 · Cited by 140 · see citing works
Self-citationLinking sexual and reproductive health and HIV interventions: a systematic review
Kennedy, C. E., Spaulding, A. B., Brickley, D. B., et al. (2010) · Journal of the International AIDS Society · doi:10.1186/1758-2652-13-26 · Cited by 131 · see citing works
Integrating health interventions for women, newborn babies, and children: a framework for action
Ekman, B., Pathmanathan, I., & Liljestrand, J. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61408-7 · Cited by 117 · see citing works
Church, K., & Mayhew, S. (2009) · Studies in Family Planning · doi:10.1111/j.1728-4465.2009.00201.x · Cited by 103 · see citing works
Self-citationCousens, S. N., Hargreaves, J., Bonell, C. P., Armstrong, B., Thomas, J., Kirkwood, B. R., & Hayes, R. (2009) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2008.082610 · Cited by 84 · see citing works
Integration of family planning services into HIV care and treatment in Kenya
Grossman, D., Onono, M. A., Newmann, S. J., et al. (2013) · AIDS · doi:10.1097/qad.0000000000000035 · Cited by 82 · see citing works
Implementation and Operational Research
Turan, J. M., Onono, M. A., Steinfeld, R. L., Shade, S. B., Owuor, K. O., Washington, S., Bukusi, E. A., Ackers, M., Kioko, J., Interis, E., et al. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000678 · Cited by 78 · see citing works
Zwarenstein, M., Fairall, L. R., Lombard, C., Mayers, P., Bheekie, A., English, R. G., Lewin, S., Bachmann, M. O., & Bateman, E. (2011) · BMJ · doi:10.1136/bmj.d2022 · Cited by 77 · see citing works
Integration of sexual and reproductive health services in KwaZulu-Natal, South Africa
Maharaj, P., & Cleland, J. (2005) · Health Policy and Planning · doi:10.1093/heapol/czi038 · Cited by 74 · see citing works
The Impact of Integrated HIV Care on Patient Health Outcomes
Hoang, T., Goetz, M. B., Yano, E. M., Rossman, B., Anaya, H. D., Knapp, H., Korthuis, P. T., Henry, R., Bowman, C., Gifford, A. L., et al. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819432a0 · Cited by 73 · see citing works
Warren, C., Mayhew, S., Vassall, A., Kimani, J. K., Church, K., Obure, C. D., Preez, N. F.-D., Abuya, T., Mutemwa, R., Colombini, M., et al. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-973 · Cited by 54 · see citing works
Self-citationWhen Does It Make Sense to Consider Integrating STI and HIV Services with Family Planning Services?
Foreit, K. G. F., Hardee, K., & Agarwal, K. (2002) · International Family Planning Perspectives · doi:10.2307/3088242 · Cited by 49 · see citing works
Obure, C. D., Sweeney, S., Darsamo, V., Michaels-Igbokwe, C., Guinness, L., Terris‐Prestholt, F., Muketo, E., Nhlabatsi, Z., Initiative, I., Warren, C., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124476 · Cited by 39 · see citing works
Self-citationSweeney, S., Obure, C. D., Terris‐Prestholt, F., et al. (2014) · Human Resources for Health · doi:10.1186/1478-4491-12-42 · Cited by 36 · see citing works
Self-citationBradley, H. M., Bedada, A., TSUI, A. O., Brahmbhatt, H., Gillespie, D. G., & Kidanu, A. (2008) · AIDS Care · doi:10.1080/09540120701449112 · Cited by 30 · see citing works
Brindis, C. D., Loo, V., Adler, N. E., et al. (2005) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2004.09.015 · Cited by 25 · see citing works
Birdthistle, I. J., Mayhew, S., Kikuvi, J., et al. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003715 · Cited by 22 · see citing works
Self-citationMutemwa, R., Mayhew, S., Warren, C., Abuya, T., Ndwiga, C., & Kivunaga, J. (2017) · Health Policy and Planning · doi:10.1093/heapol/czx090 · Cited by 19 · see citing works
Self-citationUebel, K., Joubert, G., Wouters, E., Mollentze, W. F., & van Rensburg, D. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054266 · Cited by 18 · see citing works
Achieving synergies in prevention through linking sexual and reproductive health and HIV services
Askew, I. (2007) · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [8]Criel B., De Brouwere V., and Dugas S., Integration of vertical programmes in multi-function health services, in Studies in Health Services Organisation and Policy. 1997, ITG Press: Antwerp.
- [29]Muthen L.K. and Muthen B.O., Mplus User's Guide. Sixth Edition, ed. Muthen M.. 1998–2010, Los Angeles, CA.
Cited by
Sorted by citations
Sommer, M., Phillips-Howard, P. A., Mahon, T., Zients, S., Jones, M., & Caruso, B. A. (2017) · BMJ Global Health · doi:10.1136/bmjgh-2017-000405 · Cited by 54 · see citing works
- Authors
- Mayhew, S. H., Ploubidis, G. B., Sloggett, A., Church, K., Obure, C. D., Birdthistle, I., Sweeney, S., Warren, C. E., Watts, C., Vassall, A., & Initiative, I.
- Affiliations
- London School of Hygiene & Tropical Medicine (GB)
- University College London (GB)
- Swiss Tropical and Public Health Institute (CH)
- Population Council (US)
- Vanderbilt University (US)
- Corresponding author
- Mayhew, Susannah H.
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-01-22
- Volume
- 11
- Issue
- 1
- Pages
- e0146694
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4723242
- OpenAlex
- W2270928010
- Cited by
- 34
- References
- 32
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 9 · 2020: 1 · 2019: 3 · 2018: 2 · 2017: 9 · 2016: 2
- FWCI
- 9.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- London School of Hygiene & Tropical Medicine (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Bill and Melinda Gates Foundation (48733)
- Johns Hopkins University
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
- Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
- Keywords
- service integration, integration index, structural integration, functional integration, complex interventions, health service evaluation, health care costs, Swaziland, Kenya
- MeSH terms
- Female, Humans, Kenya, Male, Eswatini, Models, Statistical, HIV Infections, Models, Organizational, Delivery of Health Care, Integrated, Reproductive Health Services, Reproductive Health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review