Impact of a district-wide health center strengthening intervention on healthcare utilization in rural Rwanda: Use of interrupted time series analysis
Open accessThe DOI matches its Crossref record; 50 of the 53 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Evaluations of health systems strengthening (HSS) interventions using observational data are rarely used for causal inference due to limited data availability. Routinely collected national data allow use of quasi-experimental designs such as interrupted time series (ITS). Rwanda has invested in a robust electronic health management information system (HMIS) that captures monthly healthcare utilization data. We used ITS to evaluate impact of an HSS intervention to improve primary health care facility readiness on health service utilization in two rural districts of Rwanda. METHODS: We used controlled ITS analysis to compare changes in healthcare utilization at health centers (HC) that received the intervention (n = 13) to propensity score matched non-intervention health centers in Rwanda (n = 86) from January 2008 to December 2012. HC support included infrastructure renovation, salary support, medical equipment, referral network strengthening, and clinical training. Baseline quarterly mean outpatient visit rates and population density were used to model propensity scores. The intervention began in May 2010 and was implemented over a twelve-month period. We used monthly healthcare utilization data from the national Rwandan HMIS to study changes in the (1) number of facility deliveries per 10,000 women, (2) number of referrals for high risk pregnancy per 100,000 women, and (3) the number of outpatient visits performed per 1,000 catchment population. RESULTS: PHIT HC experienced significantly higher monthly delivery rates post-HSS during the April-June season than comparison (3.19/10,000, 95% CI: [0.27, 6.10]). In 2010, this represented a 13% relative increase, and in 2011, this represented a 23% relative increase. The post-HSS change in monthly rate of high-risk pregnancies referred increased slightly in intervention compared to control HC (0.03/10,000, 95% CI: [-0.007, 0.06]). There was a small immediate post-HSS increase in outpatient visit rates in intervention compared to control HC (6.64/1,000, 95% CI: [-13.52, 26.81]). CONCLUSION: We failed to find strong evidence of post-HSS increases in outpatient visit rates or referral rates at health centers, which could be explained by small sample size and high baseline nation-wide health service coverage. However, our findings demonstrate that high quality routinely collected health facility data combined with ITS can be used for rigorous policy evaluation in resource-limited settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This system collects information on health-care services from each facility on a monthly basis and has been used in previous evaluations of this type.20,21”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758 · cited 1×
“We assessed the performance of the propensity score match by comparing the standardized difference in health service utilization between intervention and control health centers before and after applying the match [47, 48].”
MethodRosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774 · cited 1×
“To account for differences in health center characteristics across intervention and control groups and select control facilities that were similar to intervention facilities at baseline with respect to health center characteristics, propensity scores were derived for each health center using multiple logistic regressi…”
MethodAustin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Segmented regression analysis of interrupted time series studies in medication use research
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross-Degnan, D. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00430.x · Cited by 3,279 · cited 1×
“We framed our causal question as follows: what is the difference in level and monthly trend in mean health service utilization rates comparing observed rates from PHIT-supported health centers to the rates they would have had if they had not received the HSS intervention? Controlled interrupted time series operational…”
MethodInterrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049 · cited 1×
“Controlled interrupted time series analysis allows for unbiased estimation of population level effects of an intervention, assuming that no other co-interventions occur at the same time as the primary intervention [36].”
BackgroundPopulation and Housing Census.
Tobago (2011) · Cited by 1,384
Time series regression studies in environmental epidemiology
Bhaskaran, K., Gasparrini, A., Hajat, S., Smeeth, L., & Armstrong, B. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt092 · Cited by 1,150 · cited 3×
“We converted these metrics to rates using population estimates from the Ministry of Health [37] and measured differences in the monthly number of facility deliveries per 1,000 women, the monthly number of referrals for high risk pregnancy per 10,000 women, monthly number of outpatient (OPD) visits per 1,000 catchment…”
MethodInfluentialSystems thinking for health systems strengthening.
de Savigny, D., & Adam, T. (2009) · Cited by 1,060
Basinga, P., Gertler, P. J., Binagwaho, A., Soucat, A. L., Sturdy, J., & Vermeersch, C. M. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60177-3 · Cited by 625 · cited 5×
“Further analyses have suggested that the benefits of these interventions have allowed the poorest patients in Rwanda to increasingly access health services over time [20, 30], meaning that the additional improvement attributable to the PHIT HSS intervention would be challenging to measure.”
BackgroundInfluentialSelf-citationRwanda Demographic and Health Survey 2010
Rwanda (2012) · Cited by 553
Research works printed but not linked: 1
- Coca-Perraillon M. (2007) Local and Global Optimal Propensity Score Matching. Proceedings of the SAS® Global Forum 2007 Conference. Cary, NC: SAS® Institute Inc. Paper 185–2007.
Cited by
Nisingizwe, M. P., Ndishimye, P., Swaibu, K., Nshimiyimana, L., Karame, P., Dushimiyimana, V., Musabyimana, J. P., Musanabaganwa, C., Nsanzimana, S., & Law, M. R. (2022) · The Lancet Global Health · doi:10.1016/s2214-109x(22)00048-1 · Cited by 175
Self-citationHung, Y. W., Hoxha, K., Irwin, B. R., Law, M. R., & Grépin, K. A. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05660-1 · Cited by 116
Self-citationKebede, M., Adeba, E., & Chego, M. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01148-4 · Cited by 61
“In resource-limited countries, routine HMIS data with other data types can be used in rigorous evaluation of policy interventions [15].”
BackgroundNshimyiryo, A., Kirk, C. M., Sauer, S. M., Ntawuyirusha, E., Muhire, A., Sayinzoga, F., & Hedt‐Gauthier, B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235823 · Cited by 58
Self-citationRoutine Health Information System (RHIS) improvements for strengthened health system management
Leon, N., Balakrishna, Y., Hohlfeld, A., Odendaal, W., Schmidt, B., Zweigenthal, V., Watkins, J. A., & Daniels, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012012.pub2 · Cited by 80
“…design Hendriks 2016 Ineligible intervention Hooper 2012 Ineligible intervention Hunt 2009 Ineligible study design Ir 2015 Ineligible intervention Iyer 2015 Ineligible study design Iyer 2017 Ineligible intervention Ji 2018 Ineligible intervention Johnson 2016 Ineligible study design Lamanna,…”
BackgroundInfluential
Metadata
- Authors
- Iyer, H. S., Hirschhorn, L. R., Nisingizwe, M. P., Kamanzi, E., Drobac, P. C., Rwabukwisi, F. C., Law, M. R., Muhire, A., Rusanganwa, V., & Basinga, P.
- Affiliations
- Brigham and Women's Hospital (US)
- Northwestern University (US)
- Partners In Health (US)
- University of British Columbia (CA)
- Ministry of Health (RW)
- Gates Foundation (US)
- Corresponding author
- Iyer, Hari S.
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-08-01
- Volume
- 12
- Issue
- 8
- Pages
- e0182418
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5538651
- OpenAlex
- W2741458641
- Cited by
- 24
- References
- 53
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 2 · 2023: 2 · 2022: 1 · 2021: 4 · 2020: 7 · 2019: 3 · 2018: 1
- FWCI
- 3.29
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Doris Duke Charitable Foundation (2009P001941)
- Topics
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Global Maternal and Child Health
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Reforms
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- health system strengthening, health centers, primary care, health care utilization, rural Rwanda, institutional delivery, outpatient visits, health management information systems, health facility readiness, health insurance coverage, health system adaptability, health system responsiveness, health system equity
- MeSH terms
- Female, Health Facilities, Health Resources, Health Services Research, Humans, Outpatients, Patient Acceptance of Health Care, Pregnancy, Prenatal Care, Primary Health Care, Rwanda, Social Support, Least-Squares Analysis, Sample Size, Pregnancy, High-Risk, Rural Health Services, Electronic Health Records, Interrupted Time Series Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of a district-wide health center strengthening intervention on healthcare utilization in rural Rwanda: Use of interrupted time series analysis. https://app.cochat.ai/papers/10.1371/journal.pone.0182418
- The paper
- Iyer, H. S., Hirschhorn, L. R., Nisingizwe, M. P., Kamanzi, E., Drobac, P. C., Rwabukwisi, F. C., Law, M. R., Muhire, A., Rusanganwa, V., & Basinga, P. (2017). Impact of a district-wide health center strengthening intervention on healthcare utilization in rural Rwanda: Use of interrupted time series analysis. PLOS ONE. https://doi.org/10.1371/journal.pone.0182418
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.