Using routine health information systems for well-designed health evaluations in low- and middle-income countries
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Routine health information systems (RHISs) are in place in nearly every country and provide routinely collected full-coverage records on all levels of health system service delivery. However, these rich sources of data are regularly overlooked for evaluating causal effects of health programmes due to concerns regarding completeness, timeliness, representativeness and accuracy. Using Mozambique's national RHIS (Módulo Básico) as an illustrative example, we urge renewed attention to the use of RHIS data for health evaluations. Interventions to improve data quality exist and have been tested in low-and middle-income countries (LMICs). Intrinsic features of RHIS data (numerous repeated observations over extended periods of time, full coverage of health facilities, and numerous real-time indicators of service coverage and utilization) provide for very robust quasi-experimental designs, such as controlled interrupted time-series (cITS), which are not possible with intermittent community sample surveys. In addition, cITS analyses are well suited for continuously evolving development contexts in LMICs by: (1) allowing for measurement and controlling for trends and other patterns before, during and after intervention implementation; (2) facilitating the use of numerous simultaneous control groups and non-equivalent dependent variables at multiple nested levels to increase validity and strength of causal inference; and (3) allowing the integration of continuous 'effective dose received' implementation measures. With expanded use of RHIS data for the evaluation of health programmes, investments in data systems, health worker interest in and utilization of RHIS data, as well as data quality will further increase over time. Because RHIS data are ministry-owned and operated, relying upon these data will contribute to sustainable national capacity over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Segmented regression analysis of interrupted time series studies in medication use research
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross-Degnan, D. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00430.x · Cited by 3,279 · cited 2×
“Last, the design elements above allow for the use of advanced time-series analyses such as generalized estimating equations (GEEs) (Zorn 2001), segmented regression (Wagner et al. 2002), multi-level modelling (Goldstein et al.”
MethodExternal validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 1×
“Quasiexperimental designs are of particular advantage in LMIC settings, where alternative randomized controlled trials are often expensive, slow, not feasible, lacking in external validity and/or ethically questionable (Biglan et al. 2000; Victora et al. 2004; Rothwell 2005).”
BackgroundEvidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · cited 1×
“Quasiexperimental designs are of particular advantage in LMIC settings, where alternative randomized controlled trials are often expensive, slow, not feasible, lacking in external validity and/or ethically questionable (Biglan et al. 2000; Victora et al. 2004; Rothwell 2005).”
BackgroundThe Value of Interrupted Time-Series Experiments for Community Intervention Research
Biglan, A., Ary, D., & Wagenaar, A. C. (2000) · Prevention Science · doi:10.1023/a:1010024016308 · Cited by 444 · cited 4×
“…and specify the functional form of the effect, allow for use of multiple replications (ABA or ABAB designs) and dose-response analyses to increase confidence that observed intervention effects were not due to some idiosyncratic or uncontrolled factor (Biglan et al. 2000; Wagenaar and Burris 2013).”
BackgroundInfluentialSelf-citationThe impact of a smoking ban on hospital admissions for coronary heart disease
Khuder, S. A., Milz, S., Jordan, T., Price, J., Silvestri, K., & Butler, P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.03.011 · Cited by 152 · cited 2×
“2009), clean indoor air ordinances banning smoking (Khuder et al. 2007) and suicide prevention strategies (Morrell et al.”
BackgroundThe imperfect world of global health estimates
Byass, P. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1001006 · Cited by 68
Cited by
Lovero, K. L., Kemp, C. G., Wagenaar, B. H., Giusto, A., Greene, M. C., Powell, B. J., & Proctor, E. K. (2023) · Implementation Science · doi:10.1186/s13012-023-01310-2 · Cited by 52
Self-citationThe Operational Research and Coaching for Analysts (ORCA)- participants & team, Adane, A., Adege, T. M., Ahmed, M. M., Anteneh, H. A., Ayalew, E. S., Berhanu, D., Berhanu, N., Getnet, M., Bishaw, T., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-050356 · Cited by 51
Irungu, E. M., Mugwanya, K. K., Mugo, N. R., Bukusi, E. A., Donnell, D., Odoyo, J., Wamoni, E., Peacock, S., Morton, J. F., Ngure, K., et al. (2021) · The Lancet Global Health · doi:10.1016/s2214-109x(21)00391-0 · Cited by 49
Iyer, H. S., Hirschhorn, L. R., Nisingizwe, M. P., Kamanzi, E., Drobac, P. C., Rwabukwisi, F. C., Law, M. R., Muhire, A., Rusanganwa, V., & Basinga, P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0182418 · Cited by 24
“An underutilized resource that could be used to address this issue is the wealth of routinely collected service utilization data produced by national health management information systems (HMIS) in low income countries [8, 10].”
Background
Metadata
- Authors
- Wagenaar, B. H., Sherr, K., Fernandes, Q., & Wagenaar, A. C.
- Venue
- Health Policy and Planning
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-04-16
- Volume
- 31
- Issue
- 1
- Pages
- 129-135
- ISSN
- 0268-1080 (ISSN-L)
- 1460-2237
- OpenAlex
- W2060004321
- Cited by
- 167
- References
- 6
- FWCI
- 14.13
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using routine health information systems for well-designed health evaluations in low- and middle-income countries. https://app.cochat.ai/papers/10.1093/heapol/czv029
- The paper
- Wagenaar, B. H., Sherr, K., Fernandes, Q., & Wagenaar, A. C. (2016). Using routine health information systems for well-designed health evaluations in low- and middle-income countries. Health Policy and Planning. https://doi.org/10.1093/heapol/czv029
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.