CoChat

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation

Open access
Neupane, Sunisha, Odendaal, Willem, Friedman, Irwin, Jassat, Waasila, Schneider, Helen, Doherty, Tanya · 2014 · BMC Medical Informatics and Decision Making
Cited by 41

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

BACKGROUND: In an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs. METHODS: One sub-district in the North West province was identified for the evaluation. One outreach team comprising ten CHWs maintained both the paper forms and mHealth system to record household data on community-based services. A comparative analysis was done to calculate the correspondence between the paper and phone records. A focus group discussion was conducted with the CHWs. Clinical referrals, data accuracy and supervised visits were compared and analysed for the paper and phone systems. RESULTS: Compared to the mHealth system where data accuracy was assured, 40% of the CHWs showed a consistently high level (>90% correspondence) of data transfer accuracy on paper. Overall, there was an improvement over time, and by the fifth month, all CHWs achieved a correspondence of 90% or above between phone and paper data. The most common error that occurred was summing the total number of visits and/or activities across the five household activity indicators. Few supervised home visits were recorded in either system and there was no evidence of the team leader following up on the automatic notifications received on their cell phones. CONCLUSIONS: The evaluation emphasizes the need for regular supervision for both systems and rigorous and ongoing assessments of data quality for the paper system. Formalization of a mHealth M&E system for PHC outreach teams delivering community based services could offer greater accuracy of M&E and enhance supervision systems for CHWs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1472-6947-14-69

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 25

  1. Ingram M, Sabo S, Rothers J, Wennerstrom A, de Zapien JG: Community health workers and community advocacy: addressing health disparities. J Commun Health. 2008, 33 (6): 417-424. 10.1007/s10900-008-9111-y. · DOI
  2. van Ginneken N, Lewin S, Berridge V: The emergence of community health worker programmes in the late apartheid era in South Africa: a historical analysis. Soc Sci Med. 2010, 71 (6): 1110-1118. 10.1016/j.socscimed.2010.06.009. · DOI
  3. Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, Odgaard-Jensen J, Johansen M, Aja GN, Zwarenstein M: Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010, 3: CD004015-
  4. Ingram M, Reinschmidt KM, Schachter KA, Davidson CL, Sabo SJ, De Zapien JG, Carvajal SC: Establishing a professional profile of community health workers: results from a national study of roles, activities and training. J Commun Health. 2012, 37 (2): 529-537. 10.1007/s10900-011-9475-2. · DOI
  5. Bhutta ZA, Chopra M, Axelson H, Berman P, Boerma T, Bryce J, Bustreo F, Cavagnero E, Cometto G, Daelmans B: Countdown to 2015 decade report (2000–10): taking stock of maternal, newborn, and child survival. Lancet. 2010, 375 (9730): 2032-2044. 10.1016/S0140-6736(10)60678-2. · DOI · Paper page
  6. Bhutta ZA, Lassi ZS, Pariyo G, Huicho L: Global Experience of Community Health Workers for Delivery of Health Related Millennium Development Goals: a Systematic Review, Country Case Studies, and Recommendations for Integration into National Health Systems. 2010, Geneva, Switzerland: Global Health Workforce Alliance
  7. Lehmann U, Sanders D: Community Health Workers: What Do We Know About Them. 2007, Geneva: World Health Organization
  8. The Partnership for Maternal, Newborn & Child Health: A Global Review of the Key Interventions Related to Reproductive, Maternal, Newborn and Child Health (RMNCH). 2011, Geneva, Switzerland: PMNCH
  9. Kidane G, Morrow RH: Teaching mothers to provide home treatment of malaria in Tigray, Ethiopia: a randomised trial. Lancet. 2000, 356 (9229): 550-555. 10.1016/S0140-6736(00)02580-0. · DOI · Paper page
  10. Koenig SP, Leandre F, Farmer PE: Scaling-up HIV treatment programmes in resource-limited settings: the rural Haiti experience. Aids. 2004, 18: S21-S25. 10.1097/00002030-200406003-00005. · DOI · Paper page
  11. Sazawal S, Black RE: Effect of pneumonia case management on mortality in neonates, infants, and preschool children: a meta-analysis of community-based trials. Lancet Infect Dis. 2003, 3 (9): 547-556. 10.1016/S1473-3099(03)00737-0. · DOI · Paper page
  12. UNICEF: Committing to Child Survival: A Promise Renewed Progress Report 2013. Edited by: Anthony D, Mullerbeck E. 2013, New York: UNICEF
  13. United Nations: Millennium Development Goals Indicators, Maternal Mortality Ratio, South Africa. 2012, United Nationals
  14. Rowe AK, Onikpo F, Lama M, Deming MS: The rise and fall of supervision in a project designed to strengthen supervision of integrated management of childhood illness in Benin. Health Policy Plann. 2010, 25 (2): 125-134. 10.1093/heapol/czp054. · DOI
  15. Walt G, Perera M, Heggenhougen K: Are large-scale volunteer community health worker programmes feasible? The case of Sri Lanka. Soc Sci Med. 1989, 29 (5): 599-608. 10.1016/0277-9536(89)90179-2. · DOI
  16. Agarwal M, Bourgeois J, Sodhi S, Matengeni A, Bezanson K, van Schoor V, van Lettow M: Updating a patient-level ART database covering remote health facilities in Zomba district, Malawi: lessons learned. PHA. 2013, 3 (2): 175-179. · DOI
  17. Clarke M, Schoeman H, Friedman I: Towards a Generic Surveillance System to Measure the Impact of Community Health Worker Programmes in South Africa: A Comparison of Paper-Based and Mobile/Cell Phone Methods. 2007, Durban, South Africa: Health Systems Trust
  18. Ogunmefun C, Friedman I, Mothibe N: Electronic Community Care Giver (CCG) Study: A Formative Evaluation of the Implementation of an Electronic Monitoring and Evaluation Solution for CCG Programmes. 2010, Durban, South Africa: Health Systems Trust
  19. Shozi NA, Pottas D, Mostert-Phipps N: Perceived benefits of remote data capturing in community home-based care: the caregivers’ perspective. Journal of Community Informatics. 2013, 9 (2): · doi:10.15353/joci.v9i2.3176
  20. Brath H, Morak J, Kästenbauer T, Modre‒Osprian R, Strohner‒Kästenbauer H, Schwarz M, Kort W, Schreier G: Mobile health (mHealth) based medication adherence measurement–a pilot trial using electronic blisters in diabetes patients. Br J Clin Pharmacol. 2013, 76 (S1): 47-55. · DOI · Paper page
  21. Leon N, Schneider H: MHealth4CBS in South Africa: A Review of the Role of Mobile Phone Technology for Monitoring and Evaluation of Community Based Health Services. 2012, Cape Town: Medical Research Council and University of Western Cape
  22. Mechael P, Batavia H, Kaonga N, Searle S, Kwan A, Goldberger A, Fu L, Ossman J: Barriers and Gaps Affecting mHealth in Low and Middle Income Countries: Policy White Paper. 2010, New York: Columbia University. Earth institute. Center for global health and economic development (CGHED): with mHealth alliance
  23. Municipal Demarcation Board: State Municipal Capacity Assessment 2010/2011: National Trends in Municipal Capacity. 2012, Pretoria: Municipal Demarcation Board
  24. Bernabe-Ortiz A, Curioso WH, Gonzales MA, Evangelista W, Castagnetto JM, Carcamo CP, Hughes JP, Garcia PJ, Garnett GP, Holmes KK: Handheld computers for self-administered sensitive data collection: a comparative study in Peru. BMC Med Inform Decis Mak. 2008, 8 (1): 11-10.1186/1472-6947-8-11. · DOI · Paper page
  25. Qiang CZ, Yamamichi M, Hausman V, Altman D, Unit IS: Mobile Applications for The Health Sector. 2011, Washington: World Bank

Cited by

See all 41

Metadata

Authors
Neupane, S., Odendaal, W., Friedman, I., Jassat, W., Schneider, H., & Doherty, T.
Venue
BMC Medical Informatics and Decision Making
Published
2014-08-09
Volume
14
Issue
1
Pages
69-69
ISSN
1472-6947 (ISSN-L)
OpenAlex
W2050943305
Cited by
41
References
9
FWCI
5.23
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation. https://app.cochat.ai/papers/10.1186/1472-6947-14-69
The paper
Neupane, S., Odendaal, W., Friedman, I., Jassat, W., Schneider, H., & Doherty, T. (2014). Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-14-69

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.