Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: In an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs. METHODS: One sub-district in the North West province was identified for the evaluation. One outreach team comprising ten CHWs maintained both the paper forms and mHealth system to record household data on community-based services. A comparative analysis was done to calculate the correspondence between the paper and phone records. A focus group discussion was conducted with the CHWs. Clinical referrals, data accuracy and supervised visits were compared and analysed for the paper and phone systems. RESULTS: Compared to the mHealth system where data accuracy was assured, 40% of the CHWs showed a consistently high level (>90% correspondence) of data transfer accuracy on paper. Overall, there was an improvement over time, and by the fifth month, all CHWs achieved a correspondence of 90% or above between phone and paper data. The most common error that occurred was summing the total number of visits and/or activities across the five household activity indicators. Few supervised home visits were recorded in either system and there was no evidence of the team leader following up on the automatic notifications received on their cell phones. CONCLUSIONS: The evaluation emphasizes the need for regular supervision for both systems and rigorous and ongoing assessments of data quality for the paper system. Formalization of a mHealth M&E system for PHC outreach teams delivering community based services could offer greater accuracy of M&E and enhance supervision systems for CHWs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Achieving child survival goals: potential contribution of community health workers
Haines, A., Sanders, D., Lehmann, U., Rowe, A. K., Lawn, J. E., Jan, S., Walker, D. G., & Bhutta, Z. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60325-0 · Cited by 911 · cited 1×
“While considering the integration of CHW programs at national level, studies have demonstrated that monitoring and evaluation (M&E), supervision and accountability remain key elements to ensure the effectiveness of CHW services [10,17-19].”
BackgroundScaling Up mHealth: Where Is the Evidence?
Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001382 · Cited by 673 · cited 1×
“mHealth is already used for health promotion, education and awareness, adherence to chronic medication [25,26], the collection of surveillance data [23], and also in community-based CHW programmes [27,28].”
BackgroundCommunity Health Workers and Mobile Technology: A Systematic Review of the Literature
Braun, R., Catalani, C., Wimbush, J., & Israelski, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065772 · Cited by 493 · cited 2×
“Thus, CHWs can produce accurate data, better record keeping and also use mHealth to save time to provide quality care [4,35,36].”
BackgroundGlenton, C., Colvin, C., Carlsen, B., Swartz, A., Lewin, S., Noyes, J., & Rashidian, A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010414.pub2 · Cited by 454 · cited 1×
“community’s health [5], and act as an interface between the community and the health system [6].”
BackgroundThe use of mobile phones as a data collection tool: A report from a household survey in South Africa
Tomlinson, M., Solomon, W., Singh, Y., Doherty, T., Chopra, M., Ijumba, P., Tsai, A. C., & Jackson, D. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-51 · Cited by 340 · cited 3×
“Similar to findings in the literature [20-24], the results indicate that the CHWs have struggled with the paper M&E, irrespective of the introduction of the phones.”
BackgroundResultSelf-citation1 million community health workers in sub-Saharan Africa by 2015
Singh, P., & Sachs, J. D. (2013) · The Lancet · doi:10.1016/s0140-6736(12)62002-9 · Cited by 267
Lane, S. J., Heddle, N. M., Arnold, E., & Walker, I. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-23 · Cited by 208
Leon, N., Schneider, H., & Daviaud, E. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-123 · Cited by 200 · cited 1×
“mHealth is already used for health promotion, education and awareness, adherence to chronic medication [25,26], the collection of surveillance data [23], and also in community-based CHW programmes [27,28].”
BackgroundSelf-citation
Research works printed but not linked: 25
- Ingram M, Sabo S, Rothers J, Wennerstrom A, de Zapien JG: Community health workers and community advocacy: addressing health disparities. J Commun Health. 2008, 33 (6): 417-424. 10.1007/s10900-008-9111-y. · DOI
- van Ginneken N, Lewin S, Berridge V: The emergence of community health worker programmes in the late apartheid era in South Africa: a historical analysis. Soc Sci Med. 2010, 71 (6): 1110-1118. 10.1016/j.socscimed.2010.06.009. · DOI
- Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, Odgaard-Jensen J, Johansen M, Aja GN, Zwarenstein M: Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010, 3: CD004015-
- Ingram M, Reinschmidt KM, Schachter KA, Davidson CL, Sabo SJ, De Zapien JG, Carvajal SC: Establishing a professional profile of community health workers: results from a national study of roles, activities and training. J Commun Health. 2012, 37 (2): 529-537. 10.1007/s10900-011-9475-2. · DOI
- Bhutta ZA, Chopra M, Axelson H, Berman P, Boerma T, Bryce J, Bustreo F, Cavagnero E, Cometto G, Daelmans B: Countdown to 2015 decade report (2000–10): taking stock of maternal, newborn, and child survival. Lancet. 2010, 375 (9730): 2032-2044. 10.1016/S0140-6736(10)60678-2. · DOI · Paper page
- Bhutta ZA, Lassi ZS, Pariyo G, Huicho L: Global Experience of Community Health Workers for Delivery of Health Related Millennium Development Goals: a Systematic Review, Country Case Studies, and Recommendations for Integration into National Health Systems. 2010, Geneva, Switzerland: Global Health Workforce Alliance
- Lehmann U, Sanders D: Community Health Workers: What Do We Know About Them. 2007, Geneva: World Health Organization
- The Partnership for Maternal, Newborn & Child Health: A Global Review of the Key Interventions Related to Reproductive, Maternal, Newborn and Child Health (RMNCH). 2011, Geneva, Switzerland: PMNCH
- Kidane G, Morrow RH: Teaching mothers to provide home treatment of malaria in Tigray, Ethiopia: a randomised trial. Lancet. 2000, 356 (9229): 550-555. 10.1016/S0140-6736(00)02580-0. · DOI · Paper page
- Koenig SP, Leandre F, Farmer PE: Scaling-up HIV treatment programmes in resource-limited settings: the rural Haiti experience. Aids. 2004, 18: S21-S25. 10.1097/00002030-200406003-00005. · DOI · Paper page
- Sazawal S, Black RE: Effect of pneumonia case management on mortality in neonates, infants, and preschool children: a meta-analysis of community-based trials. Lancet Infect Dis. 2003, 3 (9): 547-556. 10.1016/S1473-3099(03)00737-0. · DOI · Paper page
- UNICEF: Committing to Child Survival: A Promise Renewed Progress Report 2013. Edited by: Anthony D, Mullerbeck E. 2013, New York: UNICEF
- United Nations: Millennium Development Goals Indicators, Maternal Mortality Ratio, South Africa. 2012, United Nationals
- Rowe AK, Onikpo F, Lama M, Deming MS: The rise and fall of supervision in a project designed to strengthen supervision of integrated management of childhood illness in Benin. Health Policy Plann. 2010, 25 (2): 125-134. 10.1093/heapol/czp054. · DOI
- Walt G, Perera M, Heggenhougen K: Are large-scale volunteer community health worker programmes feasible? The case of Sri Lanka. Soc Sci Med. 1989, 29 (5): 599-608. 10.1016/0277-9536(89)90179-2. · DOI
- Agarwal M, Bourgeois J, Sodhi S, Matengeni A, Bezanson K, van Schoor V, van Lettow M: Updating a patient-level ART database covering remote health facilities in Zomba district, Malawi: lessons learned. PHA. 2013, 3 (2): 175-179. · DOI
- Clarke M, Schoeman H, Friedman I: Towards a Generic Surveillance System to Measure the Impact of Community Health Worker Programmes in South Africa: A Comparison of Paper-Based and Mobile/Cell Phone Methods. 2007, Durban, South Africa: Health Systems Trust
- Ogunmefun C, Friedman I, Mothibe N: Electronic Community Care Giver (CCG) Study: A Formative Evaluation of the Implementation of an Electronic Monitoring and Evaluation Solution for CCG Programmes. 2010, Durban, South Africa: Health Systems Trust
- Shozi NA, Pottas D, Mostert-Phipps N: Perceived benefits of remote data capturing in community home-based care: the caregivers’ perspective. Journal of Community Informatics. 2013, 9 (2): · doi:10.15353/joci.v9i2.3176
- Brath H, Morak J, Kästenbauer T, Modre‒Osprian R, Strohner‒Kästenbauer H, Schwarz M, Kort W, Schreier G: Mobile health (mHealth) based medication adherence measurement–a pilot trial using electronic blisters in diabetes patients. Br J Clin Pharmacol. 2013, 76 (S1): 47-55. · DOI · Paper page
- Leon N, Schneider H: MHealth4CBS in South Africa: A Review of the Role of Mobile Phone Technology for Monitoring and Evaluation of Community Based Health Services. 2012, Cape Town: Medical Research Council and University of Western Cape
- Mechael P, Batavia H, Kaonga N, Searle S, Kwan A, Goldberger A, Fu L, Ossman J: Barriers and Gaps Affecting mHealth in Low and Middle Income Countries: Policy White Paper. 2010, New York: Columbia University. Earth institute. Center for global health and economic development (CGHED): with mHealth alliance
- Municipal Demarcation Board: State Municipal Capacity Assessment 2010/2011: National Trends in Municipal Capacity. 2012, Pretoria: Municipal Demarcation Board
- Bernabe-Ortiz A, Curioso WH, Gonzales MA, Evangelista W, Castagnetto JM, Carcamo CP, Hughes JP, Garcia PJ, Garnett GP, Holmes KK: Handheld computers for self-administered sensitive data collection: a comparative study in Peru. BMC Med Inform Decis Mak. 2008, 8 (1): 11-10.1186/1472-6947-8-11. · DOI · Paper page
- Qiang CZ, Yamamichi M, Hausman V, Altman D, Unit IS: Mobile Applications for The Health Sector. 2011, Washington: World Bank
Cited by
Odendaal, W. A., Anstey Watkins, J., Leon, N., Goudge, J., Griffiths, F., Tomlinson, M., & Daniels, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942.pub2 · Cited by 289
“Neupane 2014 Neupane S, Odendaal W, Friedman I, Jassat W, Schneider H, Doherty T. Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation.”
BackgroundSelf-citationAbaza, H., & Marschollek, M. (2017) · Methods of Information in Medicine · doi:10.3414/me17-05-0003 · Cited by 138
“App solutions were used to provide information exchange between healthcare providers [183, 26], deliver video and image instructions to patients [29], and support CHWs in recording household data and managing referrals [27].”
BackgroundMethodBalakrishnan, R., Gopichandran, V., Chaturvedi, S., Chatterjee, R., Mahapatra, T., & Chaudhuri, I. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0326-z · Cited by 116
“cantly improved data transfer accuracy compared to the paper based system [13].”
BackgroundMethodSaif‐Ur‐Rahman, K., Islam, M. S., Alaboson, J., Ola, O., Hasan, I., Islam, N., Mainali, S., Martina, T., Silenga, E., Muyangana, M., et al. (2023) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12547 · Cited by 56
“34,43,46,60,61 On average, 65.7% of EHR recorded diagnostic accuracy.”
Influential
Metadata
- Authors
- Neupane, S., Odendaal, W., Friedman, I., Jassat, W., Schneider, H., & Doherty, T.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2014-08-09
- Volume
- 14
- Issue
- 1
- Pages
- 69-69
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W2050943305
- Cited by
- 41
- References
- 9
- FWCI
- 5.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation. https://app.cochat.ai/papers/10.1186/1472-6947-14-69
- The paper
- Neupane, S., Odendaal, W., Friedman, I., Jassat, W., Schneider, H., & Doherty, T. (2014). Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-14-69
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.