Acceptability and Potential Effectiveness of eHealth Tools for Training Primary Health Workers From Nigeria at Scale: Mixed Methods, Uncontrolled Before-and-After Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Background: The in-service training of frontline health workers (FHWs) in primary health care facilities plays an important role in improving the standard of health care delivery. However, it is often expensive and requires FHWs to leave their posts in rural areas to attend courses in urban centers. This study reports the implementation of a digital health tool for providing video training (VTR) on maternal, newborn, and child health (MNCH) care to provide in-service training at scale without interrupting health services. The VTR intervention was supported by satellite communications technology and existing 3G mobile networks. Objective: This study aims to determine the feasibility and acceptability of these digital health tools and their potential effectiveness in improving clinical knowledge, attitudes, and practices related to MNCH care. Methods: A mixed methods design, including an uncontrolled pre- and postquantitative evaluation, was adopted. From October 2017 to May 2018, a VTR mobile intervention was delivered to FHWs in 3 states of Nigeria. We examined changes in workers’ knowledge and confidence in delivering MNCH services through a pre- and posttest survey. Stakeholders’ experiences with the intervention were explored through semistructured interviews that drew on the technology acceptance model to frame contextual factors that shaped the intervention’s acceptability and usability in the work environment. Results: In total, 328 FHWs completed both pre- and posttests. FHWs achieved a mean pretest score of 51% (95% CI 48%-54%) and mean posttest score of 69% (95% CI 66%-72%), reflecting, after adjusting for key covariates, a mean increase between the pre- and posttest of 17 percentage points (95% CI 15-19; P<.001). Variation was identified in pre- and posttest scores by the sex and location of participants alongside topic-specific areas where scores were lowest. Stakeholder interviews suggested a wide acceptance of VTR Mobile (delivered via digital technology) as an important tool for enhancing the quality of training, reinforcing knowledge, and improving health outcomes. Conclusions: This study found that VTR supported through a digital technology approach is a feasible and acceptable approach for supporting improvements in clinical knowledge, attitudes, and reported practices in MNCH. The determinants of technology acceptance included ease of use, perceived usefulness, access to technology and training contents, and the cost-effectiveness of VTR, whereas barriers to the adoption of VTR were poor electricity supply, poor internet connection, and FHWs’ workload. The evaluation also identified the mechanisms of the impact of delivering VTR Mobile at scale on the micro (individual), meso (organizational), and macro (policy) levels of the health system. Future research is required to explore the translation of this digital health approach for the VTR of FHWs and its impact across low-resource settings to ameliorate the financial and time costs of training and support high-quality MNCH care delivery. Trial Registration: ISRCTN Registry 32105372; https://www.isrctn.com/ISRCTN32105372
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Qualitative Data Analysis for Applied Policy Research
Ritchie, J., & Spencer, L. (2002) · The Qualitative Researcher's Companion · doi:10.4135/9781412986274.n12 · Cited by 905
E-learning in medical education in resource constrained low- and middle-income countries
Frehywot, S., Vovides, Y., Talib, Z., Mikhail, N., Ross, H., Wohltjen, H., Bedada, S., Korhumel, K., Koumare, A. K., & Scott, J. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-4 · Cited by 559
Agarwal, S., Perry, H. B., Long, L., & Labrique, A. B. (2015) · Tropical Medicine & International Health · doi:10.1111/tmi.12525 · Cited by 498
Lee, S. H., Nurmatov, U. B., Nwaru, B. I., Mukherjee, M., Grant, L., & Pagliari, C. (2016) · Journal of Global Health · doi:10.7189/jogh.06.010401 · Cited by 456 · cited 4×
“Furthermore, this project is an example of thriving public-private partnerships between the government and local technology companies to develop digital health initiatives in Sub-Saharan Africa with initial financial inputs, technical know-how, and operational efficiency to ensure long-term adoption of digital health…”
InfluentialBest practices in scaling digital health in low and middle income countries
Labrique, A. B., Wadhwani, C., Williams, K. A., Lamptey, P., Hesp, C., Luk, R., & Aerts, A. (2018) · Globalization and Health · doi:10.1186/s12992-018-0424-z · Cited by 449
Gh, G. (1966) · PubMed · Cited by 414
Portz, J. D., Bayliss, E. A., Bull, S., Boxer, R. S., Bekelman, D. B., Gleason, K., & Czaja, S. (2019) · Journal of Medical Internet Research · doi:10.2196/11604 · Cited by 313
Watterson, J. L., Walsh, J., & Madeka, I. (2015) · BioMed Research International · doi:10.1155/2015/153402 · Cited by 183
Bongaarts, J. (2016) · Population and Development Review · doi:10.1111/padr.12033 · Cited by 164
E-Learning for Medical Education in Sub-Saharan Africa and Low-Resource Settings: Viewpoint
Barteit, S., Jahn, A., Banda, S. S., Bärnighausen, T., Bowa, A. C., Chileshe, G., Guzek, D., Jorge, M. M., Lüders, S., Malunga, G., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/12449 · Cited by 151
Long, L.-A., Pariyo, G., & Kallander, K. (2018) · Global Health: Science and Practice · doi:10.9745/ghsp-d-18-00167 · Cited by 148 · cited 1×
“This study also addresses earlier calls for studies with larger sample sizes, more quantitative methods of evaluation, and exploration of implementation at scale while assessing the effectiveness of digital health approaches to train health care professionals in resource-limited countries [29-32].”
BackgroundBias in Before–After Studies: Narrative Overview for Anesthesiologists
Ho, A. M. ‐., Phelan, R., Mizubuti, G. B., Murdoch, J. A. C., Wickett, S., Ho, A. K., Shyam, V., & Gilron, I. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002705 · Cited by 116
Campbell, J. I., Aturinda, I., Mwesigwa, E., Burns, B., Santorino, D., Haberer, J. E., Bangsberg, D. R., Holden, R. J., Ware, N. C., & Siedner, M. J. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1765-y · Cited by 105
Rahman, A., Akhtar, P., Hamdani, S. U., Atif, N., Nazir, H., Uddin, I., Nisar, A., Huma, Z., Maselko, J., Sikander, S., et al. (2019) · Global Mental Health · doi:10.1017/gmh.2019.7 · Cited by 99
Strengthening Delivery of Health Services Using Digital Devices
Orton, M., Agarwal, S., Muhoza, P., Vasudevan, L., & Vu, A. (2018) · Global Health Science and Practice · doi:10.9745/ghsp-d-18-00229 · Cited by 94
Digital Health and Health Systems of the Future
Labrique, A., Vasudevan, L., Mehl, G., Rosskam, E., & Hyder, A. A. (2018) · Global Health: Science and Practice · doi:10.9745/ghsp-d-18-00342 · Cited by 83
Lee, S., Cho, Y.-M., & Kim, S. (2017) · Globalization and Health · doi:10.1186/s12992-017-0286-9 · Cited by 80
Abejirinde, I. O., Ilozumba, O., Marchal, B., Zweekhorst, M. B. M., & Dieleman, M. A. (2018) · International Journal of Care Coordination · doi:10.1177/2053434518779491 · Cited by 73
Sangoshthi: Empowering Community Health Workers through Peer Learning in Rural India
Yadav, D., Singh, P., Montague, K., Kumar, V., Sood, D., Balaam, M., Sharma, D., Duggal, M., Bartindale, T., Varghese, D., et al. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052624 · Cited by 66
Winters, N., Langer, L., Nduku, P. M., Robson, J., O’Donovan, J., Maulik, P. K., Paton, C., Geniets, A., Peiris, D., & Nagraj, S. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2019-001421 · Cited by 64
O’Donovan, J., Bersin, A., & O’Donovan, C. (2014) · BMJ Innovations · doi:10.1136/bmjinnov-2014-000013 · Cited by 54
Applications of Space Technologies to Global Health: Scoping Review
Dietrich, D., Dekova, R., Davy, S., Fahrni, G., & Geissbühler, A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9458 · Cited by 49
Nkwo, P. O., Lawani, L. O., Ubesie, A. C., Onodugo, V. A., Obu, H. A., & Chinawa, J. M. (2015) · Annals of Medical and Health Sciences Research · doi:10.4103/2141-9248.149778 · Cited by 39
Lee, Jong-Wook, (12 April 1945–22 May 2006), Director-General, World Health Organization, since 2003
(2007) · Oxford University Press eBooks · doi:10.1093/ww/9780199540884.013.u44226 · Cited by 29
Ebenso, B., Allsop, M. J., Okusanya, B. O., Akaba, G. O., Tukur, J., Okunade, K. S., Akeju, D. O., Ajepe, A., Dirisu, O., Yalma, R. M., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-022174 · Cited by 23
Self-citationTani, K., Exavery, A., Baynes, C. D., Pemba, S., Hingora, A., Manzi, F., Phillips, J. F., & Kanté, A. M. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1476-5 · Cited by 16
Mobile Health: Precision Post-Operative Wellness Monitoring Solutions
Wickramasinghe, N. S. (2019) · Advances in healthcare information systems and administration book series · doi:10.4018/978-1-7998-1371-2.ch025 · Cited by 1
Peel, I. (2001) · Oxford University Press eBooks · doi:10.1093/gmo/9781561592630.article.47231 · Cited by 1
Research works printed but not linked: 3
- 2019, WHO Guideline Recommendations on Digital Interventions for Health System Strengthening
- Assessing the enabling environment for ICTs for health in Nigeria: a review of policiesUnited Nations Foundation20142021-08-26https://ehealth4everyone.com/wp-content/uploads/2016/01/nigeria-policy-report.pdf
- 2008, R: A Language and Environment for Statistical Computing
Cited by
Alotaibi, N., Wilson, C. B., & Traynor, M. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12663-3 · Cited by 176
Edo, O. C., Ang, D. S., Etu, E.-E., Tenebe, I. T., Edo, S., & Diekola, O. A. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100186 · Cited by 147
Digital Solutions for Community and Primary Health Workers: Lessons From Implementations in Africa
Owoyemi, A., Osuchukwu, J. I., Azubuike, C., Ikpe, R. K., Nwachukwu, B. C., Akinde, C. B., Biokoro, G. W., Ajose, A. B., Nwokoma, E. I., Mfon, N. E., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876957 · Cited by 78
Egwudo, A. E., Jegede, A. O., Oyeniyi, T. A., Ezekwelu, N. J., Abdu-Aguye, S. N., Okwuraiwe, A. P., Onyeaghala, C. A., Ozoude, T. O., Suleiman, M. O., Aziken, G. O., et al. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000928 · Cited by 52
Okuzu, O., Malaga, R. A., Okereafor, K., Amos, U., Dosunmu, A. O., Oyeneyin, A., Adeoye, V., Sambo, M. N., & Ebenso, B. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1008458 · Cited by 46
Self-citation
Metadata
- Authors
- Hicks, J. P., Allsop, M. J., Akaba, G. O., Yalma, R. M., Dirisu, O., Okusanya, B., Tukur, J., Okunade, K., Akeju, D., Ajepe, A., Okuzu, O., Mirzoev, T., & Ebenso, B.
- Affiliations
- University of Leeds (GB)
- University of Abuja (NG)
- University of Lagos (NG)
- Aminu Kano Teaching Hospital (NG)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Allsop, Matthew John
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2021-09-16
- Volume
- 9
- Issue
- 9
- Pages
- e24182
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC8485189
- OpenAlex
- W3192105592
- Cited by
- 26
- References
- 29
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 5 · 2023: 6 · 2022: 4
- FWCI
- 3.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Greater South Information System
- Topics
- Physical Sciences › Computer Science › Information Systems › ICT in Developing Communities
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- video-based training, mobile health, in-service training, frontline health workers, primary care, maternal, newborn and child health, digital health tools, technology acceptance, satellite communication, 3G, acceptability, Nigeria, health professions education, rural health workers, cost-effectiveness, technology adoption barriers, perceived usefulness, ease of use
- MeSH terms
- Child, Child Health Services, Delivery of Health Care, Health Personnel, Humans, Infant, Newborn, Nigeria, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.