SMS versus voice messaging to deliver MNCH communication in rural Malawi: assessment of delivery success and user experience
Open accessAbstract
OBJECTIVE: To determine the difference in delivery success of health messages delivered through pushed SMS, pushed voice messages sent to personal phones, and voice messages retrieved from a community phone ("retrieved voice messaging"), as well as the difference in quality of the user experience. METHODS: We analyzed the project's electronic monitoring data between September 2011 and June 2013, including demographics, enrollment data, and messages sent and successfully delivered. We also collected and analyzed information from quarterly phone-based surveys with users to assess quality of the user experience, including acceptability, comprehension, new information learned, and reported behavior change. RESULTS: More than half of subscribers enrolled in the retrieved voice messaging service while nearly one-third enrolled in the pushed SMS service and less than 10% in pushed voice messaging. Message delivery success was highest among pushed SMS subscribers and lowest among retrieved voice subscribers. Overall, 99% of survey respondents reported trusting messages they received, and about 75% of respondents recalled the last message they received and learned something new. Almost 75% of respondents reported that they had already changed or intended to change their behavior based on received messages. Intended or actual behavior change was significantly higher among pushed SMS enrollees than among pushed or retrieved voice messaging enrollees (P = .01). CONCLUSION: All message modalities led to high levels of satisfaction, comprehension, and new information learned. Due to lower cost, higher delivery success, and higher levels of intended or actual behavior change, SMS is the preferred delivery modality. However, the majority of users included in this study did not have access to a personal phone, and retrieved voice messages provided an opportunity to access a population that otherwise could not be served. Providing multiple methods by which users could access the service was crucial in extending reach beyond literate personal phone owners.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Mobile messaging is cost effective to implement and is rated highest for achieving favourable outcomes in health programmes.
“Mobile messaging has been cited to be cost effective to implement, and is rated highest for achieving favourable outcomes in health programmes [42–44].”
From mHealth communication to strengthen postnatal care in rural areas: a systematic review (2019) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766 · see citing works
Text messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190 · see citing works
Free, C., Phillips, G., Felix, L., Galli, L., Patel, V., & Edwards, P. (2010) · BMC Research Notes · doi:10.1186/1756-0500-3-250 · Cited by 539 · see citing works
Tamrat, T., & Kachnowski, S. (2012) · Maternal and Child Health Journal · doi:10.1007/s10995-011-0836-3 · Cited by 312 · see citing works
Lund, S., Hemed, M., Nielsen, B., Said, A., Said, K., Makungu, M., & Rasch, V (2012) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2012.03413.x · Cited by 228 · see citing works
Heterogeneous Mobile Phone Ownership and Usage Patterns in Kenya
Wesolowski, A., Eagle, N., Noor, A. M., Snow, R. W., & Buckee, C. O. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035319 · Cited by 216 · see citing works
Pilot evaluation of the text4baby mobile health program
Evans, W. D., Wallace, J. L., & Snider, J. W. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-1031 · Cited by 207 · see citing works
Improvement of maternal health services through the use of mobile phones
Noordam, A. C., Kuepper, B. M., Stekelenburg, J., & Milen, A. (2011) · Tropical Medicine & International Health · doi:10.1111/j.1365-3156.2011.02747.x · Cited by 174 · see citing works
Piecing Together the Maternal Death Puzzle through Narratives: The Three Delays Model Revisited
Thorsen, V. C., Sundby, J., & Malata, A. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052090 · Cited by 136 · see citing works
Application of smart phone in "Better Border Healthcare Program": A module for mother and child care
Kaewkungwal, J., Singhasivanon, P., Khamsiriwatchara, A., Sawang, S., Meankaew, P., & Wechsart, A. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-69 · Cited by 126 · see citing works
Cormick, G., Kim, N. A., Rodgers, A., Gibbons, L., Buekens, P. M., Belizán, J. M., & Althabe, F. (2012) · Reproductive Health · doi:10.1186/1742-4755-9-9 · Cited by 118 · see citing works
Sharma, R., Hebbal, M. I., Ankola, A. V., & Murugabupathy, V. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.110416 · Cited by 72 · see citing works
Greaney, M. L., Puleo, E., Sprunck‐Harrild, K., Bennett, G. G., Cunningham, M. A., Gillman, M. W., Coeling, M., & Emmons, K. M. (2012) · Preventive Medicine · doi:10.1016/j.ypmed.2012.05.014 · Cited by 27 · see citing works
Flagged first, then by citations
1 of the 14 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [17]Grameen Foundation. Mobile technology for community health in Ghana: what it is and what Grameen Foundation has learned so far. 2nd edition. Washington (DC): Grameen Foundation; 2012 Available from: http://www.grameenfoundation.org/sites/grameenfoundation.org/files/MOTECH-Lessons-Learned-Sept-2012.pdf
Cited by
Sorted by citations
Watterson, J. L., Walsh, J., & Madeka, I. (2015) · BioMed Research International · doi:10.1155/2015/153402 · Cited by 183 · see citing works
Gowshall, M., & Taylor-Robinson, S. D. (2018) · International Journal of General Medicine · doi:10.2147/ijgm.s157987 · Cited by 143 · see citing works
Posadzki, P., Mastellos, N., Ryan, R. E., Gunn, L. H., Felix, L. M., Pappas, Y., Gagnon, M., Julious, S. A., Xiang, L., Oldenburg, B. F., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009921.pub2 · Cited by 132 · see citing works
eRegistries: Electronic registries for maternal and child health
Frøen, J. F., Myhre, S. L., Frost, M. J., Chou, D., Mehl, G. L., Say, L., Cheng, S., Fjeldheim, I., Friberg, I. K., French, S. D., et al. (2016) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-016-0801-7 · Cited by 94 · see citing works
Oliver-Williams, C., Brown, E., Devereux, S., Fairhead, C., & Holeman, I. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7792 · Cited by 86 · see citing works
Yasmin, F., Banu, B., Zakir, S. M., Sauerborn, R., Ali, L., & Souares, A. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0286-3 · Cited by 75 · see citing works
Hampshire, K., Porter, G., Mariwah, S., Munthali, A., Robson, E., Owusu, S., Abane, A., & Milner, J. (2016) · Health Policy and Planning · doi:10.1093/heapol/czw095 · Cited by 72 · see citing works
Mildon, A., & Sellen, D. (2019) · Journal of Global Health · doi:10.7189/jogh.09.020425 · Cited by 65 · see citing works
Linde, D. S., Korsholm, M., Katanga, J., Rasch, V., Lundh, A., & Andersen, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217485 · Cited by 58 · see citing works
mHealth communication to strengthen postnatal care in rural areas: a systematic review
Mbuthia, F., Reid, M., & Fichardt, A. (2019) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-019-2531-0 · Cited by 57 · see citing works
Krah, E., & de Kruijf, J. G. (2016) · Digital Health · doi:10.1177/2055207616679264 · Cited by 57 · see citing works
mHealth outcomes for pregnant mothers in Malawi: a capability perspective
Nyemba-Mudenda, M., & Chigona, W. (2017) · Information Technology for Development · doi:10.1080/02681102.2017.1397594 · Cited by 55 · see citing works
Hackett, K., Lafleur, C., Nyella, P., Ginsburg, O., Lou, W., & Sellen, D. (2018) · PLOS ONE · doi:10.1371/journal.pone.0199400 · Cited by 50 · see citing works
Yasmin, F., Nahar, N., Banu, B., Ali, L., Sauerborn, R., & Souares, A. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05387-z · Cited by 48 · see citing works
Alam, M., Banwell, C. L., Olsen, A., & Lokuge, K. (2019) · JMIR mhealth and uhealth · doi:10.2196/11842 · Cited by 45 · see citing works
Holeman, I., Evans, J., Kane, D., Grant, L., Pagliari, C., & Weller, D. (2014) · European Journal of Cancer Care · doi:10.1111/ecc.12250 · Cited by 42 · see citing works
Olajubu, A. O., Fajemilehin, B. R., Olajubu, T. O., & Afolabi, B. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238911 · Cited by 43 · see citing works
Yasmin, F., Ali, L., Banu, B., Rasul, F. B., Sauerborn, R., & Souares, A. (2020) · BMC Health Services Research · doi:10.1186/s12913-019-4811-9 · Cited by 37 · see citing works
Hmone, M. P., Dibley, M. J., Li, M., & Alam, A. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0301-8 · Cited by 36 · see citing works
Use of mobile phone for improvement in maternal health: a randomized control trial
Bangal, V. B., Borawake, S. K., Gavhane, S. P., & Aher, K. H. (2017) · International Journal of Reproduction Contraception Obstetrics and Gynecology · doi:10.18203/2320-1770.ijrcog20175260 · Cited by 37 · see citing works
Laidlaw, R., Dixon, D. L., Morse, T., Beattie, T. K., Kumwenda, S., & Mpemberera, G. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0485-6 · Cited by 34 · see citing works
Shan, H., & Li, M. (2017) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-017-1541-z · Cited by 31 · see citing works
LeFevre, A. E., Agarwal, S., Chamberlain, S., Scott, K., Godfrey, A., Chandra, R. K., Singh, A., Shah, N., Dhar, D., Labrique, A. B., et al. (2019) · Trials · doi:10.1186/s13063-019-3369-5 · Cited by 33 · see citing works
Twimukye, A., Naggirinya, A. B., Parkes-Ratanshi, R. M., Kasirye, R. P., Kiragga, A. N., Castelnuovo, B., Wasswa, J., Nabaggala, M. S., Katabira, E. T., Lamorde, M., et al. (2021) · JMIR mhealth and uhealth · doi:10.2196/17418 · Cited by 33 · see citing works
Babalola, S. O., Loehr, C., Oyenubi, O., Akiode, A., & Mobley, A. (2019) · Global Health Science and Practice · doi:10.9745/ghsp-d-19-00066 · Cited by 32 · see citing works
Buildings with persona: Towards effective building-occupant communication
Khashe, S., Lucas, G., Becerik-Gerber, B., & Gratch, J. S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.05.040 · Cited by 34 · see citing works
Pankomera, R., & van Greunen, D. (2018) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/isd2.12019 · Cited by 30 · see citing works
Effect of Two Complementary Mass-Scale Media Interventions on Handwashing with Soap among Mothers
Tidwell, J. B., Gopalakrishnan, A., Lovelady, S., Sheth, E., Unni, A., Wright, R. L., Ghosh, S., & Sidibe, M. (2019) · Journal of Health Communication · doi:10.1080/10810730.2019.1593554 · Cited by 29 · see citing works
Brody, C., Tuot, S., Chhoun, P., Swendenman, D., Kaplan, K. C., & Yi, S. (2018) · Trials · doi:10.1186/s13063-018-2614-7 · Cited by 29 · see citing works
Innovative Healthcare Applications of ICT for Developing Countries
Ariani, A., Koesoema, A. P., & Soegijoko, S. (2017) · Understanding complex systems · doi:10.1007/978-3-319-55774-8_2 · Cited by 28 · see citing works
Lebrun, V., Dulli, L., Alami, S. O., Sidiqi, A., Sultani, A. S., Rastagar, S. H., Halimzai, I., Ahmadzai, S. A. H., & Todd, C. S. (2020) · JMIR mhealth and uhealth · doi:10.2196/17535 · Cited by 24 · see citing works
Maliwichi, P., Chigona, W., & Sowon, K. (2021) · JMIR mhealth and uhealth · doi:10.2196/22653 · Cited by 25 · see citing works
Acharya, A., Cunningham, K., Manandhar, S., Shrestha, N., Chen, M., & Weissman, A. (2020) · Journal of Medical Internet Research · doi:10.2196/17659 · Cited by 23 · see citing works
Voice Keyword Retrieval Method Using Attention Mechanism and Multimodal Information Fusion
Zhang, H. (2021) · Scientific Programming · doi:10.1155/2021/6662841 · Cited by 19 · see citing works
Hmone, M. P., Li, M., Alam, A., & Dibley, M. J. (2017) · JMIR Research Protocols · doi:10.2196/resprot.7679 · Cited by 19 · see citing works
Sowon, K., Maliwichi, P., & Chigona, W. (2021) · JMIR mhealth and uhealth · doi:10.2196/22093 · Cited by 23 · see citing works
Development and evaluation of an application for syphilis control
de Sales, R. O., Dilts, L. M., da Silva, R. M., Brasil, C. C. P., & Filho, J. E. D. V. (2019) · Revista Brasileira de Enfermagem · doi:10.1590/0034-7167-2018-0877 · Cited by 22 · see citing works
Tripathi, V., Arnoff, E., Bellows, B., & Sripad, P. (2020) · mHealth · doi:10.21037/mhealth.2019.12.04 · Cited by 18 · see citing works
Alam, M., Banwell, C. L., & Lokuge, K. (2020) · JMIR mhealth and uhealth · doi:10.2196/17665 · Cited by 18 · see citing works
Fotso, J. C., Bellhouse, L., Vesel, L., & Jezman, Z. (2015) · African Population Studies · doi:10.11564/29-1-717 · Cited by 16 · see citing works
Self-citationGebremariam, K. T., Zelenko, O., Hadush, Z., Mulugeta, A., & Gallegos, D. (2020) · Health Informatics Journal · doi:10.1177/1460458220911779 · Cited by 15 · see citing works
Mobile phone use among female entertainment workers in Cambodia: an observation study
Brody, C., Tatomir, B., Tuot, S., Pal, K., Mengsrun, S., Dionosio, J., Luong, M.-A., & Yi, S. (2017) · mHealth · doi:10.21037/mhealth.2017.01.01 · Cited by 14 · see citing works
Dol, J., Murphy, G. T., Aston, M. L., McMillan, D., & Campbell-Yeo, M. L. (2020) · Women and Birth · doi:10.1016/j.wombi.2020.05.004 · Cited by 13 · see citing works
Acquah-Gyan, E., Acheampong, P. R., Mohammed, A., Adjei, T. K., Agyapong, E., Twumasi-Ankrah, S., Sylverken, A. A., Owusu, M., & Owusu‐Dabo, E. (2022) · PLoS ONE · doi:10.1371/journal.pone.0261806 · Cited by 11 · see citing works
Does Gender and Accent of Voice Matter?
Mubarak, E., Shahid, T., Mustafa, M., & Naseem, M. (2020) · International Conference on Information and Communication Technologies and Development (ICTD) · doi:10.1145/3392561.3397588 · Cited by 8 · see citing works
Baik, D., Reinsma, K., Chhea, C., Oy, S., Heang, H., & Young, M. F. (2022) · Current Developments in Nutrition · doi:10.1093/cdn/nzac045 · Cited by 8 · see citing works
Rothstein, J. D., Klemm, R., Niyeha, D., Smith, E., & Nordhagen, S. (2021) · Public Health Nutrition · doi:10.1017/s1368980020003742 · Cited by 7 · see citing works
Read, G. L., Yan, H. Y., Anderson, P. B., Partain, L. P. B., Vaughn, Z., Semivolos, A., Kim, Y., & Gonzales, A. L. (2021) · Information Communication & Society · doi:10.1080/1369118x.2021.1928263 · Cited by 7 · see citing works
Ehlman, D. C., Magoola, J., Tanifum, P., Wallace, A. S., Behumbiize, P., Mayanja, R., Luzze, H., Yukich, J. O., Daniels, D. S., Mugenyi, K., et al. (2020) · JMIR Research Protocols · doi:10.2196/17262 · Cited by 6 · see citing works
Fotso, J. C., Robinson, A. L., Noordam, A. C., & Crawford, J. (2015) · African Population Studies · doi:10.11564/29-1-713 · Cited by 7 · see citing works
Self-citationCell phones and CHWs: a transformational marriage?
(2014) · Global Health Science and Practice · doi:10.9745/ghsp-d-14-00007 · Cited by 7 · see citing works
Abajobir, A. A., de Groot, R., Wainaina, C., Pradhan, M., Janssens, W., & Sidze, E. (2024) · Health Policy and Planning · doi:10.1093/heapol/czae079 · Cited by 6 · see citing works
Chaney, S. C., & Mechael, P. (2023) · Journal of Medical Internet Research · doi:10.2196/47713 · Cited by 6 · see citing works
Pervin, J., Sarker, B. K., Nu, U. T., Khatun, F., Rahman, A. M., Venkateswaran, M., Rahman, A. M., Frøen, J. F., & Friberg, I. K. (2021) · BMC Public Health · doi:10.1186/s12889-021-10811-y · Cited by 3 · see citing works
Towards a Framework on the Use of Infomediaries in Maternal mHealth in Rural Malawi
Maliwichi, P., & Chigona, W. (2022) · Interdisciplinary Journal of Information Knowledge and Management · doi:10.28945/5015 · Cited by 3 · see citing works
Validation of Mobile Messages for an mHealth Intervention for Smokeless Tobacco Cessation in India
Lahoti, S., Panda, R., Prabhu, R. R., Das, S., Patro, S. K., & Nazareth, I. (2023) · Asian Pacific Journal of Cancer Prevention · doi:10.31557/apjcp.2023.24.12.4011 · Cited by 3 · see citing works
Fotso, J. C., & TSUI, A. O. (2015) · African Population Studies · doi:10.11564/29-1-712 · Cited by 3 · see citing works
Kalbarczyk, A., Saksena, K., Carras, M. C., Gomes, I., Zon, J., Zhou, X., & Agarwal, S. (2025) · BMC Digital Health · doi:10.1186/s44247-025-00231-y · Cited by 2 · see citing works
Higgins‐Steele, A., Noordam, A. C., Crawford, J., & Fotso, J. C. (2015) · African Population Studies · doi:10.11564/29-1-715 · Cited by 2 · see citing works
Self-citationEffectiveness of SMS text messaging to improve exclusive breastfeeding in Mekelle, Ethiopia
Gebremariam, K. T. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.205813 · Cited by 1 · see citing works
Data capture and analysis to assess impact of carbon credit schemes
Rhode, M., RANA, O. F., & Edwards, T. (2017) · ORCA Online Research @Cardiff (Cardiff University)
Ogawa, K., Kawakatsu, Y., Kadoi, N., Balogun, O. O., Adesina, A. O., Iwayemi, V. O., & Aiga, H. (2021) · doi:10.2196/preprints.35692
Mbuthia, F. W., Reid, M., & Fichardt, A. (2022) · Journal of Community Health Nursing · doi:10.1080/07370016.2022.2028064
Ogawa, K., Kawakatsu, Y., Kadoi, N., Balogun, O. O., Adesina, A. O., Iwayemi, V. O., & Aiga, H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275855
Factors motivating maternal healthcare clients to use mHealth interventions in rural Malawi
Maliwichi, P., Chigona, W., & Malata, A. M. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000805
Atukunda, E. C., Mugyenyi, G. R., Haberer, J. E., Nghiem, V. T. H., Atuhumuza, E., Waiswa, P., Musiimenta, A., Kanyesigye, M., Obua, C., Siedner, M. J., et al. (2026) · medRxiv · doi:10.64898/2026.04.28.26351943
Pal, V., Kumar, I. S., Barua, K., Gohar, M., Srivastava, S., Mahajan, H., Singh, N. P., Chaudhary, R., Bansal, T., Gupta, T., et al. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-15008-w
- Authors
- Crawford, J., Larsen-Cooper, E., Jezman, Z., Cunningham, S. C., & Bancroft, E.
- Affiliations
- VillageReach (US)
- Corresponding author
- Crawford, Jessica
- Venue
- Global Health: Science and Practice
- Published
- 2014-01-28
- Volume
- 2
- Issue
- 1
- Pages
- 35-46
- ISSN
- 2169-575X (ISSN-L)
- PMC
- PMC4168599
- OpenAlex
- W2099019068
- Cited by
- 69
- References
- 14
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 1 · 2023: 2 · 2022: 5 · 2021: 7 · 2020: 14 · 2019: 8 · 2018: 4 · 2017: 10 · 2016: 6 · 2015: 5 · 2014: 2
- FWCI
- 13.88
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Global Health Science and Practice (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Information Systems › ICT in Developing Communities
- Social Sciences › Health › Social Media in Health Education
- Keywords
- mobile health, SMS, voice mail, user experience, behavior change, rural Malawi, digital divide
- MeSH terms
- Communication, Health Education, Humans, Malawi, Maternal Health Services, Surveys and Questionnaires, Rural Health Services, Access to Information, Information Dissemination, Cell Phone, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
