Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
While mobile phones have found broad application in reporting health, financial, and environmental data, there has been little study of the possible errors incurred during mobile data collection. This paper provides the first (to our knowledge) quantitative evaluation of data entry accuracy on mobile phones in a resource-poor setting. Via a study of 13 users in Gujarat, India, we evaluated three user interfaces: 1) electronic forms, containing numeric fields and multiple-choice menus, 2) SMS, where users enter delimited text messages according to printed cue cards, and 3) voice, where users call an operator and dictate the data in real-time. Our results indicate error rates (per datum entered) of 4.2% for electronic forms, 4.8% for SMS, and 0.45% for voice. These results caused us to migrate our own initiative (a tuberculosis treatment program in rural India) from electronic forms to voice, in order to avoid errors on critical health data. While our study has some limitations, including varied backgrounds and training of participants, it suggests that some care is needed in deploying electronic interfaces in resource-poor settings. Further, it raises the possibility of using voice as a low-tech, high-accuracy, and cost-effective interface for mobile data collection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lane, S. J., Heddle, N. M., Arnold, E., & Walker, I. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-23 · Cited by 208
Evaluation of use of cellphones to aid compliance with drug therapy for HIV patients
Skinner, D., Rivette, U., & Bloomberg, C. (2007) · AIDS Care · doi:10.1080/09540120701203378 · Cited by 40 · cited 1×
“Cell-Life employs electronic forms on mobile phones to improve TB and HIV treatment in South Africa [13], [33].”
Background
Cited by
The Ins and Outs of HCI for Development
Dell, N., & Kumar, N. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858081 · Cited by 254
Marcano Belisario, J. S., Jamsek, J., Huckvale, K., O'Donoghue, J., Morrison, C. P., & Car, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000042.pub2 · Cited by 211
User Interface Design for Low-literate and Novice Users: Past, Present and Future
Medhi Thies, I. (2015) · Foundations and Trends in Human–Computer Interaction · doi:10.1561/1100000047 · Cited by 83
Mobile health data collection at primary health care in Ethiopia: a feasible challenge
Medhanyie, A. A., Moser, A., Spigt, M., Yebyo, H., Little, A., Dinant, G., & Blanco, R. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.09.006 · Cited by 77
Using mobile phone text messaging for malaria surveillance in rural Kenya
Githinji, S., Kigen, S., Memusi, D., Nyandigisi, A., Wamari, A., Muturi, A., Jagoe, G., Ziegler, R., Snow, R. W., & Zurovac, D. (2014) · Malaria Journal · doi:10.1186/1475-2875-13-107 · Cited by 53
“Inaccurate data can compromise the benefits of mobile phone SMS-based reporting, potentially leading to significant misallocation of resources [18].”
Background
Metadata
- Authors
- Patnaik, S., Brunskill, E., & Thies, W.
- Venue
- 2009 International Conference on Information and Communication Technologies and Development (ICTD)
- Publisher
- IEEE
- Published
- 2009-04
- Pages
- 74-84
- OpenAlex
- W3150306987
- Cited by
- 71
- References
- 2
- FWCI
- 2.74
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice. https://app.cochat.ai/papers/10.1109/ictd.2009.5426700
- The paper
- Patnaik, S., Brunskill, E., & Thies, W. (2009). Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice. 2009 International Conference on Information and Communication Technologies and Development (ICTD). https://doi.org/10.1109/ictd.2009.5426700
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.