Sticky apps, not sticky hands: A systematic review and content synthesis of hand hygiene mobile apps
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Objective: The study sought to identify smartphone apps that support hand hygiene practice and to assess their content, technical and functional features, and quality. A secondary objective was to make design and research recommendations for future apps. Materials and Methods: We searched the UK Google Play and Apple App stores for hand hygiene smartphone apps aimed at adults. Information regarding content, technical and functional features was extracted and summarized. Two raters evaluated each app, using the IMS Institute for Healthcare Informatics functionality score and the Mobile App Rating Scale (MARS). Results: A total of 668 apps were identified, with 90 meeting the inclusion criteria. Most (96%) were free to download. The majority (78%) intended to educate or inform or remind users to hand wash (69%), using behavior change techniques such as personalization and prompting practice. Only 20% and 4% named a best practice guideline or had expert involvement in development, respectively. Innovative means of engagement were used in 42% (eg, virtual or augmented reality or geolocation-based reminders). Apps included an average of 2.4 out of 10 of the IMS functionality criteria (range, 0-8). The mean MARS score was 3.2 ± 0.5 out of 5, and 68% had a minimum acceptability score of 3. Two had been tested or trialed. Conclusions: Although many hand hygiene apps exist, few provide content on best practice. Many did not meet the minimum acceptability criterion for quality or were formally trialed or tested. Research should assess the feasibility and effectiveness of hand hygiene apps (especially within healthcare settings), including when and how they “work.” We recommend that future apps to support hand hygiene practice are developed with infection prevention and control experts and align with best practice. Robust research is needed to determine which innovative methods of engagement create “sticky” apps.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Why Don't Physicians Follow Clinical Practice Guidelines?: A Framework for Improvement
Cabana, M. D., Rand, C. S., Powe, N. R., Wu, A. W., Wilson, M. H., Abboud, P.-A. C., & Rubin, H. R. (1999) · JAMA · doi:10.1001/jama.282.15.1458 · Cited by 6,677
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171
Systematic Review of Studies on Compliance with Hand Hygiene Guidelines in Hospital Care
Erasmus, V., Daha, T. J., Brug, H., Richardus, J. H., Behrendt, M. D., Vos, M. C., & van Beeck, E. F. (2010) · Infection Control & Hospital Epidemiology · doi:10.1086/650451 · Cited by 1,114
Evaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Interventions to improve hand hygiene compliance in patient care
Gould, D. J., Moralejo, D., Drey, N., Chudleigh, J. H., & Taljaard, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005186.pub4 · Cited by 663
Edwards, E. A., Lumsden, J., Rivas, C., Steed, L., Edwards, L. A., Thiyagarajan, A., Sohanpal, R., Caton, H., Griffiths, C. J., Munafò, M. R., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012447 · Cited by 446
Hand hygiene: Back to the basics of infection control
Mathur, P. (2011) · Indian Journal of Medical Research · doi:10.4103/0971-5916.90985 · Cited by 372
Internet interventions: In review, in use, and into the future.
Ritterband, L. M., Gonder-Frederick, L. A., Cox, D. J., Clifton, A. D., West, R. W., & Borowitz, S. M. (2003) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.34.5.527 · Cited by 352
Bardus, M., van Beurden, S. B., Smith, J. R., & Abraham, C. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0359-9 · Cited by 350
Luangasanatip, N., Hongsuwan, M., Limmathurotsakul, D., Lubell, Y., Lee, A. S., Harbarth, S., Day, N. P. J., Graves, N., & Cooper, B. S. (2015) · BMJ · doi:10.1136/bmj.h3728 · Cited by 330
A systematic review of hand hygiene improvement strategies: a behavioural approach
Huis, A., van Achterberg, T., de Bruin, M., Grol, R., Schoonhoven, L., & Hulscher, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-92 · Cited by 267
Erasmus, V., Brouwer, W., van Beeck, E. F., Oenema, A., Daha, T. J., Richardus, J. H., Vos, M. C., & Brug, J. (2009) · Infection Control & Hospital Epidemiology · doi:10.1086/596773 · Cited by 267
Masterson Creber, R. M., Maurer, M. S., Reading, M., Hiraldo, G., Hickey, K. T., & Iribarren, S. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5882 · Cited by 249
Hand Hygiene Compliance in the ICU: A Systematic Review
Lambe, K. A., Lydon, S., Madden, C., Vellinga, A., Hehir, A., Walsh, M., & O’Connor, P. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003868 · Cited by 197
Experimental pretesting of hand-washing interventions in a natural setting
Judah, G., Aunger, R., Schmidt, W.-P., Michie, S., Granger, S., & Curtis, V. (2009) · American Journal of Public Health · doi:10.2105/ajph.2009.164160 · Cited by 196
DUGAS, M. A., Gao, G. G., & Agarwal, R. (2020) · Digital Health · doi:10.1177/2055207620905411 · Cited by 179
Taj, F., Klein, M. C. A., & van Halteren, A. (2019) · JMIR mHealth and uHealth · doi:10.2196/13311 · Cited by 173
Twenty-four-hour observational study of hospital hand hygiene compliance
Randle, J., Arthur, A., & Vaughan, N. (2010) · Journal of Hospital Infection · doi:10.1016/j.jhin.2010.06.027 · Cited by 161
Quality of Publicly Available Physical Activity Apps: Review and Content Analysis
Bondaronek, P., Alkhaldi, G., Slee, A., Hamilton, F. L., & Murray, E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9069 · Cited by 156
Smartphone Applications to Support Sleep Self-Management: Review and Evaluation
Choi, Y. K., Demiris, G., Lin, S.-Y., Iribarren, S. J., Landis, C. A., Thompson, H. J., McCurry, S. M., Heitkemper, M. M., & Ward, T. M. (2018) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7396 · Cited by 156
Grainger, R., Townsley, H., White, B., Langlotz, T., & Taylor, W. J. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6956 · Cited by 145
A systematic review on hand hygiene knowledge and compliance in student nurses
Labrague, L. J., McEnroe–Petitte, D. M., van de Mortel, T., & Nasirudeen, A. M. A. (2017) · International Nursing Review · doi:10.1111/inr.12410 · Cited by 127
Kim, B. Y., Sharafoddini, A., Tran, N., Wen, E. Y., & Lee, J. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8613 · Cited by 125
Infection Prevention in the Emergency Department
Liang, S. Y., Theodoro, D. L., Schuur, J. D., & Marschall, J. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.02.024 · Cited by 120
Doronina, O., Jones, D., Martello, M., Biron, A. D., & Lavoie‐Tremblay, M. (2017) · Journal of Nursing Scholarship · doi:10.1111/jnu.12274 · Cited by 101
Commercially Available Smartphone Apps to Support Postoperative Pain Self-Management: Scoping Review
Lalloo, C., Shah, U., Birnie, K. A., Davies-Chalmers, C., Rivera, J., Stinson, J., & Campbell, F. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8230 · Cited by 91
Assessing hand hygiene compliance among healthcare workers in six Intensive Care Units
Musu, M., Lai, A., Mereu, N. M., Galletta, M., Campagna, M., Tidore, M., Piazza, M. F., Spada, L., Massidda, M. V., Colombo, S., et al. (2016) · Journal of preventive medicine and hygiene · doi:10.15167/2421-4248/jpmh2017.58.3.674 · Cited by 84
Evans, E. W., & Redmond, E. C. (2018) · Journal of Food Protection · doi:10.4315/0362-028x.jfp-17-378 · Cited by 68
Hand hygiene adherence is influenced by the behavior of role models
Schneider, J., Moromisato, D. Y., Zemetra, B., Rizzi-Wagner, L., Rivero, N., Mason, W. H., Imperial-Perez, F., & Ross, L. A. (2009) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e3181a32f16 · Cited by 66
Interventions to improve hand hygiene compliance in emergency departments: a systematic review
Seo, H., Sohng, K.-Y., Chang, S. O., Chaung, S., Won, J., & Choi, M.-J. (2019) · Journal of Hospital Infection · doi:10.1016/j.jhin.2019.03.013 · Cited by 57
Approaches to hand hygiene monitoring: From low to high technology approaches
Masroor, N., Doll, M. E., Stevens, M., & Bearman, G. M. (2017) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2017.09.031 · Cited by 50
Schnall, R., & Iribarren, S. (2015) · American Journal of Infection Control · doi:10.1016/j.ajic.2015.01.021 · Cited by 46
Observation of Hand Hygiene Practices in Home Health Care
McDonald, M. V., Brickner, C., Russell, D., Dowding, D., Larson, E., Trifilio, M., Bick, I., Sridharan, S., Song, J., Adams, V., et al. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2020.07.031 · Cited by 45
Self-citationSamyoun, S., Shubha, S. S., Mondol, A. S., & Stankovic, J. A. (2020) · Smart Health · doi:10.1016/j.smhl.2020.100171 · Cited by 37
Lawson, A., & Vaganay, M. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16245036 · Cited by 33
Digital manikins to self‐report pain on a smartphone: A systematic review of mobile apps
Ali, S. M., Lau, W. J., McBeth, J., Dixon, W. G., & van der Veer, S. N. (2020) · European Journal of Pain · doi:10.1002/ejp.1688 · Cited by 32
Self-citationAssessment of Real-World Use of Behavioral Health Mobile Applications by a Novel Stickiness Metric
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., Strong, M. A., & Areán, P. A. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.11978 · Cited by 31
Healthcare workers' perceptions and acceptance of an electronic reminder system for hand hygiene
Blomgren, P., Lytsy, B., Hjelm, K., & Swenne, C. L. (2020) · Journal of Hospital Infection · doi:10.1016/j.jhin.2020.12.005 · Cited by 30
Review of technologies available to improve hand hygiene compliance – are they fit for purpose?
Dawson, C., & Mackrill, J. (2014) · Journal of Infection Prevention · doi:10.1177/1757177414548695 · Cited by 25
Taneja, J., & Mishra, B. (2015) · Journal of Patient Safety & Infection Control · doi:10.1016/j.jpsic.2015.11.004 · Cited by 11
Usability of Hand Hygiene Observation Apps
Sivek, A., Sparnon, E., & Tremoulet, P. D. (2019) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857919081066 · Cited by 5
Localization of the SureWash Pocket® mobile health app to Brazilian Portuguese
Baggio, É., Valim, M. D., Barbosa, S. D. F. F., Sasso, G. T. M. D., & Lacey, G. (2020) · Revista gaúcha de enfermagem · doi:10.1590/1983-1447.2020.20190462 · Cited by 3
Research works printed but not linked: 2
- Michie, 2013, Encyclopedia of Behavioural Medicine
- Price, 2019, Investigating the effect of short daily hand hygiene practice on achieving proficiency: a prospective cohort study, Antimicrob Resist Infect Control, 8, 156
Cited by
Gasteiger, N., van der Veer, S. N., Wilson, P. M., & Dowding, D. (2021) · JMIR Serious Games · doi:10.2196/31644 · Cited by 127
Self-citationEichel, V. M., Brandt, C., Brandt, J., Jabs, J., & Mutters, N. T. (2022) · Antimicrobial Resistance and Infection Control · doi:10.1186/s13756-022-01127-6 · Cited by 50
Gasteiger, N., Dowding, D., Norman, G., McGarrigle, L., Eost‐Telling, C., Jones, D. J., Vercell, A., Ali, S. M., & O’Connor, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073283 · Cited by 44
Self-citationVercell, A., Gasteiger, N., Yorke, J., & Dowding, D. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104931 · Cited by 36
Self-citationGasteiger, N., van der Veer, S. N., Wilson, P. M., & Dowding, D. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-050033 · Cited by 37
Self-citation
Metadata
- Authors
- Gasteiger, N., Dowding, D., Ali, S. M., Scott, A. J. S., Wilson, P., & van der Veer, S. N.
- Affiliations
- University of Manchester (GB)
- University of Huddersfield (GB)
- Division of Informatics, Imaging and Data Sciences, Centre for Health Informatics, University of Manchester, Manchester, United Kingdom
- Corresponding author
- Gasteiger, Norina
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-06-28
- Volume
- 28
- Issue
- 9
- Pages
- 2027-2038
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC8363789
- OpenAlex
- W3166180214
- Cited by
- 26
- References
- 49
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 5 · 2023: 8 · 2022: 6 · 2021: 2
- FWCI
- 1.08
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- Huddersfield Research Portal (University of Huddersfield) (publishedVersion, other-oa)
- Funders
- National Institute for Health Research Applied Research Collaboration
- the National Institute for Health Research or the Department of Health and Social Care
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Infectious Diseases › Infection Control in Healthcare
- Social Sciences › Health › Social Media in Health Education
- Keywords
- hand hygiene, mobile health apps, mobile application, infection control, app quality, behaviour change techniques, user engagement, app functionality, nosocomial infections
- MeSH terms
- Delivery of Health Care, Health Facilities, Informatics, Hand Hygiene, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.