Assessing the quality and usability of smartphone apps for pain self-management
Abstract
OBJECTIVE: To evaluate smartphone apps intended for self-management of pain using quality assessment criteria and usability testing with prospective users. DESIGN: 1) Survey and content analysis of available apps; and 2) individual usability study of two apps. SETTING: University of Leeds, United Kingdom. PARTICIPANTS: Forty-one participants (aged 19-59 years) with experience of chronic or recurrent pain episodes. METHODS: We undertook a survey, content analysis, and quality appraisal of all currently available mobile phone apps for self-management of pain. Two apps were then selected and assessed with usability testing. RESULTS: Twelve apps met the inclusion criteria. The quality assessment revealed wide variation in their clinical content, interface design, and usability to support self-management of pain. Very little user or clinician involvement was identified in the development of the apps. From the usability testing, participants stated a preference for an interface design employing a lighter color scheme and particular text font. Although very few participants were aware of pain-reporting apps prior to participation, many would consider use in the future. CONCLUSIONS: Variation in app quality and a lack of user and clinician engagement in development were found across the pain apps in this research. Usability testing identified a range of user preferences. Although useful information was obtained, it would be beneficial to involve users earlier in the process of development, as well as establishing ways to merge end user requirements with evidence-based content, to provide high-quality and usable apps for self-management of pain.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The majority of available smartphone applications marketed for chronic pain do not follow evidence-based guidelines, do not involve health care providers or experts in development, and have not undergone scientific studies of effect or validity.
“Overall, the findings show that the majority of available applications do not follow evidence-based guidelines, do not involve health care providers or experts in the development process, and have not undergone any scientific studies of effect and/or validity.”
From ACTsmart: Guided Smartphone-Delivered Acceptance and Commitment Therapy for Chronic Pain—A Pilot Trial. (2021) · cites this paper as [34]
One significant challenge is the lack of guidance and involvement of health care providers and intended users in the development process.
“One significant challenge is the lack of guidance and involvement of health care providers and intended users in the development process [21,27,32-37].”
From A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO (2020) · cites this paper as [36]
The lack of user involvement (patients and health care providers) and human centeredness in development of eHealth interventions have been criticized repeatedly.
“The lack of user involvement (ie, patients and health care providers) and human centeredness in development of eHealth interventions have been criticized repeatedly [5,21,27,32,34,36,39], and this lack of user involvement in the development process can potentially also explain the high attrition rates and low adherence associated with such interventions [32,40-42].”
From A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO (2020) · cites this paper as [36]
Cites
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
Psychological therapies for the management of chronic pain (excluding headache) in adults
Williams, A. C. D. C., Eccleston, C., & Morley, S. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007407.pub3 · Cited by 1,634 · see citing works
Torrance, N., Smith, B. H., Bennett, M., & Lee, A. J. (2006) · Journal of Pain · doi:10.1016/j.jpain.2005.11.008 · Cited by 1,001 · see citing works
Self-citationImproving a human-computer dialogue
Molich, R., & Nielsen, J. (1990) · Communications of the ACM · doi:10.1145/77481.77486 · Cited by 821 · see citing works
Patrick, K., Griswold, W. G., Raab, F., & Intille, S. S. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.05.001 · Cited by 479 · see citing works
Smartphone applications for pain management
Rosser, B. A., & Eccleston, C. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.101102 · Cited by 364 · see citing works
Benefits of and barriers to involving users in medical device technology development and evaluation
Shah, S. G. S., & Robinson, I. (2007) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462307051677 · Cited by 299 · see citing works
Apps for asthma self-management: a systematic assessment of content and tools
Huckvale, K., Car, M., Morrison, C. P., & Car, J. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-144 · Cited by 252 · see citing works
Ryan, D., Price, D., Musgrave, S. D., Malhotra, S., Lee, A. J., Ayansina, D., Sheikh, A., Tarassenko, L., Pagliari, C., & Pinnock, H. (2012) · BMJ · doi:10.1136/bmj.e1756 · Cited by 197 · see citing works
Palmier‐Claus, J. E., Ainsworth, J. D., Machin, M., Barrowclough, C., Dunn, G., Barkus, E., Rogers, A. E., Wykes, T., Kapur, S., Buchan, I. E., et al. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-172 · Cited by 189 · see citing works
Kirwan, M., Duncan, M. J., Vandelanotte, C., & Mummery, W. K. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1950 · Cited by 189 · see citing works
Innovation in practice: mobile phone technology in patient care
Blake, H. (2008) · British Journal of Community Nursing · doi:10.12968/bjcn.2008.13.4.29024 · Cited by 154 · see citing works
Chronic widespread pain predicts physical inactivity: Results from the prospective EPIFUND study
McBeth, J., Nicholl, B. I., Cordingley, L., Davies, K. A., & Macfarlane, G. J. (2010) · European Journal of Pain · doi:10.1016/j.ejpain.2010.03.005 · Cited by 91 · see citing works
Usability testing of mobile ICT for clinical settings: Methodological and practical challenges
Svanæs, D., Alsos, O. A., & Dahl, Y. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.06.014 · Cited by 80 · see citing works
Appropriating Heuristic Evaluation for Mobile Computing
Bertini, E., Catarci, T., Dix, A. J., Gabrielli, S., Kimani, S., & Santucci, G. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009010102 · Cited by 68 · see citing works
Hanna, L., May, C. R., & Fairhurst, K. (2011) · Family Practice · doi:10.1093/fampra/cmr087 · Cited by 63 · see citing works
Appropriating Heuristic Evaluation Methods for Mobile Computing
Bertini, E., Catarci, T., Dix, A. J., Gabrielli, S., Kimani, S., & Santucci, G. (2008) · IGI Global eBooks · doi:10.4018/978-1-59904-871-0.ch046 · Cited by 31 · see citing works
The benefits of mobile apps for patients and providers
Moore, J. T. (2012) · British Journal of Healthcare Management · doi:10.12968/bjhc.2012.18.9.465 · Cited by 15 · see citing works
Dempster, P., Bewick, B. M., Jones, R., & Bennett, M. (2012) · Health Informatics Journal · doi:10.1177/1460458212445341 · Cited by 11 · see citing works
Self-citationPain Control in Palliative Care
Simon, C. (2008) · InnovAiT Education and inspiration for general practice · doi:10.1093/innovait/inn034 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585 · see citing works
Evaluating mobile phone applications for health behaviour change: A systematic review
McKay, F. H., Cheng, C. C., Wright, A., Shill, J., Stephens, H., & Uccellini, M. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16673538 · Cited by 367 · see citing works
Lalloo, C., Jibb, L. A., Rivera, J., Agarwal, A., & Stinson, J. N. (2015) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000171 · Cited by 257 · see citing works
Akbar, S., Coiera, E. W., & Magrabi, F. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz175 · Cited by 246 · see citing works
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · see citing works
The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment
Chen, J., Cade, J. E., & Allman-Farinelli, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4334 · Cited by 219 · see citing works
Unertl, K. M., Schaefbauer, C. L., Campbell, T. R., Senteio, C., Siek, K. A., Bakken, S., & Veinot, T. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv094 · Cited by 198 · see citing works
Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps
Jake-Schoffman, D. E., Silfee, V. J., Waring, M. E., Boudreaux, E. D., Sadasivam, R. S., Mullen, S. P., Carey, J. L., Hayes, R. B., Ding, E. Y., Bennett, G. G., et al. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8758 · Cited by 165 · see citing works
Benefits of mobile apps in pain management: Systematic review
Thurnheer, S. E., Gravestock, I., Pichierri, G., Steurer, J., & Burgstaller, J. M. (2018) · JMIR mHealth and uHealth · doi:10.2196/11231 · Cited by 160 · see citing works
Systematic Review of Mobile Health Applications in Rehabilitation
Nussbaum, R., Kelly, C. J., Quinby, E., Mac, A., Parmanto, B., & Dicianno, B. E. (2018) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2018.07.439 · Cited by 163 · see citing works
Challenges in Assessing Mobile Health App Quality
Grundy, Q. H., Wang, Z., & Bero, L. A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.07.009 · Cited by 154 · see citing works
Usability in telemedicine systems—A literature survey
Klaassen, B., van Beijnum, B.-J. F., & Hermens, H. J. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.004 · Cited by 152 · see citing works
McKay, F. H., Slykerman, S., & Dunn, M. (2018) · JMIR mhealth and uhealth · doi:10.2196/11130 · Cited by 117 · see citing works
A design and evaluation framework for digital health interventions
Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019) · it - Information Technology · doi:10.1515/itit-2019-0019 · Cited by 118 · see citing works
Scott, I. A., Scuffham, P., Gupta, D., Harch, T. M., Borchi, J., & Richards, B. (2018) · Australian Health Review · doi:10.1071/ah18064 · Cited by 120 · see citing works
Mobile health app usability and quality rating scales: a systematic review
Azad‐Khaneghah, P., Neubauer, N., Cruz, A. M., & Liu, L. (2020) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2019.1701103 · Cited by 119 · see citing works
Pfeifer, A.-C., Uddin, R., Schröder‐Pfeifer, P., Holl, F., Swoboda, W. J., & Schiltenwolf, M. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9113557 · Cited by 108 · see citing works
Subhi, Y., Bube, S. H., Bojsen, S. R., Thomsen, A. S. S., & Konge, L. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4169 · Cited by 93 · see citing works
Mobile applications for pain management: an app analysis for clinical usage
Zhao, P., Yoo, I., Lancey, R., & Varghese, E. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0827-7 · Cited by 93 · see citing works
Commercially Available Smartphone Apps to Support Postoperative Pain Self-Management: Scoping Review
Lalloo, C., Shah, U. J., Birnie, K. A., Davies-Chalmers, C., Rivera, J., Stinson, J., & Campbell, F. A. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8230 · Cited by 89 · see citing works
Infant Feeding Websites and Apps: A Systematic Assessment of Quality and Content
Taki, S., Campbell, K. J., Russell, C. G., Elliott, R. M., Laws, R., & Denney‐Wilson, E. (2015) · Interactive Journal of Medical Research · doi:10.2196/ijmr.4323 · Cited by 89 · see citing works
Muro-Culebras, A., Escriche-Escuder, A., Martín‐Martín, J., Roldán‐Jiménez, C., De-Torres, I., Ruiz‐Muñoz, M., González‐Sánchez, M., Mayoral, F., Biró, A., Tang, W. J., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/15433 · Cited by 82 · see citing works
Jamison, R. N., Jurcik, D. C., Edwards, R. R., Huang, C.-C., & Ross, E. L. (2017) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000455 · Cited by 83 · see citing works
Treatment of Low Back Pain with a Digital Multidisciplinary Pain Treatment App: Short-Term Results
Huber, S., Priebe, J. A., Baumann, K.-M., Plidschun, A., Schießl, C., & Tölle, T. R. (2017) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.9032 · Cited by 79 · see citing works
Patients’ Needs and Requirements for eHealth Pain Management Interventions: Qualitative Study
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Mirkovic, J., Børøsund, E., Haaland-Øverby, M., Heldal, K., Schreurs, K. M., Waxenberg, L. B., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13205 · Cited by 80 · see citing works
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/15889 · Cited by 80 · see citing works
An overview on the emerging area of identification, characterization, and assessment of health apps
Paglialonga, A., Lugo, A., & Santoro, E. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.05.017 · Cited by 77 · see citing works
Flaherty, S. J., McCarthy, M. B., Collins, A., & McAuliffe, F. M. (2017) · Public Health Nutrition · doi:10.1017/s1368980017002889 · Cited by 76 · see citing works
Moshi, M. R., Tooher, R. L., & Merlin, T. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646231800051x · Cited by 74 · see citing works
Hensher, M., Cooper, P., Dona, S. W. A., Angeles, M. R., Nguyen, D., Heynsbergh, N., Chatterton, M. L., & Peeters, A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab041 · Cited by 80 · see citing works
Suso-Ribera, C., Castilla, D., Zaragozá, I., Ribera-Canudas, M. V., Botella, C., & García-Palacios, A. (2018) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000618 · Cited by 73 · see citing works
Integration of Mobile Health Technology in the Treatment of Chronic Pain: A Critical Review
Sundararaman, L. V., Edwards, R. R., Ross, E. L., & Jamison, R. N. (2017) · Regional Anesthesia and Pain Medicine · doi:10.1097/aap.0000000000000621 · Cited by 72 · see citing works
Rabbi, M., Aung, M. H., Gay, G. K., Reid, M. C., & Choudhury, T. (2018) · Journal of Medical Internet Research · doi:10.2196/10147 · Cited by 67 · see citing works
App Chronic Disease Checklist: Protocol to Evaluate Mobile Apps for Chronic Disease Self-Management
Anderson, K., Burford, O., & Emmerton, L. (2016) · JMIR Research Protocols · doi:10.2196/resprot.6194 · Cited by 65 · see citing works
Ross, E. L., Jamison, R. N., Nicholls, L., Perry, B. M., & Nolen, K. D. (2020) · Journal of Medical Internet Research · doi:10.2196/16939 · Cited by 62 · see citing works
Lazaridou, A., Elbaridi, N., Edwards, R. R., & Berde, C. B. (2018) · Elsevier eBooks · doi:10.1016/b978-0-323-40196-8.00005-x · Cited by 60 · see citing works
Jamison, R. N., Mei, A., & Ross, E. L. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16679049 · Cited by 57 · see citing works
Fischer, F., & Kleen, S. (2020) · Journal of Medical Internet Research · doi:10.2196/17691 · Cited by 55 · see citing works
Alamoodi, A., Garfan, S., Zaidan, B. B., Zaidan, A., Shuwandy, M. L., Alaa, M., Alsalem, M., Mohammed, A., Aleesa, A. M., Albahri, O., et al. (2020) · Health technology · doi:10.1007/s12553-020-00451-4 · Cited by 51 · see citing works
Quality and Usability of Arthritic Pain Self-Management Apps for Older Adults: A Systematic Review
Vandersman, P., Newton-John, T. R. O., & Phillips, J. L. (2017) · Pain Medicine · doi:10.1093/pm/pnx090 · Cited by 52 · see citing works
Apps and Mobile Health Technology in Rehabilitation
Ramey, L. N., Osborne, C. L., Kasitinon, D., & Juengst, S. B. (2019) · Physical Medicine and Rehabilitation Clinics of North America · doi:10.1016/j.pmr.2018.12.001 · Cited by 54 · see citing works
Supporting the Self-Management of Chronic Pain Conditions with Tailored Momentary Self-Assessments
Adams, P., Murnane, E. L., Elfenbein, M., Wethington, E., & Gay, G. K. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025832 · Cited by 52 · see citing works
Metelmann, B., Metelmann, C., Schuffert, L., Hahnenkamp, K., & Brinkrolf, P. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9651 · Cited by 49 · see citing works
Adams, A. T., Murnane, E. L., Adams, P., Elfenbein, M., Chang, P. F., Sannon, S., Gay, G. K., & Choudhury, T. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174076 · Cited by 48 · see citing works
Smartphone applications for chronic pain management: A critical appraisal
Alexander, J., & Joshi, G. (2016) · Journal of Pain Research · doi:10.2147/jpr.s119966 · Cited by 47 · see citing works
Mobile applications to enhance self-management of gout
Nguyen, A., Baysari, M. T., Kannangara, D. R. W., Tariq, A., Lau, A. Y. S., Westbrook, J. I., & Day, R. O. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.021 · Cited by 44 · see citing works
Amann, J., Fiordelli, M., Brach, M., Bertschy, S., Scheel-Sailer, A., & Rubinelli, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/18018 · Cited by 44 · see citing works
Quality of Smartphone Apps Related to Panic Disorder
Van Singer, M., Chatton, A., & Khazaal, Y. (2015) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2015.00096 · Cited by 43 · see citing works
Pain Detection using a Smartphone in Real Time
Kong, Y., Posada-Quintero, H. F., & Chon, K. H. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176077 · Cited by 39 · see citing works
Leveraging Multi-Modal Sensing for Mobile Health: A Case Review in Chronic Pain
Aung, M. H., Alquaddoomi, F., Hsieh, C.-K., Rabbi, M., Yang, L., Pollak, J., Estrin, D. L., & Choudhury, T. (2016) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2565381 · Cited by 38 · see citing works
Wu, J. Y., Tombor, I., Shahab, L., & West, R. (2017) · Digital Health · doi:10.1177/2055207617704273 · Cited by 33 · see citing works
Nordstoga, A. L., Bach, K., Sani, S., Wiratunga, N., Mork, P. J., Villumsen, M., & Cooper, K. (2020) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/18729 · Cited by 30 · see citing works
Quality of Smartphone Apps Related to Alcohol Use Disorder
Penzenstadler, L. E., Chatton, A., Singer, M. V., & Khazaal, Y. (2016) · European Addiction Research · doi:10.1159/000449097 · Cited by 33 · see citing works
Bedson, J., Hill, J., White, D., Chen, Y., Wathall, S., Dent, S., Cooke, K., & van der Windt, D. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0741-z · Cited by 31 · see citing works
Pain relief in the palm of your hand: Harnessing mobile health to manage pediatric pain
Hunter, J. F., Kain, Z. N., & Fortier, M. A. (2018) · Pediatric Anesthesia · doi:10.1111/pan.13547 · Cited by 32 · see citing works
A Biofeedback App for Migraine: Development and Usability Study
Ingvaldsen, S. H., Tronvik, E., Brenner, E., Winnberg, I. G., Olsen, A., Gravdahl, G. B., & Stubberud, A. (2021) · JMIR Formative Research · doi:10.2196/23229 · Cited by 31 · see citing works
Shah, U. E. M., & Chiew, T. K. (2019) · Symmetry · doi:10.3390/sym11030400 · Cited by 31 · see citing works
Engaging Teens with Asthma in Designing a Patient-Centered Mobile App to Aid Disease Self-Management
Schneider, T., Panzera, A. D., Couluris, M., Lindenberger, J. H., McDermott, R. J., & Bryant, C. A. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0041 · Cited by 30 · see citing works
Evaluation of a mobile application to support HIV self-testing in Johannesburg, South Africa
Gous, N. M., Fischer, A. E., Rhagnath, N., Phatsoane, M., Majam, M., & Lalla‐Edward, S. T. (2020) · Southern African Journal of HIV Medicine · doi:10.4102/sajhivmed.v21i1.1088 · Cited by 30 · see citing works
Woulfe, F., Fadahunsi, K. P., Smith, S. D., Chirambo, G. B., Larsson, E. E. C., Henn, P., Mawkin, M., & Donoghue, J. O. (2021) · JMIR mhealth and uhealth · doi:10.2196/28384 · Cited by 30 · see citing works
Bulaj, G. (2014) · Frontiers in Neurology · doi:10.3389/fneur.2014.00126 · Cited by 29 · see citing works
User-Centric Design Methodology for mHealth Apps: The PainApp Paradigm for Chronic Pain
Koumpouros, Y. (2022) · Technologies · doi:10.3390/technologies10010025 · Cited by 27 · see citing works
Sulaiman, S. K., Wong, A. Y. L., Li, L. L., Antwi‐Afari, M. F., Ou, H., & Tsang, H. W. H. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104937 · Cited by 26 · see citing works
Singh, G., MacGillivray, M. K., Mills, P. B., Adams, J. R., Sawatzky, B., & Mortenson, W. B. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1487-y · Cited by 26 · see citing works
Current Status of Cardiovascular Disease-Related Smartphone Apps Downloadable in China
Xiao, Q., Lu, L., Wang, Y., Sun, L., & Wu, Y. X. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2016.0083 · Cited by 24 · see citing works
Johnson, S. S., Levesque, D. A., Broderick, L. E., Bailey, D. G., & Kerns, R. D. (2017) · JMIR Medical Informatics · doi:10.2196/medinform.7117 · Cited by 23 · see citing works
Gentili, C., Zetterqvist, V., Rickardsson, J., Holmström, L., Simons, L. E., & Wicksell, R. K. (2021) · Pain Medicine · doi:10.1093/pm/pnaa360 · Cited by 20 · see citing works
Mann, D., Riddell, L. J., Lim, K., Byrne, L. K., Nowson, C. A., Rigo, M., Szymlek‐Gay, E. A., & Booth, A. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4300 · Cited by 23 · see citing works
Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors
Constantinescu, G., Kuffel, K., King, B., Hodgetts, W. E., & Rieger, J. (2018) · Health Informatics Journal · doi:10.1177/1460458218766574 · Cited by 22 · see citing works
Hein, H. J., Glombiewski, J. A., Rief, W., & Riecke, J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060020 · Cited by 21 · see citing works
van Gaalen, J. L., van Bodegom‐Vos, L., Bakker, M. J., Snoeck-Stroband, J. B., & Sont, J. K. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010809 · Cited by 19 · see citing works
Almeida, A. F., Rocha, N. P., & Silva, A. G. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17030785 · Cited by 18 · see citing works
Adler, R. F., Baez, K., Morales, P., Sotelo, J., Victorson, D. E., & Magasi, S. R. (2024) · JMIR Human Factors · doi:10.2196/51522 · Cited by 22 · see citing works
Ben-Mussa, A., & Paget, A. M. (2016) · Health Informatics Journal · doi:10.1177/1460458216664193 · Cited by 17 · see citing works
Constructing an assessment framework for the quality of asthma smartphone applications
Guan, Z., Sun, L., Xiao, Q., & Wang, Y. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0923-8 · Cited by 17 · see citing works
Jamison, R. N., Xu, X., Wan, L., Edwards, R. R., & Ross, E. L. (2019) · The Journal of Pain · doi:10.1016/j.jpain.2018.09.005 · Cited by 16 · see citing works
Patient reported postoperative pain with a smartphone application: A proof of concept
Thiel, B., Godfried, M. B., van Huizen, E. C., Mooijer, B. C., de Boer, B. A., van Mierlo, R. A. A. M., van Os, J., Geerts, B. F., & Kalkman, C. J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0232082 · Cited by 16 · see citing works
The Use of Robotic Technology in the Healthcare of People above the Age of 65—A Systematic Review
Leonardsen, A. L., Hardeland, C., Helgesen, A. K., Bååth, C., Busso, L. A. D., & Grøndahl, V. A. (2023) · Healthcare · doi:10.3390/healthcare11060904 · Cited by 15 · see citing works
Pain Management Mobile Applications: A Systematic Review of Commercial and Research Efforts
Koumpouros, Y., & Γεωργούλας, Ά. (2023) · Sensors · doi:10.3390/s23156965 · Cited by 15 · see citing works
Experiment design of free pregnancy monitoring mobile personal health records quality evaluation
Idri, A., Bachiri, M., Fernández‐Alemán, J. L., & Toval, A. (2016) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2016.7749501 · Cited by 15 · see citing works
Cummins, K. M., Brumback, T., Chung, T. A., Moore, R. C., Henthorn, T., Eberson, S., Lopez, A., Sarkissyan, T., Nooner, K. B., Brown, S. A., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/24472 · Cited by 15 · see citing works
Wathne, H. B., Morken, I. M., Storm, M., & Husebø, A. M. L. (2022) · JMIR Human Factors · doi:10.2196/39391 · Cited by 13 · see citing works
Paglialonga, A., Pinciroli, F., & Tognola, G. (2017) · American Journal of Audiology · doi:10.1044/2017_aja-16-0132 · Cited by 12 · see citing works
Tiozzo, E., Fondi, S., Biagioli, V., Piccinelli, E., Alibrandi, F., Gawronski, O., Dall’Oglio, I., Margarella, E., Piga, S., Ricci, R., et al. (2020) · Journal of Pediatric Oncology Nursing · doi:10.1177/1043454220975443 · Cited by 12 · see citing works
Batalas, N., Rot, M. A. H., Khan, V.-J., & Markopoulos, P. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3179428 · Cited by 12 · see citing works
Mobile Applications for Allergic Rhinitis
Zhou, A. H., Patel, V. R., Baredes, S., Eloy, J. A., & Hsueh, W. D. (2018) · Annals of Otology Rhinology & Laryngology · doi:10.1177/0003489418798385 · Cited by 11 · see citing works
Optimizing smartphone intervention features to improve chronic disease management: A rapid review
Gomolin, A., Lebouché, B., Engler, K., & Vedel, I. (2019) · Health Informatics Journal · doi:10.1177/1460458219891377 · Cited by 12 · see citing works
Oudbier, S. J., Smets, E. M. A., Nieuwkerk, P. T., Neal, D. P., Nurmohamed, A. S., Meij, H. J., & Peute, L. (2024) · JMIR Medical Informatics · doi:10.2196/63703 · Cited by 13 · see citing works
Lang, E. V., Jackson, W., Senn, P., Aroni, D. K. K., Finkelman, M., Corino, T. A., Conway, G., & Kulich, R. J. (2021) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207144.2021.1883988 · Cited by 11 · see citing works
Quintana, Y., Fahy, D., Abdelfattah, A. M., Henao, J., & Safran, C. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0907-8 · Cited by 11 · see citing works
Badshah, S., Khan, A. A., Hussain, S., & Khan, B. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10099-x · Cited by 11 · see citing works
The mHealth Applications Usability Evaluation Review
Ansaar, M. Z., Hussain, J., Bang, J., Lee, S., Shin, K. Y., & Woo, K. Y. (2020) · International Conference on Information Networking · doi:10.1109/icoin48656.2020.9016509 · Cited by 10 · see citing works
Koumpouros, Y. (2021) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3453892.3461350 · Cited by 10 · see citing works
Aspira: Employing a serious game in an mHealth app to improve asthma outcomes
Thomson, J., Hass, C. J., Horn, I. B., Kleine, E., Mitchell, S., Gary, K. A., Ahmed, I., Hamel, D., & Amresh, A. (2017) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah.2017.7939268 · Cited by 10 · see citing works
Taylor, S., Allsop, M. J., Shaw, J., Bennett, M., Jones, R. N., & Bewick, B. M. (2015) · Pain Medicine · doi:10.1111/pme.12811 · Cited by 9 · see citing works
Self-citationYates, E., Buckley, L., Sterling, M. M., Cruwys, T., Ashton-James, C. E., Rankin, R., & Elphinston, R. A. (2022) · JMIR Formative Research · doi:10.2196/41211 · Cited by 9 · see citing works
Using Chronic Pain Outcomes Data to Improve Outcomes
Mehta, N. D., Inturrisi, C. E., Horn, S. D., & Witkin, L. R. (2016) · Anesthesiology Clinics · doi:10.1016/j.anclin.2016.01.009 · Cited by 9 · see citing works
Anderson, J., Pollitt, E., Crowley, J., Holbrook, D. S., & Draughon, J. E. (2020) · Journal of American College Health · doi:10.1080/07448481.2019.1705839 · Cited by 9 · see citing works
Mobile Health Apps That Act as Surgical Preparatory Guides: App Store Search and Quality Evaluation
Gadde, N. S., & Yap, K. Y. (2021) · JMIR Perioperative Medicine · doi:10.2196/27037 · Cited by 8 · see citing works
An approach towards development of evaluation framework for usability of smartphone applications
Rahmat, H., Zulzalil, H. B., Ghani, A., & Kamaruddin, A. (2015) · Malaysian Software Engineering Conference (MySEC) · doi:10.1109/mysec.2015.7475217 · Cited by 8 · see citing works
- Authors
- Reynoldson, C., Stones, C., Allsop, M., Gardner, P., Bennett, M. I., Closs, S. J., Jones, R., & Knapp, P.
- Affiliations
- University of Leeds (GB)
- University of York (GB)
- Corresponding author
- Knapp, Peter
- Venue
- Pain Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-06
- Volume
- 15
- Issue
- 6
- Pages
- 898-909
- ISSN
- 1526-2375 (ISSN-L)
- 1526-4637
- OpenAlex
- W1600431780
- Cited by
- 178
- References
- 21
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 14 · 2023: 4 · 2022: 10 · 2021: 18 · 2020: 26 · 2019: 20 · 2018: 25 · 2017: 14 · 2016: 20 · 2015: 12 · 2014: 2
- FWCI
- 28.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Pain Medicine (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute for Health and Care Research (RP-PG-0610-10114)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- mobile application, pain self-management, app quality assessment, usability testing, chronic pain, recurrent pain, interface design, user preferences, mobile health
- MeSH terms
- Adult, Data Collection, Female, Humans, Male, Middle Aged, Self Care, Software Design, Telemedicine, Cell Phone, Young Adult, Pain Management, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
