The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Acceptability of digital health interventions: embracing the complexity
Open accessAbstract
Acceptability is a core concept in digital health. Available frameworks have not clearly articulated why and how researchers, practitioners and policy makers may wish to study the concept of acceptability. Here, we aim to discuss (i) the ways in which acceptability might differ from closely related concepts, including user engagement; (ii) the utility of the concept of acceptability in digital health research and practice; (iii) social and cultural norms that influence acceptability; and (iv) pragmatic means of measuring acceptability, within and beyond the research process. Our intention is not to offer solutions to these open questions but to initiate a debate within the digital health community. We conducted a narrative review of theoretical and empirical examples from the literature. First, we argue that acceptability may usefully be considered an emergent property of a complex, adaptive system of interacting components (e.g., affective attitude, beliefs), which in turn influences (and is influenced by) user engagement. Second, acceptability is important due to its ability to predict and explain key outcomes of interest, including user engagement and intervention effectiveness. Third, precisely what people find acceptable is deeply contextualized and interlinked with prevailing social and cultural norms. Understanding and designing for such norms (e.g., through drawing on principles of user centered design) is therefore key. Finally, there is a lack of standard acceptability measures and thresholds. Star ratings coupled with free-text responses may provide a pragmatic means of capturing acceptability. Acceptability is a multifaceted concept, which may usefully be studied with a complexity science lens.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561
Sekhon, M., Cartwright, M., & Francis, J. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2031-8 · Cited by 3,938 · cited 6×
“, a smartphone app, an implant, a wearable device), potential users consider whether the intervention fits with their value system (“ethicality”), whether it appears effortful to use (“burden”) and/or whether it appears likely to achieve its purpose (“perceived effectiveness”) [5].”
BackgroundInfluentialGreenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 2×
“At the population level, the failure to implement evidencebased digital health interventions within healthcare or organizational systems is widespread [14].”
BackgroundDisseminating Innovations in Health Care
Berwick, D. M. (2003) · JAMA · doi:10.1001/jama.289.15.1969 · Cited by 1,878
Guidance on how to develop complex interventions to improve health and healthcare
O"Cathain, A., Croot, L., Duncan, E., Rousseau, N., Sworn, K., Turner, K. M., Yardley, L., & Hoddinott, P. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029954 · Cited by 1,591
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Self-citationA Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · cited 2×
“The extent to which interventions are perceived as “acceptable” to patients, family members, treatment providers, institutional review boards and policy makers is central to digital health research and practice [1].”
BackgroundA Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · cited 1×
“At the individual level, we know that people need to engage with digital health interventions for them to be effective [11]; however, engagement tends to be suboptimal [11–13].”
Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810
User Experiences of Social Support From Companion Chatbots in Everyday Contexts: Thematic Analysis
Ta, V., Griffith, C., Boatfield, C., Wang, X., Civitello, M., Bader, H., DeCero, E., & Loggarakis, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16235 · Cited by 561 · cited 1×
“Due to evolving social and cultural norms, however, chatbots underpinned by AI may at present be seen as “uncanny” by the majority of users [25], but commonplace and more widely acceptable in 2030.”
BackgroundFeasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493
Complex Systems Research in Educational Psychology: Aligning Theory and Method
Hilpert, J. C., & Marchand, G. C. (2018) · Educational Psychologist · doi:10.1080/00461520.2018.1469411 · Cited by 325
Technology Acceptance in Mobile Health: Scoping Review of Definitions, Models, and Measurement
Nadal, C., Sas, C., & Doherty, G. (2020) · Journal of Medical Internet Research · doi:10.2196/17256 · Cited by 320
Szinay, D., Jones, A., Chadborn, T., Brown, J., & Naughton, F. (2020) · Journal of Medical Internet Research · doi:10.2196/17572 · Cited by 289 · cited 1×
“In addition, research shows that users tend to rely heavily on “social proof,” including other users’ ratings or recommendations from healthcare professionals, to help navigate which digital health interventions to adopt [26, 27], as these serve as shortcuts”
BackgroundPatients’ views of wearable devices and AI in healthcare: findings from the ComPaRe e-cohort
Tran, V.-T., Riveros, C., & Ravaud, P. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0132-y · Cited by 264
Embracing Chaos and Complexity: A Quantum Change for Public Health
Resnicow, K., & Page, S. E. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.129460 · Cited by 257
Hallingberg, B., Turley, R., Segrott, J., Wight, D., Craig, P., Moore, L., Murphy, S., Robling, M., Simpson, S. A., & Moore, G. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0290-8 · Cited by 248
Validating the Unified Theory of Acceptance and Use of Technology (UTAUT) tool cross-culturally
Oshlyansky, L., Cairns, P., & Thimbleby, H. (2007) · Electronic Workshops in Computing · doi:10.14236/ewic/hci2007.67 · Cited by 203
Tariman, J. D., Berry, D. L., Halpenny, B., Wolpin, S., & Schepp, K. (2011) · Applied Nursing Research · doi:10.1016/j.apnr.2009.04.003 · Cited by 157
Digital navigators to implement smartphone and digital tools in care
Wisniewski, H., & Torous, J. B. (2020) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13149 · Cited by 152
Hirani, S. P., Rixon, L., Beynon, M., Cartwright, M., Cleanthous, S., Selva, A., Sanders, C., & Newman, S. P. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16649531 · Cited by 148
Mills, N., Donovan, J. L., Smith, M., Jacoby, A., Neal, D. E., & Hamdy, F. C. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(03)00020-5 · Cited by 142
Putting the social back into sociotechnical: Case studies of co-design in digital health
Papoutsi, C., Wherton, J., Shaw, S., Morrison, C., & Greenhalgh, T. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa197 · Cited by 126
Perski, O., Blandford, A., Ubhi, H. K., West, R., & Michie, S. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0422-8 · Cited by 123
Self-citationA chaotic view of behavior change: a quantum leap for health promotion.
Resnicow, K., & VAUGHAN, R. D. (2006) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-3-25 · Cited by 117
The treatment acceptability/adherence scale: Moving beyond the assessment of treatment effectiveness
Milosevic, I., Levy, H. C., Alcolado, G. M., & Radomsky, A. S. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1053407 · Cited by 107
Innovative methods for observing and changing complex health behaviors: four propositions
Chevance, G., Perski, O., & Hekler, E. B. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaa026 · Cited by 107
Self-citationEaston, K., Potter, S., Bec, R., Bennion, M., Christensen, H., Grindell, C., Mirheidari, B., Weich, S., de Witte, L., Wolstenholme, D., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12996 · Cited by 88 · cited 1×
“ample, Easton and colleagues co-created an autonomous virtual agent for and with people living with chronic health conditions through a series of co-design workshops [31].”
BackgroundAcceptability of mHealth augmentation of Collaborative Care: A mixed methods pilot study
Bauer, A. M., Iles-Shih, M., Ghomi, R. H., Rue, T. C., Grover, T., Kincler, N., Miller, M., & Katon, W. J. (2017) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2017.11.010 · Cited by 88
Juarascio, A. S., Goldstein, S. P., Manasse, S. M., Forman, E. M., & Butryn, M. L. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.06.004 · Cited by 81
Wakefield, C. E., Sansom-Daly, U. M., McGill, B. C., Ellis, S. J., Doolan, E. L., Robertson, E. G., Mathur, S., & Cohn, R. J. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3077-6 · Cited by 61
Dario, C., Luisotto, E., Pozzo, E. D., Mancin, S., Aletras, V. H., Newman, S. P., Gubian, L., & Saccavini, C. (2016) · International Journal of Integrated Care · doi:10.5334/ijic.2219 · Cited by 54
Simblett, S. K., Bruno, E., Siddi, S., Matcham, F., Giuliano, L., López, J. H., Biondi, A., Curtis, H., Ferrão, J., Polhemus, A., et al. (2019) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2019.05.035 · Cited by 54
AL-Asadi, A. M., Klein, B., & Meyer, D. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2989 · Cited by 53
Poli, A., Kelfve, S., Klompstra, L. V., Strömberg, A., Jaarsma, T., & Motel-Klingebiel, A. (2020) · Journal of Medical Internet Research · doi:10.2196/17884 · Cited by 52
Córdova, D., Alers‐Rojas, F., Lua, F. M., Bauermeister, J. A., Nurenberg, R., Ovadje, L., Fessler, K. B., Delva, J., Salas‐Wright, C. P., & Youth Leadership Council (2016) · Behavioral Medicine · doi:10.1080/08964289.2016.1189396 · Cited by 51
Soucy, J. N., & Hadjistavropoulos, H. D. (2017) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2017.02.002 · Cited by 38
Emotions and technology acceptance: development and validation of a technology affect scale
Perlusz, S. (2005) · IEEE International Engineering Management Conference (IEMC) · doi:10.1109/iemc.2004.1407500 · Cited by 37
Gooding, K., Phiri, M. M., Peterson, I., Parker, M. J., & Desmond, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.07.040 · Cited by 37
Bravo, C., O’Donoghue, C., Kaplan, C. P., Luce, J. A., & Ozanne, E. M. (2014) · PubMed · Cited by 29
Bassett, S. M., Cohn, M., Cotten, P. D., Kwok, I., & Moskowitz, J. T. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02412-z · Cited by 24
Herbeć, A., Perski, O., Shahab, L., & West, R. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15020288 · Cited by 21
Self-citationEvans, H. E. L., Forbes, C. C., Galvao, D. A., Vandelanotte, C., Newton, R. U., Wittert, G., Chambers, S. K., Vincent, A. D., Kichenadasse, G., Brook, N. R., et al. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00763-2 · Cited by 21
Self-citationLally, R. M., Bellavia, G. M., Gallo, S. M., Kupzyk, K. A., Helgeson, V. S., Brooks, C., Erwin, D. O., & Brown, J. (2019) · Psycho-Oncology · doi:10.1002/pon.5038 · Cited by 19
Taak, K., Brown, J., & Perski, O. (2020) · Drug and Alcohol Review · doi:10.1111/dar.13172 · Cited by 17
Self-citationLaine, A., Valimaki, M. A., Pekurinen, V., Löyttyniemi, E., MARTTUNEN, M. J., & Anttila, M. (2019) · Journal of Medical Internet Research · doi:10.2196/13073 · Cited by 15
Hanson, J. D., Weber, T. L., Shrestha, U., Bares, V., Seiber, M., & Ingersoll, K. S. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14229 · Cited by 14
Lemey, C., Larsen, M. E., DeVylder, J., Courtet, P., Billot, R., Lenca, P., Walter, M., Baca‐García, E., & Berrouiguet, S. (2018) · Journal of Medical Internet Research · doi:10.2196/10111 · Cited by 13
Jessop, A. B., Bass, S. B., Brajuha, J. A., Alhajji, M., Burke, M., Gashat, M. T., Wellington, C., Ventriglia, N., Coleman, J., & D’Avanzo, P. A. (2019) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2019.11.001 · Cited by 10
Integrated care in an international perspective: EUPHA proceedings December 2001.
Delnoij, D. M. J., Klazinga, N., & Glasgow, I. K. (2002) · Data Archiving and Networked Services (DANS) · Cited by 8
Acceptability and Feasibility of a Sexual Health Intervention for Young Adult Black Women
Montgomery, T. M., Mays, V. M., Heilemann, M. V., Nyamathi, A., Bauermeister, J. A., & Koniak‐Griffin, D. (2018) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2018.04.136 · Cited by 8
Cited by
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R., Parsons, R., & McPhail, S. M. (2023) · Implementation Science · doi:10.1186/s13012-023-01287-y · Cited by 131
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83
“Objective measures include biomarkers such as salivary cortisol which have been used to measure resilience (Petros et al., 2013).”
MethodAcceptability of Digital Mental Health Interventions for Depression and Anxiety: Systematic Review
Lau, C. K. Y., Saad, A., Camara, B., Rahman, D., & Bolea-Alamanac, B. (2024) · Journal of Medical Internet Research · doi:10.2196/52609 · Cited by 51
“Acceptability, the degree to which individuals view a treatment or potential treatment positively, has been identified as predicting adherence and user engagement [14], and ultimately the intervention’s effectiveness [15].”
Goldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26
LaMontagne, L. G., Doty, J. L., Diehl, D. C., Nesbit, T. S., Gage, N. A., Kumbkarni, N., & Leon, S. P. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.09.014 · Cited by 13
Metadata
- Authors
- Perski, O., & Short, C. E.
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-05-08
- Volume
- 11
- Issue
- 7
- Pages
- 1473-1480
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- OpenAlex
- W3159975376
- Cited by
- 300
- References
- 53
- FWCI
- 39.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.