Characterising smoking cessation smartphone applications in terms of behaviour change techniques, engagement and ease-of-use features
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
The aim of this study was to assess whether or not behaviour change techniques (BCTs) as well as engagement and ease-of-use features used in smartphone applications (apps) to aid smoking cessation can be identified reliably. Apps were coded for presence of potentially effective BCTs, and engagement and ease-of-use features. Inter-rater reliability for this coding was assessed. Inter-rater agreement for identifying presence of potentially effective BCTs ranged from 66.8 to 95.1 % with 'prevalence and bias adjusted kappas' (PABAK) ranging from 0.35 to 0.90 (p < 0.001). The intra-class correlation coefficients between the two coders for scores denoting the proportions of (a) a set of engagement features and (b) a set of ease-of-use features, which were included, were 0.77 and 0.75, respectively (p < 0.001). Prevalence estimates for BCTs ranged from <10 % for medication advice to >50 % for rewarding abstinence. The average proportions of specified engagement and ease-of-use features included in the apps were 69 and 83 %, respectively. The study found that it is possible to identify potentially effective BCTs, and engagement and ease-of-use features in smoking cessation apps with fair to high inter-rater reliability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Self-citationMortality in relation to smoking: 50 years' observations on male British doctors
Doll, R., Peto, R., Boreham, J., & Sutherland, I. (2004) · BMJ · doi:10.1136/bmj.38142.554479.ae · Cited by 2,920
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 1×
“A number of taxonomies of BCTs, including generic taxonomies of BCTs [22, 24] and those relating to specific behaviours such as alcohol reduction [25], promoting physical activity and healthy eating [26], increasing safe sexual behaviours [27] and smoking cessation [28, 29] have been developed.”
BackgroundSelf-citationByrt, T., Bishop, J., & Carlin, J. B. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90018-v · Cited by 2,179 · cited 2×
“Inter-rater reliability was assessed by percentage agreement and by ‘ prevalence and bias adjusted kappas ’ (PABAK) [40] for BCTs. PABAK is considered preferable to kappa as it adjusts for potential chance agreement between coders and high prevalence of negative agreement (i.e. when both coders…”
BackgroundMethodMichie, S., Ashford, S., Sniehotta, F. F., Dombrowski, S. U., Bishop, A., & French, D. P. (2011) · Psychology & Health · doi:10.1080/08870446.2010.540664 · Cited by 1,756
Self-citationDesign of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study
Cafazzo, J. A., Casselman, M., Hamming, N., Katzman, D. K., & Palmert, M. R. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2058 · Cited by 676 · cited 1×
“We searched online databases, reviewed key textbooks, blogs and emagazines and consulted with experienced app developers to arrive at a set of features that we judged would possibly promote user engagement and make apps easy to use [32–36].”
MethodApps to promote physical activity among adults: a review and content analysis
Middelweerd, A., Mollee, J. S., van der Wal, C. N., Brug, J., & te Velde, S. J. (2014) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-014-0097-9 · Cited by 546 · cited 1×
“This approach is used widely [37 – 39].”
MethodMichie, S., Hyder, N., Walia, A., & West, R. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2010.11.016 · Cited by 459
Self-citationiPhone Apps for Smoking Cessation
Abroms, L. C., Padmanabhan, N., Thaweethai, L., & Phillips, T. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.10.032 · Cited by 365 · cited 4×
“5 %), which suggests that smoking cessation apps lack evidence-based content [7–11].”
BackgroundResultInfluentialLaing, B. Y., Mangione, C. M., Tseng, C.-H., Leng, M., Vaisberg, E., Mahida, M., Bholat, M., Glazier, E., Morisky, D. E., & Bell, D. S. (2014) · Annals of Internal Medicine · doi:10.7326/m13-3005 · Cited by 353 · cited 1×
“For example, with fitness and weight loss apps, evidence suggests that popularity and usage are not related to effectiveness [43].”
BackgroundBricker, J. B., Mull, K. E., Kientz, J. A., Vilardaga, R., Mercer, L. D., Akioka, K. J., & Heffner, J. L. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.07.006 · Cited by 340 · cited 1×
“Around 400 apps are aimed at helping smokers to quit, but very little is known about their content [7–11] or effectiveness [12–14].”
BackgroundIdentification of behaviour change techniques to reduce excessive alcohol consumption
Michie, S., Whittington, C., Hamoudi, Z., Zarnani, F., Tober, G., & West, R. (2012) · Addiction · doi:10.1111/j.1360-0443.2012.03845.x · Cited by 288
Self-citationBuller, D. B., Borland, R., Bettinghaus, E. P., Shane, J. H., & Zimmerman, D. E. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0169 · Cited by 178 · cited 1×
“Around 400 apps are aimed at helping smokers to quit, but very little is known about their content [7 – 11] or effectiveness [12 – 14].”
BackgroundWest, R., Walia, A., Hyder, N., Shahab, L., & Michie, S. (2010) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntq074 · Cited by 165
Self-citationStrecher, V., Shiffman, S., & West, R. (2006) · Nicotine & Tobacco Research · doi:10.1080/14622200601039444 · Cited by 108
Self-citationAssessing fidelity of delivery of smoking cessation behavioural support in practice
Lorencatto, F., West, R., Christopherson, C., & Michie, S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-40 · Cited by 107 · cited 1×
“BCTs also provide a means of assessing how behaviour change interventions link with particular theories and provide a basis for testing these theories [23].”
BackgroundSelf-citationApplying the behaviour change technique (BCT) taxonomy v1: A study of coder training
Wood, C. E., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., & Michie, S. (2015) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0290-z · Cited by 100 · cited 2×
“Approach of using just two coders has been a common practice in evaluating BCT taxonomies to arrive at an initial evaluation of the coding system [37].”
MethodSelf-citation
Cited by
Perski, O., Blandford, A., Ubhi, H. K., West, R., & Michie, S. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0422-8 · Cited by 123
“the Mobile Application Rating Scale [85]; a coding scheme developed by Ubhi and colleagues [86]) are available, the predictive validity of such scales (i.”
MethodSelf-citationBricker, J. B., Mull, K. E., Santiago-Torres, M., Miao, Z., Perski, O., & Di, C. (2022) · Journal of Medical Internet Research · doi:10.2196/39208 · Cited by 44
“A total of 2415 individuals were enrolled in the 2-arm iCanQuit randomized controlled trial for smoking cessation, with full protocol details previously described [12].”
BackgroundInfluentialApplicability of the User Engagement Scale to Mobile Health: A Survey-Based Quantitative Study
(2019) · doi:10.2196/13244 · Cited by 54
Pbert, L., Druker, S., Crawford, S., Frisard, C., Trivedi, M., Osganian, S. K., & Brewer, J. (2020) · Mindfulness · doi:10.1007/s12671-019-01273-w · Cited by 40
Martinez Agulleiro, L., Patil, B., Firth, J., Sawyer, C., Amann, B. L., Fonseca, F., Torrens, M., Perez, V., Castellanos, F. X., Kane, J. M., et al. (2023) · Psychological Medicine · doi:10.1017/s003329172300123x · Cited by 19
Metadata
- Authors
- Ubhi, H. K., Michie, S., Kotz, D., van Schayck, O. C. P., Selladurai, A., & West, R.
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-11-23
- Volume
- 6
- Issue
- 3
- Pages
- 410-417
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- OpenAlex
- W2179576685
- Cited by
- 66
- References
- 17
- FWCI
- 2.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.