Can Text Messages Reach the Parts Other Process Measures Cannot Reach: An Evaluation of a Behavior Change Intervention Delivered by Mobile Phone?
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Process evaluation is essential in developing, piloting and evaluating complex interventions. This often involves observation of intervention delivery and interviews with study participants. Mobile telephone interventions involve no face to face contact, making conventional process evaluation difficult. This study assesses the utility of novel techniques for process evaluation involving no face to face contact. METHODS: Text messages were delivered to 34 disadvantaged men as part of a feasibility study of a brief alcohol intervention. Process evaluation focused on delivery of the text messages and responses received from study participants. The computerized delivery system captured data on receipt of the messages. The text messages, delivered over 28 days, included nine which asked questions. Responses to these questions served as one technique for process evaluation by ascertaining the nature of engagement with the study and with steps on the causal chain to behavior change. RESULTS: A total of 646 SMS text messages were sent to participants. Of these, 613 messages (95%) were recorded as delivered to participants' telephones. 88% of participants responded to messages that asked questions. There was little attenuation in responses to the questions across the intervention period. Content analysis of the responses revealed that participants engaged with text messages, thought deeply about their content and provided carefully considered personal responses to the questions. CONCLUSIONS: Socially disadvantaged men, a hard to reach population, engaged in a meaningful way over a sustained period with an interactive intervention delivered by text message. The novel process measures used in the study are unobtrusive, low cost and collect real-time data on all participants. They assessed the fidelity of delivery of the intervention and monitored retention in the study. They measured levels of engagement and identified participants' reactions to components of the intervention. These methods provide a valuable addition to conventional process evaluation techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“participants’ understanding of the information given, particularly if literacy levels are low [26].”
BackgroundEffectiveness of brief alcohol interventions in primary care populations
Kaner, E. F., Beyer, F. R., Muirhead, C., Campbell, F., Pienaar, E. D., Bertholet, N., Daeppen, J. B., Saunders, J. B., & Burnand, B. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub4 · Cited by 1,665
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247
Behavior change interventions delivered by mobile telephone short message service
Fjeldsoe, B. S., Marshall, A. L., & Miller, Y. D. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.09.040 · Cited by 1,213 · cited 4×
“The content of the SMS and MMS messages was derived from several sources: alcohol brief interventions [15]; text message interventions [2,3]; and communication theory [17].”
BackgroundMethodInfluentialMobile phone-based interventions for smoking cessation
Whittaker, R., McRobbie, H., Bullen, C., Rodgers, A., & Gu, Y. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub4 · Cited by 1,079
Saunders, R. P., Evans, M. H., & Joshi, P. (2005) · Health Promotion Practice · doi:10.1177/1524839904273387 · Cited by 1,031
Healthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970
Motivational interviewing in health care: helping patients change behavior
Rollnick, S., Miller, W. R., Butler, C. C., & Aloia, M. S. (2008) · COPD: Journal of Chronic Obstructive Pulmonary Disease · doi:10.1080/15412550802093108 · Cited by 901
Effectiveness of brief alcohol interventions in primary care populations
Kaner, E. F. S., Dickinson, H. O., Beyer, F. R., Campbell, F., Schlesinger, C., Heather, N., Saunders, J. B., Burnand, B., & Pienaar, E. D. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub3 · Cited by 746
Cited by
Berrouiguet, S., Baca-García, E., Brandt, S., Walter, M., & Courtet, P. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5066 · Cited by 332
Suffoletto, B., Kristan, J., Callaway, C., Kim, K. H., Chung, T., Monti, P. M., & Clark, D. B. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.06.010 · Cited by 151
Diez-Canseco, F., Zavala-Loayza, J. A., Beratarrechea, A., Kanter, R., Ramirez-Zea, M., Rubinstein, A., Martinez, H., & Miranda, J. J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3874 · Cited by 68
“Taking into consideration that SMS text messaging is one of many delivery channels, clarity of the communication is key [2], and very few studies have properly described their methods and criteria used for the development and validation of the content of text messages [26,35,36].”
mHealth Interventions to Reduce Alcohol Use in Young People: A Systematic Review of the Literature
Hutton, A., Prichard, I., Whitehead, D., Thomas, S., Rubin, M., Sloand, E., Powell, T. W., Frisch, K., Newman, P., & Goodwin Veenema, T. (2020) · Comprehensive Child and Adolescent Nursing · doi:10.1080/24694193.2019.1616008 · Cited by 64
“…2012; Suffoletto, Callaway, Kristan, Monti, & Clark, 2013); intervention development (Hospital et al., 2016); the primary focus was not alcohol (Irvine et al., 2012; Kazemi, Cochran, Kelly, Cornelius, & Belk, 2014; Reid et al., 2009; Shrier, Rhoads, Fredette, & Burke, 2014); and participants…”
BackgroundMartinez-Brockman, J. L., Harari, N., & Pérez-Escamilla, R. (2018) · Journal of Health Communication · doi:10.1080/10810730.2017.1401686 · Cited by 32
“In an intervention aimed at reducing alcohol use in disadvantaged men, 88% of participants responded to at least one text (Irvine et al., 2012).”
Background
Metadata
- Authors
- Irvine, L., Falconer, D. W., Jones, C., Ricketts, I. W., Williams, B., & Crombie, I. K.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-12-26
- Volume
- 7
- Issue
- 12
- Pages
- e52621
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2013613161
- Cited by
- 58
- References
- 10
- FWCI
- 9.73
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can Text Messages Reach the Parts Other Process Measures Cannot Reach: An Evaluation of a Behavior Change Intervention Delivered by Mobile Phone? https://app.cochat.ai/papers/10.1371/journal.pone.0052621
- The paper
- Irvine, L., Falconer, D. W., Jones, C., Ricketts, I. W., Williams, B., & Crombie, I. K. (2012). Can Text Messages Reach the Parts Other Process Measures Cannot Reach: An Evaluation of a Behavior Change Intervention Delivered by Mobile Phone? PLoS ONE. https://doi.org/10.1371/journal.pone.0052621
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.