Using online crowdsourcing to understand young adult attitudes toward expert-authored messages aimed at reducing hazardous alcohol consumption and to collect peer-authored messages
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Text message delivered prevention interventions have the potential to improve health behaviors on a large scale, including reducing hazardous alcohol consumption in young adults. Online crowdsourcing can be used to efficiently develop relevant messages, but remains largely understudied. This study aims to use online crowdsourcing to evaluate young adult attitudes toward expert-authored messages and to collect peer-authored messages. We designed an online survey with four drinking scenarios and a demographic questionnaire. We made it available to people who reported age 18-25 years, residence in the US, and any lifetime alcohol consumption via the Amazon Mechanical Turk crowdsourcing platform. Participants rated 71 sample text messages on instrumental (helpful) and affective (interesting) attitude scales and generated their own messages. All messages were coded as informational, motivational, or strategy facilitating. We examined differences in attitudes by message type and by drinking status and sex. We surveyed 272 participants in 48 h, and 222 were included in analysis for a total participant payment cost of $178. Sample mean age was 23 years old, with 50 % being female, 65 % being of white race, and 78 % scored as hazardous drinkers. Informational messages were rated the most helpful, whereas motivational messages were rated the most interesting. Hazardous drinkers rated informational messages less helpful than non-hazardous drinkers. Men reported messages less helpful and interesting than women for most categories. Young adults authored 161 messages, with the highest proportion being motivational. Young adults had variable instrumental and affective attitudes toward expert-authored messages. They generated a substantial number of peer-authored messages that could enhance relevance of future alcohol prevention interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Fisher, J. D., & Fisher, W. A. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.3.455 · Cited by 2,459
Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126
Tailored and Targeted Health Communication: Strategies for Enhancing Information Relevance
Kreuter, M. W., & Wray, R. J. (2003) · American Journal of Health Behavior · doi:10.5993/ajhb.27.1.s3.6 · Cited by 1,095
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., & Jones, M. (2005) · Tobacco Control · doi:10.1136/tc.2005.011577 · Cited by 732
Lehto, T., & Oinas-Kukkonen, H. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1559 · Cited by 203
Suffoletto, B., Kristan, J., Callaway, C., Kim, K. H., Chung, T., Monti, P. M., & Clark, D. B. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.06.010 · Cited by 151
Self-citation
Research works printed but not linked: 17
- Foreman KF, Stockl KM, Le LB, et al. Impact of a text messaging pilot program on patient medication adherence. Clin Ther. 2012;34(5):1084-1091. doi: 10.1016/j.clinthera.2012.04.007 . · DOI
- Suffoletto B, Callaway C, Kristan J, Kraemer K, Clark DB. Text-message-based drinking assessments and brief interventions for young adults discharged from the emergency department. Alcoholism: Clin Exp Res. 2012;36(3):552-560. doi: 10.1111/j.1530-0277.2011.01646 . · DOI · Paper page
- Paolacci G, Chandler J, Ipeirotis PG. Running experiments on Amazon Mechanical Turk. Fuzzy Optim Decis Making. 2010;5(5):411-4119.
- Behrend TS, Sharek DJ, Meade AW, Wiebe EN. The viability of crowdsourcing for survey research. Behav Res Methods. 2011;43(3):800-813. doi: 10.3758/s13428-011-0081-0 . · DOI · Paper page
- Turner AM, Kirchhoff K, Capurro D. Using crowdsourcing technology for testing multilingual public health promotion materials. J Med Internet Res. 2012;14(3):e79. doi: 10.2196/jmir.2063 . · DOI
- Muench F, van Stolk-Cooke K, Morgenstern J, Kuerbis AN, Markle K. Understanding messaging preferences to inform development of mobile goal-directed behavioral interventions. J Med Internet Res. 2014;16(2):e14. doi: 10.2196/jmir.2945 . · DOI · Paper page
- Carey KB, Henson JM, Carey MP, Maisto SA. Which heavy drinking college students benefit from a brief motivational intervention? J Consult Clin Psychol. 2007;75(4):663-669. doi: 10.1037/0022-006×.75.4.663 . · DOI · Paper page
- Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a brief screen for alcohol misuse in primary care. Alcoholism: Clin Exp Res. 2007;31(7):1208-1217. · DOI · Paper page
- Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived alcohol use disorders identification test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcoholism: Clin Exp Res. 2005;29(5):844-854. doi: 10.1097/01.ALC.0000164374.32229 . · DOI · Paper page
- Coley HL, Sadasivam RS, Williams JH, et al. Crowdsourced peer- versus expert-written smoking-cessation messages. Am J Prev Med. 2013;45(5):543-550. doi: 10.1016/j.amepre.2013.07.004 . · DOI
- Walters ST, Bennett ME, Noto JV. Drinking on campus: what do we know about reducing alcohol use among college students? J Subst Abus Treat. 2000;19(3):223-228. doi: 10.1016/S0740-5472(00)00101-X . · DOI
- Ziemelis A, Bucknam RB, Elfessi AM. Prevention efforts underlying decreases in binge drinking at institutions of higher education. J American College Health. 2002;50(5):238-252. doi: 10.1080/074484802095957157 . · DOI
- Miller MB, Leffingwell TR. What do college student drinkers want to know? Student perceptions of alcohol-related feedback. Psychol Addict Behav. 2013;27(1):214. doi: 10.1037/a0031380 . · DOI
- Walters ST, Roudsari BS, Vader AM, Harris TR. Correlates of protective behavior utilization among heavy-drinking college students. Addict Behav. 2007;32:2633-2644. doi: 10.1016/j.addbeh.2007.06.022 . · DOI
- Norman P, Armitage CJ, Quigley C. The theory of planned behavior and binge drinking: assessing the impact of binge drinker prototypes. Addict Behav. 2007;32(9):1753-1768. doi: 10.1016/j.addbeh.2006.12.009 . · DOI · Paper page
- Norman P, Conner M. The theory of planned behaviour and binge drinking: assessing the moderating role of past behaviour within the theory of planned behaviour. Br J Health Psychol. 2006;11(1):55-70. doi: 10.1016/j.addbeh.2006.12.009 . · DOI · Paper page
- Hagger MS, Lonsdale A, Chatzisarantis NL. A theory-based intervention to reduce alcohol drinking in excess of guideline limits among undergraduate students. Br J Health Psychol. 2012;17(1):18-43. doi: 10.1111/j.2044-8287.2010.02011 . · DOI · Paper page
Cited by
Patient Engagement and the Design of Digital Health
Birnbaum, F., Lewis, D., Rosen, R. K., & Ranney, M. L. (2015) · Academic Emergency Medicine · doi:10.1111/acem.12692 · Cited by 252
Mapping of Crowdsourcing in Health: Systematic Review
Créquit, P., Mansouri, G., Benchoufi, M., Vivot, A., & Ravaud, P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9330 · Cited by 135
“selected for further evaluation, and 202 studies were included (182 published papers and 20 conference abstracts [3,16-216]).”
BackgroundMethods for Human-Centered eHealth Development: Narrative Scoping Review
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2022) · Journal of Medical Internet Research · doi:10.2196/31858 · Cited by 67
Methods for Human-Centered eHealth Development: Narrative Scoping Review (Preprint)
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2021) · doi:10.2196/preprints.31858 · Cited by 67
Kornfield, R., Zhang, R., Nicholas, J., Schueller, S. M., Cambo, S. A., Mohr, D. C., & Reddy, M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376309 · Cited by 64
“Whereas work has examined messages from peers and experts [34,62], self-generated content may help individuals with mental health conditions motivate themselves in highly individualized and directive ways.”
Background
Metadata
- Authors
- Kristan, J., & Suffoletto, B.
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-10-30
- Volume
- 5
- Issue
- 1
- Pages
- 45-52
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- OpenAlex
- W2021029546
- Cited by
- 38
- References
- 10
- FWCI
- 4.27
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using online crowdsourcing to understand young adult attitudes toward expert-authored messages aimed at reducing hazardous alcohol consumption and to collect peer-authored messages. https://app.cochat.ai/papers/10.1007/s13142-014-0298-4
- The paper
- Kristan, J., & Suffoletto, B. (2015). Using online crowdsourcing to understand young adult attitudes toward expert-authored messages aimed at reducing hazardous alcohol consumption and to collect peer-authored messages. Translational Behavioral Medicine. https://doi.org/10.1007/s13142-014-0298-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.