Social presence and use of Internet-delivered interventions: a multi-method approach
Open accessAbstract
OBJECTIVE: Internet-delivered interventions can effectively change health risk behaviors and their determinants, but adherence to intervention websites once they are accessed is very low. This study tests whether and how social presence elements can increase website use. METHODS: A website about Hepatitis A, B, and C virus infections was used in a preparatory lab-based eye-tracking study assessing whether social presence elements attract participants' attention, because this is a prerequisite for affecting website use. In the following field study, 482 participants representative of the Dutch population were randomized to either a website with or a website without social presence elements. Participants completed a questionnaire of validated measures regarding user perceptions immediately after exposure to the website. Server registrations were used to assess website use. RESULTS: Participants in the experimental condition focused on the social presence elements, both in terms of frequency (F(1, 98) = 40.34, p<.001) and duration (F(1, 88) = 39.99, p<.001), but did not differ in website use in comparison with the control condition; neither in terms of the number of pages visited (t(456) = 1.44, p = .15), nor in terms of time on the website (t(456) = 0.01, p = .99). CONCLUSIONS: Adding social presence elements did not affect actual use of an intervention website within a public health context. Possible reasons are limited attention for these elements in comparison with the main text and the utilitarian value of intervention websites.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Surrogate measures of engagement can be difficult to interpret and differences in attention may not always translate into differences in intervention use or other measures of engagement.
“These surrogate measures of engagement can be difficult to interpret and differences in attention may not always translate into differences in intervention use (or other measures of engagement) 40 .”
From Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions (2016) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1998) · Cited by 36,049 · see citing works
Cultures and Organizations: Software of the Mind.
Triandis, H. C., & Hofstede, G. (1993) · Administrative Science Quarterly · doi:10.2307/2393257 · Cited by 17,696 · see citing works
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979 · see citing works
Lewis, M., & Haviland, J. M. (1993) · Cited by 3,308 · see citing works
The Theory of Planned Behavior: A Review of its Applications to Health-Related Behaviors
Godin, G., & Kok, G. (1996) · American Journal of Health Promotion · doi:10.4278/0890-1171-11.2.87 · Cited by 3,185 · see citing works
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · see citing works
Structural equations modeling: Fit Indices, sample size, and advanced topics
Iacobucci, D. (2010) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2009.09.003 · Cited by 2,263 · cited 1× · see citing works
“09 [45,46].”
Factors influencing the usage of websites: the case of a generic portal in The Netherlands
van der Heijden, H. (2003) · Information & Management · doi:10.1016/s0378-7206(02)00079-4 · Cited by 1,425 · see citing works
Benbasat, I., Barki, H., & Montréal, H. (2007) · Journal of the Association for Information Systems · doi:10.17705/1jais.00126 · Cited by 1,389 · see citing works
Interest, learning, and the psychological processes that mediate their relationship.
Ainley, M., Hidi, S. E., & Berndorff, D. (2002) · Journal of Educational Psychology · doi:10.1037/0022-0663.94.3.545 · Cited by 1,239 · see citing works
Managing User Trust in B2C e-Services
Gefen, & Straub (2003) · e-Service Journal · doi:10.2979/esj.2003.2.2.7 · Cited by 1,074 · see citing works
Attention web designers: You have 50 milliseconds to make a good first impression!
Lindgaard, G., Fernandes, G., Dudek, C., & Brown, J. M. (2006) · Behaviour and Information Technology · doi:10.1080/01449290500330448 · Cited by 1,025 · see citing works
Hassanein, K., & Head, M. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.018 · Cited by 986 · see citing works
Qualitative Descriptors of Strength of Association and Effect Size
Rosenthal, J. A. (1996) · Journal of Social Service Research · doi:10.1300/j079v21n04_02 · Cited by 941 · see citing works
Understanding tailoring in communicating about health
Hawkins, R. P., Kreuter, M., Resnicow, K., Fishbein, M., & Dijkstra, A. (2008) · Health Education Research · doi:10.1093/her/cyn004 · Cited by 934 · cited 1× · see citing works
“Personalization is one of the strategies, besides feedback and content matching, that is part of tailoring: creating communications individualized for their receivers, with the expectation that this individualization will lead to larger intended effects of these communications [55].”
BackgroundA meta-analysis of computer-tailored interventions for health behavior change
Krebs, P., Prochaska, J. O., & Rossi, J. S. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.06.004 · Cited by 854 · see citing works
The value of Internet commerce to the customer
Keeney, R. L. (1999) · Management Science · doi:10.1287/mnsc.45.4.533 · Cited by 810 · see citing works
The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential
Bennett, G. G., & Glasgow, R. E. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100235 · Cited by 800 · see citing works
The development and evaluation of a survey to measure user engagement
O'Brien, H. L., & Toms, E. G. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21229 · Cited by 794 · see citing works
Exploring the Psychology of Interest
Silvia, P. J. (2006) · doi:10.1093/acprof:oso/9780195158557.001.0001 · Cited by 734 · see citing works
The role of social presence in establishing loyalty in e-Service environments
Cyr, D., Hassanein, K., Head, M. M., & Ivanov, A. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.07.010 · Cited by 710 · see citing works
Self-citationYoo, Y., & Alavi, M. (2001) · MIS Quarterly · doi:10.2307/3250922 · Cited by 679 · see citing works
Sienkiewicz, H. (1895) · Cited by 662 · see citing works
Exploring Human Images in Website Design: A Multi-Method Approach1
Cyr, Head, M. M., Larios, H., & Pan, B. (2009) · MIS Quarterly · doi:10.2307/20650308 · Cited by 639 · see citing works
Self-citationExploring the psychology of interest
(2006) · Choice Reviews Online · doi:10.5860/choice.44-1818 · Cited by 481 · see citing works
Brouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455 · see citing works
Self-citationPortnoy, D. B., Scott-Sheldon, L. A. J., Johnson, B. T., & Carey, M. P. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.02.014 · Cited by 451 · see citing works
The Impact of Infusing Social Presence in the Web Interface: An Investigation Across Product Types
Hassanein, K., & Head, M. M. (2005) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415100202 · Cited by 371 · see citing works
Cyr, D., Head, M. M., & Ivanov, A. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.07.004 · Cited by 362 · see citing works
Self-citationVisual complexity of websites: Effects on users’ experience, physiology, performance, and memory
Tuch, A. N., Bargas-Avila, J. A., Opwis, K., & Wilhelm, F. H. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.04.002 · Cited by 329 · see citing works
Past purchase and intention to purchase in e‐commerce
Weisberg, J., Te’eni, D., & Arman, L. (2011) · Internet Research · doi:10.1108/10662241111104893 · Cited by 317 · see citing works
Towards a theory of user judgment of aesthetics and user interface quality
Hartmann, J., Sutcliffe, A., & Angeli, A. D. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1460355.1460357 · Cited by 260 · see citing works
The Influence of Home Page Complexity on Consumer Attention, Attitudes, and Purchase Intent
Geissler, G. L., Zinkhan, G. M., & Watson, R. T. (2006) · Journal of Advertising · doi:10.1080/00913367.2006.10639232 · Cited by 248 · see citing works
Online consumer behavior: Comparing Canadian and Chinese website visitors
Mazaheri, E., Richard, M., & Laroche, M. (2011) · Journal of Business Research · doi:10.1016/j.jbusres.2010.11.018 · Cited by 242 · see citing works
An examination of situational interest and its sources
Chen, A., Darst, P. W., & Pangrazi, R. P. (2001) · British Journal of Educational Psychology · doi:10.1348/000709901158578 · Cited by 227 · see citing works
Crutzen, R., Peters, G.-J. Y., Portugal, S. D., Fisser, E. M., & Grolleman, J. J. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.09.002 · Cited by 205 · see citing works
Self-citationMust interesting things be pleasant? A test of competing appraisal structures.
Turner, S. A., & Silvia, P. J. (2006) · Emotion · doi:10.1037/1528-3542.6.4.670 · Cited by 182 · see citing works
Ballantine, P. W. (2005) · International Journal of Retail & Distribution Management · doi:10.1108/09590550510600870 · Cited by 182 · see citing works
An Integrated Approach for Modeling Learning Patterns of Students in Web-Based Instruction
Chen, S. Y., & Liu, X. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1352782.1352783 · Cited by 177 · see citing works
Hermans, D., Vansteenwegen, D., & Eelen, P. (1999) · Cognition & Emotion · doi:10.1080/026999399379249 · Cited by 173 · see citing works
A study of demographic embodiments of product recommendation agents in electronic commerce
Qiu, L., & Benbasat, I. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.05.005 · Cited by 158 · see citing works
Crutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2011) · Health Education & Behavior · doi:10.1177/1090198110372878 · Cited by 158 · see citing works
Self-citationBrouwer, W., Oenema, A., Raat, H., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2010) · Health Education Research · doi:10.1093/her/cyp063 · Cited by 147 · see citing works
Self-citationA Two-Process View of Trust and Distrust Building in Recommendation Agents: A Process-Tracing Study
Komiak, S., & Benbasat, I. (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00180 · Cited by 115 · see citing works
Hassanein, K., Head, M. M., & Ju, C. (2009) · International Journal of Electronic Business · doi:10.1504/ijeb.2009.029050 · Cited by 104 · see citing works
Riet, J. V. ‘., Crutzen, R., & de Vries, H. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1345 · Cited by 93 · see citing works
Self-citationCrutzen, R., Cyr, D., & de Vries, N. K. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1922 · Cited by 91 · see citing works
Self-citationSmerecnik, C. M. R., Mesters, I., Kessels, L. T. E., Ruiter, R. A. C., de Vries, N. K., & de Vries, H. (2010) · Risk Analysis · doi:10.1111/j.1539-6924.2010.01435.x · Cited by 82 · see citing works
Self-citationBringing Loyalty to E-health: Theory Validation Using Three Internet-Delivered Interventions
Crutzen, R., Cyr, D., & de Vries, N. K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1837 · Cited by 69 · see citing works
Self-citationThe Dimensions of Web Site Credibility and Their Relation to Active Trust and Behavioural Impact
Cugelman, B., Thelwall, M. A., & Dawes, P. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02426 · Cited by 62 · see citing works
Crutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2009) · Health Promotion International · doi:10.1093/heapro/dap018 · Cited by 60 · see citing works
Self-citationUtilization patterns and user characteristics of an ad libitum Internet weight loss program
Binks, M., & van Mierlo, T. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1347 · Cited by 52 · see citing works
Exploring Human Images in Website Design: A Multi-Method Approach
Cyr, D., Head, M., Larios, H., & Pan, B. (2009) · Journal of the Association for Information Systems · Cited by 46 · see citing works
Self-citationSun, Y., Wang, N., & Peng, Z. C. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2010.12.007 · Cited by 40 · see citing works
Crutzen, R., de Nooijer, J., Candel, M. J. J. M., & de Vries, N. K. (2008) · Journal of Health Psychology · doi:10.1177/1359105308095064 · Cited by 37 · see citing works
Self-citationPublic awareness and practical knowledge regarding Hepatitis A, B, and C: A two-country survey
Crutzen, R., & Göritz, A. S. (2012) · Journal of Infection and Public Health · doi:10.1016/j.jiph.2011.12.001 · Cited by 35 · see citing works
Self-citationThe development and evaluation of a survey to measure user engagement in e-commerce environments
O'Brien, H. L., & Toms, E. G. (2011) · cIRcle (University of British Columbia) · doi:10.14288/1.0107443 · Cited by 35 · see citing works
High and low spatial frequencies in website evaluations
Thielsch, M. T., & Hirschfeld, G. H. F. (2010) · Ergonomics · doi:10.1080/00140139.2010.489970 · Cited by 33 · see citing works
You never get a second chance to make a first impression
Crutzen, R., de Kruif, L., & de Vries, N. K. (2012) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.13.3.07cru · Cited by 14 · see citing works
Self-citationEffect of Utilitarian and Hedonic Motivations on Consumer Satisfaction with Travel Websites
Nusair, K., Yoon, H. J., & Parsa, H. G. (2008) · Information Technology & Tourism · doi:10.3727/109830508785058977 · Cited by 13 · see citing works
Cyr, D., & Head, M. M. (2008) · Journal of the Association for Information Systems · Cited by 9 · see citing works
Self-citationIS IT TIME TO START FOCUSING ON THE CONTENT OF COMPUTER‐DELIVERED INTERVENTIONS?
Crutzen, R. (2011) · Addiction · doi:10.1111/j.1360-0443.2011.03539.x · Cited by 7 · see citing works
Self-citationJust Another Manic Monday: Peaking Sexual Concerns After the Weekend
Crutzen, R., & Mevissen, F. E. F. (2011) · Archives of Sexual Behavior · doi:10.1007/s10508-011-9833-2 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
2 of the 65 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [52]Sheeran P (2002) Intention-behaviour relations: A conceptual and empirical review. In: Hewstone M, Stroebe W, editors. European Review of Social Psychology. Chichester, UK: John Wiley & Sons. pp. 1–36.
Cited by
Sorted by citations
Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · see citing works
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193 · see citing works
Short, C. E., DeSmet, A., Woods, C., Williams, S. L., Maher, C., Middelweerd, A., Müller, A. M., Wark, P. A., Vandelanotte, C., Poppe, L., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9397 · Cited by 400 · see citing works
Self-citationReturn Visits: A Review of how Web Site Design Can Engender Visitor Loyalty
Cyr, D. (2014) · Journal of Information Technology · doi:10.1057/jit.2013.25 · Cited by 52 · see citing works
Self-citationZong, D., Gan, P., Zhou, A., Li, J., Xie, Z., Duan, A., & He, C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218455 · Cited by 37 · see citing works
Can interest and enjoyment help to increase use of Internet-delivered interventions?
Crutzen, R., Ruiter, R. A. C., & de Vries, N. K. (2014) · Psychology and Health · doi:10.1080/08870446.2014.921300 · Cited by 22 · see citing works
Self-citationE‐loyalty towards a cancer information website: applying a theoretical framework
Crutzen, R., Beekers, N., van Eenbergen, M. V., Becker, M., Jongen, L., & van Osch, L. (2014) · Psycho-Oncology · doi:10.1002/pon.3471 · Cited by 15 · see citing works
Self-citationCremers, H., Mercken, L. A. G., Crutzen, R., Willems, P., de Vries, H., & Oenema, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3069 · Cited by 13 · see citing works
Self-citationPot, M., Paulussen, T. G., Ruiter, R. A. C., Mollema, L., Hofstra, M., & van Keulen, H. M. (2020) · Journal of Medical Internet Research · doi:10.2196/14822 · Cited by 8 · see citing works
Self-citationCan evolutionary mismatch help generate interest in health promotion messages?
Grey, E., Gillison, F., & Thompson, D. (2018) · Health Education Journal · doi:10.1177/0017896918754923 · Cited by 3 · see citing works
Lazard, A. J., Vereen, R. N., Zhou, J., Nichols, H. B., Pulido, M., Swift, C., Dasgupta, N., & Fredrickson, B. L. (2024) · JMIR Cancer · doi:10.2196/48627 · Cited by 2 · see citing works
RetractedAn appointment with Dr. google: Online searching for health information in times of stress
(2014) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.2014.14505101136
- Authors
- Crutzen, R., Cyr, D., Larios, H., Ruiter, R. A. C., & de Vries, N. K.
- Affiliations
- Maastricht University (NL)
- Simon Fraser University (CA)
- Corresponding author
- Crutzen, Rik
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-20
- Volume
- 8
- Issue
- 2
- Pages
- e57067
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3577738
- OpenAlex
- W2003628279
- Cited by
- 12
- References
- 65
- Citations by year
- 2024: 1 · 2020: 1 · 2019: 1 · 2018: 2 · 2016: 2 · 2014: 5
- FWCI
- 4.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Summit (Simon Fraser University) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Media Influence and Health
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- social presence, online intervention, internet use, user engagement, eye tracking, hepatitis B and C, hepatitis A, health information websites, user perception
- MeSH terms
- Adult, Attention, Female, Health Promotion, Humans, Male, Perception, Health Behavior, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
