Transaction logfile analysis in health communication research: Challenges and opportunities
Abstract
Objective To investigate the individualized nature of eHealth communication, it is necessary for us to go beyond the conventional approach to explain the effect of eHealth initiatives. The current article proposes transaction logfile analysis as a unique method to probe the process by which individuals locate needed information and obtains benefits out of it.Methods This article discusses the background of logfile analysis along with practical and methodological issues related to the analysis of log data.Results This article recommends potential solutions to resolve issues discussed in the Section 2.Conclusions This article discusses how transaction logfile analysis could benefit eHealth researchers, along with its relevance and application in health communication research. Logfile analysis could provide rich knowledge on how eHealth applications and tools work if performed on a regular basis, incorporated with appropriate measurement techniques and research design, and interpreted carefully.Practice implications Logfile analysis can point toward important design implications for more effective eHealth applications. Further, interventions employing logfile analysis require not only well-designed research models but also interdisciplinary research team to handle the multifaceted work involved in the process.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
RCTs cannot provide insight into process outcomes or how use of different components of eHealth technology contributed to healthier living, improved well-being, or daily tasks.
“Therefore, no insight can be obtained on process outcomes or how the use of the different components of the technology has contributed to healthier living, improved well-being, or a user’s ability to conduct daily tasks [7,9,10].”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
Analyses of log data can provide continuous and objective insights into the actual usage of eHealth technology.
“The analyses of log data (anonymous records of real-time actions performed by each user) can provide continuous and objective insights into the actual usage of the technology.”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
Longer and more frequent exposure to an eHealth technology might indicate how well the system fits users' needs, but can also signify unfocused and/or non-strategic use or an inefficient system.
“For example, a longer and more frequent exposure to an eHealth technology might indicate how well the system fits the users’ needs, but it can also signify unfocused and/or non-strategic use or an inefficient system [9,21].”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
eHealth research has limited insight into process outcomes or how technology use contributes to healthier living, improved well-being, or daily tasks.
“In electronic health (eHealth) research, limited insight has been obtained on process outcomes or how the use of technology has contributed to the users’ ability to have a healthier life, improved well-being, or activate new attitudes in their daily tasks.”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
The possibilities of log data in eHealth research have not been exploited to their fullest extent.
“However, the possibilities of log data in eHealth research have not been exploited to their fullest extent.”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
Log data analysis has the potential to explain outcomes of traditional methods by gaining insight into mediating mechanisms and to identify unexpected effects of a technology.
“Such analyses are a promising approach to explain the outcomes of the more traditional methods, such as RCTs, by gaining insight into the mediating mechanisms that contribute to the found effects [8,9] and have also the potential to identify unexpected effects of a technology.”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [9]
Cites
(1993) · Cited by 9,879 · see citing works
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-21512-1 · Cited by 5,533 · see citing works
Uses and Gratifications Theory in the 21st Century
Ruggiero, T. E. (2000) · Mass Communication and Society · doi:10.1207/s15327825mcs0301_02 · Cited by 2,810 · see citing works
(2009) · Routledge eBooks · doi:10.4324/9780203877111 · Cited by 1,675 · see citing works
Digital Media, Youth, and Credibility
Metzger, M. J., & Flanagin, A. J. (2007) · Cited by 1,036 · see citing works
Growing Up with Television: Cultivation Processes
Morgan, M., & Shanahan, J. L. (2009) · Routledge eBooks · doi:10.4324/9780203877111-9 · Cited by 675 · see citing works
Communication, Context, and Community
Shah, D. V., McLeod, J. M., & Yoon, S. (2001) · Communication Research · doi:10.1177/009365001028004005 · Cited by 514 · see citing works
A Comprehensive Model of Cancer-Related Information Seeking Applied to Magazines
Johnson, J. D., & Meischke, H. W. (1993) · Human Communication Research · doi:10.1111/j.1468-2958.1993.tb00305.x · Cited by 407 · see citing works
Effect of computer support on younger women with breast cancer
Gustafson, D. H., Hawkins, R., Pingree, S., McTavish, F., Arora, N. K., Mendenhall, J., Cella, D. F., Serlin, R. C., Apantaku, F. M., Stewart, J., et al. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016007435.x · Cited by 387 · see citing works
Rethinking Communication in the E-health Era
Neuhauser, L., & Kreps, G. L. (2003) · Journal of Health Psychology · doi:10.1177/1359105303008001426 · Cited by 344 · see citing works
Internet Connectedness and Inequality
Jung, J.-Y., Qiu, J. L., & Kim, Y. (2001) · Communication Research · doi:10.1177/009365001028004006 · Cited by 291 · see citing works
Pingree, R. J. (2007) · Communication Theory · doi:10.1111/j.1468-2885.2007.00306.x · Cited by 277 · see citing works
Internet Methods for Delivering Behavioral and Health-Related Interventions (eHealth)
Strecher, V. J. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091428 · Cited by 277 · see citing works
Use and Impact of eHealth System by Low-income Women With Breast Cancer
Gustafson, D. H., Mctavish, F. M., Stengle, W., Ballard, D., Hawkins, R. P., Shaw, B. R., Jones, E., Julèsberg, K., McDowell, H., Chen, W. C., et al. (2005) · Journal of Health Communication · doi:10.1080/10810730500263257 · Cited by 202 · see citing works
Randomized pilot of a self-guided internet coping group for women with early-stage breast cancer
Owen, J. E., Klapow, J. C., Roth, D. L., Shuster, J. L., Bellis, J., Meredith, R., & Tucker, D. C. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3001_7 · Cited by 192 · see citing works
Health Promotion and Interactive Technology
Street, R. L., Gold, W. R., & Manning, T. R. (2013) · Routledge eBooks · doi:10.4324/9780203811047 · Cited by 191 · see citing works
Lieberman, M. A., & Goldstein, B. A. (2005) · Psycho-Oncology · doi:10.1002/pon.932 · Cited by 188 · see citing works
UNIFORM MESSAGES AND HABITUAL VIEWING: UNNECESSARY ASSUMPTIONS IN SOCIAL REALITY EFFECTS
Hawkins, R. P., & Pingree, S. (1981) · Human Communication Research · doi:10.1111/j.1468-2958.1981.tb00576.x · Cited by 186 · see citing works
Credibility of Health Information and Digital Media: New Perspectives and Implications for Youth
Eysenbach, G. (2007) · TSpace (University of Toronto) · Cited by 178 · see citing works
Internet-Based Interactive Support for Cancer Patients: Are Integrated Systems Better?
Gustafson, D. H., Hawkins, R. P., Mctavish, F. M., Pingree, S., Chen, W. C., Volrathongchai, K., Stengle, W., Stewart, J. A., & Serlin, R. C. (2008) · Journal of Communication · doi:10.1111/j.1460-2466.2008.00383.x · Cited by 160 · see citing works
Han, J. Y., Shah, D. V., Kim, E., Namkoong, K., Lee, S., Moon, T. J., Cleland, R., Bu, Q. L., Mctavish, F. M., & Gustafson, D. H. (2011) · Health Communication · doi:10.1080/10410236.2010.544283 · Cited by 106 · see citing works
Self-citationExpressing Positive Emotions within Online Support Groups by Women with Breast Cancer
Han, J. Y., Shaw, B. R., Hawkins, R. P., Pingree, S., Mctavish, F. M., & Gustafson, D. H. (2008) · Journal of Health Psychology · doi:10.1177/1359105308097963 · Cited by 104 · see citing works
Self-citationThe value of theory for enhancing and understanding e-health interventions
Pingree, S., Hawkins, R., Baker, T., DuBenske, L., Roberts, L. J., & Gustafson, D. H. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.09.035 · Cited by 103 · see citing works
The Internet and health care: theory, research, and practice
(2006) · Choice Reviews Online · doi:10.5860/choice.44-2144 · Cited by 98 · see citing works
Han, J. Y., Wise, M. E., Kim, E., Pingree, R. J., Hawkins, R. P., Pingree, S., Mctavish, F. M., & Gustafson, D. H. (2010) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2010.01508.x · Cited by 87 · see citing works
Self-citationAge Differences in Information-Seeking among Cancer Patients
Charles, S. T., Meyerowitz, B. E., & Gatz, M. (1997) · The International Journal of Aging and Human Development · doi:10.2190/7cbt-12k3-ga8h-f68r · Cited by 87 · see citing works
The internet and health care : theory, research, and practice
Murero, M., & Rice, R. E. (2006) · Cited by 60 · see citing works
Pingree, S., Hawkins, R. P., Gustafson, D. H., Boberg, E. W., Bricker, E., Wise, M. E., Berhe, H., & Hsu, E. (1996) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838159609364357 · Cited by 52 · see citing works
Unraveling Uses and Effects of an Interactive Health Communication System
Han, J. Y., Hawkins, R. P., Shaw, B. R., Pingree, S., Mctavish, F. M., & Gustafson, D. H. (2009) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838150802643787 · Cited by 49 · see citing works
Self-citationThe Quality of Interactive Computer Use Among HIV-Infected Individuals
SUZA, P. S. R. P. H. (1998) · Journal of Health Communication · doi:10.1080/108107398127508 · Cited by 48 · see citing works
Nicholas, D. M., & Huntington, P. A. (2003) · Journal of Information Science · doi:10.1177/01655515030295005 · Cited by 35 · see citing works
Kim, E., Han, J. Y., Shah, D. V., Shaw, B. R., Mctavish, F. M., Gustafson, D. H., & Fan, D. P. (2011) · Journal of Health Communication · doi:10.1080/10810730.2011.571337 · Cited by 31 · see citing works
Self-citationDelivering Consumer Health Information Digitally: A Comparison Between the Web and Touchscreen Kiosk
Nicholas, D. M., Huntington, P. A., & Williams, P. (2003) · Journal of Medical Systems · doi:10.1023/a:1021053027926 · Cited by 27 · see citing works
Diagnostic and Treatment Decisions in US Healthcare
Kaplan, R. M., Ganiats, T. G., & Frosch, D. L. (2004) · Journal of Health Psychology · doi:10.1177/1359105304036100 · Cited by 26 · see citing works
Assessing used content across five digital health information services using transaction log files
Nicholas, D. M., Huntington, P. A., & Homewood, J. (2003) · Journal of Information Science · doi:10.1177/0165551503296007 · Cited by 18 · see citing works
On the validity of client‐side vs server‐side web log data analysis
Yun, G. W., Ford, J., Hawkins, R. P., Pingree, S., Mctavish, F. M., Gustafson, D. H., & Berhe, H. (2006) · Internet Research · doi:10.1108/10662240610711003 · Cited by 8 · see citing works
Flagged first, then by citations
3 of the 39 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Himelboim, I., & Han, J. Y. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.811321 · Cited by 136 · see citing works
Self-citationVan Gemert-Pijnen, J. E., Kelders, S. M., & Bohlmeijer, E. T. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2991 · Cited by 84 · see citing works
Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data
Sieverink, F., Kelders, S., Poel, M., & van Gemert-Pijnen, L. (2017) · JMIR Research Protocols · doi:10.2196/resprot.6452 · Cited by 88 · see citing works
Ruland, C. M., Maffei, R. M., Børøsund, E., Krahn, A., Andersen, T., & Grimsbø, G. H. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2013.02.007 · Cited by 88 · see citing works
Bonten, T. N., Rauwerdink, A., Wyatt, J. C., Kasteleyn, M. J., Witkamp, L., Riper, H. M., van Gemert‐Pijnen, J. E. W. C., Cresswell, K. M., Sheikh, A., Schijven, M. P., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17774 · Cited by 81 · see citing works
van den Berg, S. W., Peters, E. J., Kraaijeveld, J. F., Gielissen, M. F., & Prins, J. B. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2566 · Cited by 53 · see citing works
Jones, J. B., Weiner, J. P., Shah, N. R., & Stewart, W. F. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3157 · Cited by 49 · see citing works
van de Graaf, D. L., Trompetter, H. R., Smeets, T., & Mols, F. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100465 · Cited by 49 · see citing works
Sieverink, F., Kelders, S. M., Braakman-Jansen, L. M. A., & van Gemert-Pijnen, J. E. W. C. (2014) · Journal of Diabetes Science and Technology · doi:10.1177/1932296814525696 · Cited by 30 · see citing works
Nota, I., Drossaert, C. H. C., Melissant, H. C., Taal, E., Vonkeman, H. E., HAAGSMA, C. J., & van de Laar, M. A. F. J. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0433-5 · Cited by 28 · see citing works
Patient Engagement as Measured by Inpatient Portal Use: Methodology for Log File Analysis
Huerta, T. R., Fareed, N., Hefner, J. L., Sieck, C. J., Swoboda, C. M., Taylor, R. M., & McAlearney, A. S. (2018) · Journal of Medical Internet Research · doi:10.2196/10957 · Cited by 25 · see citing works
How Cancer Patients Use and Benefit from an Interactive Cancer Communication System
Han, J. Y., Hawkins, R. P., Baker, T. B., Shah, D. V., Pingree, S., & Gustafson, D. H. (2017) · Journal of Health Communication · doi:10.1080/10810730.2017.1360413 · Cited by 20 · see citing works
Self-citationInpatient portal clusters: identifying user groups based on portal features
Fareed, N., Walker, D. M., Sieck, C. J., Taylor, R. M., Scarborough, S., Huerta, T. R., & McAlearney, A. S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy147 · Cited by 18 · see citing works
A systematic review on eHealth technology personalization approaches
ten Klooster, I., Kip, H., van Gemert‐Pijnen, J. E. W. C., Crutzen, R., & Kelders, S. M. (2024) · iScience · doi:10.1016/j.isci.2024.110771 · Cited by 18 · see citing works
Hong, T. J. (2012) · Communication Research · doi:10.1177/0093650212439710 · Cited by 15 · see citing works
Methodological pluralism in health communication research
Neumann, M., Kreps, G. L., & Visser, A. P. (2011) · Patient Education and Counseling · doi:10.1016/j.pec.2011.01.018 · Cited by 12 · see citing works
A Longitudinal Study of Use of an Interactive Health Communication System
Han, J. Y. (2011) · Health Communication · doi:10.1080/10410236.2011.578334 · Cited by 8 · see citing works
Self-citationChih, M. (2014) · PubMed Central · Cited by 8 · see citing works
Wentzel, M. J., Jong, D. N., Nijdam, L. C., Drie-Pierik, V. R., & Gemert-Pijnen, V. J. E. W. C. (2014) · University of Twente Research Information · Cited by 7 · see citing works
Understanding Engagement With Forensic Smartphone Apps: The Service Design Engagement Model
Ross, S., Wood, M. A., Johns, D., Murphy, J. M., Baird, R., & Alford, B. (2022) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x221106323 · Cited by 6 · see citing works
Keeping an eye on the context: participatory development of eHealth to support clinical practice
Wentzel, J. (2015) · doi:10.3990/1.9789036539784 · Cited by 6 · see citing works
Sieverink, F. (2017) · doi:10.3990/1.9789036544177 · Cited by 5 · see citing works
Quality Measurement and Improvement Study of Surgical Coronary Revascularization
Liu, C., Du, J.-Z., Rao, C., Zhang, H., Liu, H., Zhao, Y., Yang, L., Li, X., Li, J., Wang, J., et al. (2018) · Chinese Medical Journal · doi:10.4103/0366-6999.233767 · Cited by 4 · see citing works
Sieverink, F., Kelders, S. M., Akkersdijk, S. M., Poel, M., Siemons, L., & van Gemert‐Pijnen, J. E. W. C. (2016) · University of Twente Research Information · Cited by 3 · see citing works
Guo, H., Xiao, Y., Liao, C., Sun, J., Xie, Y., Zheng, Y., & Fan, G. (2023) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1141645 · Cited by 1 · see citing works
Dharmayanti, P. A., Atmoko, A., Lasan, B. B., Muslihati, M., & Lestari, P. S. (2023) · Mimbar Ilmu · doi:10.23887/mi.v28i3.72034 · Cited by 1 · see citing works
Examining the influence of an online health behaviour support tool for high school aged youth
Malbon, C. A. (2012) · UVic’s Research and Learning Repository (University of Victoria) · Cited by 1 · see citing works
Børøsund, E. (2015) · NORA - Norwegian Open Research Archives
ADDRESSING TECHNOLOGY ISSUES THAT MAY IMPEDE E-HEALTH COMPLIANCE: A CASE STUDY
Richards, D., Noriega-Ardila, S., & Caldwell, P. H. Y. (2014) · Journal of the Association for Information Systems
Kurt, E. V. (2021) · Gümüşhane Üniversitesi İletişim Fakültesi Elektronik Dergisi · doi:10.19145/e-gifder.916702
- Authors
- Han, J. Y.
- Affiliations
- University of Georgia (US)
- Corresponding author
- Han, Jeong Yeob
- ORCID
- Han, Jeong Yeob
- Venue
- Patient Education and Counseling
- Publisher
- Elsevier BV
- Published
- 2011-03
- Volume
- 82
- Issue
- 3
- Pages
- 307-312
- ISSN
- 0738-3991 (ISSN-L)
- OpenAlex
- W2029246441
- Cited by
- 31
- References
- 39
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 1 · 2021: 2 · 2020: 1 · 2018: 3 · 2017: 5 · 2016: 1 · 2015: 3 · 2014: 5 · 2013: 3 · 2012: 2
- FWCI
- 7.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Patient Education and Counseling (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of Georgia
- University of Georgia Research Foundation
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- health communication research, user behavior, information seeking, log analysis, user-centered design
- MeSH terms
- Comprehensive Health Care, Humans, Information Systems, Medical Informatics, Patient Education as Topic, Research Design, Transactional Analysis, Patient-Centered Care, Internet, Information Seeking Behavior, Health Communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review