The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Examining the generalizability of the User Engagement Scale (UES) in exploratory search
Open accessAbstract
The user experience is an integral component of interactive information retrieval (IIR). However, there is a twofold problem in its measurement. Firstly, while many IIR studies have relied on a single dimension of user feedback, that of satisfaction, experience is a much more complex concept. IIR in general, and exploratory search more specifically, are dynamic, multifaceted experiences that evoke pragmatic and hedonic needs, expectations, and outcomes that are not adequately captured by user satisfaction. Secondly, questionnaires, which are typically the means in which user's attitudes and perceptions are measured, are not typically subjected to rigorous reliability and validity testing. To address these issues, we administered the multidimensional User Engagement Scale (UES) in an exploratory search environment to assess users' perceptions of the Perceived Usability (PUs), Aesthetics (AE), Novelty (NO), Felt Involvement (FI), Focused Attention (FA), and Endurability (EN) aspects of the experience. In a typical laboratory-style study, 381 participants performed three relatively complex search tasks using a novel search interface, and responded to the UES immediately upon completion. We used Principal Axis Factor Analysis and Multiple Regression to examine the factor structure of UES items and the relationships amongst factors. Results showed that three of the six sub-scales (PUs, AE, FA) were stable, while NO, FI and EN merged to form a single factor. We discuss recommendations for revising and validating the UES in light of these findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Self-citationThe Analysis of Social Science Data with Missing Values
LITTLE, R. J. A., & RUBIN, D. B. (1989) · Sociological Methods & Research · doi:10.1177/0049124189018002004 · Cited by 1,016
Factor analysis and scale revision.
Reise, S. P., Waller, N. G., & Comrey, A. L. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.3.287 · Cited by 855
Cited by
O’Brien, H. L., Cairns, P., & Hall, M. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.01.004 · Cited by 1,014
Self-citationMeasuring engagement in video game-based environments: Investigation of the User Engagement Scale
Wiebe, E. N., Lamb, A., Hardy, M., & Sharek, D. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.12.001 · Cited by 306
Engagement in HCI: Conception, Theory and Measurement
Doherty, K., & Doherty, G. (2019) · ACM Computing Surveys · doi:10.1145/3234149 · Cited by 264
Lalmas, M., O’Brien, H., & Yom-Tov, E. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02289-0 · Cited by 192
Self-citationTheoretical Perspectives of Adherence to Web-Based Interventions: a Scoping Review
Ryan, C., Bergin, M., & Wells, J. S. (2018) · International Journal of Behavioral Medicine · doi:10.1007/s12529-017-9678-8 · Cited by 86
Nitsch, M., Dimopoulos, C. N., Flaschberger, E., Saffran, K., Kruger, J. F., Garlock, L., Wilfley, D. E., Taylor, C. B., & Jones, M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4972 · Cited by 87
Does gamification engage users in online shopping?
García-Jurado, A., Torres-Jiménez, M., Leal-Rodríguez, A. L., & Castro-González, P. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101076 · Cited by 81
Xu, N., Li, Y., Wei, X., Xie, L., Yu, L., & Liang, H.-N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2171350 · Cited by 75
Chen, A. T., Wu, S., Tomasino, K. N., Lattie, E. G., & Mohr, D. C. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103187 · Cited by 58
Wong, V., Smith, A. J., Hawkins, N. J., Kumar, R. K., Young, N., Kyaw, M., & Velan, G. M. (2015) · Academic Radiology · doi:10.1016/j.acra.2015.07.002 · Cited by 55
Applicability of the User Engagement Scale to Mobile Health: A Survey-Based Quantitative Study
(2019) · doi:10.2196/13244 · Cited by 54
Metadata
- Authors
- O’Brien, H. L., & Toms, E. G.
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2013-09
- Volume
- 49
- Issue
- 5
- Pages
- 1092-1107
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W2121131916
- Cited by
- 179
- References
- 4
- FWCI
- 22.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.