UX Heatmaps: Mapping User Experience on Visual Interfaces
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
In this paper, we present an off-the-shelf UX evaluation tool which contextualizes users' physiological and behavioral signals while interacting with a system. The proposed tool triangulates users' gaze data with inferred users' cognitive and emotional states to produce user experience (UX) heatmaps, which show where users were looking when they experienced specific cognitive and emotional states. Results show that for a given cognitive state (i.e., cognitive load), the proposed UX heatmap was able to effectively highlight the areas where users experienced different levels of cognitive load on an interface. The proposed tool enables the visual analysis of users' various emotional and cognitive states for specific areas on a given interface, and also to compare users' states across multiple interfaces, which should be useful for both UX researchers and practitioners.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202,217,224].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [76]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“According to Sweller [30], intrinsic cognitive load is linked to the material's content, extraneous cognitive load is based on the presentation forms, and germane cognitive load involves information consolidation.”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1×
“The regulation of emotional and cognitive states relies at once upon the sympathetic and parasympathetic activity of the autonomic nervous system, and thus requires physiological adjustments stemming from multiple response patterns [20].”
BackgroundEye Tracking: A comprehensive guide to methods and measures
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R. J., Jarodzka, H. M., & van de Weijer, J. (2015) · Lund University Publications (Lund University) · Cited by 2,919
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Social desirability bias: A neglected aspect of validity testing
King, M. F., & Bruner, G. C. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<79::aid-mar2>3.0.co;2-0 · Cited by 1,067
Pupillometry: A Window to the Preconscious?
Laeng, B., Sirois, S., & Gredebäck, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611427305 · Cited by 921
Needs, affect, and interactive products – Facets of user experience
Hassenzahl, M., Diefenbach, S., & Göritz, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.002 · Cited by 867
Research works printed but not linked: 3
- Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009. Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009.
- 10.1037/0033-2909.118.1.155 · doi:10.1037/0033-2909.118.1.155 · Paper page
- van den Broek , E. , van der Zwaag , M.D. , Healey , J.A. , Janssen , J.H. and Westerink , J.H.D. M . Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010 , Valencia, Spain , 2010 , 59--66. van den Broek, E., van der Zwaag, M.D., Healey, J.A., Janssen, J.H. and Westerink, J.H.D.M. Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010, Valencia, Spain, 2010, 59--66.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202, 217, 224].”
InfluentialEye Tracking, Usability, and User Experience: A Systematic Review
Novák, J. Š., Masner, J., Benda, P., Šimek, P., & Merunka, V. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2221600 · Cited by 238
Tcha-Tokey, K., Christmann, O., Loup-Escande, E., & Richir, S. (2016) · International Journal of Virtual Reality · doi:10.20870/ijvr.2016.16.1.2880 · Cited by 206
Büschel, W., Lehmann, A., & Dachselt, R. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445651 · Cited by 143
AI Assistance for UX: A Literature Review Through Human-Centered AIPreprint
Lu, Y., Yang, Y., Zhao, Q., Zhang, C., & Li, T. J.-J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06089 · Cited by 102
Metadata
- Authors
- Georges, V., Courtemanche, F., Senecal, S., Baccino, T., Fredette, M., & Leger, P.-M.
- Affiliations
- HEC Montréal (CA)
- HEC Montreal, Montreal, Canada
- Université Paris 8 (FR)
- HEC montreal, montreal, Canada
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 4850-4860
- OpenAlex
- W2406420416
- Cited by
- 29
- References
- 37
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 3 · 2019: 3 · 2017: 3 · 2016: 1
- FWCI
- 1.59
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Social Sciences and Humanities Research Council (SSHRC) (435-2012-1232)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- user experience evaluation, gaze tracking, cognitive load, emotional state, physiological signals, behavioral signals, user interface usability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: UX Heatmaps: Mapping User Experience on Visual Interfaces. https://app.cochat.ai/papers/10.1145/2858036.2858271
- The paper
- Georges, V., Courtemanche, F., Senecal, S., Baccino, T., Fredette, M., & Leger, P.-M. (2016). UX Heatmaps: Mapping User Experience on Visual Interfaces. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/2858036.2858271
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.