UX Heatmaps: Mapping User Experience on Visual Interfaces
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
In this paper, we present an off-the-shelf UX evaluation tool which contextualizes users' physiological and behavioral signals while interacting with a system. The proposed tool triangulates users' gaze data with inferred users' cognitive and emotional states to produce user experience (UX) heatmaps, which show where users were looking when they experienced specific cognitive and emotional states. Results show that for a given cognitive state (i.e., cognitive load), the proposed UX heatmap was able to effectively highlight the areas where users experienced different levels of cognitive load on an interface. The proposed tool enables the visual analysis of users' various emotional and cognitive states for specific areas on a given interface, and also to compare users' states across multiple interfaces, which should be useful for both UX researchers and practitioners.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202,217,224].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [76]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“According to Sweller [30], intrinsic cognitive load is linked to the material's content, extraneous cognitive load is based on the presentation forms, and germane cognitive load involves information consolidation.”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1×
“The regulation of emotional and cognitive states relies at once upon the sympathetic and parasympathetic activity of the autonomic nervous system, and thus requires physiological adjustments stemming from multiple response patterns [20].”
BackgroundEye Tracking: A comprehensive guide to methods and measures
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R. J., Jarodzka, H. M., & van de Weijer, J. (2015) · Lund University Publications (Lund University) · Cited by 2,919
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Social desirability bias: A neglected aspect of validity testing
King, M. F., & Bruner, G. C. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<79::aid-mar2>3.0.co;2-0 · Cited by 1,067
Pupillometry: A Window to the Preconscious?
Laeng, B., Sirois, S., & Gredebäck, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611427305 · Cited by 921
Needs, affect, and interactive products – Facets of user experience
Hassenzahl, M., Diefenbach, S., & Göritz, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.002 · Cited by 867
Research works printed but not linked: 3
- Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009. Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009.
- 10.1037/0033-2909.118.1.155 · doi:10.1037/0033-2909.118.1.155 · Paper page
- van den Broek , E. , van der Zwaag , M.D. , Healey , J.A. , Janssen , J.H. and Westerink , J.H.D. M . Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010 , Valencia, Spain , 2010 , 59--66. van den Broek, E., van der Zwaag, M.D., Healey, J.A., Janssen, J.H. and Westerink, J.H.D.M. Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010, Valencia, Spain, 2010, 59--66.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202, 217, 224].”
InfluentialEye Tracking, Usability, and User Experience: A Systematic Review
Novák, J. Š., Masner, J., Benda, P., Šimek, P., & Merunka, V. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2221600 · Cited by 238
Tcha-Tokey, K., Christmann, O., Loup-Escande, E., & Richir, S. (2016) · International Journal of Virtual Reality · doi:10.20870/ijvr.2016.16.1.2880 · Cited by 206
Büschel, W., Lehmann, A., & Dachselt, R. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445651 · Cited by 143
AI Assistance for UX: A Literature Review Through Human-Centered AIPreprint
Lu, Y., Yang, Y., Zhao, Q., Zhang, C., & Li, T. J.-J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06089 · Cited by 103
A Critique of Electrodermal Activity Practices at CHI
Babaei, E., Tag, B., Dingler, T., & Velloso, E. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445370 · Cited by 81
Advancing Patient-Centered Shared Decision-Making with AI Systems for Older Adult Cancer Patients
Hao, Y., Liu, Z., Riter, R. N., & Kalantari, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642353 · Cited by 62
Physiological heatmaps: a tool for visualizing users’ emotional reactions
Courtemanche, F., Léger, P., Dufresne, A., Frédette, M., Labonté-LeMoyne, É., & Sénécal, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5091-1 · Cited by 60
Self-citationThe tone of voice of tourism brands on social media: Does it matter?
Barcelos, R. H., Dantas, D. C., & Sénécal, S. (2019) · Tourism Management · doi:10.1016/j.tourman.2019.03.008 · Cited by 52
HCITools: Strategies and Best Practices for Designing, Evaluating and Sharing Technical HCI Toolkits
Marquardt, N., Houben, S., Beaudouin-Lafon, M., & Wilson, A. D. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3027073 · Cited by 42
Exploring the Effect of Visual Cues on Eye Gaze During AR-Guided Picking and Assembly Tasks
Seeliger, A., Merz, G., Holz, C., & Feuerriegel, S. (2021) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct54149.2021.00041 · Cited by 40
The Influence of Online Search Behavior on Consumers’ Decision-Making Heuristics
Etco, M., Sénécal, S., Léger, P., & Frédette, M. (2016) · Journal of Computer Information Systems · doi:10.1080/08874417.2016.1232987 · Cited by 27
A Toolkit for the Automatic Analysis of Human Behavior in HCI Applications in the Wild
Generosi, A., Ceccacci, S., Faggiano, S., Giraldi, L., & Mengoni, M. (2020) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj050622 · Cited by 25
Dávila, F. M. C., Paz, F., & Moquillaza, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35702-2_1 · Cited by 23
The Adoption of Physiological Measures as an Evaluation Tool in UX
Georges, V., Courtemanche, F., Sénécal, S., Léger, P., Nacke, L. E., & Pourchon, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58481-2_8 · Cited by 22
Self-citationA Systematic Review for Cognitive State-Based QoE/UX Evaluation
Bañuelos-Lozoya, E., González, G., González-Franco, N., Díaz, O. G. F., & Castro-Sánchez, N. A. (2021) · Sensors · doi:10.3390/s21103439 · Cited by 21
Systematic Literature Review of Automation and Artificial Intelligence in Usability Issue Detection
Kuric, E., Demcak, P., Krajcovic, M., & Lang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.01415 · Cited by 18
Assessing User Experience via Biometric Sensor Affect Detection
Kula, I., Branaghan, R. J., Atkinson, R. K., & Roscoe, R. D. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2639-1.ch006 · Cited by 13
Is usability testing valid with prototypes where clickable hotspots are highlighted upon misclick?
Krajcovic, M., Demcak, P., & Kuric, E. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112446 · Cited by 13
Emotional Maps for User Experience Research in the Wild
Georges, V., Courtemanche, F., Frédette, M., & Doyon-Poulin, P. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3383042 · Cited by 11
Self-citationAlkhathlan, M., Tlachac, M., Harrison, L., & Rundensteiner, E. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85623-6_23 · Cited by 11
Sensing What Surveys Miss: Understanding and Personalizing Proactive LLM Support by User Modeling
Liu, A., Karoui, Y., Draxler, F., Kreuter, F., & Chiossi, F. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791191 · Cited by 9
Market Engineering: Insights from Two Decades of Research on Markets and Information
Gimpel, H., Krämer, J., Neumann, D., Pfeiffer, J., Seifert, S., Teubner, T., Veit, D. J., & Weidlich, A. (2021) · Springer eBooks · doi:10.1007/978-3-030-66661-3 · Cited by 8
An Exploratory Study on the Impact of Collective Immersion on Learning and Learning Experience
Vignaux, M. M. D., Léger, P., Charland, P., Salame, Y., Durand, E., Bouillot, N., Pardoen, M., & Sénécal, S. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5040017 · Cited by 6
Towards Agility and Speed in Enriched UX Evaluation Projects
Alvarez, J., Brieugne, D., Léger, P., Sénécal, S., & Frédette, M. (2019) · IntechOpen eBooks · doi:10.5772/intechopen.89762 · Cited by 5
Human 4.0 - From Biology to Cybernetic
Rybarczyk, Y. P. (2019) · IntechOpen eBooks · doi:10.5772/intechopen.77612 · Cited by 4
Assessing User Experience via Biometric Sensor Affect Detection
Kula, I., Branaghan, R. J., Atkinson, R. K., & Roscoe, R. D. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8356-1.ch036 · Cited by 2
Gaze2Prompt: Turning Eye-Tracking Data into Visual Prompts for Multimodal LLMs
Choi, J. Y., Kim, S. G., Jeong, J. H., Rossi, R. A., Kil, J., & Lee, T. Y. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3754401 · Cited by 1
Simard, F., Aumont, T., Kizuk, S. A. D., & Fortin, P. E. (2022) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3536220.3558039 · Cited by 1
Viewer Arousal Display System Using Eye-Tracking and Skin Conductance Data
Omata, M., & Shimizu, K. (2019) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3369457.3369481
The Socialoid: A Computational Model of a City
Hall, M., Haas, C. S., Schacht, J., & Kimbrough, S. O. (2020) · Springer eBooks · doi:10.1007/978-3-030-66661-3_12
Design Science Methodology for AI-Based Contract Design Research
Nuottila, J., Hurmerinta‐Haanpää, A., & Autto, H. (2025) · Law, governance and technology series · doi:10.1007/978-3-031-80111-2_16
РЕКОМЕНДАЦІЇ ЩОДО ПРАВИЛ ЕРГОНОМІЧНОГО РОЗМІЩЕННЯ ВІДОМОСТЕЙ НА ВЕБ-СТОРІНЦІ
Leshko, R. Y., Гольський, В., Попович, А., Stolyarchuk, I. D., & Григорович, А. (2025) · Наука і техніка сьогодні · doi:10.52058/2786-6025-2025-3(44)-1216-1229
KULLANICI ARAYÜZLERİNİN KULLANICILARA OLAN ETKİSİ ÜZERİNE BİR ÇALIŞMA
Fırlar, T., & Mehdiyev, H. (2025) · Beykent üniversitesi fen ve mühendislik bilimleri dergisi · doi:10.20854/bujse.1702766
Salazar, M. B. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
ARAYÜZ TASARIMININ GELECEĞİ ÜZERİNE BİR ÇALIŞMA
Fırlar, T., & Mammadzada, J. (2025) · Beykent üniversitesi fen ve mühendislik bilimleri dergisi · doi:10.20854/bujse.1816706
A STUDY ON THE IMPACT OF USER INTERFACES ON USERS
Fırlar, T., & Mehdiyev, H. (2025) · Beykent üniversitesi fen ve mühendislik bilimleri dergisi
Métodos psicofisiológicos de avaliação de UX: um mapeamento sistemático
Kamimura, F. I. D. M. (2022) · Institutional Repository of the Federal Technological University of Paraná (RIUT) (Federal University of Technology – Paraná)
Operationalisierung der Usability-Evaluation
Vindigni, G. (2026) · Springer eBooks · doi:10.1007/978-3-662-72235-0_4
Moura, F. R. T., & Seruffo, M. C. D. R. (2026) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3788851.3815058
Katseenseurantapalvelu käytettävyyden arvioinnissa
Kosonen, E. (2024) · UEF eRepo (University of Eastern Finland)
Metadata
- Authors
- Georges, V., Courtemanche, F., Senecal, S., Baccino, T., Fredette, M., & Leger, P.-M.
- Affiliations
- HEC Montréal (CA)
- HEC Montreal, Montreal, Canada
- Université Paris 8 (FR)
- HEC montreal, montreal, Canada
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 4850-4860
- OpenAlex
- W2406420416
- Cited by
- 29
- References
- 37
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 3 · 2019: 3 · 2017: 3 · 2016: 1
- FWCI
- 1.59
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Social Sciences and Humanities Research Council (SSHRC) (435-2012-1232)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- user experience evaluation, gaze tracking, cognitive load, emotional state, physiological signals, behavioral signals, user interface usability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.