UX Heatmaps: Mapping User Experience on Visual Interfaces
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
In this paper, we present an off-the-shelf UX evaluation tool which contextualizes users' physiological and behavioral signals while interacting with a system. The proposed tool triangulates users' gaze data with inferred users' cognitive and emotional states to produce user experience (UX) heatmaps, which show where users were looking when they experienced specific cognitive and emotional states. Results show that for a given cognitive state (i.e., cognitive load), the proposed UX heatmap was able to effectively highlight the areas where users experienced different levels of cognitive load on an interface. The proposed tool enables the visual analysis of users' various emotional and cognitive states for specific areas on a given interface, and also to compare users' states across multiple interfaces, which should be useful for both UX researchers and practitioners.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202,217,224].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [76]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“According to Sweller [30], intrinsic cognitive load is linked to the material's content, extraneous cognitive load is based on the presentation forms, and germane cognitive load involves information consolidation.”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1×
“The regulation of emotional and cognitive states relies at once upon the sympathetic and parasympathetic activity of the autonomic nervous system, and thus requires physiological adjustments stemming from multiple response patterns [20].”
BackgroundEye Tracking: A comprehensive guide to methods and measures
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R. J., Jarodzka, H. M., & van de Weijer, J. (2015) · Lund University Publications (Lund University) · Cited by 2,919
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Social desirability bias: A neglected aspect of validity testing
King, M. F., & Bruner, G. C. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<79::aid-mar2>3.0.co;2-0 · Cited by 1,067
Pupillometry: A Window to the Preconscious?
Laeng, B., Sirois, S., & Gredebäck, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611427305 · Cited by 921
Needs, affect, and interactive products – Facets of user experience
Hassenzahl, M., Diefenbach, S., & Göritz, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.002 · Cited by 867
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
(2014) · doi:10.1145/2556288 · Cited by 818
User experience evaluation methods: current state and development needs
Vermeeren, A. P. O. S., Law, E. L.-C., Roto, V., Obrist, M., Hoonhout, J., & Väänänen-Vainio-Mattila, K. (2010) · Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries · doi:10.1145/1868914.1868973 · Cited by 592
Studies in the New Experimental Aesthetics
Alluisi, E. A., & Berlyne, D. E. (1975) · The American Journal of Psychology · doi:10.2307/1421783 · Cited by 558
Social-desirability bias and the validity of self-reported values
Fisher, R. J., & Katz, J. E. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<105::aid-mar3>3.0.co;2-9 · Cited by 544
Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes.
Robinson, M. D., & Clore, G. L. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.1.198 · Cited by 531 · cited 1×
“More so, these methods assess user perceptions either after or during the interaction, which induces retrospective biases or disrupts the user experience [9, 27].”
MethodNielsen, J., & Pernice, K. (2009) · Cited by 446
Galvanic skin response (GSR) as an index of cognitive load
Shi, Y., Ruiz, N., Taib, R., Choi, E., & Chen, F. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1241057 · Cited by 423
An eye-tracking study of website complexity from cognitive load perspective
Wang, Q., Yang, S., Liu, M., Cao, Z., & Ma, Q. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.02.007 · Cited by 411
Psycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 1×
“For example, heart rate can be associated with shifts from low to high mental workload [12].”
BackgroundDriver workload and eye blink duration
Benedetto, S., Pedrotti, M., Minin, L., Baccino, T., Re, A., & Montanari, R. (2011) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2010.12.001 · Cited by 303
Self-citationOlkin, I., & Finn, J. D. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.118.1.155 · Cited by 284
Identifying the Perceptual Dimensions of Visual Complexity of Scenes
Olivia, A., Mack, M. L., Shrestha, M., & Peeper, A. (2004) · eScholarship (California Digital Library) · Cited by 174
Physiological responses to different WEB page designs
Ward, R. D., & Marsden, P. H. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00019-3 · Cited by 169
Fixation maps: quantifying eye-movement traces
Wooding, D. S. (2002) · Proceedings of the symposium on Eye tracking research & applications - ETRA '02 · doi:10.1145/507072.507078 · Cited by 165
Toward a definition of visual complexity as an implicit measure of cognitive load
Harper, S., Michailidou, E., & Stevens, R. (2009) · ACM Transactions on Applied Perception · doi:10.1145/1498700.1498704 · Cited by 154
Defining user experience goals to guide the design of industrial systems
Kaasinen, E., Roto, V., Hakulinen, J., Heimonen, T., Jokinen, J. P. P., Karvonen, H., Keskinen, T., Koskinen, H., Lu, Y., Saariluoma, P., et al. (2015) · Behaviour & Information Technology · doi:10.1080/0144929x.2015.1035335 · Cited by 130
de Guinea, A. O., Titah, R., & Léger, P.-M. (2014) · Journal of Management Information Systems · doi:10.2753/mis0742-1222300407 · Cited by 127
Psychophysiological Science: Interdisciplinary Approaches to Classic Questions About the Mind
Cacioppo, J. T., Tassinary, L. G., & Berntson, G. G. (2009) · Handbook of Psychophysiology · doi:10.1017/cbo9780511546396.001 · Cited by 109
Human-Centred Intelligent Human Computer Interaction (HCI²): how far are we from attaining it?
Pantic, M., Nijholt, A., Pentland, A., & Huanag, T. S. (2008) · International Journal of Autonomous and Adaptive Communications Systems · doi:10.1504/ijaacs.2008.019799 · Cited by 109
The FaceReader: measuring instant fun of use
Zaman, B., & Shrimpton-Smith, T. (2006) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1182475.1182536 · Cited by 89
LEMtool: measuring emotions in visual interfaces
Huisman, G., van Hout, M., van Dijk, E. M. A. G., van der Geest, T., & Heylen, D. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470706 · Cited by 61
User Experience Evaluation – Which Method to Choose?
Roto, V., Vermeeren, A. P. O. S., Väänänen, K., & Law, E. L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23768-3_129 · Cited by 35
Cognitive Models of the Influence of Color Scale on Data Visualization Tasks
Breslow, L. A., Ratwani, R. M., & Trafton, J. G. (2009) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809338286 · Cited by 29
Kivikangas, J. M., Nacke, L. E., & Ravaja, N. (2011) · Entertainment Computing · doi:10.1016/j.entcom.2011.03.006 · Cited by 20
Emotion scents: a method of representing user emotions on GUI widgets
Cernea, D., Weber, C., Ebert, A., & Kerren, A. (2013) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2001261 · Cited by 19
Dufresne, A., Tep, S. P., Sénéchal, S., & Courtemanche, F. (2010) · Cited by 17
Self-citationCourtemanche, F., Dufresne, A., & Labonté-LeMoyne, É. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-45686-6_3 · Cited by 5
Self-citation
Research works printed but not linked: 3
- Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009. Ganglbauer E. Schrammel J. Deutsch S. and Tscheligi M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities Challenges and Feasibility User Experience Evaluation Methods in Product Development (UXEM'09) workshop at the 12th IFIP TC13 Conference on Human-Computer Interaction 2009.
- 10.1037/0033-2909.118.1.155 · doi:10.1037/0033-2909.118.1.155 · Paper page
- van den Broek , E. , van der Zwaag , M.D. , Healey , J.A. , Janssen , J.H. and Westerink , J.H.D. M . Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010 , Valencia, Spain , 2010 , 59--66. van den Broek, E., van der Zwaag, M.D., Healey, J.A., Janssen, J.H. and Westerink, J.H.D.M. Prerequisites for Affective Signal Processing (ASP) - Part IV 1st International Workshop on Bioinspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010, Valencia, Spain, 2010, 59--66.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Measurements of EDA and derived metrics have been successfully applied, including, e.g., user experience evaluation tools [76], detecting office workload [216] and driver-related tasks [202, 217, 224].”
InfluentialEye Tracking, Usability, and User Experience: A Systematic Review
Novák, J. Š., Masner, J., Benda, P., Šimek, P., & Merunka, V. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2221600 · Cited by 238
Tcha-Tokey, K., Christmann, O., Loup-Escande, E., & Richir, S. (2016) · International Journal of Virtual Reality · doi:10.20870/ijvr.2016.16.1.2880 · Cited by 206
Büschel, W., Lehmann, A., & Dachselt, R. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445651 · Cited by 143
AI Assistance for UX: A Literature Review Through Human-Centered AIPreprint
Lu, Y., Yang, Y., Zhao, Q., Zhang, C., & Li, T. J.-J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06089 · Cited by 102
Metadata
- Authors
- Georges, V., Courtemanche, F., Senecal, S., Baccino, T., Fredette, M., & Leger, P.-M.
- Affiliations
- HEC Montréal (CA)
- HEC Montreal, Montreal, Canada
- Université Paris 8 (FR)
- HEC montreal, montreal, Canada
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 4850-4860
- OpenAlex
- W2406420416
- Cited by
- 29
- References
- 37
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 3 · 2019: 3 · 2017: 3 · 2016: 1
- FWCI
- 1.59
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Social Sciences and Humanities Research Council (SSHRC) (435-2012-1232)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- user experience evaluation, gaze tracking, cognitive load, emotional state, physiological signals, behavioral signals, user interface usability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.