Cited by 16Usability and User Interface DesignInnovative Human-Technology InteractionEmotion and Mood Recognition

The DOI matches its Crossref record; 91 of the 92 references it cites were found in a registry or an index.

Do You Feel the Same? On the Robustness of Cued-Recall Debriefing for User Experience Evaluation

Bruun, Anders, Law, Effie Lai-Chong, Nielsen, Thomas Dyhre, Heintz, Matthias·2021·ACM Transactions on Computer-Human Interaction

DOI 10.1145/3453479

Open this paper in CoChat — free account

Abstract

Cued Recall Debriefing (CRD) is a form of retrospective think aloud approach. It involves re-immersing users to a level where emotional responses are comparable to those experienced during actual interaction with a system. To validate whether the robustness of CRD would vary with the time gap between the actual and recalled event and with the affective state preceding the recall, two empirical studies with altogether 100 participants were conducted. Specifically, participants’ emotions were measured in terms of galvanic skin response (GSR) , heart rate (HR) , and self-assessment manikin (SAM) rating when they were interacting with an email client seeded with usability problems. The same measures were taken when they viewed the videoed interactions. Two between-subject variables were ‘intervening time’ (from 0 minutes up to 24 hours) and ‘intervening affect’ (images with different valence and arousal). Advanced computational models were applied to optimise the shifting of GSR/HR waves generated at the actual interaction and recall phases, which were found to be significantly correlated. The shifting process is necessary for addressing the memory effect and is a methodological innovation. Overall, CRD proved to be a robust method that can be deployed to a broad range of HCI research and practice contexts.

Integrity signals

Registry

Crossref · 10.1145/3453479

Cites

91 of 91 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767
Bad Is Stronger Than Good
Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001) · Review of General Psychology · doi:10.1037/1089-2680.5.4.323 · Cited by 7,678
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Untitled work
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Negativity Bias, Negativity Dominance, and Contagion
Rozin, P., & Royzman, E. B. (2001) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0504_2 · Cited by 4,342
What are emotions? And how can they be measured?
Scherer, K. R. (2005) · Social Science Information · doi:10.1177/0539018405058216 · Cited by 4,264
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Positive emotions broaden the scope of attention and thought‐action repertoires
Fredrickson, B. L., & Branigan, C. (2005) · Cognition & Emotion · doi:10.1080/02699930441000238 · Cited by 3,521
A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004) · Science · doi:10.1126/science.1103572 · Cited by 3,422
The emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544
Los cinco grandes across cultures and ethnic groups: multitrait multimethod analyses of the big five in Spanish and English.
Benet-Martínez, V., & John, O. P. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.3.729 · Cited by 1,996
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940 · cited 1×
“Osgood’s three-dimensional model evolved into Semantic Differential Measures of Emotional States [94, 95] and SAM [18].”
Background
The Electrodermal System
Dawson, M. E., Schell, A. M., Filion, D. L., & Berntson, G. G. (2009) · Handbook of Psychophysiology · doi:10.1017/cbo9780511546396.007 · Cited by 1,720
When More Pain Is Preferred to Less: Adding a Better End
Kahneman, D., Fredrickson, B. L., Schreiber, C. A., & Redelmeier, D. A. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00589.x · Cited by 1,502
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
Experience Sampling Method
Hektner, J., Schmidt, J., & Csikszentmihalyi, M. (2007) · doi:10.4135/9781412984201 · Cited by 1,174
Patients' memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures
Redelmeier, D. A., & Kahneman, D. (1996) · Pain · doi:10.1016/0304-3959(96)02994-6 · Cited by 1,078 · cited 1×
“This is due to the gap between what we actually experience and what we can freely recall, an effect often referred to as the “memory experience gap” or “peak-end effect” [57, 77, 90].”
Background
Understanding experience in interactive systems
Forlizzi, J., & Battarbee, K. (2004) · Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/1013115.1013152 · Cited by 925
Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses
Scollon, C. N., Kim-Prieto, C., & Diener, E. (2003) · Journal of Happiness Studies · doi:10.1023/a:1023605205115 · Cited by 825
Thinking aloud: reconciling theory and practice
Boren, T., & Ramey, J. (2000) · IEEE Transactions on Professional Communication · doi:10.1109/47.867942 · Cited by 808
SenseCam: A Retrospective Memory Aid
Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. (2006) · Lecture Notes in Computer Science · doi:10.1007/11853565_11 · Cited by 753
The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance
Dan-Glauser, E. S., & Scherer, K. R. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0064-1 · Cited by 736
Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience
Bargas-Avila, J. A., & Hornbæk, K. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979336 · Cited by 660
The validity of verbal protocols
Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989) · Memory & Cognition · doi:10.3758/bf03202637 · Cited by 543
A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies
Mandryk, R. L., & Atkins, M. S. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.011 · Cited by 538
Using psychophysiological techniques to measure user experience with entertainment technologies
Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006) · Behaviour & Information Technology · doi:10.1080/01449290500331156 · Cited by 518
Retrieval of emotional memories.
Buchanan, T. W. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.761 · Cited by 499
Retrospective vs. concurrent think-aloud protocols: Testing the usability of an online library catalogue
van den Haak, M., De Jong, M., & Jan Schellens, P. (2003) · Behaviour & Information Technology · doi:10.1080/0044929031000 · Cited by 486
Patterns of mobile device use by caregivers and children during meals in fast food restaurants
Radesky, J. S., Kistin, C. J., Zuckerman, B., Nitzberg, K., Gross, J., Kaplan-Sanoff, M., Augustyn, M., & Silverstein, M. (2014) · Pediatrics · doi:10.1542/peds.2013-3703 · Cited by 468
Observations: SAM: The Self-Assessment Manikin An Efficient Cross-Cultural Measurement Of Emotional Response 1
Morris, J. D. (1995) · Journal of Advertising Research · Cited by 465
Memories of colonoscopy: a randomized trial
Redelmeier, D. A., Katz, J., & Kahneman, D. (2003) · Pain · doi:10.1016/s0304-3959(03)00003-4 · Cited by 460
A comparison of coping assessed by ecological momentary assessment and retrospective recall.
Stone, A. A., Schwartz, J. E., Neale, J. M., Shiffman, S., Marco, C. A., Hickcox, M., Paty, J., Porter, L. S., & Cruise, L. J. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.74.6.1670 · Cited by 449
How emotion is made and measured
Boehner, K., DePaula, R., Dourish, P., & Sengers, P. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.016 · Cited by 444
Human-computer interaction – Interact 84
(1986) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(86)90067-4 · Cited by 402
Distinguishing anger and anxiety in terms of emotional response factors.
Russell, J. A., & Mehrabian, A. (1974) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0035915 · Cited by 364
Uncovering the Problem-Solving Process: Cued Retrospective Reporting Versus Concurrent and Retrospective Reporting.
van Gog, T., Paas, F., van Merriënboer, J. J. G., & Witte, P. (2005) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.11.4.237 · Cited by 359
Emotion and perception: the role of affective information
Zadra, J. R., & Clore, G. L. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.147 · Cited by 346
Do life-logging technologies support memory for the past?: an experimental study using sensecam
Sellen, A. J., Fogg, A., Aitken, M., Hodges, S., Rother, C., & Wood, K. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240636 · Cited by 324
Appraisal Theory: Old and New Questions
Ellsworth, P. C. (2013) · Emotion Review · doi:10.1177/1754073912463617 · Cited by 324
Multiple Arousal Theory and Daily-Life Electrodermal Activity Asymmetry
Picard, R. W., Fedor, S., & Ayzenberg, Y. (2016) · Emotion Review · doi:10.1177/1754073914565517 · Cited by 287
A continuous and objective evaluation of emotional experience with interactive play environments
Mandryk, R. L., Atkins, M. S., & Inkpen, K. M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124926 · Cited by 265
The measurement of affect, mood, and emotion: a guide for health-behavioral research
(2013) · Choice Reviews Online · doi:10.5860/choice.51-2369 · Cited by 264
The Effects of Positive Mood on Memory
Lee, A. Y., & Sternthal, B. (1999) · Journal of Consumer Research · doi:10.1086/209554 · Cited by 263
The nature of emotion: Fundamental questions
Öhman, A. (1996) · Biological Psychology · doi:10.1016/s0301-0511(96)05205-2 · Cited by 255
The use of a wearable camera, SenseCam, as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A preliminary report
Berry, E., Kapur, N., Williams, L., Hodges, S., Watson, P., Smyth, G., Srinivasan, J., Smith, R., Wilson, B., & Wood, K. (2007) · Neuropsychological Rehabilitation · doi:10.1080/09602010601029780 · Cited by 236
Memories of yesterday’s emotions: Does the valence of experience affect the memory-experience gap?
Miron‐Shatz, T., Stone, A. A., & Kahneman, D. J. (2009) · Emotion · doi:10.1037/a0017823 · Cited by 217
Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?
Hertzum, M., Hansen, K. D., & Andersen, H. H. K. (2009) · Behaviour and Information Technology · doi:10.1080/01449290701773842 · Cited by 188
Experiencing the Affective Diary
Ståhl, A., Höök, K., Svensson, M. G. A., Taylor, A. S., & Combetto, M. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0202-7 · Cited by 183
Using the SenseCam to Improve Classifications of Sedentary Behavior in Free-Living Settings
Kerr, J., Marshall, S. J., Godbole, S. V., Chen, J. M., Legge, A., Doherty, A., Kelly, P., Oliver, M., Badland, H. M., & Foster, C. E. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.11.004 · Cited by 181
Designing Interactive Systems : A Comprehensive Guide to HCI, UX and Interaction Design
Benyon, D. (2010) · Cited by 169
To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals
Hassenzahl, M., & Ullrich, D. (2007) · Interacting with Computers · doi:10.1016/j.intcom.2007.05.001 · Cited by 165
Is heart rate variability (HRV) an adequate tool for evaluating human emotions? – A focus on the use of the International Affective Picture System (IAPS)
Choi, K.-H., Kim, J., Kwon, O. S., Kim, M. J., Ryu, Y. H., & Park, J.-E. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.02.025 · Cited by 164
Rethinking Thinking Aloud: A Comparison of Three Think-Aloud Protocols
Alhadreti, O., & Mayhew, P. J. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173618 · Cited by 151
Psychophysiological Science: Interdisciplinary Approaches to Classic Questions About the Mind
Cacioppo, J. T., Tassinary, L. G., & Berntson, G. G. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546396.001 · Cited by 123
The validity of the stimulated retrospective think-aloud method as measured by eye tracking
Guan, Z., Lee, S., Cuddihy, E., & Ramey, J. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124961 · Cited by 123
Affective priming with subliminally presented pictures.
Hermans, D., Spruyt, A., Houwer, J. D., & Eelen, P. (2003) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087416 · Cited by 123
Self-Assessment Manikin
Bynion, T., & Feldner, M. T. (2017) · Springer eBooks · doi:10.1007/978-3-319-28099-8_77-1 · Cited by 122
Gaze Path Stimulation in Retrospective Think-Aloud
Hyrskykari, A., Ovaska, S., Majaranta, P., Räihä, K.-J., & Lehtinen, M. (2008) · Journal of Eye Movement Research · doi:10.16910/jemr.2.4.5 · Cited by 118
Coherence between subjective experience and physiology in emotion: Individual differences and implications for well-being.
Brown, C. L., Doren, N. V., Ford, B. Q., Mauss, I. B., Sze, J. A., & LEVENSON, R. W. (2019) · Emotion · doi:10.1037/emo0000579 · Cited by 116
Accessing problem-solving strategy knowledge: The complementary use of concurrent verbal protocols and retrospective debriefing
Taylor, K. L., & Dionne, J.-P. (2000) · Journal of Educational Psychology · doi:10.1037/0022-0663.92.3.413 · Cited by 108
Studying Complex Decision Making in Natural Settings: Using a Head-Mounted Video Camera to Study Competitive Orienteering
Omodei, M. M., & McLennan, J. (1994) · Perceptual and Motor Skills · doi:10.2466/pms.1994.79.3f.1411 · Cited by 93
Modulation of retrieval processing reflects accuracy of emotional source memoryPreprint
Smith, A. P. R., Henson, R. N., Rugg, M. D., & Dolan, R. J. (2005) · Learning & Memory · doi:10.1101/lm.84305 · Cited by 92
Emotions, experiences and usability in real-life mobile phone use
Kujala, S., & Miron‐Shatz, T. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466135 · Cited by 80
Investigating the Information-Seeking Processes of Adolescents
Branch, J. L. (2000) · Library & Information Science Research · doi:10.1016/s0740-8188(00)00051-7 · Cited by 74
What Do Thinking-Aloud Participants Say? A Comparison of Moderated and Unmoderated Usability Sessions
Hertzum, M., Borlund, P., & Kristoffersen, K. B. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1065691 · Cited by 69
Measuring multiple components of emotions in interactive contexts
Mahlke, S., Minge, M., & Thüring, M. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125653 · Cited by 66
Scanning and deep processing of information in hypertext: an eye tracking and cued retrospective think‐aloud study
Salmerón, L., Naumann, J., García, V., & Fajardo, I. (2016) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12152 · Cited by 66
Lifelogging in the Wild: Participant Experiences of Using Lifelogging as a Research Tool
Bruun, A., & Stentoft, M. L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29387-1_24 · Cited by 62
Self-citation
Subjective objectivity: negotiating emotional meaning
Leahu, L., Schwenk, S., & Sengers, P. (2008) · Proceedings of the 7th ACM conference on Designing interactive systems · doi:10.1145/1394445.1394491 · Cited by 61
Emotion Prediction from Physiological Signals: A Comparison Study Between Visual and Auditory Elicitors
Zhou, F., Qu, X., Jiao, J. R., & Helander, M. G. (2013) · Interacting with Computers · doi:10.1093/iwc/iwt039 · Cited by 60
The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool
Peute, L. W. P., de Keizer, N. F., & Jaspers, M. W. M. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.02.006 · Cited by 57
Recognizing Emotions in Human Computer Interaction: Studying Stress Using Skin Conductance
Liapis, A., Katsanos, C., Sotiropoulos, D. G., Xenos, M., & Καρούσος, Ν. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22701-6_18 · Cited by 56
Specifying emotional information: Regulation of emotional intensity via executive processes.
Philippot, P., Baeyens, C., & Douilliez, C. (2006) · Emotion · doi:10.1037/1528-3542.6.4.560 · Cited by 54
Affective Priming with Pictures of Emotional Scenes: The Role of Perceptual Similarity and Category Relatedness
Avero, P., & Calvo, M. G. (2006) · The Spanish Journal of Psychology · doi:10.1017/s1138741600005928 · Cited by 38
Mind the Gap! Comparing Retrospective and Concurrent Ratings of Emotion in User Experience Evaluation
Bruun, A., & Ahm, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22701-6_17 · Cited by 38
Self-citation
The use of eye mark recordings to support verbal retrospection in software testing
Hansen, J. P. (1991) · Acta Psychologica · doi:10.1016/0001-6918(91)90052-2 · Cited by 33
How is physiological arousal related to self-reported measures of emotional intensity and valence of events and their autobiographical memories?
Salgado, S., & Kingo, O. (2019) · Consciousness and Cognition · doi:10.1016/j.concog.2019.102811 · Cited by 31
Retrospective versus Concurrent Thinking-Out-Loud in Usability Testing
Ohnemus, K. R., & Biers, D. W. (1993) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129303701701 · Cited by 30
Understanding the Relationship between Frustration and the Severity of Usability Problems
Bruun, A., Law, E. L., Heintz, M., & Alkly, L. H. A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858511 · Cited by 29
Self-citation
Dual Verbal Elicitation: The Complementary Use of Concurrent and Retrospective Reporting Within a Usability Test
McDonald, S., Zhao, T., & Edwards, H. M. (2013) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2012.758529 · Cited by 28
Measuring affect in hci
Shami, N. S., Hancock, J. T., Peter, C., Muller, M. J., & Mandryk, R. L. (2008) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1358628.1358952 · Cited by 22
Asserting Real-Time Emotions through Cued-Recall
Bruun, A., Law, E. L., Heintz, M., & Eriksen, P. S. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971516 · Cited by 21
Self-citation
A software system for the collection of retrospective protocols prompted by eye fixations
Russo, J. E. (1979) · Behavior Research Methods · doi:10.3758/bf03205643 · Cited by 19
Retrospective Cued Recall: A Method for Accurately Recalling Previous User Behaviors
Russell, D. M., & Oren, M. (2009) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2009.370 · Cited by 14
Lifelogging in User Experience Research: Supporting Recall and Improving Data Richness
Arvola, M., Blomkvist, J., & Wahlman, F. (2017) · The Design Journal · doi:10.1080/14606925.2017.1352898 · Cited by 14
It's not complicated
Bruun, A. (2018) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3240167.3240183 · Cited by 13
Self-citation
Evaluation of heart rate measurements in clinical studies: a prospective cohort study in patients with heart disease
Albanese, M., Neofytou, M., Ouarrak, T., Schneider, S., & Schöls, W. H. (2016) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-016-2046-9 · Cited by 9
Usability Engineering
Heimgärtner, R. (2019) · Human-computer interaction series · doi:10.1007/978-3-030-17427-9_4 · Cited by 3

Research works printed but not linked: 17

John R. Anderson and Gordon H . Bower . 1979 . Human associative memory. Lawrence Erlbaum Associates , Hillsdale, NJ. John R. Anderson and Gordon H. Bower. 1979. Human associative memory. Lawrence Erlbaum Associates, Hillsdale, NJ.
Todd Bentley , Lorraine Johnston , and Karola von Baggo . 2005 . Evaluation using cued-recall debrief to elicit information about a user's affective experiences . In Proceedings of the 2005 Australasian Computer-Human Interaction Conference (OZCHI’05) . 1–10. Retrieved from http://dl.acm.org/citation.cfm?id=1108368.1108403. Todd Bentley, Lorraine Johnston, and Karola von Baggo. 2005. Evaluation using cued-recall debrief to elicit information about a user's affective experiences. In Proceedings of the 2005 Australasian Computer-Human Interaction Conference (OZCHI’05). 1–10. Retrieved from http://dl.acm.org/citation.cfm?id=1108368.1108403.
Gordon H. Bower and Joseph P . Forgas . 2000 . Affect, memory, and social cognition. In Cognition and Emotion. Oxford University Press , 87–168. Gordon H. Bower and Joseph P. Forgas. 2000. Affect, memory, and social cognition. In Cognition and Emotion. Oxford University Press, 87–168.
V. A. Bowers and H. L. Snyder . 1990. Concurrent versus retrospective verbal protocols for comparing window usability . In Proceedings of the Human Factors Society 34th Meeting. 1270–1274 . V. A. Bowers and H. L. Snyder. 1990. Concurrent versus retrospective verbal protocols for comparing window usability. In Proceedings of the Human Factors Society 34th Meeting. 1270–1274.
Jason J. Braithwaite and Derrick G . Watson . 2015 . Issues Surrounding the Normalization and Standardisation of Skin Conductance Responses (SCRs). Birmingham . Jason J. Braithwaite and Derrick G. Watson. 2015. Issues Surrounding the Normalization and Standardisation of Skin Conductance Responses (SCRs). Birmingham.
10.5555/1531294.1531312 · doi:10.5555/1531294.1531312
Eva Ganglbauer , Stephanie Deutsch , and Manfred Tscheligi . 2009 . Applying psychophysiological methods for measuring user experience: Possibilities, challenges and feasibility . In Proceedings of the User Experience Evaluation Methods in Product Development (UXEM’09) . DOI:https://doi.org/10.1.1.189.3410 Eva Ganglbauer, Stephanie Deutsch, and Manfred Tscheligi. 2009. Applying psychophysiological methods for measuring user experience: Possibilities, challenges and feasibility. In Proceedings of the User Experience Evaluation Methods in Product Development (UXEM’09). DOI:https://doi.org/10.1.1.189.3410
Caroll E. Izard . 1993. Organizational and motivational functions of discrete emotions . In Handbook of emotions . Guilford Press , New York, NY , 631–641. Caroll E. Izard. 1993. Organizational and motivational functions of discrete emotions. In Handbook of emotions. Guilford Press, New York, NY, 631–641.
10.2307/40062570 · doi:10.2307/40062570
Liadh Kelly and Gareth J. F. Jones . 2010. An exploration of the utility of GSR in locating events from personal lifelogs for reflection . In Proceedings of the 4th Irish Human Computer Interaction Conference (iHCI’10) . Retrieved September 21, 2018 from https://www.semanticscholar.org/paper/An-Exploration-of-the-Utility-of-GSR-in-Locating-Kelly/12e73eb02d357ee0085465d0cff6aa322e19e515. Liadh Kelly and Gareth J. F. Jones. 2010. An exploration of the utility of GSR in locating events from personal lifelogs for reflection. In Proceedings of the 4th Irish Human Computer Interaction Conference (iHCI’10). Retrieved September 21, 2018 from https://www.semanticscholar.org/paper/An-Exploration-of-the-Utility-of-GSR-in-Locating-Kelly/12e73eb02d357ee0085465d0cff6aa322e19e515.
10.1037/0003-066x.50.5.372 · DOI · Paper page
Clayton Lewis . 1982. Using the “Thinking-Aloud ” Method in Cognitive Interface Design . IBM T. J. Watson Research Center, Yorktown Heights , NY. Retrieved June 19, 2019 from https://www.worldcat.org/title/using-the-thinking-aloud-method-in-cognitive-interface-design/oclc/38214134. Clayton Lewis. 1982. Using the “Thinking-Aloud” Method in Cognitive Interface Design. IBM T. J. Watson Research Center, Yorktown Heights, NY. Retrieved June 19, 2019 from https://www.worldcat.org/title/using-the-thinking-aloud-method-in-cognitive-interface-design/oclc/38214134.
Brendan D. Murray , Alisha C. Holland , and Elisabeth A . Kensinger . 2013 . Episodic memory and emotion. In Handbook of Cognition and Emotion. M. D. Robinson, E. R. Watkins, and E. Harmon-Jones (Eds.), Guilford Press , 156–175. Brendan D. Murray, Alisha C. Holland, and Elisabeth A. Kensinger. 2013. Episodic memory and emotion. In Handbook of Cognition and Emotion. M. D. Robinson, E. R. Watkins, and E. Harmon-Jones (Eds.), Guilford Press, 156–175.
K. N. Ochsner . 2000 . Are affective events richly recollected or simply familiar? The experience and process of recognizing feelings past. Journal of Experimental Psychology . General 129 , 2 (2000), 242 – 261 . K. N. Ochsner. 2000. Are affective events richly recollected or simply familiar? The experience and process of recognizing feelings past. Journal of Experimental Psychology. General 129, 2 (2000), 242–261.
Jenny Preece , Yvonne Rogers , and Helen Sharp . 2019 . Interaction Design: Beyond Human-Computer Interaction. Retrieved May 2, 2019 from https://www.wiley.com/en-us/Interaction+Design%3A+Beyond+Human+Computer+Interaction%2C+4th+Edition-p-9781119020752. Jenny Preece, Yvonne Rogers, and Helen Sharp. 2019. Interaction Design: Beyond Human-Computer Interaction. Retrieved May 2, 2019 from https://www.wiley.com/en-us/Interaction+Design%3A+Beyond+Human+Computer+Interaction%2C+4th+Edition-p-9781119020752.
10.1037/0022-3514.74.6.1670 · DOI · Paper page
10.1093/iwc · doi:10.1093/iwc

Wearables measuring electrodermal activity to assess perceived stress in care: a scoping review
Klimek, A., Mannheim, I., Schouten, G., Wouters, E., & Peeters, M. W. H. (2023) · Acta Neuropsychiatrica · doi:10.1017/neu.2023.19 · Cited by 76
Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review
Hertzum, M. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3665327 · Cited by 41
Using Electrodermal Activity Measurements to Understand Student Emotions While Programming
Benario, J. G., Cunningham, K. I., Worsley, M. B., & O'Rourke, E. (2022) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3501385.3543981 · Cited by 26
Blending in or standing out? The disclosure dilemma of ad cues of social media native advertising
Hübner, M., Thalmann, J., & Henseler, J. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1636910 · Cited by 14
Exploring the influencing factors of wall‐following behavior in a virtual reality fire evacuation game
Wang, J., Liu, T., Liu, Z., & Chai, Y. (2022) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2122 · Cited by 8

See all 16

Authors: Bruun, A., Law, E. L.-C., Nielsen, T. D., & Heintz, M.
Affiliations: Aalborg University (DK)
University of Leicester (GB)
ORCID: Bruun, Anders
Law, Effie Lai-Chong
Nielsen, Thomas Dyhre
Heintz, Matthias
Venue: ACM Transactions on Computer-Human Interaction
Publisher: Association for Computing Machinery (ACM)
Published: 2021-07-23
Volume: 28
Issue: 4
Pages: 1-45
ISSN: 1073-0516 (ISSN-L)
1557-7325
DOI: 10.1145/3453479
OpenAlex: W3185232422
Cited by: 16
References: 92
Citations by year: 2026: 7 · 2025: 1 · 2024: 4 · 2023: 1 · 2022: 2 · 2021: 1
FWCI: 0.99
Type: journal article
Language: en
Open access: closed
Licence: www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations: ACM Transactions on Computer-Human Interaction (publishedVersion)
VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
Topics: Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
Keywords: retrospective think-aloud, user experience evaluation, emotional responses, memory effects, skin conductance, heart rate, Self-Assessment Manikin

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

Do You Feel the Same? On the Robustness of Cued-Recall Debriefing for User Experience Evaluation

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks

Data sources