The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
How Is Your User Feeling? Inferring Emotion Through Human-Computer Interaction Devices1
Abstract
Emotion can influence important user behaviors, including purchasing decisions, technology use, and customer loyalty. The ability to easily assess users’ emotion during live system use therefore has practical significance for the design and improvement of information systems. In this paper, we discuss using human–computer interaction input devices to infer emotion. Specifically, we utilize attentional control theory to explain how movement captured via a computer mouse (i.e., mouse cursor movements) can be a real-time indicator of negative emotion. We report three studies. In Study 1, an experiment with 65 participants from Amazon’s Mechanical Turk, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements as they completed a number-ordering task. We found that negative emotion increases the distance and reduces the speed of mouse cursor movements during the task. In Study 2, an experiment with 126 participants from a U.S. university, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements while they interacted with a mock e-commerce site. We found that mouse cursor distance and speed can be used to infer the presence of negative emotion with an overall accuracy rate of 81.7 percent. In Study 3, an observational study with 80 participants from universities in Germany and Hong Kong, we monitored mouse cursor movements while participants interacted with an online product configurator. Participants reported their level of emotion after each step in the configuration process. We found that mouse cursor distance and speed can be used to infer the level of negative emotion with an out-of-sample R2 of 0.17. The results enable researchers to assess negative emotional reactions during live system use, examine emotional reactions with more temporal precision, conduct multimethod emotion research, and create more unobtrusive affective and adaptive systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Anxiety and cognitive performance: Attentional control theory
Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007) · Emotion · doi:10.1037/1528-3542.7.2.336 · Cited by 5,289
Agarwal, R., & Karahanna, E. (2000) · MIS Quarterly · doi:10.2307/3250951 · Cited by 4,726
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
The Role of Emotions in Marketing
Bagozzi, R. P., Gopinath, M., & Nyer, P. U. (1999) · Journal of the Academy of Marketing Science · doi:10.1177/0092070399272005 · Cited by 3,349
Progress on a cognitive-motivational-relational theory of emotion
Lazarus, R. S. (1991) · American Psychologist · doi:10.1037/0003-066x.46.8.819 · Cited by 3,272
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Dual-task interference in simple tasks: data and theory
Pashler, H. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.2.220 · Cited by 3,112
Cited by
Perceived Greenwashing: The Effects of Green Marketing on Environmental and Product Perceptions
Szabo, S., & Webster, J. (2021) · Journal of Business Ethics · doi:10.1007/s10551-020-04461-0 · Cited by 806
Lehrer, C., Wieneke, A., vom Brocke, J., Jung, R., & Seidel, S. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2018.1451953 · Cited by 404
Kowatsch, T., Nißen, M. K., Shih, C.-H. I., Rüegger, D., Volland, D., Filler, A., Künzler, F., Barata, F., Hung, S., Büchter, D., et al. (2017) · ETH Zurich · doi:10.3929/ethz-b-000218776 · Cited by 74
“We see THCBs as digital health coaches that use not only self-reports to infer the health condition of patients but also sensor information from everyday objects (e.g. from a smartphone [21], a car [19] or a PC mouse [16, 24-26, 42, 45]) and medical devices (e.g. a blood glucose meter [39]).”
BackgroundEMA at SemEval-2018 Task 1: Emotion Mining for Arabic
Badaro, G., El Jundi, O., Khaddaj, A., Maarouf, A., Kain, R., Hajj, H., & El-Hajj, W. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1036 · Cited by 60
“Different models have been used to detect people’s emotions such as human computer interaction (HCI) (Hibbeln et al., 2017; Patwardhan and Knapp, 2017; Con-stantine et al., 2016) and their facial expressions (Trad et al., 2012; Wegrzyn et al., 2017).”
BackgroundMethod
Metadata
- Authors
- Hibbeln, M., Jenkins, J. L., Schneider, C., Valacich, J. S., & Weinmann, M.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2017-03-01
- Volume
- 41
- Issue
- 1
- Pages
- 1-21
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W2615393547
- Cited by
- 181
- References
- 17
- FWCI
- 20.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.