Fundamentals of physiological computing

Fairclough, Stephen H.

doi:10.1016/j.intcom.2008.10.011

Cited by 608Emotion and Mood RecognitionInnovative Human-Technology InteractionGaze Tracking and Assistive Technology

Fundamentals of physiological computing

Fairclough, Stephen H.·2009·Interacting with Computers

DOI 10.1016/j.intcom.2008.10.011

Open this paper in CoChat — free account

Abstract

This review paper is concerned with the development of physiological computing systems that employ real-time measures of psychophysiology to communicate the psychological state of the user to an adaptive system. It is argued that physiological computing has enormous potential to innovate human–computer interaction by extending the communication bandwidth to enable the development of ‘smart’ technology. This paper focuses on six fundamental issues for physiological computing systems through a review and synthesis of existing literature, these are (1) the complexity of the psychophysiological inference, (2) validating the psychophysiological inference, (3) representing the psychological state of the user, (4) designing explicit and implicit system interventions, (5) defining the biocybernetic loop that controls system adaptation, and (6) ethical implications. The paper concludes that physiological computing provides opportunities to innovate HCI but complex methodological/conceptual issues must be fully tackled during the research and development phase if this nascent technology is to achieve its potential.

Integrity signals

Registry

Crossref · 10.1016/j.intcom.2008.10.011

Cites

120 of 120 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Mapping from physiological signals to psychological states is a limitation of physiological computing.
“One of the limitations of physiological computing is that of mapping from physiological signals to psychological states [12].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [12]

Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,652 · see citing works
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · cited 2× · see citing works
“Subjective self-report is also prone to bias due to personality or memory limitations (Nisbett and Wilson, 1977; Villon and Lisetti, 2006), and the correspondence of these measures with psychophysiological activity is often erratic (Cacioppo et al.”
Background
Affective Computing
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382 · see citing works
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2× · see citing works
“The perception of accuracy is an important determinant of system reliability that influences the level of trust in an adaptive system (Lee and See, 2004; Muir and Moray, 1996; Parasuraman and Miller, 2004 ).”
Background
The feeling of what happens: body and emotion in the making of consciousness
(2000) · Choice Reviews Online · doi:10.5860/choice.37-6553 · Cited by 5,998 · see citing works
Cybernetics or Control and Communication in the Animal and the Machine
Wiener, N. (2019) · The MIT Press eBooks · doi:10.7551/mitpress/11810.001.0001 · Cited by 5,045 · see citing works
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · see citing works
Handbook of Psychophysiology
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482 · see citing works
Handbook of Self-Regulation
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-109890-2.x5027-6 · Cited by 4,439 · see citing works
Flow: The Psychology of Optimal Experience
Mirvis, P. H., & Csikszentmihalyi, M. (1991) · Academy of Management Review · doi:10.2307/258925 · Cited by 3,706 · see citing works
Neural systems supporting interoceptive awareness
Critchley, H. D., Wiens, S., Rotshtein, P., Öhman, A., & Dolan, R. J. (2004) · Nature Neuroscience · doi:10.1038/nn1176 · Cited by 3,406 · cited 2× · see citing works
“…process wherein physiological activity provides one source of data input among others (e.g., context, beliefs) and expression of these data with respect to self-awareness is vulnerable to the vagaries of self-perception and selective attention (Craig, 2004; Critchley et al., 2004; Dolan, 2002 ).”
Background
The motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332 · see citing works
Handbook of Emotions
Lewis, M., & Haviland, J. M. (1993) · Cited by 3,308 · see citing works
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · see citing works
Brain-computer interface technology: a review of the first international meeting
Wolpaw, J. R., Birbaumer, N., Heetderks, W., McFarland, D. J., Peckham, P. H., Schalk, G., Donchin, E., Quatrano, L. A., Robinson, C. J., & Vaughan, T. M. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/tre.2000.847807 · Cited by 2,322 · see citing works
Emotion, cognition, and behavior
Dolan, R. J. (2002) · Science · doi:10.1126/science.1076358 · Cited by 1,979 · see citing works
Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990.
Csíkszentmihályi, M. (1990) · Cited by 1,864 · see citing works
Are Emotions Natural Kinds?
Barrett, L. F. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00003.x · Cited by 1,859 · see citing works
Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework
Robert J. Hockey, G. (1997) · Biological Psychology · doi:10.1016/s0301-0511(96)05223-4 · Cited by 1,753 · see citing works
Emotions, morbidity, and mortality: new perspectives from psychoneuroimmunology.
Kiecolt-Glaser, J. K., McGuire, L., Robles, T. F., & Glaser, R. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135217 · Cited by 1,176 · see citing works
EMOTION
Cacioppo, J. T., & Gardner, W. L. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.191 · Cited by 1,004 · see citing works
Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993 · see citing works
Affective computing: challenges
Picard, R. W. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00052-1 · Cited by 978 · see citing works
The psychophysiology of emotion.
Larsen, J. T., Berntson, G. G., Poehlmann, K. M., Ito, T. A., & Cacioppo, J. T. (1993) · Cited by 957 · see citing works
A Dynamic Model of Stress and Sustained Attention
Hancock, P. A. (1989) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088903100503 · Cited by 874 · see citing works
Designing Calm Technology
Weiser, M. (1996) · Cited by 820 · see citing works
Stress, Workload, and Fatigue
(2000) · CRC Press eBooks · doi:10.1201/b12791 · Cited by 797 · see citing works
Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii
Larsen, J. T., Norris, C. J., & Cacioppo, J. T. (2003) · Psychophysiology · doi:10.1111/1469-8986.00078 · Cited by 766 · see citing works
Biocybernetic system evaluates indices of operator engagement in automated task
Pope, A., Bogart, E. H., & Bartolome, D. S. (1995) · Biological Psychology · doi:10.1016/0301-0511(95)05116-3 · Cited by 670 · see citing works
Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry.
Matthews, G., Campbell, S. E., Falconer, S., Joyner, L. A., Huggins, J., Gilliland, K., Grier, R. A., & Warm, J. S. (2002) · Emotion · doi:10.1037/1528-3542.2.4.315 · Cited by 596 · see citing works
Automatic prediction of frustration
Kapoor, A., Burleson, W., & Picard, R. W. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.02.003 · Cited by 592 · see citing works
Ten challenges for making automation a ‘team player’ in joint human-agent activity
Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004) · IEEE Intelligent Systems · doi:10.1109/mis.2004.74 · Cited by 590 · see citing works
Workload assessment methodology.
O’Donnell, R. D., & Eggemeier, F. T. (1986) · Cited by 585 · see citing works
Cybernetics: Control and Communication in the Animal and the Machine.
Johnson, H. G., & Wiener, N. (1949) · The Economic Journal · doi:10.2307/2226579 · Cited by 576 · see citing works
This computer responds to user frustration:
Klein, J., Moon, Y., & Picard, R. W. (2002) · Interacting with Computers · doi:10.1016/s0953-5438(01)00053-4 · Cited by 560 · see citing works
A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies
Mandryk, R. L., & Atkins, M. S. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.011 · Cited by 538 · see citing works
Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods
Gevins, A., Smith, M. E., Leong, H., McEvoy, L., Whitfield, S., Du, R., & Rush, G. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480578 · Cited by 535 · see citing works
Interoception: The Inside Story—A Model for Psychosomatic Processes
Cameron, O. G. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200109000-00001 · Cited by 535 · see citing works
Using psychophysiological techniques to measure user experience with entertainment technologies
Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006) · Behaviour and Information Technology · doi:10.1080/01449290500331156 · Cited by 516 · see citing works
Affective Learning — A Manifesto
Picard, R. W., Papert, S. A., Bender, W. R., Blumberg, B. M., Breazeal, C., Cavallo, D. P., Machover, T., Resnick, M., Roy, D. K., & Strohecker, C. (2004) · BT Technology Journal · doi:10.1023/b:bttj.0000047603.37042.33 · Cited by 511 · see citing works
Inferring psychological significance from physiological signals.
Cacioppo, J. T., & Tassinary, L. G. (1990) · American Psychologist · doi:10.1037//0003-066x.45.1.16 · Cited by 486 · see citing works
Inferring psychological significance from physiological signals.
Cacioppo, J. T., & Tassinary, L. G. (1990) · American Psychologist · doi:10.1037/0003-066x.45.1.16 · Cited by 481 · see citing works
Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451 · see citing works
Human feelings: why are some more aware than others?
Craig, A. D. (. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.004 · Cited by 445 · see citing works
Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals
Lisetti, C., & Nasoz, F. (2004) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865704406192 · Cited by 432 · see citing works
The Transparent Society: Will Technology Force Us to Choose Between Privacy and Freedom?
Brin, D. (1998) · DigitalGeorgetown (Georgetown University Library) · Cited by 419 · see citing works
Computers that recognise and respond to user emotion: theoretical and practical implications
Picard, R. W., & Klein, J. (2002) · Interacting with Computers · doi:10.1016/s0953-5438(01)00055-8 · Cited by 392 · see citing works
Psychophysiology and adaptive automation
Byrne, E. A., & Parasuraman, R. (1996) · Biological Psychology · doi:10.1016/0301-0511(95)05161-9 · Cited by 360 · cited 2× · see citing works
“These systems operate by transforming psychophysiological data into a control signal (or an input to a control signal) without a requirement for any overt response from the user (Byrne and Parasuraman, 1996).”
Background
Frustrating the user on purpose: a step toward building an affective computer
Scheirer, J., Fernandez, R., Klein, J., & Picard, R. W. (2002) · Interacting with Computers · doi:10.1016/s0953-5438(01)00059-5 · Cited by 360 · see citing works
Human Computing and Machine Understanding of Human Behavior: A Survey
Pantić, M., Pentland, A., Nijholt, A., & Huang, T. S. (2007) · Springer eBooks · doi:10.1007/978-3-540-72348-6_3 · Cited by 322 · see citing works
Automated Posture Analysis for Detecting Learner's Interest Level
Mota, S., & Picard, R. W. (2003) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2003.10047 · Cited by 315 · see citing works
An empirical study of machine learning techniques for affect recognition in human–robot interaction
Rani, P., Liu, C., Sarkar, N., & Vanman, E. (2006) · Pattern Analysis and Applications · doi:10.1007/s10044-006-0025-y · Cited by 313 · see citing works
Trust and etiquette in high-criticality automated systems
Parasuraman, R., & Miller, C. A. (2004) · Communications of the ACM · doi:10.1145/975817.975844 · Cited by 311 · see citing works
Automation and Human Performance
Bowers, C. A., Oser, R. L., Eduardo Salas, A., & Cannon‐Bowers, J. A. (2018) · Routledge eBooks · doi:10.1201/9781315137957 · Cited by 307 · see citing works
The Design of Future Things
Norman, D. A. (2007) · Cited by 302 · see citing works
The influence of task demand and learning on the psychophysiological response
Fairclough, S. H., Venables, L., & Tattersall, A. J. (2005) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2004.11.003 · Cited by 291 · see citing works
Self-citation
Evaluation of an adaptive automation system using three EEG indices with a visual tracking task
Freeman, F. G., Mikulka, P. J., Prinzel, L. J., & Scerbo, M. W. (1999) · Biological Psychology · doi:10.1016/s0301-0511(99)00002-2 · Cited by 283 · see citing works
Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding
Wilson, G. F., & Russell, C. A. (2007) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007x249875 · Cited by 270 · see citing works
Cardiovascular and respiratory responses during musical mood induction
Etzel, J. A., Johnsen, E. L., Dickerson, J. A., Tranel, D., & Adolphs, R. (2006) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2005.10.025 · Cited by 267 · see citing works
Constraints for emotion specificity in fear and anger: The context counts
Stemmler, G., Heldmann, M., Pauls, C. A., & SCHERER, T. (2001) · Psychophysiology · doi:10.1111/1469-8986.3820275 · Cited by 260 · see citing works
Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me
Gilleade, K. M., Dix, A. J., & Allanson, J. (2005) · doi:10.26503/dl.v2005i1.229 · Cited by 260 · see citing works
The human cortex responds to an interoceptive challenge
Critchley, H. D. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0401510101 · Cited by 251 · see citing works
Hedonomics: The Power of Positive and Pleasurable Ergonomics
Hancock, P., Pepe, A. A., & Murphy, L. L. (2005) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480460501300104 · Cited by 249 · see citing works
Ambient intelligence: a multimedia perspective
Aarts, E. (2004) · IEEE Multimedia · doi:10.1109/mmul.2004.1261101 · Cited by 229 · see citing works
Cybernetics, or Control and Communication in the Animal and the Machine
Robinson, E. A., & Wiener, N. (1963) · Technometrics · doi:10.2307/1266498 · Cited by 221 · see citing works
Beyond Calculation: The Next Fifty Years of Computing
Denning, P. J., & Metcalfe, B. D. (1997) · Medical Entomology and Zoology · Cited by 215 · see citing works
Monitoring Task Loading with Multivariate EEG Measures during Complex Forms of Human-Computer Interaction
Smith, M. E., Gevins, A. S., Brown, H. D., Karnik, A., & Du, R. (2001) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775898287 · Cited by 214 · see citing works
A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation
Prinzel, L. J., Freeman, F. G., Scerbo, M. W., Mikulka, P. J., & Pope, A. (2000) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1004_6 · Cited by 211 · see citing works
Using frustration in the design of adaptive videogames
Gilleade, K. M., & Dix, A. J. (2004) · International Conference on Advances in Computer Entertainment Technology (ACE) · doi:10.1145/1067343.1067372 · Cited by 208 · see citing works
Prediction of subjective states from psychophysiology: A multivariate approach
Fairclough, S. H., & Venables, L. (2005) · Biological Psychology · doi:10.1016/j.biopsycho.2005.03.007 · Cited by 199 · see citing works
Self-citation
Emotions and heart rate while sitting on a chair
Anttonen, J., & Surakka, V. (2005) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055040 · Cited by 196 · see citing works
Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task
Wilson, G. F., & Russell, C. A. (2003) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.45.3.381.27252 · Cited by 195 · see citing works
The effects of affective interventions in human–computer interaction
Partala, T., & Surakka, V. (2004) · Interacting with Computers · doi:10.1016/j.intcom.2003.12.001 · Cited by 192 · see citing works
The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious
Ju, W. G., & LEIFER, L. J. (2008) · Design Issues · doi:10.1162/desi.2008.24.3.72 · Cited by 177 · see citing works
Physiological responses to different WEB page designs
Ward, R. D., & Marsden, P. H. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00019-3 · Cited by 169 · see citing works
Developing multimodal intelligent affective interfaces for tele-home health care
Lisetti, C., Nasoz, F., LeRouge, C., Ozyer, O., & Alvarez, K. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00051-x · Cited by 165 · see citing works
Psychophysiological responses to appraisal dimensions in a computer game
van Reekum, C. M., Johnstone, T., Banse, R., Etter, A., Wehrle, T., & Scherer, K. R. (2004) · Cognition & Emotion · doi:10.1080/02699930341000167 · Cited by 160 · see citing works
Self-Representation in Nervous Systems.
Churchland, P. S. (2002) · Science · doi:10.1126/science.1070564 · Cited by 160 · see citing works
Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game
Prendinger, H., Mori, J., & Ishizuka, M. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.11.009 · Cited by 155 · see citing works
Online stress detection using psychophysiological signals for implicit human-robot cooperation
Rani, P., Sims, J. P., Brackin, R., & Sarkar, N. (2002) · Robotica · doi:10.1017/s0263574702004484 · Cited by 150 · see citing works
Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game: useful tools for psychophysiology in ergonomics
Yamada, F. (1998) · Ergonomics · doi:10.1080/001401398186847 · Cited by 149 · see citing works
Effects of a Psychophysiological System for Adaptive Automation on Performance, Workload, and the Event-Related Potential P300 Component
Prinzel, L. J., Freeman, F. G., Scerbo, M. W., Mikulka, P. J., & Pope, A. (2003) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.45.4.601.27092 · Cited by 145 · see citing works
A research agenda for physiological computing
Allanson, J., & Fairclough, S. H. (2004) · Interacting with Computers · doi:10.1016/j.intcom.2004.08.001 · Cited by 144 · see citing works
Self-citation
Hedonomics—affective human factors design
Helander, M. G., & Tham, M. P. (2003) · Ergonomics · doi:10.1080/00140130310001610810 · Cited by 137 · see citing works
Digital processing of affective signals
Healey, J., & Picard, R. W. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.679699 · Cited by 122 · see citing works
Experimental Evaluation of a Model of Mental Workload
Hancock, P. A., & Caird, J. K. (1993) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500303 · Cited by 117 · see citing works
Affective Agents: Sustaining Motivation to Learn Through Failure and a State of Stuck
Burleson, W., & Picard, R. W. (2004) · Cited by 109 · see citing works
Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback
Rani, P., Sarkar, N., & Liu, C. (2005) · Cited by 108 · see citing works
Entertainment capture through heart rate activity in physical interactive playgrounds
Yannakakis, G. N., Hallam, J. C. T., & Lund, H. H. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9036-7 · Cited by 104 · see citing works
Please biofeed the zombies: Enhancing the gameplay and display of a horror game using biofeedback
Champion, E., & Dekker, A. (2019) · doi:10.25917/5d1443e8af4a0 · Cited by 103 · see citing works
A brain-based system for adaptive automation
Scerbo, M. W., Freeman, F. G., & Mikulka, P. J. (2003) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922021000020891 · Cited by 100 · see citing works
Operator functional state : the assessment and prediction of human performance degradation in complex tasks
Hockey, G. R. J., Gaillard, A., & Burov, O. Y. (2003) · Data Archiving and Networked Services (DANS) · Cited by 99 · see citing works
Comparison of a Brain-Based Adaptive System and a Manual Adaptable System for Invoking Automation
Bailey, N. R., Scerbo, M. W., Freeman, F. G., Mikulka, P. J., & Scott, L. A. (2006) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006779166280 · Cited by 91 · see citing works
Beyond Calculation: The Next Fifty Years of Computing
Daukantas, P. J., Metcalfe, R. M., Daukantas, P., McKay, S. R., & Christian, W. (1997) · Computers in Physics · doi:10.1063/1.4822609 · Cited by 88 · see citing works
Anxiety detection during human-robot interaction
Kulić, D., & Croft, E. A. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545012 · Cited by 87 · see citing works
The HandWave Bluetooth Skin Conductance Sensor
Strauss, M. D., Reynolds, C., Hughes, S., Park, K., McDarby, G., & Picard, R. W. (2005) · Lecture notes in computer science · doi:10.1007/11573548_90 · Cited by 85 · see citing works
Neuroadaptive technologies: Applying neuroergonomics to the design of advanced interfaces
Hettinger, L. J., Branco, P., Encarnação, L. M., & Bonato, P. (2003) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922021000020918 · Cited by 71 · see citing works
Cardiovascular reactivity during performance under social observation: The moderating role of task difficulty
Gendolla, G. H. E., & Richter, M. M. (2006) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2006.04.002 · Cited by 71 · see citing works
Incentive effects on cardiovascular reactivity in active coping with unclear task difficulty
Richter, M. M., & Gendolla, G. H. E. (2005) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2005.10.003 · Cited by 69 · see citing works
An empirical study of machine learning techniques for affect recognition in human-robot interaction
Liu, C., Rani, P., & Sarkar, N. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545344 · Cited by 67 · see citing works
Evaluation of a Psychophysiologically Controlled Adaptive Automation System, Using Performance on a Tracking Task
Freeman, F. G., Mikulka, P. J., Scerbo, M. W., Prinzel, L. J., & Clouatre, K. (2000) · Applied Psychophysiology and Biofeedback · doi:10.1023/a:1009566809021 · Cited by 66 · see citing works
The future of neuroergonomics
Hancock, P. A., & Szalma, J. L. (2003) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922021000020927 · Cited by 57 · see citing works
Symvatology: The science of an artifact-human compatibility
Karwowski, W. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/146392200308480 · Cited by 57 · see citing works
A User-Modeling Approach to Build User's Psycho-Physiological Maps of Emotions using Bio-Sensors
Villon, O., & Lisetti, C. (2006) · IEEE RO-MAN · doi:10.1109/roman.2006.314429 · Cited by 54 · see citing works
Artifical Intelligence for Human Computing
Huang, T. S., Pentland, A., Huang, T., Nijholt, A., Pantić, M., & Pentland, S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72348-6 · Cited by 53 · see citing works
Selection of input features across subjects for classifying crewmember workload using artificial neural networks
Laine, T. I., Bauer, K. W., Lanning, J. W., Russell, C. A., & Wilson, G. F. (2002) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2002.807036 · Cited by 53 · see citing works
Affective sensors, privacy, and ethical contracts
Reynolds, C., & Picard, R. W. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.985999 · Cited by 49 · see citing works
Domain-specific anger expression and blood pressure in an occupational setting
Bongard, S., & Al’Absi, M. (2005) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2004.04.370 · Cited by 40 · see citing works
Affective computing in tele-home health
Lisetti, C., & LeRouge, C. (2004) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2004.1265373 · Cited by 38 · see citing works
Electrophysiologically interactive computer systems
Allanson, J. (2002) · Computer · doi:10.1109/2.989931 · Cited by 37 · see citing works
Affective communication for implicit human-machine interaction
Rani, P., Sarkar, N., Smith, C. A., & Adams, J. A. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1245758 · Cited by 34 · see citing works
Performance Enhancement with Real-Time Physiologically Controlled Adaptive Aiding
Wilson, G. F., Lambert, J. D., & Russell, C. A. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004401316 · Cited by 33 · see citing works
Human Factors in Design
de Waard, D., Brookhuis, K. A., & Weikert, C. (2004) · Lund University Publications (Lund University) · Cited by 31 · see citing works
Estimation and Control Theory: Application to Modeling Human Behavior
Rouse, W. B., & Gopher, D. (1977) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872087701900402 · Cited by 25 · see citing works
A Bio-Cybernetic System for Adaptive Automation
Prinzel, L. J., Scerbo, M. W., Freeman, F. G., & Mikulka, P. J. (1995) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129503902102 · Cited by 24 · see citing works
Estimating Robot Induced Affective State using Hidden Markov Models
Kulić, D., & Croft, E. A. (2006) · IEEE RO-MAN · doi:10.1109/roman.2006.314427 · Cited by 20 · see citing works
Stoop to Conquer: Posture and Affect Interact to Influence Computer Users’ Persistence
Ahn, H.-I., Teeters, A., Wang, A., Breazeal, C., & Picard, R. W. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_51 · Cited by 18 · see citing works
Research on Hazardous States of Awareness and Physiological Factors in Aerospace Operations
Prinzel, L. J. (2002) · NASA Technical Reports Server (NASA) · Cited by 15 · see citing works
Teleology for Technology
Hancock, P. A. (2019) · CRC Press eBooks · doi:10.1201/9780429458330-14 · Cited by 13 · see citing works
Effects of Task Demand and Time-on-Task on Psychophysiological Candidates for Biocybernetic Control
Fairclough, S. H., & Venables, L. (2004) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120404800119 · Cited by 8 · see citing works
Self-citation

Flagged first, then by citations

Sorted by citations

A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453 · see citing works
Identifying emotional states using keystroke dynamics
Epp, C., Lippold, M., & Mandryk, R. L. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979046 · Cited by 364 · see citing works
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243 · see citing works
Digital Behaviour Change Interventions to Break and Form Habits
Pinder, C., Vermeulen, J., Cowan, B. R., & Beale, R. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3196830 · Cited by 235 · see citing works
Brain–Computer Interface Technologies in the Coming Decades
Lance, B. J., Kerick, S. E., Ries, A. J., Oie, K. S., & McDowell, K. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2184830 · Cited by 231 · see citing works
Measuring User Engagement
Lalmas, M., O’Brien, H., & Yom-Tov, E. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02289-0 · Cited by 192 · see citing works
Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load
Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., & Vetere, F. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130898 · Cited by 154 · see citing works
Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State
Yuksel, B. F., Oleson, K. B., Harrison, L., Peck, E. M., Afergan, D., Chang, R., & Jacob, R. J. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858388 · Cited by 137 · see citing works
“One of the limitations of physiological computing is that of mapping from physiological signals to psychological states [12].”
Background
A Narrative Review of Mindfulness-Based Interventions Using Virtual Reality
Arpaia, P., D’Errico, G., De Paolis, L. T., Moccaldi, N., & Nuccetelli, F. (2022) · Mindfulness · doi:10.1007/s12671-021-01783-6 · Cited by 122 · see citing works
AI Technologies for Social Emotional Learning: Recent Research and Future Directions
Sethi, S. S., & Jain, K. (2024) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-03-2024-0073 · Cited by 111 · see citing works
Brainput: enhancing interactive systems with streaming fnirs brain input
Solovey, E., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., & Jacob, R. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208372 · Cited by 86 · see citing works
Capturing user engagement via psychophysiology: measures and mechanisms for biocybernetic adaptation
Fairclough, S. H., Gilleade, K., Ewing, K. C., & Roberts, J. (2013) · International Journal of Autonomous and Adaptive Communications Systems · doi:10.1504/ijaacs.2013.050694 · Cited by 60 · see citing works
Self-citation
Introducing Mental Workload Assessment for the Design of Virtual Reality Training Scenarios
Luong, T., Argelaguet, F., Martin, N., & Lecuyer, A. (2020) · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr46266.2020.00089 · Cited by 37 · see citing works
One does not Simply RSVP: Mental Workload to Select Speed Reading Parameters using Electroencephalography
Kosch, T., Schmidt, A., Thanheiser, S., & Chuang, L. L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376766 · Cited by 25 · see citing works
Integrating Biocybernetic Adaptation in Virtual Reality Training Concentration and Calmness in Target Shooting
Muñoz, J. E., Pope, A. T., & Velez, L. E. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-27950-9_12 · Cited by 24 · see citing works
Brain-based target expansion
Afergan, D., Shibata, T., Hincks, S. W., Peck, E. M., Yuksel, B. F., Chang, R., & Jacob, R. J. K. (2014) · Proceedings of the 27th annual ACM symposium on User interface software and technology · doi:10.1145/2642918.2647414 · Cited by 19 · see citing works
DDoD: Dual Denial of Decision Attacks on Human-AI Teams
Tag, B., van Berkel, N., Verma, S., Zhao, B. Z. H., Berkovsky, S., Kaafar, D., Kostakos, V., & Ohrimenko, O. (2023) · IEEE Pervasive Computing · doi:10.1109/mprv.2022.3218773 · Cited by 15 · see citing works

Authors: Fairclough, S. H.
Affiliations: Liverpool John Moores University (GB)
Corresponding author: Fairclough, Stephen H.
ORCID: Fairclough, Stephen H.
Venue: Interacting with Computers
Publisher: Oxford University Press (OUP)
Published: 2009-01
Volume: 21
Issue: 1-2
Pages: 133-145
ISSN: 0953-5438 (ISSN-L)
DOI: 10.1016/j.intcom.2008.10.011
OpenAlex: W2009989063
Cited by: 608
References: 120
Citations by year: 2026: 66 · 2025: 35 · 2024: 26 · 2023: 18 · 2022: 28 · 2021: 36 · 2020: 36 · 2019: 30 · 2018: 35 · 2017: 36 · 2016: 44 · 2015: 40 · 2014: 49 · 2013: 24 · 2012: 27
FWCI: 35.38
Type: journal article
Language: en
Open access: closed
Locations: Interacting with Computers (publishedVersion)
HighWire Press Open Archive (submittedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
Keywords: physiological computing, psychophysiology, adaptive systems, human-computer interaction, smart technologies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Fundamentals of physiological computing

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks