CoChat
Sign Up
Cited by 100Psychiatry, Mental Health, NeuroscienceArtificial Intelligence ApplicationsCognitive Computing and Networks

From Emotion AI to Cognitive AI

Open access
Zhao, Guoying, Li, Yante, Xu, Qianru·2022·International Journal of Network Dynamics and Intelligence
DOI 10.53941/ijndi0101006
Open this paper in CoChat — free accountOpen PDF

Abstract

Cognitive computing is recognized as the next era of computing. In order to make hardware and software systems more human-like, emotion artificial intelligence (AI) and cognitive AI which simulate human intelligence are the core of real AI. The current boom of sentiment analysis and affective computing in computer science gives rise to the rapid development of emotion AI. However, the research of cognitive AI has just started in the past few years. In this visionary paper, we briefly review the current development in emotion AI, introduce the concept of cognitive AI, and propose the envisioned future of cognitive AI, which intends to let computers think, reason, and make decisions in similar ways that humans do. The important aspect of cognitive AI in terms of engagement, regulation, decision making, and discovery are further discussed. Finally, we propose important directions for constructing future cognitive AI, including data and knowledge mining, multi-modal AI explainability, hybrid AI, and potential ethical challenges.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.53941/ijndi0101006

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 64

  1. Luckin, R. Machine Learning and Human Intelligence: The Future of Education for the 21st Century; UCL IOE Press, London, 27, July, 2018. doi:10.1177/14782103221117655 · DOI
  2. Isaacowitz, D.M.; Charles, S.T.; Carstensen, L.L. Emotion and cognition. In The Handbook of Aging and Cognition; Salthouse, T.A., Ed.; Lawrence Erlbaum Associates Inc.: Mahwah, 2000; pp. 593-631.
  3. Jessica A.Sommerville. Social Cognition. Encyclopedia of Infant and Early Childhood Development, 2020, pp.196-206, Elsevier. doi: 10.1016/B978-0-12-809324-5.21640-4. · DOI
  4. Jian, M.W.; Zhang, W.Y.; Yu, H.; et al, Saliency detection based on directional patches extraction and principal local color contrast. J. Vis. Commun. Image Represent., 2018, 57: 1-11. · DOI
  5. Jian, M.W., Qi, Q., Dong, J.Y.; et al, Integrating QDWD with pattern distinctness and local contrast for underwater saliency detec- tion. J. Vis. Commun. Image Represent., 2018, 53: 31-41. · DOI
  6. Jian, M.W.; Lam, K.M.; Dong, J.Y.; et al, Visual-patch-attention-aware saliency detection. IEEE Trans. Cybern., 2015, 45: 1575-1586. · DOI
  7. Schmid, U, Cognition and AI. Fachbereich 1 Künstliche Intelligenz der Gesellschaft für Informatik e.V., GI., 2008, 1: 5.
  8. IJNDI, 2022, 1(1): 65-72. https://doi.org/10.53941/ijndi0101006
  9. Pessoa, L. The Cognitive-Emotional Brain: From Interactions to Integration; MIT Press: Cambridge, 2013.
  10. Dolcos, F.; Katsumi, Y.; Moore, M.; et al, Neural correlates of emotion-attention interactions: From perception, learning, and mem- ory to social cognition, individual differences, and training interventions. Neurosci. Biobehav. Rev., 2020, 108: 559-601. · DOI
  11. Shackman, A.J.; Salomons, T.V.; Slagter, H.A.; et al, The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat. Rev. Neurosci., 2011, 12: 154-167. · DOI · Paper page
  12. Young, M.P.; Scanneil, J.W.; Burns, G.A.P.C.; et al, Analysis of connectivity: Neural systems in the cerebral cortex. Rev. Neurosci., 1994, 5: 227-250. · DOI
  13. Pessoa, L, On the relationship between emotion and cognition. Nat. Rev. Neurosci., 2008, 9: 148-158. · DOI · Paper page
  14. Martıńez-Miranda, J.; Aldea, A, Emotions in human and artificial intelligence. Comput. Hum. Behav., 2005, 21: 323-341. · DOI
  15. Tao, J.H.; Tan, T.N. Affective computing: A review. In Proceedings of the 1st International Conference on Affective Computing and Intelligent Interaction, Beijing, China, October 22-24, 2005; Springer: Beijing, China, 2005; pp. 981-995. doi:10.1007/11573548_ 125 · DOI
  16. Schuller, D.; Schuller, B.W, The age of artificial emotional intelligence. Computer, 2018, 51: 38-46. · DOI
  17. Saxena, A.; Khanna, A.; Gupta, D, Emotion recognition and detection methods: A comprehensive survey. J. Artif. Intell. Syst., 2020, 2: 53-79. · DOI
  18. Li, Y.T.; Wei, J.S.; Liu, Y.; et al. 2022, Deep learning for micro-expression recognition: A survey. IEEE Trans. Affect. Comput., 2022, 13: 2028-2046. · DOI
  19. Liu, Y.; Zhou, J.Z.; Li, X.; et al, Graph-based Facial Affect Analysis: A Review. IEEE Trans. Affect. Comput., 2022, 19: 1-20. · DOI
  20. Liu, Y.; Zhang, X.M.; Zhou, J.Z.; et al, SG-DSN: A Semantic Graph-based Dual-Stream Network for facial expression recognition. Neurocomputing, 2021, 462: 320-330. · DOI
  21. Chen, H.Y.; Liu, X.; Li, X.B.; et al. Analyze spontaneous gestures for emotional stress state recognition: A micro-gesture dataset and analysis with deep learning. In Proceedings of 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), Lille, France, 14-18 May 2019; IEEE: Lille, France, 2019; pp. 1-8. doi:10.1109/FG.2019.8756513 · DOI
  22. Liu, X.; Shi, H.L.; Chen, H.Y.; et al. iMiGUE: An identity-free video dataset for micro-gesture understanding and emotion analysis. In Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20-25 June 2021; IEEE: Nashville, USA, 2021; pp. 10631-10642. doi:10.1109/CVPR46437.2021.01049 · DOI
  23. Koolagudi, S.G.; Rao, K.S, Emotion recognition from speech: A review. Int. J. Speech Technol., 2012, 15: 99-117. · DOI
  24. Zhou, Z.H.; Zhao, G.Y.; Hong, X.P.; et al, A review of recent advances in visual speech decoding. Image Vis. Comput., 2014, 32: 590-605. · DOI
  25. Yu, Z.T.; Li, X.B.; Zhao, G.Y, Facial-Video-Based Physiological Signal Measurement: Recent advances and affective applications. IEEE Signal Process. Mag., 2021, 38: 50-58. · DOI
  26. Shu, L.; Xie, J.Y.; Yang, M.Y.; et al, A review of emotion recognition using physiological signals. Sensors, 2018, 18: 2074. · DOI · Paper page
  27. Li, X.B.; Cheng, S.Y.; Li, Y.T.; et al. 4DME: A spontaneous 4D micro-expression dataset with multimodalities. IEEE Trans. Affect. Comput. 2022, in press. doi:10.1109/TAFFC.2022.3182342 · DOI
  28. Huang, X.H.; Kortelainen, J.; Zhao, G.Y.; et al, Multi-modal emotion analysis from facial expressions and electroencephalogram. Comput. Vis. Image Underst., 2016, 147: 114-124. · DOI
  29. Lisetti, C.L. Emotion synthesis: Some research directions. In Proceedings of the Working Notes of the AAAI Fall Symposium Series on Emotional and Intelligent: The Tangled Knot of Cognition, Orlando, FL, USA, October 22-24,1998; AAAI Press: Menlo Park, USA, 1998; pp. 109-115.
  30. Hudlicka, E, Guidelines for designing computational models of emotions. Int. J. Synth. Emotions (IJSE), 2011, 2: 26-79. · DOI
  31. Strömfelt, H.; Zhang, Y.; Schuller, B.W. 2017. Emotion-augmented machine learning: Overview of an emerging domain. In Pro- ceedings of 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, TX, USA, 23-26 October 2017; IEEE: San Antonio, USA, 2017; pp. 305-312. doi:10.1109/ACII.2017.8273617 · DOI
  32. Khashman, A. A modified backpropagation learning algorithm with added emotional coefficients, IEEE Trans. Neural Netw., 2008, 19: 1896-1909. · DOI
  33. Hwang, K.; Chen, M. Big-Data Analytics for Cloud, IoT and Cognitive Computing; John Wiley & Sons: Hoboken, NJ, USA, 2017.
  34. Wang, Y.X, A cognitive informatics reference model of autonomous agent systems (AAS). Int. J. Cognit. Inf. Nat. Intell., 2009, 3: 1-16. · DOI
  35. Li, J.H.; Mei, C.L.; Xu, W.H.; et al. Concept learning via granular computing: A cognitive viewpoint. Inf. Sci. 2015, 298, 447-467. doi:10.1016/j.ins.2014.12.010 · DOI
  36. Chen, M.; Herrera, F.; Hwang, K, Cognitive computing: Architecture, technologies and intelligent applications. IEEE Access, 2018, 6: 19774-19783. · DOI · Paper page
  37. Gudivada, V.N, Cognitive computing: Concepts, architectures, systems, and applications. Handb. Stat., 2016, 35: 3-38. · DOI
  38. Sreedevi, A.G.; Harshitha, T.N.; Sugumaran, V.; et al. Application of cognitive computing in healthcare, cybersecurity, big data and IoT: A literature review. Inf. Process. Manage. 2022, 59, 102888. doi:10.1016/J.IPM.2022.102888 · DOI
  39. Ferrucci, D.A, Introduction to "This is Watson". IBM J. Res. Dev., 2012, 56: 1.1-1.5. · DOI
  40. Hurwitz, J.S.; Kaufman, M.; Bowles, A. Cognitive Computing and Big Data Analytics; John Wiley & Sons: Indianapolis, IN, USA, 2015.
  41. Fairclough, S.H.; Venables, L, Prediction of subjective states from psychophysiology: A multivariate approach. Biol. Psychol., 2006, 71: 100-110. · DOI
  42. Teixeira, T.; Wedel, M.; Pieters, R, Emotion-induced engagement in internet video advertisements. J. Mark. Res., 2012, 49: 144-159. · DOI
  43. Skinner, E.; Pitzer, J.; Brule, H. The role of emotion in engagement, coping, and the development of motivational resilience. In Inter- national Handbook of Emotions in Education; Pekrun, R.; Linnenbrink-Garcia, L., Eds.; Routledge: New York, 2014; pp. 331-347.
  44. Mathur, A.; Lane, N.D.; Kawsar, F. Engagement-aware computing: Modelling user engagement from mobile contexts. In Proceed- 48. ings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 12 -16 September 2016; ACM: Heidelberg, Germany, 2016; pp. 622-633. doi:10.1145/2971648.2971760 · DOI
  45. Renninger, K.A.; Hidi, S.E. The Power of Interest for Motivation and Engagement; Routledge: New York, 2015.
  46. Klie, L, IBM's Watson brings cognitive computing to customer engagement. Speech Technol. Mag., 2014, 19: 38-42.
  47. Behera, R.K.; Bala, P.K.; Dhir, A, The emerging role of cognitive computing in healthcare: A systematic literature review. Int. J. Med. Inf., 2019, 129: 154-166. · DOI · Paper page
  48. Schunk, D.H.; Greene, J.A. Historical, contemporary, and future perspectives on self-regulated learning and performance. In Hand- book of Self-Regulation of Learning and Performance; Schunk, D.H.; Greene, J.A., Eds.; Routledge: New York, 2018; pp. 1 -15. doi:10.4324/9781315697048-1 · DOI
  49. Bandura, A. Social Foundations of Thought and Action; Prentice Hall, New York, 2002. Available online: https://psycnet.apa.org/ record/1985-98423-000(accessed on 5 November 2022).
  50. Azevedo, R.; Gašević, D, Analyzing multimodal multichannel data about self-regulated learning with advanced learning technolo- gies: Issues and challenges. Comput. Hum. Behav., 2019, 96: 207-210. · DOI · Paper page
  51. Forgas, J.P, Mood effects on decision making strategies. Aust. J. Psychol., 1989, 41: 197-214. · DOI
  52. Loewenstein, G.; Lerner, J.S. The role of affect in decision making. In Handbook of Affective Science; Davidson, R.; Goldsmith, H.; Scherer, K., Eds.; Oxford University Press: Oxford, 2003; pp. 619-642.
  53. Iyengar, S.S.; Mukhopadhyay, S.; Steinmuller, C.; et al, Preventing future oil spills with software-based event detection. Computer, 2010, 43: 95-97. · DOI
  54. Starkey, K.; Hatchuel, A.; Tempest, S, Management research and the new logics of discovery and engagement. J. Manage. Stud., 2009, 46: 547-558. · DOI
  55. Araujo, T.; Helberger, N.; Kruikemeier, S.; et al, In AI we trust? Perceptions about automated decision-making by artificial intelli- gence AI Soc., 2020, 35: 611-623. · DOI · Paper page
  56. Sagiroglu, S.; Sinanc, D. Big data: A review. In Proceedings of 2013 International Conference on Collaboration Technologies and Systems (CTS), San Diego, CA, USA, 20-24 May 2013; IEEE: San Diego, USA, 2013; pp. 42-47. doi:10.1109/CTS.2013.6567202 · DOI
  57. Peng, W.; Varanka, T.; Mostafa, A.; et al, Hyperbolic deep neural networks: A survey. IEEE Trans. Pattern Anal. Mach. Intell., 2022, 44: 10023-10044. · DOI
  58. Li, Z.M.; Tian, W.W.; Li, Y.T.; et al. A more effective method for image representation: Topic model based on latent dirichlet allo- cation. In Proceedings of 2015 14th International Conference on Computer-Aided Design and Computer Graphics (CAD/Graphics), Xi'an, China, 26-28 August 2015; IEEE: Xi'an, China, 2015; pp. 143-148. doi:10.1109/CADGRAPHICS.2015.19 · DOI
  59. Jarrahi, M.H, Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Bus. Horiz., 2018, 61: 577-586. · DOI · Paper page
  60. Wyant, D.K.; Bingi, P.; Knight, J.R.; et al. DeTER framework: A novel paradigm for addressing cybersecurity concerns in mobile healthcare. In Research Anthology on Securing Medical Systems and Records; Information Resources Management Association, Ed.; IGI Global, Chocolate Ave. Hershey, PA 17033, USA, 2022; pp. 381-407. doi:10.4018/978-1-6684-6311-6.ch019 · DOI
  61. Ravindran, N.J.; Gopalakrishnan, P. Predictive analysis for healthcare sector using big data technology. In Proceedings of 2018 Sec- ond International Conference on Green Computing and Internet of Things (ICGCIoT), Bangalore, India, 16-18 August 2018; IEEE: Bangalore, India, 2018; pp. 326-331. doi:10.1109/ICGCIoT.2018.8753090 · DOI
  62. Lin, S.J.; Hsu, M.F. Incorporated risk metrics and hybrid AI techniques for risk management. Neural Comput. Appl. 2017, 28, 3477-3489. doi:10.1007/s00521-016-2253-4 · DOI
  63. Peeters, M.M.M.; van Diggelen, J.; van den Bosch, K.; et al, Hybrid collective intelligence in a human-AI society. AI Soc., 2021, 36: 217-238. · DOI · Paper page
  64. Citation: Zhao, G.; Li, Y.; Xu, Q. From Emotion AI to Cognitive AI International Journal of Network Dynamics and Intelligence. https://doi.org/10.53941/

Cited by

Sorted by citations

Authors
Zhao, G., Li, Y., & Xu, Q.
Affiliations
University of Oulu (FI)
ORCID
Venue
International Journal of Network Dynamics and Intelligence
Publisher
Scilight Press Pty Ltd
Published
2022-12-22
Volume
1
Issue
1
Pages
65-72
ISSN
2653-6226 (ISSN-L)
DOI
10.53941/ijndi0101006
OpenAlex
W4313325965
Cited by
100
References
9
Citations by year
2026: 18 · 2025: 36 · 2024: 17 · 2023: 29
FWCI
6.74
Type
journal article
Language
en
Open access
Licence
Locations
International Journal of Network Dynamics and Intelligence (publishedVersion, cc-by)
Funders
Academy of Finland (336116, 345122)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
Keywords
cognitive AI, affective computing, sentiment analysis, cognitive computing, AI decision-making, explainable AI, hybrid AI, knowledge mining, AI ethics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review