Design of a hierarchy modular neural network and its application in multimodal emotion recognition
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A synaptic model of memory: long-term potentiation in the hippocampus
Bliss, T. V. P., & Collingridge, G. L. (1993) · Nature · doi:10.1038/361031a0 · Cited by 11,566 · cited 1×
“Besides, HMNN is trained based on Hebbian learning rule which has been demonstrated in various neural circuits (Bliss and Collingridge 1993; Hirsch et al. 1992).”
MethodDerrac, J., García, S., Molina, D., & Herrera, F. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.02.002 · Cited by 5,512
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Multimodal Emotion Recognition in Response to Videos
Soleymani, M., Pantic, M., & Pun, T. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.37 · Cited by 722
Hierarchical modularity in human brain functional networks
Meunier, D. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.037.2009 · Cited by 667
Uncovering Intrinsic Modular Organization of Spontaneous Brain Activity in Humans
He, Y., Wang, J., Wang, L., Chen, Z. J., Yan, C., Yang, H., Tang, H., Zhu, C., Gong, Q., Zang, Y., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005226 · Cited by 630
The modular and integrative functional architecture of the human brain
Bertolero, M. A., Yeo, B. T. T., & D’Esposito, M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510619112 · Cited by 565
Chen, Z. J., He, Y., Rosa-Neto, P., Germann, J., & Evans, A. C. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn003 · Cited by 484
Short-term emotion assessment in a recall paradigm
Chanel, G., Kierkels, J. J. M., Soleymani, M., & Pun, T. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.005 · Cited by 367
DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses
Abadi, M. K., Subramanian, R., Kia, S. M., Avesani, P., Patras, I., & Sebe, N. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2392932 · Cited by 365
Verma, G. K., & Tiwary, U. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.007 · Cited by 354
Kessous, L., Castellano, G., & Caridakis, G. (2010) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0025-5 · Cited by 256
Lu, B.-L., & Ito, M. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788664 · Cited by 241
Fan, G., Peng, L., & Hong, W. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.04.075 · Cited by 183
Ensemble of Deep Neural Networks with Probability-Based Fusion for Facial Expression Recognition
Wen, G., Hou, Z., Li, H., Li, D., Jiang, L., & Xun, E. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9472-6 · Cited by 164
Exploring Fusion Methods for Multimodal Emotion Recognition with Missing Data
Wagner, J., Andre, E., Lingenfelser, F., & Kim, J. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.12 · Cited by 156 · cited 2×
“For the decision-level fusion, features from different modalities are independently classified using separate clas-sifiers, and the output of each classifier is merged using multiple methods (Wagner et al. 2011), such as weighted voting, averaging and sum rule.”
BackgroundMethodModular neural-SVM scheme for speech emotion recognition using ANOVA feature selection method
Sheikhan, M., Bejani, M., & Gharavian, D. (2012) · Neural Computing and Applications · doi:10.1007/s00521-012-0814-8 · Cited by 118
Effect of number of hidden neurons on learning in large-scale layered neural networks
Shibata, K., & Ikeda, Y. (2009) · 2009 ICCAS-SICE · Cited by 117
Wang (2011) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2011.00030 · Cited by 104
Bejani, M., Gharavian, D., & Charkari, N. M. (2012) · Neural Computing and Applications · doi:10.1007/s00521-012-1228-3 · Cited by 80
Sánchez, D., Melín, P., & Castillo, O. (2015) · Information Sciences · doi:10.1016/j.ins.2015.02.020 · Cited by 60
Hierarchical modular brain connectivity is a stretch for criticality
Hilgetag, C. C., & Hütt, M.-T. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.10.016 · Cited by 55
A novel Bayesian learning method for information aggregation in modular neural networks
Wang, P., Xu, L., Zhou, S., Fan, Z., Li, Y., & Shan, F. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.06.104 · Cited by 52
Sun, B., Li, L., Wu, X., Zuo, T., Chen, Y., Zhou, G., He, J. Y. D., & Zhu, X. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0203-6 · Cited by 50
Assessing users’ emotion at interaction time: a multimodal approach with multiple sensors
Gonçalves, V. P., Giancristofaro, G. T., Filho, G. P. R., Johnson, T. M., Carvalho, V., Pessin, G., Néris, V. P. D. A., & Ueyama, J. (2016) · Soft Computing · doi:10.1007/s00500-016-2115-0 · Cited by 39
Ali, M., Sarwar, A., Sharma, V., & Suri, J. (2017) · Neural Computing and Applications · doi:10.1007/s00521-017-3246-7 · Cited by 32
Chétouani, M., Mahdhaoui, A., & Ringeval, F. (2009) · Cognitive Computation · doi:10.1007/s12559-009-9016-9 · Cited by 30
Hirsch, J. C., Barrionuevo, G., & Crépel, F. (1992) · Synapse · doi:10.1002/syn.890120110 · Cited by 27
Research on Personnel Information Collaborative Sensing Method of Intelligent Building Based on CPS
Wang, B., Zongjie, D., & Zhang, S. (2019) · Network Computing and Applications · doi:10.23977/jnca.2019.41001 · Cited by 26
Modular neural network modelling for long-range prediction of an evaporator
Russell, N. T., Bakker, H. H. C., & Chaplin, R. I. (2000) · Control Engineering Practice · doi:10.1016/s0967-0661(99)00123-9 · Cited by 21
Modular neural networks with Hebbian learning rule
Goltsev, A., & Grіtsenko, V. I. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.11.011 · Cited by 16
Adaptive On-Line Neural Network Retraining for Real Life Multimodal Emotion Recognition
Ioannou, S. V., Kessous, L., Caridakis, G., Karpouzis, K. C., Aharonson, V., & Kollias, S. (2006) · Lecture notes in computer science · doi:10.1007/11840817_9 · Cited by 12
Bhattacharya, A., Choudhury, D., & Dey, D. (2016) · Soft Computing · doi:10.1007/s00500-016-2395-4 · Cited by 11
Mozaffari, A., Scott, K. A., Chenouri, S., & Azad, N. L. (2016) · Soft Computing · doi:10.1007/s00500-016-2074-5 · Cited by 10
Planet, S., & Iriondo, I. (2012) · Cognitive Computation · doi:10.1007/s12559-012-9174-z · Cited by 7
Secondary learning in the assembly neural network
Goltsev, A. (2004) · Neurocomputing · doi:10.1016/j.neucom.2004.06.001 · Cited by 7
Induction, recording and recognition of natural emotions from facial expressions and speech prosody
Karpouzis, K. C., Caridakis, G., Cowie, R., & Douglas‐Cowie, E. (2013) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-013-0122-3 · Cited by 7
Automatic classification of urinary sediment images by using a hierarchical modular neural network
Mitsuyama, S., Motoike, J., & Matsuo, H. (1999) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.348624 · Cited by 4
Research works printed but not linked: 1
- Chen J, Hu B, Xu L, Moore P, Su Y (2015) Feature-level fusion of multimodal physiological signals for emotion recognition. In: The IEEE international conference on bioinformatics and biomedicine, pp 395–399
Cited by
Adaptive Multimodal Emotion Detection Architecture for Social Robots
Heredia, J., Lopes-Silva, E., Cardinale, Y., Díaz-Amado, J., Dongo, I., Graterol, W., & Aguilera, A. (2022) · IEEE Access · doi:10.1109/access.2022.3149214 · Cited by 116
Multimodal Emotion Recognition Using a Hierarchical Fusion Convolutional Neural Network
Zhang, Y., Cheng, C., & Zhang, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3049516 · Cited by 84
Multimodal emotion recognition: A comprehensive review, trends, and challenges
Ramaswamy, M. P. A., & Palaniswamy, S. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1563 · Cited by 70
Subject independent emotion recognition using EEG and physiological signals – a comparative study
Ramaswamy, M. P. A., & Palaniswamy, S. (2022) · Applied Computing and Informatics · doi:10.1108/aci-03-2022-0080 · Cited by 28
Dissociation artificial neural network for tool wear estimation in CNC milling
Wong, S. Y., Chuah, J. H., Yap, H. J., & Tan, C. F. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-022-10737-8 · Cited by 18
“In addition, MNNs have proven themselves to be highly robust with strong capabilities in handling corrupted or missing data [43].”
Background
Metadata
- Authors
- Li, W., Chu, M., & Qiao, J.
- Affiliations
- Beijing University of Technology (CN)
- Corresponding author
- Li, Wenjing
- Venue
- Soft Computing
- Published
- 2019-01-04
- Volume
- 23
- Issue
- 22
- Pages
- 11817-11828
- ISSN
- 1432-7643 (ISSN-L)
- 1433-7479
- OpenAlex
- W2906843454
- Cited by
- 13
- References
- 40
- Citations by year
- 2024: 3 · 2023: 2 · 2022: 4 · 2021: 3 · 2020: 1
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Soft Computing (publishedVersion)
- Funders
- National Natural Science Foundation of China (61603009, 61533002)
- Beijing Natural Science Foundation (4182007)
- Rixin Scientist Foundation of Beijing University of Technology (2017-RX(1)-04)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- multimodal emotion recognition, multimodal fusion, Hebbian learning, missing data, corrupted data, decision fusion, feature-level fusion, brain-inspired architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.