The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Early, intermediate and late fusion strategies for robust deep learning-based multimodal action recognition
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“features from Red, Green, and Blue (RGB) images and skeletal sequences can be fused and their separate advantages exploited simultaneously (Boulahia et al. 2021).”
From A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding (2024) · cites this paper as Boulahia et al. 2021
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410 · cited 7×
“For instance, the use of the ST-GCN [41] extraction module provides on average 96, 000 features for each skeleton-based action sample.”
MethodInfluentialReal-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
Hara, K., Kataoka, H., & Satoh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00685 · Cited by 2,205
Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition
Liu, Z., Zhang, H., Chen, Z., Wang, Z., & Ouyang, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00022 · Cited by 1,225
Skeleton-Based Action Recognition With Shift Graph Convolutional Network
Cheng, K., Zhang, Y., He, X., Chen, W., Cheng, J., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00026 · Cited by 981
Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges
Gravina, R., Alinia, P., Ghasemzadeh, H., & Fortino, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.09.005 · Cited by 899
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action RecognitionPreprint
Yan, S., Xiong, Y., & Lin, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.07455 · Cited by 599
Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates
Liu, J., Shahroudy, A., Xu, D., Kot, A. C., & Wang, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2771306 · Cited by 530
Two-person interaction detection using body-pose features and multiple instance learning
Yun, K., Honorio, J., Chattopadhyay, D., Berg, T. L., & Samaras, D. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239234 · Cited by 523
Deep Multimodal Feature Analysis for Action Recognition in RGB+D Videos
Shahroudy, A., Ng, T.-T., Gong, Y., & Wang, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2691321 · Cited by 264
MMTM: Multimodal Transfer Module for CNN Fusion
Vaezi Joze, H. R., Shaban, A., Iuzzolino, M. L., & Koishida, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01330 · Cited by 259
Zolfaghari, M., Oliveira, G. L., Sedaghat, N., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.316 · Cited by 235
MFAS: Multimodal Fusion Architecture Search
Perez-Rua, J.-M., Vielzeuf, V., Pateux, S., Baccouche, M., & Jurie, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00713 · Cited by 193
Vision-based human action recognition: An overview and real world challenges
Jegham, I., Ben Khalifa, A., Alouani, I., & Mahjoub, M. A. (2020) · Forensic Science International: Digital Investigation · doi:10.1016/j.fsidi.2019.200901 · Cited by 181
VPN: Learning Video-Pose Embedding for Activities of Daily Living
Das, S., Sharma, S., Dai, R., Brémond, F., & Thonnat, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_5 · Cited by 181
Human activity recognition for video surveillance
Lin, W., Sun, M., Poovandran, R., & Zhang, Z. (2008) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2008.4542023 · Cited by 177
Human action recognition in RGB-D videos using motion sequence information and deep learning
Ijjina, E. P., & Chalavadi, K. M. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.07.013 · Cited by 168
Combining CNN streams of RGB-D and skeletal data for human activity recognition
Khaire, P., Kumar, P., & Imran, J. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.04.035 · Cited by 160
A multimodal approach for human activity recognition based on skeleton and RGB data
Franco, A., Magnani, A., & Maio, D. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.01.010 · Cited by 154
Two-stream RNN/CNN for action recognition in 3D videos
Zhao, R., Ali, H., & van der Smagt, P. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206288 · Cited by 150
A combined multiple action recognition and summarization for surveillance video sequences
Elharrouss, O., Almaadeed, N., Al-Maadeed, S. A., Bouridane, A., & Beghdadi, A. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01823-z · Cited by 130
Applications of mobile activity recognition
Lockhart, J. W., Pulickal, T. T., & Weiss, G. M. (2012) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2370216.2370441 · Cited by 128
HAMLET: A Hierarchical Multimodal Attention-based Human Activity Recognition Algorithm
Islam, M., & Iqbal, T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340987 · Cited by 123
Evaluating fusion of RGB-D and inertial sensors for multimodal human action recognition
Imran, J., & Raman, B. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01239-9 · Cited by 116
Deep Bilinear Learning for RGB-D Action Recognition
Hu, J., Zheng, W., Pan, J., Lai, J., & Zhang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_21 · Cited by 110
Islam, M. M., & Iqbal, T. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3059624 · Cited by 97
Fusion of depth, skeleton, and inertial data for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472170 · Cited by 90
Combing RGB and Depth Map Features for human activity recognition
Zhao, Y., Liu, Z., Yang, L., & Cheng, H. (2012) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · Cited by 89
MSAF: Multimodal Split Attention FusionPreprint
Su, L., Hu, C., Li, G., & Cao, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07175 · Cited by 89
Gimme Signals: Discriminative signal encoding for multimodal activity recognition
Memmesheimer, R., Theisen, N., & Paulus, D. W. R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341699 · Cited by 78
Infrared and 3D Skeleton Feature Fusion for RGB-D Action Recognition
de Boissiere, A. M., & Noumeir, R. (2020) · IEEE Access · doi:10.1109/access.2020.3023599 · Cited by 72
Dynamic hand gesture recognition based on 3D pattern assembled trajectories
Boulahia, S. Y., Anquetil, É., Multon, F., & Kulpa, R. (2017) · International Conference on Image Processing Theory, Tools and Applications (IPTA) · doi:10.1109/ipta.2017.8310146 · Cited by 67
Self-citationMulti-modal feature fusion for action recognition in RGB-D sequences
Shahroudy, A., Wang, G., & Ng, T.-T. (2014) · International Symposium on Communications, Control and Signal Processing · doi:10.1109/isccsp.2014.6877819 · Cited by 57
Fusing Multiple Features for Depth-Based Action Recognition
Zhu, Y. M., Chen, W., & Guo, G. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2629483 · Cited by 43
Context-Aware Cross-Attention for Skeleton-Based Human Action Recognition
Fan, Y., Weng, S., Zhang, Y., Shi, B., & Zhang, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2968054 · Cited by 39
Pham, C., Nguyen, L., Nguyen, A., Nguyen, C.-N., & Nguyen, V.-T. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11058-w · Cited by 35
Hierarchical Action Classification with Network Pruning
Davoodikakhki, M., & Yin, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64556-4_23 · Cited by 31
Shedding Light on People Action Recognition in Social Robotics by Means of Common Spatial Patterns
Rodríguez-Moreno, I., Martínez‐Otzeta, J. M., Goienetxea, I., Rodríguez, I., & Sierra, B. (2020) · Sensors · doi:10.3390/s20082436 · Cited by 18
Bouderbal, I., Amamra, A., & Benatia, M. A. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-69418-0_3 · Cited by 15
Self-citationCuDi3D: Curvilinear displacement based approach for online 3D action detection
Boulahia, S. Y., Anquetil, É., Multon, F., & Kulpa, R. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.07.003 · Cited by 12
Self-citation
Cited by
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274
A review of cancer data fusion methods based on deep learning
Zhao, Y., Li, X., Zhou, C., Peng, H., Zheng, Z., Chen, J., & Ding, W. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102361 · Cited by 95
Multimodal Hierarchical CNN Feature Fusion for Stress Detection
Kuttala, R., Subramanian, R., & Murthy, O. V. R. (2023) · IEEE Access · doi:10.1109/access.2023.3237545 · Cited by 104
Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities
Abdali, S., Shaham, S., & Krishnamachari, B. (2024) · ACM Computing Surveys · doi:10.1145/3697349 · Cited by 142
Shao, Z., Dou, W., & Pan, Y. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102113 · Cited by 96
Metadata
- Authors
- Boulahia, S. Y., Amamra, A., Madi, M. R., & Daikh, S.
- Corresponding author
- Boulahia, Said Yacine
- Venue
- Machine Vision and Applications
- Published
- 2021-09-30
- Volume
- 32
- Issue
- 6
- ISSN
- 0932-8092 (ISSN-L)
- 1432-1769
- OpenAlex
- W3204266507
- Cited by
- 236
- References
- 46
- Citations by year
- 2026: 49 · 2025: 87 · 2024: 53 · 2023: 34 · 2022: 12 · 2021: 1
- FWCI
- 9.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Machine Vision and Applications (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Keywords
- multimodal action recognition, feature-level fusion, intermediate fusion, decision fusion, feature fusion, human action recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.