CoChat

Hierarchical human activity recognition with fusion of audio and multiple inertial sensor modalities

Yılmaz, Tuğce Alara, Yatbaz, Hakan Yekta, Ever, Enver, Yazici, Adnan · 2025 · Scientific Reports
Cited by 3

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-025-29801-w

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 46

  1. Bolatov, A., Yessenbayeva, A. & Yazici, A. Glula: Linear attention-based model for efficient human activity recognition from wearable sensors. Wearable Technol. 5, e10 (2024). · DOI
  2. Islam, M. M., Nooruddin, S., Karray, F. & Muhammad, G. Multi-level feature fusion for multimodal human activity recognition in internet of healthcare things. Inf. Fusion 94, 17–31 (2023). · DOI · Paper page
  3. Li, W. Application of iot-enabled computing technology for designing sports technical action characteristic model. Soft Comput. 1–18 (2023). · DOI
  4. Li, Y., Yang, G., Su, Z., Li, S. & Wang, Y. Human activity recognition based on multienvironment sensor data. Inf. Fusion 91, 47–63 (2023). · DOI · Paper page
  5. Kshirsagar, A. P. & Azath, H. Yolov3-based human detection and heuristically modified-lstm for abnormal human activities detection in atm machine. J. Vis. Commun. Image Represent. 95, 103901 (2023). · doi:10.1016/j.jvcir.2023.103901
  6. Saleem, G., Bajwa, U. I. & Raza, R. H. Toward human activity recognition: a survey. Neural Comput. Appl. 35, 4145–4182 (2023). · DOI
  7. Yatbaz, H. Y., Ever, E. & Yazici, A. Activity recognition and anomaly detection in e-health applications using color-coded representation and lightweight cnn architectures. IEEE Sens. J. 21, 14191–14202 (2021). · DOI
  8. Ehatisham-Ul-Haq, M., Azam, M. A., Amin, Y. & Naeem, U. C2fhar: Coarse-to-fine human activity recognition with behavioral context modeling using smart inertial sensors. IEEE Access 8, 7731–7747 (2020). · DOI
  9. Asim, Y., Azam, M. A., Ehatisham-ul Haq, M., Naeem, U. & Khalid, A. Context-aware human activity recognition (cahar) in-the-wild using smartphone accelerometer. IEEE Sens. J. 20, 4361–4371 (2020). · DOI
  10. Anguita, D. et al. A public domain dataset for human activity recognition using smartphones. In Esann 3, 3 (2013).
  11. Zheng, Y., Liu, Q., Chen, E., Ge, Y. & Zhao, J. L. Time series classification using multi-channels deep convolutional neural networks. In International Conference on Web-Age Information Management, 298–310 (Springer, 2014). · DOI · Paper page
  12. Altun, K., Barshan, B. & Tunçel, O. Comparative study on classifying human activities with miniature inertial and magnetic sensors. Pattern Recogn. 43, 3605–3620 (2010). · DOI · Paper page
  13. Balaha, H. M. & Hassan, A.E.-S. Comprehensive machine and deep learning analysis of sensor-based human activity recognition. Neural Comput. Appl. 35, 12793–12831 (2023). · DOI
  14. Yazici, A. et al. A smart e-health framework for monitoring the health of the elderly and disabled. Internet of Things 24, 100971 (2023). · DOI
  15. Wang, Y., Cang, S. & Yu, H. A data fusion-based hybrid sensory system for older people’s daily activity and daily routine recognition. IEEE Sens. J. 18, 6874–6888 (2018). · DOI
  16. Mario, M.-O. Human activity recognition based on single sensor square hv acceleration images and convolutional neural networks. IEEE Sens. J. 19, 1487–1498 (2018). · DOI · Paper page
  17. Ignatov, A. Real-time human activity recognition from accelerometer data using convolutional neural networks. Appl. Soft Comput. 62, 915–922 (2018). · DOI · Paper page
  18. Gao, W. et al. Deep neural networks for sensor-based human activity recognition using selective kernel convolution. IEEE Trans. Instrum. Meas. 70, 1–13 (2021).
  19. Meena, T. & Sarawadekar, K. Seq2dense u-net: Analysing sequential inertial sensor data for human activity recognition using dense segmentation model. IEEE Sensors J. (2023). · DOI
  20. Aidarova, S., Nurmakhan, T., Myrzakhan, R., Fazli, S. & Yazici, A. Advancing activity recognition with multimodal fusion and transformer techniques. IEEE Sens. J. 25, 19632–19649. https://doi.org/10.1109/JSEN.2025.3555663 (2025). · DOI
  21. Jung, M. & Chi, S. Human activity classification based on sound recognition and residual convolutional neural network. Autom. Constr. 114, 103177 (2020). · DOI
  22. Huang, J. et al. Tse-cnn: A two-stage end-to-end cnn for human activity recognition. IEEE J. Biomed. Health Inform. 24, 292–299 (2019). · DOI · Paper page
  23. Teng, Q., Wang, K., Zhang, L. & He, J. The layer-wise training convolutional neural networks using local loss for sensor-based human activity recognition. IEEE Sens. J. 20, 7265–7274 (2020). · DOI · Paper page
  24. Hassan, M. M., Huda, S., Uddin, M. Z., Almogren, A. & Alrubaian, M. Human activity recognition from body sensor data using deep learning. J. Med. Syst. 42, 1–8 (2018). · DOI · Paper page
  25. Yang, X. et al. A multiscale cross-modal interactive fusion network for human activity recognition using wearable sensors and smartphones. IEEE Internet Things J. 11, 27139–27152. https://doi.org/10.1109/JIOT.2024.3400022 (2024). · DOI
  26. Khan, D. et al. Advanced IoT-based human activity recognition and localization using deep polynomial neural network. IEEE Access 12, 94337–94353. https://doi.org/10.1109/ACCESS.2024.3420752 (2024). · DOI
  27. Attoumi, H., Achroufene, A., Saifi, R., Souici, L. & Boukredera, D. Smartphone-based context-aware system for human activity recognition: dynamic and static methods. Multimed. Tools Appl. https://doi.org/10.1007/s11042-025-21053-0 (2025). · DOI
  28. Stork, J. A., Spinello, L., Silva, J. & Arras, K. O. Audio-based human activity recognition using non-markovian ensemble voting. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, 509–514 (IEEE, 2012). · DOI
  29. Bukht, T. F. N. et al. A review of video-based human activity recognition: theory, methods and applications. Multimed. Tools Appl. 1–47 (2024).
  30. Sanal Kumar, K. & Bhavani, R. Human activity recognition in egocentric video using hog, gist and color features. Multimed. Tools Appl. 79, 3543–3559 (2020). · DOI
  31. Prati, A., Shan, C. & Wang, K.I.-K. Sensors, vision and networks: From video surveillance to activity recognition and health monitoring. J. Ambient Intell. Smart Environ. 11, 5–22 (2019). · DOI · Paper page
  32. Khaire, P., Kumar, P. & Imran, J. Combining cnn streams of rgb-d and skeletal data for human activity recognition. Pattern Recogn. Lett. 115, 107–116 (2018). · DOI · Paper page
  33. Li, W., Wen, L., Chang, M.-C., Lim, S.-N. & Lyu, S. Adaptive rnn tree for large-scale human action recognition. 1453–1461 (2017). · DOI · Paper page
  34. Jia, C., Shao, M., Li, S., Zhao, H. & Fu, Y. Stacked denoising tensor auto-encoder for action recognition with spatiotemporal corruptions. IEEE Trans. Image Process. PP, 1–1 (2017).
  35. Ullah, A., Muhammad, K., Del Ser, J., Baik, S. & Albuquerque, V. Activity recognition using temporal optical flow convolutional features and multi-layer lstm. IEEE Trans. Ind. Electron. PP, 1–1 (2018).
  36. Jalal, A. Robust human activity recognition from depth video using spatiotemporal multi-fused features. Pattern Recogn. 61, 295–308 (2017). · DOI · Paper page
  37. Wang, P., Wang, S., Gao, Z., Hou, Y. & Li, W. Structured images for rgb-d action recognition. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), 1005–1014 (2017). · DOI
  38. Du, Y., Wang, W. & Wang, L. Hierarchical recurrent neural network for skeleton based action recognition. In CVPR, 1110–1118 (IEEE Computer Society, 2015). · DOI · Paper page
  39. Tarafdar, P. & Bose, I. Recognition of human activities for wellness management using a smartphone and a smartwatch: A boosting approach. Decis. Support Syst. 140, 113426 (2020). · DOI
  40. Cruciani, F. et al. Feature learning for human activity recognition using convolutional neural networks: A case study for inertial measurement unit and audio data. CCF Trans. Pervasive Comput. Interact. 2, 18–32 (2020). · DOI · Paper page
  41. Ehatisham-ul Haq, M. & Azam, M. A. Opportunistic sensing for inferring in-the-wild human contexts based on activity pattern recognition using smart computing. Future Gener. Comput. Syst. 106, 374–392 (2020). · DOI
  42. Zhumabekova, K., Yazici, A. & Enver Ever, A. Edge-integrated nosql database for efficient wireless multimedia sensor networks. In International Conference on Advanced Information Networking and Applications, 129–139 (Springer, 2025). · doi:10.1007/978-3-031-87763-6_12
  43. Adaimi, R. & Thomaz, E. Leveraging active learning and conditional mutual information to minimize data annotation in human activity recognition. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3 (2019). · DOI
  44. Ge, W., Mou, G., Agu, E. O. & Lee, K. Deep heterogeneous contrastive hyper-graph learning for in-the-wild context-aware human activity recognition. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, https://doi.org/10.1145/3631444 (2024). · DOI
  45. Ge, W., Mou, G., Agu, E. O. & Lee, K. Semantically encoding activity labels for context-aware human activity recognition. In 2025 IEEE International Conference on Pervasive Computing and Communications (PerCom), 190–196. https://doi.org/10.1109/PerCom64205.2025.00039 (2025). · DOI
  46. King, G. & Zeng, L. Logistic regression in rare events data. Polit. Anal. 9, 137–163 (2001). · DOI · Paper page

Metadata

Authors
Yılmaz, T. A., Yatbaz, H. Y., Ever, E., & Yazici, A.
Venue
Scientific Reports
Published
2025-12-12
Volume
16
Issue
1
ISSN
2045-2322
Cited by
3
References
12
Language
en
Licence
Funders
Ministry of Science and Higher Education of the Republic of Kazakhstan (AP23487613)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Hierarchical human activity recognition with fusion of audio and multiple inertial sensor modalities. https://app.cochat.ai/papers/10.1038/s41598-025-29801-w
The paper
Yılmaz, T. A., Yatbaz, H. Y., Ever, E., & Yazici, A. (2025). Hierarchical human activity recognition with fusion of audio and multiple inertial sensor modalities. Scientific Reports. https://doi.org/10.1038/s41598-025-29801-w

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.