Multimodal Deep Learning for Activity and Context Recognition
Open accessAbstract
Wearables and mobile devices see the world through the lens of half a dozen low-power sensors, such as, barometers, accelerometers, microphones and proximity detectors. But differences between sensors ranging from sampling rates, discrete and continuous data or even the data type itself make principled approaches to integrating these streams challenging. How, for example, is barometric pressure best combined with an audio sample to infer if a user is in a car, plane or bike? Critically for applications, how successfully sensor devices are able to maximize the information contained across these multi-modal sensor streams often dictates the fidelity at which they can track user behaviors and context changes. This paper studies the benefits of adopting deep learning algorithms for interpreting user activity and context as captured by multi-sensor systems. Specifically, we focus on four variations of deep neural networks that are based either on fully-connected Deep Neural Networks (DNNs) or Convolutional Neural Networks (CNNs). Two of these architectures follow conventional deep models by performing feature representation learning from a concatenation of sensor types. This classic approach is contrasted with a promising deep model variant characterized by modality-specific partitions of the architecture to maximize intra-modality learning. Our exploration represents the first time these architectures have been evaluated for multimodal deep learning under wearable data -- and for convolutional layers within this architecture, it represents a novel architecture entirely. Experiments show these generic multimodal neural network models compete well with a rich variety of conventional hand-designed shallow methods (including feature extraction and classifier construction) and task-specific modeling pipelines, across a wide-range of sensor types and inference tasks (four different datasets). Although the training and inference overhead of these multimodal deep approaches is in some cases appreciable, we also demonstrate the feasibility of on-device mobile and wearable execution is not a barrier to adoption. This study is carefully constructed to focus on multimodal aspects of wearable data modeling for deep learning by providing a wide range of empirical observations, which we expect to have considerable value in the community. We summarize our observations into a series of practitioner rules-of-thumb and lessons learned that can guide the usage of multimodal deep learning for activity and context detection.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · see citing works
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,037 · see citing works
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809 · see citing works
(2016) · Cited by 11,679 · see citing works
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · see citing works
(2006) · Springer eBooks · Cited by 8,123 · see citing works
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
(2011) · Cited by 2,752 · see citing works
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,785 · see citing works
Proceedings of the 29th International Conference on Machine Learning (ICML-12)Preprint
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,687 · see citing works
Unifying Visual-Semantic Embeddings with Multimodal Neural Language ModelsPreprint
Kiros, R., Salakhutdinov, R., & Zemel, R. S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.2539 · Cited by 1,386 · see citing works
Deep neural networks for small footprint text-dependent speaker verification
Variani, E., Lei, X., McDermott, E., Moreno, I. L., & Gónzalez-Domínguez, J. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854363 · Cited by 1,073 · see citing works
Consensus Filters for Sensor Networks and Distributed Sensor Fusion
Olfati‐Saber, R., & Shamma, J. S. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2005.1583238 · Cited by 1,005 · see citing works
Deep Bayesian Active Learning with Image Data
Gal, Y., Islam, R., & Ghahramani, Z. (2017) · arXiv · doi:10.48550/arxiv.1703.02910 · Cited by 900 · see citing works
Early versus late fusion in semantic video analysis
Snoek, C. G. M., Worring, M., & Smeulders, A. W. M. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101236 · Cited by 899 · see citing works
On Deep Multi-View Representation Learning
Wang, W., Livescu, K., & Bilmes, J. (2015) · Cited by 751 · see citing works
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714 · see citing works
Self-citationDeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · see citing works
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606 · see citing works
The Mobile Sensing Platform: An Embedded Activity Recognition System
Choudhury, T., Borriello, G., Consolvo, S., Haehnel, D., Harrison, B. L., Hemingway, B., Hightower, J. R., Klasnja, P., Koscher, K., LaMarca, A., et al. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.39 · Cited by 598 · see citing works
Sensor network-based countersniper system
Simon, G., Maróti, M., Lédeczi, Á., et al. (2004) · International Conference on Embedded Networked Sensor Systems · doi:10.1145/1031495.1031497 · Cited by 577 · see citing works
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/1869983.1869992 · Cited by 561 · see citing works
Self-citationSmall-footprint keyword spotting using deep neural networks
Chen, G., Parada, C., & Heigold, G. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854370 · Cited by 555 · see citing works
Fusing audio, visual and textual clues for sentiment analysis from multimodal content
Poria, S., Cambria, E., Howard, N., Huang, G.-B., & Hussain, A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.01.095 · Cited by 534 · see citing works
DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450 · see citing works
Self-citationAccelerometer-based transportation mode detection on smartphones
Hemminki, S., Nurmi, P., & Tarkoma, S. (2013) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/2517351.2517367 · Cited by 436 · see citing works
Multimodal semi-supervised learning for image classification
Guillaumin, M., Verbeek, J. J., & Schmid, C. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540120 · Cited by 425 · see citing works
Explain Images with Multimodal Recurrent Neural NetworksPreprint
Mao, J., Xu, W., Yang, Y., Wang, J., & Yuille, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.1090 · Cited by 423 · see citing works
EmoNets: Multimodal deep learning approaches for emotion recognition in video
Kahou, S. E., Bouthillier, X., Lamblin, P., Gülçehre, Ç., Michalski, V., Konda, K., Jean, S., Froumenty, P., Dauphin, Y., Boulanger-Lewandowski, N., et al. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0195-2 · Cited by 413 · see citing works
Deep learning for robust feature generation in audiovisual emotion recognition
Kim, Y., Lee, H., & Provost, E. M. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638346 · Cited by 401 · see citing works
Multimodal affect recognition in learning environments
Kapoor, A., & Picard, R. W. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101300 · Cited by 342 · see citing works
DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications
Huynh, L. N., Lee, Y., & Balan, R. K. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081360 · Cited by 329 · see citing works
Lane, N. D., Georgiev, P., & Qendro, L. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804262 · Cited by 310 · see citing works
Self-citationCan Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282 · see citing works
Self-citationBhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236 · see citing works
Self-citationCNN-based sensor fusion techniques for multimodal human activity recognition
Münzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., & Dürichen, R. (2017) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3123021.3123046 · Cited by 236 · see citing works
Wireless Sensor Networks for Battlefield Surveillance
Bokareva, T., Hu, W. S., Kanhere, S. S., et al. (2006) · Cited by 235 · see citing works
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., & Kawsar, F. (2015) · doi:10.1145/2820975.2820980 · Cited by 231 · see citing works
Self-citationDeep multimodal learning for Audio-Visual Speech Recognition
Mroueh, Y., Marcheret, E., & Goel, V. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178347 · Cited by 226 · see citing works
PD Disease State Assessment in Naturalistic Environments Using Deep Learning
Hammerla, N., Fisher, J., Andras, P., Rochester, L., Walker, R., & Ploetz, T. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9484 · Cited by 179 · see citing works
From smart to deep: Robust activity recognition on smartwatches using deep learning
Bhattacharya, S., & Lane, N. D. (2016) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2016.7457169 · Cited by 175 · see citing works
Self-citationOnline multimodal deep similarity learning with application to image retrieval
Wu, P., Hoi, S. C. H., Xia, H., Zhao, P., Wang, D., & Miao, C. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502112 · Cited by 173 · see citing works
Activity recognition in beach volleyball using a Deep Convolutional Neural Network
Kautz, T., Groh, B. H., Hannink, J., Jensen, U. J., Strubberg, H., & Eskofier, B. M. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0495-0 · Cited by 162 · see citing works
Towards multimodal deep learning for activity recognition on mobile devices
Radu, V., Lane, N. D., Bhattacharya, S., Mascolo, C., Marina, M. K., & Kawsar, F. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct · doi:10.1145/2968219.2971461 · Cited by 147 · see citing works
Self-citationImproved Multimodal Deep Learning with Variation of Information
Sohn, K., Shang, W., & Lee, H. (2014) · neural information processing systems · Cited by 142 · see citing works
Mobile Robot Localization and Map Building
Castellanos, J. A., & Tardós, J. D. (1999) · Springer eBooks · doi:10.1007/978-1-4615-4405-0 · Cited by 140 · see citing works
Morales, F. J. O., & Roggen, D. (2016) · Proceedings of the 2016 ACM International Symposium on Wearable Computers · doi:10.1145/2971763.2971764 · Cited by 136 · see citing works
Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness
Zappi, P., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., & Troster, G. (2007) · 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information · doi:10.1109/issnip.2007.4496857 · Cited by 126 · see citing works
A semi-supervised learning approach for robust indoor-outdoor detection with smartphones
Radu, V., Katsikouli, P., Sarkar, R., & Marina, M. K. (2014) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/2668332.2668347 · Cited by 125 · see citing works
Self-citationRadu, V., & Marina, M. K. (2013) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2013.6817916 · Cited by 119 · see citing works
Self-citationSimilar gait action recognition using an inertial sensor
Ngo, T. T., Makihara, Y., Nagahara, H., Mukaigawa, Y., & Yagi, Y. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.10.012 · Cited by 103 · see citing works
Khamis, M., Alt, F., Hassib, M., von Zezschwitz, E., Hasholzner, R., & Bulling, A. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2892314 · Cited by 98 · see citing works
Brown, D. E., Corruble, V., & Pittard, C. L. (1993) · Pattern Recognition · doi:10.1016/0031-3203(93)90060-a · Cited by 95 · see citing works
Multimodal recognition of reading activity in transit using body-worn sensors
Bulling, A., Ward, J. A., & Gellersen, H. W. (2012) · ACM Transactions on Applied Perception · doi:10.1145/2134203.2134205 · Cited by 95 · see citing works
Guo, H., Chen, L., Peng, L., & Chen, G. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971708 · Cited by 83 · see citing works
Georgiev, P., Bhattacharya, S., Lane, N. D., & Mascolo, C. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3131895 · Cited by 67 · see citing works
Multimodal Emotion Recognition Using Multimodal Deep LearningPreprint
Liu, W., Zheng, W., & Lu, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.08225 · Cited by 49 · see citing works
Multimodality Sensing for Eating Recognition
Merck, C., Maher, C., Mirtchouk, M., Zheng, M., Huang, Y., & Kleinberg, S. (2016) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/eai.16-5-2016.2263281 · Cited by 38 · see citing works
Learning to judge like a human
Brock, H., Ohgi, Y., & Lee, J. (2017) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3123021.3123038 · Cited by 20 · see citing works
Multimodal ambulatory sleep detection
Chen, W. '., Sano, A., Martínez, D., et al. (2017) · IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) · doi:10.1109/bhi.2017.7897306 · Cited by 18 · see citing works
Multimodal multisensor activity annotation tool
Barz, M., Moniri, M. M., Weber, M., et al. (2016) · doi:10.1145/2968219.2971459 · Cited by 17 · see citing works
Multimodal data collection framework for mental stress monitoring
Kye, S., Moon, J., Lee, J., Choi, I., Cheon, D., & Lee, K. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3125616 · Cited by 16 · see citing works
Sports video classification from multimodal information using deep neural networks
Sachan, D. S., Tekwani, U., & Sethi, A. (2013) · National Conference on Artificial Intelligence · Cited by 8 · see citing works
(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690 · see citing works
“cture not only extracts modality-specific information from various sensors but also allows flexible complexity distribution since the structures of the modality-specific branches can be different. In [115, 116], Radu et al. proposed a fully-connected deep neural network (DNN) architecture to facilitate the intra-modal…”
BackgroundBayoudh, K., Knani, R., Hamdaoui, F., & Mtibaa, A. (2022) · The Visual Computer · doi:10.1007/s00371-021-02166-7 · Cited by 456 · see citing works
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works
“Similarly, researchers also investigated DL training in wearable [347] and embedded [348] devices.”
BackgroundA Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition
Chen, K., Yao, L., Zhang, D., Wang, X., Chang, X., & Nie, F. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927224 · Cited by 368 · see citing works
Multi-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346 · see citing works
Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314 · see citing works
“cture not only extracts modality-specific information from various sensors but also allows flexible complexity distribution since the structures of the modality-specific branches can be different. In [115, 116], Radu et al. proposed a fully-connected deep neural network (DNN) architecture to facilitate the intra-modal…”
BackgroundLv, M., Xu, W., & Chen, T. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.051 · Cited by 64 · see citing works
Self-supervised transfer learning of physiological representations from free-living wearable data
Spathis, D., Perez-Pozuelo, I., Brage, S., Wareham, N. J., & Mascolo, C. (2021) · Proceedings of the Conference on Health, Inference, and Learning · doi:10.1145/3450439.3451863 · Cited by 40 · see citing works
Self-citationSense and Learn: Self-supervision for omnipresent sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100152 · Cited by 34 · see citing works
PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels
Cai, R., Janaka, N., Chen, Y., Wang, L., Zhao, S., & Liu, C. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642320 · Cited by 36 · see citing works
Enabling Edge Devices that Learn from Each Other: Cross Modal Training for Activity Recognition
Xing, T., Sandha, S. S., Balaji, B., Chakraborty, S., & Srivastava, M. (2018) · Proceedings of the 1st International Workshop on Edge Systems, Analytics and Networking · doi:10.1145/3213344.3213351 · Cited by 35 · see citing works
Human-centred artificial intelligence for mobile health sensing: challenges and opportunities
Dang, T., Spathis, D., Ghosh, A., & Mascolo, C. (2023) · Royal Society Open Science · doi:10.1098/rsos.230806 · Cited by 30 · see citing works
Self-citationLi, Z., Li, H., Ralescu, A. L., Dillman, J. R., Altaye, M., Cecil, K. M., Parikh, N. A., & He, L. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102993 · Cited by 10 · see citing works
UniMTS: Unified Pre-training for Motion Time Series
Zhang, X., Teng, D., Chowdhury, R., Li, S., Hong, D., Gupta, R., & Shang, J. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3414 · Cited by 8 · see citing works
The benefit of the doubt: Uncertainty aware sensing for edge computing platforms
Qendro, L., Chauhan, J., Ramos, A. G. C. P., & Mascolo, C. (2021) · arXiv · doi:10.48550/arxiv.2102.05956 · Cited by 6 · see citing works
UniMTS: Unified Pre-training for Motion Time Series
Zhang, X., Teng, D., Chowdhury, R. R., Li, S., Hong, D., Gupta, R. K., & Shang, J. (2024) · arXiv · Cited by 9 · see citing works
“We aim for a more generic yet challenging generalization scenario where pre-training and downstream datasets share different label names.”
MoPFormer: Motion-Primitive Transformer for Wearable-Sensor Activity Recognition
Zhang, H., Zhuang, Z., Wang, X., Yang, X., & Zhang, Y. (2025) · arXiv · doi:10.48550/arxiv.2505.20744
- Authors
- Radu, V., Tong, C., Bhattacharya, S., Lane, N. D., Mascolo, C., Marina, M. K., & Kawsar, F.
- Affiliations
- University of Edinburgh (GB)
- University of Oxford (GB)
- Nokia Bell Labs
- University of Cambridge
- Delft University of Technology (NL)
- ORCID
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-01-08
- Volume
- 1
- Issue
- 4
- Pages
- 1-27
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2777460464
- Cited by
- 281
- References
- 68
- Citations by year
- 2026: 11 · 2025: 19 · 2024: 36 · 2023: 29 · 2022: 45 · 2021: 54 · 2020: 46 · 2019: 31 · 2018: 10
- FWCI
- 17.64
- Type
- journal article
- Language
- en
- Open access
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (publishedVersion, other-oa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion)
- Apollo
- Funders
- European Union's Horizon2020 (Grant No. 687698)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multimodal deep learning, activity recognition, context recognition, wearable sensors, mobile devices, sensor fusion, convolutional neural networks, on-device inference, user behavior monitoring, atmospheric pressure, audio sensing, low-power sensors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
