Ontology‐based activity recognition in intelligent pervasive environments
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Purpose: This paper aims to serve two main purposes. In the first instance it aims to it provide an overview addressing the state‐of‐the‐art in the area of activity recognition, in particular, in the area of object‐based activity recognition. This will provide the necessary material to inform relevant research communities of the latest developments in this area in addition to providing a reference for researchers and system developers who ware working towards the design and development of activity‐based context aware applications. In the second instance this paper introduces a novel approach to activity recognition based on the use of ontological modeling, representation and reasoning, aiming to consolidate and improve existing approaches in terms of scalability, applicability and easy‐of‐use. Design/methodology/approach: The paper initially reviews the existing approaches and algorithms, which have been used for activity recognition in a number of related areas. From each of these, their strengths and weaknesses are discussed with particular emphasis being placed on the application domain of sensor enabled intelligent pervasive environments. Based on an analysis of existing solutions, the paper then proposes an integrated ontology‐based approach to activity recognition. The proposed approach adopts ontologies for modeling sensors, objects and activities, and exploits logical semantic reasoning for the purposes of activity recognition. This enables incremental progressive activity recognition at both coarse‐grained and fine‐grained levels. The approach has been considered within the realms of a real world activity recognition scenario in the context of assisted living within Smart Home environments. Findings: Existing activity recognition methods are mainly based on probabilistic reasoning, which inherently suffer from a number of limitations such as ad hoc static models, data scarcity and scalability. Analysis of the state‐of‐the‐art has helped to identify a major gap between existing approaches and the need for novel recognition approaches posed by the emerging multimodal sensor technologies and context‐aware personalised activity‐based applications in intelligent pervasive environments. The proposed ontology based approach to activity recognition is believed to be the first of its kind, which provides an integrated framework‐based on the unified conceptual backbone, i.e. activity ontologies, addressing the lifecycle of activity recognition. The approach allows easy incorporation of domain knowledge and machine understandability, which facilitates interoperability, reusability and intelligent processing at a higher level of automation. Originality/value: The comprehensive overview and critiques on existing work on activity recognition provide a valuable reference for researchers and system developers in related research communities. The proposed ontology‐based approach to activity recognition, in particular the recognition algorithm has been built on description logic based semantic reasoning and offers a promising alternative to traditional probabilistic methods. In addition, activities of daily living (ADL) activity ontologies in the context of smart homes have not been, to the best of one's knowledge, been produced elsewhere.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The effort involved in such manual coding of semantic relationships has motivated the use of ontologies [17,26].However, their scope is also limited, in particular when it comes to covering the entire breadth of less common situations.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [26]
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,473
International Classification of Functioning Disability and Health (ICF)
Battistella, L. R., & Brito, C. M. M. D. (2002) · Acta Fisiátrica · doi:10.5935/0104-7795.20020003 · Cited by 4,446
Learning patterns of activity using real-time tracking
Stauffer, C., & Grimson, W. E. L. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868677 · Cited by 3,248
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
The Computer for the Twenty-First Century
Weiser, M. (1991) · Scientific American · Cited by 2,113
A review of smart homes—Present state and future challenges
Chan, M., Estève, D., Escriba, C., & Campo, E. (2008) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2008.02.001 · Cited by 1,007
Inferring Activities from Interactions with Objects
Philipose, M., Fishkin, K. P., Perkowitz, M., Patterson, D. J., Fox, D., Kautz, H., & Hahnel, D. (2004) · IEEE Pervasive Computing · doi:10.1109/mprv.2004.7 · Cited by 875
The Gator Tech Smart House: a programmable pervasive space
Helal, S., Mann, W., El-Zabadani, H., King, J., Kaddoura, Y., & Jansen, E. (2005) · Computer · doi:10.1109/mc.2005.107 · Cited by 874
Measuring Similarity between Ontologies
Maedche, A., & Staab, S. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45810-7_24 · Cited by 785
Activity Classification Using Realistic Data From Wearable Sensors
Parkka, J., Ermes, M., Korpipaa, P., Mantyjarvi, J., Peltola, J., & Korhonen, I. (2006) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2005.856863 · Cited by 760
Recognition of visual activities and interactions by stochastic parsing
Ivanov, Y. A., & Bobick, A. F. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868686 · Cited by 659
Practical Reasoning for Expressive Description Logics
Horrocks, I., Sattler, U., & Tobies, S. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-48242-3_11 · Cited by 532
Activity and location recognition using wearable sensors
Lee, S.-W., & Mase, K. (2002) · IEEE Pervasive Computing · doi:10.1109/mprv.2002.1037719 · Cited by 525
Tapia, E. M., Intille, S. S., Haskell, W., Larson, K., Wright, J., King, A., & Friedman, R. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373774 · Cited by 458 · cited 1×
“In particular, such approaches and methods should tackle technical challenges in terms of their robustness to real-world conditions and real-time performance, e.g., applicability, scalability and reusability.”
BackgroundFine-Grained Activity Recognition by Aggregating Abstract Object Usage
Patterson, D. J., Fox, D., Kautz, H., & Philipose, M. (2005) · Ninth IEEE International Symposium on Wearable Computers (ISWC'05) · doi:10.1109/iswc.2005.22 · Cited by 452
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
Ward, J. A., Lukowicz, P., Troster, G., & Starner, T. E. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.197 · Cited by 431
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields
Liao, L., Fox, D., & Kautz, H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907073775 · Cited by 412
Willard and Spackman's Occupational Therapy
Willard, H. S., Spackman, C. S., Hopkins, H., & Smith, H. D. (2003) · Cited by 398
Towards an Extensible Context Ontology for Ambient Intelligence
Preuveneers, D., Van den Bergh, J., Wagelaar, D., Georges, A., Rigole, P., Clerckx, T., Berbers, Y., Coninx, K., Jonckers, V., & De Bosschere, K. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30473-9_15 · Cited by 310
A Formal Theory of Plan Recognition and its Implementation
Kautz, H. A. (1991) · Reasoning About Plans · doi:10.1016/b978-1-55860-137-6.50008-x · Cited by 227
Bayesian Models for Keyhole Plan Recognition in an Adventure Game
Albrecht, D. W., Zukerman, I., & Nicholson, A. E. (1998) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1008238218679 · Cited by 202
VERL: an ontology framework for representing and annotating video events
Francois, A. R. J., Nevatia, R., Hobbs, J., Bolles, R. C., & Smith, J. R. (2005) · IEEE MultiMedia · doi:10.1109/mmul.2005.87 · Cited by 200
(2005) · Discovery Research Portal (University of Dundee) · Cited by 158
Scalable Recognition of Daily Activities with Wearable Sensors
Huỳnh, T., Blanke, U., & Schiele, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75160-1_4 · Cited by 158
An Ontology for Video Event Representation
Nevatia, R., Hobbs, J., & Bolles, B. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.301 · Cited by 144
Common Sense Based Joint Training of Human Activity Recognizers
Wang, S., Pentney, W. R., Popescu, A.-M., Choudhury, T., & Philipose, M. (2007) · Cited by 137
Multi-Camera Human Activity Monitoring
Fiore, L., Fehr, D., Bodor, R., Drenner, A., Somasundaram, G., & Papanikolopoulos, N. P. (2008) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-007-9201-6 · Cited by 100
Latfi, F., Lefebvre, B., & Descheneaux, C. (2007) · OWL: Experiences and Directions · Cited by 98
Human Activity Recognition with Wearable Sensors
Huynh, D. T. G. (2008) · Technischen Universität Darmstadt · doi:10.26083/tuprints-00001132 · Cited by 97
A Smart Home Agent for Plan Recognition of Cognitively-impaired Patients.
Bouchard, B., Giroux, S., & Bouzouane, A. (2006) · Journal of Computers · doi:10.4304/jcp.1.5.53-62 · Cited by 95
Semantic Smart Homes: Towards Knowledge Rich Assisted Living Environments
Chen, L., Nugent, C., Mulvenna, M. D., Finlay, D., & Hong, X. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-00179-6_17 · Cited by 93
Self-citationAn ontology based approach for activity recognition from video
Akdemir, U., Turaga, P. K., & Chellappa, R. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459466 · Cited by 93
A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home
Chen, L., Nugent, C., Mulvenna, M. D., Finlay, D., Hong, X., & Poland, M. P. (2008) · Ulster University Research Portal (Ulster University) · Cited by 79
Self-citationUnsupervised Discovery of Structure in Activity Data Using Multiple Eigenspaces
Huỳnh, T., & Schiele, B. (2006) · Lecture notes in computer science · doi:10.1007/11752967_11 · Cited by 75
Experiences in the development of a Smart Lab
Nugent, C. D., Mulvenna, M. D., Hong, X., & Devlin, S. (2009) · International Journal of Biomedical Engineering and Technology · doi:10.1504/ijbet.2009.027796 · Cited by 71
Self-citationBuilding Reliable Activity Models Using Hierarchical Shrinkage and Mined Ontology
Tapia, E. M., Choudhury, T., & Philipose, M. (2006) · Lecture notes in computer science · doi:10.1007/11748625_2 · Cited by 69
Applying Ontology and Probabilistic Model to Human Activity Recognition from Surrounding Things
Yamada, N., Sakamoto, K., Kunito, G., Isoda, Y., Yamazaki, K., & Tanaka, S. (2007) · IPSJ Digital Courier · doi:10.2197/ipsjdc.3.506 · Cited by 67
Activities of daily living and instrumental activities of daily living
James, A. B. (2009) · Sound Ideas (University of Puget Sound) · Cited by 60
Towards automatic analysis of social interaction patterns in a nursing home environment from video
Chen, D., Yang, J., & Wactlar, H. D. (2004) · Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval · doi:10.1145/1026711.1026757 · Cited by 59
Ontology and Taxonomy Collaborated Framework for Meeting Classification
Hakeem, A., & Shah, M. (2004) · Cited by 53
A video interpretation platform applied to bank agency monitoring
Georis, B. (2004) · doi:10.1049/ic:20040097 · Cited by 47
Ontology and taxonomy collaborated framework for meeting classification
Hakeem, A., & Shah, M. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333743 · Cited by 44
Two Logical Theories of Plan Recognition
Wobcke, W. (2002) · Journal of Logic and Computation · doi:10.1093/logcom/12.3.371 · Cited by 39
Research works printed but not linked: 2
- Bodor, R., Jackson, B. and Papanikolopoulos, N. (2003), “Vision based human tracking and activity recognition”, Proceedings of the 11th Mediterranean Conference on Control and Automation.
- Klein, M., Schmidt, A. and Lauer, R. (2007), “Ontology‐centred design of an ambient middleware for assisted living: the case of SOPRANO”, Proceedings of the 30th Annual German Conference on Artificial Intelligence, available: www.fzi.de/KCMS/kcms_file.php?action=link&id=706.
Cited by
Sensor-Based Activity Recognition
Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2198883 · Cited by 1,074
Self-citationA Knowledge-Driven Approach to Activity Recognition in Smart Homes
Chen, L., Nugent, C. D., & Wang, H. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.51 · Cited by 589
Self-citationNi, Q., García Hernando, A., & De la Cruz, I. (2015) · Sensors · doi:10.3390/s150511312 · Cited by 264
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
“The effort involved in the manual coding of semantic relationships has motivated the use of ontologies as source of information [17, 23].”
Large Language Models are Zero-Shot Recognizers for Activities of Daily Living
Civitarese, G., Fiori, M., Choudhary, P., & Bettini, C. (2024) · arXiv · doi:10.48550/arxiv.2407.01238 · Cited by 28
Metadata
- Authors
- Chen, L., & Nugent, C.
- Affiliations
- University of Ulster (GB)
- Venue
- International Journal of Web Information Systems
- Publisher
- Emerald
- Published
- 2009-11-20
- Volume
- 5
- Issue
- 4
- Pages
- 410-430
- ISSN
- 1744-0084 (ISSN-L)
- OpenAlex
- W2074783809
- Cited by
- 253
- References
- 44
- Citations by year
- 2025: 3 · 2024: 3 · 2023: 9 · 2022: 16 · 2021: 10 · 2020: 13 · 2019: 24 · 2018: 30 · 2017: 18 · 2016: 21 · 2015: 33 · 2014: 19 · 2013: 21 · 2012: 14
- FWCI
- 12.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.emerald.com/insight/site-policies (tdm)
- Locations
- International Journal of Web Information Systems (publishedVersion)
- DMU Open Research Archive (De Montfort University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Health Professions › Health Information Management › Innovation in Digital Healthcare Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- activity recognition, description logics, semantic reasoning, ubiquitous computing, context-aware systems, home automation, assisted living, activities of daily living, sensor modeling, multimodal sensors, domain knowledge integration, data scarcity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.