The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
A Survey on Human-in-the-Loop Applications Towards an Internet of All
Abstract
Our tools and appliances are becoming increasingly more intelligent and interconnected, giving birth to an “Internet of Things” that can be used to support new types of cyber-physical systems (CPSs). While many CPSs are human-centric applications where humans are an essential part of the system, unfortunately, most of these systems still consider the human as an external and unpredictable element to the control loop. In order for these systems to better serve human needs, future CPSs will need to bolster a closer tie with the human element, through Human-in-the-Loop controls that take into consideration human intents, psychological states, emotions and actions inferred through sensory data. This area is a natural confluence of multidisciplinary focus but currently lacks a general understanding of the underlying requirements, principles and theory. As far as we know, this survey is the first effort towards extending the field's knowledge through an in-depth research of the state-of-the-art and a critical overview of the current taxonomic efforts in the area of Human-in-the-Loop CPSs. On top of this research, a novel taxonomic exercise focused on the general roles of the human component together with a requirement analysis, are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 3×
“A circumplex model of emotion was first proposed by Russell [100], where emotions were distributed in a two-dimensional circular space, ranging from “miserable” to “pleased” and from “sleepy” to “aroused.”
BackgroundInfluentialLazarus, R. S. (1991) · doi:10.1093/oso/9780195069945.001.0001 · Cited by 12,691
A robust layered control system for a mobile robot
Brooks, R. (1986) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1986.1087032 · Cited by 7,799
The Cognitive Structure of Emotions
Ortony, A., Clore, G. L., & Collins, A. (1988) · doi:10.1017/cbo9780511571299 · Cited by 6,208
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
The second machine age: work, progress, and prosperity in a time of brilliant technologies
(2015) · Choice Reviews Online · doi:10.5860/choice.184834 · Cited by 4,381
The Cricket location-support system
Priyantha, N. B., Chakraborty, A., & Balakrishnan, H. (2000) · Proceedings of the 6th annual international conference on Mobile computing and networking · doi:10.1145/345910.345917 · Cited by 3,716
Context Aware Computing for The Internet of Things: A Survey
Perera, C., Zaslavsky, A., Christen, P., & Georgakopoulos, D. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.042313.00197 · Cited by 2,861 · cited 23×
“From now on we will call this reference model the Internet of All (IoA), meaning that it includes not only the (traditional) IoT but also the Human as a fundamental element.”
BackgroundInfluentialTowards a Better Understanding of Context and Context-Awareness
Abowd, G. D., Dey, A. K., Brown, P. J., Davies, N., Smith, M., & Steggles, P. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-48157-5_29 · Cited by 2,634
The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies
Dong, X., & McIntyre, S. H. (2014) · Quantitative Finance · doi:10.1080/14697688.2014.946440 · Cited by 1,658
On the features and challenges of security and privacy in distributed internet of things
Roman, R., Zhou, J., & Lopez, J. (2013) · Computer Networks · doi:10.1016/j.comnet.2012.12.018 · Cited by 1,217
(1992) · Choice Reviews Online · doi:10.5860/choice.30-0601 · Cited by 1,146
The anatomy of a context-aware application
Harter, A., Hopper, A., Steggles, P., Ward, A., & Webster, P. (1999) · Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking · doi:10.1145/313451.313476 · Cited by 1,107
Wireless sensor networks: a survey on recent developments and potential synergies
Rawat, P., Singh, K. D., Chaouchi, H., & Bonnin, J. M. (2014) · The Journal of Supercomputing · doi:10.1007/s11227-013-1021-9 · Cited by 1,054
The cognitive structure of emotions
(1989) · Choice Reviews Online · doi:10.5860/choice.26-4153 · Cited by 688
Introduction to GPS: The Global Positioning System
El‐Rabbany, A. (2002) · Cited by 673
People, Places, Things: Web Presence for the Real World
Kindberg, T., Barton, J., Morgan, J., Becker, G., Caswell, D., Debaty, P., Gopal, G., Frid, M., Krishnan, V., Morris, H., et al. (2002) · Mobile Networks and Applications · doi:10.1023/a:1016591616731 · Cited by 613
Monostori, L. (2019) · CIRP Encyclopedia of Production Engineering · doi:10.1007/978-3-662-53120-4_16790 · Cited by 606
Bridging physical and virtual worlds with electronic tags
Want, R., Fishkin, K. P., Gujar, A., & Harrison, B. L. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303111 · Cited by 588
SoundSense: scalable sound sensing for people-centric applications on mobile phones
Lu, H., Pan, W., Lane, N. D., Choudhury, T., & Campbell, A. T. (2009) · Proceedings of the 7th international conference on Mobile systems, applications, and services · doi:10.1145/1555816.1555834 · Cited by 581
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
(2017) · The SAGE Encyclopedia of Communication Research Methods · doi:10.4135/9781483381411.n178 · Cited by 559
The smart thermostat: using occupancy sensors to save energy in homes
Lu, J., Sookoor, T., Srinivasan, V., Gao, G., Holben, B., Stankovic, J., Field, E., & Whitehouse, K. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1870005 · Cited by 502
Accuracy characterization for metropolitan-scale Wi-Fi localization
Cheng, Y.-C., Chawathe, Y., LaMarca, A., & Krumm, J. (2005) · Proceedings of the 3rd international conference on Mobile systems, applications, and services · doi:10.1145/1067170.1067195 · Cited by 460
Tapia, E. M., Intille, S. S., Haskell, W., Larson, K., Wright, J., King, A., & Friedman, R. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373774 · Cited by 458
MoodScope: building a mood sensor from smartphone usage patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464449 · Cited by 444
Requirements for Safe Robots: Measurements, Analysis and New Insights
Haddadin, S., Albu-Schäffer, A., & Hirzinger, G. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364909343970 · Cited by 444
Swarmanoid: A Novel Concept for the Study of Heterogeneous Robotic Swarms
Dorigo, M., Floreano, D., Gambardella, L. M., Mondada, F., Nolfi, S., Baaboura, T., Birattari, M., Bonani, M., Brambilla, M., Brutschy, A., et al. (2013) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2013.2252996 · Cited by 410
A Hybrid Discriminative/Generative Approach for Modeling Human Activities
Lester, J., Choudhury, T., Kern, N., Borriello, G., & Hannaford, B. (2005) · TUbilio (Technical University of Darmstadt) · Cited by 398
The Future of Human-in-the-Loop Cyber-Physical Systems
Schirner, G., Erdogmus, D., Chowdhury, K., & Padir, T. (2013) · Computer · doi:10.1109/mc.2013.31 · Cited by 327
Nanonetworks: a new frontier in communications
Akyildiz, I. F., Jornet, J. M., & Pierobon, M. (2011) · Communications of the ACM · doi:10.1145/2018396.2018417 · Cited by 290
A survey of context data distribution for mobile ubiquitous systems
Bellavista, P., Corradi, A., Fanelli, M., & Foschini, L. (2012) · ACM Computing Surveys · doi:10.1145/2333112.2333119 · Cited by 289
Duncombe, R., & Boateng, R. (2009) · Third World Quarterly · doi:10.1080/01436590903134882 · Cited by 251
Internet of Things Applications - From Research and Innovation to Market Deployment
Spirito, M., Pastrone, C., Soldatos, J., Giaffreda, R., Doukas, C., Stavroulaki, V., Muñoz, L., Polidura, V. G., Gusmeroli, S., Sola, J., et al. (2022) · Internet of Things Applications - From Research and Innovation to Market Deployment · doi:10.1201/9781003338628-7 · Cited by 233
Lullaby: a capture & access system for understanding the sleep environment
Kay, M., Choe, E. K., Shepherd, J., Greenstein, B., Watson, N., Consolvo, S., & Kientz, J. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370253 · Cited by 219
Duty-cycling buildings aggressively: The next frontier in HVAC control
Agarwal, Y., Balaji, B., Dutta, S., et al. (2011) · Information Processing in Sensor Networks · Cited by 201
Human-robot interaction and future industrial robotics applications
Heyer, C. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5651294 · Cited by 199
Rachuri, K. K., Mascolo, C., Musolesi, M., & Rentfrow, P. J. (2011) · Proceedings of the 17th annual international conference on Mobile computing and networking · doi:10.1145/2030613.2030623 · Cited by 197
Smartphones for Large-Scale Behavior Change Interventions
Lathia, N., Pejovic, V., Rachuri, K. K., Mascolo, C., Musolesi, M., & Rentfrow, P. J. (2013) · IEEE Pervasive Computing · doi:10.1109/mprv.2013.56 · Cited by 194
Signal Transmission by Galvanic Coupling Through the Human Body
Wegmueller, M. S., Oberle, M., Felber, N., Kuster, N., & Fichtner, W. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2031449 · Cited by 182
Lane, N. D., Xu, Y., Lu, H., Hu, S., Choudhury, T., Campbell, A. T., & Zhao, F. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030160 · Cited by 171
Makris, P., Skoutas, D. N., & Skianis, C. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.040912.00180 · Cited by 169
A Human-Aware Manipulation Planner
Sisbot, E. A., & Alami, R. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2196303 · Cited by 166
ActiServ: Activity Recognition Service for mobile phones
Berchtold, M., Budde, M., Gordon, D., Schmidtke, H. R., & Beigl, M. (2010) · International Symposium on Wearable Computers (ISWC) 2010 · doi:10.1109/iswc.2010.5665868 · Cited by 160
Longstaff, B., Reddy, S., & Estrin, D. L. (2010) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth2010.8851 · Cited by 155
Mobile phones in Africa: how much do we really know?
James, J. D., & Versteeg, M. E. (2007) · Social Indicators Research · doi:10.1007/s11205-006-9079-x · Cited by 152
Fernandes, S., & Karmouch, A. (2010) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.082010.00099 · Cited by 151
Common Sense Based Joint Training of Human Activity Recognizers
Wang, S., Pentney, W. R., Popescu, A.-M., Choudhury, T., & Philipose, M. (2007) · Cited by 136
Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness
Zappi, P., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., & Troster, G. (2007) · 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information · doi:10.1109/issnip.2007.4496857 · Cited by 126
Toward patient safety in closed-loop medical device systems
Arney, D. E., Pajić, M., Goldman, J. M., Lee, I., Mangharam, R., & Sokolsky, O. V. (2010) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1145/1795194.1795214 · Cited by 114
CAALYX: a new generation of location-based services in healthcare
Boulos, M. N. K., Rocha, A., Martins, Â., Vicente, M., Bolz, A., Feld, R., Tchoudovski, I., Braecklein, M., Nelson, J., OLaighin, G. M., et al. (2007) · International Journal of Health Geographics · doi:10.1186/1476-072x-6-9 · Cited by 110
Cyber Physical System Challenges for Human-in-the-Loop Control
Munir, S., Stankovic, J. A., Liang, C.-J. M., & Lin, S. (2013) · Cited by 108
Security in the integration of low-power Wireless Sensor Networks with the Internet: A survey
Granjal, J., Monteiro, E., & Silva, J. S. (2014) · Ad Hoc Networks · doi:10.1016/j.adhoc.2014.08.001 · Cited by 107
WLAN location determination in e-home via support vector classification
Wu, C.-L., Fu, L., & Lian, F. (2004) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2004.1297088 · Cited by 104
MoodScope: Building a Mood Sensor from Smartphone Usage Patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2012) · Rice Research Repository (Rice University) · Cited by 97
Song, Y., Hao, Q., Zhang, K., Wang, M., Chu, Y., & Kang, B. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2010.2087870 · Cited by 91
Contextual dissonance: design bias in sensor-based experience sampling methods
Lathia, N., Rachuri, K. K., Mascolo, C., & Rentfrow, P. J. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2493432.2493452 · Cited by 89
Computers in the Human Interaction Loop
Waibel, A., Steusloff, H. U., Stiefelhagen, R., & Watson, K. (2009) · Springer eBooks · doi:10.1007/978-1-84882-054-8_1 · Cited by 87
(2011) · Acatech-Position · doi:10.1007/978-3-642-27567-8 · Cited by 87
Anxiety-based affective communication for implicit human–machine interaction
Rani, P., Sarkar, N., & Adams, J. A. (2007) · Advanced Engineering Informatics · doi:10.1016/j.aei.2006.11.009 · Cited by 82
Localization Using Neural Networks in Wireless Sensor Networks
Shareef, A., Zhu, Y., & Musavi, M. T. (2008) · doi:10.4108/icst.mobilware2008.2901 · Cited by 71
Musolesi, M., Piraccini, M., Fodor, K., Antonio Corradi, A., & Campbell, A. T. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12654-3_21 · Cited by 69
An Alignment Approach for Context Prediction Tasks in UbiComp Environments
Sigg, S., Haseloff, S., & David, K. (2010) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.23 · Cited by 68
“I Want That”: Human-in-the-Loop Control of a Wheelchair-Mounted Robotic Arm
Tsui, K. M., Kim, D., Behal, A., et al. (2011) · Applied Bionics and Biomechanics · doi:10.1155/2011/698079 · Cited by 67
Lallée, S., Pattacini, U., Lemaignan, S., Lenz, A., Melhuish, C., Natale, L., Skachek, S., Hamann, K., Steinwender, J., Sisbot, E. A., et al. (2012) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2012.2199754 · Cited by 62
"I want that": Human-in-the-loop control of a wheelchair-mounted robotic arm
Tsui, K. M., Kim, D., Behal, A., et al. (2011) · Journal of International Crisis and Risk Communication Research · doi:10.3233/abb-2011-0004 · Cited by 61
Detecting User Activities using the Accelerometer on Android Smartphones
Perez, B., Murphy, M. J., & Olin, F. W. (2010) · Cited by 53
Cyber-Physical Systems: Integrated Computing and Engineering Design
Hu, F. (2013) · CERN Document Server (European Organization for Nuclear Research) · Cited by 48
A vision of cyber-physical internet
Koubâa, A., & Andersson, B. A. (2009) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 47
A Smoothed Naive Bayes-Based Classifier for Activity Recognition
Sarkar, A. J., Lee, Y.-K., & Lee, S. (2010) · IETE Technical Review · doi:10.4103/0256-4602.60164 · Cited by 41
WAGENAAR, R. C., Sapir, I., Zhang, Y., Markovic, S., Vaina, L. M., & Little, T. D. C. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091200 · Cited by 34
Affective communication for implicit human-machine interaction
Rani, P., Sarkar, N., Smith, C. A., & Adams, J. A. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1245758 · Cited by 33
Exploring emotional preference for smartphone applications
Kim, H., & Choi, Y. S. (2012) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc.2012.6181095 · Cited by 31
Wood, A. D., Selavo, L., & Stankovic, J. A. (2008) · Springer eBooks · doi:10.1007/978-3-540-69170-9_40 · Cited by 30
Computers in the Human Interaction Loop
Waibel, A. H., Stiefelhagen, R., Carlson, R., Casas, J. R., Kleindienst, J., Lamel, L. F., Lanz, O., Mostefa, D., Omologo, M., Pianesi, F., et al. (2009) · Springer eBooks · doi:10.1007/978-0-387-93808-0_40 · Cited by 25
Reducing Energy Waste for Computers by Human-in-the-Loop Control
Munir, S., Stankovic, J. A., Liang, C.-J. M., & Lin, S. (2013) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2013.2281204 · Cited by 23
Bieber, G., Luthardt, A., Peter, C., et al. (2011) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/2141622.2141674 · Cited by 22
Thatte, G., Li, M., Lee, S., Emken, A., Narayanan, S. S., Mitra, U., Spruijt‐Metz, D., & Annavaram, M. (2012) · ACM Transactions on Embedded Computing Systems · doi:10.1145/2331147.2331158 · Cited by 20
Robot Interface Design of Domestic and Condominium Robot for Ageing Population
Casiddu, N., Cavallo, F., Divano, A., Mannari, I., Micheli, E., Porfirione, C., Zallio, M., Aquilano, M., & Dario, P. (2014) · Springer eBooks · doi:10.1007/978-3-319-01119-6_6 · Cited by 5
Cited by
Edge Computing in Industrial Internet of Things: Architecture, Advances and Challenges
Qiu, T., Chi, J., Zhou, X., Ning, Z., Atiquzzaman, M., & Wu, D. O. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3009103 · Cited by 857
Applications of Blockchains in the Internet of Things: A Comprehensive Survey
Ali, M. S., Vecchio, M., Pincheira, M., Dolui, K., Antonelli, F., & Rehmani, M. H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2886932 · Cited by 855
A survey of human-in-the-loop for machine learning
Wu, X., Xiao, L., Sun, Y., Zhang, J., Ma, T., & He, L. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.014 · Cited by 800
Quo vadis artificial intelligence?
Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00022-8 · Cited by 544
Human–Cyber–Physical Systems (HCPSs) in the Context of New-Generation Intelligent Manufacturing
Zhou, J., Zhou, Y., Wang, B., & Zang, J. (2019) · Engineering · doi:10.1016/j.eng.2019.07.015 · Cited by 492
Metadata
- Authors
- Nunes, D. S., Zhang, P., & Sa Silva, J.
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2015
- Volume
- 17
- Issue
- 2
- Pages
- 944-965
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W2062305196
- Cited by
- 284
- References
- 79
- FWCI
- 31.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.