The multi-modal interface of Robot-Era multi-robot services tailored for the elderly
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Socially assistive robotic platforms are now a realistic option for the long-term care of ageing populations. Elderly users may benefit from many services provided by robots operating in different environments, such as providing assistance inside apartments, serving in shared facilities of buildings or guiding people outdoors. In this paper, we present the experience gained within the EU FP7 ROBOT-ERA project towards the objective of implementing easy-to-use and acceptable service robotic system for the elderly. In particular, we detail the user-centred design and the experimental evaluation in realistic environments of a web-based multi-modal user interface tailored for elderly users of near future multi-robot services. Experimental results demonstrate positive evaluation of usability and willingness to use by elderly users, especially those less experienced with technological devices who could benefit more from the adoption of robotic services. Further analyses showed how multi-modal modes of interaction support more flexible and natural elderly–robot interaction, make clear the benefits for the users and, therefore, increase its acceptability. Finally, we provide insights and lessons learned from the extensive experimentation, which, to the best of our knowledge, is one of the largest experimentation of a multi-robot multi-service system so far.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 1×
“The overall strategy is that objects, providing enough optical features, are detected using the SIFT algorithm [36].”
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · cited 10×
“Then, each participant filled a questionnaire based on the model of the UTAUT [55].”
InfluentialSUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 1×
“Bangor, Kortum andMiller [2] have used the scale extensively over a 10-year period and have produced normative data that allow SUS ratings to be positioned relative to other systems.”
BackgroundThe handbook of psychological testing
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1802 · Cited by 3,534
The handbook of psychological testing, 2nd ed.
Kline, P. (1993) · Cited by 1,251
Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model
Heerink, M., Kröse, B., Evers, V., & Wielinga, B. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0068-5 · Cited by 1,229
Feil-Seifer, D., & Mataric, M. J. (2005) · 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005. · doi:10.1109/icorr.2005.1501143 · Cited by 972 · cited 1×
“In this scenario, the new field of Socially Assistive Robotics (SAR) has been defined [24] to identify those service robots that provide assistance through social interaction but without the necessity of physical contact with the user.”
BackgroundAssistive social robots in elderly care: a review
Broekens, J., Heerink, M., & Rosendal, H. (2024) · Gerontechnology · doi:10.4017/gt.2009.08.02.002.00 · Cited by 940 · cited 1×
“More are designed to help with physical aspects such as housekeeping, walking, and social communication, than tomanage other activities, for example, money, laundry, grooming [5].”
Socially assistive robotics [Grand Challenges of Robotics]
Tapus, A., Mataric, M., & Scassellati, B. (2007) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2007.339605 · Cited by 547
Exploring influencing variables for the acceptance of social robots
de Graaf, M. M. A., & Ben Allouch, S. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.07.007 · Cited by 499
A Review of Mobile Robotic Telepresence
Kristoffersson, A., Coradeschi, S., & Loutfi, A. (2013) · Advances in Human-Computer Interaction · doi:10.1155/2013/902316 · Cited by 375
Melenhorst, A.-S., Rogers, W. A., & Bouwhuis, D. G. (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.1.190 · Cited by 363 · cited 1×
“More generally, older adults are willing to accept home technological assistance when they are able to live independently [23,50], but only if the perceived benefits of using the technology are clear [39].”
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Dumas, B., Lalanne, D., & Oviatt, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-00437-7_1 · Cited by 305
The RavenClaw dialog management framework: Architecture and systems
Bohus, D., & Rudnicky, A. I. (2009) · Computer Speech & Language · doi:10.1016/j.csl.2008.10.001 · Cited by 264 · cited 1×
“TheRavenclaw dialogue manager, part of Olympus, simplifies the authoring of complex dialogues, has general support handling speech recognition errors, and can be extended to support multimodal input and output [3].”
BackgroundThe Grand Challenges in Socially Assistive Robotics
Tapus, A., Matarić, M. J., & Scassellati, B. M. (2007) · HAL · Cited by 213
Ambient Intelligence in Assisted Living: Enable Elderly People to Handle Future Interfaces
Kleinberger, T., Becker, M., Ras, E., Holzinger, A., & Müller, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-73281-5_11 · Cited by 207 · cited 1×
“Services were performed by three robots, and therefore, a single flexible interface was designed to simplify the use of such a heterogeneous system [32] and be the link between the user and the assistive robotic system.”
Coeckelbergh, M., Pop, C., Simut, R., Peca, A., Pintea, S., David, D., & Vanderborght, B. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9649-x · Cited by 205
Conti, D., Di Nuovo, S., Buono, S., & Di Nuovo, A. (2017) · International Journal of Social Robotics · doi:10.1007/s12369-016-0359-6 · Cited by 178 · cited 1×
“Overall, stakeholders and the general public seem to be sceptical or even against the use of robots for the care of people [14].”
BackgroundAALIANCE Ambient Assisted Living Roadmap
van den Broek, G., Cavallo, F., & Wehrmann, C. (2010) · Florence Research (University of Florence) · Cited by 164
Self-citationHeerink, M. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957704 · Cited by 145 · cited 1×
“We know from the literature that the perceived ease of use is related to the previous experience with computers, but not to age and education [28], which is confirmed by our correlation analysis.”
The PEIS-Ecology project: Vision and results
Saffiotti, A., Broxvall, M., Gritti, M., LeBlanc, K. A., Lundh, R., Rashid, J., Seo, B.-S., & Cho, Y. J. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650962 · Cited by 138 · cited 2×
“Modules are interconnected each other using the PEIS Middleware [49] in order to collect information from the environment (i.”
MethodOlder Adults’ Preferences for and Acceptance of Robot Assistance for Everyday Living Tasks
Smarr, C.-A., Prakash, A., Beer, J. M., Mitzner, T. L., Kemp, C. C., & Rogers, W. A. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561009 · Cited by 123 · cited 1×
“More generally, older adults are willing to accept home technological assistance when they are able to live independently [23,50], but only if the perceived benefits of using the technology are clear [39].”
Interface design and engagement with older people
Hawthorn, D. (2007) · Behaviour & Information Technology · doi:10.1080/01449290601176930 · Cited by 117 · cited 1×
“representative older people in the design process extremely important [27].”
Development of a Socially Believable Multi-Robot Solution from Town to Home
Cavallo, F., Limosani, R., Manzi, A., Bonaccorsi, M., Esposito, R., Di Rocco, M., Pecora, F., Teti, G., Saffiotti, A., & Dario, P. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9290-z · Cited by 102
Self-citationTablets for Seniors – An Evaluation of a Current Model (iPad)
Werner, F., Werner, K., & Oberzaucher, J. (2012) · Advanced technologies and societal change · doi:10.1007/978-3-642-27491-6_13 · Cited by 73 · cited 2×
“In the design for the Robot-Era Indoor and Condominium robots, we decided to adopt a detachable tablet because it has been found that elderly users are very receptive to tablets [57].”
Ezer, N., Fisk, A. D., & Rogers, W. A. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905300206 · Cited by 71 · cited 1×
“More generally, older adults are willing to accept home technological assistance when they are able to live independently [23,50], but only if the perceived benefits of using the technology are clear [39].”
MIRA - middleware for robotic applications
Einhorn, E., Langner, T., Stricker, R., Martin, C., & Groß, H. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385959 · Cited by 64 · cited 1×
“Each robot runs ROS and the Metralabs MIRA [21] middlewares, the first is used for connecting the additional devices mounted on the robots(e.g. AsusXtion,LEDs),whilethesecondsupportsthe CogniDrive navigation software that moves the robots.”
MethodMulti-touch as a Natural User Interface for elders: A survey
Loureiro, B., & Rodrigues, R. (2011) · Iberian Conference on Information Systems and Technologies (CISTI) · Cited by 62
Research design in studies of aging and cognition.
Hertzog, C. K. (1996) · Cited by 58
Computer usage patterns of university faculty members across the life span
Rousseau, G. K., & Rogers, W. A. (1998) · Computers in Human Behavior · doi:10.1016/s0747-5632(98)00014-4 · Cited by 49 · cited 1×
“they learn and use only what they really need [48].”
Cavallo, F., Aquilano, M., Bonaccorsi, M., Limosani, R., Manzi, A., Carrozza, M. C., & Dario, P. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631187 · Cited by 49
Self-citationNow what was that password again? A more flexible way of identifying and authenticating our seniors
Renaud, K., & Ramsay, J. (2007) · Behaviour & Information Technology · doi:10.1080/01449290601173770 · Cited by 49
Survey-Based Discussions on Morally Contentious Applications of Interactive Robotics
Moon, A., Danielson, P. A., & der Loos, H. F. M. V. (2011) · International Journal of Social Robotics · doi:10.1007/s12369-011-0120-0 · Cited by 33 · cited 1×
“Research based on public surveys towards using robots in elderly care and other applications showed a high acceptance for pet-like therapeutic robots, human-like care robots, and surveillance care robots [40].”
A web based Multi-Modal Interface for elderly users of the Robot-Era multi-robot services
Nuovo, A. G. D., Broz, F., Belpaeme, T., Cangelosi, A., Cavallo, F., Esposito, R., & Dario, P. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6974248 · Cited by 30 · cited 2×
“For additional information, a step-by-step example of the Shopping service has been provided in [17], while a video presentation of all Robot-Era services can be found on YouTube [47].”
Self-citationMayer, P., Beck, C., & Panek, P. E. (2012) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2012.6422014 · Cited by 24 · cited 1×
“In particular, themajority of the recent experimental projects on robots for elderly care focused on a single platform that was operating inside the user’s home [38].”
Ferri, G., Mondini, A., Manzi, A., Mazzolai, B., Laschi, C., Mattoli, V., Reggente, M., Stoyanov, T., Lilienthal, A. J., Lettere, M., et al. (2010) · CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) · Cited by 22
Self-citationAssistance and Service Robotics in a Human Environment
Amirat, Y., Daney, D., Mohammed, S., Spalanzani, A., Chibani, A., & Simonin, O. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.11.002 · Cited by 19 · cited 1×
“Many robots may be employed to cover different user needs, and thus there is the need to integrate and enable synergistic cooperation among all these robots that can be deployed to assist the elderly inside or outside their home [1,16].”
User Acceptance of a Mobile LED Projector on a Socially Assistive Robot
Panek, P. E., Edelmayer, G., Mayer, P. B., Beck, C., & Rauhala, M. (2012) · Advanced technologies and societal change · doi:10.1007/978-3-642-27491-6_6 · Cited by 17 · cited 1×
“This solution also demonstrated how to overcome the limitation of the short distance needed to interact with the robot when a fixed touch screen is adopted [42].”
Rocco, M. D., Pecora, F., Sathyakeerthy, S., Grosinger, J., Saffiotti, A., Bonaccorsi, M., Limosani, R., Manzi, A., Cavallo, F., Dario, P., et al. (2014) · CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) · Cited by 15
Self-citationExperimental Evaluation of a Multi-modal User Interface for a Robotic Service
Nuovo, A. G. D., Wang, N., Broz, F., Belpaeme, T., Jones, R. B., & Cangelosi, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40379-3_9 · Cited by 15
Self-citationBonaccorsi, M., Fiorini, L., Cavallo, F., Esposito, R., & Dario, P. (2015) · Biosystems & biorobotics · doi:10.1007/978-3-319-18374-9_43 · Cited by 14 · cited 1×
“DoRo localizes the user position in the house via a Wireless Sensor Networks using RSSI and ZigBee technology [4].”
MethodSelf-citationTouch and Speech: Multimodal Interaction for Elderly Persons
Cui, J., Shi, H., Schafmeister, F., Rachuy, C., Sasse, N., Schmidt, H., Hoemberg, V., & von Steinbüchel, N. (2013) · Communications in computer and information science · doi:10.1007/978-3-642-38256-7_26 · Cited by 12 · cited 1×
“This paper presents the user-centred design approach of a multi-modal user interface (MMUI), which targets a more intuitive human way of interacting with machines, by means of speech, gestures or other modalities, that may be preferred over unimodal interfaces by elderly users [31].”
A User-Centric Design of Service Robots Speech Interface for the Elderly
Wang, N., Broz, F., Nuovo, A. G. D., Belpaeme, T., & Cangelosi, A. (2016) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-28109-4_28 · Cited by 12 · cited 1×
“Additional technical details and examples, including some preliminary evaluations of specific aspects of the Robot-Era system, can be found in [17–19 , 56 ].”
Self-citationNew Frontiers of Service Robotics for Active and Healthy Ageing
Nuovo, A. G. D., Broz, F., Cavallo, F., & Dario, P. (2016) · International Journal of Social Robotics · doi:10.1007/s12369-016-0350-2 · Cited by 10
Self-citationComplexity versus Page Hierarchy of a GUI for Elderly Homecare Applications
Torun, M., van Kasteren, T. L. M., İncel, Ö. D., & Ersoy, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31522-0_103 · Cited by 6 · cited 1×
“All service interfaces are directly available from the main menu and contained on one page only, in order to avoid going back and forth through the pages to search for functionalities, as this could confuse the elderly user [53].”
BackgroundBroz, F., Nuovo, A. G. D., Belpaeme, T., & Cangelosi, A. (2015) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2015-0007 · Cited by 6 · cited 1×
“Finally, our preliminary studies suggested particular emphasis on the types and quality of feedback that the robot interface provides in order to make the system more intuitive for elderly users [8] and how often this feedback is given [7].”
Self-citationRobot Interface Design of Domestic and Condominium Robot for Ageing Population
Casiddu, N., Cavallo, F., Divano, A., Mannari, I., Micheli, E., Porfirione, C., Zallio, M., Aquilano, M., & Dario, P. (2014) · Springer eBooks · doi:10.1007/978-3-319-01119-6_6 · Cited by 5 · cited 1×
“of the domestic and condominium platforms was studied in the preliminary studies with elderly and stakeholders and specifically designed for the Robot-Era project [9].”
BackgroundSelf-citationThe Global Ageing Experience Project: Anthropology, technology and independent living
Plowman, T., Prendergast, D. K., Roberts, S., & Sherry, J. (2010) · Gerontechnology · doi:10.4017/gt.2010.09.02.275.00 · Cited by 3
(2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
Research works printed but not linked: 1
- Broz F, Nuovo AD, Belpaeme T, Cangelosi A (2012) Multimodal robot feedback for eldercare. In: Workshop on robot feedback in human–robot interaction: how to make a robot readable for a human interaction partner at Ro-MAN 2012, pp 1–4
Cited by
Intelligent Robotics—A Systematic Review of Emerging Technologies and Trends
Licardo, J. T., Domjan, M., & Orehovački, T. (2024) · Electronics · doi:10.3390/electronics13030542 · Cited by 211
Review of the Factors Affecting Acceptance of AI-Infused Systems
Ismatullaev, U. V. U., & Kim, S.-H. (2024) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211064707 · Cited by 175
“Robotic technologies were likely to be more appealing to older users, especially those less experienced with technological devices and who could bene fi t more from the adoption of robotic services (Di Nuovo et al., 2018).”
BackgroundCavallo, F., Esposito, R., Limosani, R., Manzi, A., Bevilacqua, R., Felici, E., Di Nuovo, A., Cangelosi, A., Lattanzio, F., & Dario, P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9460 · Cited by 140
Self-citationMannheim, I., Wouters, E., Köttl, H., van Boekel, L. C., Brankaert, R., & van Zaalen, Y. (2022) · The Gerontologist · doi:10.1093/geront/gnac144 · Cited by 166
A Survey of Behavioral Models for Social Robots
Nocentini, O., Fiorini, L., Acerbi, G., Sorrentino, A., Mancioppi, G., & Cavallo, F. (2019) · Robotics · doi:10.3390/robotics8030054 · Cited by 139
“[74] The multi-modal interface of Robot-Era multi-robot services tailored for the elderly (2018) ROBOTERA project has the objective of implementing easy and acceptable service robotic system for the elderly.”
BackgroundSelf-citation
Metadata
- Authors
- Di Nuovo, A., Broz, F., Wang, N., Belpaeme, T., Cangelosi, A., Jones, R., Esposito, R., Cavallo, F., & Dario, P.
- Affiliations
- Heriot-Watt University (GB)
- University of Plymouth (GB)
- Ghent University (BE)
- Scuola Superiore Sant'Anna (IT)
- ORCID
- Venue
- Intelligent Service Robotics
- Published
- 2017-09-02
- Volume
- 11
- Issue
- 1
- Pages
- 109-126
- ISSN
- 1861-2776 (ISSN-L)
- 1861-2784
- OpenAlex
- W2726275180
- Cited by
- 111
- References
- 50
- Citations by year
- 2026: 6 · 2025: 14 · 2024: 11 · 2023: 14 · 2022: 20 · 2021: 16 · 2020: 9 · 2019: 13 · 2018: 8
- FWCI
- 11.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Intelligent Service Robotics (publishedVersion, cc-by)
- Ghent University Academic Bibliography (Ghent University) (publishedVersion)
- SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) (acceptedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, cc-by)
- UWE Research Repository (UWE Bristol) (submittedVersion, cc-by)
- PEARL (University of Plymouth) (submittedVersion, cc-by)
- Florence Research (University of Florence) (submittedVersion)
- PEARL (University of Plymouth) (submittedVersion)
- Research Explorer (The University of Manchester) (submittedVersion, other-oa)
- CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) (submittedVersion, other-oa)
- Funders
- Seventh Framework Programme (288899)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- multi-robot systems, multimodal interfaces, elderly users, socially assistive robots, long-term care, user-centered design, web interface, usability evaluation, robot acceptance, service robots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.