CoChat
Sign Up
Cited by 108Augmented Reality ApplicationsRobot Manipulation and LearningTeleoperation and Haptic Systems

A systematic review of Augmented Reality interfaces for collaborative industrial robots

Open access
De Pace, Francesco, Manuri, Federico, Sanna, Andrea, Fornaro, Claudio·2020·Computers & Industrial Engineering
DOI 10.1016/j.cie.2020.106806
Open this paper in CoChat — free accountOpen PDF

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.cie.2020.106806

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Augmented reality in industrial robot applications is mainly used to control and program robotic arms, visualise general tasks or robot information, and visualise the industrial robot workspace.

    “The analysis shows that AR is mainly used to control and program robotic arms, visualise general tasks or robot information, and visualise the industrial robot workspace.”

    From Advanced Applications of Industrial Robotics: New Trends and Possibilities (2021) · cites this paper as [21]

  • AR systems are faster than traditional approaches, users appreciate AR systems more in terms of likeability and usability, and AR seems to reduce physical workload, whereas the impact on mental workload depends on the interaction interface.

    “Results of the analysis indicate that AR systems are faster than traditional approaches; users have greater appreciation for AR systems in terms of likeability and usability; and AR seems to reduce physical workload, whereas the impact on mental workload depends on the interaction interface [16].”

    From Advanced Applications of Industrial Robotics: New Trends and Possibilities (2021) · cites this paper as [21]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 68

  1. L. Habib, M.-P. Pacaux-Lemoine, P. Millot, Adaptation of the level 920 of automation according to the type of cooperative partner, in: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2017, pp. 864-869.
  2. A. Bauer, D. Wollherr, M. Buss, Human-robot collaboration: a survey, 930 International Journal of Humanoid Robotics 5 (01) (2008) 47-66.
  3. C. Gely, D. Trentesaux, A. Le Mortellec, Maintenance of the autonomous train: A human-machine cooperation framework, in: Towards User- Centric Transport in Europe 2, Springer, 2020, pp. 135-148.
  4. M. Pacaux-Lemoine, L. Habib, N. Sciacca, T. Carlson, Emulated 935 haptic shared control for brain-computer interfaces improves human-robot cooperation, IEEE, 2020.
  5. S. A. Green, M. Billinghurst, X. Chen, J. G. Chase, Human-robot collaboration: A literature review and augmented reality approach in design, International journal of advanced robotic systems 5 (1) (2008) 940 1-18.
  6. I. E. Sutherland, A head-mounted three dimensional display, in: Proceedings of the December 9-11, 1968, fall joint computer conference, part I, ACM, 1968, pp. 757-764.
  7. P. Milgram, F. Kishino, A taxonomy of mixed reality visual displays, 945 IEICE Transactions on Information and Systems 77 (12) (1994) 1321- 1329.
  8. ifr.org, Ifr forecast: 1.7 million new robots to transform the world 's factories by 2020. URL https://ifr.org/ifr-press-releases/news/ifr-forecast-1. 7-million-new-robots-to-transform-the-worlds-factories-by-20
  9. A. Gallala, B. Hichri, P. Plapper, Survey: The evolution of the usage of augmented reality in industry 4.0, in: IOP Conference Series: Materials Science and Engineering, Vol. 521, IOP Publishing, 2019, p. 012017.
  10. A. Booth, A. Sutton, D. Papaioannou, Systematic approaches to a successful literature review, Sage, 2016.
  11. A. C. C. dos Santos, M. E. Delamaro, F. L. Nunes, The relationship between requirements engineering and virtual reality systems: A systematic literature review, in: 2013 XV Symposium on Virtual and Augmented Reality, IEEE, 2013, pp. 53-62.
  12. R. Palmarini, J. A. Erkoyuncu, R. Roy, H. Torabmostaedi, A systematic 975 review of augmented reality applications in maintenance, Robotics and Computer-Integrated Manufacturing 49 (2018) 215-228.
  13. M. A. Peshkin, J. E. Colgate, W. Wannasuphoprasit, C. A. Moore, R. B. Gillespie, P. Akella, Cobot architecture, IEEE Transactions on Robotics and Automation 17 (4) (2001) 377-390.
  14. S. Makris, P. Karagiannis, S. Koukas, A.-S. Matthaiakis, Augmented reality system for operator support in human-robot collaborative 1000 assembly, CIRP Annals-Manufacturing Technology 65 (1) (2016) 61-64.
  15. H. Fang, S. Ong, A. Nee, A novel augmented reality-based interface for robot path planning, International Journal on Interactive Design and Manufacturing (IJIDeM) 8 (1) (2014) 33-42.
  16. Y. S. Pai, H. J. Yap, R. Singh, Augmented reality-based programming, planning and simulation of a robotic work cell, Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering 1010 Manufacture 229 (6) (2015) 1029-1045.
  17. D. De Tommaso, S. Calinon, D. G. Caldwell, A tangible interface for transferring skills, International Journal of Social Robotics 4 (4) (2012) 1020 397-408.
  18. S. Papanastasiou, N. Kousi, P. Karagiannis, C. Gkournelos, A. Papavasileiou, K. Dimoulas, K. Baris, S. Koukas, G. Michalos, S. Makris, Towards seamless human robot collaboration: integrating multimodal interaction, The International Journal of Advanced 1025 Manufacturing Technology 105 (9) (2019) 3881-3897.
  19. H. Peng, J. Briggs, C.-Y. Wang, K. Guo, J. Kider, S. Mueller, P. Baudisch, F. Guimbretière, Roma: Interactive fabrication with augmented reality and a robotic 3d printer, in: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, 2018, p. 579. 1030
  20. I. Malỳ, D. Sedláček, P. Leitao, Augmented reality experiments with industrial robot in industry 4.0 environment, in: 2016 IEEE 14th International Conference on Industrial Informatics (INDIN), IEEE, 2016, pp. 176-181. 1040
  21. R. S. Andersen, O. Madsen, T. B. Moeslund, H. B. Amor, Projecting robot intentions into human environments, in: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO- MAN), IEEE, 2016, pp. 294-301.
  22. J. A. Frank, M. Moorhead, V. Kapila, Realizing mixed-reality 1045 environments with tablets for intuitive human-robot collaboration for object manipulation tasks, in: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), IEEE, 2016, pp. 302-307.
  23. C. P. Quintero, S. Li, M. K. Pan, W. P. Chan, H. M. Van der Loos, E. Croft, Robot programming through augmented trajectories in augmented reality, in: 2018 IEEE/RSJ International Conference on 1055 Intelligent Robots and Systems (IROS), IEEE, 2018, pp. 1838-1844.
  24. J. Hügle, J. Lambrecht, J. Krüger, An integrated approach for industrial 1060 robot control and programming combining haptic and non-haptic gestures, in: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), IEEE, 2017, pp. 851-857.
  25. D. Krupke, F. Steinicke, P. Lubos, Y. Jonetzko, M. Görner, J. Zhang, Comparison of multimodal heading and pointing gestures for co-located 1065 mixed reality human-robot interaction, in: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2018, pp. 1-9.
  26. M. Tanzini, P. Tripicchio, E. Ruffaldi, G. Galgani, G. Lutzemberger, C. A. Avizzano, A novel human-machine interface for working machines 1070 operation, in: 2013 IEEE RO-MAN, IEEE, 2013, pp. 744-750.
  27. T. Chakraborti, S. Sreedharan, A. Kulkarni, S. Kambhampati, Projection- aware task planning and execution for human-in-the-loop operation of robots in a mixed-reality workspace, in: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2018, pp. 1075 4476-4482.
  28. H. Liu, Y. Zhang, W. Si, X. Xie, Y. Zhu, S.-C. Zhu, Interactive robot knowledge patching using augmented reality, in: 2018 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2018, pp. 1947- 1954. 1080
  29. C. Lenz, A. Knoll, Mechanisms and capabilities for human robot collaboration, in: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, IEEE, 2014, pp. 666-671.
  30. J. Lambrecht, J. Krüger, Spatial programming for industrial robots based on gestures and augmented reality, in: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2012, pp. 466-472.
  31. M. F. Zaeh, W. Vogl, Interactive laser-projection for programming industrial robots, in: 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE, 2006, pp. 125-128. 1095
  32. Z. Materna, M. Kapinus, V. Beran, P. Smrž, P. Zemčík, Interactive spatial augmented reality in collaborative robot programming: User experience evaluation, in: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), IEEE, 2018, pp. 80-87.
  33. G. Veiga, P. Malaca, R. Cancela, Interactive industrial robot programming 1100 for the ceramic industry, International Journal of Advanced Robotic Systems 10 (10) (2013) 354.
  34. T. Weng, L. Perlmutter, S. Nikolaidis, S. Srinivasa, M. Cakmak, Robot object referencing through legible situated projections, in: 2019 International Conference on Robotics and Automation (ICRA), IEEE, 1105 2019, pp. 8004-8010.
  35. S. Charoenseang, T. Tonggoed, Human-robot collaboration with augmented reality, in: International Conference on Human-Computer 1110 Interaction, Springer, 2011, pp. 93-97.
  36. L. Shi, C. Copot, S. Derammelaere, S. Vanlanduit, A performance analysis of invariant feature descriptors in eye tracking based human robot collaboration, in: 2019 5th International Conference on Control, Automation and Robotics (ICCAR), IEEE, 2019, pp. 256-260. 1115
  37. H. Fang, S. K. Ong, A. Y.-C. Nee, Robot programming using augmented reality, in: 2009 International Conference on CyberWorlds, IEEE, 2009, 1120 pp. 13-20.
  38. C. Vogel, C. Walter, N. Elkmann, A projection-based sensor system for safe physical human-robot collaboration, in: Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on, IEEE, 2013, pp. 5359-5364. 1125
  39. D. Liu, J. Kinugawa, K. Kosuge, A projection-based making-human-feel- safe system for human-robot cooperation, in: 2016 IEEE International Conference on Mechatronics and Automation, IEEE, 2016, pp. 1101-1106.
  40. R. S. Andersen, S. Bøgh, T. B. Moeslund, O. Madsen, Intuitive task programming of stud welding robots for ship construction, in: 2015 IEEE 1130 International Conference on Industrial Technology (ICIT), IEEE, 2015, pp. 3302-3307.
  41. A. Dietrich, M. Schulze, S. Zug, J. Kaiser, Visualization of robot's 1135 awareness and perception, in: Proceedings of the First International Workshop on Digital Engineering, ACM, 2010, pp. 38-44.
  42. C. Vogel, M. Poggendorf, C. Walter, N. Elkmann, Towards safe physical human-robot collaboration: A projection-based safety system, in: Intelligent Robots and Systems (IROS), 2011 IEEE/RSJ International 1140 Conference on, IEEE, 2011, pp. 3355-3360.
  43. G. Reinhart, W. Vogl, I. Kresse, A projection-based user interface for industrial robots, in: 2007 IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, IEEE, 2007, pp. 67-71. 1145
  44. C. Vogel, C. Walter, N. Elkmann, Exploring the possibilities of supporting robot-assisted work places using a projection-based sensor system, in: 1150 Robotic and Sensors Environments (ROSE), 2012 IEEE International Symposium on, IEEE, 2012, pp. 67-72.
  45. S.-K. Ong, J. Chong, A. Y. Nee, Methodologies for immersive robot programming in an augmented reality environment, in: Proceedings of the 4th international conference on computer graphics and interactive 1155 techniques in Australasia and Southeast Asia, ACM, 2006, pp. 237-244.
  46. L. Claassen, S. Aden, J. Gaa, J. Kotlarski, T. Ortmaier, Intuitive robot control with a projected touch interface, in: International Conference on Social Robotics, Springer, 2014, pp. 95-104.
  47. E. Ruffaldi, F. Brizzi, F. Tecchia, S. Bacinelli, Third point of view 1160 augmented reality for robot intentions visualization, in: International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Springer, 2016, pp. 471-478.
  48. O. Kyjaneka, B. Al Bahar, L. Vaseya, B. Wannemacherb, A. Mengesa, Implementation of an augmented reality ar workflow for human robot 1165 collaboration in timber prefabrication, in: ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, Vol. 36, IAARC Publications, 2019, pp. 1223-1230.
  49. L. Manring, J. Pederson, D. Potts, B. Boardman, D. Mascarenas, T. Harden, A. Cattaneo, Augmented reality for interactive robot control, in: Special Topics in Structural Dynamics & Experimental Techniques, Volume 5, Springer, 2020, pp. 11-18. 1175
  50. H. Dinh, Q. Yuan, I. Vietcheslav, G. Seet, Augmented reality interface for taping robot, in: 2017 18th International Conference on Advanced Robotics (ICAR), IEEE, 2017, pp. 275-280.
  51. C. N. Deac, G. C. Deac, C. L. Popa, M. Ghinea, C. E. Cotet, Using augmented reality in smart manufacturing, in: Proceedings of the 28th 1180 DAAAM International Symposium, 2017, pp. 0727-0732.
  52. F. Leutert, C. Herrmann, K. Schilling, A spatial augmented reality system for intuitive display of robotic data, in: Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction, IEEE Press, 2013, pp. 179-180. 1185
  53. C. Vogel, M. Fritzsche, N. Elkmann, Safe human-robot cooperation with high-payload robots in industrial applications, in: Human-Robot Interaction (HRI), 2016 11th ACM/IEEE International Conference on, IEEE, 2016, pp. 529-530.
  54. C. Vogel, N. Elkmann, Novel safety concept for safeguarding and 1190 supporting humans in human-robot shared workplaces with high-payload robots in industrial applications, in: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, ACM, 2017, pp. 315-316.
  55. E. Sita, M. Studley, F. Dailami, A. Pipe, T. Thomessen, Towards 1195 multimodal interactions: robot jogging in mixed reality, in: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ACM, 2017, pp. 1-2.
  56. D. Araque, R. Díaz, B. Pérez-Gutiérrez, A. J. Uribe, Augmented reality motion-based robotics off-line programming, in: 2011 IEEE Virtual 1200 Reality Conference, IEEE, 2011, pp. 191-192.
  57. Z. Materna, M. Kapinus, V. Beran, P. Smr Ě, M. Giuliani, N. Mirnig, S. Stadler, G. Stollnberger, M. Tscheligi, Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace, in: Proceedings of the Companion of the 2017 ACM/IEEE International 1205 Conference on Human-Robot Interaction, ACM, 2017, pp. 201-202.
  58. D. Araiza-Illan, A. De San Bernabe, F. Hongchao, L. Y. Shin, Augmented reality for quick and intuitive robotic packing re-programming, in: 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), IEEE, 2019, pp. 664-664.
  59. Y. Harada, N. Nazir, Y. Shiote, T. Ito, Human-machine collaboration system for fine assembly process, in: SICE-ICASE, 2006. International Joint Conference, IEEE, 2006, pp. 5355-5360.
  60. M. A. Al-Mouhamed, O. Toker, A. Iqbal, A multithreaded distributed telerobotic framework, IEEE ASME Transactions on Mechatronics 11 (5) 1215 (2006) 558-566.
  61. V. Le Ligeour, S. Otmane, M. Mallem, P. Richard, Distributed software architecture for collaborative teleoperation based on networked mixed 1220 reality platforms, in: Information and Communication Technologies, 2006. ICTTA'06. 2nd, Vol. 2, IEEE, 2006, pp. 3498-3503.
  62. T. Machino, Y. Nanjo, Y. Yanagihara, H. Kawata, S. Iwaki, K.-i. Shimokura, Robot-augmented communication: a remote-collaboration system based on a shared field of view in real space, in: Intelligent Robots 1225 and Systems, 2005.(IROS 2005). 2005 IEEE/RSJ International Conference on, IEEE, 2005, pp. 2203-2209.
  63. R. Marín, P. J. Sanz, P. Nebot, R. Wirz, A multimodal interface to control a robot arm via the web: a case study on remote programming, IEEE Transactions on Industrial Electronics 52 (6) (2005) 1506-1520. 1230
  64. V. Le Ligeour, S. Otmane, M. Mallem, Augmented reality interface for free teleoperation, IFAC Proceedings Volumes 38 (1) (2005) 523-528.
  65. A. Kron, G. Schmidt, B. Petzold, M. I. Zah, P. Hinterseer, E. Steinbach, Disposal of explosive ordnances by use of a bimanual haptic telepresence system, in: IEEE International Conference on Robotics and Automation, 1235 2004. Proceedings. ICRA'04. 2004, Vol. 2, IEEE, 2004, pp. 1968-1973.
  66. F. Brizzi, L. Peppoloni, A. Graziano, E. Di Stefano, C. A. Avizzano, E. Ruffaldi, Effects of augmented reality on the performance of teleoperated industrial assembly tasks in a robotic embodiment, IEEE Transactions on Human-Machine Systems (2018). 1240
  67. J. Lambrecht, H. Walzel, J. Krüger, Robust finger gesture recognition on handheld devices for spatial programming of industrial robots, in: RO- 1245 MAN, 2013 IEEE, IEEE, 2013, pp. 99-106.
  68. M. Hassenzahl, M. Burmester, F. Koller, Attrakdiff: Ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität, in: 1250 Mensch & computer 2003, Springer, 2003, pp. 187-196.

Cited by

Sorted by citations

Authors
De Pace, F., Manuri, F., Sanna, A., & Fornaro, C.
Affiliations
  • Politecnico di Torino (IT)
  • UniNettuno University (IT)
ORCID
Venue
Computers & Industrial Engineering
Publisher
Elsevier BV
Published
2020-11
Volume
149
Pages
106806
ISSN
0360-8352 (ISSN-L)
DOI
10.1016/j.cie.2020.106806
OpenAlex
W3082767005
Cited by
108
References
5
Citations by year
2026: 12 · 2025: 20 · 2024: 18 · 2023: 19 · 2022: 23 · 2021: 14 · 2020: 2
FWCI
1.15
Type
journal article
Language
en
Open access
Licence
Locations
  • Computers & Industrial Engineering (publishedVersion)
  • PORTO@Iris (submittedVersion, cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
Keywords
augmented reality, human-robot collaboration, industrial robots, Industry 4.0, human-robot interaction, user interface evaluation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review