Extending the Body for Interaction with Reality
Open accessAbstract
In this paper, we explore how users can control remote devices with a virtual long arm, while preserving the perception that the artificial arm is actually part of their own body. Instead of using pointing, speech, or a remote control, the users' arm is extended in augmented reality, allowing access to devices that are out of reach. Thus, we allow users to directly manipulate real-world objects from a distance using their bare hands. A core difficulty we focus on is how to maintain ownership for the unnaturally long virtual arm, which is the strong feeling that one's limbs are actually part of the own body. Fortunately, what the human brain experiences as being part of the own body is very malleable and we find that during interaction the user's virtual arm can be stretched to more than twice its real length, without breaking the user's sense of ownership for the virtual limb.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Among usability papers, the system usability scale (SUS) was the most widely used, with five papers applying it.
“Among these papers, the system usability scale (SUS) was the most widely used [29] with five papers applying it.”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [29]
The Questionnaire section (page unavailable) describes measures of virtual-hand ownership and agency, not the system usability scale. Searches for SUS and for a comparison of its use across five papers found no passage addressing the claimed frequency or ranking. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410 · see citing works
Direct Manipulation: A Step Beyond Programming Languages
Shneiderman (1983) · Computer · doi:10.1109/mc.1983.1654471 · Cited by 1,939 · see citing works
An Image Inpainting Technique Based on the Fast Marching Method
Telea, A. (2004) · Journal of Graphics Tools · doi:10.1080/10867651.2004.10487596 · Cited by 1,421 · see citing works
Direct Manipulation Interfaces
Hutchins, E. L., Hollan, J. D., & Norman, D. A. (1985) · Human-Computer Interaction · doi:10.1207/s15327051hci0104_2 · Cited by 1,374 · see citing works
That's my hand! Activity in premotor cortex reflects feeling of ownership of a limb
Ehrsson, H. H., Spence, C., & Passingham, R. E. (2004) · Science · doi:10.1126/science.1097011 · Cited by 1,348 · see citing works
First person experience of body transfer in virtual reality
Slater, M., Spanlang, B., Sanchez-Vives, M. V., & Blanke, O. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010564 · Cited by 1,090 · see citing works
(2004) · Medical Entomology and Zoology · Cited by 978 · see citing works
If I were you: Perceptual illusion of body swapping
Petkova, V. I., & Ehrsson, H. H. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003832 · Cited by 953 · see citing works
The Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948 · see citing works
The go-go interaction technique: non-linear mapping for direct manipulation in VR
Poupyrev, I., Billinghurst, M., Weghorst, S., & Ichikawa, T. (1996) · Proceedings of the 9th annual ACM symposium on User interface software and technology - UIST '96 · doi:10.1145/237091.237102 · Cited by 872 · see citing works
Ehrsson, H. H., Holmes, N. P., & Passingham, R. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0800-05.2005 · Cited by 784 · see citing works
Banakou, D., Groten, R., & Slater, M. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1306779110 · Cited by 695 · see citing works
Having a body versus moving your body: How agency structures body-ownership
Tsakiris, M., Prabhu, G., & Haggard, P. (2006) · Consciousness and Cognition · doi:10.1016/j.concog.2005.09.004 · Cited by 622 · see citing works
The building blocks of the full body ownership illusion
Maselli, A., & Slater, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00083 · Cited by 615 · see citing works
Beaudouin-Lafon, M. (2000) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/332040.332473 · Cited by 615 · see citing works
Inducing illusory ownership of a virtual body
Slater, M. (2009) · Frontiers in Neuroscience · doi:10.3389/neuro.01.029.2009 · Cited by 605 · see citing works
Multisensory integration and the body schema: Close to hand and within reach
Maravita, A., Spence, C., & Driver, J. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00449-4 · Cited by 578 · see citing works
Towards a digital body: the virtual arm illusion
Slater, M. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.006.2008 · Cited by 570 · see citing works
A survey of 3D object selection techniques for virtual environments
Argelaguet, F., & Andújar, C. (2012) · Computers & Graphics · doi:10.1016/j.cag.2012.12.003 · Cited by 523 · see citing works
Defective Recognition of One’s Own Actions in Patients With Schizophrenia
Franck, N., Farrer, C., Georgieff, N., Marie-Cardine, M., Daléry, J., d’Amato, T., & Jeannerod, M. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.3.454 · Cited by 522 · see citing works
Kilteni, K., Maselli, A., Kording, K. P., & Slater, M. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00141 · Cited by 519 · see citing works
Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A. D. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858226 · Cited by 501 · see citing works
Extending body space in immersive virtual reality: a very long arm illusion
Kilteni, K., Normand, J.-M., Sanchez-Vives, M. V., & Slater, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040867 · Cited by 499 · see citing works
The rubber hand illusion: Sensitivity and reference frame for body ownership.
Costantini, M., & Haggard, P. (2007) · Consciousness and Cognition · doi:10.1016/j.concog.2007.01.001 · Cited by 489 · see citing works
Ishii, H., Lakatos, D., Bonanni, L., & Labrune, J. (2012) · interactions · doi:10.1145/2065327.2065337 · Cited by 437 · see citing works
Distant freehand pointing and clicking on very large, high resolution displays
Vogel, D., & Balakrishnan, R. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095041 · Cited by 432 · see citing works
The role of interaction in virtual embodiment: Effects of the virtual hand representation
Argelaguet, F., Hoyet, L., Trico, M., & Lécuyer, A. (2016) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2016.7504682 · Cited by 361 · see citing works
Manos Tsakiris, A., Carpenter, L., James, D., & Fotopoulou, A. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2039-3 · Cited by 350 · see citing works
The Impact of Control-Display Gain on User Performance in Pointing Tasks
Casiez, G., Vogel, D., Balakrishnan, R., & Cockburn, A. (2008) · Human-Computer Interaction · doi:10.1080/07370020802278163 · Cited by 347 · see citing works
Kalckert, A., & Ehrsson, H. H. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.02.003 · Cited by 345 · see citing works
Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play
Kilteni, K., Bergstrom, I., & Slater, M. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.29 · Cited by 326 · see citing works
Rubber Hand Illusion under Delayed Visual Feedback
Shimada, S., Fukuda, K., & Hiraki, K. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006185 · Cited by 306 · see citing works
Kokkinara, E., & Slater, M. (2014) · Perception · doi:10.1068/p7545 · Cited by 300 · see citing works
Buchmann, V., Violich, S., Billinghurst, M., et al. (2004) · International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE) · doi:10.1145/988834.988871 · Cited by 258 · see citing works
The Illusion of Owning a Third Arm
Guterstam, A., Petkova, V. I., & Ehrsson, H. H. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017208 · Cited by 250 · see citing works
IJsselsteijn, W. A., de Kort, Y. A. W., & Haans, A. (2006) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.15.4.455 · Cited by 249 · see citing works
Movement and the Rubber Hand Illusion
Dummer, T., Picot-Annand, A., Neal, T., & Moore, C. L. (2009) · Perception · doi:10.1068/p5921 · Cited by 230 · see citing works
Hilliges, O., Kim, D., Izadi, S., Weiss, M., & Wilson, A. D. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208405 · Cited by 219 · see citing works
Human Tails: Ownership and Control of Extended Humanoid Avatars
Steptoe, W., Steed, A. J., & Slater, M. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.32 · Cited by 200 · see citing works
Object-focused interaction in collaborative virtual environments
Hindmarsh, J., Fraser, M., Heath, C., et al. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/365058.365088 · Cited by 180 · see citing works
The relationship between human agency and embodiment
Caspar, É. A., Axel Cleeremans, B., & Haggard, P. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.01.007 · Cited by 173 · see citing works
Proprioceptive signals contribute to the sense of body ownership
Walsh, L. D., Moseley, G. L., Taylor, J. L., & Gandevia, S. C. (2011) · The Journal of Physiology · doi:10.1113/jphysiol.2011.204941 · Cited by 166 · see citing works
PRISM interaction for enhancing control in immersive virtual environments
Frees, S., Kessler, G. D., & Kay, E. J. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1229855.1229857 · Cited by 164 · see citing works
Tieri, G., Tidoni, E., Pavone, E. F., & Aglioti, S. M. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4202-3 · Cited by 146 · see citing works
3D User Interfaces: New Directions and Perspectives
Bowman, D. A., Coquillart, S., Froehlich, B., Hirose, M., Kitamura, Y., Kiyokawa, K., & Stuerzlinger, W. (2008) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2008.109 · Cited by 141 · see citing works
Lin, L., & Jörg, S. (2016) · ACM Symposium on Applied Perception · doi:10.1145/2931002.2931006 · Cited by 141 · see citing works
The spatial distance rule in the moving and classical rubber hand illusions
Kalckert, A., & Ehrsson, H. H. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.08.022 · Cited by 140 · see citing works
Braun, N., Thorne, J. D., Hildebrandt, H., & Debener, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111967 · Cited by 99 · see citing works
Supporting awareness and interaction through collaborative virtual interfaces
Fraser, M., Benford, S., Hindmarsh, J., & Heath, C. (1999) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/320719.322580 · Cited by 96 · see citing works
Mid-Air Pointing on Ultra-Walls
Nancel, M., Pietriga, E., Chapuis, O., & Beaudouin-Lafon, M. (2015) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2766448 · Cited by 88 · see citing works
Holz, C., Grossman, T., Fitzmaurice, G. W., & Agur, A. M. R. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207745 · Cited by 76 · see citing works
van der Hoort, B., & Ehrsson, H. H. (2014) · Attention Perception & Psychophysics · doi:10.3758/s13414-014-0664-9 · Cited by 67 · see citing works
TractorBeam: seamless integration of local and remote pointing for tabletop displays
Parker, J., Mandryk, R. L., & Inkpen, K. M. (2005) · Graphics Interface · Cited by 59 · see citing works
New reflections on agency and body ownership: The moving rubber hand illusion in the mirror
Jenkinson, P. M., & Preston, C. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.02.020 · Cited by 50 · see citing works
The rubber hand illusion depends on a congruent mapping between real and artificial fingers
Riemer, M., Fuchs, X., Bublatzky, F., Kleinböhl, D., Hölzl, R., & Trojan, J. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.07.012 · Cited by 29 · see citing works
Abednego, M., Lee, J.-H., Moon, W., et al. (2009) · ACM International Conference on Interactive Tabletops and Surfaces (ITS) · doi:10.1145/1731903.1731917 · Cited by 25 · see citing works
Smoothed Pointing: A User-Friendly Technique for Precision Enhanced Remote Pointing
Gallo, L., Ciampi, M., & Minutolo, A. (2010) · ... International Conference on Complex, Intelligent and Software Intensive Systems · doi:10.1109/cisis.2010.76 · Cited by 24 · see citing works
König, W. A., Gerken, J., Dierdorf, S., et al. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520635 · Cited by 22 · see citing works
Disentangling the sense of agency and the sense of ownership in the virtual hand illusion paradigmPreprint
Zhang, J., Chen, W., Li, H., Hommel, B., & Yuan, T. (2014) · doi:10.7287/peerj.preprints.673v1 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Abednego, M., Lee, J.-H., Moon, W., and Park, J.-H. I-grabber: Expanding physical reach in a large-display tabletop environment through the use of a virtual grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS '09, ACM (New York, NY, USA, 2009), 61-64.
- Buchmann, V., Violich, S., Billinghurst, M., and Cockburn, A. Fingartips: gesture based direct manipulation in augmented reality. In Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, ACM (2004), 212-221.
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. Holodesk: direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2012), 2421-2430.
- Lin, L., and Jörg, S. Need a hand?: How appearance affects the virtual hand illusion. In Proceedings of the ACM Symposium on Applied Perception, SAP '16, ACM (New York, NY, USA, 2016), 69-76.
Cited by
Sorted by citations
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 176 · see citing works
“Examples of newer techniques like those by Feuchtner and Müller (2017) using elongated hand interactions may be employed to extend the e ff ective area of interaction and thus accommodate for a disparity between physical and virtual space.”
Method
- Authors
- Feuchtner, T., & Müller, J.
- Affiliations
- Aarhus University (DK)
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 5145-5157
- OpenAlex
- W2610942663
- Cited by
- 85
- References
- 59
- Citations by year
- 2026: 3 · 2025: 12 · 2024: 8 · 2023: 8 · 2022: 11 · 2021: 15 · 2020: 16 · 2019: 5 · 2018: 6 · 2017: 1
- FWCI
- 5.79
- Type
- conference paper
- Language
- en
- Open access
- green
- nbn-resolving.de
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- KOPS (University of Konstanz) (submittedVersion)
- ERef Bayreuth (University of Bayreuth) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Keywords
- body ownership, augmented reality, teleoperation, remote device control, bare-hand interaction, body schema
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
