CoChat

A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments

Mendes, D., Caputo, F. M., Giachetti, A., Ferreira, A., Jorge, J. · 2019 · Computer Graphics Forum
Cited by 194

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Interactions within virtual environments often require manipulating 3D virtual objects. To this end, researchers have endeavoured to find efficient solutions using either traditional input devices or focusing on different input modalities, such as touch and mid‐air gestures. Different virtual environments and diverse input modalities present specific issues to control object position, orientation and scaling: traditional mouse input, for example, presents non‐trivial challenges because of the need to map between 2D input and 3D actions. While interactive surfaces enable more natural approaches, they still require smart mappings. Mid‐air gestures can be exploited to offer natural manipulations mimicking interactions with physical objects. However, these approaches often lack precision and control. All these issues and many others have been addressed in a large body of work. In this article, we survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/cgf.13390

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 104

  1. 10.1016/j.cag.2012.12.003 · DOI · Paper page
  2. Araújo B. R. D., 2012, Proceedings of GI '12, 173
  3. 10.1016/j.cag.2012.12.005 · DOI
  4. Aguerreche L., 2009, Proceedings of the 15th Joint Virtual Reality Eurographics Conference on Virtual Environments, 153
  5. Auteri C., 2013, Increasing precision for extended reach 3D manipulation, The International Journal of Virtual Reality, 12, 66, 10.20870/IJVR.2013.12.1.2859 · DOI
  6. 10.1162/PRES_a_00205 · DOI
  7. 10.1111/j.1467-8659.2012.03044.x · DOI
  8. 10.1145/2788940.2788941 · DOI
  9. 10.1109/3DUI.2007.340778 · DOI
  10. Bettio F., 2007, A practical vision based approach to unencumbered direct spatial manipulation in virtual worlds, Eurographics Italian Chapter Conference, 145
  11. 10.1145/253284.253301 · DOI · Paper page
  12. 10.1006/jvlc.1998.0111 · DOI · Paper page
  13. Barrett T. J., 2014, Proceedings of the 36th Annual Conference of the Cognitive Science Society
  14. Bollensdorff B., 2012, Proceedings of Graphics Interface 2012, 165
  15. Bérard F., 2009, IFIP Conference on Human‐Computer Interaction, 400
  16. 10.1145/91394.91446 · doi:10.1145/91394.91446
  17. 10.1162/105474601750182342 · DOI · Paper page
  18. Bowman D., 2004, 3D User Interfaces: Theory and Practice
  19. 10.1162/PRES_a_00207 · DOI
  20. 10.1145/2330667.2330687 · DOI · Paper page
  21. 10.1145/965105.807503 · DOI · Paper page
  22. 10.1145/1978942.1979387 · DOI
  23. 10.1145/253284.253315 · DOI · Paper page
  24. 10.1145/2808435.2808439 · DOI
  25. Cohé A., 2012, Graphics Interface, 157
  26. 10.1007/s10055-014-0246-0 · DOI
  27. 10.1145/147156.147199 · DOI · Paper page
  28. 10.1109/3DUI.2015.7131738 · DOI
  29. Davis B. A., 2015, Oculus Rift in Action
  30. 10.1145/2254556.2254641 · doi:10.1145/2254556.2254641
  31. 10.1109/TSMCC.2008.923862 · DOI · Paper page
  32. 10.1145/2788940.2788942 · DOI
  33. 10.1145/1124772.1124802 · doi:10.1145/1124772.1124802
  34. Frees S., 2005, Virtual Reality, 2005. Proceedings, VR 2005. IEEE, 99
  35. 10.1145/1229855.1229857 · DOI · Paper page
  36. 10.1145/332040.332491 · DOI · Paper page
  37. Froehlich B., 2005, The Quest for Intuitive 3d Input Devices
  38. Guerreiro J., 2014, Beyond post‐it: Structured multimedia annotations for collaborative VES, Proceedings of the Eurographics Conference on Virtual Environments, 55
  39. 10.1145/2659766.2659779 · DOI
  40. 10.1109/TABLETOP.2007.18 · DOI
  41. 10.1145/1095034.1095054 · DOI · Paper page
  42. 10.1145/2047196.2047273 · DOI
  43. 10.1145/1240624.1240798 · DOI · Paper page
  44. 10.1145/1008653.1008689 · DOI
  45. 10.1145/1622176.1622203 · DOI · Paper page
  46. 10.1145/2207676.2208405 · DOI · Paper page
  47. 10.1145/142750.142772 · DOI
  48. 10.1145/1731903.1731930 · DOI
  49. [HVW*06] HancockM. VernierF. WigdorD. CarpendaleS. ShenC.:Rotation and translation mechanisms for tabletop interaction. InFirst IEEE International Workshop on Horizontal Interactive Human‐Computer Systems 2006 TableTop2006 pp. 8.
  50. 10.1109/3DUI.2013.6550244 · doi:10.1109/3dui.2013.6550244
  51. [IGIA16] IssartelP. GuéniatF. IsenbergT. AmmiM.:Analysis of locally coupled 3d manipulation mappings based on mobile device motion. CoRR abs/1603.07462 (2016). · arXiv
  52. 10.1111/cgf.12466 · DOI
  53. Kin K., 2009, Proceedings of Graphics Interface 2009, 119
  54. 10.1145/1054972.1055055 · DOI
  55. 10.1145/364338.364370 · DOI · Paper page
  56. 10.1109/3DUI.2010.5444700 · doi:10.1109/3dui.2010.5444700
  57. 10.1109/3DUI.2011.5759220 · doi:10.1109/3dui.2011.5759220
  58. 10.1145/1978942.1979141 · DOI
  59. 10.1109/MCG.2014.20 · DOI
  60. Kiyokawa K., 1997, Manipulation aid for two‐handed 3‐D designing within a shared virtual environment, Human–Computer Interaction, 2, 937
  61. 10.1111/j.1467-8659.2012.03197.x · doi:10.1111/j.1467-8659.2012.03197.x
  62. LaValle S. M., 2017, Virtual Reality
  63. LaViola J. J., 2017, 3D User Interfaces: Theory and Practice
  64. 10.1145/258734.258747 · DOI · Paper page
  65. 10.1109/3DUI.2010.5444709 · doi:10.1109/3dui.2010.5444709
  66. 10.1145/1889863.1889888 · DOI
  67. 10.1007/978-3-642-23768-3_73 · doi:10.1007/978-3-642-23768-3_73
  68. 10.1109/VR.2011.5759451 · DOI
  69. 10.1109/3DUI.2014.6798833 · DOI
  70. 10.1007/978-3-642-23765-2_32 · doi:10.1007/978-3-642-23765-2_32
  71. 10.1145/2071423.2071447 · DOI
  72. 10.1162/pres.1995.4.4.403 · DOI
  73. 10.1016/j.jmatprotec.2004.04.401 · DOI · Paper page
  74. 10.1145/2659766.2659780 · DOI
  75. 10.1016/j.cag.2015.02.004 · DOI
  76. 10.1145/2396636.2396639 · doi:10.1145/2396636.2396639
  77. Nacenta M. A., 2009, Proceedings of Graphics Interface 2009, 175
  78. 10.1109/3DUI.2013.6550230 · DOI
  79. Nguyen T. T. H., 2014, A new direct manipulation technique for immersive 3D virtual environments, ICAT‐EGVE 2014: The 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, 8
  80. 10.1145/319120.319134 · doi:10.1145/319120.319134
  81. 10.1007/978-3-540-89639-5_94 · DOI
  82. 10.1145/300523.300540 · DOI · Paper page
  83. 10.1145/2702123.2702244 · DOI
  84. 10.1145/1622176.1622190 · DOI · Paper page
  85. 10.1145/147156.147201 · doi:10.1145/147156.147201
  86. 10.1145/2909132.2909251 · DOI
  87. 10.1145/223904.223938 · DOI · Paper page
  88. 10.1145/2914920.2915018 · DOI
  89. Shoemake K., 1992, Arcball: A user interface for specifying three‐dimensional orientation using a mouse, Graphics Interface, 92, 151
  90. 10.1109/3DUI.2016.7460025 · doi:10.1109/3dui.2016.7460025
  91. 10.1109/3DUI.2012.6184195 · doi:10.1109/3dui.2012.6184195
  92. 10.1111/j.1467-8659.2008.01127.x · DOI
  93. 10.1145/2076354.2076377 · DOI
  94. 10.1145/1643928.1643942 · DOI
  95. 10.1016/S0097-8493(02)00113-9 · DOI
  96. 10.1145/2788940.2788950 · DOI
  97. 10.1145/1450579.1450585 · DOI
  98. 10.1145/2821592.2821606 · DOI
  99. 10.1145/1449715.1449728 · doi:10.1145/1449715.1449728
  100. 10.1145/274644.274688 · DOI
  101. 10.1145/1576246.1531369 · DOI · Paper page
  102. 10.1145/2047196.2047269 · DOI · Paper page
  103. Wigdor D., 2011, Brave NUI World: Designing Natural User Interfaces for Touch and Gesture
  104. 10.1145/253284.253316 · DOI

Cited by

See all 194

Metadata

Authors
Mendes, D., Caputo, F. M., Giachetti, A., Ferreira, A., & Jorge, J.
Venue
Computer Graphics Forum
Publisher
Wiley
Published
2018-04-14
Volume
38
Issue
1
Pages
21-45
ISSN
  • 0167-7055 (ISSN-L)
  • 1467-8659
OpenAlex
W2797552926
Cited by
194
References
4
FWCI
12.09
Type
journal article
Language
en
Open access
closed
Funders
Fundação para a Ciência e a Tecnologia (UID/CEC/50021/2013, TECTON 3D (PTDC/EEI-SII/3154/2012), IT-MEDEX (PTDC/EEISII/6038/2014), SFRH/BD/91372/2012)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.