Direct Manipulation in Tactile Displays
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Tactile displays have predominantly been used for information transfer using patterns or as assistive feedback for interactions. With recent advances in hardware for conveying increasingly rich tactile information that mirrors visual information, and the increasing viability of wearables that remain in constant contact with the skin, there is a compelling argument for exploring tactile interactions as rich as visual displays. Direct Manipulation underlies much of the advances in visual interactions. In this work, we introduce the concept of a Direct Manipulation-enabled Tactile display (DMT). We define the concepts of a tactile screen, tactile pixel, tactile pointer, and tactile target which enable tactile pointing, selection and drag & drop. We build a proof of concept tactile display and study its precision limits. We further develop a performance model for DMTs based on a tactile target acquisition study. Finally, we study user performance in a real-world DMT menu application. The results show that users are able to use the application with relative ease and speed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Direct Manipulation: A Step Beyond Programming Languages
Shneiderman (1983) · Computer · doi:10.1109/mc.1983.1654471 · Cited by 1,939 · cited 1×
“The concept of direct manipulation [21] underlies much of these advances in visual interactions in the past decades.”
BackgroundGibson, J. J. (1962) · Psychological Review · doi:10.1037/h0046962 · Cited by 1,435 · cited 1×
“The tactile sense requires active exploration to identify objects and their forms [9].”
BackgroundA three-state model of graphical input
Buxton, W. A. S. (1990) · International Conference on Human-Computer Interaction · Cited by 389
Tactile brush: drawing on skin with a tactile grid display
Israr, A., & Poupyrev, I. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979235 · Cited by 354 · cited 2×
“We use vibrotactile stimulation for its proven phantom sensation capabilities [10].”
BackgroundMethodThe Impact of Control-Display Gain on User Performance in Pointing Tasks
Casiez, G., Vogel, D., Balakrishnan, R., & Cockburn, A. (2008) · Human–Computer Interaction · doi:10.1080/07370020802278163 · Cited by 347 · cited 1×
“The scale factor between movement velocities in the two spaces is termed as CD gain = Vdisplay/Vinput [5].”
BackgroundSelf-citationVibrotactile localization on the arm: Effects of place, space, and age
Cholewiak, R. W., & Collins, A. A. (2003) · Perception & Psychophysics · doi:10.3758/bf03194834 · Cited by 325 · cited 1×
“This increases tactile acuity due to the anchor effect [7].”
BackgroundTesting pointing device performance and user assessment with the ISO 9241, Part 9 standard
Douglas, S. A., Kirkpatrick, A. E., & MacKenzie, I. S. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303042 · Cited by 291 · cited 4×
“Participants were instructed to work as fast as possible while still maintaining high accuracy [8].”
BackgroundMethodResultInfluentialMaidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
BuzzWear: alert perception in wearable tactile displays on the wrist
Lee, S., & Starner, T. E. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753392 · Cited by 164 · cited 1×
“Assistive feedback is when the user is aided in an interaction by tactile feedback, such as eyes-free gestures [12], braillereading [17] or color identification [4].”
BackgroundTactile display for the visually impaired using TeslaTouch
Xu, C., Israr, A., Poupyrev, I., Bau, O., & Harrison, C. (2011) · CHI '11 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1979742.1979705 · Cited by 119 · cited 1×
“Such displays mostly work when users use their fingers [23] to explore on the display.”
Background
Research works printed but not linked: 1
- 10.1109/iswc.2010.5665867 · DOI
Cited by
ThermalBracelet: Exploring Thermal Haptic Feedback Around the Wrist
Peiris, R. L., Feng, Y.-L., Chan, L., & Minamizawa, K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300400 · Cited by 121
“Vibrotactile stimulation has been the broad choice for many wrist based haptic displays [6, 9, 27, 32].”
BackgroundStudying the Role of Haptic Feedback on Virtual Embodiment in a Drawing Task
Richard, G., Pietrzak, T., Argelaguet, F., Lécuyer, A., & Casiez, G. (2021) · Frontiers in Virtual Reality · doi:10.3389/frvir.2020.573167 · Cited by 82
“A classical synthesized signal based on a square shape was used (Gupta et al., 2016).”
Self-citationHapticClench: Investigating Squeeze Sensations using Memory Alloys
Gupta, A., Irudayaraj, A. A. R., & Balakrishnan, R. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126598 · Cited by 79
“Vibrotactile actuation on the wrist has been extensively explored [8,10,13,17].”
BackgroundSelf-citationDesign, Control, and Psychophysics of Tasbi: A Force-Controlled Multimodal Haptic Bracelet
Pezent, E., Agarwal, P., Hartcher-O’Brien, J., Colonnese, N., & O’Malley, M. K. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3164840 · Cited by 70
“Gupta et al. [37] developed a device with four radial voice coil actuators to enhance manipulation feedback of a touch screen surface, and Pece et al. [38] have developed a variation of voice coil technology that indents instead of vibrates the skin.”
BackgroundHaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind
Carcedo, M. G., Chua, S. H., Perrault, S. T., Woźniak, P. W., Joshi, R., Obaid, M., Fjeld, M., & Zhao, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858220 · Cited by 66
“[8] used a similar spatial distribution around the wrist using”
MethodInvestigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality
Gupta, A., Samad, M., Kin, K., Kristensson, P. O., & Benko, H. (2020) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar50242.2020.00062 · Cited by 52
“Multiple glove-based or optical tracking-based techniques have been proposed that map a keyboard layout on to the hand/fingers [15, 31, 45, 49], reporting speeds in the range of 5–10 WPM.”
BackgroundInfluentialSelf-citationTactileWear: A Comparison of Electrotactile and Vibrotactile Feedback on the Wrist and Ring Finger
Stanke, D., Duente, T., & Rohs, M. (2020) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3419249.3420107 · Cited by 44
“Vibration feedback is commonly used as well [2, 14, 34, 43], as it is the default notification method of commercial products.”
BackgroundGaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality
Zhao, M., Pierce, A. M., Tan, R., Zhang, T., Wang, T., Jonker, T. R., Benko, H., & Gupta, A. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584072 · Cited by 40
“Multiple wrist wearables explore text-entry on the smartwatch using the second hand [9, 12, 51].”
MethodSelf-citationSummon and Select: Rapid Interaction with Interface Controls in Mid-air
Gupta, A., Pietrzak, T., Yau, C., Roussel, N., & Balakrishnan, R. (2017) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3132272.3134120 · Cited by 28
“Multiple recent works have investigated wearable tactile feedback [15, 14, 26].”
BackgroundSelf-citationChen, Q., Perrault, S. T., Roy, Q., & Wyse, L. L. (2018) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3206505.3206511 · Cited by 28
“The wrist is also a good candidate for SVP, as explored by [6,12,16,17,19].”
BackgroundHan, L., Afzal, N., Wang, Z., Wang, Z., Jin, T., Guo, S., Gong, H., & Wang, D. (2024) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-024-00166-9 · Cited by 21
“Gupta et al. (2016) developed a tactile display with direct manipulation features, allowing users to track system states and perform actions like selection, execution, and dragging using four wrist-mounted actuators.”
Speed-accuracy tradeoff of fingertip force control with visual/audio/haptic feedback
Li, T., Wang, D., Peng, C., Yu, C., & Zhang, Y. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.10.004 · Cited by 21
“Gupta et al. (Gupta et al., 2016) defined and developed a Direct Manipulation-enabled Tactile display with gesture-based input.”
BackgroundEyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction
Bernard, C., Monnoyer, J., Ystad, S., & Wiertlewski, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501872 · Cited by 19
“While these methods are based on our temporal perception and segregation of tactile events, other strategies exploit our tactile spatial acuity [17] by conveying information through the localization of vibrations on the body.”
BackgroundZhang, L., He, W., Cao, Z., Wang, S., Bai, H., & Billinghurst, M. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2041895 · Cited by 19
“The vibrational feedback at any collision position is supposed to be composed of the two nearest neighboring motors based on the law of parallelogram (Gupta, Pietrzak, et al., 2016).”
BackgroundInfluentialGupta, A., Sendhilnathan, N., Hartcher-O’Brien, J., Pezent, E., Benko, H., & Jonker, T. R. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581467 · Cited by 16
Self-citationMultiVibes: What if your VR Controller had 10 Times more Vibrotactile Actuators?
Richard, G., Pietrzak, T., Argelaguet, F., Lécuyer, A., & Casiez, G. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00085 · Cited by 15
“The tactile feedback consisted of a square shape signal with a controllable frequency up to 1000Hz [20, 22], modulated with a 31kHz square signal with a variable duty cycle to control the vibration amplitude.”
Self-citationDesigning Vibrotactile Widgets with Printed Actuators and Sensors
Frisson, C., Decaudin, J., Pietrzak, T., Ng, A., Poncet, P., Casset, F., Latour, A., & Brewster, S. A. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3131785.3131800 · Cited by 15
“In our future work, we would like to extend the design of sliders to touchpads and multi-touch interaction; and enable tactile direct manipulation [4].”
BackgroundMethodSelf-citationYu, N.-H., Ma, S.-Y., Lin, T.-M., Fan, C.-A., Taglialatela, L. E., Huang, T.-Y., Yu, C., Cheng, Y.-T., Liao, Y.-C., & Chen, M. Y. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3604253 · Cited by 14
“Another approachmay utilize prior research that has demonstrated apparent tactile motion for other parts of the body, such as the back [26, 27], wrist [20], or forearm [26], to support more”
Kronester, M. J., Riener, A., & Babic, T. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451655 · Cited by 12
“[3] created a continuous one-dimensional tactile display consisting of four actuators in combination with the phantom sensation.”
BackgroundAn Empirical Evaluation on Vibrotactile Feedback for Wristband System
Wang, F., Zhang, W., & Luo, W. (2018) · Mobile Information Systems · doi:10.1155/2018/4878014 · Cited by 11
Learning Vibes: Communication Bandwidth of a Single Wrist-Worn Vibrotactile Actuator
Chase, E. D. Z., Israr, A., Preechayasomboon, P., Sykes, S., Gupta, A., & Hartcher-O’Brien, J. (2021) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc49131.2021.9517208 · Cited by 11
“[2] used 4 VCMs at the cardinal locations around the wrist and presented concepts of tactile screen, tactile pixels, tactile pointers, and tactile targets; then, they”
BackgroundMethodSelf-citationWristDial: An Eyes-Free Integer-Value Input Method by Quantizing the Wrist Rotation
Youn, E., Lee, S., Kim, S., Shim, Y. A., Chan, L., & Lee, G. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2021.1898848 · Cited by 10
Pietrzak, T., & Ray, R. K. (2025) · IEEE Transactions on Haptics · doi:10.1109/toh.2025.3552992 · Cited by 5
“[9].”
InfluentialSelf-citationZhang, L., He, W., Sun, M., Bai, X., & Wang, S. (2019) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2019.8797878 · Cited by 4
“There have been many approaches for giving directional haptic feedback, such as asymmetric vibrations based on haptic illusion [7], air thrusts using motors and propellers [5], and spatially distributed multiple vibration motors [4].”
MethodIbarboure, S. (2021) · theses.fr (ABES) · doi:10.70675/5aaf7c03z19a0z4c3fzb3b3z134fbc5fada6 · Cited by 4
Perception of audio-haptic textures for new touchscreen interactions
Bernard, C. (2022) · theses.fr (ABES) · doi:10.70675/d0963081zf56az4742z912fzc25754400706 · Cited by 4
Cortés, J. P. F., Suriyaarachchi, H., Nassani, A., Zhang, H., & Nanayakkara, S. C. (2021) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3447526.3472028 · Cited by 3
“…[71], researchers have 1) encouraged both individual and collaborative participatory design [68], 2) highlighted the need for authoring tools [6, 28, 77] and support interfaces [18, 70, 82], 3) investigated vibrotactile sensations in everyday contexts [8] and analysed their impact in…”
BackgroundMethodHands-On or Hands-Off? Active Touch Influences Multisensory Perception of Referred Haptics
Chase, E. D. Z., Sullivan, D. H., & O’Malley, M. K. (2025) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc64065.2025.11123388 · Cited by 2
“Wristband devices have been used to communicate passively received information [28], like language [29], guidance [30], [31], and social touch [32], to active information such as material properties [5], [8].”
Lavenant, S., Goguey, A., Malacria, S., Nigay, L., & Pietrzak, T. (2024) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar62088.2024.00092 · Cited by 2
“We focus on 6 tactons (including some using tactile animation illusions such as the funneling illusion [2, 26]) that could be used to convey 6 frequent microgestures ( Tap , Hold , Flex Up , Flex Down , Swipe Up , Swipe Down ), along-side four axes, one corresponding to each finger (from index to…”
Self-citationTowards more tactile information on sliders
Parriaud, S., Reynaud, V., Joatton, J.-B., Caffiau, S., & Coutrix, C. (2019) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/3366550.3372257 · Cited by 1
“2502032 [10] Aakar Gupta, Thomas Pietrzak, Nicolas Roussel, and Ravin Balakrishnan.”
BackgroundKandler, A. (2018) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 1
Extended Hand Attributes for Touch Input, Touch Output and Touchless Interaction
Gupta, A. (2018) · TSpace (University of Toronto)
Self-citationA New Haptic Interaction Paradigm
Gupta, A., & Pietrzak, T. (2016) · HAL
Self-citationRôle du retour haptique dans les interactions avec des avatars en réalité virtuelle
Richard, G. (2023) · theses.fr (ABES) · doi:10.70675/57804456za910z496azabeezbe1193c397b9
A Haptic Guidance Method that Conveys Motion Error Magnitude via Haptic Localization Around the Arm
Zheng, Y., Xu, J., Fan, C.-A., & Monnai, Y. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795049
“Analogous to Gupta et al.’s [14] concept of exploratory localization, users can judge feedback not only from the spatial position of the magnitude indicator but also from the direction of movement of the indicator and the positions it passes through.”
Chase, E. D. Z., Israr, A., Schepmann, M. S., O’Malley, M. K., & Hartcher-O’Brien, J. (2026) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3822501
“Gupta et al. [23] used four VCMs at cardinal locations around the wrist and introduced concepts of tactile screens, tactile pixels, tactile pointers, and tactile targets; they then used them in pointing, selection, and drag-and-drop tasks.”
Cardinal Pressure Pulses Rendered by a Wristband Can Elicit Phantom Directional Cues
Kadmani, A., Bartels, J. U., Sanchez‐Tamayo, N., Gasparetto, W., & Kuchenbecker, K. J. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3830398.3830603
“Rings of four actuators support intermediate directions through phantom co-activation of adjacent sites [15, 20], whereas rings of six to eight actuators provide finer angular resolution through added hardware [32, 33, 39, 56].”
Metadata
- Authors
- Gupta, A., Pietrzak, T., Roussel, N., & Balakrishnan, R.
- Affiliations
- University of Toronto (CA)
- Université de Lille (FR)
- Centre Inria de l'Université de Lille (FR)
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 3683-3693
- OpenAlex
- W2408121295
- Cited by
- 33
- References
- 21
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 1 · 2023: 4 · 2022: 4 · 2021: 6 · 2020: 2 · 2019: 3 · 2018: 3 · 2017: 4 · 2016: 2
- FWCI
- 6.86
- Type
- conference paper
- Language
- en
- Open access
- green
- inria.hal.science
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- HAL (submittedVersion, other-oa)
- LillOA (Université de Lille (University Of Lille)) (submittedVersion, other-oa)
- Funders
- NSERC Canada (482670)
- Project Happiness (H2020 645145)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Keywords
- tactile display, direct manipulation, drag and drop, performance models, wearable interfaces, haptic interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.