Dwell+: Multi-Level Mode Selection Using Vibrotactile Cues
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
We present Dwell+, a method that boosts the effectiveness of typical dwell selection by augmenting the passive dwell duration with active haptic ticks which promptly drives rapid switches of modes forward through the user's skin sensations. In this way, Dwell+ enables multi-level dwell selection using rapid haptic ticks. To select a mode from a button, users dwell-touch the button until the mode of selection is haptically prompted. Our haptic stimulation design consists of a short 10ms vibrotacile feedback that indicates a mode arriving and a break that separates consecutive modes. We first tested the effectiveness of 170ms, 150ms, 130ms, and 110ms intervals between modes for a 10-level selection. The results reveal that 3-beats-per-chunk rhythm design, e.g., displaying longer 25ms vibrations initially for all three modes, could potentially achieve higher accuracy. The second study reveals significant improvement wherein a 94.5% accuracy was achieved for a 10-level Dwell+ selection using the 170ms interval with 3-beats-per-chunk design, and a 93.82% rate of accuracy using the more frequent 150ms interval with similar chunks for 5-level selection. The performance of conducting touch and receiving vibration from disparate hands was investigated for our final study to provide a wider range of usage. Our applications demonstrated implementing Dwell+ across interfaces, such as text input on a smartwatch, enhancing touch space for HMDs, boosting modalities of stylus-based tool selection, and extending the input vocabulary of physical interfaces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
What you look at is what you get: eye movement-based interaction techniques
Jacob, R. J. K. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97246 · Cited by 712 · cited 1×
“In natural interaction such as eye-gazing [18, 19, 35] and body motion input (e.”
BackgroundTactons: structured tactile messages for non-visual information display
Brewster, S. A., & Brown, L. M. (2004) · Enlighten: Publications (University of Glasgow) · Cited by 697
An evaluation of an eye tracker as a device for computer input2
Ware, C., & Mikaelian, H. H. (1986) · Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface · doi:10.1145/29933.275627 · Cited by 382 · cited 1×
“In natural interaction such as eye-gazing [18, 19, 35] and body motion input (e.”
BackgroundUser learning and performance with marking menus
Kurtenbach, G., & Buxton, W. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191759 · Cited by 340 · cited 1×
“[22] first proposed to invoke a marking menus by holding a stylus on screen for 1/3 second.”
TapSense: enhancing finger interaction on touch surfaces
Harrison, C., Schwarz, J., & Hudson, S. E. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047279 · Cited by 213 · cited 3×
“Single-tap mode switching has been further improved in regards to timeand space-efficiency by exploiting immediate modalities derived from tapping pressure [13], contact points in the touch finger [12, 17], and fingerprints [33].”
BackgroundExperimental analysis of mode switching techniques in pen-based user interfaces
Li, Y., Hinckley, K., Guan, Z., & Landay, J. A. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055036 · Cited by 170
BuzzWear: alert perception in wearable tactile displays on the wrist
Lee, S., & Starner, T. E. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753392 · Cited by 168 · cited 1×
“Vibrotactile Feedback as Notification Finally, vibrotactile feedback has been extensively explored as an intimate and private communication channel to display notifications through temporal patterns [6] and spatial patterns such as direction [24] and alphanumeric letters [26].”
BackgroundDesigning Large Sets of Haptic Icons with Rhythm
Ternes, D., & MacLean, K. E. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-69057-3_24 · Cited by 163
The fat thumb: using the thumb's contact size for single-handed mobile interaction
Boring, S., Ledo, D., Chen, X. '., Marquardt, N., Tang, A., & Greenberg, S. (2012) · Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2371574.2371582 · Cited by 154
MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb
Roudaut, A., Lecolinet, É., & Guiard, Y. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518843 · Cited by 145 · cited 2×
“Two-step mode switching determines a mode based upon subsequent finger motions, such as rolling [30], shear direction [11], and in-air motion [8].”
BackgroundHinckley, K., & Song, H. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979059 · Cited by 124 · cited 1×
“For example, rolling [4, 30], swiping [7] or shearing direction [11], motion in air [8], and motion of the device [14] have been explored to expand input space on both smartphones and smartwatches.”
BackgroundChen, X. '., Schwarz, J., Harrison, C., Mankoff, J. C., & Hudson, S. E. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647392 · Cited by 122 · cited 2×
“Two-step mode switching determines a mode based upon subsequent finger motions, such as rolling [30], shear direction [11], and in-air motion [8].”
BackgroundChen, X. '., Grossman, T., & Fitzmaurice, G. (2014) · Proceedings of the 27th annual ACM symposium on User interface software and technology · doi:10.1145/2642918.2647354 · Cited by 116 · cited 1×
“For example, rolling [4, 30], swiping [7] or shearing direction [11], motion in air [8], and motion of the device [14] have been explored to expand input space on both smartphones and smartwatches.”
BackgroundAdaptive one-switch row-column scanning
Simpson, R. C., & Koester, H. H. (1999) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.808950 · Cited by 107 · cited 2×
“Furthermore, it uses numerosity perception, i.e., counting vibrations, to enable an indirect, invisible and efficient Switch-AccessScanning1 [2, 32] mode selection.”
MethodA haptic wristwatch for eyes-free interactions
Pasquero, J., Stobbe, S. J., & Stonehouse, N. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979425 · Cited by 106 · cited 1×
“[28] experimented with human perception of temporal tactile messages.”
BackgroundControl menus: excecution and control in a single interactor
Pook, S., Lecolinet, E., Vaysseix, G., & Barillot, E. (2000) · CHI '00 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/633292.633446 · Cited by 105 · cited 2×
“[29] introduced the same function with longpress using mouse’s right button.”
BackgroundTactile spatial acuity varies with site and axis in the human upper limb
Cody, F. W. J., Garside, R., Lloyd, D. M., & Poliakoff, E. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2007.12.054 · Cited by 97 · cited 1×
“Due to the fact that different body regions have different levels of tactile sensitivity [9, 10, 16], different vibration parameters (e.”
BackgroundTEMPORAL NUMEROSITY DISCRIMINATION: INTERMODAL COMPARISONS REVISITED
LECHELT, E. C. (1975) · British Journal of Psychology · doi:10.1111/j.2044-8295.1975.tb01444.x · Cited by 86
Holz, C., & Baudisch, P. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502021 · Cited by 81 · cited 1×
“Single-tap mode switching, for example, utilizes different parts of the finger [12, 17], different levels of pressure [13, 36], the area of the finger contact [5] or different fingers [15, 33] to activate a number of modes at the instance of finger contact.”
BackgroundStylus input and editing without prior selection of mode
Saund, E., & Lank, E. (2003) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/964696.964720 · Cited by 79 · cited 2×
“As such, dwell is commonly used to provide 2-mode operations in stylus input [25, 31], e.”
BackgroundMethodForcetap: extending the input vocabulary of mobile touch screens by adding tap gestures
Heo, S., & Lee, G. (2011) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2037373.2037393 · Cited by 78 · cited 2×
“Single-tap mode switching has been further improved in regards to timeand space-efficiency by exploiting immediate modalities derived from tapping pressure [13], contact points in the touch finger [12, 17], and fingerprints [33].”
BackgroundA comparison of tactile spatial sensitivity on the palm and fingerpad
Craig, J. C., & Lyle, K. B. (2001) · Perception & Psychophysics · doi:10.3758/bf03194474 · Cited by 76 · cited 1×
“Due to the fact that different body regions have different levels of tactile sensitivity [9, 10, 16], different vibration parameters (e.”
BackgroundAppert, C., Chapuis, O., & Pietriga, E. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208339 · Cited by 76 · cited 1×
“Also, researchers have introduced two-fingered performance of hold-and-move gestures to reduce dwelling times before dragging objects [20], and undoing dwell-based direct manipulation, such as moving and resizing a window, via a spring design [1].”
BackgroundEdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display
Liao, Y.-C., Chen, Y., Lo, J.-Y., Liang, R.-H., Chan, L., & Chen, B. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984522 · Cited by 75 · cited 1×
“Vibrotactile Feedback as Notification Finally, vibrotactile feedback has been extensively explored as an intimate and private communication channel to display notifications through temporal patterns [6] and spatial patterns such as direction [24] and alphanumeric letters [26].”
BackgroundSelf-citationUsing shear as a supplemental two-dimensional input channel for rich touchscreen interaction
Harrison, C., & Hudson, S. E. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208730 · Cited by 70 · cited 2×
“Two-step mode switching determines a mode based upon subsequent finger motions, such as rolling [30], shear direction [11], and in-air motion [8].”
BackgroundPressure-based menu selection for mobile devices
Wilson, G., Stewart, C. D., & Brewster, S. A. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851631 · Cited by 69 · cited 1×
“Single-tap mode switching, for example, utilizes different parts of the finger [12, 17], different levels of pressure [13, 36], the area of the finger contact [5] or different fingers [15, 33] to activate a number of modes at the instance of finger contact.”
BackgroundA user interface using fingerprint recognition
Sugiura, A., & Koseki, Y. (1998) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/288392.288575 · Cited by 57 · cited 3×
“Single-tap mode switching has been further improved in regards to timeand space-efficiency by exploiting immediate modalities derived from tapping pressure [13], contact points in the touch finger [12, 17], and fingerprints [33].”
BackgroundCounting clicks and beeps: Exploring numerosity based haptic and audio PIN entry
Bianchi, A., Oakley, I., & Kwon, D. S. (2012) · Interacting with Computers · doi:10.1016/j.intcom.2012.06.005 · Cited by 56 · cited 1×
“[3] adapt numerosity sense for secret digit-input and Kuribara et al.”
Augmentative and Alternative Communication
Dyczko, M. J. J., & Jones, N. L. (2004) · BRILL eBooks · doi:10.1163/9780080475974_013 · Cited by 55
Temporal discrimination threshold on various parts of the body
Hoshiyama, M., Kakigi, R., & Tamura, Y. (2003) · Muscle & Nerve · doi:10.1002/mus.10532 · Cited by 38 · cited 1×
“Due to the fact that different body regions have different levels of tactile sensitivity [9, 10, 16], different vibration parameters (e.”
BackgroundHuang, D.-Y., Tsai, M.-C., Tung, Y.-C., Tsai, M.-L., Yeh, Y.-T., Chan, L., Hung, Y.-P., & Chen, M. Y. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557258 · Cited by 31 · cited 3×
“Single-tap mode switching has been further improved in regards to timeand space-efficiency by exploiting immediate modalities derived from tapping pressure [13], contact points in the touch finger [12, 17], and fingerprints [33].”
BackgroundSelf-citationExtending the Vocabulary of Touch Events with ThumbRock
Bonnet, D., Appert, C., & Beaudouin-Lafon, M. (2013) · HAL · Cited by 20
Kuribara, T., Shizuki, B., & Tanaka, J. (2014) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2559206.2581187 · Cited by 16 · cited 1×
“[21] used tactile perception for users to secretly enter a pin-code through counting vibrations.”
MethodThe hold-and-move gesture for multi-touch interfaces
Kulik, A., Dittrich, J., & Froehlich, B. (2012) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2371574.2371583 · Cited by 10
Cited by
Button Simulation and Design via FDVV Models
Liao, Y.-C., Kim, S., Lee, B., & Oulasvirta, A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376262 · Cited by 31
“e can deliver rich temporal information through continuous vibrotactile cues while the press is at the bottom. This interaction can enhance the effectiveness and efficiency of dwell-press applications [36]. For instance, when the shutter button of a camera is pressed and the camera is continuously shooting, vibration t…”
BackgroundSelf-citationEyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction
Bernard, C., Monnoyer, J., Ystad, S., & Wiertlewski, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501872 · Cited by 19
“Applying this approach to interactions with touchscreens proves effective to help users set a value or select a menu by counting the number of vibration ticks they can feel from a vibrotactile surface [24] or with actuators directly on the wrist [44].”
MethodTerenti, M., & Vatavu, R.-D. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519704 · Cited by 19
“Vibrotactile feedback accompanying touch input on mobile devices is known to reduce error rates during touch target acquisition [6,12], improve user performance for text entry [8,13] and dwell mode switching [18] tasks, lower the cognitive demand of touch input interactions [6,12], and even deliver new sensing capabil…”
BackgroundTerenti, M., Pamparău, C., & Vatavu, R.-D. (2024) · Virtual Reality · doi:10.1007/s10055-024-00977-2 · Cited by 20
“…tablets, and smartwatches, the majority of the displays from our physical environments lack haptic feedback even though prior work has repeatedly highlighted the positive impact of the vibrotactile information channel on user performance (Brewster et al. 2007; Liao et al. 2017; Hoggan et al. 2008).”
Gait Gestures: Examining Stride and Foot Strike Variation as an Input Method While Walking
Tsai, C.-Y., Yen, R., Kim, D., & Vogel, D. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676342 · Cited by 15
Metadata
- Authors
- Liao, Y.-C., Chen, Y.-C., Chan, L., & Chen, B.-Y.
- Affiliations
- National Taiwan University (TW)
- National Yang Ming Chiao Tung University (TW)
- Venue
- Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2017-10-20
- Pages
- 5-16
- OpenAlex
- W2766623767
- Cited by
- 25
- References
- 37
- Citations by year
- 2025: 3 · 2024: 8 · 2023: 4 · 2022: 5 · 2021: 1 · 2020: 3 · 2018: 1
- FWCI
- 1.79
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Funders
- Ministry of Science and Technology, Taiwan
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- haptic feedback, vibrotactile feedback, multilevel selection, touch input
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.