Principles for Designing Large-Format Refreshable Haptic Graphics Using Touchscreen Devices: An Evaluation of Nonvisual Panning Methods
The DOI matches its Crossref record; 57 of the 59 references it cites were found in a registry or an index.
Abstract
Touchscreen devices, such as smartphones and tablets, represent a modern solution for providing graphical access to people with blindness and visual impairment (BVI). However, a significant problem with these solutions is their limited screen real estate, which necessitates panning or zooming operations for accessing large-format graphical materials such as maps. Non-visual interfaces cannot directly employ traditional panning or zooming techniques due to various perceptual and cognitive limitations (e.g., constraints of the haptic field of view and disorientation due to loss of one's reference point after performing these operations). This article describes the development of four novel non-visual panning methods designed from the onset with consideration of these perceptual and cognitive constraints. Two studies evaluated the usability of these panning methods in comparison with a non-panning control condition. Results demonstrated that the exploration, learning, and subsequent spatial behaviors were similar between panning and non-panning conditions, with one panning mode, based on a two-finger drag technique, revealing the overall best performance. Findings provide compelling evidence that incorporating panning operations on touchscreen devices -- the fastest growing computational platform among the BVI demographic -- is a viable, low-cost, and immediate solution for providing BVI people with access to a broad range of large-format digital graphical information.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This 2-hand anchoring strategy has also been found to be useful with touchscreen-based haptic DIMs, similar to the VAM studied here, in supporting map panning operations (Palani and Giudice, 2017).”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Palani and Giudice, 2017
In the citing paper
“Haptic perception shares similar advantages [83] and is also naturally suited for exploring spatial relationships [91].”
From The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19 (2023) · cites this paper as [91]
Citations
Cites
Human photoreceptor topography
Curcio, C. A., Sloan, K. R., Kalina, R. E., & Hendrickson, A. E. (1990) · Journal of Comparative Neurology · doi:10.1002/cne.902920402 · Cited by 3,167 · cited 1×
“By contrast, people can visually perceive as small as 0.116mm width of graphical elements at a viewing distance of ∼ 400mm [Curcio et al. 1990].”
BackgroundJones, L. A., & Lederman, S. J. (2006) · doi:10.1093/acprof:oso/9780195173154.001.0001 · Cited by 720
Exploring the anchor-point hypothesis of spatial cognition
Couclelis, H., Golledge, R. G., Gale, N., & Tobler, W. (1987) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(87)80020-8 · Cited by 401 · cited 1×
“The logic here is that the referenced map locations will act as anchor points [Couclelis et al. 1987] and will support the user in integrating graphical elements across the panned screens.”
BackgroundThe Power of Infographics: Using Pictures to Communicate and Connect With Your Audiences
Smiciklas, M. (2012) · International Linear Collider · Cited by 380
Reference points in spatial cognition.
Sadalla, E. K., Burroughs, W. J., & Staplin, L. J. (1980) · Journal of Experimental Psychology: Human Learning & Memory · doi:10.1037//0278-7393.6.5.516 · Cited by 339 · cited 2×
“Many studies have suggested that reference points occur in spatial cognition that provide an organizational structure and are used to define the position of adjacent elements [Sadalla et al. 1980; Sjöström 2002].”
BackgroundOptical-to-Tactile Image Conversion for the Blind
Bliss, J., Katcher, M., Rogers, C., & Shepard, R. (1970) · IEEE Transactions on Man Machine Systems · doi:10.1109/tmms.1970.299963 · Cited by 306 · cited 2×
“…PHANTOM devices [Phantom 2015]; tactile pin-based HAPTAC and Virtouch mouse [Hasser 1995; Kammermeier and Schmidt 2002]; camera-based Optacon [Bliss et al. 1970]; Graphic Window Professional (GWP) by Handy Tech [Chouvardas et al. 2005]; the Dots View DV1 by KGS Electronics [Nishi and Fukuda…”
BackgroundBlind Navigation and the Role of Technology
Giudice, N. A., & Legge, G. E. (2008) · The Engineering Handbook of Smart Technology for Aging, Disability, and Independence · doi:10.1002/9780470379424.ch25 · Cited by 232
Self-citationSimilarity of Tactual and Visual Picture Recognition with Limited Field of View
Loomis, J. M., Klatzky, R. L., & Lederman, S. J. (1991) · Perception · doi:10.1068/p200167 · Cited by 221 · cited 2×
“Given that learning graphical materials with touch by itself is a challenging process and often yields far from accurate results, it is highly likely that incorporation of additional operations such as panning will further increase the cognitive effort of accessing and learning large-format graphical materials [Loomis…”
BackgroundWayfinding without Vision: An Experiment with Congenitally Totally Blind People
Passini, R., & Proulx, G. (1988) · Environment and Behavior · doi:10.1177/0013916588202006 · Cited by 194 · cited 1×
“…that visually-impaired individuals often have particular difficulty organizing and integrating the many elements of tactile maps into a coherent whole [Casey 1978] and that they require more landmarks than their sighted peers to build a global representation in memory [Passini and Proulx 1988].”
BackgroundFriedman, A., & Kohler, B. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.468 · Cited by 181 · cited 1×
“The Distortion Index represents a standardized measure of the overall difference between the reconstructed map and original map, taking into account both scale and rotation [Tobler 1994; Friedman and Kohler 2003].”
Background
Research works printed but not linked: 9
- Nick Bilton. 2013. Disruptions: Visually impaired turn to smartphones to see their world. New York Times.
- Yvonne Eriksson. 1998. Tactile pictures. Pictorial Representations for the Blind 1784-1940.
- HyperBraille. 2015. Hyperbraille: The project. Retrieved January 1, 2015 from http://hyperbraille.de/project/.
- Perkins Maps. 2015. Perkins maps. Retrieved January 1, 2015 from http://www.perkins.org/resources/scout/education/geography/tactile-maps.html.
- Phantom. 2015. Phantom omni. Retrieved January 1, 2013 from http://geomagic.com/en/products-landing-pages/sensable.
- 10.1037/0278-7393.6.5.516 · doi:10.1037/0278-7393.6.5.516 · Paper page
- Ben Shneiderman, Catherine Plaisant, Maxine Cohen, and Steven Jacobs. 2009. Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5th ed. Addison-Wesley Publishing Company.
- 10.1145/1714458.1714459.http · doi:10.1145/1714458.1714459.http
- 10.1037/0278-7393.28.6.1051 · doi:10.1037/0278-7393.28.6.1051 · Paper page
Cited by
Butler, M., Holloway, L. M., Reinders, S., Goncu, C., & Marriott, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445207 · Cited by 72
“Key areas of research include new approaches to 3D-printed tactile models [7, 18, 25, 46, 51], haptic feedback [11, 14, 38, 39, 50], robotic systems [22], touch-triggered auditory feedback [10, 42, 43], and automated tactile generation [9, 33, 48, 54], such as utilising online mapping systems [17, 49, 55].”
BackgroundGiudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60
“…requiring nonvisual panning techniques to learn the entire spatial extent was shown by 6 BVI users on egocentric pointing and map recreation tasks (Palani and Giudice, 2017), and by performance on similar tasks by 12 blindfolded-sighted participants found after learning VAMs requiring nonvisual…”
MethodSelf-citationDesign Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics
Gorlewicz, J. L., Tennison, J. L., Uesbeck, P. M., Richard, M. E., Palani, H. P., Stefik, A., Smith, D. W., & Giudice, N. A. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3403933 · Cited by 53
“Upon removal of the second finger, the interface resumes to exploration mode from the same location on the map, thus allowing the user to access the graphical elements after panning from a known reference [53].”
MethodSelf-citationFan, D., Fay Siu, A., Rao, H., Kim, G. S.-H., Vazquez, X., Greco, L., O'Modhrain, S., & Follmer, S. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3557899 · Cited by 46
“While accessible, non-visual techniques to present a variety of data graphics have largely been investigated in research [43, 92, 93, 130, 134], few have been translated to standard web tools for use in practice.”
BackgroundEvaluating touch-screen vibration modality for blind users to access simple shapes and graphics
Tekli, J., Issa, Y. B., & Chbeir, R. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.10.009 · Cited by 52
Siu, A. F., Fan, D., Kim, G. S.-H., Rao, H. V., Vazquez, X., O'Modhrain, S., & Follmer, S. (2021) · Proceedings of the 18th International Web for All Conference · doi:10.1145/3430263.3452432 · Cited by 37
Jiang, C., Kuang, E., & Fan, M. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3711931 · Cited by 52
Palani, H. P., Fink, P. D. S., & Giudice, N. A. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1752464 · Cited by 33
“…judging the angle subtended between them, BVI users will typically employ a “ circling ” strategy (see Figure 4 left), where they move their finger in a circular pattern around the intersection as their exploratory procedure (Palani et al., 2016; Palani, 2013; Palani & Giudice, 2017; Raja, 2011).”
BackgroundMethodInfluentialSelf-citationNair, V., Zhu, H. '., & Smith, B. A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581302 · Cited by 29
Palani, H. P., Tennison, J. L., Giudice, G. B., & Giudice, N. A. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-94947-5_82 · Cited by 25
“, force, position and motion sensors) to keep track of their finger position within some frame of reference, defined by the body or external landmarks such as the display frame, (2) extract the spatial information by synchronously interpreting the vibrotactile cues that innervate pacinian corpuscles in the fingertip,…”
BackgroundSelf-citationPalani, H. P., Fink, P. D. S., & Giudice, N. A. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti6010001 · Cited by 24
“The gr ate learning t me for the VAM condition (see Figure 6) i not surprising based on pr vious studies with similar vibro-audio touchscreen-based interfaces [6,12,13].”
BackgroundMethodResultInfluentialSelf-citationJiang, C., Fan, Y., Xie, J., Kuang, E., Zhang, K., & Fan, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642546 · Cited by 34
Vibrotactile display design: Quantifying the importance of age and various factors on reaction times
Bao, T., Su, L., Kinnaird, C. R., Kabeto, M., Shull, P. B., & Sienko, K. H. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219737 · Cited by 24
Palani, H. P., Giudice, G. B., & Giudice, N. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-92049-8_18 · Cited by 14
Self-citationGill, S. S., & Pawluk, D. T. V. (2022) · Sensors · doi:10.3390/s22124468 · Cited by 13
“, [24]) or multiple fingers (using finger-mounted devices that could freely move independent of each other [11,25]), or spatially distributed tactile feedback (pin matrix) on single or multiple finger pads a fixed distance apart [19,20].”
BackgroundAccessible Maps for the Future of Inclusive Ridesharing
Fink, P. D. S., Milne, H., Caccese, A., Alsamsam, M., Loranger, J., Colley, M., & Giudice, N. A. (2024) · Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3640792.3675736 · Cited by 8
Self-citationBrown, J. R., Doore, S. A., Dimmel, J. K., Giudice, N., & Giudice, N. A. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608429 · Cited by 13
“However, there have been some promising techniques developed for performing non-visual panning and zooming with maps using a similar vibro-audio interface as was tested here [47, 49].”
Self-citationGiroux, F., Couture, L., Lasbareille, C., Boasen, J., Stagg, C. J., Fleming, M. K., Sénécal, S., & Léger, P. (2022) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-13064-9_35 · Cited by 10
Hersh, M. A., & Ramírez, A. R. G. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3549077 · Cited by 4
Adnan, F., Putra, J. A., Agustiningsih, M. D., Oktaviana, E., & Adawiyah, N. A. R. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1601621 · Cited by 2
A Systematic Mapping Study on Accessibility in Data Visualizations for Visually Impaired Users
Tlapa-Monge, L. R., & Montané-Jiménez, L. G. (2023) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft58849.2023.00032 · Cited by 3
“1) Haptic: In the field of data visualizations, it has been demonstrated that non-visual feedback, such as haptic and sonification, can be highly effective in guiding users during interactive visualization tasks [19], [20], [22].”
BackgroundDeng, H., Rong, A., Lee, H. L., & Xu, J. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2696961 · Cited by 1
Multimodal Technology: Improving Accessibility of the Design of Home Appliances
Adam, D. L., & Okimoto, M. L. L. R. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-80091-8_53 · Cited by 1
A scrolling performance model based on two-dimensional touch peephole interactions
Yin, J., Wu, M., Bai, S., Liu, H., & Wei, S. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2226777
“For visually impaired users, they can access graphic information such as maps through vibration modality (Tekli, Issa, and Chbeir 2018), non-visual panning (Palani and Giudice 2017) and non-visual zooming (Palani, Giudice, and Giudice 2016) on mobile touch-screens.”
Electrotactile Assistive Tools to Support Blind and Low Vision People’s Data Comprehension
Jiang, C. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746058.3758460
“However, the inherently visual nature of these infographics creates accessibility barriers for BLV people [32].”
Zhang, H., Song, R., Liu, R., Jiang, S., Tan, X., Luo, T., Jin, Y., Lin, H., Han, T., & Tian, F. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790930 · Cited by 1
Design of Tactile Graphics and Audio Feedback for Refreshable Tactile Displays
Saeed, T., Magnusson, C., Rassmus-Gröhn, K., Balčikonis, V., Hudin, C., & Panëels, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-32230-2_22
Moore, W. J. R., Kalal, M., Tennison, J. L., Giudice, N. A., & Gorlewicz, J. L. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829047
“For data-dense representations, zoom levels should be based on meaningful information grouping, not on a fixed scale [49], and two-finger dragging is the most efficient non-visual panning method [50].”
Self-citationEyes-free map learning: comparing cognitive map development from visual and nonvisual digital maps
Giudice, N. A., Kutzer, K. M., Brown, J. R., James, K. J., Varyani, A. R., & Palani, H. P. (2026) · Spatial Cognition and Computation · doi:10.1080/13875868.2026.2750883
Self-citation
Metadata
- Authors
- Palani, H. P., & Giudice, N. A.
- Affiliations
- University of Maine (US)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2017-02-03
- Volume
- 9
- Issue
- 3
- Pages
- 1-25
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W2585969526
- Cited by
- 29
- References
- 59
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 2 · 2023: 4 · 2022: 4 · 2021: 4 · 2020: 3 · 2019: 1 · 2018: 2 · 2017: 1
- FWCI
- 1.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Funders
- NSF (CHS-1425337 and CDI-1028895)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- touchscreen devices, visual impairment, blindness, panning, zooming, non-visual interaction, disorientation, accessible computing, spatial exploration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.