Spatial learning and navigation using a virtual verbal display
Abstract
We report on three experiments that investigate the efficacy of a new type of interface called a virtual verbal display (VVD) for nonvisual learning and navigation of virtual environments (VEs). Although verbal information has been studied for route-guidance, little is known about the use of context-sensitive, speech-based displays (e.g., the VVD) for supporting free exploration and wayfinding behavior. During training, participants used the VVD (Experiments I and II) or a visual display (Experiment III) to search the VEs and find four hidden target locations. At test, all participants performed a route-finding task in the corresponding real environment, navigating with vision (Experiments I and III) or from verbal descriptions (Experiment II). Training performance between virtual display modes was comparable, but wayfinding in the real environment was worse after VVD learning than visual learning, regardless of the testing modality. Our results support the efficacy of the VVD for searching computer-based environments but indicate a difference in the cognitive maps built up between verbal and visual learning, perhaps due to lack of physical movement in the VVD.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Similar transfer paradigms have proven effective for supporting accurate navigation in large physical indoor layouts after learning in the corresponding virtual space using verbal and auditory interfaces.
“Similar transfer paradigms have proven effective for supporting accurate navigation in large physical indoor layouts after learning in the corresponding virtual space using verbal and auditory interfaces (Giudice and Tietz, 2008; Giudice et al., 2010; Connors et al., 2014).”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Giudice et al., 2010
Cites
The Development of Spatial Representations of Large-Scale Environments
Siegel, A. W., & White, S. H. (1975) · Advances in Child Development and Behavior · doi:10.1016/s0065-2407(08)60007-5 · Cited by 1,830 · see citing works
Immersive virtual environment technology as a basic research tool in psychology
Loomis, J. M., Blascovich, J. J., & Beall, A. C. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200735 · Cited by 717 · see citing works
Loomis, J. M., Marston, J. R., Golledge, R. G., & Klatzky, R. L. (2005) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x0509900404 · Cited by 156 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Evaluation of a vibrotactile feedback device for spatial guidance
Weber, B. M., Schatzle, S., Hulin, T., Preusche, C., & Deml, B. (2011) · 2011 IEEE World Haptics Conference · doi:10.1109/whc.2011.5945511 · Cited by 99 · see citing works
“Within the context of navigation, verbal guidance has shown to be effective [22] [23].”
BackgroundConnors, E. C., Chrastil, E. R., Sánchez, J., & Merabet, L. B. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00133 · Cited by 69 · see citing works
“…typically less emphasis has been placed on using assistive devices for the specific purpose of training spatial cognitive skills that are crucial to promote more efficient travel and independent navigation [for examples of studies in the effort, see (Giudice and Tietz, 2008; Giudice et al., 2010)].”
BackgroundGiudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60 · see citing works
“Similar transfer paradigms have proven effective for supporting accurate navigation in large physical indoor layouts after learning in the corresponding virtual space using verbal and auditory interfaces (Giudice and Tietz, 2008; Giudice et al., 2010; Connors et al., 2014).”
BackgroundSelf-citationMassiceti, D., Hicks, S. L., & van Rheede, J. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199389 · Cited by 54 · see citing works
Kraemer, D. J. M., Schinazi, V. R., Cawkwell, P., Tekriwal, A., Epstein, R. A., & Thompson-Schill, S. L. (2016) · Journal of Experimental Psychology. Learning, Memory and Cognition · doi:10.1037/xlm0000314 · Cited by 45 · see citing works
“…2008a, 2008b; Lee & Tversky, 2005; Mani & Johnson-Laird, 1982; Schneider & Taylor, 1999; Taylor & Tversky, 1992a, 1992b), and for online navigation (Giudice et al., 2007, 2010; Meilinger, 2005; Pazzaglia & De Beni, 2001; Tversky & Lee, 1999; but see Wanet-Defalque, Vanlierde, & Michaux, 2001).”
Perception of Graphical Virtual Environments by Blind Users via Sensory Substitution
Maidenbaum, S., Buchs, G., Abboud, S., Lavi‐Rotbain, O., & Amedi, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147501 · Cited by 34 · see citing works
“…and mobility knowledge between virtual and real environments, at least to a certain extent, is well established, including for users who are blind [2 – 6], these worlds can be used for familiarization with an unknown environment virtually before going there physically, e.g., via Google-Street-view.”
BackgroundA Wearable Virtual Usher for Vision-Based Cognitive Indoor Navigation
Li, L., Xu, Q.-L., Chandrasekhar, V., Lim, J.-H., Tan, C., & Mukawa, M. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2530407 · Cited by 31 · see citing works
“It requires extra mental effort to interpret the map and associate it with egocentric perception of the environment [6], [7], largely owing to the different mental mechanisms for processing allocentric and egocentric information [8].”
BackgroundJiang, C., Fan, Y., Xie, J., Kuang, E., Zhang, K., & Fan, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642546 · Cited by 25 · see citing works
“Since our findings reinforce earlier research showing that non-visual egocentric navigation using auditory and haptic cues can attain exceptional accuracy [28, 63, 71], future work could consider continuing to leverage this method to support BLV users.”
ResultA wearable virtual guide for context-aware cognitive indoor navigation
Xu, Q.-L., Li, L., Lim, J.-H., Tan, C., Mukawa, M., & Wang, G. S. (2014) · International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/2628363.2628390 · Cited by 25 · see citing works
“normally anchor the user’s location on a 2D map, which requires the users to interpret the map and associate it with the egocentric perception of the environment [18].”
Learning with Virtual Verbal Displays: Effects of Interface Fidelity on Cognitive Map Development
Giudice, N. A., & Tietz, J. D. (2008) · Spatial Cognition · doi:10.1007/978-3-540-87601-4_11 · Cited by 17 · see citing works
Self-citationLohmann, K., Eschenbach, C., & Habel, C. (2011) · Conference On Spatial Information Theory · doi:10.1007/978-3-642-23196-4_18 · Cited by 13 · see citing works
Concurrent explanations can enhance visual decision making.
Leisti, T., Radun, J., Virtanen, T., Nyman, G., & Häkkinen, J. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2013.11.001 · Cited by 9 · see citing works
Guided Navigation Impairs Spatial Knowledge: Using Aids to Improve Spatial Representations
Bakdash, J. (2020) · doi:10.18130/v3xz8c · Cited by 6 · see citing works
Self-citationThe Influence of the Encoding Modality on Spatial Navigation for Sighted and Late-Blind People.
Santoro, I., Murgia, M., Sors, F., & Agostini, T. (2020) · Multisensory Research · doi:10.1163/22134808-20191431 · Cited by 6
Embodied, situated, and sociocultural spatial cognition: Toward theoretical integration
Knauff, M. (2026) · Spatial Cogn. Comput. · doi:10.1080/13875868.2026.2678799 · Cited by 2 · see citing works
“Tactile and haptic information is central for blind and visually impaired navigation and for cognitive map formation without visual access (Giudice, 2018; Giudice et al., 2010, 2020; Ottink et al., 2022; Schinazi et al., 2016).”
Leisti, T., & Häkkinen, J. (2018) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2063 · Cited by 2 · see citing works
Wang, Y., Zhang, H.-T., Yu, L., Zhang, K., Sun, X., & Plocher, T. (2011) · Interacción · doi:10.1007/978-3-642-21616-9_39 · Cited by 2 · see citing works
“People with permanent or temporary visual impairment were used to evaluate the effects of different auditory display modes in terms of spatial perception [3] [4], route guidance [5] [6] [7] [8] [9], spatial learning [10] [11], and cognitive loads [12].”
MethodThe Role of Contextual Info‐Marks in Navigating a Virtual Rural Environment
Rousell, A., Jarvis, C., & Brunsdon, C. (2016) · Trans. GIS · doi:10.1111/tgis.12136 · Cited by 1 · see citing works
“The research takes place in the context of a Virtual Environment (VE); skills gained in VEs can transfer to real world instances (Giudice et al. 2010).”
BackgroundMethod
- Authors
- Giudice, N. A., Bakdash, J. Z., Legge, G. E., & Roy, R.
- Affiliations
- University of Maine (US)
- University of Virginia (US)
- University of Minnesota (US)
- Venue
- ACM Transactions on Applied Perception
- Published
- 2010-01
- Volume
- 7
- Issue
- 1
- Pages
- 1-22
- ISSN
- 1544-3558 (ISSN-L)
- 1544-3965
- OpenAlex
- W2079196769
- Cited by
- 22
- References
- 0
- Citations by year
- 2026: 1 · 2024: 1 · 2020: 1 · 2019: 1 · 2018: 1 · 2017: 1 · 2016: 3 · 2015: 1 · 2014: 3 · 2013: 1 · 2012: 2
- FWCI
- 6.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Applied Perception (publishedVersion)
- Funders
- National Institute on Disability and Rehabilitation Research (H133A011903)
- National Institutes of Health (5T32EY07133EY-02857)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Spatial Cognition and Navigation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Keywords
- spatial learning, wayfinding, virtual worlds, cognitive maps, route finding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review