Integration of vision and haptics during tool use
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
When integrating signals from vision and haptics the brain must solve a "correspondence problem" so that it only combines information referring to the same object. An invariant spatial rule could be used when grasping with the hand: here the two signals should only be integrated when the estimate of hand and object position coincide. Tools complicate this relationship, however, because visual information about the object, and the location of the hand, are separated spatially. We show that when a simple tool is used to estimate size, the brain integrates visual and haptic information in a near-optimal fashion, even with a large spatial offset between the signals. Moreover, we show that an offset between the tool-tip and the object results in similar reductions in cross-modal integration as when the felt and seen positions of an object are offset in normal grasping. This suggests that during tool use the haptic signal is treated as coming from the tool-tip, not the hand. The brain therefore appears to combine visual and haptic information, not based on the spatial proximity of sensory stimuli, but based on the proximity of the distal causes of stimuli, taking into account the dynamics and geometry of tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Coding of modified body schema during tool use by macaque postcentral neurones
lriki, A., Tanaka, M., & Iwamura, Y. (1996) · NeuroReport · doi:10.1097/00001756-199610020-00010 · Cited by 1,274
Maravita, A., & Iriki, A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.12.008 · Cited by 1,214
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
Slant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421
Self-citationDynamic size-change of hand peripersonal space following tool use
Farnè, A., & Làdavas, E. (2000) · NeuroReport · doi:10.1097/00001756-200006050-00010 · Cited by 385
Learning to integrate arbitrary signals from vision and touch
Ernst, M. O. (2007) · Journal of Vision · doi:10.1167/7.5.7 · Cited by 332
Cited by
Principles of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391
“Interestingly, this integration process can take into account the properties of external objects, such as tools, so that the visuo–haptic integration is optimal even when the tactile input comes through a hand-held too”
BackgroundSelf-citationCausal inference accounts for heading perception in the presence of object motion
Dokka, K., Park, H., Jansen, M., DeAngelis, G. C., & Angelaki, D. E. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820373116 · Cited by 80
“The causal inference framework has previously been used to explain processing of multimodal signals, including auditory–visual (1, 4–9), visual–speech (10, 11), visual– vestibular (12, 13), and visual–tactile interactions (14, 15).”
MethodExperimentally disambiguating models of sensory cue integration
Scarfe, P. (2022) · Journal of Vision · doi:10.1167/jov.22.1.5 · Cited by 17
Metadata
- Authors
- Takahashi, C., Diedrichsen, J., & Watt, S. J.
- Venue
- Journal of Vision
- Published
- 2009-06-01
- Volume
- 9
- Issue
- 6
- Pages
- 3-3
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W1998102133
- Cited by
- 53
- References
- 13
- FWCI
- 3.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.