The eye in hand: predicting others' behavior by integrating multiple sources of information
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The ability to predict the outcome of other beings' actions confers significant adaptive advantages. Experiments have assessed that human action observation can use multiple information sources, but it is currently unknown how they are integrated and how conflicts between them are resolved. To address this issue, we designed an action observation paradigm requiring the integration of multiple, potentially conflicting sources of evidence about the action target: the actor's gaze direction, hand preshape, and arm trajectory, and their availability and relative uncertainty in time. In two experiments, we analyzed participants' action prediction ability by using eye tracking and behavioral measures. The results show that the information provided by the actor's gaze affected participants' explicit predictions. However, results also show that gaze information was disregarded as soon as information on the actor's hand preshape was available, and this latter information source had widespread effects on participants' prediction ability. Furthermore, as the action unfolded in time, participants relied increasingly more on the arm movement source, showing sensitivity to its increasing informativeness. Therefore, the results suggest that the brain forms a robust estimate of the actor's motor intention by integrating multiple sources of information. However, when informative motor cues such as a preshaped hand with a given grip are available and might help in selecting action targets, people tend to capitalize on such motor cues, thus turning out to be more accurate and fast in inferring the object to be manipulated by the other's hand.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“Formally speaking, participants behaved in a way that is dictated by their “hyperpriors” (i.e., prior beliefs about precision of a given source that derive from previous experience; Friston 2010), and they fail to update these (hyper)priors during the experiment.”
BackgroundMerging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906 · cited 1×
“…action unfolded in time (e.g., in longer videos) is in keeping with the idea that multiple sources of evidence can be integrated and weighted depending on their reliability, a principle that has been demonstrated in perceptual (Ernst and Bulthoff 2004) and motor domains (Kording and Wolpert 2006).”
BackgroundThe functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations
Rizzolatti, G., & Sinigaglia, C. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2805 · Cited by 1,680 · cited 1×
“…results thus suggest that observing an agent's hand preshape automatically evokes motor representations of the action-object relationship (e.g., Rizzolatti and Sinigaglia 2010; see also Becchio et al. 2012), implying the detection of the potential for successful action outcomes (Bach et al.…”
BackgroundPredictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134 · cited 1×
“…evidence that similar principles might be at work during action perception, which is compatible with recent proposals that cast it in terms of hierarchical probabilistic inference and predictive coding (Dindo et al. 2011; Friston et al. 2011; Kilner et al. 2007; Pezzulo 2013; Pezzulo et al. 2013 ).”
BackgroundAction understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Examples of mixed-effects modeling with crossed random effects and with binomial data
Quené, H., & van den Bergh, H. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2008.02.002 · Cited by 534
Looking Ahead: Anticipatory Gaze and Motor Ability in Infancy
Ambrosini, E., Reddy, V., de Looper, A., Costantini, M., Lopez, B., & Sinigaglia, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0067916 · Cited by 140 · cited 2×
“Moreover, they extend our previous findings (Ambrosini et al. 2011, 2012, 2013; Costantini et al. 2012a, 2012b, 2013; see also Kanakogi and Itakura 2011) by showing that the agent's hand preshape provides the observer with enough motor cues to anticipate with his/her gaze the target object of the…”
ResultSelf-citation
Cited by
Action perception as hypothesis testing
Donnarumma, F., Costantini, M., Ambrosini, E., Friston, K., & Pezzulo, G. (2017) · Cortex · doi:10.1016/j.cortex.2017.01.016 · Cited by 90
Self-citationDell'Acqua, C., Hajcak, G., Amir, N., Santopetro, N. J., Brush, C. J., & Meyer, A. (2023) · Psychophysiology · doi:10.1111/psyp.14216 · Cited by 16
Social context modulates autonomic responses to direct eye contact
Lapolla, N. J., Bishop, B. H., & Gahtan, E. (2023) · Physiology & Behavior · doi:10.1016/j.physbeh.2023.114119 · Cited by 5
“Some of the same gaze stimuli, especially gaze direction in pictures, can influence behavior, including judgements of emotional facial expressions [20], memory for pictures of unfamiliar faces [21], attributions of an actor’s behavioral intentions [22], and allocation of visual attention [23].”
Metadata
- Authors
- Ambrosini, E., Pezzulo, G., & Costantini, M.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2015-04
- Volume
- 113
- Issue
- 7
- Pages
- 2271-2279
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2074216070
- Cited by
- 42
- References
- 7
- FWCI
- 8.34
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The eye in hand: predicting others' behavior by integrating multiple sources of information. https://app.cochat.ai/papers/10.1152/jn.00464.2014
- The paper
- Ambrosini, E., Pezzulo, G., & Costantini, M. (2015). The eye in hand: predicting others' behavior by integrating multiple sources of information. Journal of Neurophysiology. https://doi.org/10.1152/jn.00464.2014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.