Hand and mind: what gestures reveal about thought
The DOI matches its Crossref record.
Abstract
What is the relation between gestures and speech? In terms of symbolic forms, of course, the spontaneous and unwitting gestures we make while talking differ sharply from spoken language itself. Whereas spoken language is linear, segmented, standardized, and arbitrary, gestures are global, synthetic, idiosyncratic, and imagistic. In Hand and Mind, David McNeill presents a bold theory of the essential unity of speech and the gestures that accompany it. This long-awaited, provocative study argues that the unity of gestures and language far exceeds the surface level of speech noted by previous researchers and in fact also includes the semantic and pragmatic levels of language. In effect, the whole concept of language must be altered to take into account the nonsegmented, instantaneous, and holistic images conveyed by gestures. McNeill and his colleagues carefully devised a standard methodology for examining the speech and gesture behavior of individuals engaged in narrative discourse. A research subject is shown a cartoon like the 1950 Canary Row--a classic Sylvester and Tweedy Bird caper that features Sylvester climbing up a downspout, swallowing a bowling ball and slamming into a brick wall. After watching the cartoon, the subject is videotaped recounting the story from memory to a listener who has not seen the cartoon. Painstaking analysis of the videotapes revealed that although the research subjects--children as well as adults, some neurologically impaired--represented a wide variety of linguistic groupings, the gestures of people speaking English and a half dozen other languages manifest the same principles. Relying on data from more than ten years of research, McNeill shows thatgestures do not simply form a part of what is said and meant but have an impact on thought itself. He persuasively argues that because gestures directly transfer mental images to visible forms, conveying ideas that language cannot always express, we must examine language and gesture
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Items 101–187 of 187
Numerical representation in the parietal lobes: Abstract or not abstract?
Cohen Kadosh, R., & Walsh, V. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990938 · Cited by 322
Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
The Role of Gesture in Learning: Do Children Use Their Hands to Change Their Minds?
Cook, S. W., & Goldin-Meadow, S. (2006) · Journal of Cognition and Development · doi:10.1207/s15327647jcd0702_4 · Cited by 320
Gesture in Spatial Cognition: Expressing, Communicating, and Thinking About Spatial Information
Alibali, M. W. (2005) · Spatial Cognition & Computation · doi:10.1207/s15427633scc0504_2 · Cited by 317
Learning words by hand: Gesture's role in predicting vocabulary development
Rowe, M. L., Özçalışkan, Ş., & Goldin-Meadow, S. (2008) · First Language · doi:10.1177/0142723707088310 · Cited by 315
Motor action and emotional memory
Casasanto, D., & Dijkstra, K. (2010) · Cognition · doi:10.1016/j.cognition.2009.11.002 · Cited by 314
Cassell, J., McNeill, D., & McCullough, K.-E. (1999) · Pragmatics & Cognition · doi:10.1075/pc.7.1.03cas · Cited by 310
A Framework for Recognizing the Simultaneous Aspects of American Sign Language
Vogler, C., & Metaxas, D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0895 · Cited by 309
Enabling Effective Human–Robot Interaction Using Perspective-Taking in Robots
Trafton, J. G., Cassimatis, N. L., Bugajska, M. D., Brock, D. P., Mintz, F. E., & Schultz, A. C. (2005) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2005.850592 · Cited by 309
Cross-modal interactions in the perception of musical performance
VINES, B., KRUMHANSL, C., WANDERLEY, M., & LEVITIN, D. (2006) · Cognition · doi:10.1016/j.cognition.2005.09.003 · Cited by 306
Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design
Green, S. A., Billinghurst, M., Chen, X., & Chase, J. G. (2008) · International Journal of Advanced Robotic Systems · doi:10.5772/5664 · Cited by 306
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Dumas, B., Lalanne, D., & Oviatt, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-00437-7_1 · Cited by 305
Teaching and learning of robot tasks via observation of human performance
Dillmann, R. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.005 · Cited by 303
Toward multimodal human-computer interface
Sharma, R., Pavlovic, V. I., & Huang, T. S. (1998) · Proceedings of the IEEE · doi:10.1109/5.664275 · Cited by 302
Flexible Conceptual Projection of Time Onto Spatial Frames of Reference
Torralbo, A., Santiago, J., & Lupiáñez, J. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_67 · Cited by 294
Multimodal human discourse: gesture and speech
Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K. E., & Ansari, R. (2002) · ACM Transactions on Computer-Human Interaction · doi:10.1145/568513.568514 · Cited by 291
Gestures as semiotic resources in the mathematics classroom
Arzarello, F., Paola, D., Robutti, O., & Sabena, C. (2009) · Educational Studies in Mathematics · doi:10.1007/s10649-008-9163-z · Cited by 291
Farnell, B. (1999) · Annual Review of Anthropology · doi:10.1146/annurev.anthro.28.1.341 · Cited by 289
Goodwin, C. (2003) · Discourse, the Body, and Identity · doi:10.1057/9781403918543_2 · Cited by 285
Interjections, language, and the ‘showing/saying’ continuum
Wharton, T. (2003) · Pragmatics & Cognition · doi:10.1075/pc.11.1.04wha · Cited by 285
Prelinguistic evolution in early hominins: Whence motherese?
Falk, D. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000111 · Cited by 284
Brief training with co-speech gesture lends a hand to word learning in a foreign language
Kelly, S. D., McDevitt, T., & Esch, M. (2009) · Language and Cognitive Processes · doi:10.1080/01690960802365567 · Cited by 282
The intentional network: How the brain reads varieties of intentions
Ciaramidaro, A., Adenzato, M., Enrici, I., Erk, S., Pia, L., Bara, B. G., & Walter, H. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.05.011 · Cited by 277
Gesture interaction in virtual reality
LI, Y., HUANG, J., TIAN, F., WANG, H.-A., & DAI, G.-Z. (2019) · Virtual Reality & Intelligent Hardware · doi:10.3724/sp.j.2096-5796.2018.0006 · Cited by 278
The impact of iconic gestures on foreign language word learning and its neural substrate
Macedonia, M., Müller, K., & Friederici, A. D. (2011) · Human Brain Mapping · doi:10.1002/hbm.21084 · Cited by 277
The Blackness of Black: Color Categories as Situated Practice
Goodwin, C. (1997) · Discourse, Tools and Reasoning · doi:10.1007/978-3-662-03362-3_6 · Cited by 276
The hands of Donald Trump: Entertainment, gesture, spectacle
Hall, K., Goldstein, D. M., & Ingram, M. B. (2016) · HAU: Journal of Ethnographic Theory · doi:10.14318/hau6.2.009 · Cited by 275
Gestures specialized for dialogue
Bavelas, J. B., Chovil, N., Coates, L., & Roe, L. (1995) · Personality and Social Psychology Bulletin · doi:10.1177/0146167295214010 · Cited by 272
Embodied conversational agents: representation and intelligence in user interfaces
Cassell, J. (2001) · AI Magazine · doi:10.1609/aimag.v22i4.1593 · Cited by 269
Barsalou, L. W., Niedenthal, P. M., Barbey, A. K., & Ruppert, J. A. (2003) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(03)01011-9 · Cited by 263
Speech and gesture share the same communication system
Bernardis, P., & Gentilucci, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.05.007 · Cited by 263
The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena
Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., & Paggio, P. (2007) · Language Resources and Evaluation · doi:10.1007/s10579-007-9061-5 · Cited by 260
Communication Behavior in Embodied Virtual Reality
Smith, H. J., & Neff, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173863 · Cited by 260
(2024) · Springer eBooks · doi:10.1007/978-3-031-70064-4 · Cited by 258
Parallel hidden Markov models for American sign language recognition
Vogler, C., & Metaxas, D. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791206 · Cited by 258
Turn-taking cues in task-oriented dialogue
Gravano, A., & Hirschberg, J. (2011) · Computer Speech & Language · doi:10.1016/j.csl.2010.10.003 · Cited by 254
Usability in the real world: assessing medical information technologies in patients’ homes
Kaufman, D. R., Patel, V. L., Hilliman, C., Morin, P. C., Pevzner, J., Weinstock, R. S., Goland, R., Shea, S., & Starren, J. (2003) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(03)00056-x · Cited by 254
Speech-associated gestures, Broca’s area, and the human mirror system
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.02.008 · Cited by 252
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247
Synthesizing multimodal utterances for conversational agents
Kopp, S., & Wachsmuth, I. (2004) · Computer Animation and Virtual Worlds · doi:10.1002/cav.6 · Cited by 243
Gesturing Saves Cognitive Resources When Talking About Nonpresent Objects
Ping, R., & Goldin‐Meadow, S. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01102.x · Cited by 230
Implementing Expressive Gesture Synthesis for Embodied Conversational Agents
Hartmann, B., Mancini, M., & Pelachaud, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11678816_22 · Cited by 202
Enactive Metaphors: Learning Through Full-Body Engagement
Gallagher, S., & Lindgren, R. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9327-1 · Cited by 200
Embodied Learning: Why at School the Mind Needs the Body
Macedonia, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02098 · Cited by 194
Gestures, but not meaningless movements, lighten working memory load when explaining math
Cook, S. W., Yip, T. K., & Goldin-Meadow, S. (2012) · Language and Cognitive Processes · doi:10.1080/01690965.2011.567074 · Cited by 192
Virtual character performance from speech
Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., & Shapiro, A. (2013) · Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation · doi:10.1145/2485895.2485900 · Cited by 168
Processing language in face-to-face conversation: Questions with gestures get faster responses
Holler, J., Kendrick, K. H., & Levinson, S. C. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1363-z · Cited by 167
Chiu, M. M. (2004) · American Educational Research Journal · doi:10.3102/00028312041002365 · Cited by 142
Goldin‐Meadow, S. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.132 · Cited by 134
Evaluation of Speech-to-Gesture Generation Using Bi-Directional LSTM Network
Hasegawa, D., Kaneko, N., Shirakawa, S., Sakuta, H., & Sumi, K. (2018) · Proceedings of the 18th International Conference on Intelligent Virtual Agents · doi:10.1145/3267851.3267878 · Cited by 131
Iconicity and Sign Lexical Acquisition: A Review
Ortega, G. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01280 · Cited by 123
Improving language without words: First evidence from aphasia
Marangolo, P., Bonifazi, S., Tomaiuolo, F., Craighero, L., Coccia, M., Altoè, G., Provinciali, L., & Cantagallo, A. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.09.025 · Cited by 121
Willems, R. M., Özyürek, A., & Hagoort, P. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20085 · Cited by 102
Gestures Enhance Foreign Language Learning
Macedonia, M., & Von Kriegstein, K. (2012) · Biolinguistics · doi:10.5964/bioling.8931 · Cited by 104
Iconicity can ground the creation of vocal symbols
Perlman, M., Dale, R., & Lupyan, G. (2015) · Royal Society Open Science · doi:10.1098/rsos.150152 · Cited by 99
Advances in Natural Multimodal Dialogue Systems
(2005) · Text, Speech and Language Technology · doi:10.1007/1-4020-3933-6 · Cited by 99
Training with rhythmic beat gestures benefits L2 pronunciation in discourse-demanding situations
Gluhareva, D., & Prieto, P. (2017) · Language Teaching Research · doi:10.1177/1362168816651463 · Cited by 96
Robot deictics: how gesture and context shape referential communication
Sauppé, A., & Mutlu, B. (2014) · Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction · doi:10.1145/2559636.2559657 · Cited by 93
Speech-and-gesture integration in high functioning autism
Silverman, L. B., Bennetto, L., Campana, E., & Tanenhaus, M. K. (2010) · Cognition · doi:10.1016/j.cognition.2010.01.002 · Cited by 92
Gesture's Role in the Learning Process
Goldin-Meadow, S. (2004) · Theory Into Practice · doi:10.1207/s15430421tip4304_10 · Cited by 90
OBSERVING AND PRODUCING PITCH GESTURES FACILITATES THE LEARNING OF MANDARIN CHINESE TONES AND WORDS
Baills, F., Suárez-González, N., González-Fuente, S., & Prieto, P. (2019) · Studies in Second Language Acquisition · doi:10.1017/s0272263118000074 · Cited by 74
Gesture Facilitates the Syntactic Analysis of Speech
Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., & Gunter, T. C. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00074 · Cited by 70
Reversing one’s fortune by pushing away bad luck.
Zhang, Y., Risen, J. L., & Hosey, C. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0034023 · Cited by 65
User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts
Chen, Z., Ma, X., Peng, Z., Zhou, Y., Yao, M., Ma, Z., Wang, C., Gao, Z., & Shen, M. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2017.1342943 · Cited by 57
Beat gestures help preschoolers recall and comprehend discourse information
Llanes-Coromina, J., Vilà-Giménez, I., Kushch, O., Borràs-Comes, J., & Prieto, P. (2018) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2018.02.004 · Cited by 56
Adversarial gesture generation with realistic gesture phasing
Ferstl, Y., Neff, M., & McDonnell, R. (2020) · Computers & Graphics · doi:10.1016/j.cag.2020.04.007 · Cited by 51
Using Gesture to Facilitate L2 Phoneme Acquisition: The Importance of Gesture and Phoneme Complexity
Hoetjes, M., & van Maastricht, L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.575032 · Cited by 48
Prominence in speech and gesture favour second language novel word learning
Kushch, O., Igualada, A., & Prieto, P. (2018) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2018.1435894 · Cited by 45
OBSERVING PITCH GESTURES FAVORS THE LEARNING OF SPANISH INTONATION BY MANDARIN SPEAKERS
Yuan, C., González-Fuente, S., Baills, F., & Prieto, P. (2019) · Studies in Second Language Acquisition · doi:10.1017/s0272263117000316 · Cited by 45
Speech-accompanying gestures are not processed by the language-processing mechanisms
Jouravlev, O., Zheng, D., Balewski, Z., Le Arnz Pongos, A., Levan, Z., Goldin-Meadow, S., & Fedorenko, E. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107132 · Cited by 39
Kelly, S. D., Hirata, Y., Manansala, M., & Huang, J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00673 · Cited by 37
Kelly, S., Bailey, A., & Hirata, Y. (2017) · Collabra: Psychology · doi:10.1525/collabra.76 · Cited by 34
Modeling Warmth and Competence in Virtual Characters
Nguyen, T.-H. D., Carstensdottir, E., Ngo, N., El-Nasr, M. S., Gray, M., Isaacowitz, D., & Desteno, D. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-21996-7_18 · Cited by 34
Generating Robot/Agent backchannels during a storytelling experiment
Al Moubayed, S., Baklouti, M., Chetouani, M., Dutoit, T., Mahdhaoui, A., Martin, J.-C., Ondas, S., Pelachaud, C., Urbain, J., & Yilmaz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152572 · Cited by 33
Modeling multimodal behaviors from speech prosody,
Ding, Y., Pelachaud, C., & Artières, T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_19 · Cited by 32
Exploring the boundaries of gesture-speech integration during language comprehension
Kelly, S. D. (2017) · Gesture Studies · doi:10.1075/gs.7.12kel · Cited by 30
Collision with China: Conceptual Metaphor Analysis, Somatic Marking, and the EP-3 Incident
SLINGERLAND, E., BLANCHARD, E. M., & BOYD-JUDSON, L. (2007) · International studies quarterly · doi:10.1111/j.1468-2478.2007.00439.x · Cited by 29
The future of preconception care
Jack, B. W., Atrash, H., Bickmore, T., & Johnson, K. (2008) · Women's Health Issues · doi:10.1016/j.whi.2008.09.004 · Cited by 25
More than words: a literature review of language of mathematics research
Simpson, A., & Cole, M. W. (2015) · Educational Review · doi:10.1080/00131911.2014.971714 · Cited by 25
Enhancing learning with hand gestures: Potential mechanisms
Cook, S. W. (2018) · Psychology of Learning and Motivation · doi:10.1016/bs.plm.2018.10.001 · Cited by 23
Social significance of trunk use in captive Asian elephants
Yasui, S., & Idani, G. (2017) · Ethology Ecology & Evolution · doi:10.1080/03949370.2016.1179684 · Cited by 18
The Embodied Teaching of Spatial Terms: Gestures Mapped to Morphemes Improve Learning
Janzen Ulbricht, N. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00109 · Cited by 13
Analyzing Multimodal Communication around a Shared Tabletop Display
Piper, A. M., & Hollan, J. D. (2009) · ECSCW 2009 · doi:10.1007/978-1-84882-854-4_17 · Cited by 11
Mining a multimodal corpus of doctor's training for virtual patient's feedbacks,
Porhet, C., Ochs, M., Saubesty, J., de Montcheuil, G., & Bertrand, R. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136816 · Cited by 10
Using Storytelling to Develop Fraction Concepts with Culturally and Linguistically Diverse Learners
Sum, E. S. W., Wong, M. K. Y., Yip, A. Y. T., & Seah, W. T. (2024) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-023-10388-5 · Cited by 7
Multimodal meaning making: the annotation of nonverbal elements in multimodal corpus transcription
Brunner, M.-L., & Diemer, S. (2021) · Research in Corpus Linguistics · doi:10.32714/ricl.09.01.05 · Cited by 7
"Oh, I Say, Jeeves!” A Calm Approach to Smart Home Input
Brown, J. N. A., Kaufmann, B., Bacher, F., Sourisse, C., & Hitz, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39146-0_23 · Cited by 3
Metadata
- Venue
- Choice Reviews Online
- Publisher
- American Library Association
- Published
- 1993-01-01
- Volume
- 30
- Issue
- 05
- Pages
- 30-2492-30-2492
- ISSN
- 0009-4978 (ISSN-L)
- 1523-8253
- OpenAlex
- W2118163921
- Cited by
- 5,094
- References
- 0
- Type
- book review
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.