The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Multimodal interaction: A review
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
(1987) · Andalas University Repository (Andalas University) · Cited by 1,584
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · Proceedings of the 7th annual conference on Computer graphics and interactive techniques - SIGGRAPH '80 · doi:10.1145/800250.807503 · Cited by 1,445
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
(2004) · Medical Entomology and Zoology · Cited by 978
Multimodal human–computer interaction: A survey
Jaimes, A., & Sebe, N. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.019 · Cited by 965
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · ACM SIGGRAPH Computer Graphics · doi:10.1145/965105.807503 · Cited by 921
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 2×
“, area V1 in the visual cortex) where connections are made and outputs influenced by crossmodal sources – combining auditory and visual stimuli (Falchier et al., 2002; Arnal et al., 2009; Campi et al., 2010; Werner and Noppeney, 2011; Leitão et al., 2012), visual and tactile stimuli (Vasconcelos et al.”
BackgroundVisual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 854
Ten myths of multimodal interaction
Oviatt, S. (1999) · Communications of the ACM · doi:10.1145/319382.319398 · Cited by 689
Multimodal integration for the representation of space in the posterior parietal cortex
Andersen, R. A. (1997) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1997.0128 · Cited by 515
QuickSet: multimodal interaction for distributed applications
Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., & Clow, J. (1997) · Proceedings of the fifth ACM international conference on Multimedia - MULTIMEDIA '97 · doi:10.1145/266180.266328 · Cited by 466
van Dam, A. (1997) · Communications of the ACM · doi:10.1145/253671.253708 · Cited by 432
Oviatt, S., Cohen, P., Wu, L., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., et al. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1504_1 · Cited by 375
Intelligent multimedia interfaces
Maybury, M. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260410 · Cited by 343
Synesthesia: A Union of the Senses
Cytowič, R. E. (1989) · Cited by 342
A design space for multimodal systems: concurrent processing and data fusion
Nigay, L., & Coutaz, J. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169143 · Cited by 312
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Dumas, B., Lalanne, D., & Oviatt, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-00437-7_1 · Cited by 305
Taming recognition errors with a multimodal interface
Oviatt, S. (2000) · Communications of the ACM · doi:10.1145/348941.348979 · Cited by 299
Multimodal human discourse: gesture and speech
Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K. E., & Ansari, R. (2002) · ACM Transactions on Computer-Human Interaction · doi:10.1145/568513.568514 · Cited by 291
When do we interact multimodally?: cognitive load and multimodal communication patterns
Oviatt, S., Coulston, R., & Lunsford, R. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027957 · Cited by 285
Perceptual user interfaces: multimodal interfaces that process what comes naturally
Oviatt, S., & Cohen, P. (2000) · Communications of the ACM · doi:10.1145/330534.330538 · Cited by 278
Guidelines for multimodal user interface design
Reeves, L. M., Lai, J., Larson, J. A., Oviatt, S., Balaji, T. S., Buisine, S., Collings, P., Cohen, P., Kraal, B., Martin, J.-C., et al. (2004) · Communications of the ACM · doi:10.1145/962081.962106 · Cited by 260
Emerging Topics in Computer Vision
Medioni, G., & Kang, S. B. (2004) · Cited by 241
Dual Neural Routing of Visual Facilitation in Speech Processing
Arnal, L. H., Morillon, B., Kell, C. A., & Giraud, A.-L. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3194-09.2009 · Cited by 241
Chen, T. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911195 · Cited by 230
Speechreading by Humans and Machines: Models, Systems, and Applications
(1996) · NATO ASI Series · doi:10.1007/978-3-662-13015-5 · Cited by 226
Facilitating multiparty dialog with gaze, gesture, and speech
Bohus, D., & Horvitz, E. (2010) · International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction · doi:10.1145/1891903.1891910 · Cited by 191
Multimodal integration-a statistical view
Wu, L., Oviatt, S. L., & Cohen, P. R. (1999) · IEEE Transactions on Multimedia · doi:10.1109/6046.807953 · Cited by 190
Multimodal behavior and interaction as indicators of cognitive load
Chen, F., Ruiz, N., Choi, E. H. C., Epps, J., Khawaja, M. A., Taib, R., Yin, B., & Wang, Y. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2395123.2395127 · Cited by 175
Unification-based multimodal integration
Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A., & Smith, I. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979653 · Cited by 174
Calvert, G. A., Brammer, M. J., & Iversen, S. D. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01189-9 · Cited by 171
Perceptual user interfaces (introduction)
Turk, M., & Robertson, G. (2000) · Communications of the ACM · doi:10.1145/330534.330535 · Cited by 163
Self-citationNeural Correlates of Multisensory Perceptual Learning
Powers, A. R., Hevey, M. A., & Wallace, M. T. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6138-11.2012 · Cited by 160
Integrating the physical environment into mobile remote collaboration
Gauglitz, S., Lee, C., Turk, M., & Höllerer, T. (2012) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2371574.2371610 · Cited by 147
Self-citationUnification-based multimodal parsing
Johnston, M. O. (1998) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/980845.980949 · Cited by 127
Turk, M. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0259-5_4 · Cited by 117
Self-citationAdvances in robust multimodal interface design
Oviatt, S. L. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1231179 · Cited by 113
Fusion engines for multimodal input: a survey
Lalanne, D., Nigay, L., Palanque, P. A., Robinson, P., Vanderdonckt, J. M., & Ladry, J.-F. (2009) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1647314.1647343 · Cited by 109
Blattner, M. M., & Glinert, E. P. (1996) · IEEE Multimedia · doi:10.1109/93.556457 · Cited by 108
Looming Signals Reveal Synergistic Principles of Multisensory Integration
Cappe, C., Thelen, A., Romei, V., Thut, G., & Murray, M. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5517-11.2012 · Cited by 107
A virtual protocol model for computer-human interaction
Nielsen, J. (1986) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(86)80028-1 · Cited by 105
Campi, K. L., Bales, K. L., Grunewald, R., & Krubitzer, L. A. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp082 · Cited by 105
Synesthesia: A union of the senses, 2nd ed.
Cytowič, R. E. (2002) · Cited by 101
Thinking Penguin: Multimodal Brain–Computer Interface Control of a VR Game
Leeb, R., Lancelle, M., Kaiser, V., Fellner, D. W., & Pfurtscheller, G. (2013) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2013.2242072 · Cited by 96
A probabilistic approach to reference resolution in multimodal user interfaces
Chai, J. Y., Hong, P., & Zhou, M. X. (2004) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/964442.964457 · Cited by 89
de Vasconcelos, N. A. P., Pantoja, J., Belchior, H., Caixeta, F. V., Faber, J., Freire, M. A. M., Cota, V. R., de Macedo, E. A., Laplagne, D. A., Gomes, H. M., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102780108 · Cited by 89
Individual differences in multimodal integration patterns: what are they and why do they exist?
Oviatt, S. L., Lunsford, R., & Coulston, R. (2005) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055006 · Cited by 74
Waibel, A., Vo, M. T., Duchnowski, P., & Manke, S. (1996) · Artificial Intelligence Review · doi:10.1007/bf00127684 · Cited by 72
The Contributions of Transient and Sustained Response Codes to Audiovisual Integration
Werner, S., & Noppeney, U. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq161 · Cited by 67
Finite-state multimodal integration and understanding
Johnston, M. O., & Bangalore, S. (2005) · Natural Language Engineering · doi:10.1017/s1351324904003572 · Cited by 65
Multimodal human behavior analysis: learning correlation and interaction across modalities
Song, Y., Morency, L., & Davis, R. (2012) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2388676.2388684 · Cited by 61
Xiao, B., Lunsford, R., Coulston, R., Wesson, M., & Oviatt, S. L. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/958432.958480 · Cited by 57
Nostril-Specific Olfactory Modulation of Visual Perception in Binocular Rivalry
Zhou, W., Zhang, X., Chen, J., Wang, L., & Chen, D. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2649-12.2012 · Cited by 51
Selection of events in time enhances activity throughout early visual cortex
Swallow, K. M., Makovski, T., & Jiang, Y. V. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00472.2012 · Cited by 51
Leitão, J., Thielscher, A., Werner, S., Pohmann, R., & Noppeney, U. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs078 · Cited by 45
Statistical multimodal integration for audio-visual speech processing
Nakamura, S. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1021886 · Cited by 42
Vision Merges With Touch in a Purely Tactile Discrimination
Arabzadeh, E., Clifford, C. W. G., & Harris, J. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02134.x · Cited by 41
Multimodal Integration - A Biological View
Coen, M. H. (2001) · Cited by 29
Multimodal framework for mobile interaction
Cutugno, F., Leano, V. A., Rinaldi, R., et al. (2012) · International Working Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/2254556.2254592 · Cited by 26
Towards automatic evaluation of multimodal user interfaces
Coutaz, J., Salber, D., & Balbo, S. (1993) · Knowledge-Based Systems · doi:10.1016/0950-7051(93)90018-o · Cited by 14
Bourguet, M.-L., & Chang, J. (2008) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-008-0004-2 · Cited by 7
Cited by
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
“, [21], [27], [58] (biomedical imaging) and [10], [11] (HMI).”
BackgroundInfluentialGuna, J., Jakus, G., Pogačnik, M., Tomažič, S., & Sodnik, J. (2014) · Sensors · doi:10.3390/s140203702 · Cited by 387
A meta-analysis of how signaling affects learning with media
Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018) · Educational Research Review · doi:10.1016/j.edurev.2017.11.001 · Cited by 268
Artificial Intelligence and Biosensors in Healthcare and Its Clinical Relevance: A Review
(2023) · doi:10.1109/access.2023.3285596 · Cited by 205
Trusting Virtual Agents: The Effect of Personality
Zhou, M. X., Mark, G., Li, J., & Yang, H. (2019) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3232077 · Cited by 176
Metadata
- Authors
- Turk, M.
- Venue
- Pattern Recognition Letters
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 36
- Pages
- 189-195
- ISSN
- 0167-8655 (ISSN-L)
- OpenAlex
- W1989689139
- Cited by
- 496
- References
- 62
- FWCI
- 33.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.