Multimodal Interaction, Interfaces, and Analytics
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Prior research suggests that older adults' trust in touch interfaces often stems from schema transfer from legacy devices (e.g., feature phones, ATMs), whereas their trust in speech interfaces reflects alignment with natural communication paradigms (Oviatt, 2022).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Oviatt, 2022
In the citing paper
“Second, while speech enforces a linear dialog pattern (speak-listen-speak cycle) that creates sequential processing bottlenecks, touch permits parallel operations-enabling simultaneous finger gestures and visual scanning of interface elements (Oviatt, 2022).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Oviatt, 2022
Citations
Cites
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Projected number of people with Parkinson disease in the most populous nations, 2005 through 2030
Dorsey, E. R., Constantinescu, R., Thompson, J. P., Biglan, K. M., Holloway, R. G., Kieburtz, K., Marshall, F. J., Ravina, B. M., Schifitto, G., Siderowf, A., et al. (2007) · Neurology · doi:10.1212/01.wnl.0000247740.47667.03 · Cited by 2,472
Hand and Mind: What Gestures Reveal about Thought
Feyereisen, P., & McNeill, D. (1994) · The American Journal of Psychology · doi:10.2307/1423299 · Cited by 1,688
Human facial expression: an evolutionary view
(1995) · Choice Reviews Online · doi:10.5860/choice.32-3890 · Cited by 1,279
The Age of Surveillance Capitalism
Heyndels, S. (2020) · Tijdschrift voor Philosophie · Cited by 1,269
Gesticulation and Speech: Two Aspects of the Process of Utterance
KENDON, A. (1980) · The Relationship of Verbal and Nonverbal Communication · doi:10.1515/9783110813098.207 · Cited by 1,205
Facial Expressions of Emotion: New Findings, New Questions
Ekman, P. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00253.x · Cited by 917
(2017) · Cambridge University Press eBooks · doi:10.1017/9781316676202 · Cited by 763
Research works printed but not linked: 29
- Allen J, Andre E, Cohen P, Hakkani-Tur D, Kaplan R, Lemon O, Traum D (2019) Challenge discussion: advancing multimodal dialogue. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Alpaydın E (2018) Classifying multimodal data. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Baltrusaitis T, Ahuja C, Morency L-P (2018) Multimodal machine learning. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Bengio S, Deng L, Morency L, Schuller B (2018) Perspectives on predictive power of multimodal deep learning: surprises and future directions. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Burzo M, Abouelenien M, Perez-Rosas V, Mihalcea R (2018) Multimodal deception detection. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Calvert G, Spence C, Stein BE (eds) (2004) The handbook of multisensory processing. MIT Press, Cambridge, MA
- Cohen P, Tumuluri R (2019) Commercialization of multimodal systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Cohn J, Cummins N, Epps J, Goecke R, Joshi J, Scherer S (2018) Multimodal assessment of depression and related disorders based on behavioural signals. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- D’Mello S, Bosch N, Chen H (2018) Multimodal-multisensor affect detection. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- DeMaagd G, Philip A (2015) Parkinson’s disease and its management. P T 40(8):504–510
- Friedland G, Tschantz M (2019) Privacy concerns of multimodal sensor systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Johnston M (2019) Multimodal integration for interactive conversational systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Keren G, Mousa A, Pietquin O, Zafeiriou S, Schuller B (2018) Deep learning for multisensorial and multimodal interaction. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Kirchner E, Fairclough S, Kirchner F (2019) Embedded multimodal interfaces in robotics: applications, future trends, and societal applications. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Oviatt SL (2018) Multimodal-multisensor behavioral analytics: going deeper into human-centered design, invited tutorial. In: ACM international conference on multimodal interaction, New York
- Oviatt SL, Smeulders A (2018) Multimodal knowledge discovery. In: Chang S, Hauptmann A, Morency L, Antani S, Bulterman D, Busso C, Chai J, Hirschberg J, Jain R, Mayer-Patel K, Meth R, Mooney R, Nahrstedt K, Narayanan S, Natarajan P, Oviatt S, Prabhakaran B, Smeulders A, Sundaram H, Zhang Z, Zhou M (eds) Report of 2017 NSF workshop on multimedia challenges, opportunities and research roadmap. arXiv preprint arXiv:1908.02308 · arXiv
- Oviatt SL, Bernard J, Levow G (1999) Linguistic adaptation during error resolution with spoken and multimodal systems. Lang Speech 41(3–4):415–438
- Oviatt S, Graafsgard J, Chen L, Ochoa X (2018a) Multimodal learning analytics: assessing learners’ mental state during the process of learning. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) (2018b) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of cognition and emotion. Morgan Claypool Publishers, San Rafael
- Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) (2019) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Oviatt S, Lin J, Sriramulu A (2021) I know what you know: what hand movements reveal about domain expertise. ACM Trans Intell Interact Syst 4:25
- Panagakis Y, Rudovic O, Pantic M (2018) Learning for multi-modal and context-sensitive interfaces. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
- Schnelle-Walka D, Radomski S (2019) Automotive multimodal human-machine interface. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Sonntag D (2019) Medical and health systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Stork DG, Hennecke ME (eds) (1995) Speechreading by humans and machines. Springer, New York
- Suhm B (1998) Multimodal interactive error recovery for non-conversational speech user interfaces. Ph.D. thesis, Fredericiana University, Shaker Verlag
- Valstar M (2019) Multimodal databases. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
- Xiao B, Girand C, Oviatt S (2002) Multimodal integration patterns in children. In: Hansen J, Pellom B (eds) Proceedings of the international conference on spoken language processing (ICSLP’02). Casual Prod. Ltd, Denver, pp 629–632
- Zhou J, Yu K, Chen F, Wang Y, Arshad S (2018) Multimodal behavioral and physiological signals as indicators of cognitive load. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
Cited by
Multimodal Interaction, Interfaces, and Communication: A Survey
Dritsas, E., Τρίγκα, Μ., Troussas, C., & Mylonas, P. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9010006 · Cited by 142
Audience design and egocentrism in reference production during human-computer dialogue
Peña, P. R., Doyle, P. R., Edwards, J., Garaialde, D., Rough, D. J., Bleakley, A., Clark, L., Tobar-Henríquez, A., Branigan, H. P., Gessinger, I., et al. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103058 · Cited by 20
Weichbroth, P. (2025) · IEEE Access · doi:10.1109/access.2025.3573503 · Cited by 22
A Dynamic Bayesian Network Based Framework for Multimodal Context-Aware Interactions
Han, V. Y., Wang, T., Cho, H., Todi, K., Fernandes, A. S., Levi, A., Zhang, Z., Grossman, T., Ion, A., & Jonker, T. R. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712070 · Cited by 13
Metadata
- Authors
- Oviatt, S.
- Affiliations
- Monash University (AU)
- Corresponding author
- Oviatt, Sharon
- ORCID
- Oviatt, Sharon
- Venue
- Handbook of Human Computer Interaction
- Publisher
- Springer International Publishing
- Published
- 2022
- Pages
- 1-29
- OpenAlex
- W4225880986
- Cited by
- 12
- References
- 62
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 2 · 2023: 3
- FWCI
- 15.99
- Type
- book chapter
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Springer eBooks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- mobile devices, cognitive foundations, language processing, multimodal learning, deep learning, physiological sensing, behavioral analytics, deception detection, neurodegenerative disease detection, privacy, explainability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal Interaction, Interfaces, and Analytics. https://app.cochat.ai/papers/10.1007/978-3-319-27648-9_22-1
- The paper
- Oviatt, S. (2022). Multimodal Interaction, Interfaces, and Analytics. Handbook of Human Computer Interaction. https://doi.org/10.1007/978-3-319-27648-9_22-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.