CoChat

Multimodal Interaction, Interfaces, and Analytics

Oviatt, Sharon · 2022 · Handbook of Human Computer Interaction

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.

Overview

Integrity signals

Registry

Crossref · 10.1007/978-3-319-27648-9_22-1

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 62 references

Research works printed but not linked: 29

  1. Allen J, Andre E, Cohen P, Hakkani-Tur D, Kaplan R, Lemon O, Traum D (2019) Challenge discussion: advancing multimodal dialogue. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  2. Alpaydın E (2018) Classifying multimodal data. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  3. Baltrusaitis T, Ahuja C, Morency L-P (2018) Multimodal machine learning. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  4. Bengio S, Deng L, Morency L, Schuller B (2018) Perspectives on predictive power of multimodal deep learning: surprises and future directions. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  5. Burzo M, Abouelenien M, Perez-Rosas V, Mihalcea R (2018) Multimodal deception detection. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  6. Calvert G, Spence C, Stein BE (eds) (2004) The handbook of multisensory processing. MIT Press, Cambridge, MA
  7. Cohen P, Tumuluri R (2019) Commercialization of multimodal systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  8. Cohn J, Cummins N, Epps J, Goecke R, Joshi J, Scherer S (2018) Multimodal assessment of depression and related disorders based on behavioural signals. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  9. D’Mello S, Bosch N, Chen H (2018) Multimodal-multisensor affect detection. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  10. DeMaagd G, Philip A (2015) Parkinson’s disease and its management. P T 40(8):504–510
  11. Friedland G, Tschantz M (2019) Privacy concerns of multimodal sensor systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  12. Johnston M (2019) Multimodal integration for interactive conversational systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  13. Keren G, Mousa A, Pietquin O, Zafeiriou S, Schuller B (2018) Deep learning for multisensorial and multimodal interaction. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  14. Kirchner E, Fairclough S, Kirchner F (2019) Embedded multimodal interfaces in robotics: applications, future trends, and societal applications. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  15. Oviatt SL (2018) Multimodal-multisensor behavioral analytics: going deeper into human-centered design, invited tutorial. In: ACM international conference on multimodal interaction, New York
  16. Oviatt SL, Smeulders A (2018) Multimodal knowledge discovery. In: Chang S, Hauptmann A, Morency L, Antani S, Bulterman D, Busso C, Chai J, Hirschberg J, Jain R, Mayer-Patel K, Meth R, Mooney R, Nahrstedt K, Narayanan S, Natarajan P, Oviatt S, Prabhakaran B, Smeulders A, Sundaram H, Zhang Z, Zhou M (eds) Report of 2017 NSF workshop on multimedia challenges, opportunities and research roadmap. arXiv preprint arXiv:1908.02308 · arXiv
  17. Oviatt SL, Bernard J, Levow G (1999) Linguistic adaptation during error resolution with spoken and multimodal systems. Lang Speech 41(3–4):415–438
  18. Oviatt S, Graafsgard J, Chen L, Ochoa X (2018a) Multimodal learning analytics: assessing learners’ mental state during the process of learning. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  19. Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) (2018b) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of cognition and emotion. Morgan Claypool Publishers, San Rafael
  20. Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) (2019) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  21. Oviatt S, Lin J, Sriramulu A (2021) I know what you know: what hand movements reveal about domain expertise. ACM Trans Intell Interact Syst 4:25
  22. Panagakis Y, Rudovic O, Pantic M (2018) Learning for multi-modal and context-sensitive interfaces. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael
  23. Schnelle-Walka D, Radomski S (2019) Automotive multimodal human-machine interface. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  24. Sonntag D (2019) Medical and health systems. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  25. Stork DG, Hennecke ME (eds) (1995) Speechreading by humans and machines. Springer, New York
  26. Suhm B (1998) Multimodal interactive error recovery for non-conversational speech user interfaces. Ph.D. thesis, Fredericiana University, Shaker Verlag
  27. Valstar M (2019) Multimodal databases. In: Oviatt SL, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 3: language processing, software, commercialization and emerging directions. Morgan Claypool Publishers, San Rafael
  28. Xiao B, Girand C, Oviatt S (2002) Multimodal integration patterns in children. In: Hansen J, Pellom B (eds) Proceedings of the international conference on spoken language processing (ICSLP’02). Casual Prod. Ltd, Denver, pp 629–632
  29. Zhou J, Yu K, Chen F, Wang Y, Arshad S (2018) Multimodal behavioral and physiological signals as indicators of cognitive load. In: Oviatt S, Schuller B, Cohen P, Sonntag D, Potamianos G, Krueger A (eds) The handbook of multimodal-multisensor interfaces, volume 2: signal processing, architectures, and detection of emotion and cognition. Morgan Claypool Publishers, San Rafael

Cited by

See all 12

Metadata

Authors
Oviatt, S.
Affiliations
Monash University (AU)
Corresponding author
Oviatt, Sharon
Venue
Handbook of Human Computer Interaction
Published
2022
Pages
1-29
OpenAlex
W4225880986
Cited by
12
References
62
Citations by year
2026: 1 · 2025: 6 · 2024: 2 · 2023: 3
FWCI
15.99
Type
book chapter
Language
en
Open access
closed
Licence
Locations
Springer eBooks (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
Keywords
mobile devices, cognitive foundations, language processing, multimodal learning, deep learning, physiological sensing, behavioral analytics, deception detection, neurodegenerative disease detection, privacy, explainability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Multimodal Interaction, Interfaces, and Analytics. https://app.cochat.ai/papers/10.1007/978-3-319-27648-9_22-1
The paper
Oviatt, S. (2022). Multimodal Interaction, Interfaces, and Analytics. Handbook of Human Computer Interaction. https://doi.org/10.1007/978-3-319-27648-9_22-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.