The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
A design space for multimodal systems: concurrent processing and data fusion
Abstract
Multimodal interaction enables the user to employ different modalities such as voice, gesture and typing for communicating with a computer. This paper presents an analysis of the integration of multiple communication modalities within an interactive system. To do so, a software engineering perspective is adopted. First, the notion of “multimodal system” is clarified. We aim at proving that two main features of a multimodal system are the concurrency of processing and the fusion of input/output data. On the basis of these two features, we then propose a design space and a method for classifying multimodal systems. In the last section, we present a software architecture model of multimodal systems which supports these two salient properties: concurrency of processing and data fusion. Two multimodal systems developed in our team, VoicePaint and NoteBook, are used to illustrate the discussion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Computer graphics: principles and practice
(2014) · Choice Reviews Online · doi:10.5860/choice.51-2713 · Cited by 4,651
The human factors of computer graphics interaction techniques
Foley, J. D., Wallace, V. L., & Chan, P. (1984) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.1984.6429355 · Cited by 478
A morphological analysis of the design space of input devices
Card, S. K., Mackinlay, J. D., & Robertson, G. G. (1991) · ACM Transactions on Information Systems · doi:10.1145/123078.128726 · Cited by 337 · cited 1×
“[8], are based on physical properties (such as motion and pressure), the data that a device returns (discrete or continuous) and the dimensions of input a device provides.”
BackgroundLexical and pragmatic considerations of input structures
Buxton, W. (1983) · ACM SIGGRAPH Computer Graphics · doi:10.1145/988584.988586 · Cited by 267
Hill, R. D. (1986) · ACM Transactions on Graphics · doi:10.1145/24054.24055 · Cited by 188
Speech and gestures for graphic image manipulation
Hauptmann, A. G. (1989) · Proceedings of the SIGCHI conference on Human factors in computing systems Wings for the mind - CHI '89 · doi:10.1145/67449.67496 · Cited by 168
Chalfonte, B. L., Fish, R., & Kraut, R. E. (1991) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/108844.108848 · Cited by 116
The Design Space of Interfaces
Frohlich, D. M. (1992) · Springer eBooks · doi:10.1007/978-3-642-77331-0_5 · Cited by 30
CHI'90 workshop on multimedia and multimodal interface design
Blattner, M. M., & Dannenberg, R. B. (1990) · ACM SIGCHI Bulletin · doi:10.1145/122475.122486 · Cited by 20
Cited by
Multimodal human–computer interaction: A survey
Jaimes, A., & Sebe, N. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.019 · Cited by 965
Multimodal interaction: A review
Turk, M. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.07.003 · Cited by 496
Multimodal Video Indexing: A Review of the State-of-the-art
Snoek, C. G. M., & Worring, M. (2005) · Multimedia Tools and Applications · doi:10.1023/b:mtap.0000046380.27575.a5 · Cited by 486
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Dumas, B., Lalanne, D., & Oviatt, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-00437-7_1 · Cited by 305
An argument for design space reflection
Dove, G., Hansen, N. B., & Halskov, K. (2016) · Proceedings of the 9th Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971528 · Cited by 46
Metadata
- Authors
- Nigay, L., & Coutaz, J.
- Venue
- Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93
- Publisher
- ACM Press
- Published
- 1993
- Pages
- 172-178
- OpenAlex
- W2000885980
- Cited by
- 312
- References
- 9
- FWCI
- 11.42
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A design space for multimodal systems: concurrent processing and data fusion. https://app.cochat.ai/papers/10.1145/169059.169143
- The paper
- Nigay, L., & Coutaz, J. (1993). A design space for multimodal systems: concurrent processing and data fusion. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93. https://doi.org/10.1145/169059.169143
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.