MovEcho: A Gesture-Sound Interface Allowing Blind Manipulations in a Driving Context
The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Most recent vehicles are equipped with touchscreens, which replace arrays of buttons that control secondary driving functions, such as temperature level, strength of ventilation, GPS, or choice of radio stations. While driving, manipulating such interfaces can be problematic in terms of safety, because they require the drivers’ sight. In this article, we develop an innovative interface, MovEcho, which is piloted with gestures and associated with sounds that are used as informational feedback. We compare this interface to a touchscreen in a perceptual experiment that took place in a driving simulator. The results show that MovEcho allows for a better visual task completion related to traffic and is preferred by the participants. These promising results in a simulator condition have to be confirmed in future studies, in a real vehicle with a comparable expertise for both interfaces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in [11] authors showed that using a gesture based sonified interface was challenging at first, but after training, users preferred it to a conventional touch screen in a driving situation as it distracted them less from monitoring the road.”
From Eyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction (2022) · cites this paper as [11]
Citations
Cites
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“The non-overlapping zones were constructed to represent a distance range from the hand, with an identical index of difficulty Id = log2 (1 + D/W ), with D the distance to the target, and W the target width [15, 31].”
BackgroundFitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637 · cited 1×
“The non-overlapping zones were constructed to represent a distance range from the hand, with an identical index of difficulty Id = log2 (1 + D/W ), with D the distance to the target, and W the target width [15, 31].”
BackgroundCrossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618 · cited 1×
“During this process, the pitch of the sonification strategy was modified, as previous crossmodal studies have shown a relation between this sound parameter and the vertical position in space [29, 34, 35, 39].”
MethodProceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,432
What in the World Do We Hear?: An Ecological Approach to Auditory Event Perception
Gaver, W. W. (1993) · Ecological Psychology · doi:10.1207/s15326969eco0501_1 · Cited by 903
Effects of visual and cognitive load in real and simulated motorway driving
Engström, J., Johansson, E., & Östlund, J. (2005) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2005.04.012 · Cited by 834
Blueprints for complex learning: The 4C/ID-model
van Merriënboer, J. J. G., Clark, R. E., & de Croock, M. B. M. (2002) · Educational Technology Research and Development · doi:10.1007/bf02504993 · Cited by 708 · cited 1×
“New cognitive schemata are therefore needed to easily manipulate such interfaces [37, 40, 43] and even more to manipulate them in a driving situation.”
BackgroundAssimilating complex information
Pollock, E., Chandler, P., & Sweller, J. (2002) · Learning and Instruction · doi:10.1016/s0959-4752(01)00016-0 · Cited by 692 · cited 1×
“New cognitive schemata are therefore needed to easily manipulate such interfaces [37, 40, 43] and even more to manipulate them in a driving situation.”
BackgroundDingus, T. A., Klauer, S. G., Neale, V. L., Petersen, A., Lee, S. E., Sudweeks, J., Perez, M. A., Hankey, J., Ramsey, D., Gupta, S., et al. (2006) · PsycEXTRA Dataset · doi:10.1037/e624282011-001 · Cited by 681
Research works printed but not linked: 8
- Mitsuko Aramaki , Charles Gondre , Richard Kronland-Martinet , Thierry Voinier , and Sølvi Ystad . 2010. Imagine the sounds: An intuitive control of an impact sound synthesizer . In Auditory Display (Lecture Notes in Computer Science), Sølvi Ystad, Mitsuko Aramaki, Richard Kronland-Martinet , and Kristoffer Jensen (Eds.). Springer , Berlin , 408–421. Mitsuko Aramaki, Charles Gondre, Richard Kronland-Martinet, Thierry Voinier, and Sølvi Ystad. 2010. Imagine the sounds: An intuitive control of an impact sound synthesizer. In Auditory Display (Lecture Notes in Computer Science), Sølvi Ystad, Mitsuko Aramaki, Richard Kronland-Martinet, and Kristoffer Jensen (Eds.). Springer, Berlin, 408–421.
- Meera M. Blattner , Denise A. Sumikawa , and Robert M . Greenberg . 1989 . Earcons and icons: Their structure and common design principles. Human–Computer Interaction 4, 1 (1989), 11–44. Meera M. Blattner, Denise A. Sumikawa, and Robert M. Greenberg. 1989. Earcons and icons: Their structure and common design principles. Human–Computer Interaction 4, 1 (1989), 11–44.
- Jérémy Danna , Jean-Luc Velay , Vietminh Paz-Villagrán , Annabelle Capel , Céline Petroz , Charles Gondre , Etienne Thoret , Mitsuko Aramaki , Solvi Ystad , and Richard Kronland-Martinet . 2013 . Handwriting movement sonification for the rehabilitation of dysgraphia . In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR’13) . Marseille, France, 200–208. Jérémy Danna, Jean-Luc Velay, Vietminh Paz-Villagrán, Annabelle Capel, Céline Petroz, Charles Gondre, Etienne Thoret, Mitsuko Aramaki, Solvi Ystad, and Richard Kronland-Martinet. 2013. Handwriting movement sonification for the rehabilitation of dysgraphia. In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR’13). Marseille, France, 200–208.
- Thomas Hermann and Helge Ritter . 2005 . Model-based sonification revisited Authors’ comments on Hermann and Ritter , ICAD 2002 . ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 559–563. Thomas Hermann and Helge Ritter. 2005. Model-based sonification revisited Authors’ comments on Hermann and Ritter, ICAD 2002. ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 559–563.
- Gregory Kramer , Bruce Walker , Terri Bonebright , Perry Cook , John H. Flowers , Nadine Miner , and John Neuhoff . 1999 . Sonification report: Status of the field and research agenda . In Proceedings of the International Conference on Auditory Display. Gregory Kramer, Bruce Walker, Terri Bonebright, Perry Cook, John H. Flowers, Nadine Miner, and John Neuhoff. 1999. Sonification report: Status of the field and research agenda. In Proceedings of the International Conference on Auditory Display.
- Carl A. Pickering , Keith J. Burnham , and Michael J. Richardson . 2007. A research study of hand gesture recognition technologies and applications for human vehicle interaction . In Proceedings 3rd Institution of Engineering and Technology Conference on Automotive Electronics. 1–15 . Carl A. Pickering, Keith J. Burnham, and Michael J. Richardson. 2007. A research study of hand gesture recognition technologies and applications for human vehicle interaction. In Proceedings 3rd Institution of Engineering and Technology Conference on Automotive Electronics. 1–15.
- John Sweller , Jeroen J. G. Van Merrienboer , and Fred G. W. C. Paas . 1998 . Cognitive architecture and instructional design. Edu . Psychol. Rev. 10 , 3 (1998), 251 – 296 . John Sweller, Jeroen J. G. Van Merrienboer, and Fred G. W. C. Paas. 1998. Cognitive architecture and instructional design. Edu. Psychol. Rev. 10, 3 (1998), 251–296.
- Bruce N. Walker and Gregory Kramer. 2005. Sonification design and metaphors: Comments on Walker and Kramer , ICAD 1996 . ACM Trans. Appl. Percept. 2, 4 ( Oct. 2005 ), 413–417. Bruce N. Walker and Gregory Kramer. 2005. Sonification design and metaphors: Comments on Walker and Kramer, ICAD 1996. ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 413–417.
Cited by
Eyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction
Bernard, C., Monnoyer, J., Ystad, S., & Wiertlewski, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501872 · Cited by 19
Self-citationPerception of audio-haptic textures for new touchscreen interactions
Bernard, C. (2022) · theses.fr (ABES) · doi:10.70675/d0963081zf56az4742z912fzc25754400706 · Cited by 4
Zhao, S. X., Chong, W. T., Ali, M. A. H., & Xu, X. (2026) · ICT Express · doi:10.1016/j.icte.2026.10.006
Metadata
- Authors
- Bressolette, B., Denjean, S., Roussarie, V., Aramaki, M., Ystad, S., & Kronland-Martinet, R.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- PSA Peugeot Citroën (France) (FR)
- Venue
- ACM Transactions on Applied Perception
- Published
- 2021-07-31
- Volume
- 18
- Issue
- 3
- Pages
- 1-19
- ISSN
- 1544-3558 (ISSN-L)
- 1544-3965
- OpenAlex
- W3195132553
- Cited by
- 3
- References
- 37
- Citations by year
- 2026: 1 · 2022: 2
- FWCI
- 0.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Applied Perception (publishedVersion)
- HAL (submittedVersion)
- Funders
- French National Research Agency under the SoniMove project (ANR-14-CE24-0018-01)
- Openlab PSA-AMU Automotive Motion Lab’ part of the StelLab network
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- gesture-based interfaces, auditory feedback, in-vehicle interfaces, driver distraction, driving simulator, driver preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.