MovEcho: A Gesture-Sound Interface Allowing Blind Manipulations in a Driving Context
The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Most recent vehicles are equipped with touchscreens, which replace arrays of buttons that control secondary driving functions, such as temperature level, strength of ventilation, GPS, or choice of radio stations. While driving, manipulating such interfaces can be problematic in terms of safety, because they require the drivers’ sight. In this article, we develop an innovative interface, MovEcho, which is piloted with gestures and associated with sounds that are used as informational feedback. We compare this interface to a touchscreen in a perceptual experiment that took place in a driving simulator. The results show that MovEcho allows for a better visual task completion related to traffic and is preferred by the participants. These promising results in a simulator condition have to be confirmed in future studies, in a real vehicle with a comparable expertise for both interfaces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in [11] authors showed that using a gesture based sonified interface was challenging at first, but after training, users preferred it to a conventional touch screen in a driving situation as it distracted them less from monitoring the road.”
From Eyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction (2022) · cites this paper as [11]
Citations
Cites
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“The non-overlapping zones were constructed to represent a distance range from the hand, with an identical index of difficulty Id = log2 (1 + D/W ), with D the distance to the target, and W the target width [15, 31].”
BackgroundFitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618 · cited 1×
“During this process, the pitch of the sonification strategy was modified, as previous crossmodal studies have shown a relation between this sound parameter and the vertical position in space [29, 34, 35, 39].”
MethodProceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,432
What in the World Do We Hear?: An Ecological Approach to Auditory Event Perception
Gaver, W. W. (1993) · Ecological Psychology · doi:10.1207/s15326969eco0501_1 · Cited by 903
Effects of visual and cognitive load in real and simulated motorway driving
Engström, J., Johansson, E., & Östlund, J. (2005) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2005.04.012 · Cited by 834
Blueprints for complex learning: The 4C/ID-model
van Merriënboer, J. J. G., Clark, R. E., & de Croock, M. B. M. (2002) · Educational Technology Research and Development · doi:10.1007/bf02504993 · Cited by 708 · cited 1×
“New cognitive schemata are therefore needed to easily manipulate such interfaces [37, 40, 43] and even more to manipulate them in a driving situation.”
BackgroundAssimilating complex information
Pollock, E., Chandler, P., & Sweller, J. (2002) · Learning and Instruction · doi:10.1016/s0959-4752(01)00016-0 · Cited by 692 · cited 1×
“New cognitive schemata are therefore needed to easily manipulate such interfaces [37, 40, 43] and even more to manipulate them in a driving situation.”
BackgroundDingus, T. A., Klauer, S. G., Neale, V. L., Petersen, A., Lee, S. E., Sudweeks, J., Perez, M. A., Hankey, J., Ramsey, D., Gupta, S., et al. (2006) · PsycEXTRA Dataset · doi:10.1037/e624282011-001 · Cited by 681
Designing interaction, not interfaces
Beaudouin-Lafon, M. (2004) · Proceedings of the working conference on Advanced visual interfaces · doi:10.1145/989863.989865 · Cited by 403
Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., & Sodnik, J. (2014) · Sensors · doi:10.3390/s140203702 · Cited by 387
On the Psychophysics of Workload: Why Bother with Subjective Measures?
Gopher, D., & Braune, R. (1984) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088402600504 · Cited by 280
Combining cognitive and visual distraction: Less than the sum of its parts
Liang, Y., & Lee, J. D. (2010) · Accident Analysis & Prevention · doi:10.1016/j.aap.2009.05.001 · Cited by 271
2015 Proceedings of the International Conference on Auditory Display
Metatla, O., Bryan–Kinns, N., Stockman, T., & Martin, F. (2015) · Cited by 234
Mobile phone use—Effects of handheld and handsfree phones on driving performance
Törnros, J. E. B., & Bolling, A. K. (2005) · Accident Analysis & Prevention · doi:10.1016/j.aap.2005.04.007 · Cited by 233
Santos, J. A., Merat, N., Mouta, S. S., Brookhuis, K., & de Waard, D. (2005) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2005.04.001 · Cited by 155
Selecting Performance Measures: "Objective" versus "Subjective" Measurement
Muckler, F. A., & Seven, S. A. (1992) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089203400406 · Cited by 148
Visual Demand of Driving and the Execution of Display-Intensive in-Vehicle Tasks
Tsimhoni, O., & Green, P. (2001) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120104502305 · Cited by 147
Mappings and metaphors in auditory displays: An experimental assessment
Walker, B. N., & Kramer, G. (2005) · ACM Transactions on Applied Perception · doi:10.1145/1101530.1101534 · Cited by 146
Magnitude estimation of conceptual data dimensions for use in sonification.
Walker, B. N. (2002) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.8.4.211 · Cited by 139
Behavioral Foundations of System Development
Arima, J. K., & Meister, D. (1977) · The American Journal of Psychology · doi:10.2307/1422072 · Cited by 95
Bimodal perception of audio-visual material properties for virtual environments
Bonneel, N., Suied, C., Viaud‐Delmon, I., & George Drettakis, B. (2010) · ACM Transactions on Applied Perception · doi:10.1145/1658349.1658350 · Cited by 66
Compatibility effects between sound frequency and tactile elevation
Occelli, V., Spence, C. J., & Zampini, M. (2009) · Neuroreport · doi:10.1097/wnr.0b013e32832b8069 · Cited by 62
Magnitude estimation of conceptual data dimensions for use in sonification.
Walker, B. N. (2002) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.8.4.211 · Cited by 59
Perception of the size and speed of rolling balls by sound
Houben, M. M. J., Kohlrausch, A., & Hermes, D. J. (2004) · Speech Communication · doi:10.1016/j.specom.2004.03.004 · Cited by 49
Data sonification from the desktop: Should sound be part of standard data analysis software?
Flowers, J. H., Buhman, D. C., & Turnage, K. D. (2005) · ACM Transactions on Applied Perception · doi:10.1145/1101530.1101544 · Cited by 49
Analyzing sound tracings: a multimodal approach to music information retrieval
Nymoen, K., Caramiaux, B., Kozak, M., & Tørresen, J. (2011) · International ACM Workshop on Music Information Retrieval with User-Centered and Multimodal Strategies (MIRUM) · doi:10.1145/2072529.2072541 · Cited by 37
Driver queries using wheel-constrained finger pointing and 3-D head-up display visual feedback
Fujimura, K., Xu, L., Tran, C., Bhandari, R., & Ng‐Thow‐Hing, V. (2013) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/2516540.2516551 · Cited by 36
Rising tones and rustling noises: Metaphors in gestural depictions of sounds
Lemaître, G., Scurto, H., Françoise, J., Bevilacqua, F. P., Houix, O., & Susini, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181786 · Cited by 26
User interface for in-vehicle systems with on-wheel finger spreading gestures and head-up displays
Lee, S. H., & Yoon, S.-O. (2020) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwaa052 · Cited by 26
What you see is what you touch
Lauber, F., Follmann, A., & Butz, A. M. (2014) · Designing Interactive Systems Conference · doi:10.1145/2598510.2598521 · Cited by 21
Curve shape and curvature perception through interactive sonification
Alonso, M., Shelley, S., Hermes, D. J., Hollowood, J., Pettitt, M., Sharples, S., & Kohlrausch, A. (2012) · ACM Transactions on Applied Perception · doi:10.1145/2355598.2355600 · Cited by 20
A Synthesis Model With Intuitive Control Capabilities for Rolling Sounds
Conan, S., Derrien, O., Aramaki, M., Ystad, S., & Kronland-Martinet, R. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2327297 · Cited by 20
Self-citationBressolette, B., Denjean, S., Roussarie, V., Aramaki, M., Ystad, S., & Kronland-Martinet, R. (2018) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2017.2721678 · Cited by 10
Self-citationBuchhop, K., Edel, L., Kenaan, S., Raab, U., Böhm, P., & Isemann, D. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3122986.3123001 · Cited by 10
Blind Driving by Means of a Steering-Based Predictor Algorithm
Bazilinskyy, P., Beaumont, C., van der Geest, X., de Jonge, R., van der Kroft, K., & de Winter, J. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60441-1_45 · Cited by 5
Research works printed but not linked: 8
- Mitsuko Aramaki , Charles Gondre , Richard Kronland-Martinet , Thierry Voinier , and Sølvi Ystad . 2010. Imagine the sounds: An intuitive control of an impact sound synthesizer . In Auditory Display (Lecture Notes in Computer Science), Sølvi Ystad, Mitsuko Aramaki, Richard Kronland-Martinet , and Kristoffer Jensen (Eds.). Springer , Berlin , 408–421. Mitsuko Aramaki, Charles Gondre, Richard Kronland-Martinet, Thierry Voinier, and Sølvi Ystad. 2010. Imagine the sounds: An intuitive control of an impact sound synthesizer. In Auditory Display (Lecture Notes in Computer Science), Sølvi Ystad, Mitsuko Aramaki, Richard Kronland-Martinet, and Kristoffer Jensen (Eds.). Springer, Berlin, 408–421.
- Meera M. Blattner , Denise A. Sumikawa , and Robert M . Greenberg . 1989 . Earcons and icons: Their structure and common design principles. Human–Computer Interaction 4, 1 (1989), 11–44. Meera M. Blattner, Denise A. Sumikawa, and Robert M. Greenberg. 1989. Earcons and icons: Their structure and common design principles. Human–Computer Interaction 4, 1 (1989), 11–44.
- Jérémy Danna , Jean-Luc Velay , Vietminh Paz-Villagrán , Annabelle Capel , Céline Petroz , Charles Gondre , Etienne Thoret , Mitsuko Aramaki , Solvi Ystad , and Richard Kronland-Martinet . 2013 . Handwriting movement sonification for the rehabilitation of dysgraphia . In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR’13) . Marseille, France, 200–208. Jérémy Danna, Jean-Luc Velay, Vietminh Paz-Villagrán, Annabelle Capel, Céline Petroz, Charles Gondre, Etienne Thoret, Mitsuko Aramaki, Solvi Ystad, and Richard Kronland-Martinet. 2013. Handwriting movement sonification for the rehabilitation of dysgraphia. In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR’13). Marseille, France, 200–208.
- Thomas Hermann and Helge Ritter . 2005 . Model-based sonification revisited Authors’ comments on Hermann and Ritter , ICAD 2002 . ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 559–563. Thomas Hermann and Helge Ritter. 2005. Model-based sonification revisited Authors’ comments on Hermann and Ritter, ICAD 2002. ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 559–563.
- Gregory Kramer , Bruce Walker , Terri Bonebright , Perry Cook , John H. Flowers , Nadine Miner , and John Neuhoff . 1999 . Sonification report: Status of the field and research agenda . In Proceedings of the International Conference on Auditory Display. Gregory Kramer, Bruce Walker, Terri Bonebright, Perry Cook, John H. Flowers, Nadine Miner, and John Neuhoff. 1999. Sonification report: Status of the field and research agenda. In Proceedings of the International Conference on Auditory Display.
- Carl A. Pickering , Keith J. Burnham , and Michael J. Richardson . 2007. A research study of hand gesture recognition technologies and applications for human vehicle interaction . In Proceedings 3rd Institution of Engineering and Technology Conference on Automotive Electronics. 1–15 . Carl A. Pickering, Keith J. Burnham, and Michael J. Richardson. 2007. A research study of hand gesture recognition technologies and applications for human vehicle interaction. In Proceedings 3rd Institution of Engineering and Technology Conference on Automotive Electronics. 1–15.
- John Sweller , Jeroen J. G. Van Merrienboer , and Fred G. W. C. Paas . 1998 . Cognitive architecture and instructional design. Edu . Psychol. Rev. 10 , 3 (1998), 251 – 296 . John Sweller, Jeroen J. G. Van Merrienboer, and Fred G. W. C. Paas. 1998. Cognitive architecture and instructional design. Edu. Psychol. Rev. 10, 3 (1998), 251–296.
- Bruce N. Walker and Gregory Kramer. 2005. Sonification design and metaphors: Comments on Walker and Kramer , ICAD 1996 . ACM Trans. Appl. Percept. 2, 4 ( Oct. 2005 ), 413–417. Bruce N. Walker and Gregory Kramer. 2005. Sonification design and metaphors: Comments on Walker and Kramer, ICAD 1996. ACM Trans. Appl. Percept. 2, 4 (Oct. 2005), 413–417.
Cited by
Eyes-Off Your Fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction
Bernard, C., Monnoyer, J., Ystad, S., & Wiertlewski, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501872 · Cited by 19
Self-citationPerception of audio-haptic textures for new touchscreen interactions
Bernard, C. (2022) · theses.fr (ABES) · doi:10.70675/d0963081zf56az4742z912fzc25754400706 · Cited by 4
Zhao, S. X., Chong, W. T., Ali, M. A. H., & Xu, X. (2026) · ICT Express · doi:10.1016/j.icte.2026.10.006
Metadata
- Authors
- Bressolette, B., Denjean, S., Roussarie, V., Aramaki, M., Ystad, S., & Kronland-Martinet, R.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- PSA Peugeot Citroën (France) (FR)
- Venue
- ACM Transactions on Applied Perception
- Published
- 2021-07-31
- Volume
- 18
- Issue
- 3
- Pages
- 1-19
- ISSN
- 1544-3558 (ISSN-L)
- 1544-3965
- OpenAlex
- W3195132553
- Cited by
- 3
- References
- 37
- Citations by year
- 2026: 1 · 2022: 2
- FWCI
- 0.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Applied Perception (publishedVersion)
- HAL (submittedVersion)
- Funders
- French National Research Agency under the SoniMove project (ANR-14-CE24-0018-01)
- Openlab PSA-AMU Automotive Motion Lab’ part of the StelLab network
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- gesture-based interfaces, auditory feedback, in-vehicle interfaces, driver distraction, driving simulator, driver preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.