Comparison and Evaluation of Sonification Strategies for Guidance Tasks
Open accessThe DOI matches its Crossref record; 45 of the 52 references it cites were found in a registry or an index.
Abstract
This paper aims to reveal the efficiency of sonification strategies in terms of rapidity, precision, and overshooting in the case of a one-dimensional guidance task. The sonification strategies are based on the four main perceptual attributes of a sound (pitch, loudness, duration/tempo, and timbre) and classified with respect to the presence or not of one or several auditory references. Perceptual evaluations are used to display the strategies in a precision/rapidity space and enable prediction of user behavior for a chosen sonification strategy. The evaluation of sonification strategies constitutes a first step toward general guidelines for sound design in interactive multimedia systems that involve guidance issues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S. (1990) · The MIT Press eBooks · doi:10.7551/mitpress/1486.001.0001 · Cited by 3,284
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S., & McAdams, S. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408434 · Cited by 3,029
An Introduction to the Psychology of Hearing: Fourth Edition
Moore, B. (1997) · BRILL eBooks · doi:10.1163/9789004658820 · Cited by 2,646
Psychoacoustics: facts and models
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5706 · Cited by 2,402
Spatial hearing: the psychophysics of human sound localization
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0346 · Cited by 2,304
When the brain plays music: auditory–motor interactions in music perception and production
Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2152 · Cited by 1,754 · cited 1×
“In addition, due to the strong relationship that exists between the auditory and sensorimotor systems [16], [17], it is also a valuable tool for applications that involve perception of one’s own body motion.”
Background3-D sound for virtual reality and multimedia
Madole, D., & Begault, D. (1995) · Computer Music Journal · doi:10.2307/3680997 · Cited by 868 · cited 1×
“It consists in using the natural abilities of the hearing system to locate the target position by virtually rendering its position through stereophony or virtual auditory display (such as 3-D binaural rendering) [22].”
BackgroundA Matlab Toolbox for Music Information Retrieval
Lartillot, O., Toiviainen, P., & Eerola, T. (2008) · Studies in Classification, Data Analysis, and Knowledge Organization · doi:10.1007/978-3-540-78246-9_31 · Cited by 472
Stevens, S. S. (1955) · The Journal of the Acoustical Society of America · doi:10.1121/1.1908048 · Cited by 467
Frequency discrimination as a function of frequency and sensation level
Wier, C. C., Jesteadt, W., & Green, D. M. (1977) · The Journal of the Acoustical Society of America · doi:10.1121/1.381251 · Cited by 379 · cited 1×
“Considering the protocol of this experiment this resolution was of the same order of magnitude as the perceptible threshold for frequency variations below 500 Hz (equal to 2 Hz according to [38] or to 1 Hz according to [39]).”
BackgroundNavigation system for the blind: Auditory display modes and guidance
Loomis, J. M., Golledge, R. G., & Klatzky, R. L. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565677 · Cited by 366 · cited 2×
“Most electronic travel aids for visually impaired are based on this paradigm and display guidance information with spatialized auditory icons or earcons [1], [2], [23].”
BackgroundTAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY
Hermann, T. M. (2008) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 331
Sonific ation Report: Status of the Field and Research Agenda
Kramer, G., Walker, B. N., Bonebright, T. L., Cook, P. R., & Flowers, J. H. (2010) · Lincoln (University of Nebraska) · Cited by 315
Thinking in SoundThe Cognitive Psychology of Human Audition
McAdams, S., & Bigand, E. (1993) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198522577.001.0001 · Cited by 300
A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities
Dubus, G., & Bresin, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082491 · Cited by 272 · cited 2×
“As per the description introduced in [30], sound parameters from pitch-related, temporal, loudness-related, and timbral categories were investigated.”
BackgroundLearning and Generalization of Auditory Temporal–Interval Discrimination in Humans
Wright, B. A., Buonomano, D. V., Mahncke, H. W., & Merzenich, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-10-03956.1997 · Cited by 255 · cited 1×
“This value is in line with the literature (for a 1000 Hz sine wave) that gives a just noticeable variation of 1.54 ms at 67 ms [40] and of 12.5 ms at 50 ms [41].”
ResultInfluentialPreference for Sensory Consonance in 2- and 4-Month-Old Infants
Trainor, L. J., Tsang, C. D., & Cheung, V. H. W. (2002) · Music Perception · doi:10.1525/mp.2002.20.2.187 · Cited by 238 · cited 1×
“the notion of reference can be addressed as an implicit perceptual reference such as the inharmonicity [29] (the sound is harmonic on the target and becomes increasingly”
BackgroundSWAN: System for Wearable Audio Navigation
Wilson, J., Walker, B. N., Lindsay, J., Cambias, C., & Dellaert, F. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373786 · Cited by 200 · cited 2×
“Most electronic travel aids for visually impaired are based on this paradigm and display guidance information with spatialized auditory icons or earcons [1], [2], [23].”
BackgroundFletcher, H., Blackham, E. D., & Stratton, R. (1962) · The Journal of the Acoustical Society of America · doi:10.1121/1.1918192 · Cited by 178 · cited 1×
“, range of values observed in piano strings [37]).”
BackgroundMovement Sonification: Effects on Perception and Action
Effenberg, A. O. (2005) · IEEE Multimedia · doi:10.1109/mmul.2005.31 · Cited by 177 · cited 1×
“This process is called interactive sonification [18], [19] and has been shown to be very effective, for example, in enhancing the performance of the human perceptual system in the field of motor control and motor learning [20] or in enhancing 3-D navigation in virtual environments [21].”
BackgroundBarrass, S. (1997) · ANU Open Research (Australian National University) · doi:10.25911/5d7a2acd2b71d · Cited by 141
Synthesis by Spectral Amplitude and "Brightness" Matching of Analyzed Musical Instrument Tones
Beauchamp, J. W. (1982) · Journal of the Audio Engineering Society · Cited by 123
Guest Editors' Introduction: An Introduction to Interactive Sonification
Hermann, T., & Hunt, A. (2005) · IEEE MultiMedia · doi:10.1109/mmul.2005.26 · Cited by 104
Studies on subjective duration
Michon, J. A. (1964) · Acta Psychologica · doi:10.1016/0001-6918(64)90032-0 · Cited by 95 · cited 1×
“This value is in line with the literature (for a 1000 Hz sine wave) that gives a just noticeable variation of 1.54 ms at 67 ms [40] and of 12.5 ms at 50 ms [41].”
ResultInfluentialNavigation with Auditory Cues in a Virtual Environment
Lokki, T., & Gröhn, M. (2005) · IEEE Multimedia · doi:10.1109/mmul.2005.33 · Cited by 90 · cited 1×
“This process is called interactive sonification [18], [19] and has been shown to be very effective, for example, in enhancing the performance of the human perceptual system in the field of motor control and motor learning [20] or in enhancing 3-D navigation in virtual environments [21].”
BackgroundInharmonicity of Plain Wire Piano Strings
Young, R. W. (1952) · The Journal of the Acoustical Society of America · doi:10.1121/1.1906888 · Cited by 76 · cited 2×
“The sound is constructed using a sum of N sine waves whose fundamental frequency is f 0 = 200 Hz and with higher frequencies computed using the inharmonicity formula proposed by Young [36] for the piano: where f k = kf 0 , and b ( x ) is the inharmonicity factor based on the normalized distance x such that b ( x ) var…”
MethodInfluentialCORRECTIVE SONIC FEEDBACK FOR SPEED SKATING: A CASE STUDY
Godbout, A., & Boyd, J. E. (2010) · Cited by 50
Auditory support for resection guidance in navigated liver surgery
Hansen, C., Black, D. A., Lange, C., Rieber, F., Lamadé, W., Donati, M., Oldhafer, K. J., & Hahn, H. K. (2012) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1466 · Cited by 46 · cited 1×
“Meanwhile, a growing number of applications involving the auditory modality to inform or guide users can be found in a large number of domains ranging from pedestrian navigation aid [1], [2], or hand guidance for visually impaired [3], to positional guidance in surgery [4], [5], rehabilitation for patients with disabi…”
BackgroundReaching nearby sources: comparison between real and virtual sound and visual targets
Parseihian, G., Jouffrais, C., & Katz, B. F. G. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00269 · Cited by 45 · cited 1×
“Meanwhile, a growing number of applications involving the auditory modality to inform or guide users can be found in a large number of domains ranging from pedestrian navigation aid [1], [2], or hand guidance for visually impaired [3], to positional guidance in surgery [4], [5], rehabilitation for patients with disabi…”
BackgroundSelf-citationPitch of Pure Tones: Its Relation to Intensity
Terhardt, E. (1974) · Communication and cybernetics · doi:10.1007/978-3-642-65902-7_46 · Cited by 43
Sonification as a possible stroke rehabilitation strategy
Scholz, D. S., Wu, L., Pirzer, J., Schneider, J., Rollnik, J. D., Großbach, M., & Altenmüller, E. O. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00332 · Cited by 38 · cited 4×
“For example, in [7], the authors use two parameters based on frequency variation (e.g. pitch and brightness) to guide the user on a 2D space.”
BackgroundMethodInfluentialMorphocons: A New Sonification Concept Based on Morphological Earcons
Parseihian, G., & Katz, B. F. G. (2012) · HAL · Cited by 34
Self-citationA Percussive Sound Synthesizer Based on Physical and Perceptual Attributes
Aramaki, M., Kronland-Martinet, R., Voinier, T., & Ystad, S. (2006) · Computer Music Journal · doi:10.1162/comj.2006.30.2.32 · Cited by 28 · cited 1×
“Finally, the current study provides relevant information for predicting the user performance with a chosen sonification strategy and constitutes a first step toward general guidelines for mapping data onto auditory display dimensions and toward the identification of efficient perceptual sound structures (which are kno…”
BackgroundSelf-citationA portable audio-biofeedback system to improve postural control
Dozza, M., Chiari, L., & Horak, F. B. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2004.1404328 · Cited by 27 · cited 1×
“Meanwhile, a growing number of applications involving the auditory modality to inform or guide users can be found in a large number of domains ranging from pedestrian navigation aid [1], [2], or hand guidance for visually impaired [3], to positional guidance in surgery [4], [5], rehabilitation for patients with disabi…”
BackgroundUsing psychoacoustical models for information sonification
Ferguson, S., Cabrera, D. A., Beilharz, K., & Song, H. (2006) · OPUS - Open Publications of UTS Scholars (University of Technology Sydney) · Cited by 23
Curve shape and curvature perception through interactive sonification
Alonso, M., Shelley, S., Hermes, D. J., Hollowood, J., Pettitt, M., Sharples, S., & Kohlrausch, A. (2012) · ACM Transactions on Applied Perception · doi:10.1145/2355598.2355600 · Cited by 20 · cited 1×
“As certain works have highlighted, it is indeed possible to apply variations of a perceptual sound parameter to complex sound textures without affecting sonification performances [43].”
BackgroundCho, B., Matsumoto, N., Komune, S., & Hashizume, M. (2014) · BioMed Research International · doi:10.1155/2014/769659 · Cited by 20 · cited 1×
“In [24], for example, three different frequencies (300, 600, and 900 Hz) are used to help the surgeon access the scala tympani without injuring important organs in the complex structure of the temporal bone.”
MethodSurgical Navigation System and Method Using Audio Feedback
Wegner, K. (1998) · Electronic workshops in computing · doi:10.14236/ewic/ad1998.31 · Cited by 17 · cited 2×
“Meanwhile, a growing number of applications involving the auditory modality to inform or guide users can be found in a large number of domains ranging from pedestrian navigation aid [1], [2], or hand guidance for visually impaired [3], to positional guidance in surgery [4], [5], rehabilitation for patients with disabi…”
BackgroundMethodBresin, R., Hermann, T. M., & Hunt, A. (2012) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-012-0095-7 · Cited by 16 · cited 1×
“This process is called interactive sonification [18], [19] and has been shown to be very effective, for example, in enhancing the performance of the human perceptual system in the field of motor control and motor learning [20] or in enhancing 3-D navigation in virtual environments [21].”
BackgroundHigh-level control of sound synthesis for sonification processes
Kronland-Martinet, R., Ystad, S., & Aramaki, M. (2011) · AI & Society · doi:10.1007/s00146-011-0340-8 · Cited by 12
Self-citationThe process of sonification design for guidance tasks
Parseihian, G., Ystad, S., Aramaki, M., & Kronland-Martinet, R. (2015) · Wi Journal of Mobile Media · doi:10.65968/ecfy4936 · Cited by 12 · cited 1×
“The categorization was constructed on the basis of the results of one of our previous studies [27], [28] which firstly introduced the sonification categories and its evaluation and highlighted the need to separate precise, rapid and direct guidance in the instructions.”
MethodSelf-citationModel-based Target Sonification on Mobile Devices
Eslambolchilar, P., Crossan, A., & Murray‐Smith, R. (2004) · Cited by 9
Hunt, A., Hermann, T., Hermann, T., Hunt, A., & Neuhoff, J. G. (2011) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 8
Parseihian, G., Gondre, C., Aramaki, M., Kronland-Martinet, R., & Ystad, S. (2013) · HAL · Cited by 7
Self-citationGames with Sounds: the Blind Navigation and Target Acquisition
Nyman, A. (2005) · Cited by 1
Research works printed but not linked: 1
- gibet, 2009, Sensorimotor control of sound-producing gestures, Musical Gestures Sound Movement and Meaning, 212
Cited by
Hong, J., Pradhan, A., Froehlich, J. E., & Findlater, L. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132538 · Cited by 77
“Audio feedback has also been used to help users reach targets in their peripersonal space [28, 41].”
MethodComparing Non-Visual and Visual Guidance Methods for Narrow Field of View Augmented Reality Displays
Marquardt, A., Trepkowski, C., Eibich, T. D., Maiero, J., Kruijff, E., & Schöning, J. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3023605 · Cited by 63
“Pulse Feedback is inspired by commonly used car parking metaphors that encode distance information through a decreasing time interval between impulse tones [69], but in a vibro-tactile manner.”
BackgroundA Survey of auditory display in image-guided interventions
Black, D., Hansen, C., Nabavi, A., Kikinis, R., & Hahn, H. K. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-017-1547-z · Cited by 45
“Investigations into comparing multiple methods for auditory display for 1-dimensional guidance tasks suggest expanding such evaluations to 2-D and 3-D tasks [33].”
Sonification as a reliable alternative to conventional visual surgical navigation
Matinfar, S., Salehi, M., Suter, D., Seibold, M., Dehghani, S., Navab, N., Wanivenhaus, F., Fürnstahl, P., Farshad, M., & Navab, N. (2023) · Scientific Reports · doi:10.1038/s41598-023-32778-z · Cited by 39
“Further, previous sonification research [46,47,48,49,50,51,52,73] has investigated different sonification strategies for navigation, providing the preliminary basis for further research.”
BackgroundMethodInfluentialSonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis
Roodaki, H., Navab, N., Eslami, A., Stapleton, C. B., & Navab, N. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2734327 · Cited by 37
“In [6] the authors illustrate that sonification strategies which give the users the opportunity to hear a sound that can be compared with the guidance tone, generally achieve higher accuracy but at the cost of longer identification time.”
Background
Metadata
- Authors
- Parseihian, G., Gondre, C., Aramaki, M., Ystad, S., & Kronland-Martinet, R.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2016-04
- Volume
- 18
- Issue
- 4
- Pages
- 674-686
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2299284748
- Semantic Scholar
- 0101c4020ce4a625760d3b931c94fa895a9a097f
- Cited by
- 60
- References
- 52
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 5 · 2023: 6 · 2022: 13 · 2021: 5 · 2020: 6 · 2019: 5 · 2018: 7 · 2017: 7 · 2016: 2
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- HAL (submittedVersion, other-oa)
- Funders
- French National Research Agency (ANR)
- SoniMove: Inform, Guide, and Learn Actions by Sounds (ANR-14-CE24-0018-01)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- sonification, pitch, loudness, timbre, tempo, sound design, interactive multimedia, user behavior prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.