CoChat

How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry

Ansani, Alessandro, Marini, Marco, D’Errico, Francesca, Poggi, Isabella · 2020 · Frontiers in Psychology
Cited by 32

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2020.02242

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 91

  1. Ansani, 2019, ‘You will be judged by the music I hear’: a study on the influence of music on moral judgement., Web Intellig., 1, 53, 10.3233/WEB-190400 · DOI
  2. Asch, 1946, Forming impressions of personality., J. Abnorm. Soc. Psychol., 41, 10.1037/h0055756 · DOI · Paper page
  3. Au, 2003, Mood in foreign exchange trading: Cognitive processes and performance., Organ. Behav. Hum. Decis. Process., 91, 322, 10.1016/S0749-5978(02)00510-1 · DOI
  4. Auer, 2012, When music drives vision: Influences of film music on viewers’ eye movements, Proceeding of the 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
  5. Batson, 1983, Influence of self-reported distress and empathy on egoistic versus altruistic motivation to help., J. Person. Soc. Psychol., 45, 10.1037/0022-3514.45.3.706 · doi:10.1037/0022-3514.45.3.706 · Paper page
  6. Batten, 2018, Looking at sound: sound design and the audiovisual influences on gaze, Seeing into Screens: Eye Tracking the Moving Image, 85
  7. Bolivar, 1994, Semantic and formal congruency in music and motion pictures: effects on the interpretation of visual action., Psychomusicolo. J. Res. Music Cogn., 13, 10.1037/h0094102 · DOI
  8. Boltz, 2001, Musical soundtracks as a schematic influence on the cognitive processing of filmed events., Music Percept., 18, 427, 10.1525/mp.2001.18.4.427 · DOI · Paper page
  9. Boltz, 2004, The cognitive processing of film and musical soundtracks., Mem. Cogn., 32, 1194, 10.3758/BF03196892 · DOI · Paper page
  10. Branigan, 2010, Soundtrack in mind., Projections, 4, 10.3167/proj.2010.040104 · doi:10.3167/proj.2010.040104
  11. Bravo, 2013, The influence of music on the emotional interpretation of visual contexts, From Sounds to Music and Emotions, 366, 10.1007/978-3-642-41248-6_20 · DOI
  12. Breeden, 2017, Gaze data for the analysis of attention in feature films., ACM Trans. Appl. Percept., 14, 1, 10.1145/3127588 · doi:10.1145/3127588
  13. Brodsky, 2001, The effects of music tempo on simulated driving performance and vehicular control., Transp. Res. Part F: Traffic Psychol. Behav., 4, 219, 10.1016/S1369-8478(01)00025-0 · DOI · Paper page
  14. Brône, 2018, Eye-Tracking in Interaction: Studies on the Role of Eye Gaze in Dialogue., 10.1075/ais.10 · doi:10.1075/ais.10
  15. Brown, 2006, How does music work? toward a pragmatics of musical communication, Music and Manipulation, 10.1093/acprof:oso/9780198529361.003.0001 · DOI · Paper page
  16. Brown, 2006, The social uses of background music for personal enhancement, Music and Manipulation: On the Social Uses and Social Control of Music, 126
  17. Bruner, 1990, Music, mood, and marketing., J. Market., 54, 94, 10.1177/002224299005400408 · DOI · Paper page
  18. Bullerjahn, 2005, Musik und bild [music and image], Musikpsychologie, 205
  19. Bullerjahn, 1994, An empirical investigation of effects of film music using qualitative content analysis., Psychomusicology, 13, 99, 10.1037/h0094100 · DOI
  20. Cespedes-Guevara, 2018, Music communicates affects, not basic emotions - a constructionist account of attribution of emotional meanings to music., Front. Psychol., 9, 10.3389/fpsyg.2018.00215 · DOI
  21. Cohen, 2001, Music as a source of emotion in film, Series in Affective Science. Music and Emotion: Theory and Research, 249
  22. Cohen, 2013, Congruence-association model of music and multimedia: Origin and evolution, The psychology of Music in Multimedia, 17, 10.1093/acprof:oso/9780199608157.003.0002 · DOI
  23. Coutrot, 2012, Influence of soundtrack on eye movements during video exploration., J. Eye Mov. Res., 5, 1, 10.16910/jemr.5.4.2 · DOI
  24. Dixon, 2007, An empirical investigation of music and gambling behaviour., Intern. Gambl. Stud., 7, 315, 10.1080/14459790701601471 · DOI
  25. Duras, 1981, L’homme Atlantique.
  26. Edworthy, 2006, The effects of music tempo and loudness level on treadmill exercise., Ergonomics, 49, 1597, 10.1080/00140130600899104 · DOI · Paper page
  27. Eerola, 2013, Emotional expression in music: contribution, linearity, and additivity of primary musical cues., Front. Psychol., 4, 10.3389/fpsyg.2013.00487 · DOI · Paper page
  28. Ezell, 2012, Affective, Attitudinal, and Cognitive Responses to Music in Modern US Political Advertising.
  29. Fabian, 2003, Expressive devices and perceived musical character in 34 performances of variation 7 from bach’s goldbergvariations., Mus. Sci., 7, 49, 10.1177/10298649040070s103 · doi:10.1177/10298649040070s103
  30. Fernández-Sotos, 2016, Influence of tempo and rhythmic unit in musical emotion regulation., Front. Comput. Neurosci., 10, 10.3389/fncom.2016.00080 · DOI
  31. Fraser, 2013, Music to your brain: background music changes are processed first, reducing ad message recall: MUSIC TO YOUR BRAIN., Psychol. Market., 30, 62, 10.1002/mar.20580 · DOI
  32. Furnham, 2002, Music is as distracting as noise: the differential distraction of background music and noise on the cognitive test performance of introverts and extraverts., Ergonomics, 45, 203, 10.1080/00140130210121932 · DOI · Paper page
  33. Grimm, 2010, Toward a recommendation for a European standard of peak and LKFS loudness levels., SMPTE Mot. Imag. J., 119, 28, 10.5594/j11396 · doi:10.5594/j11396
  34. Hailstone, 2009, It’s not what you play, it’s how you play it: timbre affects perception of emotion in music., Q. J. Exper. Psychol., 62, 2141, 10.1080/17470210902765957 · DOI
  35. Herget, 2019, On music’s potential to convey meaning in film: a systematic review of empirical evidence., Psychol. Music, 2019, 10.1177/0305735619835019 · DOI · Paper page
  36. Herget, 2018, Development and testing of an instrument to determine musical Fit in audio-visual advertising., Mus. Sci., 22, 362, 10.1177/1029864917731127 · doi:10.1177/1029864917731127
  37. Hoeckner, 2011, Film music influences how viewers relate to movie characters., Psychol. Aesthet. Creat. Arts, 5, 146, 10.1037/a0021544 · DOI
  38. Huron, 1989, Music in advertising: an analytic paradigm., Mus. Q., 73, 557, 10.1093/mq/73.4.557 · doi:10.1093/mq/73.4.557
  39. iMotions Biometric Research Platform
  40. Israel, 2019, Stop the music?: the effect of music on risky financial decisions: an experimental study., SSRN Electron. J., 42, 10.2139/ssrn.3318151 · doi:10.2139/ssrn.3318151
  41. Iwamiya, 1997, Interaction between auditory and visual processing in car audio: Simulation experiment using video reproduction., Appl. Hum. Sci., 16, 115, 10.2114/jpa.16.115 · doi:10.2114/jpa.16.115
  42. Jones, 1972, Attribution: Perceiving the Causes of Behavior.
  43. Juslin, 2004, Expression, perception, and induction of musical emotions: a review and a questionnaire study of everyday listening., J. New Music Res., 33, 217, 10.1080/0929821042000317813 · DOI · Paper page
  44. Kahneman, 1973, Attention and Effort.
  45. Kallinen, 2002, Reading news from a pocket computer in a distracting environment: effects of the tempo of background music., Comput. Hum. Behav., 18, 537, 10.1016/S0747-5632(02)00005-5 · DOI
  46. Karim, 2011, International positive and negative affect schedule short-form (I-PANAS-SF): testing for factorial invariance across cultures., Proc. Soc. Behav. Sci., 15, 2016, 10.1016/j.sbspro.2011.04.046 · DOI · Paper page
  47. Killmeier, 2004, Wolves at the door: musical persuasion in a 2004 Bush-Cheney campaign advertisement., MedieKultur J. Med. Commun. Res., 27, 10.7146/mediekultur.v27i50.2857 · DOI
  48. Kret, 2019, Preprocessing pupil size data: guidelines and code., Behav. Res. Methods, 51, 1336, 10.3758/s13428-018-1075-y · DOI · Paper page
  49. Kruger, 2012, Making meaning in AVT: eye tracking and viewer construction of narrative., Perspectives, 20, 67, 10.1080/0907676X.2011.632688 · DOI
  50. Lang, 2011, Short assessment of the big five: robust across survey methods except telephone interviewing., Behav. Res. Methods, 43, 548, 10.3758/s13428-011-0066-z · DOI · Paper page
  51. Lehmann, 2017, The influence of background music on learning in the light of different theoretical perspectives and the role of working memory capacity., Front. Psychol., 8, 10.3389/fncom.2016.01902 · doi:10.3389/fncom.2016.01902
  52. Lemercier, 2014, Pupillometry of taste: Methodological guide-from acquisition to data processing-and toolbox for MATLAB, Quantitative Methods for Psychology, 179, 10.20982/tqmp.10.2.p179 · DOI · Paper page
  53. Leone, 2008, Empatia e Costi Psicologici Dell’aiuto’, La Mente Del Cuore, Le Emozioni Nel Lavoro Nella Scuola Nella Vita.
  54. Lesiuk, 2005, The effect of music listening on work performance., Psychol. Music, 33, 173, 10.1177/0305735605050650 · DOI · Paper page
  55. Marshall, 1988, Effects of musical soundtracks on attitudes toward animated geometric figures., Music Percept., 6, 95, 10.2307/40285417 · DOI
  56. Mathôt, 2018, Pupillometry: psychology, physiology, and function., J. Cogn., 1, 10.5334/joc.18 · DOI · Paper page
  57. Mentzoni, 2014, Type of musical soundtrack affects behavior in gambling., J. Behav. Addict., 3, 102, 10.1556/JBA.3.2014.006 · DOI
  58. Mera, 2014, Eye-tracking film music., Music Mov. Image, 7, 10.5406/musimoviimag.7.3.0003 · DOI
  59. Michon, 2004, The interaction effect of background music and ambient scent on the perception of service quality., J. Bus. Res., 34, 191
  60. Nelson, 1997, Video Rhetorics: Televised Advertising in American Politics
  61. Neumann, 2015, Measures of Empathy, Measures of Personality and Social Psychological Constructs, 257, 10.1016/B978-0-12-386915-9.00010-3 · DOI
  62. Nguyen, 2017, Mind your music: the effects of music-induced mood and arousal across different memory tasks., Psychomusicology, 27, 81, 10.1037/pmu0000178 · DOI
  63. Oakes, 2007, Evaluating empirical research into music in advertising: a congruity perspective., J. Advert. Res., 47, 38, 10.2501/s0021849907070055 · DOI
  64. Pisciottano, 2019, Effetti Della Musica Sull’interpretazione di Stimoli Visivi.
  65. Quinto, 2014, The contributions of compositional structure and performance expression to the communication of emotion in music., Psychol. Music, 42, 503, 10.1177/0305735613482023 · DOI
  66. Rogers, 2012, Audiovisual coalescence: the effect of synchrony in film score, Proceedings of the 9th International Symposium on Computer Modeling and Retrieval
  67. Salvucci, 2007, iPod distraction: effects of portable music-player use on driver performance, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 10.1145/1240624.1240665 · DOI
  68. Scherer, 2015, Comparing the acoustic expression of emotion in the speaking and the singing voice., Comput. Speech Lang., 29, 218, 10.1016/j.csl.2013.10.002 · DOI
  69. Shevy, 2007, The mood of rock music affects evaluation of video elements differing in valence and dominance., Psychomusicology, 19, 57, 10.1037/h0094034 · doi:10.1037/h0094034
  70. Shevy, 2013, Music in television advertising and other persuasive media, The Psychology of Music in Multimedia, 311
  71. Sirois, 2014, Pupillometry., Wiley Interdiscipl. Rev., 5, 679, 10.1002/wcs.1323 · DOI · Paper page
  72. Smith, 2013, Watching you watch movies: using eye tracking to inform cognitive film theory, Psychocinematics: Exploring Cognition at the Movies, 165, 10.1093/acprof:oso/9780199862139.003.0009 · DOI · Paper page
  73. Smith, 2014, Audiovisual correspondences in sergei eisenstein’s alexander nevsky: a case study in viewer attention, Cognitive Media Theory, 85
  74. Steffens, 2020, The influence of film music on moral judgments of movie scenes and felt emotions., Psychol. Music, 48, 3, 10.1177/0305735618779443 · DOI
  75. Tagg, 2006, Music, moving images, semiotics, and the democratic right to know., Music Manipul. Soc. Uses Soc. Contr. Music, 21, 163
  76. Tagg, 2013, Music’s Meanings: A Modern Musicology for Non-Musos.
  77. Tan, 2007, Viewers’ interpretations of film characters’ emotions: effects of presenting film music before or after a character is shown., Music Percept., 25, 135, 10.1525/mp.2007.25.2.135 · DOI
  78. Taylor, 2017, Investigating the influence of music training on verbal memory., Psychol. Music, 45, 814, 10.1177/0305735617690246 · DOI
  79. Västfjäll, 2001, Emotion induction through music: a review of the musical mood induction procedure., Mus. Sci., 5, 173, 10.1177/10298649020050S107 · DOI · Paper page
  80. Vitouch, 2001, When your ear sets the stage: musical context effects in film perception., Psychol. Music, 29, 70, 10.1177/0305735601291005 · DOI
  81. Wallengren, 2015, Film music and visual attention: a pilot experiment using eye-tracking., Music Mov. Image, 8, 69, 10.5406/musimoviimag.8.2.0069 · doi:10.5406/musimoviimag.8.2.0069
  82. Wallengren, 2018, Into the film with music: measuring eyeblinks to explore the role of film music in emotional arousal and narrative transportation, Seeing into Screens: Eye Tracking and the Moving Image, 65
  83. Wedel, 2017, A review of eye-tracking research in marketing, Review of Marketing Research, 123, 10.4324/9781351550932-5 · doi:10.4324/9781351550932-5
  84. Wöllner, 2018, The impact of music and stretched time on pupillary responses and eye movements in slow-motion film scenes., J. Eye Mov. Res., 11, 10.16910/jemr.11.2.10 · DOI
  85. Woloszyn, 2012, Memory for facial expression is influenced by the background music playing during study., Adv. Cogn. Psychol., 8, 10.5709/acp-0118-9 · DOI
  86. Wu, 2014, The correspondence of music emotion and timbre in sustained musical instrument sounds., J. Audio Eng. Soc., 62, 663, 10.17743/jaes.2014.0037 · doi:10.17743/jaes.2014.0037
  87. Yamasaki, 2015, Viewing the world through the prism of music: Effects of music on perceptions of the environment., Psychol. Music, 43, 61, 10.1177/0305735613493954 · DOI
  88. Zabalbeascoa, 2008, The nature of the audiovisual text and its parameters., Didact. Audiovis. Transl., 7, 21, 10.1075/btl.77.05zab · doi:10.1075/btl.77.05zab
  89. Ziv, 2015, Music and compliance: can good music make us do bad things?, Psychol. Music, 14
  90. Ziv, 2006, The effect of ‘sad’ and ‘happy’ background music on the interpretation of a story in 5 to 6-year-old children., Br. J. Music Educ., 23, 10.1017/S0265051706007078 · DOI
  91. Ziv, 2012, Music and moral judgment: the effect of background music on the evaluation of ads promoting unethical behavior., Psychol. Music, 40, 738, 10.1177/0305735611406579 · DOI

Metadata

Authors
Ansani, A., Marini, M., D’Errico, F., & Poggi, I.
Venue
Frontiers in Psychology
Published
2020-10-07
Volume
11
ISSN
1664-1078
Cited by
32
References
4
Funders
Ministero dell’Istruzione, dell’Università e della Ricerca (2015WXBPYK)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.