How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Uses of music in everyday life.
North, A. C., Hargreaves, D. J., & Hargreaves, J. J. (2004) · Music Perception · doi:10.1525/mp.2004.22.1.41 · Cited by 663 · cited 2×
“…Gibson, 2012) and, most of all, congruity to what is stated and depicted (i.e., visual information) by the main message, whether movies or advertising (Bolivar et al., 1994; Boltz, 2004; North, 2004; Oakes, 2007; Herget et al., 2018), as stated by the CongruenceAssociation Model by Cohen (2013).”
BackgroundThe impact of background music on adult listeners: A meta-analysis
Kämpfe, J., Sedlmeier, P., & Renkewitz, F. (2011) · Psychology of Music · doi:10.1177/0305735610376261 · Cited by 285
Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
Kosch, T., Hassib, M., Woźniak, P. W., Buschek, D., & Alt, F. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174010 · Cited by 79
Noseworthy, T. J., & Finlay, K. (2009) · Journal of Gambling Studies · doi:10.1007/s10899-009-9136-x · Cited by 57 · cited 1×
“…decreases in reading performance, being a source of distraction during cognitive tasks per se (Furnham and Strbac, 2002; Kallinen, 2002; Salvucci et al., 2007) or depending on its tempo (Mentzoni et al., 2014; Nguyen and Grahn, 2017; Israel et al., 2019) or its volume (Noseworthy and Finlay, 2009).”
Background
Research works printed but not linked: 91
- Ansani, 2019, ‘You will be judged by the music I hear’: a study on the influence of music on moral judgement., Web Intellig., 1, 53, 10.3233/WEB-190400 · DOI
- Asch, 1946, Forming impressions of personality., J. Abnorm. Soc. Psychol., 41, 10.1037/h0055756 · DOI · Paper page
- Au, 2003, Mood in foreign exchange trading: Cognitive processes and performance., Organ. Behav. Hum. Decis. Process., 91, 322, 10.1016/S0749-5978(02)00510-1 · DOI
- Auer, 2012, When music drives vision: Influences of film music on viewers’ eye movements, Proceeding of the 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
- Batson, 1983, Influence of self-reported distress and empathy on egoistic versus altruistic motivation to help., J. Person. Soc. Psychol., 45, 10.1037/0022-3514.45.3.706 · doi:10.1037/0022-3514.45.3.706 · Paper page
- Batten, 2018, Looking at sound: sound design and the audiovisual influences on gaze, Seeing into Screens: Eye Tracking the Moving Image, 85
- Bolivar, 1994, Semantic and formal congruency in music and motion pictures: effects on the interpretation of visual action., Psychomusicolo. J. Res. Music Cogn., 13, 10.1037/h0094102 · DOI
- Boltz, 2001, Musical soundtracks as a schematic influence on the cognitive processing of filmed events., Music Percept., 18, 427, 10.1525/mp.2001.18.4.427 · DOI · Paper page
- Boltz, 2004, The cognitive processing of film and musical soundtracks., Mem. Cogn., 32, 1194, 10.3758/BF03196892 · DOI · Paper page
- Branigan, 2010, Soundtrack in mind., Projections, 4, 10.3167/proj.2010.040104 · doi:10.3167/proj.2010.040104
- Bravo, 2013, The influence of music on the emotional interpretation of visual contexts, From Sounds to Music and Emotions, 366, 10.1007/978-3-642-41248-6_20 · DOI
- Breeden, 2017, Gaze data for the analysis of attention in feature films., ACM Trans. Appl. Percept., 14, 1, 10.1145/3127588 · doi:10.1145/3127588
- Brodsky, 2001, The effects of music tempo on simulated driving performance and vehicular control., Transp. Res. Part F: Traffic Psychol. Behav., 4, 219, 10.1016/S1369-8478(01)00025-0 · DOI · Paper page
- Brône, 2018, Eye-Tracking in Interaction: Studies on the Role of Eye Gaze in Dialogue., 10.1075/ais.10 · doi:10.1075/ais.10
- Brown, 2006, How does music work? toward a pragmatics of musical communication, Music and Manipulation, 10.1093/acprof:oso/9780198529361.003.0001 · DOI · Paper page
- Brown, 2006, The social uses of background music for personal enhancement, Music and Manipulation: On the Social Uses and Social Control of Music, 126
- Bruner, 1990, Music, mood, and marketing., J. Market., 54, 94, 10.1177/002224299005400408 · DOI · Paper page
- Bullerjahn, 2005, Musik und bild [music and image], Musikpsychologie, 205
- Bullerjahn, 1994, An empirical investigation of effects of film music using qualitative content analysis., Psychomusicology, 13, 99, 10.1037/h0094100 · DOI
- Cespedes-Guevara, 2018, Music communicates affects, not basic emotions - a constructionist account of attribution of emotional meanings to music., Front. Psychol., 9, 10.3389/fpsyg.2018.00215 · DOI
- Cohen, 2001, Music as a source of emotion in film, Series in Affective Science. Music and Emotion: Theory and Research, 249
- Cohen, 2013, Congruence-association model of music and multimedia: Origin and evolution, The psychology of Music in Multimedia, 17, 10.1093/acprof:oso/9780199608157.003.0002 · DOI
- Coutrot, 2012, Influence of soundtrack on eye movements during video exploration., J. Eye Mov. Res., 5, 1, 10.16910/jemr.5.4.2 · DOI
- Dixon, 2007, An empirical investigation of music and gambling behaviour., Intern. Gambl. Stud., 7, 315, 10.1080/14459790701601471 · DOI
- Duras, 1981, L’homme Atlantique.
- Edworthy, 2006, The effects of music tempo and loudness level on treadmill exercise., Ergonomics, 49, 1597, 10.1080/00140130600899104 · DOI · Paper page
- Eerola, 2013, Emotional expression in music: contribution, linearity, and additivity of primary musical cues., Front. Psychol., 4, 10.3389/fpsyg.2013.00487 · DOI · Paper page
- Ezell, 2012, Affective, Attitudinal, and Cognitive Responses to Music in Modern US Political Advertising.
- Fabian, 2003, Expressive devices and perceived musical character in 34 performances of variation 7 from bach’s goldbergvariations., Mus. Sci., 7, 49, 10.1177/10298649040070s103 · doi:10.1177/10298649040070s103
- Fernández-Sotos, 2016, Influence of tempo and rhythmic unit in musical emotion regulation., Front. Comput. Neurosci., 10, 10.3389/fncom.2016.00080 · DOI
- Fraser, 2013, Music to your brain: background music changes are processed first, reducing ad message recall: MUSIC TO YOUR BRAIN., Psychol. Market., 30, 62, 10.1002/mar.20580 · DOI
- Furnham, 2002, Music is as distracting as noise: the differential distraction of background music and noise on the cognitive test performance of introverts and extraverts., Ergonomics, 45, 203, 10.1080/00140130210121932 · DOI · Paper page
- Grimm, 2010, Toward a recommendation for a European standard of peak and LKFS loudness levels., SMPTE Mot. Imag. J., 119, 28, 10.5594/j11396 · doi:10.5594/j11396
- Hailstone, 2009, It’s not what you play, it’s how you play it: timbre affects perception of emotion in music., Q. J. Exper. Psychol., 62, 2141, 10.1080/17470210902765957 · DOI
- Herget, 2019, On music’s potential to convey meaning in film: a systematic review of empirical evidence., Psychol. Music, 2019, 10.1177/0305735619835019 · DOI · Paper page
- Herget, 2018, Development and testing of an instrument to determine musical Fit in audio-visual advertising., Mus. Sci., 22, 362, 10.1177/1029864917731127 · doi:10.1177/1029864917731127
- Hoeckner, 2011, Film music influences how viewers relate to movie characters., Psychol. Aesthet. Creat. Arts, 5, 146, 10.1037/a0021544 · DOI
- Huron, 1989, Music in advertising: an analytic paradigm., Mus. Q., 73, 557, 10.1093/mq/73.4.557 · doi:10.1093/mq/73.4.557
- iMotions Biometric Research Platform
- Israel, 2019, Stop the music?: the effect of music on risky financial decisions: an experimental study., SSRN Electron. J., 42, 10.2139/ssrn.3318151 · doi:10.2139/ssrn.3318151
- Iwamiya, 1997, Interaction between auditory and visual processing in car audio: Simulation experiment using video reproduction., Appl. Hum. Sci., 16, 115, 10.2114/jpa.16.115 · doi:10.2114/jpa.16.115
- Jones, 1972, Attribution: Perceiving the Causes of Behavior.
- Juslin, 2004, Expression, perception, and induction of musical emotions: a review and a questionnaire study of everyday listening., J. New Music Res., 33, 217, 10.1080/0929821042000317813 · DOI · Paper page
- Kahneman, 1973, Attention and Effort.
- Kallinen, 2002, Reading news from a pocket computer in a distracting environment: effects of the tempo of background music., Comput. Hum. Behav., 18, 537, 10.1016/S0747-5632(02)00005-5 · DOI
- Karim, 2011, International positive and negative affect schedule short-form (I-PANAS-SF): testing for factorial invariance across cultures., Proc. Soc. Behav. Sci., 15, 2016, 10.1016/j.sbspro.2011.04.046 · DOI · Paper page
- Killmeier, 2004, Wolves at the door: musical persuasion in a 2004 Bush-Cheney campaign advertisement., MedieKultur J. Med. Commun. Res., 27, 10.7146/mediekultur.v27i50.2857 · DOI
- Kret, 2019, Preprocessing pupil size data: guidelines and code., Behav. Res. Methods, 51, 1336, 10.3758/s13428-018-1075-y · DOI · Paper page
- Kruger, 2012, Making meaning in AVT: eye tracking and viewer construction of narrative., Perspectives, 20, 67, 10.1080/0907676X.2011.632688 · DOI
- Lang, 2011, Short assessment of the big five: robust across survey methods except telephone interviewing., Behav. Res. Methods, 43, 548, 10.3758/s13428-011-0066-z · DOI · Paper page
- Lehmann, 2017, The influence of background music on learning in the light of different theoretical perspectives and the role of working memory capacity., Front. Psychol., 8, 10.3389/fncom.2016.01902 · doi:10.3389/fncom.2016.01902
- Lemercier, 2014, Pupillometry of taste: Methodological guide-from acquisition to data processing-and toolbox for MATLAB, Quantitative Methods for Psychology, 179, 10.20982/tqmp.10.2.p179 · DOI · Paper page
- Leone, 2008, Empatia e Costi Psicologici Dell’aiuto’, La Mente Del Cuore, Le Emozioni Nel Lavoro Nella Scuola Nella Vita.
- Lesiuk, 2005, The effect of music listening on work performance., Psychol. Music, 33, 173, 10.1177/0305735605050650 · DOI · Paper page
- Marshall, 1988, Effects of musical soundtracks on attitudes toward animated geometric figures., Music Percept., 6, 95, 10.2307/40285417 · DOI
- Mathôt, 2018, Pupillometry: psychology, physiology, and function., J. Cogn., 1, 10.5334/joc.18 · DOI · Paper page
- Mentzoni, 2014, Type of musical soundtrack affects behavior in gambling., J. Behav. Addict., 3, 102, 10.1556/JBA.3.2014.006 · DOI
- Mera, 2014, Eye-tracking film music., Music Mov. Image, 7, 10.5406/musimoviimag.7.3.0003 · DOI
- Michon, 2004, The interaction effect of background music and ambient scent on the perception of service quality., J. Bus. Res., 34, 191
- Nelson, 1997, Video Rhetorics: Televised Advertising in American Politics
- Neumann, 2015, Measures of Empathy, Measures of Personality and Social Psychological Constructs, 257, 10.1016/B978-0-12-386915-9.00010-3 · DOI
- Nguyen, 2017, Mind your music: the effects of music-induced mood and arousal across different memory tasks., Psychomusicology, 27, 81, 10.1037/pmu0000178 · DOI
- Oakes, 2007, Evaluating empirical research into music in advertising: a congruity perspective., J. Advert. Res., 47, 38, 10.2501/s0021849907070055 · DOI
- Pisciottano, 2019, Effetti Della Musica Sull’interpretazione di Stimoli Visivi.
- Quinto, 2014, The contributions of compositional structure and performance expression to the communication of emotion in music., Psychol. Music, 42, 503, 10.1177/0305735613482023 · DOI
- Rogers, 2012, Audiovisual coalescence: the effect of synchrony in film score, Proceedings of the 9th International Symposium on Computer Modeling and Retrieval
- Salvucci, 2007, iPod distraction: effects of portable music-player use on driver performance, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 10.1145/1240624.1240665 · DOI
- Scherer, 2015, Comparing the acoustic expression of emotion in the speaking and the singing voice., Comput. Speech Lang., 29, 218, 10.1016/j.csl.2013.10.002 · DOI
- Shevy, 2007, The mood of rock music affects evaluation of video elements differing in valence and dominance., Psychomusicology, 19, 57, 10.1037/h0094034 · doi:10.1037/h0094034
- Shevy, 2013, Music in television advertising and other persuasive media, The Psychology of Music in Multimedia, 311
- Sirois, 2014, Pupillometry., Wiley Interdiscipl. Rev., 5, 679, 10.1002/wcs.1323 · DOI · Paper page
- Smith, 2013, Watching you watch movies: using eye tracking to inform cognitive film theory, Psychocinematics: Exploring Cognition at the Movies, 165, 10.1093/acprof:oso/9780199862139.003.0009 · DOI · Paper page
- Smith, 2014, Audiovisual correspondences in sergei eisenstein’s alexander nevsky: a case study in viewer attention, Cognitive Media Theory, 85
- Steffens, 2020, The influence of film music on moral judgments of movie scenes and felt emotions., Psychol. Music, 48, 3, 10.1177/0305735618779443 · DOI
- Tagg, 2006, Music, moving images, semiotics, and the democratic right to know., Music Manipul. Soc. Uses Soc. Contr. Music, 21, 163
- Tagg, 2013, Music’s Meanings: A Modern Musicology for Non-Musos.
- Tan, 2007, Viewers’ interpretations of film characters’ emotions: effects of presenting film music before or after a character is shown., Music Percept., 25, 135, 10.1525/mp.2007.25.2.135 · DOI
- Taylor, 2017, Investigating the influence of music training on verbal memory., Psychol. Music, 45, 814, 10.1177/0305735617690246 · DOI
- Västfjäll, 2001, Emotion induction through music: a review of the musical mood induction procedure., Mus. Sci., 5, 173, 10.1177/10298649020050S107 · DOI · Paper page
- Vitouch, 2001, When your ear sets the stage: musical context effects in film perception., Psychol. Music, 29, 70, 10.1177/0305735601291005 · DOI
- Wallengren, 2015, Film music and visual attention: a pilot experiment using eye-tracking., Music Mov. Image, 8, 69, 10.5406/musimoviimag.8.2.0069 · doi:10.5406/musimoviimag.8.2.0069
- Wallengren, 2018, Into the film with music: measuring eyeblinks to explore the role of film music in emotional arousal and narrative transportation, Seeing into Screens: Eye Tracking and the Moving Image, 65
- Wedel, 2017, A review of eye-tracking research in marketing, Review of Marketing Research, 123, 10.4324/9781351550932-5 · doi:10.4324/9781351550932-5
- Wöllner, 2018, The impact of music and stretched time on pupillary responses and eye movements in slow-motion film scenes., J. Eye Mov. Res., 11, 10.16910/jemr.11.2.10 · DOI
- Woloszyn, 2012, Memory for facial expression is influenced by the background music playing during study., Adv. Cogn. Psychol., 8, 10.5709/acp-0118-9 · DOI
- Wu, 2014, The correspondence of music emotion and timbre in sustained musical instrument sounds., J. Audio Eng. Soc., 62, 663, 10.17743/jaes.2014.0037 · doi:10.17743/jaes.2014.0037
- Yamasaki, 2015, Viewing the world through the prism of music: Effects of music on perceptions of the environment., Psychol. Music, 43, 61, 10.1177/0305735613493954 · DOI
- Zabalbeascoa, 2008, The nature of the audiovisual text and its parameters., Didact. Audiovis. Transl., 7, 21, 10.1075/btl.77.05zab · doi:10.1075/btl.77.05zab
- Ziv, 2015, Music and compliance: can good music make us do bad things?, Psychol. Music, 14
- Ziv, 2006, The effect of ‘sad’ and ‘happy’ background music on the interpretation of a story in 5 to 6-year-old children., Br. J. Music Educ., 23, 10.1017/S0265051706007078 · DOI
- Ziv, 2012, Music and moral judgment: the effect of background music on the evaluation of ads promoting unethical behavior., Psychol. Music, 40, 738, 10.1177/0305735611406579 · DOI
Metadata
- Authors
- Ansani, A., Marini, M., D’Errico, F., & Poggi, I.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2020-10-07
- Volume
- 11
- ISSN
- 1664-1078
- Cited by
- 32
- References
- 4
- Funders
- Ministero dell’Istruzione, dell’Università e della Ricerca (2015WXBPYK)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry. https://app.cochat.ai/papers/10.3389/fpsyg.2020.02242
- The paper
- Ansani, A., Marini, M., D’Errico, F., & Poggi, I. (2020). How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2020.02242
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.