Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Open accessAbstract
Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., ‘Early’) processing benefits or post-sensory (i.e., ‘Late’) changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Complementary audio-visual information improves accuracy on perceptual decision-making tasks compared with visual information only.
“Complementary audio-visual information has been shown to improve accuracy on perceptual decision-making tasks compared with visual information only, by amplifying post-sensory decision evidence82.”
From Human detection of political speech deepfakes across transcripts, audio, and video (2024) · cites this paper as [82]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
1 retracted
Limited individual attention and online virality of low-quality information
Qiu, X., Oliveira, D. F. M., Shirazi, A. S., Flammini, A., & Menczer, F. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0132 · Cited by 186 · see citing works
RetractedFitting Linear Mixed-Effects Models Using <b>lme4</b>
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835 · see citing works
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392 · see citing works
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · see citing works
Nonparametric statistical testing of EEG- and MEG-data
Maris, E., & Oostenveld, R. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.03.024 · Cited by 8,496 · see citing works
PsychoPy2: Experiments in behavior made easy
Peirce, J. W., Gray, J., Simpson, S., MacAskill, M. R., Höchenberger, R., Sogo, H., Kastman, E. K., & Lindeløv, J. K. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-01193-y · Cited by 5,210 · see citing works
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720 · see citing works
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · see citing works
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598 · see citing works
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463 · see citing works
A Comparison of Sequential Sampling Models for Two-Choice Reaction Time.
Ratcliff, R., & Smith, P. L. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.333 · Cited by 1,227 · see citing works
Divided attention: Evidence for coactivation with redundant signals
Miller, J. O. (1982) · Cognitive Psychology · doi:10.1016/0010-0285(82)90010-x · Cited by 1,204 · see citing works
Raincloud plots: a multi-platform tool for robust data visualization
Allen, M., Poggiali, D., Whitaker, K. J., Marshall, T. R., & Kievit, R. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15191.1 · Cited by 1,125 · see citing works
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072 · see citing works
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · see citing works
HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python
Wiecki, T. V., Sofer, I., & Frank, M. J. (2013) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2013.00014 · Cited by 1,047 · see citing works
Ratcliff, R., & Tuerlinckx, F. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196302 · Cited by 838 · see citing works
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B., & Martin, A. D. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 765 · see citing works
A supramodal accumulation-to-bound signal that determines perceptual decisions in humans
O'Connell, R. G., Dockree, P. M., & Kelly, S. P. (2012) · Nature Neuroscience · doi:10.1038/nn.3248 · Cited by 755 · see citing works
A general mechanism for perceptual decision-making in the human brain
Heekeren, H. R., Marrett, S., Bandettini, P. A., & Ungerleider, L. G. (2004) · Nature · doi:10.1038/nature02966 · Cited by 741 · see citing works
The effect of stimulus strength on the speed and accuracy of a perceptual decision
Palmer, J., Huk, A. C., & Shadlen, M. N. (2005) · Journal of Vision · doi:10.1167/5.5.1 · Cited by 691 · see citing works
Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold
Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2925 · Cited by 647 · see citing works
Recipes for the linear analysis of EEG
Parra, L. C., Spence, C. D., Gerson, A. D., & Sajda, P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.05.032 · Cited by 570 · see citing works
Pernet, C. R., Wilcox, R., & Rousselet, G. A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00606 · Cited by 566 · see citing works
Multisensory contributions to low-level, ‘unisensory’ processing
Schroeder, C. E., & Foxe, J. J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.06.008 · Cited by 506 · see citing works
Small is beautiful: In defense of the small-N design
Smith, P. L., & Little, D. R. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1451-8 · Cited by 466 · see citing works
Face recognition under varying poses: The role of texture and shape
Troje, N. F., & Bülthoff, H. (1996) · Vision Research · doi:10.1016/0042-6989(95)00230-8 · Cited by 424 · see citing works
Talsma, D., & Woldorff, M. G. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054475172 · Cited by 417 · see citing works
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh197 · Cited by 404 · see citing works
Philiastides, M. G., Ratcliff, R., & Sajda, P. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1655-06.2006 · Cited by 394 · see citing works
Self-citationMultisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383 · see citing works
Optimal decision-making theories: linking neurobiology with behaviour
Bogacz, R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.006 · Cited by 367 · see citing works
Temporal Characterization of the Neural Correlates of Perceptual Decision Making in the Human Brain
Philiastides, M. G., & Sajda, P. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi130 · Cited by 360 · see citing works
Self-citationWhat to believe: Bayesian methods for data analysis
Kruschke, J. K. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.001 · Cited by 342 · see citing works
Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events
Stekelenburg, J. J., & Vroomen, J. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.1964 · Cited by 339 · see citing works
Do early sensory cortices integrate cross-modal information?
Kayser, C., & Logothetis, N. (2007) · Brain Structure and Function · doi:10.1007/s00429-007-0154-0 · Cited by 319 · see citing works
Self-citationEye tracking and pupillometry are indicators of dissociable latent decision processes.
Cavanagh, J. F., Wiecki, T. V., Kochar, A., & Frank, M. J. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0035813 · Cited by 289 · see citing works
Ploran, E. J., Nelson, S. M., Velanova, K., Donaldson, D. I., Petersen, S. E., & Wheeler, M. E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3522-07.2007 · Cited by 282 · see citing works
Ratcliff, R., Philiastides, M. G., & Sajda, P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0812589106 · Cited by 275 · see citing works
Self-citationThe drift diffusion model as the choice rule in reinforcement learning
Pedersen, M. L., Frank, M. J., & Biele, G. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1199-y · Cited by 272 · see citing works
Polanía, R., Krajbich, I. M., Grueschow, M., & Ruff, C. C. (2014) · Neuron · doi:10.1016/j.neuron.2014.03.014 · Cited by 261 · see citing works
A Bayesian Formulation of Exploratory Data Analysis and Goodness‐of‐fit Testing*
Gelman, A. (2003) · International Statistical Review · doi:10.1111/j.1751-5823.2003.tb00203.x · Cited by 249 · see citing works
fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning
Frank, M. J., Gagne, C., Nyhus, E., Masters, S. E., Wiecki, T. V., Cavanagh, J. F., & Badre, D. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2036-14.2015 · Cited by 242 · see citing works
Pisauro, M. A., Fouragnan, E. F., Retzler, C., & Philiastides, M. G. (2017) · Nature Communications · doi:10.1038/ncomms15808 · Cited by 217 · see citing works
Self-citationBeyond differences in means: robust graphical methods to compare two groups in neuroscience
Rousselet, G. A., Pernet, C. R., & Wilcox, R. R. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13610 · Cited by 215 · see citing works
Bridging Neural and Computational Viewpoints on Perceptual Decision-Making
O’Connell, R. G., Shadlen, M. N., Wong‐Lin, K., & Kelly, S. P. (2018) · Trends in Neurosciences · doi:10.1016/j.tins.2018.06.005 · Cited by 214 · see citing works
Multisensory Decision-Making in Rats and Humans
Raposo, D. C., Sheppard, J. P., Schrater, P., & Churchland, A. K. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.4998-11.2012 · Cited by 207 · see citing works
Ratcliff, R., & Frank, M. J. (2012) · Neural Computation · doi:10.1162/neco_a_00270 · Cited by 203 · see citing works
Causal Inference in the Multisensory Brain
Cao, Y., Summerfield, C., Park, H., Giordano, B. L., & Kayser, C. (2019) · Neuron · doi:10.1016/j.neuron.2019.03.043 · Cited by 201 · see citing works
Self-citationCausal Role of Dorsolateral Prefrontal Cortex in Human Perceptual Decision Making
Philiastides, M. G., Auksztulewicz, R., Heekeren, H. R., & Blankenburg, F. (2011) · Current Biology · doi:10.1016/j.cub.2011.04.034 · Cited by 200 · see citing works
Self-citationEEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making
Philiastides, M. G., & Sajda, P. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3540-07.2007 · Cited by 200 · see citing works
Self-citationWerner, S., & Noppeney, U. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5091-09.2010 · Cited by 197 · see citing works
Individual differences and fitting methods for the two-choice diffusion model of decision making.
Ratcliff, R., & Childers, R. (2015) · Decision · doi:10.1037/dec0000030 · Cited by 192 · see citing works
The neural dynamics of hierarchical Bayesian causal inference in multisensory perception
Rohe, T., Ehlis, A.-C., & Noppeney, U. (2019) · Nature Communications · doi:10.1038/s41467-019-09664-2 · Cited by 187 · see citing works
Improvement of visual contrast detection by a simultaneous sound
Lippert, M., Logothetis, N. K., & Kayser, C. (2007) · Brain Research · doi:10.1016/j.brainres.2007.07.050 · Cited by 180 · see citing works
Self-citationInforming cognitive abstractions through neuroimaging: The neural drift diffusion model.
Turner, B. M., van Maanen, L., & Forstmann, B. U. (2015) · Psychological Review · doi:10.1037/a0038894 · Cited by 169 · see citing works
Werner, S., & Noppeney, U. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp248 · Cited by 168 · see citing works
Lewis, R., & Noppeney, U. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5745-09.2010 · Cited by 167 · see citing works
Multivariate pattern analysis for MEG: A comparison of dissimilarity measures
Guggenmos, M., Sterzer, P., & Cichy, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.044 · Cited by 167 · see citing works
Perceptual Decisions Formed by Accumulation of Audiovisual Evidence in Prefrontal Cortex
Noppeney, U., Ostwald, D., & Werner, S. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0455-10.2010 · Cited by 158 · see citing works
Neural Oscillations Orchestrate Multisensory Processing
Keil, J., & Senkowski, D. (2018) · The Neuroscientist · doi:10.1177/1073858418755352 · Cited by 151 · see citing works
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151 · see citing works
Tagliabue, C. F., Veniero, D., Benwell, C., Cecere, R., Savazzi, S., & Thut, G. (2019) · Scientific Reports · doi:10.1038/s41598-019-41024-4 · Cited by 150 · see citing works
Nunez, M. D., Vandekerckhove, J., & Srinivasan, R. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.03.003 · Cited by 145 · see citing works
Gherman, S., & Philiastides, M. G. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.036 · Cited by 144 · see citing works
Self-citationWang, Y., Celebrini, S., Trotter, Y., & Barone, P. (2008) · BMC Neuroscience · doi:10.1186/1471-2202-9-79 · Cited by 144 · see citing works
Mercier, M. R., Foxe, J. J., Fiebelkorn, I. C., Butler, J. S., Schwartz, T. H., & Molholm, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.060 · Cited by 139 · see citing works
Eckert, M. A., Kamdar, N. V., Chang, C. E., Beckmann, C. F., Greicius, M. D., & Menon, V. (2008) · Human Brain Mapping · doi:10.1002/hbm.20560 · Cited by 138 · see citing works
Klinge, C., Eippert, F., Röder, B., & Büchel, C. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2384-10.2010 · Cited by 137 · see citing works
Optimal multisensory decision-making in a reaction-time task
Drugowitsch, J., DeAngelis, G. C., Klier, E. M., Angelaki, D. E., & Pouget, A. (2014) · eLife · doi:10.7554/elife.03005 · Cited by 133 · see citing works
Projection from Visual Areas V2 and Prostriata to Caudal Auditory Cortex in the Monkey
Falchier, A., Schroeder, C. E., Hackett, T. A., Lakatos, P., Nascimento‐Silva, S., Ulbert, I., Karmos, G., & Smiley, J. F. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp213 · Cited by 130 · see citing works
Extending JAGS: A tutorial on adding custom distributions to JAGS (with a diffusion model example)
Wabersich, D., & Vandekerckhove, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0369-3 · Cited by 121 · see citing works
Filimon, F., Philiastides, M. G., Nelson, J. D., Kloosterman, N. A., & Heekeren, H. R. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2334-12.2013 · Cited by 113 · see citing works
Self-citationHuman Scalp Potentials Reflect a Mixture of Decision-Related Signals during Perceptual Choices
Philiastides, M. G., Heekeren, H. R., & Sajda, P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3012-14.2014 · Cited by 110 · see citing works
Self-citationWhat causes non-monotonic tuning of fMRI response to noisy images?
Dakin, S. C., Hess, R. F., Ledgeway, T., & Achtman, R. L. (2002) · Current Biology · doi:10.1016/s0960-9822(02)00960-0 · Cited by 108 · see citing works
Human VMPFC encodes early signatures of confidence in perceptual decisions
Gherman, S., & Philiastides, M. G. (2018) · eLife · doi:10.7554/elife.38293 · Cited by 107 · see citing works
Self-citationComputational principles and models of multisensory integration
Chandrasekaran, C. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.11.002 · Cited by 102 · see citing works
On the importance of avoiding shortcuts in applying cognitive models to hierarchical data
Boehm, U., Marsman, M., Matzke, D., & Wagenmakers, E. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1054-3 · Cited by 101 · see citing works
To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference
Aller, M., & Noppeney, U. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000210 · Cited by 98 · see citing works
Contextual modulation of primary visual cortex by auditory signals
Petro, L. S., Paton, A., & Muckli, L. F. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0104 · Cited by 97 · see citing works
Where are multisensory signals combined for perceptual decision-making?
Bizley, J. K., Jones, G. P., & Town, S. M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.06.003 · Cited by 95 · see citing works
Dynamic weighting of multisensory stimuli shapes decision-making in rats and humans
Sheppard, J. P., Raposo, D., & Churchland, A. K. (2013) · Journal of Vision · doi:10.1167/13.6.4 · Cited by 81 · see citing works
Tuning the speed-accuracy trade-off to maximize reward rate in multisensory decision-making
Drugowitsch, J., DeAngelis, G. C., Angelaki, D. E., & Pouget, A. (2015) · eLife · doi:10.7554/elife.06678 · Cited by 79 · see citing works
Resolving multisensory and attentional influences across cortical depth in sensory cortices
Gau, R., Bazin, P., Trampel, R., Turner, R., & Noppeney, U. (2020) · eLife · doi:10.7554/elife.46856 · Cited by 76 · see citing works
A few simple steps to improve the description of group results in neuroscience
Rousselet, G. A., Foxe, J. J., & Bolam, J. P. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13400 · Cited by 73 · see citing works
Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds
Leo, F., Romei, V., Freeman, E. D., Làdavas, E., & Driver, J. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2742-8 · Cited by 70 · see citing works
Esposito, F., Mulert, C., & Goebel, R. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.074 · Cited by 70 · see citing works
Formal models and quantitative measures of multisensory integration: a selective overview
Colonius, H., & Diederich, A. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13813 · Cited by 66 · see citing works
Dynamic faces speed up the onset of auditory cortical spiking responses during vocal detection
Chandrasekaran, C., Lemus, L., & Ghazanfar, A. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312518110 · Cited by 57 · see citing works
Prestimulus alpha power predicts fidelity of sensory encoding in perceptual decision making
Lou, B., Li, Y., Philiastides, M. G., & Sajda, P. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.041 · Cited by 51 · see citing works
Self-citationMcGovern, D. P., Hayes, A., Kelly, S. P., & O’Connell, R. G. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0465-6 · Cited by 50 · see citing works
Sajda, P., Philiastides, M. G., & Parra, L. C. (2009) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2009.2034535 · Cited by 49 · see citing works
Self-citationKayser, S. J., Philiastides, M. G., & Kayser, C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.01.010 · Cited by 46 · see citing works
Self-citationPerceptual learning alters post-sensory processing in human decision-making
Diaz, J. A., Queirazza, F., & Philiastides, M. G. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0035 · Cited by 46 · see citing works
Self-citationHirokawa, J., Sadakane, O., Sakata, S., Bosch, M., Sakurai, Y., & Yamamori, T. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025283 · Cited by 42 · see citing works
Cortical Components of Reaction-Time during Perceptual Decisions in Humans
Dmochowski, J., & Norcia, A. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143339 · Cited by 37 · see citing works
Delis, I., Dmochowski, J., Sajda, P., & Wang, Q. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.035 · Cited by 33 · see citing works
Self-citationPhiliastides, M. G., & Sajda, P. (2006) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.885122 · Cited by 32 · see citing works
Self-citationBayesian-based integration of multisensory naturalistic perithreshold stimuli
Regenbogen, C., Johansson, E., Andersson, P. U., Olsson, M. J., & Lundström, J. N. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.12.017 · Cited by 29 · see citing works
Space-by-time decomposition for single-trial decoding of M/EEG activity
Delis, I., Onken, A., Schyns, P. G., Panzeri, S., & Philiastides, M. G. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.03.043 · Cited by 25 · see citing works
Self-citationNeuronal signatures of a random-dot motion comparison task
von Lautz, A., Herding, J., & Blankenburg, F. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.02.071 · Cited by 24 · see citing works
The dynamics of multimodal integration: The averaging diffusion model
Turner, B. M., Gao, J., Koenig, S. C., Palfy, D., & McClelland, J. L. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1255-2 · Cited by 19 · see citing works
Blank, H., Biele, G., Heekeren, H. R., & Philiastides, M. G. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4151-12.2013 · Cited by 18 · see citing works
Self-citationThe Intricate Interplay of Spatial Attention and Expectation: a Multisensory Perspective
Zuanazzi, A., & Noppeney, U. (2020) · Multisensory Research · doi:10.1163/22134808-20201482 · Cited by 17 · see citing works
Linking Neuronal Variability to Perceptual Decision Making via Neuroimaging
Sajda, P., Philiastides, M. G., Heekeren, H. R., & Ratcliff, R. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195393798.003.0010 · Cited by 6 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [97]Green, D. M. & Swets, J. A. Signal Detection Theory And Psychophysics (John Wiley, 1966).
Cited by
Sorted by citations
Human detection of political speech deepfakes across transcripts, audio, and video
Groh, M., Sankaranarayanan, A., Singh, N., Kim, D. Y., Lippman, A., & Picard, R. (2024) · Nature Communications · doi:10.1038/s41467-024-51998-z · Cited by 89 · see citing works
Gagné, N., & Franzen, L. (2023) · Swiss Psychology Open · doi:10.5334/spo.34 · Cited by 60 · see citing works
Self-citationRevisiting the role of computational neuroimaging in the era of integrative neuroscience
Loosen, A. M., Kato, A., & Gu, X. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01946-8 · Cited by 34 · see citing works
Delis, I., Ince, R. A. A., Sajda, P., & Wang, Q. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.0861-21.2022 · Cited by 34 · see citing works
Self-citationLiu, Z., Liu, S., Li, S., Li, L., Zheng, L., Weng, X., Guo, X., Lu, Y., Men, W., Gao, J., et al. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab471 · Cited by 28 · see citing works
Individual pupil size changes as a robust indicator of cognitive familiarity differences
Franzen, L., Cabugao, A., Grohmann, B., Elalouf, K., & Johnson, A. P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262753 · Cited by 24 · see citing works
Self-citationNewell, F. N., McKenna, E., Seveso, M. A., Devine, I., Alahmad, F., Hirst, R. J., & O’Dowd, A. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0342 · Cited by 20 · see citing works
A drift diffusion model analysis of age-related impact on multisensory decision-making processes
Bolam, J., Diaz, J. A., Andrews, M. W., Coats, R. O., Philiastides, M. G., Astill, S. L., & Delis, I. (2024) · Scientific Reports · doi:10.1038/s41598-024-65549-5 · Cited by 15 · see citing works
Self-citationSecondary motor integration as a final arbiter in sensorimotor decision-making
Balsdon, T., Verdonck, S., Loossens, T., & Philiastides, M. G. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002200 · Cited by 14 · see citing works
Self-citationLi, P., Wang, C., Li, M., Xuan, X., Zhou, B., & Li, H. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202300018 · Cited by 12 · see citing works
Visuo-vestibular heading perception: a model system to study multi-sensory decision making
Zeng, Z., Zhang, C., & Gu, Y. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0334 · Cited by 12 · see citing works
Multisensory integration operates on correlated input from unimodal transient channelsPreprint
Parise, C., & Ernst, M. O. (2023) · eLife · doi:10.7554/elife.90841 · Cited by 12 · see citing works
Bolam, J., Boyle, S. C., Ince, R. A. A., & Delis, I. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118841 · Cited by 12 · see citing works
Self-citationStrength of predicted information content in the brain biases decision behavior
Yan, Y., Zhan, J., Garrod, O., Cui, X., Ince, R. A. A., & Schyns, P. G. (2023) · Current Biology · doi:10.1016/j.cub.2023.10.042 · Cited by 10 · see citing works
An investigation on the olfactory capabilities of domestic dogs (Canis lupus familiaris)
Ferrando, E., & Dahl, C. D. (2022) · Animal Cognition · doi:10.1007/s10071-022-01640-6 · Cited by 10 · see citing works
Michail, G., Senkowski, D., Holtkamp, M., Wächter, B., & Keil, J. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119307 · Cited by 9 · see citing works
Differential effects of intra-modal and cross-modal reward value on perception: ERP evidence
Vakhrushev, R., Cheng, F. P.-H., Schacht, A., & Pooresmaeili, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287900 · Cited by 9 · see citing works
Accelerated Neurocomputation in Human Decision‐Making Under Time Pressure
Li, S., Liu, S., Lu, Y., Liu, S., Li, L., Liu, Z., & Guo, X. (2024) · Psychophysiology · doi:10.1111/psyp.14749 · Cited by 9 · see citing works
Neural processing of naturalistic audiovisual events in space and time
Hu, Y., & Mohsenzadeh, Y. (2025) · Communications Biology · doi:10.1038/s42003-024-07434-5 · Cited by 9 · see citing works
Attentional focusing and filtering in multisensory categorization
Li, J., & Deng, S. W. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02370-7 · Cited by 8 · see citing works
Li, J., Hua, L., & Deng, S. W. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1380196 · Cited by 7 · see citing works
Yu, S., Wang, N.-N., Hu, Q., Dang, P., Chang, S., Huang, X., Su, R., Li, H., Zhou, J. W., Ma, H., et al. (2023) · Neuroscience · doi:10.1016/j.neuroscience.2023.04.025 · Cited by 7 · see citing works
Evidence That Respiratory Phase May Modulate Task-Related Neural Representations of Visual Stimuli
Stetza, L., Hehemann, L., & Kayser, C. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.2236-24.2025 · Cited by 5 · see citing works
Self-citationAudiovisual integration facilitates age-related perceptual decision making
Yang, X., Yang, W., Li, R., Lin, J., Yang, J., & Ren, Y. (2025) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbaf037 · Cited by 4 · see citing works
Liu, S., Li, S., Jiang, H., Yin, L., Xu, Y., Liu, Z., & Guo, X. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121546 · Cited by 4 · see citing works
Sourav, S., Kekunnaya, R., Bottari, D., Shareef, I., Pitchaimuthu, K., & Röder, B. (2024) · Communications Biology · doi:10.1038/s42003-023-05749-3 · Cited by 4 · see citing works
Cross-modal congruency modulates evidence accumulation, not decision thresholds
Brožová, N., Vollmer, L., Kampa, B. M., Kayser, C., & Fels, J. (2025) · Frontiers in Neuroscience · doi:10.3389/fnins.2025.1513083 · Cited by 4 · see citing works
Self-citationFlexibility in choosing decision policies in gathering discrete evidence over time
Golmohamadian, M., Faraji, M., Fallah, F., Sharifizadeh, F., & Ebrahimpour, R. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316320 · Cited by 3 · see citing works
Ullah, R., Zhang, S., Asif, M., & Wahab, F. E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110082 · Cited by 3 · see citing works
Analyzing multisensory integration: Do’s and don’ts
Zhu, H., Beierholm, U., & Shams, L. B. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.107008 · Cited by 3 · see citing works
Bolhasani, E., Aboutalebi, S. H., & Merrikhi, Y. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202500147 · Cited by 3 · see citing works
More than the end: OFF response plasticity as a mnemonic signature of a sound’s behavioral salience
Anandakumar, D. B., & Liu, R. C. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.974264 · Cited by 3 · see citing works
Queirazza, F., Cavanagh, J., Philiastides, M. G., & Krishnadas, R. (2024) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2024.03.044 · Cited by 3 · see citing works
Self-citationHong, L., He, H., & Sajda, P. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.22.504728 · Cited by 3 · see citing works
Multisensory integration operates on correlated input from unimodal transients channelsPreprint
Parise, C., & Ernst, M. O. (2023) · eLife · doi:10.7554/elife.90841.1 · Cited by 3 · see citing works
Ó’Reilly, D., Bolam, J., Delis, I., & Utley, A. (2025) · Brain Sciences · doi:10.3390/brainsci15030226 · Cited by 2 · see citing works
Self-citationIncreasing visual uncertainty modulates multisensory decision-making
Yang, X., Yang, W., Yu, Y., Ejima, Y., & Yang, J. (2025) · Cortex · doi:10.1016/j.cortex.2025.11.005 · Cited by 2 · see citing works
Pepper, J. L., Yao, B., Braithwaite, J. J., Bampouras, T. M., & Nuttall, H. E. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121671 · Cited by 2 · see citing works
Diaz, J. A., Pisauro, M. A., Delis, I., & Philiastides, M. G. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00338 · Cited by 2 · see citing works
Self-citationWang, Y., Shan, X., Wang, Q., Wang, Z., Liu, S., Liu, W., Zheng, J., Zhao, X., Wang, Z., Lin, Y., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4643-6 · Cited by 1 · see citing works
Hong, L., He, H., & Sajda, P. (2023) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw59127.2023.10388080 · Cited by 1 · see citing works
Pérez-Bellido, A., Spaak, E., & de Lange, F. P. (2023) · Communications Biology · doi:10.1038/s42003-022-04335-3 · Cited by 1 · see citing works
Sensorimotor decisions rely on the entanglement of evidence and motor accumulation processesPreprint
Verdonck, S., Loossens, T., & Philiastides, M. G. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.16.492075 · Cited by 1 · see citing works
Self-citationMultisensory integration operates on correlated input from unimodal transients channelsPreprint
Parise, C., & Ernst, M. O. (2024) · eLife · doi:10.7554/elife.90841.2 · Cited by 1 · see citing works
Prior Information Shapes Perceptual Evidence Accumulation Dynamics Differentially in PsychosisPreprint
Franzen, L., Eickhoff, S., Andreou, C., Delis, I., Erb, J., Kreitewolf, J., Lencer, R., Lange, C., Schmitt, L., Schewe, H., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.03.662942 · Cited by 1 · see citing works
Self-citationNeural correlates of multisensory decision making in humans
Sousa, G. D. (2021) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.82474
Non-Linguistic Working Memory Challenges in Dyslexia in The Context of Applied Consumer PsychologyPreprint
Gagné, N., Grohmann, B., Bodur, O., Johnson, A. P., & Franzen, L. (2023) · doi:10.31234/osf.io/hcv76
Self-citationParise, C., & Ernst, M. O. (2025) · eLife · doi:10.7554/elife.90841.3.sa3
Forest before trees? It depends on not only what you see, but also what you hear
Tang, X., Liu, H., Zhang, H., He, Y., Cui, X., Liu, W., Sun, Y., Sun, J., & Fu, J. (2025) · Cognitive Psychology · doi:10.1016/j.cogpsych.2025.101764
Li, J., Zhao, J., Yang, J., & Deng, S. W. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104710
Engaging Mind and Body: An Immersive BCI Paradigm with Motion-Panoramic Virtual Reality
Zhang, L., Lei, M., Zhang, J., Huang, Z., Huang, R., & Cheng, H. M. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247199
Early Arousal Signals Drive Reward Learning and Subsequent Choice BehaviourPreprint
Ban, K., Fouragnan, E. F., & Philiastides, M. G. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.25.690494
Self-citationTan, S., Cheng, Y., Chen, J., XiangYong, Y. U. A. N., & Jiang, Y. (2026) · Cognitive Psychology · doi:10.1016/j.cogpsych.2026.101803
Asymmetry of diagnostic information integration in audiovisual category learning
Yunyi, L. I. N., HUANG, D., HUANG, H., Wenqin, T. A. N. G., & Liu, Z. (2026) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2026.2355
- Authors
- Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G.
- Affiliations
- Concordia University (CA)
- University of Leeds (GB)
- Bielefeld University (DE)
- University of Glasgow (GB)
- Corresponding author
- Franzen, Léon
- Philiastides, Marios G.
- Venue
- Nature Communications
- Published
- 2020-10-28
- Volume
- 11
- Issue
- 1
- Pages
- 5440-5440
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC7595090
- OpenAlex
- W3095323226
- Cited by
- 57
- References
- 106
- Citations by year
- 2026: 3 · 2025: 16 · 2024: 11 · 2023: 17 · 2022: 6 · 2021: 4
- FWCI
- 6.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- Funders
- European Commission (H2020-MSCA-IF-2018/845884)
- RCUK | Economic and Social Research Council (ES/L012995/1)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- auditory information, early sensory processing, audiovisual integration, drift-diffusion model, rapid decision-making
- MeSH terms
- Acoustic Stimulation, Adolescent, Adult, Auditory Perception, Choice Behavior, Decision Making, Electroencephalography, Female, Humans, Male, Models, Neurological, Models, Psychological, Photic Stimulation, Visual Perception, Multivariate Analysis, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
