Beyond Trial-Based Paradigms: Continuous Behavior, Ongoing Neural Activity, and Natural Stimuli
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The vast majority of experiments examining perception and behavior are conducted using experimental paradigms that adhere to a rigid trial structure: each trial consists of a brief and discrete series of events and is regarded as independent from all other trials. The assumptions underlying this structure ignore the reality that natural behavior is rarely discrete, brain activity follows multiple time courses that do not necessarily conform to the trial structure, and the natural environment has statistical structure and dynamics that exhibit long-range temporal correlation. Modern advances in statistical modeling and analysis offer tools that make it feasible for experiments to move beyond rigid independent and identically distributed trial structures. Here we review literature that serves as evidence for the feasibility and advantages of moving beyond trial-based paradigms to understand the neural basis of perception and cognition. Furthermore, we propose a synthesis of these efforts, integrating the characterization of natural stimulus properties with measurements of continuous neural activity and behavioral outputs within the framework of sensory-cognitive-motor loops. Such a framework provides a basis for the study of natural statistics, naturalistic tasks, and/or slow fluctuations in brain activity, which should provide starting points for important generalizations of analytical tools in neuroscience and subsequent progress in understanding the neural basis of perception and cognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 2×
“The best-known temporal extension of SDT is the drift diffusion model (Wald, 1947; Ratcliff, 1978; Smith and Ratcliff, 2004; Palmer et al., 2005; Ratcliff and McKoon, 2008).”
BackgroundThe brain's default mode network
Raichle, M. E. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-014030 · Cited by 3,904
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · cited 2×
“It is also contentious as to whether ramping activity during simple perceptual decisions is a straightforward neural correlate of evidence accumulation or whether it reflects alternate dynamics, a mixture of simpler factors, and/or secondary signals not functionally necessary for performing the task (Gold and Shadlen,…”
BackgroundThe Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 1×
“Classical drift diffusion is specified in continuous time and has no leak of the integration mechanism, but both discrete and leaky variants of accumulator models are often capable of fitting speed and accuracy data from psychophysical tasks (Usher and McClelland, 2001; Ditterich, 2006).”
BackgroundComputational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122 · cited 1×
“In one line of work, limb movements have been recognized as providing richer insight than discrete button presses or fast saccadic eye movements because of their more continuous and slower nature (Wolpert and Ghahramani, 2000; e.g., Janssen and Scherberger, 2015).”
BackgroundLearning to control a brain–machine interface for reaching and grasping by primates
Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., Patil, P. G., Henriquez, C. S., & Nicolelis, M. A. L. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000042 · Cited by 1,761 · cited 1×
“The brain-machine interface community uses Kalman filters to perform decoding on neural activity to control cursors, robotic arms, etc. (Carmena et al., 2003; Wu et al., 2004).”
MethodModeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478
The steady-state visual evoked potential in vision research: A review
Norcia, A. M., Appelbaum, L. G., Ales, J. M., Cottereau, B. R., & Rossion, B. (2015) · Journal of Vision · doi:10.1167/15.6.4 · Cited by 1,234
Stimulus onset quenches neural variability: A widespread cortical phenomenon
Churchland, M. M., Yu, B. M., Cunningham, J. P., Sugrue, L. P., Cohen, M. R., Corrado, G. S., Newsome, W. T., Clark, A. M., Hosseini, P., Scott, B. B., et al. (2010) · Nature Neuroscience · doi:10.1038/nn.2501 · Cited by 1,084
Psychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051
The Temporal Structures and Functional Significance of Scale-free Brain Activity
He, B. J., Zempel, J. M., Snyder, A. Z., & Raichle, M. E. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.020 · Cited by 990
Self-citationA hierarchy of intrinsic timescales across primate cortex
Murray, J. D., Bernacchia, A., Freedman, D. J., Romo, R., Wallis, J. D., Cai, X., Padoa-Schioppa, C., Pasternak, T., Seo, H., Lee, D., et al. (2014) · Nature Neuroscience · doi:10.1038/nn.3862 · Cited by 990 · cited 1×
“Of course, some behaviors, such as saccades, are at least individually quite ballistic, although how they play out across a longer time course is not yet well understood (Henderson, 2003; Hayhoe and Ballard, 2005; Najemnik and Geisler, 2005).”
BackgroundManning, J. R., Jacobs, J., Fried, I., & Kahana, M. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2041-09.2009 · Cited by 973
Opportunities and limitations of intrinsic functional connectivity MRI
Buckner, R. L., Krienen, F. M., & Yeo, B. T. T. (2013) · Nature Neuroscience · doi:10.1038/nn.3423 · Cited by 912 · cited 1×
“A now-extensive literature describes the rich network structures embedded in spontaneous fMRI signals (for review, see Buckner et al., 2013; Petersen and Sporns, 2015; Raichle, 2015).”
BackgroundGamma and Beta Bursts Underlie Working Memory
Lundqvist, M., Rose, J., Herman, P., Brincat, S. L., Buschman, T. J., & Miller, E. K. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.028 · Cited by 846
Hierarchical process memory: memory as an integral component of information processing
Hasson, U., Chen, J., & Honey, C. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.04.006 · Cited by 749
Power-Law Scaling in the Brain Surface Electric Potential
Miller, K. J., Sorensen, L. B., Ojemann, J. G., & den Nijs, M. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000609 · Cited by 742
Neural signature of the conscious processing of auditory regularities
Bekinschtein, T. A., Dehaene, S., Rohaut, B., Tadel, F., Cohen, L., & Naccache, L. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0809667106 · Cited by 738
The effect of stimulus strength on the speed and accuracy of a perceptual decision
Palmer, J., Huk, A. C., & Shadlen, M. N. (2005) · Journal of Vision · doi:10.1167/5.5.1 · Cited by 691 · cited 1×
“The best-known temporal extension of SDT is the drift diffusion model (Wald, 1947; Ratcliff, 1978; Smith and Ratcliff, 2004; Palmer et al., 2005; Ratcliff and McKoon, 2008).”
BackgroundSelf-citationElectrophysiological correlates of the brain's intrinsic large-scale functional architecture
He, B. J., Snyder, A. Z., Zempel, J. M., Smyth, M. D., & Raichle, M. E. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0807010105 · Cited by 670 · cited 2×
“Spontaneous fMRI signals correlate with the low-frequency ( 5 Hz) component of neural field potentials, named “slow cortical potentials” (SCPs) (He et al., 2008; Pan et al., 2013).”
BackgroundSelf-citationThalamic amplification of cortical connectivity sustains attentional control
Schmitt, L. I., Wimmer, R. D., Nakajima, M., Happ, M., Mofakham, S., & Halassa, M. M. (2017) · Nature · doi:10.1038/nature22073 · Cited by 663 · cited 2×
“For example, current debate surrounds whether persistent neural activity actually exists at the single-trial level during oculomotor working memory tasks or whether more transient bursts with variable times are the essential neural substrate (Lundqvist et al., 2016; Bolkan et al., 2017; Schmitt et al., 2017).”
BackgroundGilden, D. L., Thornton, T., & Mallon, M. W. (1995) · Science · doi:10.1126/science.7892611 · Cited by 641
A role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Brain networks and cognitive architectures
Petersen, S. E., & Sporns, O. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.027 · Cited by 553
Slow cortical dynamics and the accumulation of information over long timescales
Honey, C. J., Thesen, T., Donner, T. H., Silbert, L. J., Carlson, C. E., Devinsky, O., Doyle, W. K., Rubin, N., Heeger, D. J., & Hasson, U. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.011 · Cited by 532
Baseline brain activity fluctuations predict somatosensory perception in humans
Boly, M., Balteau, E., Schnakers, C., Degueldre, C., Moonen, G., Luxen, A., Phillips, C., Peigneux, P., Maquet, P., & Laureys, S. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611404104 · Cited by 529
Partitioning neuronal variability
Goris, R. L. T., Movshon, J. A., & Simoncelli, E. P. (2014) · Nature Neuroscience · doi:10.1038/nn.3711 · Cited by 528 · cited 2×
“…motivated by a number of current revisitations of the time course of neural activity and its correlation with behavior in the context of trial-based paradigms (Churchland et al., 2010; Goris et al., 2014; Lundqvist et al., 2016; Bolkan et al., 2017; Schmitt et al., 2017; Yates et al., 2017).”
BackgroundCognitive emissions of 1/f noise.
Gilden, D. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.1.33 · Cited by 516
Monto, S., Palva, S., Voipio, J., & Palva, J. M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1910-08.2008 · Cited by 453
The statistical determinants of adaptation rate in human reaching
Burge, J., Ernst, M. O., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.4.20 · Cited by 400 · cited 1×
“One such class of tasks that provides a time series of behavioral observations are tracking tasks (Baddeley et al., 2003; Burge et al., 2008; Mulligan et al., 2013; Bonnen et al., 2015, 2017).”
BackgroundA reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · cited 1×
“, its power) is often well approximated as 1/f (where typically ranges from 0 to 2), implying that sensory systems typically exhibit a wide set of time scales and temporal dynamics (Bernacchia et al., 2011; Murray et al., 2014; Hasson et al., 2015), quite distinct from the usual single-frequency (or otherwise tightly…”
BackgroundPredictive information in a sensory population
Palmer, S. E., Marre, O., Berry, M. J., & Bialek, W. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1506855112 · Cited by 257
Stochastic models of decisions about motion direction: Behavior and physiology
Ditterich, J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.042 · Cited by 233
Infraslow LFP correlates to resting-state fMRI BOLD signals
Pan, W.-J., Thompson, G. J., Magnuson, M. E., Jaeger, D., & Keilholz, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.035 · Cited by 231
Learned spatiotemporal sequence recognition and prediction in primary visual cortex
Gavornik, J. P., & Bear, M. F. (2014) · Nature Neuroscience · doi:10.1038/nn.3683 · Cited by 227 · cited 1×
“So far, studies on predictive processing based on statistical regularities in stimulus input have typically adopted simple, artificial stimuli that involve repeated presentations of items or sequences (Bekinschtein et al., 2009; Yaron et al., 2012; Gavornik and Bear, 2014).”
BackgroundThe accumulator model of two-choice discrimination
Smith, P. L., & Vickers, D. (1988) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(88)90043-0 · Cited by 223
Accuracy, Information, and Response Time in a Saccadic Decision Task
Reddi, B. A. J., Asrress, K. N., & Carpenter, R. H. S. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00689.2002 · Cited by 217
Spontaneous Infra-slow Brain Activity Has Unique Spatiotemporal Dynamics and Laminar Structure
Mitra, A., Kraft, A., Wright, P., Acland, B., Snyder, A. Z., Rosenthal, Z., Czerniewski, L., Bauer, A., Snyder, L., Culver, J., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.015 · Cited by 193
Initial-state-dependent, robust, transient neural dynamics encode conscious visual perception
Baria, A. T., Maniscalco, B., & He, B. J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005806 · Cited by 70 · cited 1×
“Consistent with this idea, studies have demonstrated that prestimulus spontaneous fMRI and SCP activity influences perceptual outcome and motor output (Boly et al., 2007; Fox et al., 2007; Hesselmann et al., 2008; Monto et al., 2008; Li et al., 2014; Baria et al., 2017).”
ResultSelf-citation
Cited by
The power of predictions: An emerging paradigm for psychological research
Hutchinson, J. B., & Barrett, L. F. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721419831992 · Cited by 216
Emergent behaviour and neural dynamics in artificial agents tracking odour plumes
Singh, S. H., van Breugel, F., Rao, R. P. N., & Brunton, B. W. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00599-w · Cited by 61
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
Tasks and their role in visual neuroscience
Kay, K., Bonnen, K., Denison, R. N., Arcaro, M. J., & Barack, D. L. (2023) · Neuron · doi:10.1016/j.neuron.2023.03.022 · Cited by 61
Self-citation
Metadata
- Authors
- Huk, A., Bonnen, K., & He, B. J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2018-07-23
- Volume
- 38
- Issue
- 35
- Pages
- 7551-7558
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2883281127
- Cited by
- 139
- References
- 40
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.