Using a symbolic process model as input for model-based fMRI analysis: Locating the neural correlates of problem state replacements
Abstract
In this paper, a model-based analysis method for fMRI is used with a high-level symbolic process model. Participants performed a triple-task in which intermediate task information needs to be updated frequently. Previous work has shown that the associated resource - the problem state resource - acts as a bottleneck in multitasking. The model-based method was used to locate the neural correlates of 'problem state replacements'. To analyze the fMRI data, we fit the computational process model to the behavioral data and regressed the model's activity against the fMRI data. The brain region responsible for the temporary representation of problem states, the inferior parietal lobule, and the brain region responsible for long-term storage of problem states, the inferior frontal gyrus were thus identified. These results show that model-based fMRI analyses can be performed using high-level symbolic cognitive models, enabling fine-grained exploratory fMRI research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Subjects were considerably slower and made more errors when the problem state was required for two tasks, as compared to one or none of the tasks.
“In a series of experiments it was shown that subjects were considerably slower and made more errors when the problem state was required for two tasks, as compared to one or none of the tasks [8,10,11,12,37].”
From What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption (2015) · cites this paper as [11]
Cites
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · see citing works
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5376 · Cited by 4,217 · see citing works
What we can do and what we cannot do with fMRI
Logothetis, N. K. (2008) · Nature · doi:10.1038/nature06976 · Cited by 3,612 · see citing works
Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies
Cabeza, R., & Nyberg, L. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137585 · Cited by 3,598 · see citing works
Statistical Parametric Mapping: The Analysis of Functional Brain Images
Penny, W. D., Friston, K. J., Ashburner, J., Kiebel, S. J., & Thomas, N. (2007) · UCL Discovery (University College London) · Cited by 3,339 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Neuroimaging studies of working memory:
Wager, T. D., & Smith, E. E. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.4.255 · Cited by 1,889 · see citing works
How Can the Human Mind Occur in the Physical Universe?
Anderson, J. R. (2007) · doi:10.1093/acprof:oso/9780195324259.001.0001 · Cited by 1,483 · see citing works
Frontal lobes and human memory: Insights from functional neuroimaging
Fletcher, P. C. (2001) · Brain · doi:10.1093/brain/124.5.849 · Cited by 1,348 · see citing works
Reflections of the Environment in Memory
Anderson, J. R., & Schooler, L. J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00174.x · Cited by 1,096 · see citing works
Parametric Analysis of fMRI Data Using Linear Systems Methods
Cohen, M. S. (1997) · NeuroImage · doi:10.1006/nimg.1997.0278 · Cited by 723 · see citing works
(1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.3.301 · Cited by 711 · see citing works
Statistical Parametric Mapping
Friston, K. J. (2003) · Springer eBooks · doi:10.1007/978-1-4615-1079-6_16 · Cited by 690 · see citing works
Threaded cognition: An integrated theory of concurrent multitasking.
Salvucci, D. D., & Taatgen, N. (2008) · Psychological Review · doi:10.1037/0033-295x.115.1.101 · Cited by 669 · see citing works
Self-citationBrain imaging of the central executive component of working memory
Collette, F., & Van der Linden, M. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00063-x · Cited by 617 · see citing works
LaBar, K. S., Gitelman, D. R., Parrish, T. B., & Mesulam, M. M. (1999) · NeuroImage · doi:10.1006/nimg.1999.0503 · Cited by 514 · see citing works
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 509 · see citing works
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Components of verbal working memory: Evidence from neuroimaging
Smith, E. E., Jonides, J. J., Marshuetz, C., & Koeppe, R. A. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.876 · Cited by 492 · see citing works
Cabeza, R. E. L., Dolcos, F., Graham, R., & Nyberg, L. H. (2002) · NeuroImage · doi:10.1006/nimg.2002.1063 · Cited by 466 · see citing works
Exploration of the neural substrates of executive functioning by functional neuroimaging
Collette, F., Hogge, M., Salmon, E., & Van der Linden, M. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.05.035 · Cited by 464 · see citing works
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Working memory and focal attention.
Brian Mcelree, A. (2001) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.27.3.817 · Cited by 423 · see citing works
Wagner, A. D., Maril, A., Bjork, R. A., & Schacter, D. L. (2001) · NeuroImage · doi:10.1006/nimg.2001.0936 · Cited by 421 · see citing works
Pitt, M. A., & Myung, I. J. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)01964-2 · Cited by 419 · see citing works
Serial attention within working memory
Garavan, H. (1998) · Memory & Cognition · doi:10.3758/bf03201138 · Cited by 375 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
Human Symbol Manipulation Within an Integrated Cognitive Architecture
Anderson, J. R. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_22 · Cited by 253 · see citing works
Salvucci, D. D., Taatgen, N. A., & Borst, J. P. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518981 · Cited by 251 · cited 1× · see citing works
“To account for multitasking aspects the model uses threaded cognition theory (Salvucci et al., 2009; Salvucci and Taatgen, 2008, 2011).”
Self-citationThe problem state: A cognitive bottleneck in multitasking.
Borst, J. P., Taatgen, N. A., & van Rijn, H. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0018106 · Cited by 193 · see citing works
Self-citation(2010) · Cited by 186 · see citing works
Self-citationNonlinear Regression in Parametric Activation Studies
Büchel, C., Wise, R. J. S., Mummery, C. J., Poline, J.-B., & Friston, K. J. (1996) · NeuroImage · doi:10.1006/nimg.1996.0029 · Cited by 163 · see citing works
Haruno, M., & Kawato, M. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.06.007 · Cited by 152 · see citing works
Anderson, J. R., Fincham, J. M., Qin, Y., & Stocco, A. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.006 · Cited by 146 · see citing works
An information-processing model of the BOLD response in symbol manipulation tasks
Anderson, J. R., Qin, Y., Sohn, M.-H., Stenger, V. A., & Carter, C. S. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196490 · Cited by 129 · see citing works
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104 · see citing works
Tracing Problem Solving in Real Time: fMRI Analysis of the Subject-paced Tower of Hanoi
Anderson, J. R., Albert, M. V., & Fincham, J. M. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929055002427 · Cited by 101 · see citing works
An information-processing model of three cortical regions: evidence in episodic memory retrieval
Sohn, M.-H., Goode, A., Stenger, V. A., Jung, K., Carter, C. S., & Anderson, J. R. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.11.001 · Cited by 71 · see citing works
Endogenous control and task representation: an fMRI study in algebraic problem-solving
Stocco, A., & Anderson, J. R. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20089 · Cited by 59 · see citing works
Cooper, R. (2007) · Cognitive Science · doi:10.1080/15326900701326592 · Cited by 54 · see citing works
Borst, J. P., Taatgen, N. A., Stocco, A., & van Rijn, H. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012966 · Cited by 52 · see citing works
Self-citationThe Costs of Multitasking in Threaded Cognition
Borst, J. P., & Taatgen, N. (2007) · Cited by 24 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
The nature and transfer of cognitive skills
Taatgen, N. A. (2013) · Psychological Review · doi:10.1037/a0033138 · Cited by 288 · see citing works
Self-citationA Bayesian framework for simultaneously modeling neural and behavioral data
Turner, B. M., Forstmann, B. U., Wagenmakers, E., Brown, S. D., Sederberg, P. B., & Steyvers, M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.048 · Cited by 201 · see citing works
Borst, J. P., Taatgen, N. A., & van Rijn, H. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702156 · Cited by 156 · see citing works
Self-citationOscillatory multiplexing of neural population codes for interval timing and working memory
Gu, B.-M., van Rijn, H., & Meck, W. H. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.10.008 · Cited by 155 · see citing works
Dedicated Clock/Timing-Circuit Theories of Time Perception and Timed Performance
van Rijn, H., Gu, B.-M., & Meck, W. H. (2014) · Advances in experimental medicine and biology · doi:10.1007/978-1-4939-1782-2_5 · Cited by 112 · see citing works
Borst, J. P., & Anderson, J. R. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1221572110 · Cited by 102 · see citing works
Self-citationSingle-task fMRI overlap predicts concurrent multitasking interference
Nijboer, M., Borst, J., van Rijn, H., & Taatgen, N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.082 · Cited by 72 · see citing works
Self-citationStocco, A., Lebiere, C. J., O’Reilly, R. C., & Anderson, J. R. (2012) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-012-0117-7 · Cited by 53 · see citing works
Using Data-Driven Model-Brain Mappings to Constrain Formal Models of Cognition
Borst, J. P., Nijboer, M., Taatgen, N., van Rijn, H., & Anderson, J. R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119673 · Cited by 50 · see citing works
Self-citationUsing the ACT-R Cognitive Architecture in Combination With fMRI Data
Borst, J. P., & Anderson, J. R. (2015) · Springer eBooks · doi:10.1007/978-1-4939-2236-9_17 · Cited by 45 · see citing works
Self-citationA step-by-step tutorial on using the cognitive architecture ACT-R in combination with fMRI data
Borst, J. P., & Anderson, J. R. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.05.005 · Cited by 43 · see citing works
Self-citationDifferent Ways of Linking Behavioral and Neural Data via Computational Cognitive Models
de Hollander, G., Forstmann, B. U., & Brown, S. D. (2015) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2015.11.004 · Cited by 35 · see citing works
Fechner, H. B., Pachur, T., Schooler, L. J., Mehlhorn, K., Battal, C., Volz, K. G., & Borst, J. P. (2016) · Cognition · doi:10.1016/j.cognition.2016.08.011 · Cited by 23 · see citing works
Self-citationAvoiding the problem state bottleneck by strategic use of the environment
Borst, J. P., Buwalda, T. A., van Rijn, H., & Taatgen, N. A. (2013) · Acta Psychologica · doi:10.1016/j.actpsy.2013.07.016 · Cited by 19 · see citing works
Self-citationMultitasking While Driving: Central Bottleneck or Problem State Interference?
Held, M., Rieger, J. W., & Borst, J. P. (2022) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208221143857 · Cited by 17 · see citing works
Self-citationHeld, M., Minculescu, A., Rieger, J. W., & Borst, J. P. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103164 · Cited by 11 · see citing works
Self-citationvan Vugt, M. K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.076 · Cited by 11 · see citing works
Connecting Leadership With Preferences Toward Adaption and Innovation
Friedel, C. R., Clegorne, N., Kaufman, E. K., Seibel, M., & Anderson, J. C. (2016) · Journal of Leadership Studies · doi:10.1002/jls.21437 · Cited by 7 · see citing works
Roberts, G., Jones, T. W., Davis, E. A., Ly, T. T., & Anderson, M. B. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0276-9 · Cited by 6 · see citing works
The Value of Adaption and Innovation as a Function of Diversity
Friedel, C. R. (2014) · Advances in human resources management and organizational development book series · doi:10.4018/978-1-4666-6006-9.ch004 · Cited by 6 · see citing works
Relating ACT-R buffer activation to EEG activity during an attentional blink task
van Vugt, M. K. (2012) · PsycEXTRA Dataset · doi:10.1037/e557102013-058 · Cited by 5 · see citing works
Brochard, J., & Jean Daunizeau, A. (2024) · eLife · doi:10.7554/elife.80979 · Cited by 3 · see citing works
Validating Models of Complex, Real-life Tasks Using fMRI
Borst, J. P., Taatgen, N., & van Rijn, H. (2013) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137316523_9 · Cited by 3 · see citing works
Self-citationA Data-Driven Mapping of Five ACT-R Modules on the Brain
Borst, J. P., Nijboer, M., Taatgen, N., & Anderson, J. R. (2018) · Figshare · doi:10.1184/r1/6613094 · Cited by 3 · see citing works
Self-citationBrochard, J., & Jean Daunizeau, A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.09.08.287714 · Cited by 3 · see citing works
Borst, J. P. (2012) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 2 · see citing works
Self-citationWang, C., Tian, Y., Liu, Y., Chen, S., Tian, Z., & Li, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39182-8_17 · Cited by 2 · see citing works
Predicting Interference in Concurrent Multitasking
Nijboer, M., Borst, J. P., van Rijn, H., & Taatgen, N. A. (2013) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 2 · see citing works
Self-citationThe Value of Adaption and Innovation as a Function of Diversity
Friedel, C. R. (2016) · IGI Global eBooks · doi:10.4018/978-1-4666-9624-2.ch043 · Cited by 2 · see citing works
Towards a dynamical view of ACT-R's electrophysiological correlates
van Vugt, M. K., West, R., & Stewart, T. (2013) · Cited by 1 · see citing works
Towards Pinpointing the Neural Correlates of ACT-R: A Conjunction of Two Model-Based fMRI Analyses
Borst, J. P., & Anderson, J. R. (2012) · PsycEXTRA Dataset · doi:10.1037/e557572013-001 · Cited by 1 · see citing works
Self-citationSeparation and parameter estimation of fMRI signal base on particle filter
Liu, S., Pu, J., & Zhang, L. (2016) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2016.7831996
Mitra, S. (2017) · VTechWorks (Virginia Tech)
Towards Pinpointing the Neural Correlates of ACT-R: A Conjunction of Two Model-Based fMRI Analyses
Borst, J. P., & Anderson, J. R. (2012) · PsycEXTRA Dataset · doi:10.1037/e557102013-066
Self-citationRelating ACT-R buffer activation to EEG activity during an attentional blink task
van Vugt, M. K. (2012) · PsycEXTRA Dataset · doi:10.1037/e557532013-001
Approches computationnelles d'analyse des relations entre cerveau et comportement
Brochard, J. (2021) · theses.fr (ABES) · doi:10.70675/622daac4z9213z4569z9a2eze68e530929ee
How to Match Cognitive Model Predictions With EEG Data
Preuß, K., Hilton, C. W., Gramann, K., & Rußwinkel, N. (2026) · Topics in Cognitive Science · doi:10.1111/tops.70049
- Authors
- Borst, J. P., Taatgen, N. A., & van Rijn, H.
- Affiliations
- University of Groningen (NL)
- Corresponding author
- Borst, Jelmer P.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-09
- Volume
- 58
- Issue
- 1
- Pages
- 137-147
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2016725357
- Cited by
- 33
- References
- 42
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 1 · 2020: 1 · 2018: 1 · 2017: 1 · 2016: 5 · 2015: 4 · 2014: 5 · 2013: 9 · 2012: 2
- FWCI
- 3.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NeuroImage (publishedVersion)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- multitasking, cognitive bottleneck, inferior parietal lobule, inferior frontal gyrus, working memory, long-term storage, computational cognitive model, neural correlates
- MeSH terms
- Adolescent, Adult, Behavior, Cerebrovascular Circulation, Cognition, Female, Hemodynamics, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Models, Neurological, Oxygen, Problem Solving, Psychomotor Performance, Reaction Time, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
