Hidden Stages of Cognition Revealed in Patterns of Brain Activation
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
To advance cognitive theory, researchers must be able to parse the performance of a task into its significant mental stages. In this article, we describe a new method that uses functional MRI brain activation to identify when participants are engaged in different cognitive stages on individual trials. The method combines multivoxel pattern analysis to identify cognitive stages and hidden semi-Markov models to identify their durations. This method, applied to a problem-solving task, identified four distinct stages: encoding, planning, solving, and responding. We examined whether these stages corresponded to their ascribed functions by testing whether they are affected by appropriate factors. Planning-stage duration increased as the method for solving the problem became less obvious, whereas solving-stage duration increased as the number of calculations to produce the answer increased. Responding-stage duration increased with the difficulty of the motor actions required to produce the answer.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913 · cited 2×
“Functional data were analyzed using a combination of custom code and the software package AFNI (Cox, 1996; Cox & Hyde, 1997). Prior to statistical analysis, the first four EPI volumes from each run were discarded to minimize magnetization equilibration effects. Preprocessing steps consisted of motion correction using…”
MethodInfluentialThe Brain's Default Network: Anatomy, Function, and Relevance to Disease
Buckner, R. L., Andrews‐Hanna, J. R., & Schacter, D. L. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.011 · Cited by 9,761
The discovery of processing stages: Extensions of Donders' method
Sternberg, S. (1969) · Acta Psychologica · doi:10.1016/0001-6918(69)90055-9 · Cited by 3,137 · cited 2×
“There is a rich history in cognitive psychology of trying to infer the stages of a task by using effects of manipulations on total time and their interactions, such as in the additive-factors logic employed by Sternberg (1969).”
MethodBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Event-Related fMRI: Characterizing Differential Responses
Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998) · NeuroImage · doi:10.1006/nimg.1997.0306 · Cited by 2,029 · cited 1×
“Assuming the hemodynamic response function of the Statistical Parametric Mapping difference of gammas (Friston et al., 1998: g = gamma(6, 1) – gamma(16, 1)/6), we used a Wiener filter (Glover, 1999) with a noise parameter of .1 to deconvolve the BOLD response into an inferred activity signal for…”
MethodMachine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
Deconvolution of Impulse Response in Event-Related BOLD fMRI1
Glover, G. H. (1999) · NeuroImage · doi:10.1006/nimg.1998.0419 · Cited by 1,386 · cited 1×
“…hemodynamic response function of the Statistical Parametric Mapping difference of gammas (Friston et al., 1998: g = gamma(6, 1) – gamma(16, 1)/6), we used a Wiener filter (Glover, 1999) with a noise parameter of .1 to deconvolve the BOLD response into an inferred activity signal for each region.”
MethodSoftware tools for analysis and visualization of fMRI data
Cox, R. W., & Hyde, J. S. (1997) · NMR in Biomedicine · doi:10.1002/(sici)1099-1492(199706/08)10:4/5<171::aid-nbm453>3.0.co;2-l · Cited by 1,352 · cited 1×
“Functional data were analyzed using a combination of custom code and the software package AFNI (Cox, 1996; Cox & Hyde, 1997).”
MethodYu, S.-Z. (2010) · Artificial Intelligence · doi:10.1016/j.artint.2009.11.011 · Cited by 734
Grabner, R. H., Ansari, D., Reishofer, G., Stern, E., Ebner, F., & Neuper, C. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.041 · Cited by 320 · cited 1×
“Grabner et al. (2007) have reported that these same regions were more active in more competent participants during a mathematical problem-solving task.”
Background
Cited by
Discovering Event Structure in Continuous Narrative Perception and Memory
Baldassano, C., Chen, J., Zadbood, A., Pillow, J. W., Hasson, U., & Norman, K. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.041 · Cited by 952
Chen, Q., Beaty, R. E., & Qiu, J. (2020) · Human Brain Mapping · doi:10.1002/hbm.25025 · Cited by 108
What data and analytics can and do say about effective learning
Lodge, J. M., & Corrin, L. (2017) · npj Science of Learning · doi:10.1038/s41539-017-0006-5 · Cited by 60
“There is also potential for computational neuroscience to assist in the construction and refining of analytical models that will make better predictions about student learning as they progress.(15) While learning analytics may not provide the ultimate answer to improving learning, there is potential for the field to h…”
BackgroundPhillips, L. T., Tepper, S. J., Goya‐Tocchetto, D., Davidai, S., Ordabayeva, N., Mirza, M. U., Szászi, B., Day, M. V., Hauser, O., & Jachimowicz, J. (2025) · Personality and Social Psychology Review · doi:10.1177/10888683251352048 · Cited by 70
Constructivist developmental theory is needed in developmental neuroscience
Arsalidou, M., & Pascual‐Leone, J. (2016) · npj Science of Learning · doi:10.1038/npjscilearn.2016.16 · Cited by 54
Dorsal Raphe Nucleus Down-Regulates Medial Prefrontal Cortex during Experience of Flow
Ulrich, M., Keller, J., & Grön, G. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00169 · Cited by 39
“Using hidden semi-Markov models multivariate pattern analysis of fMRI data, Anderson et al. (2016) recently revived a long standing discussion on serial multi stage process models as for example already suggested by Saul Sternberg in the 1960s (Sternberg, 1966).”
MethodGoucher-Lambert, K., & McComb, C. (2019) · Proceedings of the ... International Conference on Engineering Design · doi:10.1017/dsi.2019.193 · Cited by 24
“One of the first examples of HMM applied to fMRI data was work by Anderson et al., who applied HMM to capture characteristics of mathematical problem solving (Anderson, 2012; Anderson et al., 2010, 2016).”
MethodZhao, M., Eadeh, F. R., Nguyen, T. N., Gupta, P., Admoni, H., González, C., & Woolley, A. W. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107524 · Cited by 26
“HMMs are applied in many fields where the goal is to identify the influence of latent or hidden states based on observable data and to predict future states as they unfold sequentially across stages over time (Anderson et al., 2016; Kelley et al., 2008).”
AI and Our Understanding of Intelligence
Coleman, J. P. H. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-55180-3_15 · Cited by 21
Huebner, M. G., & LeFevre, J. (2017) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000127 · Cited by 17
Pyke, A. A., Fincham, J. M., & Anderson, J. R. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.046 · Cited by 14
“The duration of this stage is related to the number of arithmetic steps required (e.g., Anderson et al., 2016; Anderson and Fincham, 2014a).”
Self-citationUncovering hidden patterns of design ideation using hidden Markov modeling and neuroimaging
Hu, M., McComb, C., & Goucher-Lambert, K. (2023) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060423000021 · Cited by 15
“186 The earliest fMRI studies that adopted HMM were by Anderson et al. (2010, 2016) and Anderson (2012).”
BackgroundMethodBrain Science and Geographic Thinking: A Review and Research Agenda for K-3 Geography
Gersmehl, P. (2023) · Education Sciences · doi:10.3390/educsci13121199 · Cited by 11
“To complicate things even more, people are likely to access different brain networks during different phases of thinking about a visual image, or even something as straightforward as a math problem [117].”
BackgroundOn the Nature of Programmer Expertise.
Parnin, C., Siegmund, J., & Peitek, N. (2017) · PPIG · Cited by 17
Decision-Feedback Stages Revealed by Hidden Markov Modeling of EEG
Tao, Q., Si, Y., Li, F., Li, P., Li, Y., Zhang, S., Wan, F., Yao, D., & Xu, P. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721500313 · Cited by 11
Spatiotemporal analysis of event‐related fMRI to reveal cognitive states
Fincham, J. M., Lee, H. S., & Anderson, J. R. (2019) · Human Brain Mapping · doi:10.1002/hbm.24831 · Cited by 9
“Figure 1 illustrates a recent application of this method to a novel mathematical task (Anderson, Pyke, & Fincham, 2016; Anderson, Zhang, et al., 2016).”
MethodInfluentialSelf-citationQunlin, C. H. E. N., & Ke, D. I. N. G. (2022) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2022.02507 · Cited by 2
“00 14 2v 1 络的构建和分析证实想法之间的语义距离可以度量想法的新颖性,并结合图论分析方法将序列想法映射 到语义结构空间,即可以从模块性、节点中心性等网络分析指标来度量创新想法之间的关系,这为序列位 置效应的动态机制探究提供了可取的方法学指引 (Kenett & Faust, 2019)。 4.3…”
InfluentialSymbolics, Syntactics, and Semantics: Teaching a Language of Maps
Gersmehl, P. (2019) · Springer eBooks · doi:10.1007/978-3-319-73400-2_172-1 · Cited by 2
A neurocognitive model for predicting the fate of individual memoriesPreprint
Tubridy, S., Halpern, D. J., Davachi, L., & Gureckis, T. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7r3jp · Cited by 2
Symbolics, Syntactics, and Semantics: Teaching a Language of Maps
Gersmehl, P. (2019) · Springer eBooks · doi:10.1007/978-3-030-02438-3_172 · Cited by 1
Education as “Mental Vaccine:” Designing Educational Materials About COVID-19
Gersmehl, P. J., & Gersmehl, C. A. (2022) · Springer eBooks · doi:10.1007/978-3-030-94350-9_110 · Cited by 1
Error Analysis of Children with Mathematics Learning Difficulties in Tibet
Rong, L. (2016) · NORA - Norwegian Open Research Archives
Characterising goal neglect by investigating the effects of complexity and task structure
Biondo, F. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.22530
Nguyen‐Xuan, A. (2020) · Wiley eBooks · doi:10.1002/9781119750482.refs
Meaningful Individual Differences in Statistics Cognition
(2017) · Advances in higher education and professional development book series · doi:10.4018/978-1-5225-2420-5.ch006
A Cognitive Curriculum: Improving Statistics Cognition Online
(2017) · Advances in higher education and professional development book series · doi:10.4018/978-1-5225-2420-5.ch004
Understanding Statistics Cognition
(2017) · Advances in higher education and professional development book series · doi:10.4018/978-1-5225-2420-5.ch002
Cognitive and Neural Mechanisms of Musical Improvisation
刘, 丽. (2022) · Advances in Psychology · doi:10.12677/ap.2022.1210402
Wendt, A. N., Holt, D. V., von Stockhausen, L., Bredenkamp, J., Fritz, A., Hussy, W., Tobinski, D. A., Beckmann, J. F., Buchner, A., Guski-Leinwand, S., et al. (2025) · doi:10.17885/heiup.1067
Decomposing complex cognitive processes to understand individual differences in behavior
Walsh, C. (2023) · eScholarship (California Digital Library)
(2025) · OAPEN (The OAPEN Foundation)
How pupil tracks cognitive processes underlying internally- and externally-directed attention tasks
Palaskar, A., & Dang, S. (2024) · eScholarship (California Digital Library)
Metadata
- Authors
- Anderson, J. R., Pyke, A. A., & Fincham, J. M.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Anderson, John R.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2016-07-20
- Volume
- 27
- Issue
- 9
- Pages
- 1215-1226
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2500902203
- Cited by
- 29
- References
- 20
- Citations by year
- 2025: 1 · 2023: 2 · 2022: 4 · 2021: 1 · 2020: 4 · 2019: 4 · 2018: 2 · 2017: 8 · 2016: 3
- FWCI
- 3.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation
- James S. McDonnell Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- cognitive development stages, multi-voxel pattern analysis, hidden semi-Markov model, problem solving, brain activation patterns, planning, encoding, responding, stage duration, cognitive theory
- MeSH terms
- Adolescent, Adult, Algorithms, Brain, Cognition, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Problem Solving, Reaction Time, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.