When asking the question changes the ultimate answer: Metamemory judgments change memory
The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
Self-report measurements are ubiquitous in psychology, but they carry the potential of altering processes they are meant to measure. We assessed whether a common metamemory measure, judgments of learning, can change the ongoing process of memorizing and subsequent memory performance. Judgments of learning are a form of metamemory monitoring described as conscious reflection on one's own memory performance or encoding activities for the purpose of exerting strategic control over one's study and retrieval activities (T. O. Nelson & Narens, 1990). Much of the work examining the conscious monitoring of encoding relies heavily on a paradigm in which participants are asked to estimate the probability that they will recall a given item in a judgment of learning. In 5 experiments, we find effects of measuring judgments of learning on how people allocate their study time to difficult versus easy items, and on what they will recall. These results suggest that judgments of learning are partially constructed in response to the measurement question. The tendency of judgments of learning to alter performance places them in the company of other reactive verbal reporting methods, counseling researchers to consider incorporating control groups, creating alternative scales, and exploring other verbal reporting methods. Less directive methods of accessing participants' metacognition and other judgments should be considered as an alternative to response scales.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All previous reactivity studies presented stimuli in a unimodal form (e.g., word pairs presented visually; Mitchum et al., 2016; Yang, Huang, et al., 2021), which is somewhat unrepresentative of materials in real educational settings.”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum et al., 2016
In the citing paper
“Some recent studies have documented that, in some situations, the reactivity effect can be negative (that is, making JOLs impairs retention).”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum, Kelley, and Fox (2016)
In the citing paper
“The positive reactivity effect on children's learning may be accounted for by the positivereactivity theory (Mitchum et al., 2016; Rivers, 2018; Dougherty, Scheck, Nelson, & Narens, 2005), which proposes that positive reactivity is primarily caused by the fact that making item-by-item JOLs encourages learners to adopt more effective encoding strategies and exert greater study effort.”
From When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning (2022) · cites this paper as Mitchum et al., 2016
Citations
Cites
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
The MRC Psycholinguistic Database
Coltheart, M. (1981) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748108400805 · Cited by 2,437
On the Rate of Gain of Information
Hick, W. E. (1952) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215208416600 · Cited by 2,279
The construction of preference.
Slovic, P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.5.364 · Cited by 2,009
Cited by
A meta-analysis and systematic review of reactivity to judgements of learning
Double, K. S., Birney, D. P., & Walker, S. A. (2018) · Memory · doi:10.1080/09658211.2017.1404111 · Cited by 120
“…(Dougherty, Scheck, Nelson, & Narens, 2005; Soderstrom et al., 2015; Zechmeister & Shaughnessy, 1980), whereas other have found no reactivity (Benjamin, Bjork, & Schwartz, 1998; Kelemen & Weaver, 1997; Tauber & Rhodes, 2012), and still others have found negative reactivity (Mitchum et al., 2016).”
BackgroundInfluentialEfklides, A., & Schwartz, B. L. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09896-9 · Cited by 130
“Indeed, in cognitive literature, this phenomenon is called negative reactivity, and it has caused some researchers to question the value of prompting metacognitive judgments (Mitchum et al., 2016).”
Reactivity to Measures of Metacognition
Double, K. S., & Birney, D. P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02755 · Cited by 118
Providing different types of group awareness information to guide collaborative learning
Schnaubert, L., & Bodemer, D. (2019) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-018-9293-y · Cited by 106
The influence of making judgments of learning on memory performance: Positive, negative, or both?
Janes, J. L., Rivers, M. L., & Dunlosky, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1463-4 · Cited by 88
“…Mitchum et al. (2016) reported that the increased relatedness effect was largely driven by negative reactivity, wherein recall for unrelated pairs was lower for the JOL group; some trends toward positive reactivity for related pairs occurred in Mitchum et al. (2016), but they were not significant.”
BackgroundMethodResultInfluentialJudgments of learning (JOLs) selectively improve memory depending on the type of test
Myers, S. J., Rhodes, M. G., & Hausman, H. E. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01025-5 · Cited by 76
Formation of global self-beliefs in the human brain
Rouault, M., & Fleming, S. M. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2003094117 · Cited by 76
“In the context of our previous study, regularly requiring local confidence judgements may encourage subjects to pause and engage in reflecting about their confidence (48, 49), potentially allowing it to contribute more strongly to global SPE formation.”
The influence of judgments of learning on long-term learning and short-term performance
Witherby, A. E., & Tauber, S. K. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.08.004 · Cited by 62
“If making JOLs alters the learning process, then they introduce a confound for researchers focused on the effect of a given independent variable on learning (for a more detailed discussion, see Mitchum et al., 2016).”
BackgroundCan very small font size enhance memory?
Halamish, V. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0816-6 · Cited by 63
“, 2015; Witherby & Tauber, 2017), although several other studies reported no effect (Benjamin, Bjork, & Schwartz, 1998; Tauber & Rhodes, 2012) or a detrimental effect (Mitchum et al., 2016) of JOLs.”
Do judgments of learning directly enhance learning of educational materials?
Ariel, R., Karpicke, J. D., Witherby, A. E., & Tauber, S. K. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09556-8 · Cited by 55
The forward testing effect on self-regulated study time allocation and metamemory monitoring.
Yang, C., Potts, R., & Shanks, D. R. (2017) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000122 · Cited by 42
Responsible remembering and forgetting as contributors to memory for important information
Murphy, D. H., & Castel, A. D. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01139-4 · Cited by 51
Double, K. S., & Birney, D. P. (2017) · Thinking & Reasoning · doi:10.1080/13546783.2017.1289121 · Cited by 39
“In addition, the extant literature surrounding reactivity and cognitive abilities is currently characterised by equivocal results (e.g., Mitchum et al., 2016; Soderstrom et al., 2015), which may have resulted from important individual differences not being captured by the commonly used protocols.”
BackgroundMethodResultInfluentialRivers, M. L., Janes, J. L., & Dunlosky, J. T. (2021) · Memory · doi:10.1080/09658211.2021.1985143 · Cited by 47
Judgments of learning reactively facilitate visual memory by enhancing learning engagement
Shi, A., Xu, C., Zhao, W., Shanks, D. R., Hu, X., Luo, L., & Yang, C. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02174-1 · Cited by 38
“, memory itself), a phenomenon termed the memory reactivity effect (Double et al., 2018; Li et al., 2021; Mitchum et al., 2016; Witherby & Tauber, 2017; Zhao, Li, Shanks, Li, et al., 2022a; Zhao, Li, Shanks, Zhao, et al., 2022b).”
BackgroundBirney, D. P., Beckmann, J. F., Beckmann, N., & Double, K. S. (2017) · Intelligence · doi:10.1016/j.intell.2017.01.005 · Cited by 43
Buu, A., Yang, S., Li, R., Zimmerman, M. A., Cunningham, R. M., & Walton, M. A. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.106198 · Cited by 41
Making judgments of learning enhances memory by inducing item-specific processing
Senkova, O., & Otani, H. (2021) · Memory & Cognition · doi:10.3758/s13421-020-01133-2 · Cited by 41
Metacognition and fluid intelligence in value-directed remembering
Murphy, D. H., Agadzhanyan, K., Whatley, M. C., & Castel, A. D. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09265-9 · Cited by 40
Maxwell, N. P., & Huff, M. J. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09301-2 · Cited by 36
“Although JOL reactivity patterns based on pair association have been mixed (e.g., Janes et al., 2018; Mitchum et al., 2016; Soderstrom et al., 2015), a meta-analysis conducted by Double et al.”
InfluentialZhao, W., Li, B., Shanks, D. R., Zhao, W., Zheng, J., Hu, X., Su, N., Fan, T., Yin, Y., Luo, L., et al. (2022) · Child Development · doi:10.1111/cdev.13689 · Cited by 35
Strategic metacognition: Self-paced study time and responsible remembering
Murphy, D. H., Hoover, K. M., & Castel, A. D. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01307-0 · Cited by 38
“, 2012), changed goals (i.e., shifting focus to items that are perceived as easy and moderate difficulty at the expense of more challenging items; Mitchum et al., 2016), and/or the strengthening of cues that were used as the basis of the judgments (Soderstrom et al.”
Do confidence ratings prime confidence?
Double, K. S., & Birney, D. P. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1553-3 · Cited by 38
Colognesi, S., Piret, C., Demorsy, S., & Barbier, É. (2020) · lnternational Electronic Journal of Elementary Education · doi:10.26822/iejee.2020562136 · Cited by 42
“Second, judgments of learning (Mitchum, Kelley, & Fox, 2016; Nelson & Dunlosky, 1991) involve asking students to make judgements about their ability to redo a task.”
BackgroundMetamemory viewed through the judgment lens
Bröder, A., & Undorf, M. (2019) · Acta Psychologica · doi:10.1016/j.actpsy.2019.04.011 · Cited by 33
Li, B., Zhao, W., Zheng, J., Hu, X., Su, N., Fan, T., Yin, Y., Liu, M., Yang, C., & Luo, L. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01258-y · Cited by 33
Chang, M., & Brainerd, C. J. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09321-y · Cited by 33
“The current study was aimed at (a) testing the predictions of two major theories of JOL reactivity, the changed-goal hypothesis (Mitchum et al., 2016) and the cue-strengthening hypothesis (Soderstrom et al., 2015), and (b) using the dual-retrieval model to pinpoint the specific retrieval processes…”
BackgroundMethodResultInfluentialReactivity of Judgments of Learning in a Levels-of-Processing Paradigm
Tekin, E., & Roediger, H. L. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000425 · Cited by 31
“If we obtained negative reactivity for case questions as suggested by Mitchum et al. (2016), that would also augment the LOP effect.”
BackgroundMethodResultInfluentialReactivity to confidence ratings in older individuals performing the latin square task
Double, K. S., & Birney, D. P. (2018) · Metacognition and Learning · doi:10.1007/s11409-018-9186-5 · Cited by 31
Metamemory judgments have dissociable reactivity effects on item and interitem relational memory.
Zhao, W., Li, J., Shanks, D. R., Li, B., Hu, X., Yang, C., & Luo, L. (2023) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001160 · Cited by 31
“Furthermore, the 70 Google Scholar citations of Mitchum et al. (2016) were checked.”
BackgroundResultInfluentialLakhlifi, C., Lejeune, F., Rouault, M., Khamassi, M., & Rohaut, B. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00474-1 · Cited by 33
“This reactivity effect could lead either to an increased accuracy (more attention paid to the task) or decreased accuracy (cognitive resources devoted to confidence judgment instead of the first-order task) (Double & Birney, 2019; Double et al., 2018; Mitchum et al., 2016).”
BackgroundMetamemory that matters: judgments of importance can engage responsible remembering
Murphy, D. H., & Castel, A. D. (2021) · Memory · doi:10.1080/09658211.2021.1887895 · Cited by 30
“In Experiment 2b, participants rated the importance of remembering each preference (JOIs) and results revealed that JOIs led to a useful form of reactivity (Double et al., 2018; Double & Birney, 2019; Mitchum et al., 2016; Soderstrom et al., 2015; Spellman & Bjork, 1992).”
BackgroundJudgments of learning reflect the Animacy advantage for memory, but not beliefs about the effect
DeYoung, C. M., & Serra, M. J. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09264-w · Cited by 28
Metacognitive judgments can potentiate new learning: The role of covert retrieval
Kubik, V., Koslowski, K., Schubert, T., & Aslan, A. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09307-w · Cited by 27
When distraction benefits memory through semantic similarity
Hanczakowski, M., Beaman, C. P., & Jones, D. M. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.11.005 · Cited by 27
“There is a growing understanding that eliciting metacognitive judgments can change not only the quantitative, but also the qualitative patterns observed in memory performance (see Mitchum, Kelley, & Fox, 2016; Soderstrom et al., 2015).”
BackgroundSchnaubert, L., & Bodemer, D. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.03.004 · Cited by 28
“The results of our study support findings of studies conducted with judgments of learnings that have shown that judgments might not be explicitly generated automatically, but only be constructed in response to the trigger question (cf. Mitchum et al., 2016; Soderstrom et al., 2015).”
ResultDougherty, M. R., Robey, A. M., & Buttaccio, D. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0791-y · Cited by 26
“In some of these studies, the act of making an immediate JOL during learning is found to improve later memory performance (Soderstrom, et al. 2015), whereas other studies show that making JOLs leads to poorer memory performance rela t ive to a no- judgment control (Mitchum et al., 2016).”
ResultLei, W. I., Chen, J., Yang, C., Guo, Y., Feng, P., Feng, T., & Li, H. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107502 · Cited by 27
Spaced Retrieval Practice: Can Restudying Trump Retrieval?
Higham, P. A., Fastrich, G. M., Potts, R., Murayama, K., Pickering, J. S., & Hadwin, J. A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09809-2 · Cited by 28
“JOL reactivity is sometimes positive, boosting later memory (e.g., Soderstrom et al., 2015), sometime negative, reducing later memory (e.g., Mitchum et al., 2016), and sometimes has no effect on memory (e.g., Ariel et al., 2021; Janes et al., 2018; Tauber & Witherby, 2019).”
BackgroundInfluentialMaxwell, N. P., & Huff, M. J. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01381-4 · Cited by 24
“Although other studies investigating reactivity have also made use of self-paced study (e.g., Janes et al., 2018; Maxwell & Huff, 2022; Mitchum et al., 2016), the memory improvements observed for JOLs and frequency judgments could potentially be attributed to participants in the judgment groups encoding pairs for long…”
BackgroundResultA matter of priorities: High working memory enables (slightly) superior value-directed remembering
Griffin, M. L., Benjamin, A. S., Sahakyan, L., & Stanley, S. E. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104032 · Cited by 26
Metamemory: An Update of Critical Findings
Schwartz, B. L., & Metcalfe, J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21056-0 · Cited by 27
“consciously used to control study allocation or efforts at retrieval, there are also researchers who are concerned about reactivity, or the extent to which the mere act of making the judgment might influence learning (Mitchum et al., 2016).”
BackgroundDo people use category-learning judgments to regulate their learning of natural categories?
Morehead, K., Dunlosky, J. T., & Foster, N. L. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0729-9 · Cited by 21
Confidence ratings increase response thresholds in decision making
Li, B., Hu, X., Shanks, D. R., Su, N., Zhao, W., Meng, L., Lei, W. I., Luo, L., & Yang, C. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02380-5 · Cited by 21
“…(leading to a lower drift rate) and/or disrupt stimulus preprocessing and motor response speed (leading to longer non-decision time) (Ariel, Dunlosky, & Bailey, 2009; Griffin, Wiley, & Thiede, 2008; Hertzog, Kidder, Powell-Moman, & Dunlosky, 2002; Kanfer & Ackerman, 1989; Mitchum et al., 2016).”
Judgments of learning enhance recall for category-cued but not letter-cued items
Rivers, M. L., Dunlosky, J. T., Janes, J. L., Witherby, A. E., & Tauber, S. K. (2023) · Memory & Cognition · doi:10.3758/s13421-023-01417-3 · Cited by 19
“Researchers have investigated JOL reactivity using similar methodology (Janes et al., 2018; Mitchum et al., 2016; Myers et al., 2020; Rivers et al., 2021; Soderstrom et al., 2015).”
BackgroundMethodInfluentialSurvey measures of metacognitive monitoring are often false
Double, K. S. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02621-6 · Cited by 19
“For instance, many studies have suggested that online measures of meta-cognition are reactive (Double & Birney, 2017, 2019a, b; Mitchum et al., 2016; Soderstrom et al., 2015).”
Maxwell, N. P., & Huff, M. J. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09369-4 · Cited by 17
“For example, previous research investigating whether reactivity patterns on forward associates extend to backward associates (e.g., mouse – cheese vs. cheese – mouse ; Maxwell & Huff, 2022; Maxwell & Huff, 2023; Mitchum et al., 2016) has yielded mixed results.”
Do changed learning goals explain why metamemory judgments reactively affect memory?
Li, B., Shanks, D. R., Zhao, W., Hu, X., Luo, L., & Yang, C. (2024) · Journal of Memory and Language · doi:10.1016/j.jml.2024.104506 · Cited by 17
The metamemory expectancy illusion in source monitoring affects metamemory control and memory
Schaper, M. L., & Bayen, U. J. (2020) · Cognition · doi:10.1016/j.cognition.2020.104468 · Cited by 17
“To account for the possibility of such effects, future studies should also include appropriate control groups (Mitchum et al., 2016).”
BackgroundThe effect of delayed judgments of learning on retention
Tekin, E., & Roediger, H. L., III (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09260-0 · Cited by 18
Recalibration effects in judgments of learning: A signal detection analysis
Zawadzka, K., & Higham, P. A. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.04.005 · Cited by 18
Do Judgments of Learning Impair Recall When Uninformative Cues Are Salient?
Double, K. S. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11100203 · Cited by 17
“For example, Mitchum et al. (2016) proposed that JOLs prompt participants to reallocate their study time such that they overstudy easier items and understudy more difficult items, resulting in negative reactivity.”
BackgroundResultInfluentialMemory for inter-item relations is reactively disrupted by metamemory judgments
Zhao, W., Yin, Y., Hu, X., Shanks, D. R., Yang, C., & Luo, L. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09340-3 · Cited by 15
“, memory), demonstrating that memory performance can be reactive to observation and monitoring (Janes et al., 2018; Li et al., 2022; Mitchum et al., 2016; Myers et al., 2020; Rivers et al., 2021; Soderstrom et al., 2015; Spellman & Bjork, 1992).”
BackgroundZhao, L., Wang, S. Y., & Su, Y.-S. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12439-4 · Cited by 17
“…think-aloud protocols as well as interviews, which have been used to assess metacognition, may be particularly susceptible to the reactivity effect and limited task types, so the assessment itself could not be truly accurate (Double & Birney, 2019; Mitchum et al., 2016; Ohtani & Hisasaka, 2018 ).”
The Effect of Confidence Rating on a Primary Visual Task
Bonder, T., & Gopher, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02674 · Cited by 16
Remind me of the context: Memory and metacognition at restudy
Zawadzka, K., Simkiss, N. J., & Hanczakowski, M. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.03.001 · Cited by 17
Does the reactivity effect of judgments of learning transfer to learning of new information?
Li, B., Zhao, W., Shi, A., Zhong, Y., Hu, X., Liu, M., Luo, L., & Yang, C. (2023) · Memory · doi:10.1080/09658211.2023.2208792 · Cited by 14
“It has also been observed that making JOL reactively facilitates retention for children (Zhao et al., 2022) and young adults (Janes et al., 2018; Mitchum et al., 2016; Rivers et al., 2021), but the reactivity effect was not observed in older adults (Tauber & Witherby, 2019).”
BackgroundJudgments of Learning Reactivity on Item-Specific and Relational Processing
Chang, M., & Brainerd, C. J. (2024) · Journal of Intelligence · doi:10.3390/jintelligence12010004 · Cited by 14
Examining the effect of list composition on monitoring and control processes in metamemory
Laursen, S. J., & Fiacconi, C. M. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01107-4 · Cited by 14
“This finding expands upon the results from Mitchum et al. (2016) in that the explicit requirement to make a JOL not only affects the amount of study time allocated to a given item (Mitchum et al., 2016), but also whether an item is selected for re-study.”
BackgroundResultInfluentialLi, X., Chen, G., & Yang, C. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01143-8 · Cited by 14
On the proposed role of metacognition in environment learning: recommendations for research
Mason, L., Thomas, A. K., & Taylor, H. A. (2022) · Cognitive Research Principles and Implications · doi:10.1186/s41235-022-00454-x · Cited by 15
“Learning goals impact memory and attention (Anderson & Pichert, 1978; Kelly & McNamara, 2010; Pichert & Anderson, 1977; Taylor et al., 1999) and interact with metacognitive processes (Mitchum et al., 2016).”
BackgroundRivers, M. L., Janes, J. L., Dunlosky, J. T., Witherby, A. E., & Tauber, S. K. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11080164 · Cited by 16
Kubik, V., Jemstedt, A., Eshratabadi, H. M., Schwartz, B. L., & Jönsson, F. U. (2022) · Metacognition and Learning · doi:10.1007/s11409-021-09288-2 · Cited by 16
“1 3 people to mnemonic cues—such as ease of learning and retrieval fluency—which are diagnostic for metacognitive monitoring and control of learning (Karpicke, 2009; Mitchum et al., 2016; Roediger & Karpicke, 2006b; Soderstrom & Bjork, 2014; Yang, Potts, et al., 2017; Yang, Sun, et al., 2017).”
Does Interactive Imagery Influence the Reactive Effect of Judgments of Learning on Memory?
Witherby, A. E., Babineau, A. L., & Tauber, S. K. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11070139 · Cited by 15
Opting Out as an Untapped Resource in Instructional Design: Review and Implications
Sidi, Y., & Ackerman, R. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09879-w · Cited by 14
“…with the left one, can positively impact recall for related word-pairs (e.g., SOCK-SHOE; Halamish & Undorf, 2021; Soderstrom & Bjork, 2015; Tauber & Witherby, 2019), with mixed effects on unrelated word-pairs (e.g., SOCK-LAMP; Janes et al., 2018; Mitchum et al., 2016; Soderstrom & Bjork, 2015).”
Murphy, D. H. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02554-9 · Cited by 14
“…metacognitive reactivity (when making a judgment influences what is remembered; see Double & Birney, 2019; Double et al., 2018; Janes et al., 2018; Mitchum et al., 2016; Murphy, Halamish et al., 2023a; Murphy, Rhodes et al., 2024e; Soderstrom et al., 2015; Spellman & Bjork, 1992), whereby memory…”
Effortful Tests and Repeated Metacognitive Judgments Enhance Future Learning
Davis, S. D., & Chan, J. C. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09803-8 · Cited by 13
“Instead, making JOLs sometimes alters subsequent learning behavior outside of the effects of retrieval practice (e.g., Mitchum et al., 2016; Zhao et al., 2021; see Rhodes, 2016 for a review).”
BackgroundEffect of processing fluency on metamemory for written music in piano players
Schwartz, B. L., Peynircioğlu, Z. F., & Tatz, J. R. (2019) · Psychology of Music · doi:10.1177/0305735618817925 · Cited by 13
Protocol for the Mason: Health Starts Here prospective cohort study of young adult college students
Cuellar, A. E., Adams, L. M., de Jonge, L., Espina, V. A., Espinoza, L., Fischer, S. F., Frankenfeld, C. L., Hines, D. A., Kornienko, O., Lawrence, H. Y., et al. (2021) · BMC Public Health · doi:10.1186/s12889-021-10969-5 · Cited by 14
“For example, participants may be triggered to answer survey questions “appropriately” (so-called “reactivity” effects), or to address unfavorable health-related behaviors through merely being asked about them [125].”
BackgroundConfidence judgments interfere with perceptual decision making
Double, K. S., & Birney, D. P. (2024) · Scientific Reports · doi:10.1038/s41598-024-64575-7 · Cited by 13
More isn’t always better: when metacognitive prompts are misleading
Vangsness, L., & Young, M. E. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09241-9 · Cited by 14
How evaluating memorability can lead to Unintended Consequences
Murphy, D. H., Halamish, V., Rhodes, M. G., & Castel, A. D. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09332-3 · Cited by 12
“, 2021; for judgments of the likelihood of forgetting; Tauber & Rhodes 2012, for estimates of the duration of retention), and making metamemory judgments can influence memory, an effect known as reactivity (Arbuckle & Cuddy, 1969; Double & Birney, 2019; Double et al., 2018; Mitchum et al., 2016; Rivers et al., 2021; S…”
BackgroundResultInfluentialBirney, D. P., Beckmann, J. F., Beckmann, N., Double, K. S., & Whittingham, K. M. (2018) · Intelligence · doi:10.1016/j.intell.2018.03.008 · Cited by 11
“…the role of conative dispositions in complex decision-making through investigations of self-regulation (Bandura, 1997; Birney, Beckmann, Beckmann, & Double, 2017; Güss, Burger, & Dörner, 2017; Metcalfe, 1993; Mitchum, Kelley, & Fox, 2016; Stankov, 1999; Stankov & Lee, 2017; Zimmerman, 2002).”
Reactivity to confidence ratings: evidence of impaired rule-learning
Double, K. S., Goldwater, M. B., & Birney, D. P. (2025) · Metacognition and Learning · doi:10.1007/s11409-025-09413-5 · Cited by 10
“Notably, many studies have also found JOLs to be reactive (e.g., Double, 2023; Double et al., 2018 ; Mitchum et al., 2016; Soderstrom et al., 2015 ).”
InfluentialDelayed Metacomprehension Judgments Do Not Directly Improve Learning from Texts
Hausman, H., & Kubik, V. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11070150 · Cited by 10
Zheng, J., Li, B., Zhao, W., Su, N., Fan, T., Yin, Y., Hu, Y., Hu, X., Yang, C., & Luo, L. (2024) · Metacognition and Learning · doi:10.1007/s11409-024-09382-1 · Cited by 10
“Most of previous studies used word pairs as learning materials and examined the reac - tive influence of making JOLs on cued recall performance (e.g., Janes et al., 2018 ; Li et al., 2023 ; Mitchum et al., 2016 ; Rivers et al., 2021 ; Soderstrom et al., 2015 ; Witherby & Tauber, 2017).”
InfluentialBirney, D. P., Beckmann, J. F., Beckmann, N., & Stemler, S. E. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.812963 · Cited by 10
Testing judgments of learning in new contexts to reduce confidence.
Saenz, G. D., & Smith, S. M. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.07.003 · Cited by 10
Pristine Inner Experience and Descriptive Experience Sampling: Implications for Psychology
Lapping-Carr, L., & Heavey, C. L. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02170 · Cited by 11
“Similarly, participants asked to track the quality of their learning while engaging in a word-learning task had poorer recall than those participants who did not introspect about their learning (Mitchum et al., 2016).”
BackgroundLi, B., Pastötter, B., Zhong, Y., Su, N., Huang, T., Zhao, W., Hu, X., Luo, L., & Yang, C. (2024) · Journal of Intelligence · doi:10.3390/jintelligence12040044 · Cited by 9
“…− 2.655, p = 0.008, MCMC 95% CI = [ − 0.241, − 0.044], and the direct e ff ect ( c’ ) was also signi fi cant, β = − 0.466, JOLs can reactively change memory itself (Janes et al. 2018; Li et al. 2022, 2023; z = − 7.281, Mitchum 0.001, MCMC 95% CI = [ − 0.592, et al. 2016; Myers et al. 2020; − 0.342].”
BackgroundResultInfluential(2013) · Metacognition and Learning · doi:10.1007/11409.1556-1631 · Cited by 9
Halamish, V., & Undorf, M. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000429 · Cited by 8
Kaya, S., & Mulligan, N. W. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01638-0 · Cited by 8
“…of study materials, reactivity effects have been obtained with related word pairs (Chang & Brainerd, 2023; Myers et al. 2020), unrelated word pairs (Mitchum et al. 2016), word lists of single items (Senkova & Otani, 2021), pictures (Shi et al. 2023), and schematically consistent/inconsistent…”
InfluentialInfluence of emotional stimuli on metacognition: A study in arithmetic
Geurten, M., & Lemaire, P. (2022) · Consciousness and Cognition · doi:10.1016/j.concog.2022.103430 · Cited by 8
Besken, M., Solmaz, E. C., Karaca, M., & Atılgan, N. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00907-7 · Cited by 10
Ha, H., & Lee, H. S. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09341-2 · Cited by 8
“Positive effects of JOLs have been reported in the learning of various materials, including word pairs (Janes et al., 2018; Mitchum et al., 2016; Soderstrom et al., 2015), faces (Sommer et al., 1995), and text material (Dobson et al., 2019); they have also been reported when tests are delayed…”
BackgroundPrompting retrieval during monitoring and self-regulated learning in older and younger adults
DeCaro, R. E., & Thomas, A. K. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09230-y · Cited by 7
“The purpose of these reactivity studies is to determine whether the effect of making a monitoring judgment (e.g., JOLs) in and of itself causes memory enhancement effects (e.g., Soderstrom et al. 2015; Mitchum et al. 2016) or effects on strategy use/SRL (e.g., Double and Birney 2018).”
BackgroundToo Much Familiarity! The Developmental Path of the Fluency Heuristic in Children
Geurten, M., Willems, S. J., & Lloyd, M. E. (2020) · Child Development · doi:10.1111/cdev.13449 · Cited by 7
Constraints on the use of the memorizing effort heuristic
Laursen, S. J., & Fiacconi, C. M. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09273-9 · Cited by 7
“The question remains however, does this relation hold when the order in which effort and evaluation are reversed? That is, if individuals were required to first provide a JOL rating for a given item, and subsequently then allocate some amount of study time to that item, would individuals allocate more study time to it…”
BackgroundWang, X., Liu, X., Chen, L., Feng, K., Ye, Q., & Haoliang, Z. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11060101 · Cited by 7
Ha, H., & Lee, H. S. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09899-6 · Cited by 6
“Furthermore, the relatedness processing of unrelated cue-targets may induce dual-task costs that impede learning (Mitchum et al., 2016).”
Maxwell, N. P. (2025) · Memory · doi:10.1080/09658211.2025.2458813 · Cited by 6
“For example, the changed-goal hypothesis (Mitchum et al., 2016) suggests that the requirement to provide JOLs at encoding alerts participants to salient differences in item difficulty.”
Individual differences in the reactivity effect of judgments of learning: Cognitive factors
Zhao, W., Liu, S., Tian, X., Li, B., Shanks, D. R., Yang, C., & Luo, L. (2024) · Journal of Memory and Language · doi:10.1016/j.jml.2024.104574 · Cited by 6
Judgments of learning impair rule-based discovery
Double, K. S., Tran, D. M. D., & Goldwater, M. B. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01737-6 · Cited by 5
“Several studies have argued that reactivity can, in part, be explained by metacognitive ratings causing participants to shift to more conservative strategies (Double & Birney, 2017, 2018; Mitchum et al., 2016).”
InfluentialEyewitnesses' General Metamemory Beliefs Do Not Predict Culprit‐Presence Detection
Schaper, M. L., Menne, N. M., Bell, R., Mayer, C., & Buchner, A. (2025) · Applied Cognitive Psychology · doi:10.1002/acp.70100 · Cited by 5
Ardıç, E. E., & Besken, M. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01370-7 · Cited by 5
“Likewise, it is important to see whether the same patterns persist if the participants are asked to retrieve the details through more procedural means or if the JOLs are not solicited (Double et al., 2017; Mitchum et al., 2016).”
BackgroundCan metacognitive accuracy be altered through prompting in biology text reading?
Elsner, S., & Großschedl, J. (2023) · European Journal of Psychology of Education · doi:10.1007/s10212-023-00747-9 · Cited by 6
“This has been observed in experimental studies (e.g. Mazzoni et al., 1990; Mazzoni & Cornoldi, 1993; Metcalfe & Finn, 2008; Mitchum et al., 2016; Rhodes & Castel, 2009) and suggested by theoretical approaches like the ‘region of proximal learning model of study time allocation’ (Metcalfe & Kornell,…”
How does the type of expected evaluation impact students’ self-regulated learning?
Tauber, S. K., Thakkar, V. J., & Pleshek, M. A. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.08.002 · Cited by 5
Atienzar, T., Pilgrim, L. K., Sio, U. N., & Marsh, J. E. (2024) · Journal of Cognitive Psychology · doi:10.1080/20445911.2024.2319268 · Cited by 5
“Metacognitive judgements might also alter task processing by prompting a more effective strategy, a shift in task-goals, or a competition for resources to arise between the focal task and providing the monitoring judgement (Mitchum et al., 2016).”
Generalizing the effect of type of metacognitive judgment on restudy decisions
Robey, A., Castillo, C. D., Ha, J., Kerlow, M. A., Tesfa, N., & Dougherty, M. R. P. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09274-8 · Cited by 5
Metadata
- Authors
- Mitchum, A. L., Kelley, C. M., & Fox, M. C.
- Affiliations
- Florida State University (US)
- Venue
- Journal of Experimental Psychology: General
- Published
- 2016
- Volume
- 145
- Issue
- 2
- Pages
- 200-219
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2479323233
- Cited by
- 148
- References
- 85
- Citations by year
- 2026: 16 · 2025: 18 · 2024: 19 · 2023: 21 · 2022: 11 · 2021: 16 · 2020: 15 · 2019: 9 · 2018: 7 · 2017: 12 · 2016: 3
- FWCI
- 6.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- judgments of learning, metamemory, metacognitive monitoring, self-report bias, measurement effects, study time allocation, memory performance, metacognition, response scales, metacognitive regulation
- MeSH terms
- Metacognition, Adult, Humans, Judgment, Learning, Mental Recall, Word Association Tests, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.