The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index; none of the 43 sources its claims cite is checked for support yet.
A common mechanism underlies changes of mind about decisions and confidence
Open accessAbstract
Decisions are accompanied by a degree of confidence that a selected option is correct. A sequential sampling framework explains the speed and accuracy of decisions and extends naturally to the confidence that the decision rendered is likely to be correct. However, discrepancies between confidence and accuracy suggest that confidence might be supported by mechanisms dissociated from the decision process. Here we show that this discrepancy can arise naturally because of simple processing delays. When participants were asked to report choice and confidence simultaneously, their confidence, reaction time and a perceptual decision about motion were explained by bounded evidence accumulation. However, we also observed revisions of the initial choice and/or confidence. These changes of mind were explained by a continuation of the mechanism that led to the initial choice. Our findings extend the sequential sampling framework to vacillation about confidence and invites caution in interpreting dissociations between confidence and accuracy.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Changes of mind about choice and confidence in a motion-discrimination task are explained by continued bounded evidence accumulation after the initial decision, using the same evidence stream. This post-decision processing can produce an apparent dissociation between confidence and accuracy without invoking separate metacognitive mechanisms.
Key findings
- Four subjects made simultaneous direction and confidence reports by reaching to one of four targets; changes of mind occurred on 2.0–8.8% of trials, and confidence changes were more frequent than decision changes (p<1e-4 for all participants).
- Changes of decision were more likely after errors and with stronger motion; for three of four subjects they corrected an initial error more often than they spoiled a correct choice (P<0.001, P<0.001, P=0.084, P<0.001). Changes of confidence were more likely after low-confidence initial choices, and changes of mind earned 0.72–1.12 additional points per change trial.
- Motion-energy kernels showed that initial choice and confidence were supported by a common evidence stream, with information used until ~400 ms before movement onset. Post-decision information explained revisions: low-to-high confidence changes were supported by evidence for the initial choice, whereas high-to-low confidence changes were associated with evidence for the opposite direction.
- Comparing odds ratios from initial versus final confidence produced a systematic discrepancy (P<1e-4, sign test; reliable for 13 of 19 points, P<0.05 bootstrap), which the authors argue can arise from continued first-order evidence accumulation rather than a separate second-order confidence process.
Methods
- Six naïve right-handed subjects (ages 21–34) participated; two were excluded, leaving four analyzed. Subjects used a vBOT handle to judge random-dot motion direction and report confidence simultaneously, with coherence levels ±0, ±3.2, ±6.4, ±12.8, ±25.6, and ±51.2%; the stimulus was extinguished at movement onset. Each subject completed 12 sessions (9024–9216 trials), except Subject 4, for whom only the first 5000 trials were analyzed because of nonstationary behavior.
- Behavioral analyses used logistic regressions, ANOVA, Fisher exact tests, and motion-energy psychophysical kernels. The main model was a race between two accumulators receiving bivariate Gaussian evidence, with decision bound B, non-decision time, and a log-odds threshold θ for confidence; changes of mind were modeled by continued accumulation for a post-initiation period tpip with shifted thresholds δθ1–δθ3.
- Model parameters were fit by maximum likelihood to initial choice, confidence, and reaction-time data, then the change-of-mind model was fit with κ and θ carried over from the initial fits.
Limitations
- Stated: the model is imperfect—it overestimates confidence at the lowest motion strength and shows discrepancies at 0% coherence for three of four subjects; the flat bound does not capture RT distributions or mean RT on error trials, so only correct-trial mean RTs and 0% coherence trials were used in the cost function.
- Stated: basing changes of decision on log odds is a simplification, and the frequency of changes of mind was too small to evaluate more flexible post-initiation termination rules.
- Evident: the main conclusions rest on four analyzed subjects in a specific random-dot motion task with stationary evidence samples; the paper notes that other perceptual and memory-based decisions involve less well-characterized evidence streams.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 4—figure supplement 1. Estimation of the non-decision times from the psychophysical kernels. Although some previous studies measured the non-decision time as the point in time at which motion fluctuations no longer exert a significant influence on the initial choice, this method is biased because estimates of latency become shorter if non-decision times are more variable across trials, or if more trials are included. We used an alternative approach, which involves fitting a function, f(t), to the psychophysical kernels. (a) The shape of f(t) was derived assuming that the slow decay of the psychophysical kernels when aligned on movement onset is due to: (i) trial-to-trial variability in the non-decision time, and (ii) the smoothing introduced by the impulse response of the motion energy (inset; same as in Figure 4a). Without these influences, the influence of motion fluctuations on choice would step to zero at a fixed latency (μtnd) before movement (black solid line). Inter-trial variability in the non-decision time reduces the number of trials that contribute to the psychophysical kernel for times closer to movement onset. If this variability is assumed Gaussian, the step function is smoothed into a cumulative Gaussian (g[t μtnd, σtnd]; dashed line). To fit the psychophysical kernels, we also need to consider the additional smoothing introduced by the motion filter, which we do by convolving g(t) with the impulse response of the motion filter, IR(t), such thatf(t)=αg(t|μtnd,σtnd)*IR(t), where is α is an arbitrary scaling parameter. The final fit, that is f(t), is shown by the black line. To increase the statistical power, we combined the motion energy residuals from rightward and leftward choices, such that positive residuals indicate an excess of motion in the direction of the initial choice. The green shaded area represents s.e.m. for the average of the motion energy residuals, including trials from all subjects. We fit μtnd, σtnd and α to minimize the deviance between f(t) and the average of the motion energy residuals. The best-fitting parameters μtnd and σtnd are indicated in the panel. (b) Same analysis as in (a), but conducted separately for each subject. Latencies are similar to those obtained by fitting a bounded accumulation model (Table 1). DOI: http://dx.doi.org/10.7554/eLife.12192.011](/paper-figures/6349c161b1ff42158e5dd341fd04780c/a-common-mechanism-underlies-changes-of-mind-about-decisions-and-confidence-figure-8.jpg)
Verification
Claims the paper makes
44 Own result · 25 Not checked yet · 20 Own interpretation · 12 No basis given · 3 Own method
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, subjects reported high confidence more often on correct choices than on errors (Figure 2c), and they tended to be more confident on those errors associated with stronger motion (P<1e-5 for 3 subjects and P = 0.50 for S3).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Not surprisingly, stronger motion supported more accurate (Figure 2a) and faster decisions (Figure 2b), that tended to be assigned the higher confidence (Figure 2c).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that choice, confidence, and reaction time are explained by a sequential sampling mechanism operating on a common evidence stream.”
- Also stated in: § Abstract · plain
“When participants were asked to report choice and confidence simultaneously, their confidence, reaction time and a perceptual decision about motion were explained by bounded evidence accumulation.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
- Also stated in: § Abstract · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When subjects were more confident, they tended to be more accurate (Figure 2a; P<0.0001 for all subjects) and faster (Figure 2b; P<0.0001 for all subjects).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Not surprisingly, stronger motion supported more accurate (Figure 2a) and faster decisions (Figure 2b), that tended to be assigned the higher confidence (Figure 2c).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, subjects reported high confidence more often on correct choices than on errors (Figure 2c), and they tended to be more confident on those errors associated with stronger motion (P<1e-5 for 3 subjects and P = 0.50 for S3).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
hedgedcorrelationaln = 3 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Not surprisingly, stronger motion supported more accurate (Figure 2a) and faster decisions (Figure 2b), that tended to be assigned the higher confidence (Figure 2c).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When subjects were more confident, they tended to be more accurate (Figure 2a; P<0.0001 for all subjects) and faster (Figure 2b; P<0.0001 for all subjects).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
None of the sources cited for this claim have been checked yet.
In the paper
“For three of the four subjects, changes of decision corrected an initial error more often than they spoiled an initially correct choice (P<0.001, P<0.001, P = 0.084, P<0.001), consistent with previous reports (Resulaj et al., 2009; Burk et al., 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
What the sources say
plaincorrelationaln = 3 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similar hysteresis is seen for initial high confidence decisions (Figure 6, bottom row).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These values are consistent with the estimates of non-decision time (tnd) obtained from the model fits to the initial choices and RTs (Table 1).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“changes from high to low confidence were associated with motion information in support of the direction opposite to the one chosen (Figure 4b, middle)”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, all subjects required more evidence to change their initial decision about direction than a simple reversal in sign of the evidence (δθ2>0).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Those double changes that did occur tended to move from high to low confidence (1.03, 0.35, 0.12, 1.36%) compared to trials from low to high (0.26, 0.04, 0.04, 0.26%; p<0.0001 for three subjects and p<0.05 for S3).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
hedgedcorrelationaln = 4 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, by discounting the lag and smoothing introduced by the motion filter (inset), it is apparent that subjects relied on information from the beginning of the display until ~400 ms before movement onset (arrows; see Materials and methods and Figure 4—figure supplement 1) to guide both their direction choices and their confidence.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Changes of decision were more likely if the initial decision was an error than if it was correct (Figure 5a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A simple extension of the bounded accumulation model explains the frequency of these changes as well as their dependency on features of the stimulus and the subject’s initial report.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The curves in Figure 5 are fits of the model, which capture the main features of the subjects’ revisions of both choice and confidence.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Changes of mind were beneficial to the participants in that on changes of mind trials (either decision, confidence or both) the gain in points over not changing one’s mind ranged from 0.72–1.12 points across the subjects (Table 2).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirectn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Clearly, there is a systematic discrepancy between the OR pairs (P<1e-4, sign test).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
boostedn = 19- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The variations in the participants’ behavior are accounted for by the different settings of the model parameters”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“when subjects changed their confidence rating from low to high, the motion information in the post-decision period supported the initial choice (Figure 4b, bottom)”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After an initial low confidence decision (Figure 6, top row), all subjects required more belief to change to a high confidence decision than would have been required for an initial high confidence decision (δθ1>0).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These changes to high confidence were more likely when the initial low confidence accompanied a stronger motion.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These corrections were more likely if the motion information was stronger.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The influence of motion fluctuations on choice and confidence becomes negligible a few hundred milliseconds before movement onset (Figure 4a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“this trend was amplified for changes of mind about direction (Figure 4b, top)”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Changes of both decision and confidence were less common (0.4–1.6%), which may be partly due to an energy cost associated with crossing the workspace (Burk et al., 2014; Moher and Song, 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
hedgedn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Further, changes of confidence were more likely if the initial decision was low confidence than if it was high confidence (Figure 5b).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For all subjects, changes of confidence were more frequent than changes of decision (Table 2 and Figure 5c; p<1e-4 for all participants).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelationaln = 4 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, all participants relaxed their belief criterion when they changed their direction decision while either maintaining or changing to high confidence (δθ3<0).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
- The authors state this as an assumption: The state of the belief at tpip determines the final confidence and choice.
- The authors state this as an assumption: Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
- The authors state this as an assumption: The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here we show that this discrepancy can arise naturally because of simple processing delays.”
§ A common mechanism underlies changes of mind about decisions and confidence > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: There is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The first process to reach an upper bound determines the choice and decision time.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“These regularities are consistent with a common mechanism of bounded evidence accumulation to support choice, reaction time and confidence (Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
What the sources say
- Not checked yetcites Kiani et al., 2014a
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Since the winning process is at a fixed bound, the confidence is adequately summarized by the height of this bound, decision time, and the state of the losing accumulator.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Such changes of mind occur occasionally, even when there appears to be no additional information available after the initial decision has been rendered.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The similar time course of the confidence and choice kernels implies that the initial direction and confidence choices were supported by a common evidence stream.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
None of the sources cited for this claim have been checked yet.
In the paper
“Its main distinction is the recognition that the time to decision influences confidence (Fetsch et al., 2014; Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
What the sources say
- Not checked yetcites Fetsch et al., 2014 source
- Not checked yetcites Kiani et al., 2014a
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, changes of confidence arising through post-decision processing can contribute to an apparent dissociation between confidence and decision.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: There is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These changes of mind were explained by a continuation of the mechanism that led to the initial choice.”
§ A common mechanism underlies changes of mind about decisions and confidence > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
- The authors state this as an assumption: There is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.
None of the sources cited for this claim have been checked yet.
In the paper
“The same framework also explains the confidence that a decision is correct (Kiani and Shadlen, 2009; Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Kiani and Shadlen, 2009 source
- Not checked yetcites Kiani et al., 2014a
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“The process involves a race between a mechanism that accumulates evidence for right, and against left, and a process that integrates evidence for left, and against right (Usher and McClelland, 2001; Mazurek et al., 2003).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The sequential sampling framework (e.g., bounded evidence accumulation) offers a natural account of this phenomenon, because the mechanism incorporates processing delays, which leave open the possibility that the brain might have access to additional evidence that did not influence the initial decision and which might instead influence a revision.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The state of both the winning and losing processes as well as decision time (Figure 3b shows the races on the same plot) confer an expectation that a decision rendered on the evidence is likely to be correct, what we term confidence or belief.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Since these processes obtain evidence originating in the same stimulus, they will tend to accumulate noisy evidence of opposite sign (i.e., anti-correlated).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Thus, when the decision maker terminates deliberation, the choice is accompanied by a degree of certainty (i.e., confidence), based on the same stream of evidence that supported that decision (Fetsch et al., 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Fetsch et al., 2014 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thus the degree of belief is based on the balance of evidence (i.e., difference) between winning and losing DVs, as well as the decision time.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our findings extend the sequential sampling framework to vacillation about confidence and invites caution in interpreting dissociations between confidence and accuracy.”
§ A common mechanism underlies changes of mind about decisions and confidence > Abstract
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In other words, had we asked our subjects only for their confidence rating after they indicated their initial choice—without an opportunity to revise those choices—we would have detected a different relationship between confidence and accuracy (Figure 7).”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“but it demonstrates, nonetheless, that on many trials, the final confidence judgments are clearly based on additional information that did not affect the initial choice.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“We explain the initial choice and confidence using the identical stream of information, as in a previous study (Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
- Not checked yetcites Kiani et al., 2014a
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, it establishes that deliberation in the post-initiation epoch is as rich a process as the deliberation preceding initiation.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We wish to emphasize that confidence and direction reports remain coupled via a common mechanism at the time of both the initial and final decision.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelationaln = 4 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Choice and confidence are related but processed as if separate attributes, via a correspondence between decision variable and belief.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conclude that confidence, choice and reaction time can be understood in a common framework of bounded evidence accumulation.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Choice and confidence are related but processed as if separate attributes, via a correspondence between decision variable and belief.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, the finding explains a potential dissociation between the information that decision makers might use to guide confidence and choice.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When confidence is assessed after the initial choice, as it is in most experiments, then it ought to come as no surprise that choice and confidence are explained by only partially overlapping sources of information.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The state of both the winning and losing race together with decision time map directly to the log-odds of being correct (see Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
What the sources say
- Not checked yetcites Kiani et al., 2014a
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Momentary evidence is drawn from a bivariate Gaussian with mean (κC, -κC).
- The authors state this as an assumption: The two accumulators share noise with negative covariance ρ.
- The authors state this as an assumption: A decision is made when one of the two races crosses a decision bound B.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In our study, the answer seems to be negative”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The present study extends these observations to the metacognitive operation of assigning a degree of belief that the decision is correct.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 32
- It may state two separate claims as one. 26
- The quote only partly states this claim. 1
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Naturally, subjects differed in their sensitivity, speed/accuracy and confidence which was accounted for by the parameters of the fits (Table 1).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelationaln = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They also differed in their criteria for categorizing degree of belief into high and low, which can be appreciated by the separation of choice functions by confidence report.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plainn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smooth curves in Figure 2 are fits of the model (4 parameters; see Materials and methods), which capture the main features of the subjects’ choices.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelationaln = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Interestingly the inferred criteria for all the subjects were close to this optimal criterion, although all subjects were somewhat risk-averse (probability thresholds of 0.71, 0.78, 0.71 and 0.75; thresholds in log-odd units shown in Table 1).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plainn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There are some noteworthy discrepancies between model and data (e.g., proportion of high confidence choices at 0% coherence for 3 of 4 subjects), but the model captures the trend in the confidence ratings on error trials, mentioned above (3 of 4 subjects; Figure 2c), even though the fits themselves are dominated by the more numerous correct choices.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaincorrelationaln = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On a small fraction of trials, subjects changed their initial decision about the direction of motion and, more frequently, about their confidence.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that confidence and choice are informed by the same evidence, both at the initial choice and on any subsequent revision.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: The same information was used to reach an initial choice about direction and confidence.
- The authors state this as an assumption: There is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was a subtle bias for the bottom targets (50.6, 51.9, 52.5 and 51.4%, respectively), possibly due to kinematic factors, but recall that the orientation was balanced across the experiment.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Analysis
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subject 4 showed a qualitative change in behavior on the second half of their data (after ~5000 trials; Figure 2—figure supplement 2a), reporting high confidence on nearly all trials.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Procedure
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The model is by no means perfect (e.g., it overestimates confidence at the lowest motion strength)”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Just a few hundred milliseconds of additional evidence led to changes in the confidence associated with the initial choice, ranging from 1.5–6.3% of trials across our subjects, and this was enough to induce a clear departure from the level of confidence that ought to be associated with the evidence available at the time of the initial choice.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of course, errors were less frequent with stronger motion and less frequent than correct responses (Figure 2a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, our model could still fit the initial choices for the omitted second half of this participant's data (Figure 2—figure supplement 2b).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Procedure
hedgedSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The frequency of these changes of mind varied between subjects, from 2.0 to 8.8% of trials.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that despite the idiosyncrasy in this subject’s data, our model can fit their initial choices (Figure 2—figure supplement 1).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Procedure
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We have also fit data using time-dependent confidence bounds, which improve the fits for all subjects but does not affect the figures visibly and does not affect our conclusions.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, this explains why confidence associated with errors increases with stronger coherences: stronger motion induces faster decision times for correct and errors alike.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
None of the sources cited for this claim have been checked yet.
In the paper
“Evidence for such a process was adduced to explain reversals of perceptual decisions in humans and monkeys (Rabbitt, 1966; Rabbitt and Vyas, 1981; McPeek et al., 2000; Caspi and Beutter, 2004; Van Zandt and Maldonado-Molina, 2004; Resulaj et al., 2009; Burk et al., 2014; Kiani et al., 2014b; Moher and Song, 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“This last point remains controversial, however, for there are many instances when the confidence in a decision and the decision itself are dissociable.”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Fischoff et al., 1982
- Not checked yetcites Baranski and Petrusic, 1994
- Not checked yetcites Kunimoto et al., 2001 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“This model has been tested in neurophysiology and a previous report in humans (Kiani et al., 2014a) which extends ideas from signal detection theory, race, and Bayesian models (Vickers, 1979; Kepecs et al., 2008; Maniscalco and Lau, 2012; Drugowitsch et al., 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
What the sources say
- Not checked yetcites Kiani et al., 2014a
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The ensuing tradeoff between speed and accuracy is explained by sequential sampling with optional stopping models in which evidence is accumulated to some stopping criterion or bound (Link, 1975; Ratcliff and Rouder, 1998).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“To maximize the number of points, given the reward structure (see Materials and methods), subjects should choose high confidence if they believe the probability of a correct choice is greater than two-thirds, which corresponds to a log-odds of 0.69.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Initial decisions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“This is because the quantity that is accumulated, termed a decision variable (DV), when combined with elapsed decision time, maps to the probability that a decision rendered on its value will be correct (Kiani and Shadlen, 2009; Drugowitsch et al., 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Kiani and Shadlen, 2009
- Not checked yetcites Drugowitsch et al., 2014 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“and they can perform above chance level yet report they are guessing (Kunimoto et al., 2001).”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Kunimoto et al., 2001 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“For example, human decision makers tend to overestimate their certainty about choices based on truly ambiguous evidence (Fischoff et al., 1982; Baranski and Petrusic, 1994; Erev et al., 1994; Drugowitsch et al., 2014; Kiani et al., 2014a)”
§ A common mechanism underlies changes of mind about decisions and confidence > Introduction
What the sources say
- Not checked yetcites Fischoff et al., 1982
- Not checked yetcites Baranski and Petrusic, 1994
- Not checked yetcites Erev et al., 1994 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“To further reduce the degrees of freedom of the model to four we fixed both the covariance ρ to -0.5 ≈ -0.71 and non-decision time standard deviation σtnd to 60 ms (within the normal range from a previous study (Burk et al., 2014) and supported by an analysis of motion energy; see Figure 1—figure supplement 1).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
What the sources say
- Not checked yetcites Burk et al., 2014 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- The authors state this as an assumption: Reaction time is determined by the time to reach the decision bound plus a non-decision time modeled as a normal distribution with mean μtnd and standard deviation σtnd.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The observation supports a parsimonious account of decision confidence which is somewhat at odds with recent literature on meta-cognition (see Discussion).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plainn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For analytic simplicity (see below), we used a flat bound (i.e., stationary rather than collapsing), which does not capture the shape of the RT distributions and the mean RT on error trials (Drugowitsch et al., 2012).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
What the sources say
- Not checked yetcites Drugowitsch et al., 2012 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This discrepancy might be regarded as a sign of 2nd-order confidence, whereas it is simply the result of a continuation of the 1st-order process that couples choice and confidence, via bounded evidence accumulation.”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
hedgeddirectn = 19 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The variability across runs was minimal, suggesting that the optimization procedure converged to global maximum.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We show combined data for the two target configurations (high/low confidence targets at top/bottom), having reassured ourselves that the arrangement had no detectable effects on choice accuracy (p≥0.4; Fisher’s exact test) and only small effects on reaction time (RT) for 2 subjects (magnitudes<3%, p<0.01; t-test).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Analysis
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The class of bounded sequential sampling models, including many variants (Wald, 1947; Stone, 1960; Laming, 1968; Link, 1975; Good, 1979; Luce, 1986; Ratcliff and Rouder, 1998) explains the tradeoff between speed and accuracy, and many of the essential steps have correlates in neurophysiology (Romo et al., 2002; Heekeren et al., 2004; Ploran et al., 2007; Heitz and Schall, 2012; White et al., 2012;”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This implies that termination has a kind of specificity; it marks the end of deliberation for purposes of response initiation, but it does not actually terminate all deliberation.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“In previous studies, we showed that the motor system receives a continuous updating of the state of the evidence leading to a choice (Gold and Shadlen, 2000; Selen et al., 2012) and can utilize the late arriving information to revise an initial choice by continuing the process of deliberation (Resulaj et al., 2009; Burk et al., 2014).”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The present study establishes that this assessment evolves in time and, like the choice itself, can undergo revision with additional evidence.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Using this analytic method precluded the use of collapsing decision bounds (and no lower reflecting bounds; cf., Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
What the sources say
- Not checked yetcites Kiani et al., 2014a
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Importantly, however, this does not imply a dissociation between confidence and the decision (Pleskac and Busemeyer, 2010), as the latter can also be revised based on the same additional information.”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
- Not checked yetcites Pleskac and Busemeyer, 2010
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In principle, such a mechanism could terminate post-initiation processing more flexibly, but the frequency of change of mind about choice and confidence is too small to evaluate this possibility.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one. The quote only partly states this claim.
- The authors state this as an assumption: Once the initial decision has been made, the accumulators continue to integrate information that was not accessible at the time of the initial decision for a further post-initiation period tpip.
- The authors state this as an assumption: A change in confidence or choice occurs if at the end of the post-initiation period the log odds crosses a confidence or choice threshold.
In the paper
“Yet the operations leading to confidence seem neither mysterious nor dissociable from the decision process (cf. De Martino et al., 2013).”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
- Not checked yetcites De Martino et al., 2013 source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The evaluation of additional evidence may explain why confidence ratings are more strongly correlated with accuracy when they are reported with less time pressure (Yu et al., 2015), and why some individuals appear to be better than others at discriminating correct from incorrect decisions (e.g. Ais et al., 2016).”
§ A common mechanism underlies changes of mind about decisions and confidence > Discussion
What the sources say
- Not checked yetcites Yu et al., 2015
- Not checked yetcites Ais et al., 2016 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The ORs calculated from the initial confidence report establish a baseline: the breakdown of confidence associated with the information that explains the accuracy at each motion strength, analogous to meta-d′ equal to d′ in the SDT framework described above.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Analysis
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The meta-d′ statistic is not well behaved in the sequential sampling framework, but the basic logic remains applicable (see Materials and methods).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“This choice of covariance assumes that about half the noise is shared between the two accumulators (i.e. arises from the stimulus) and is within the normal range of fitted covariances (Kiani et al., 2014a).”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Model
What the sources say
- Not checked yetcites Kiani et al., 2014a
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: About half the noise is shared between the two accumulators (arises from the stimulus).
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, the SDT framework must be extended to account for RT and choice.”
§ A common mechanism underlies changes of mind about decisions and confidence > Materials and methods > Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: Under sequential sampling models, meta-d′ ≠ d′ even when choice and confidence are explained by the same decision variable.
None of the sources cited for this claim have been checked yet.
In the paper
“Evidence for a meta-cognitive process is adduced from a dissociation between the signal-to-noise properties of the evidence that would support a level of choice accuracy versus the level associated with a degree of confidence (e.g., meta-d′; see Fleming and Lau, 2014; Maniscalco and Lau, 2012).”
§ A common mechanism underlies changes of mind about decisions and confidence > Results > Changes of mind
What the sources say
- Not checked yetcites Fleming and Lau, 2014 source
- Not checked yetcites Maniscalco and Lau, 2012
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The authors state this as an assumption.
Subjects adopt a consistent criterion on degree of belief (log odds) to decide in favor of high or low confidence.
“For simplicity, we assumed that subjects adopt a consistent criterion on “degree of belief” (log odds, Figure 3b) to decide in favor of high or low confidence.”
The authors state this as an assumption.
The same information was used to reach an initial choice about direction and confidence.
“The critical assumptions are (i) the same information was used to reach an initial choice about direction and confidence, and (ii) there is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.”
The authors state this as an assumption.
There is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.
“The critical assumptions are (i) the same information was used to reach an initial choice about direction and confidence, and (ii) there is additional information available to the decision maker after committing to a choice and confidence category, despite the disappearance of the random dot motion upon response initiation.”
The authors state this as an assumption.
Evidence was accumulated past the point of the initial decision for a fixed amount of time (tpip) that is less than the non-decision time.
“We assumed that evidence was accumulated past the point of the initial decision for a fixed amount of time (a free parameter, tpip) that is less than the non-decision time.”
The authors state this as an assumption.
The state of the belief at tpip determines the final confidence and choice.
“The state of the belief at tpip determines the final confidence and choice (see Materials and methods).”
The authors state this as an assumption.
Subjects might not apply identical criteria for confidence and choice in the pre- and post-initiation epoch (δθ parameters).
“we allowed for the possibility that subjects might not apply the identical criteria for confidence and choice in the pre- and post-initiation epoch (the δθ parameters; see Materials and methods).”
The authors state this as an assumption.
Choice and confidence are related but processed as if separate attributes, via a correspondence between decision variable and belief.
“To explain our findings, we assumed that choice and confidence are related but processed as if separate attributes, via a correspondence between decision variable and belief.”
The authors state this as an assumption.
The model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.
“Note that the model parameterization requires the pink and red regions to be same for both initial high and low confidence decisions.”
The paper relies on this without support.
Non-decision time typically exceeds 300 ms even in relatively fast perceptual decisions.
“Even in relatively fast perceptual decisions, this so-called non-decision time typically exceeds 300 ms.”
The paper relies on this without support.
The temporal stream of evidence in random dot kinematograms is effectively a sequence of independent, statistically stationary samples.
“the temporal stream of evidence is effectively a sequence of independent, statistically stationary samples.”
The paper relies on this without support.
There are processing delays between the arrival of information from the environment and updating its representation in working memory as a decision variable, and there are delays between commitment to a decision and communicating this decision through the motor system.
“Specifically, there are processing delays between the arrival of information from the environment and updating its representation in working memory as a decision variable bearing on a proposition, and there are delays between commitment to a decision and communicating this decision through the motor system.”
The authors state this as an assumption.
About half the noise is shared between the two accumulators (arises from the stimulus).
“This choice of covariance assumes that about half the noise is shared between the two accumulators (i.e. arises from the stimulus) and is within the normal range of fitted covariances (Kiani et al., 2014a).”
The authors state this as an assumption.
Once the initial decision has been made, the accumulators continue to integrate information that was not accessible at the time of the initial decision for a further post-initiation period tpip.
“To model changes of mind, we assumed that once the initial decision had been made, the accumulators continued to integrate information that was not accessible at the time of the initial decision (due to latencies in the sensory and motor system) for a further post-initiation period tpip (constrained to be less than tnd).”
The authors state this as an assumption.
A change in confidence or choice occurs if at the end of the post-initiation period the log odds crosses a confidence or choice threshold.
“A change in confidence or choice would occur if at the end of this period the log odds crossed a confidence or choice threshold, respectively (Figure 3b).”
The paper relies on this without support.
There are motor costs involved in changes of mind.
“Since there are motor costs involved in changes of mind, we included additional parameters that could move the confidence and choice thresholds away from their initial values in the post-initiation stage by δθ1, δθ2 and δθ3 (Figure 3b).”
The paper relies on this without support.
Under sequential sampling models, meta-d′ ≠ d′ even when choice and confidence are explained by the same decision variable.
“Under sequential sampling (e.g., bounded drift diffusion), meta-d′ ≠ d′, even when the choice and confidence are explained by the same decision variable.”
The authors state this as an assumption.
Momentary evidence is drawn from a bivariate Gaussian with mean (κC, -κC).
“Momentary evidence was modeled as draws from a bivariate Gaussian with a mean that depends on the coherence (C) such that drift rate (/s) is κC for the rightward and -κC for the leftward accumulator, giving a mean of (κC,-κC).”
The authors state this as an assumption.
The two accumulators share noise with negative covariance ρ.
“The bivariate Gaussian has a negative covariance ρ which determines the extent to which the two accumulators share noise (for example arising from fluctuations in the stimulus).”
The authors state this as an assumption.
A decision is made when one of the two races crosses a decision bound B.
“A decision is made when one of the two races crosses a decision bound B.”
The authors state this as an assumption.
Reaction time is determined by the time to reach the decision bound plus a non-decision time modeled as a normal distribution with mean μtnd and standard deviation σtnd.
“The reaction time is determined by the time to reach the decision bound and an additional non-decision time (e.g., due to sensory and motor latencies) which was modeled as a normal distribution with mean μtnd and standard deviation σtnd.”
The authors state this as an assumption.
Confidence is modeled with a log-odds threshold θ separating high from low confidence judgments.
“To model confidence, we included a log-odds threshold θ which separated high from low confidence judgments.”
The authors state this as an assumption.
The confidence threshold is time-invariant.
“For simplicity, we chose a time-invariant threshold.”
The paper relies on this without support.
Fluctuations have a stronger impact when motion is weak.
“Because fluctuations have a stronger impact when motion is weak, only the lowest motion strengths (≤6.4% coh) were included in these analyses.”
The paper relies on this without support.
Due to the stochastic nature of the motion stimuli, the strength of motion varies from trial to trial and within a trial.
“Due to the stochastic nature of the motion stimuli, the strength of motion will vary from trial to trial, and even within a trial.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Variation in post-decision confidence predicts how likely the decision is to be revised if an opportunity arises,9”
From Two prefrontal-subcortical circuits estimate controllability and reflect its impact on learning (2026) · cites this paper as [11]
Experimental — accuracy not yet measured
Citations
Cites
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Self-citationSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152
(1986) · Cited by 2,022
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
Self-citationRoitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589
Self-citationModeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 2×
“Nor do we know how a criterion is applied to this mapping to render the categorical 354 choices in our study, or in post-decision wagering decisions (Kiani and Shadlen, 2009), or in 355 confidence ratings (Maniscalco and Lau, 2012; Fleming and Lau, 2014; Kiani et al., 2014a).”
BackgroundMethodRepresentation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027
Self-citation
Research works printed but not linked: 1
- Wald, 1947, Sequential Analysis
Cited by
Sorted by citations
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Rouault, M., Seow, T. X. F., Gillan, C. M., & Fleming, S. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.12.017 · Cited by 349
Decision-making in sensorimotor control
Gallivan, J. P., Chapman, C. S., Wolpert, D. M., & Flanagan, J. R. (2018) · Nature reviews. Neuroscience · doi:10.1038/s41583-018-0045-9 · Cited by 332
Self-citationSubjective Confidence Predicts Information Seeking in Decision Making
Desender, K., Boldt, A., & Yeung, N. (2018) · Psychological Science · doi:10.1177/0956797617744771 · Cited by 296
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“Pleskac & Busemeyer (2010) additionally proposed that this evidence accumulation process may continue after a decision has been made, to inform estimates of decision confidence and potentially leading to changes of mind (van den Berg et al., 2016a, Resulaj et al., 2009).”
Metadata
- Authors
- van den Berg, R., Anandalingam, K., Zylberberg, A., Kiani, R., Shadlen, M. N., & Wolpert, D. M.
- Affiliations
- Computational and Biological Learning Laboratory, Department of Engineering, Cambridge University, Cambridge, United Kingdom
- University of Cambridge (GB)
- Howard Hughes Medical Institute (US)
- New York University (US)
- Corresponding author
- Wolpert, Daniel M
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2016-02-01
- Volume
- 5
- Pages
- e12192-e12192
- ISSN
- 2050-084X (ISSN-L)
- PMC
- PMC4798971
- OpenAlex
- W2261997804
- Semantic Scholar
- 8a3457c13959cfb9435daf0710bf5eac7eacbc9b
- Cited by
- 270
- References
- 67
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 23 · 2023: 38 · 2022: 24 · 2021: 26 · 2020: 32 · 2019: 26 · 2018: 31 · 2017: 16 · 2016: 14
- FWCI
- 25.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- eLife (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Wellcome Trust
- Howard Hughes Medical Institute
- Royal Society
- Human Frontier Science Program
- National Eye Institute
- Simons Foundation
- Alfred P. Sloan Foundation
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- decision confidence, sequential sampling, vacillation, change of mind, perceptual decision making, motion direction discrimination, reaction time, processing delay
- MeSH terms
- Choice Behavior, Decision Making, Humans, Models, Neurological, Reaction Time, Healthy Volunteers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
