Who’s afraid of response bias?
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Response bias (or criterion) contamination is insidious in studies of consciousness: that observers report they do not see a stimulus may not mean they have absolutely no subjective experience; they may be giving such reports in relative terms in the context of other stimuli. Bias-free signal detection theoretic measures provide an excellent method for avoiding response bias confounds, and many researchers correctly adopt this approach. However, here we discuss how a fixation on avoiding criterion effects can also be misleading and detrimental to fruitful inquiry. In a recent paper, Balsdon and Azzopardi (Absolute and relative blindsight. Consciousness and Cognition 2015; 32:79–91.) claimed that contamination by response bias led to flawed findings in a previous report of “relative blindsight”. We argue that their criticisms are unfounded. They mistakenly assumed that others were trying (and failing) to apply their preferred methods to remove bias, when there was no such intention. They also dismissed meaningful findings because of their dependence on criterion, but such dismissal is problematic: many real effects necessarily depend on criterion. Unfortunately, these issues are technically tedious, and we discuss how they may have confused others to misapply psychophysical metrics and to draw questionable conclusions about the nature of TMS (transcranial magnetic stimulation)-induced blindsight. We conclude by discussing the conceptual importance of criterion effects in studies of conscious awareness: we need to treat them carefully, but not to avoid them without thinking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Suñé, P., Suñé, J. M., & Montoro, J. B. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054583 · Cited by 1,687
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 2×
“We conclude by discussing the conceptual importance of criterion effects in studies of conscious awareness: we need to treat them carefully, but not to avoid them without thinking.”
BackgroundSelf-citationMacmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262 · cited 2×
“Certain perceptual phenomena— such as the sound-induced flash illusion (Shams et al., 2000; Shams, 2002), the ventriloquist effect (Howard and Templeton, 1966; Thurlow and Jack, 1973), the stream-bounce effect (Sekuler et al.”
BackgroundManiscalco, B., & Lau, H. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.09.021 · Cited by 883
Self-citationEmpirical support for higher-order theories of conscious awareness
Lau, H., & Rosenthal, D. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.05.009 · Cited by 869 · cited 3×
“dissociation allows us to avoid confounding awareness with just basic perceptual processing, and thereby to address the phenomenon of conscious awareness in a conceptually meaningful way (Lau, 2008; Lau and Rosenthal, 2011).”
BackgroundSelf-citationRelative blindsight in normal observers and the neural correlate of visual consciousness
Lau, H. C., & Passingham, R. E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607716103 · Cited by 518 · cited 17×
“Yet it is worth noting that Balsdon and Azzopardi (2015) seem to be so concerned about response biases that they misread Lau and Passingham (2006), and so incorrectly reported Lau and Passingham’s (2006) conclusions.”
BackgroundMethodInfluentialSelf-citationRounis, E., Maniscalco, B., Rothwell, J. C., Passingham, R. E., & Lau, H. (2010) · Cognitive Neuroscience · doi:10.1080/17588921003632529 · Cited by 407 · cited 1×
“…research, mainly because the observed experimental effect was small (though replicable; Maniscalco and Lau, 2010; Maniscalco et al., 2016) and there are likely better experimental paradigms to probe the same conceptual questions (e.g. Rounis et al., 2010; Rahnev et al., 2011; Koizumi et al., 2015).”
BackgroundSelf-citationGalvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
Attention without awareness in blindsight
Kentridge, R. W., Heywood, C. A., & Weiskrantz, L. (1999) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1999.0850 · Cited by 362 · cited 2×
“Bias-free signal detection theoretic measures provide an excellent method for avoiding response bias confounds, and many researchers correctly adopt this approach.”
BackgroundMethodConfidence and accuracy of near-threshold discrimination responses
Kunimoto, C., Miller, J., & Pashler, H. (2001) · Consciousness and Cognition · doi:10.1006/ccog.2000.0494 · Cited by 291
On the inter-relatedness of theory and measurement in the study of unconscious processes
REINGOLD, E. M., & MERIKLE, P. M. (1990) · Mind & Language · doi:10.1111/j.1468-0017.1990.tb00150.x · Cited by 255
Attention induces conservative subjective biases in visual perception
Rahnev, D., Maniscalco, B., Graves, T., Huang, E., de Lange, F. P., & Lau, H. (2011) · Nature Neuroscience · doi:10.1038/nn.2948 · Cited by 241
Self-citationDistinct brain mechanisms for conscious versus subliminal error detection
Charles, L., Van Opstal, F., Marti, S., & Dehaene, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.054 · Cited by 208 · cited 1×
“correspondence between confidence and accuracy) and conscious awareness (Charles et al., 2013; Fleming and Lau, 2014; Jachs et al., 2015).”
BackgroundBlindsight in normal observers
Kolb, F. C., & Braun, J. (1995) · Nature · doi:10.1038/377336a0 · Cited by 198 · cited 4×
“Because blindsight patients are rare, there have been attempts to recreate blindsight in healthy subjects (Kolb and Braun, 1995; Kunimoto et al., 2001).”
BackgroundMethodInfluentialPeters, M. A. K., & Lau, H. (2015) · eLife · doi:10.7554/elife.09651 · Cited by 197
Self-citationManiscalco, B., Peters, M. A. K., & Lau, H. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1059-x · Cited by 129 · cited 5×
“…measure was subsequently addressed empirically: using a biasfree signal detection theoretic (SDT) measure of sensitivity (d’) in the objective task, Maniscalco and colleagues (Maniscalco and Lau, 2010; Maniscalco et al., 2016) replicated Lau and Passingham’s (2006) relative blindsight finding.”
BackgroundMethodResultInfluentialSelf-citationOn demonstrating unconscious perception: comment on Draine and Greenwald (1998)
Merikle, P. M., & Reingold, E. M. (1998) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.127.3.304 · Cited by 108 · cited 1×
“…been discussed at length in the study of semantic priming (Holender, 1992; Duscherer and Holender, 2005), unconscious processing (see Reingold and Merikle, 1990; Merikle and Reingold, 1998 for reviews), and indeed any task which can be analyzed with SDT metrics (Macmillan and Creelman, 1990, 2004).”
BackgroundVisual experience and blindsight: a methodological review
Overgaard, M. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2578-2 · Cited by 93 · cited 2×
“Bias-free signal detection theoretic measures provide an excellent method for avoiding response bias confounds, and many researchers correctly adopt this approach.”
BackgroundMethodAre we studying consciousness yet?
Lau, H. C. (2008) · Frontiers of ConsciousnessChichele Lectures · doi:10.1093/acprof:oso/9780199233151.003.0008 · Cited by 88
Self-citationBlindsight in normal subjects?
Morgan, M. J., Mason, A. J. S., & Solomon, J. A. (1997) · Nature · doi:10.1038/385401b0 · Cited by 82 · cited 2×
“Unfortunately, some of these efforts have turned out to be not replicable (Morgan et al., 1997; Robichaud and Stelmach, 2003); others revealed the mathematical complexity of estimating the correspondence between confidence and accuracy (Galvin et al., 2003; Evans and Azzopardi, 2007; Maniscalco and…”
BackgroundEvaluation of a 'bias-free' measure of awareness
Azzopardi, P., & Evans, S. (2007) · Spatial Vision · doi:10.1163/156856807779369742 · Cited by 68 · cited 6×
“Unfortunately, these issues are technically tedious, and we discuss how they may have confused others to misapply psychophysical metrics and to draw questionable conclusions about the nature of TMS (transcranial magnetic stimulation)-induced blindsight.”
BackgroundInfluentialA decisional account of subjective inflation of visual perception at the periphery
Solovey, G., Graney, G. G., & Lau, H. (2015) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-014-0769-1 · Cited by 63 · cited 1×
“Changing the criterion may be an important perceptual phenomenon, both in cases of normal perception (e.g. Rahnev et al., 2011; Solovey et al., 2014) and in neurological cases of blindsight (Ko and Lau, 2012).”
BackgroundSelf-citationComparing signal detection models of perceptual decision confidence
Maniscalco, B., & Lau, H. (2010) · Journal of Vision · doi:10.1167/10.7.213 · Cited by 15 · cited 5×
“…measure was subsequently addressed empirically: using a biasfree signal detection theoretic (SDT) measure of sensitivity (d’) in the objective task, Maniscalco and colleagues (Maniscalco and Lau, 2010; Maniscalco et al., 2016) replicated Lau and Passingham’s (2006) relative blindsight finding.”
BackgroundMethodResultInfluentialSelf-citation
Cited by
The Edge of Sentience: Risk and Precaution in Humans, Other Animals, and AI
Birch, J. (2024) · doi:10.1093/9780191966729.001.0001 · Cited by 236
Spontaneous Brain Oscillations and Perceptual Decision-Making
Samaha, J., Iemi, L., Haegens, S., & Busch, N. A. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.05.004 · Cited by 192
Conscious access in the near absence of attention: critical extensions on the dual-task paradigm
Matthews, J., Schröder, P., Kaunitz, L., van Boxtel, J. J. A., & Tsuchiya, N. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0352 · Cited by 64
Birch, J. (2024) · The Edge of Sentience · doi:10.1093/9780191966729.003.0003 · Cited by 1
Metadata
- Authors
- Peters, M. A. K., Ro, T., & Lau, H.
- Venue
- Neuroscience of Consciousness
- Publisher
- Oxford University Press (OUP)
- Published
- 2016
- Volume
- 2016
- Issue
- 1
- Pages
- niw001
- ISSN
- 2057-2107 (ISSN-L)
- OpenAlex
- W2326506044
- Cited by
- 85
- References
- 24
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.