The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Nonparametric indexes for sensitivity and bias: Computing formulas.
Abstract
Computing formulas are derived for two nonparametric indexes of sensitivity and bias that have been suggested for signal detectability studies. A relationship is shown between the sensitivity index and P(I), a statistic whose sampling variability is known. An additional index of bias is proposed, which is free of certain inconveniences, yet yields identical isobias contours. Use of the new indexes is illustrated with several sets of data. Development of the theory of signal detectability has lead to a renewed interest in the possible processes involved in perception, psychophysics, and recognition memory. To a considerable extent both theory and research in these areas have rested on specific assumptions about the underlying distributions (as in the various threshold theories versus normality). But even without explicit assumption about the distributions, data are often judged by how close they lie to operating characteristic curves derived from normal distributions, and different experimental conditions are characterized by their value of d'. Recently there has been a growing interest in various "nonparametric " analyses of detection/ recognition experiments, where specific underlying distributions are not assumed. Following one line of development, Green (1964) has shown that for experiments using the yes-no procedure, the area under the (theoretical) operating characteristic curve can be interpreted as the percentage correct on an equivalent unbiased forced-choice test, and that this is true for any continuous underlying distributions. The sampling variability of this area measure has been determined by Pollack and Hsieh (1969). A similar proof for ratingscale experiments is due to Green and Moses (1966). However, using data to estimate the area under a curve of unknown theoretical shape presents difficulties. One expedient has been to connect the points and use the trapezoidal rule (Green & Moses, 1966; Pollack, Norman, & Galanter, 1964). If the true func-
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
A non-parametric analysis of recognition experiments
Pollack, I., & Norman, D. A. (1964) · Psychonomic Science · doi:10.3758/bf03342823 · Cited by 496
Evaluation of research on expectancy theory predictions of employee performance.
Heneman, H. G., & Schwab, D. P. (1972) · Psychological Bulletin · doi:10.1037/h0033093 · Cited by 225
Nonparametric index of response bias for use in detection and recognition experiments.
Hodos, W. (1970) · Psychological Bulletin · doi:10.1037/h0029933 · Cited by 162
Signal-detection theory and short-term memory.
Murdock, B. B. (1965) · Journal of Experimental Psychology · doi:10.1037/h0022543 · Cited by 118
Sampling variability of the area under the ROC-curve and of d'e.
Pollack, I. W., & Hsieh, R. (1969) · Psychological Bulletin · doi:10.1037/h0026862 · Cited by 100
On the equivalence of two recognition measures of short-term memory.
Green, D. M., & Moses, F. L. (1966) · Psychological Bulletin · doi:10.1037/h0023645 · Cited by 98
Use of rank order data in functional measurement.
Weiss, D. J., & Anderson, N. H. (1972) · Psychological Bulletin · doi:10.1037/h0032939 · Cited by 23
Test of normality against skewed alternatives.
D’Agostino, R. B., & Cureton, E. E. (1972) · Psychological Bulletin · doi:10.1037/h0033113 · Cited by 11
Cited by
Pragmatics of measuring recognition memory: Applications to dementia and amnesia.
Snodgrass, J. G., & Corwin, J. (1988) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.117.1.34 · Cited by 3,089
Calculation of signal detection theory measures
Stanislaw, H., & Todorov, N. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207704 · Cited by 2,673
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976
Exploring differences in males’ and females’ processing strategies
Meyers-Levy, J., & Maheswaran, D. (1991) · Journal of Consumer Research · doi:10.1086/209241 · Cited by 779
Developmental changes in perception of nonnative vowel contrasts.
Polka, L., & Werker, J. F. (1994) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.20.2.421 · Cited by 721
Sensitivity to grammatical structure in so-called agrammatic aphasics
Linebarger, M. C., Schwartz, M. F., & Saffran, E. M. (1983) · Cognition · doi:10.1016/0010-0277(83)90015-x · Cited by 697
Happé, F., Booth, R., Charlton, R., & Hughes, C. (2006) · Brain and Cognition · doi:10.1016/j.bandc.2006.03.004 · Cited by 638
“5 (chance performance) to 1 (indicating perfect sensitivity), calculated according to Grier (1971) with the formula”
MethodInfluentialBrown, S. W. (1997) · Perception & Psychophysics · doi:10.3758/bf03205526 · Cited by 583
Recognizing faces of other ethnic groups: An integration of theories.
Sporer, S. L. (2001) · Psychology Public Policy and Law · doi:10.1037//1076-8971.7.1.36 · Cited by 545
Sustained attention deficit in bipolar disorder
Clark, L., Iversen, S. D., & Goodwin, G. M. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.4.313 · Cited by 539
Gist-Based False Recognition of Pictures in Older and Younger Adults
Koutstaal, W., & Schacter, D. L. (1997) · Journal of Memory and Language · doi:10.1006/jmla.1997.2529 · Cited by 505
Remember-Know: A Matter of Confidence.
Dunn, J. C. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.524 · Cited by 505
Preattentive Mere Exposure Effects
Janiszewski, C. (1993) · Journal of Consumer Research · doi:10.1086/209356 · Cited by 455
Speed of Processing in Children With Specific Language Impairment
Miller, C. A., Kail, R., Leonard, L. B., & Tomblin, J. B. (2001) · Journal of Speech, Language, and Hearing Research · doi:10.1044/1092-4388(2001/034 · Cited by 450
Inversion and Configuration of Faces
Bartlett, J. C., & Searcy, J. (1993) · Cognitive Psychology · doi:10.1006/cogp.1993.1007 · Cited by 439
Meta-analysis of the sensitivity decrement in vigilance.
See, J. E., Howe, S. R., Warm, J. S., & Dember, W. N. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.117.2.230 · Cited by 410
Response bias: Characteristics of detection theory, threshold theory, and "nonparametric" indexes.
Macmillan, N. A., & Creelman, C. D. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.107.3.401 · Cited by 376
Implicit Perceptual Anticipation Triggered by Statistical Learning
Turk-Browne, N. B., Scholl, B. J., Johnson, M. K., & Chun, M. M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0858-10.2010 · Cited by 363
Simple, effective countermeasures to P300‐based tests of detection of concealed information
Rosenfeld, J. P., Soskins, M., Bosh, G., & Ryan, A. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00158.x · Cited by 361
The development of facial emotion recognition: the role of configural information
Durand, K., Gallay, M., Seigneuric, A., Robichon, F., & Baudouin, J.-Y. (2007) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2006.12.001 · Cited by 355
“After the first task, participants were told that they would see stimuli in which two facial parts expressing different emotions were presented together either aligned or not aligned.”
InfluentialBjork, J. M., Hommer, D. W., Grant, S. J., & Danube, C. (2004) · Alcohol · doi:10.1016/j.alcohol.2004.06.012 · Cited by 354
“” On the basis of reports that the frontal lobes are involved in behavior control (ECF) [see, for example, Horn et al. (2003)], coupled with findings that dysfunctional ECF is both a potential risk factor for (Deckel et al.”
BackgroundMethods of Behavior Analysis in Neuroscience
(2000) · CRC Press eBooks · doi:10.1201/9781420041811 · Cited by 336
Automatic Mood-Congruent Amygdala Responses to Masked Facial Expressions in Major Depression
Suslow, T., Konrad, C., Kugel, H., Rumstadt, D., Zwitserlood, P., Schöning, S., Ohrmann, P., Bauer, J., Pyka, M., Kersting, A., et al. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.07.023 · Cited by 328
Kuperberg, G. R., McGuire, P. K., Bullmore, E. T., Brammer, M. J., Rabe-Hesketh, S., Wright, I. C., Lythgoe, D. J., Williams, S. C. R., & David, A. S. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562138 · Cited by 305
Nelson, J. T., McKinley, R. A., Golob, E. J., Warm, J. S., & Parasuraman, R. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2012.11.061 · Cited by 300
Interoceptive awareness in experienced meditators
Khalsa, S. S., Rudrauf, D., Damasio, A. R., Davidson, R. J., Lutz, A., & Tranel, D. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00666.x · Cited by 280
Emerging Integration of Sequential and Suprasegmental Information in Preverbal Speech Segmentation
Morgan, J. L., & Saffran, J. R. (1995) · Child Development · doi:10.1111/j.1467-8624.1995.tb00913.x · Cited by 279
Stereotype efficiency reconsidered: Encoding flexibility under cognitive load.
Sherman, J. W., Lee, A. Y., Bessenoff, G. R., & Frost, L. A. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.3.589 · Cited by 277
Plaks, J. E., Stroessner, S. J., Dweck, C. S., & Sherman, J. W. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.6.876 · Cited by 273
Phonological phrase boundaries constrain lexical access I. Adult data
Christophe, A., Peperkamp, S., Pallier, C., Block, E., & Mehler, J. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.07.001 · Cited by 271
Yang, M., Roskos-Ewoldsen, D. R., Dinu, L., & Arpan, L. M. (2006) · Journal of Advertising · doi:10.2753/joa0091-3367350410 · Cited by 269
Lovelace, C. T., Stein, B. E., & Wallace, M. T. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00160-5 · Cited by 267
Does consistent scene context facilitate object perception?
Hollingworth, A. (1998) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.127.4.398 · Cited by 267
Age-Related Differences in Movement Control: Adjusting Submovement Structure To Optimize Performance
Walker, N., Philbin, D. A., & Fisk, A. D. (1997) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/52b.1.p40 · Cited by 262
Hollingworth, A. (2004) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.30.3.519 · Cited by 258
Orienting attention in visual working memory reduces interference from memory probes.
Makovski, T., Sussman, R., & Jiang, Y. V. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.34.2.369 · Cited by 253
A single dose of citalopram increases fear recognition in healthy subjects
Browning, M., Reid, C., Cowen, P. J., Goodwin, G. M., & Harmer, C. J. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881106074062 · Cited by 245
Situation awareness during driving: Explicit and implicit knowledge in dynamic spatial memory.
Gugerty, L. J. (1997) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.3.1.42 · Cited by 227
Mehta, M. A., Sahakian, B. J., McKenna, P. J., & Robbins, T. W. (1999) · Psychopharmacology · doi:10.1007/s002130051102 · Cited by 223
Interoceptive awareness declines with age
Khalsa, S. S., Rudrauf, D., & Tranel, D. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00859.x · Cited by 211
Highly neurotic never-depressed students have negative biases in information processing
CHAN, S. W. Y., GOODWIN, G. M., & HARMER, C. J. (2007) · Psychological Medicine · doi:10.1017/s0033291707000669 · Cited by 195
Tranter, R., Bell, D., Gutting, P., Harmer, C., Healy, D., & Anderson, I. M. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.01.028 · Cited by 184
COMMUNICATING WITH THE SEXES: Male and Female Responses to Print Advertisements
Putrevu, S. (2004) · Journal of Advertising · doi:10.1080/00913367.2004.10639168 · Cited by 182
“The ability of the respondents to correctly identify the details about the advertised brand was assessed by calculating signal detection scores as proposed by Grier (1971).”
MethodTsao, F.-M., Liu, H.-M., & Kuhl, P. K. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2338290 · Cited by 174
Broca's area, sentence comprehension, and working memory: an fMRI study
Rogalsky, C. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.014.2008 · Cited by 172
“We then calculated corresponding a′ statistics, which provide an estimate of proportion correct corrected for response bias (Grier, 1971).”
MethodMasson, M. E. J., & Rotello, C. M. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0014876 · Cited by 173
Hayward, G., Goodwin, G. M., Cowen, P. J., & Harmer, C. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.11.016 · Cited by 162
Sun, L., Grutzner, C., Bolte, S., Wibral, M., Tozman, T., Schlitt, S., Poustka, F., Singer, W., Freitag, C. M., & Uhlhaas, P. J. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.1073-12.2012 · Cited by 151
Deficits in high- (>60 Hz) gamma-band oscillations during visual processing in schizophrenia
Grützner, C., Wibral, M., Sun, L., Rivolta, D., Singer, W., Maurer, K., & Uhlhaas, P. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00088 · Cited by 140
The Relationship Between Online Visual Representation of a Scene and Long-Term Scene Memory.
Hollingworth, A. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.3.396 · Cited by 140
“However, that earlier study artificially controlled participants’ eye movement scan path 2 For above-chance performance, A was calculated as specified by Grier (1971): A 1 2 y x 1 y x 4y 1 x where y is the hit rate and x the false-alarm rate.”
MethodInfluentialStuhrmann, A., Dohm, K., Kugel, H., Zwanzger, P., Redlich, R., Grotegerd, D., Rauch, A. V., Arolt, V., Heindel, W., Suslow, T., et al. (2013) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.120060 · Cited by 112
Sun, L., Castellanos, N., Grützner, C., Koethe, D., Rivolta, D., Wibral, M., Kranaster, L., Singer, W., Leweke, M. F., & Uhlhaas, P. J. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.08.023 · Cited by 96
Strauss, J., Lewis, J. L., Klorman, R., Peloquin, L., Perlmutter, R. A., & Salzman, L. F. (1984) · Psychophysiology · doi:10.1111/j.1469-8986.1984.tb00247.x · Cited by 90
LEITMAN, D. I., ZIWICH, R., PASTERNAK, R., & JAVITT, D. C. (2006) · Psychological Medicine · doi:10.1017/s0033291706007653 · Cited by 86
“…sensitivity used Ak after Snodgrass & Corwin (1988) : Ak=0 5+ (yxx)(1+yxx) 4y(1xx) when yox, or 0 5+ (xxy)(1+xxy) 4x(1xy) when yfx and bias Ba after Grier (1971) : Ba= y(1xy)xx(1xx) y(1xy)+(1xx) whenyox, or x(1xx)xy(1xy) x(1xx)+(1xy) whenyfx, where x is the probability of falsely identifying a…”
MethodHarmer, C. J., Heinzen, J., O’Sullivan, U., Ayres, R. A., & Cowen, P. J. (2008) · Psychopharmacology · doi:10.1007/s00213-007-1058-7 · Cited by 69
Miskowiak, K., Inkster, B., O’Sullivan, U., Selvaraj, S., Goodwin, G. M., & Harmer, C. J. (2008) · Experimental Brain Research · doi:10.1007/s00221-007-1102-1 · Cited by 59
Komulainen, E., Heikkilä, R., Nummenmaa, L., Raij, T. T., Harmer, C. J., Isometsä, E., & Ekelund, J. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.04.096 · Cited by 56
“For the word recognition task, the non-parametric discrimination index A (Grier, 1971) was calculated using a formula: A =0.5+[(H FA)(1+H FA)]/ [(4H(1 FA)], where H=hits/targets and FA=false alarms/distractors.”
MethodInfluentialVerbalizing events: Overshadowing or facilitation?
Huff, M., & Schwan, S. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.392 · Cited by 37
McEwen (2004) · doi:10.1016/s1054-3589(04)50016-9 · Cited by 22
Hammer, R., Tennekoon, M., Cooke, G. E., Gayda, J., Stein, M. A., & Booth, J. R. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.06.002 · Cited by 21
Miskowiak, K. W., Svendsen, A. M. B., Harmer, C. J., Elliott, R., Macoveanu, J., Siebner, H. R., Kessing, L. V., & Vinberg, M. (2017) · Psychological Medicine · doi:10.1017/s0033291717000861 · Cited by 14
Metadata
- Authors
- Grier, J. B.
- Venue
- Psychological Bulletin
- Published
- 1971
- Volume
- 75
- Issue
- 6
- Pages
- 424-429
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2031050189
- Cited by
- 1,039
- References
- 9
- FWCI
- 5.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.