Psychometric properties of startle and corrugator response in NPU, affective picture viewing, and resting state tasks
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
The current study provides a comprehensive evaluation of critical psychometric properties of commonly used psychophysiology laboratory tasks/measures within the NIMH RDoC. Participants ( N = 128) completed the no‐shock, predictable shock, unpredictable shock (NPU) task, affective picture viewing task, and resting state task at two study visits separated by 1 week. We examined potentiation/modulation scores in NPU (predictable or unpredictable shock vs. no‐shock) and affective picture viewing tasks (pleasant or unpleasant vs. neutral pictures) for startle and corrugator responses with two commonly used quantification methods. We quantified startle potentiation/modulation scores with raw and standardized responses. We quantified corrugator potentiation/modulation in the time and frequency domains. We quantified general startle reactivity in the resting state task as the mean raw startle response during the task. For these three tasks, two measures, and two quantification methods, we evaluated effect size robustness and stability, internal consistency (i.e., split‐half reliability), and 1‐week temporal stability. The psychometric properties of startle potentiation in the NPU task were good, but concerns were noted for corrugator potentiation in this task. Some concerns also were noted for the psychometric properties of both startle and corrugator modulation in the affective picture viewing task, in particular, for pleasant picture modulation. Psychometric properties of general startle reactivity in the resting state task were good. Some salient differences in the psychometric properties of the NPU and affective picture viewing tasks were observed within and across quantification methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“…2015)—an issue that has recently garnered heightened scrutiny and concern regarding the implications that small sample sizes have for the confidence and robustness of psychological and biomedical sciences (Button et al., 2013; Open Science Collaboration, 2015; Simmons, Nelson, & Simonsohn, 2011).”
BackgroundConstructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 1×
“Following Open Science recommendations (Nosek et al., 2015), we provide unrestricted access to all raw data and analysis code from this study to the research community via Open Science Framework (https://osf.io/fdjg9/).”
MethodUses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Emotion and motivation I: Defensive and appetitive reactions in picture processing.
Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001) · Emotion · doi:10.1037/1528-3542.1.3.276 · Cited by 2,224 · cited 1×
“…demonstrated poor psychometric performance of startle/corrugator modulation to pleasant pictures, which raises serious concerns regarding the conclusions that can be drawn about pleasant picture responding for either measure (Bradley et al., 2001; Larson et al., 2000, 2005; Manber et al., 2000).”
BackgroundTaylor, S., Zvolensky, M. J., Cox, B. J., Deacon, B., Heimberg, R. G., Ledley, D. R., Abramowitz, J. S., Holaway, R. M., Sandin, B., Stewart, S. H., et al. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.2.176 · Cited by 1,866
Constructing validity: New developments in creating objective measuring instruments.
Clark, L. A., & Watson, D. (2019) · Psychological Assessment · doi:10.1037/pas0000626 · Cited by 1,470
Committee report: Guidelines for human startle eyeblink electromyographic studies
Blumenthal, T. D., Cuthbert, B. N., Filion, D. L., Hackley, S., Lipp, O. V., & Van Boxtel, A. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00271.x · Cited by 1,169 · cited 3×
“We recorded eyeblink EMG activity to the startle probes from two 4-mm Ag-AgCl sensors placed according to published guidelines beneath the right eye over the orbicularis oculi muscle (Blumenthal et al., 2005).”
MethodThe International Affective Picture System (IAPS) in the Study of Emotion and Attention
Bradley, M. M., & Lang, P. J. (2007) · Handbook of Emotion Elicitation and Assessment · doi:10.1093/oso/9780195169157.003.0003 · Cited by 915
Development and validation of a brief form of the multidimensional personality questionnaire
Patrick, C. J., Curtin, J. J., & Tellegen, A. (2002) · Psychological Assessment · doi:10.1037/1040-3590.14.2.150 · Cited by 647
Self-citationSuppression and enhancement of emotional responses to unpleasant pictures
Jackson, D. C., Malmstadt, J. R., Larson, C. L., & Davidson, R. J. (2000) · Psychophysiology · doi:10.1111/1469-8986.3740515 · Cited by 459
Schmitz, A., & Grillon, C. (2012) · Nature Protocols · doi:10.1038/nprot.2012.001 · Cited by 383
Grillon, C., Lissek, S., Rabin, S., McDowell, D., Dvir, S., & Pine, D. S. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07101581 · Cited by 300 · cited 1×
“The NPU task has been used extensively to study mood and anxiety disorders (Grillon et al., 2008, 2009), addiction (Bradford, Curtin, & Piper, 2015; Hogle, Kaye, & Curtin, 2010), and the effects of pharmaceutical and recreational drugs (Grillon et al., 2006; Moberg & Curtin, 2009).”
MethodGrillon, C., Pine, D. S., Lissek, S., Rabin, S., Bonne, O., & Vythilingam, M. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.12.028 · Cited by 272 · cited 1×
“The NPU task has been used extensively to study mood and anxiety disorders (Grillon et al., 2008, 2009), addiction (Bradford, Curtin, & Piper, 2015; Hogle, Kaye, & Curtin, 2010), and the effects of pharmaceutical and recreational drugs (Grillon et al., 2006; Moberg & Curtin, 2009).”
MethodLissek, S., Pine, D. S., & Grillon, C. (2006) · Biological Psychology · doi:10.1016/j.biopsycho.2005.11.004 · Cited by 251
The Research Domain Criteria (RDoC): An analysis of methodological and conceptual challenges
Lilienfeld, S. O. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.019 · Cited by 248 · cited 2×
“Psychology and related disciplines have a rich history of rigorous psychometric evaluation of their self-report measures, but the reliability and validity of physiological measures within laboratory tasks have often been presumed rather than demonstrated (Lilienfeld, 2014).”
BackgroundThe NIMH experimental medicine initiative
Insel, T. R. (2015) · World Psychiatry · doi:10.1002/wps.20227 · Cited by 165 · cited 6×
“Psychophysiological tasks are poised to become a major contributor to the National Institute of Mental Health (NIMH) Research Domain Criteria (RDoC) and related initiatives in experimental medicine (Hajcak & Patrick, 2015; Insel, 2015; Patrick & Hajcak, 2016).”
BackgroundInfluentialMoberg, C. A., & Curtin, J. J. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0015636 · Cited by 138
Self-citationStartle reflex potentiation during aversive picture viewing as an indicator of trait fear
Vaidyanathan, U., Patrick, C. J., & Bernat, E. M. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00751.x · Cited by 116
How Bad Could It Be? Alcohol Dampens Stress Responses to Threat of Uncertain Intensity
Bradford, D. E., Shapiro, B. L., & Curtin, J. J. (2013) · Psychological Science · doi:10.1177/0956797613499923 · Cited by 86
Self-citationStability of emotion-modulated startle during short and long picture presentation
Larson, C. L., Ruffalo, D., Nietert, J. Y., & Davidson, R. J. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00345.x · Cited by 56 · cited 5×
“The effect size across study visits of startle modulation to unpleasant pictures is large and has been observed to be stable (Larson et al., 2005; Lee et al., 2009), but for pleasant pictures is smaller and may be dependent on picture content (Manber et al., 2000).”
BackgroundInfluential
Cited by
If or when? Uncertainty's role in anxious anticipation
Bennett, K. P., Sinclair, J. V., & Larson, C. L. (2018) · Psychophysiology · doi:10.1111/psyp.13066 · Cited by 58
“, 2011) or more safe trials compared to certain and uncertain trials (Ballard et al., 2014; Grillon et al., 2004, 2006, 2009, 2016; Kaye et al., 2016; Moberg & Curtin, 2009).”
ResultClinical anxiety promotes excessive response inhibition
Grillon, C., Robinson, O. J., O'Connell, K., Davis, A., Alvarez, G., Pine, D. S., & Ernst, M. (2017) · Psychological Medicine · doi:10.1017/s0033291716002555 · Cited by 56
Reactivity to unpredictable threat as a treatment target for fear-based anxiety disorders
Gorka, S. M., Lieberman, L., Klumpp, H., Kinney, K. L., Kennedy, A. E., Ajilore, O., Francis, J., Duffecy, J., Craske, M. G., Nathan, J., et al. (2017) · Psychological Medicine · doi:10.1017/s0033291717000964 · Cited by 28
“In support of it as a trait-like marker, startle to U-threat is stable a week apart according to two separate studies (Shankman et al. 2013; Kaye et al. 2016).”
Result
Metadata
- Authors
- Kaye, J. T., Bradford, D. E., & Curtin, J. J.
- Venue
- Psychophysiology
- Publisher
- Wiley
- Published
- 2016-05-11
- Volume
- 53
- Issue
- 8
- Pages
- 1241-1255
- ISSN
- 0048-5772 (ISSN-L)
- 1469-8986
- OpenAlex
- W2369710423
- Cited by
- 69
- References
- 23
- FWCI
- 15.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.