Classification Criteria for Distinguishing Cortisol Responders From Nonresponders to Psychosocial Stress: Evaluation of Salivary Cortisol Pulse Detection in Panel Designs
The DOI matches its Crossref record, with a small difference in title or year; 53 of the 53 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Hypothalamic-pituitary-adrenal axis reactivity to acute stimulation is frequently assessed by repeated sampling of salivary cortisol. Researchers often strive to distinguish between individuals who show (responders) and those do not show (nonresponders) cortisol responses. For this, fixed threshold classification criteria, such as a 2.5-nmol/l baseline-to-peak increase, are frequently used. However, the performance of such criteria has not been systematically evaluated. METHODS: Repeated salivary cortisol data from 504 participants exposed to either the Trier Social Stress Test (TSST; n = 309) or a placebo protocol (n = 195) were used for analyses. To obtain appropriate classifications of cortisol responders versus nonresponders, a physiologically plausible, autoregressive latent trajectory (ALT) mixture model was fitted to these data. Response classifications according to the ALT model and information on the experimental protocol (TSST versus placebo TSST) were then used to evaluate the performance of different proposed classifier proxies by receiver operating characteristics. RESULTS: Moment structure of cortisol time series was adequately accounted for by the proposed ALT model. The commonly used 2.5-nmol/l criterion was found to be overly conservative, resulting in a high rate of 16.5% false-negative classifications. Lowering this criterion to 1.5 nmol/l or using a percentage baseline-to-peak increase of 15.5% as a threshold yielded improved performance (39.3% and 26.7% less misclassifications, respectively). CONCLUSIONS: Alternative classification proxies (1.5 nmol/l or 15.5% increase) are able to effectively distinguish between cortisol responders and nonresponders and should be used in future research, whenever statistical response class allocation is not feasible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Based on the baseline-to-peak increase in percentage as a measure of cortisol responder rate (62), all participants were classified as responders, while using the 1.5nmol/l criterion (62) identified 70% of participants as responders.”
From Reducing neuroendocrine psychosocial stress response through socio-emotional dyadic but not mindfulness online training (2024) · cites this paper as [62]
In the citing paper
“These effects were not driven by the four vigorous intensity exercisers who displayed the lowest responses, categorized as 'non-responders' based on previous work (Miller et al., 2013).”
From The effects of exercise intensity on the cortisol response to a subsequent acute psychosocial stressor. (2021) · cites this paper as Miller et al., 2013
In the citing paper
“However, the unstandardized effect sizes, as indicated by the mean differences shown in Table 3, are substantial and well beyond a level that has been found to separate responders from non-responders to stress [50].”
From Self-soothing touch and being hugged reduce cortisol responses to stress: A randomized controlled trial on stress, physical touch, and social identity (2021) · cites this paper as [50]
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701575396 · Cited by 11,415
Kirschbaum, C., Pirke, K.-M., & Hellhammer, D. H. (2008) · Neuropsychobiology · doi:10.1159/000119004 · Cited by 6,093
Self-citationDickerson, S. S., & Kemeny, M. E. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.3.355 · Cited by 5,881
Testing the number of components in a normal mixture
Lo, Y. (2001) · Biometrika · doi:10.1093/biomet/88.3.767 · Cited by 4,640
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Muthén, B., & Muthén, L. K. (2000) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2000.tb02070.x · Cited by 3,149
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 1×
“Because change scores are calculated by $t = tnj tn j 1, such an autoregression equation tn = A * tn j 1 can be rearranged to $t = (Aj 1) * tn j 1, which corresponds to a common change score regression (53).”
BackgroundTwenty-four hour pattern of the episodic secretion of cortisol in normal subjects
WEITZMAN, E. D., FUKUSHIMA, D., NOGEIRE, C., ROFFWARG, H., GALLAGHER, T. F., & HELLMAN, L. (1971) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem-33-1-14 · Cited by 1,258
Depression and cortisol responses to psychological stress: A meta-analysis
Burke, H. M., Davis, M. C., Otte, C., & Mohr, D. C. (2005) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2005.02.010 · Cited by 1,194
Schisterman, E. F., Perkins, N. J., Liu, A., & Bondell, H. (2005) · Epidemiology · doi:10.1097/01.ede.0000147512.81966.ba · Cited by 1,185
The cortisol awakening response - normal values and confounds.
Wüst, S., Wolf, J. M., Hellhammer, D. H., Federenko, I. S., Schommer, N. C., & Kirschbaum, C. (2000) · PubMed · Cited by 868
Self-citationCluster analysis: a simple, versatile, and robust algorithm for endocrine pulse detection
Veldhuis, J. D., & Johnson, M. L. (1986) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1986.250.4.e486 · Cited by 861
The awakening cortisol response: methodological issues and significance
Clow, A., Thorn, L., Evans, P., & Hucklebridge, F. (2004) · Stress · doi:10.1080/10253890410001667205 · Cited by 856
Advances in Latent Variable Mixture Models
Hancock, G. R., & Samuelsen, K. M. (2007) · Cited by 763
Morris, M. C., Compas, B. E., & Garber, J. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.002 · Cited by 466
Autoregressive Latent Trajectory (ALT) Models A Synthesis of Two Traditions
Bollen, K. A., & Curran, P. J. (2004) · Sociological Methods & Research · doi:10.1177/0049124103260222 · Cited by 447 · cited 16×
“In the main analyses, we first set out to specify an ALT model (26) that is depicted by the solid lines in Figure 2.”
MethodInfluentialPhysiological stress reactivity and recovery: Conceptual siblings separated at birth?
Linden, W., Earle, T. L., Gerin, W., & Christenfeld, N. (1997) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)00240-1 · Cited by 417
Neuroendocrine and psychometric evaluation of a placebo version of the ‘Trier Social Stress Test’
Het, S., Rohleder, N., Schoofs, D., Kirschbaum, C., & Wolf, O. T. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.02.008 · Cited by 394
Self-citationSmeets, T., Cornelisse, S., Quaedflieg, C. W. E. M., Meyer, T., Jelicic, M., & Merckelbach, H. (2012) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.04.012 · Cited by 376
Cortisol pulsatility and its role in stress regulation and health
YOUNG, E., ABELSON, J., & LIGHTMAN, S. (2004) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2004.07.001 · Cited by 355 · cited 3×
“Proceeding from this reasoning, it is crucial to consider that stressinduced HPA activity cannot be separated from regular ultradian HPA activity by utilization of any classifier (10).”
BackgroundWindle, R. J., Wood, S. A., Shanks, N., Lightman, S. L., & Ingram, C. D. (1998) · Endocrinology · doi:10.1210/en.139.2.443 · Cited by 276 · cited 1×
“(50)) which would mask any linear LIVeffect.”
Cortisol secretion patterns in addiction and addiction risk
Lovallo, W. R. (2006) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2005.10.007 · Cited by 269
Huizenga, N. A. T. M., Koper, J. W., de Lange, P., Pols, H. A. P., Stolk, R. P., Grobbee, D. E., de Jong, F. H., & Lamberts, S. W. J. (1998) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem.83.1.4498 · Cited by 250
The significance of glucocorticoid pulsatility
Lightman, S. L., Wiles, C. C., Atkinson, H. C., Henley, D. E., Russell, G. M., Leendertz, J. A., McKenna, M. A., Spiga, F., Wood, S. A., & Conway-Campbell, B. L. (2008) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2007.11.073 · Cited by 241
Plessow, F., Fischer, R., Kirschbaum, C., & Goschke, T. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00024 · Cited by 234
Self-citationVeldhuis, J. D., Iranmanesh, A., Lizarralde, G., & Johnson, M. L. (1989) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1989.257.1.e6 · Cited by 224
Rosmalen, J. G. M., Oldehinkel, A. J., Ormel, J., de Winter, A. F., Buitelaar, J. K., & Verhulst, F. C. (2005) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2004.12.007 · Cited by 221
Comparison of salivary cortisol as measured by different immunoassays and tandem mass spectrometry
Miller, R., Plessow, F., Rauh, M., Gröschl, M., & Kirschbaum, C. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.04.019 · Cited by 181 · cited 2×
“, all examined classifiers except for the percentage increase), it is crucial to consider that the quantification of absolute salivary cortisol concentrations shows up to 250% variability, depending on the assay used in laboratory analyses (18).”
BackgroundMethodSelf-citationEstimating false-positive and false-negative errors in analyses of hormonal pulsatility
Van Cauter, E. (1988) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1988.254.6.e786 · Cited by 180
Plessow, F., Kiesel, A., & Kirschbaum, C. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2943-1 · Cited by 180
Self-citationTesting Multivariate Normality
Cox, D. R., & Small, N. J. H. (1978) · Biometrika · doi:10.1093/biomet/65.2.263 · Cited by 176
‘Normal’ cigarette smoking increases free cortisol in habitual smokers
Kirschbaum, C., Wüst, S., & Strasburger, C. J. (1992) · Life Sciences · doi:10.1016/0024-3205(92)90378-3 · Cited by 176
Self-citationPetrowski, K., Herold, U., Joraschky, P., Wïttchen, H., & Kirschbaum, C. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.08.003 · Cited by 173
Self-citationHuizenga, N. A. T. M. (1998) · Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.83.1.47 · Cited by 173
Miller, R., & Plessow, F. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.09.013 · Cited by 150
Self-citationBalodis, I. M., Wynne‐Edwards, K. E., & Olmstead, M. C. (2010) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2010.03.011 · Cited by 147
9. Structural Equation Modeling with Robust Covariances
Yuan, K.-H., & Bentler, P. M. (1998) · Sociological Methodology · doi:10.1111/0081-1750.00052 · Cited by 146
Kudielka, B. M., von Känel, R., Preckel, D., Zgraggen, L., Mischler, K., & Fischer, J. E. (2005) · Biological Psychology · doi:10.1016/j.biopsycho.2005.09.001 · Cited by 145
Reactivity and Regulation in Cortisol and Behavioral Responses to Stress
Ramsay, D., & Lewis, M. (2003) · Child Development · doi:10.1111/1467-8624.7402009 · Cited by 143
Tunn, S., Möllmann, H., Barth, J., Derendorf, H., & Krieg, M. (1992) · Clinical Chemistry · doi:10.1093/clinchem/38.8.1491 · Cited by 130
BENJAMIN, L. S. (1963) · Psychosomatic Medicine · doi:10.1097/00006842-196311000-00005 · Cited by 128
Schlotz, W., Hammerfald, K., Ehlert, U., & Gaab, J. (2011) · Biological Psychology · doi:10.1016/j.biopsycho.2011.03.005 · Cited by 119
Plessow, F., Schade, S., Kirschbaum, C., & Fischer, R. (2012) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-012-0098-6 · Cited by 109
Self-citationMueller‐Alcazar, A., Armbruster, D., Moser, D., Canli, T., Lesch, K., Brocke, B., & Kirschbaum, C. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2011.11 · Cited by 101
Self-citationToward a reconceptualization of the law of initial value.
Jin, P. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.1.176 · Cited by 88
A solution for the most basic optimization problem associated with an ROC curve
Le, C. T. (2006) · Statistical Methods in Medical Research · doi:10.1177/0962280206070637 · Cited by 85
Evolution of Deconvolution Analysis as a Hormone Pulse Detection Method
Johnson, M. L., & Veldhuis, J. D. (1995) · Methods in neurosciences · doi:10.1016/s1043-9471(06)80027-3 · Cited by 68
Stress and memory retrieval in women: No strong impairing effect during the luteal phase.
Schoofs, D., & Wolf, O. T. (2009) · Behavioral Neuroscience · doi:10.1037/a0015625 · Cited by 68
A Stochastic Differential Equation Model of Diurnal Cortisol Patterns
Brown, E. N., Meehan, P. M., & Dempster, A. P. (2001) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.2001.280.3.e450 · Cited by 61
Corticosteroid‐binding globulin regulates cortisol pharmacokinetics
Perogamvros, I., Aarons, L., Miller, A. G., Trainer, P. J., & Ray, D. W. (2011) · Clinical Endocrinology · doi:10.1111/j.1365-2265.2010.03897.x · Cited by 59
Stalder, T., Bäumler, D., Miller, R., Alexander, N., Kliegel, M., & Kirschbaum, C. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.07.015 · Cited by 48
Self-citationWilloughby, M. T., Vandergrift, N., Blair, C., & Granger, D. A. (2007) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1401_7 · Cited by 26
Research works printed but not linked: 1
- Wust, 2000, The cortisol awakening responsenormal values and confounds., Noise Health, 2, 79
Cited by
Assessment of the cortisol awakening response: Expert consensus guidelines
Stalder, T., Kirschbaum, C., Kudielka, B. M., Adam, E. K., Pruessner, J. C., Wüst, S., Dockray, S., Smyth, N., Evans, P., Hellhammer, D. H., et al. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2015.10.010 · Cited by 967
Self-citationTurner, A. I., Smyth, N., Hall, S. J., Torres, S. J., Hussein, M., Jayasinghe, S. U., Ball, K., & Clow, A. J. (2020) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2020.104599 · Cited by 503
Pruessner, M., Cullen, A. E., Aas, M., & Walker, E. F. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.12.013 · Cited by 315
Fiksdal, A., Hanlin, L., Kuras, Y., Gianferante, D., Chen, X., Thoma, M. V., & Rohleder, N. (2019) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2018.11.035 · Cited by 258
Skoluda, N., Strahler, J., Schlotz, W., Niederberger, L., Marques, S., Fischer, S., Thoma, M. V., Spoerri, C., Ehlert, U., & Nater, U. M. (2015) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2014.10.002 · Cited by 246
Metadata
- Authors
- Miller, R., Plessow, F., Kirschbaum, C., & Stalder, T.
- Affiliations
- Technische Universität Dresden (DE)
- Corresponding author
- Miller, Robert
- Venue
- Psychosomatic Medicine
- Published
- 2013-11
- Volume
- 75
- Issue
- 9
- Pages
- 832-840
- ISSN
- 0033-3174 (ISSN-L)
- OpenAlex
- W2092880670
- Cited by
- 376
- References
- 53
- Citations by year
- 2026: 30 · 2025: 36 · 2024: 33 · 2023: 24 · 2022: 32 · 2021: 42 · 2020: 42 · 2019: 25 · 2018: 35 · 2017: 19 · 2016: 27 · 2015: 20 · 2014: 10 · 2013: 1
- FWCI
- 8.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychosomatic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Behavioral Neuroscience › Stress Responses and Cortisol
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Adrenal Hormones and Disorders
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
- Keywords
- salivary cortisol, HPA axis reactivity, psychosocial stress, Trier Social Stress Test, classification criteria, receiver operating characteristic, threshold conditions
- MeSH terms
- Activity Cycles, Adolescent, Adult, Aged, Classification, Data Interpretation, Statistical, False Negative Reactions, False Positive Reactions, Female, Humans, Hydrocortisone, Hypothalamo-Hypophyseal System, Luminescent Measurements, Middle Aged, Pituitary-Adrenal System, Psychological Tests, Reference Values, Research Design, ROC Curve, Saliva, Sensitivity and Specificity, Stress, Psychological, Time Factors, Models, Statistical, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.