The DOI matches its Crossref record; 84 of the 85 references it cites were found in a registry or an index.
Estimating between- and within-individual variation in cortisol levels using multilevel models
Abstract
Cortisol measures often are used to examine variation in hypothalamic-pituitary-adrenal axis (HPA) activity as well as broader patterns of differential health. However, substantial within-individual variation renders single cortisol measurements unreliable as estimates for probing differences between individuals and groups. A standard practice to clarify between-individual differences involves collecting multiple samples from each participant and then deriving person-specific averages. By ignoring information about variation at between- and within-individual levels, this technique impedes cross-study comparison of results, ignores data useful for future study design, and hinders the analysis of cross-level interactions. This report describes how multilevel approaches can simultaneously model between- and within-individual variation in diurnal cortisol levels without using crude averages. We apply these models to data from children in Nepal (n=29, 11-15 samples per child), Mongolia (n=47, 8-12 samples per child) and the US (n=1269, 1-6 samples per child). Using the Nepal data, we show how an analysis of crude time-adjusted aggregates does not detect an association between aggressive behavior and cortisol levels, while a multilevel analysis does. More importantly, we argue that the 'roadmap' to variation generated by these multilevel models provides meaningful information about the predictive accuracy--not just statistical significance--of relationships between cortisol levels and individual-level variables, such as psychopathology, age, and gender. The 'roadmap' also facilitates comparison between the results from different studies and estimation of the necessary number of cortisol measurements for future investigations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Growth curve models are better than repeated measures analysis of variance (ANOVA), which has traditionally been used to analyze cortisol data, because the former do not require complete data for every participant or that observations be equally spaced in time (31).”
From Cortisol response to stress in female youths exposed to childhood maltreatment: results of the youth mood project (2009) · cites this paper as [31]
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,345
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Mixed-Effects Models in S and S-Plus
Carey, V., & Wang, Y.-G. (2001) · Journal of the American Statistical Association · doi:10.1198/jasa.2001.s411 · Cited by 8,092
Review of research in education
Shulman, L. S., Mowry, S., & Berliner, D. C. (1973) · F.E. Peacock eBooks · Cited by 7,754
Goldstein, H. (2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,960
Linear Mixed Models for Longitudinal Data
Verbeke, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1_3 · Cited by 3,506
The potential role of hypocortisolism in the pathophysiology of stress-related bodily disorders
Heim, C., Ehlert, U., & Hellhammer, D. H. (2000) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(99)00035-9 · Cited by 1,688
Salivary Cortisol in Psychobiological Research: An Overview
Kirschbaum, C., & Hellhammer, D. H. (2008) · Neuropsychobiology · doi:10.1159/000118611 · Cited by 1,532
Goulias, K. G. (2002) · New directions in civil engineering · doi:10.1201/9781420042283.ch9 · Cited by 1,292
Using SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models
Singer, J. D. (1998) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165280 · Cited by 1,092
The Great Smoky Mountains Study of Youth
Costello, E. J. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830120067012 · Cited by 1,088
Variance components testing in the longitudinal mixed effects model
Stram, D. O., & Lee, J. W. (1994) · Biometrics · doi:10.2307/2533455 · Cited by 992
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Anderson, C. J. (2005) · Journal of the American Statistical Association · doi:10.1198/jasa.2005.s7 · Cited by 848
Burnout, Perceived Stress, and Cortisol Responses to Awakening
Pruessner, J. C., Hellhammer, D. H., & Kirschbaum, C. (1999) · Psychosomatic Medicine · doi:10.1097/00006842-199903000-00012 · Cited by 822
Modeled Variance in Two-Level Models
Snijders, T. A. B., & Bosker, R. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003004 · Cited by 736
Socioeconomic Status And Health
(2002) · Health Affairs · doi:10.1377/hlthaff.21.2.47 · Cited by 667
Genetic factors, perceived chronic stress, and the free cortisol response to awakening
Wüst, S., Federenko, I. S., Hellhammer, D. H., & Kirschbaum, C. (2000) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(00)00021-4 · Cited by 642
van Eck, M., Berkhof, H., Nicolson, N., & Sulon, J. (1996) · Psychosomatic Medicine · doi:10.1097/00006842-199609000-00007 · Cited by 617
The Developmental Psychopathology of Anxiety
Vasey, M. W., Bosmans, G., & Ollendick, T. H. (2014) · Springer eBooks · doi:10.1007/978-1-4614-9608-3_27 · Cited by 605
Fink, G. (2000) · Cited by 502
Low Salivary Cortisol and Persistent Aggression in Boys Referred for Disruptive Behavior
McBurnett, K., LAHEY, B. B., Rathouz, P. J., & Loeber, R. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.1.38 · Cited by 484
The Developmental Psychopathology of Anxiety
(2001) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195123630.001.0001 · Cited by 479
STRESSORS AND MOOD MEASURED ON A MOMENTARY BASIS ARE ASSOCIATED WITH SALIVARY CORTISOL SECRETION
Smyth, J. M., Ockenfels, M. C., Porter, L. S., Kirschbaum, C., Hellhammer, D. H., & Stone, A. A. (1998) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(98)00008-0 · Cited by 474
Questions and Answers in the Measurement of Change
Willett, J. B. (1988) · Review of Research in Education · doi:10.2307/1167368 · Cited by 461
Kudielka, B. M., & Kirschbaum, C. (2003) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(02)00008-2 · Cited by 457
Chronic burnout, somatic arousal and elevated salivary cortisol levels
Melamed, S., Ugarten, U., Shirom, A., Kahana, L., Lerman, Y., & Froom, P. (1999) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(99)00007-0 · Cited by 436
Low Cortisol and Risk for PTSD in Adult Offspring of Holocaust Survivors
Yehuda, R., Bierer, L. M., Schmeidler, J., Aferiat, D. H., Breslau, I., & Dolan, S. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.8.1252 · Cited by 353
KLIMES–DOUGAN, B., HASTINGS, P. D., GRANGER, D. A., USHER, B. A., & ZAHN–WAXLER, C. (2001) · Development and Psychopathology · doi:10.1017/s0954579401003157 · Cited by 352
Individual differences in the diurnal cycle of cortisol
Smyth, J. M., Ockenfels, M. C., Gorin, A. A., Catley, D., Porter, L. S., Kirschbaum, C., Hellhammer, D. H., & Stone, A. A. (1997) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(96)00039-x · Cited by 350
Stone, A. A., Schwartz, J. E., Smyth, J. M., Kirschbaum, C., Cohen, S., Hellhammer, D. H., & Grossman, S. (2001) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(00)00057-3 · Cited by 347
Diurnal salivary cortisol in pediatric posttraumatic stress disorder
Carrion, V. G., Weems, C. F., Ray, R. D., Glaser, B., Hessl, D., & Reiss, A. L. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(01)01310-5 · Cited by 330
Behavior Assessment System for Children (BASC)
Walker, D. W. (1999) · Diagnostique · doi:10.1177/153450849902401-403 · Cited by 329
Multilevel Modelling of Health Statistics
Leyland, A. H., & Goldstein, H. (2001) · Cited by 307
Adam, E. K. (2001) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(00)00045-7 · Cited by 300
FISHER, P. A., GUNNAR, M. R., CHAMBERLAIN, P., & REID, J. B. (2000) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200011000-00009 · Cited by 286
Goodyer, I. M., Herbert, J., ALTHAM, P. M. E., Pearson, J., SECHER, S. M., & Shiers, H. M. (1996) · Psychological Medicine · doi:10.1017/s0033291700034644 · Cited by 284
Marital Conflict in Older Adults: Endocrinological and Immunological Correlates
Kiecolt-Glaser, J. K., Glaser, R., Cacioppo, J. T., MacCallum, R. C., Snydersmith, M., Kim, C., & Malarkey, W. B. (1997) · Psychosomatic Medicine · doi:10.1097/00006842-199707000-00001 · Cited by 281
Low salivary cortisol levels and externalizing behavior problems in youth
SHIRTCLIFF, E. A., GRANGER, D. A., BOOTH, A., & JOHNSON, D. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050091 · Cited by 264
Heritability of cortisol levels: review and simultaneous analysis of twin studies
Bartels, M., den Berg, M. V., Sluyter, F., Boomsma, D. I., & de Geus, E. J. C. (2002) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(02)00003-3 · Cited by 259
Pruessner, J. C., Gaab, J., Hellhammer, D. H., Lintz, D., Schommer, N. C., & Kirschbaum, C. (1997) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(97)00072-3 · Cited by 234
Dettling, A. C., Parker, S. W., Lane, S., Sebanc, A. M., & Gunnar, M. R. (2000) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(00)00028-7 · Cited by 234
Social economics of childhood glucocorticoid stress response and health
Flinn, M. V., & England, B. G. (1997) · American Journal of Physical Anthropology · doi:10.1002/(sici)1096-8644(199701)102:1 · Cited by 231
Veldhuis, J. D., Iranmanesh, A., Lizarralde, G., & Johnson, M. L. (1989) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1989.257.1.e6 · Cited by 224
Morning cortisol as a risk factor for subsequent major depressive disorder in adult women
Harris, T. O., Borsanyi, S., Messari, S., Stanford, K., Cleary, S. E., Shiers, H. M., Brown, G. W., & Herbert, J. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.6.505 · Cited by 220
Knutsson, U., Dahlgren, J., Marcus, C., Rosberg, S., Brönnegård, M., Stierna, P., & Albertsson-Wikland, K. G. (1997) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem.82.2.3769 · Cited by 209
Possible role of cortisol and dehydroepiandrosterone in human development and psychopathology
Goodyer, I. M., Park, R. J., Netherton, C. M., & Herbert, J. (2001) · The British Journal of Psychiatry · doi:10.1192/bjp.179.3.243 · Cited by 204
Heritability of Daytime Cortisol Levels in Children
Bartels, M., de Geus, E. J. C., Kirschbaum, C., Sluyter, F., & Boomsma, D. I. (2003) · Behavior Genetics · doi:10.1023/a:1025321609994 · Cited by 195
Late-night salivary cortisol as a screening test for cushing's syndrome
Raff, H. (1998) · Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.83.8.2681 · Cited by 194
Modeling Intraindividual Variability With Repeated Measures Data
Hershberger, S. L., & Moskowitz, D. S. (2013) · Psychology Press eBooks · doi:10.4324/9781410604477 · Cited by 186
Langford, I. H., & Lewis, T. (1998) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/1467-985x.00094 · Cited by 174
Cohen, S., & Hamrick, N. (2003) · Brain Behavior and Immunity · doi:10.1016/s0889-1591(03)00110-7 · Cited by 160
Roy, M. P. (2001) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(00)00061-5 · Cited by 143
Knutsson, U. (1997) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.82.2.536 · Cited by 140
Salivary cortisol patterns in vital exhaustion
Nicolson, N. A., & van Diest, R. (2000) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(00)00166-5 · Cited by 139
The Relative Impact of Interviewer Effects and Sample Design Effects on Survey Precision
O’Muircheartaigh, C. A., & Campanelli, P. (1998) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/1467-985x.00090 · Cited by 136
Tunn, S., Möllmann, H., Barth, J. H., Derendorf, H., & Krieg, M. (1992) · Clinical Chemistry · doi:10.1093/clinchem/38.8.1491 · Cited by 130
Cortisol and behavior: 2. Application of a Latent state-trait model to salivary cortisol
Kirschbaum, C., Steyer, R., Eid, M., Patalla, U., Schwenkmezger, P., & Hellhammer, D. H. (1990) · Psychoneuroendocrinology · doi:10.1016/0306-4530(90)90080-s · Cited by 128
Urinary cortisol and catecholamines in mothers of child cancer survivors with and without PTSD
Glover, D. A., & Poland, R. E. (2002) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(01)00081-6 · Cited by 124
Rising cortisol at childcare: Relations with nap, rest, and temperament
Watamura, S. E., Sebanc, A. M., & Gunnar, M. R. (2001) · Developmental Psychobiology · doi:10.1002/dev.10011 · Cited by 97
Use of cortisol as a stress marker: Practical and theoretical problems
Pollard, T. M. (1995) · American Journal of Human Biology · doi:10.1002/ajhb.1310070217 · Cited by 93
Increased Diurnal Plasma Concentrations of Cortisone in Depressed Patients
Weber, B., Lewicka, S., Deuschle, M., Colla, M., Vecsei, P., & Heuser, I. (2000) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem.85.3.6469 · Cited by 92
Does aggregation produce spuriously high estimates of behavior stability?
Epstein, S. J. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.50.6.1199 · Cited by 90
Cortisol concentrations in 12- to 18-Month-Old infants: stability over time, location, and stressor
Goldberg, S., Levitan, R. D., Leung, E. Y. M., Masellis, M., Basile, V. S., Nemeroff, C. B., & Atkinson, L. R. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00010-6 · Cited by 87
Biosocial bases of antisocial behavior: Psychophysiological, neurological, and cognitive factors
Brennan, P. A., & Raine, A. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00036-6 · Cited by 85
Coste, J., Strauch, G., Letrait, M., & BERTAGNA, X. Y. (1994) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1994.tb04386.x · Cited by 76
Linear Mixed Models for Longitudinal Data
Avilés, A. I. (2001) · Technometrics · doi:10.1198/tech.2001.s630 · Cited by 72
Analysis of Repeated Measures Designs with Linear Mixed Models
Hershberger, S. L., & Moskowitz, D. S. (2013) · Psychology Press eBooks · doi:10.4324/9781410604477-10 · Cited by 72
Koertge, J., Al-Khalili, F., Ahnve, S., Janszky, I., Svane, B., & Schenck-Gustafsson, K. G. (2002) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(02)00002-1 · Cited by 70
Salivary Cortisol and Social Status among Dominican Men
Decker, S. A. (2000) · Hormones and Behavior · doi:10.1006/hbeh.2000.1597 · Cited by 70
Salivary cortisol day profiles in elderly with mild cognitive impairment
Wolf, O. T., Convit, A. J., Thorn, E., & de Leon, M. J. (2002) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(01)00079-8 · Cited by 70
Comparisons of Software Packages for Generalized Linear Multilevel Models
Zhou, X., Perkins, A. J., & Hui, S. L. (1999) · The American Statistician · doi:10.1080/00031305.1999.10474475 · Cited by 59
The Role of Glucocorticoids in Anxiety Disorders: A Critical Analysis
Gunnar, M. R. (2001) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195123630.003.0007 · Cited by 59
Epidemiology of human development
Worthman, C. M. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511623462.003 · Cited by 57
Does aggregation produce spuriously high estimates of behavior stability?
Epstein, S. J. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.50.6.1199 · Cited by 56
Rose, R. M., & Fogg, L. (1993) · Psychosomatic Medicine · doi:10.1097/00006842-199307000-00001 · Cited by 42
Krapina 1: A juvenile Neandertal from the early late Pleistocene of Croatia
Minugh‐Purvis, N., Radovčić, J., & Smith, F. H. (2000) · American Journal of Physical Anthropology · doi:10.1002/(sici)1096-8644(200003)111:3 · Cited by 41
Corrections: Variance Component Testing in the Longitudinal Mixed Effects Model
(1995) · Biometrics · doi:10.2307/2533038 · Cited by 39
Rosenblum, L. L., Supriatna, J., & Melnick, D. J. (1997) · American Journal of Physical Anthropology · doi:10.1002/(sici)1096-8644(199709)104:1 · Cited by 33
Modelling repeated measurements
Goldstein, H., & Woodhouse, G. (2001) · Cited by 11
David S., A. S. K. (1998) · Psychology Press eBooks · doi:10.4324/9781410602770-9 · Cited by 11
Schulz (1998) · doi:10.1002/(sici)1099-1700(199804)14:2
Cited by
Sorted by citations
Assessment of the cortisol awakening response: Expert consensus guidelines
Stalder, T., Kirschbaum, C., Kudielka, B. M., Adam, E. K., Pruessner, J. C., Wüst, S., Dockray, S., Smyth, N., Evans, P., Hellhammer, D. H., et al. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2015.10.010 · Cited by 967
Assessing salivary cortisol in large-scale, epidemiological research
Adam, E. K., & Kumari, M. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.06.011 · Cited by 936
A Primer on Multilevel Modeling
Hayes, A. F. (2006) · Human Communication Research · doi:10.1111/j.1468-2958.2006.00281.x · Cited by 532
Alink, L. R. A., van IJzendoorn, M. H., Bakermans‐Kranenburg, M. J., Mesman, J., Juffer, F., & Koot, H. M. (2008) · Developmental Psychobiology · doi:10.1002/dev.20300 · Cited by 359
Socio-economic status, cortisol and allostatic load: a review of the literature
Dowd, J. B., Simanek, A. M., & Aiello, A. E. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyp277 · Cited by 285
Metadata
- Authors
- Hruschka, D. J., Kohrt, B. A., & Worthman, C. M.
- Affiliations
- Emory University (US)
- Corresponding author
- Hruschka, Daniel J.
- Venue
- Psychoneuroendocrinology
- Publisher
- Elsevier BV
- Published
- 2005-08
- Volume
- 30
- Issue
- 7
- Pages
- 698-714
- ISSN
- 0306-4530 (ISSN-L)
- OpenAlex
- W2131578123
- Cited by
- 303
- References
- 85
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 10 · 2023: 7 · 2022: 11 · 2021: 20 · 2020: 12 · 2019: 10 · 2018: 13 · 2017: 14 · 2016: 19 · 2015: 28 · 2014: 24 · 2013: 23 · 2012: 18
- FWCI
- 4.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychoneuroendocrinology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (MH57761, P30MH057761)
- Topics
- Life Sciences › Neuroscience › Behavioral Neuroscience › Stress Responses and Cortisol
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- cortisol, within-person variability, between-person variation, multilevel models, diurnal cortisol rhythm, hypothalamic-pituitary-adrenal axis, aggression, psychopathology, children, sample size determination, cross-study comparison
- MeSH terms
- Adolescent, Algorithms, Child, Child, Preschool, Circadian Rhythm, Data Interpretation, Statistical, Humans, Hydrocortisone, Male, Population, Research Design, Saliva, Reproducibility of Results, Models, Statistical, Cluster Analysis, Linear Models, White People, Asian People
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review