Test–retest reliability of behavioral measures of impulsive choice, impulsive action, and inattention.
Open accessAbstract
Behavioral measures of impulsivity are widely used in substance abuse research, yet relatively little attention has been devoted to establishing their psychometric properties, especially their reliability over repeated administration. The current study examined the test-retest reliability of a battery of standardized behavioral impulsivity tasks, including measures of impulsive choice (i.e., delay discounting, probability discounting, and the Balloon Analogue Risk Task), impulsive action (i.e., the stop signal task, the go/no-go task, and commission errors on the continuous performance task), and inattention (i.e., attention lapses on a simple reaction time task and omission errors on the continuous performance task). Healthy adults (n = 128) performed the battery on two separate occasions. Reliability estimates for the individual tasks ranged from moderate to high, with Pearson correlations within the specific impulsivity domains as follows: impulsive choice (r range: .76-.89, ps < .001); impulsive action (r range: .65-.73, ps < .001); and inattention (r range: .38-.42, ps < .001). Additionally, the influence of day-to-day fluctuations in mood, as measured by the Profile of Mood States, was assessed in relation to variability in performance on each of the behavioral tasks. Change in performance on the delay discounting task was significantly associated with change in positive mood and arousal. No other behavioral measures were significantly associated with mood. In sum, the current analysis demonstrates that behavioral measures of impulsivity are reliable measures and thus can be confidently used to assess various facets of impulsivity as intermediate phenotypes for drug abuse.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Delayed Discounting Task has test-retest reliability rtt=0.89 (very high).
“Test-retest reliability rtt=0.89 (very high) [122]”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 55 · Cited by 214
Research works printed but not linked: 42
- Baker F Johnson MW Bickel WK Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude Journal of Abnormal Psychology 2003 112 382 392 doi: 10.1037/0021-843X.112.3.382 12943017 · DOI · Paper page
- Bickel WK Jarmolowicz DP Mueller ET Koffarnus MN Gatchalian KM Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence Pharmacology and Therapeutics 2012 134 287 297 http://dx.doi.org/10.1016/j.pharmthera.2012.02.004 22387232 PMC3329584 · DOI · Paper page
- Broos N Schmaal L Wiskerke J Kostelijk L Lam T Stoop N Goudriaan AE The relationship between impulsive choice and impulsive action: a cross-species translational study PLoS One 2012 7 1 9 e36781. doi:10.1371/journal.pone.0036781 PMC3344935 22574225 · DOI
- Colzato LS Hertsig G van den Wildenberg WP Hommel B Estrogen modulates inhibitory control in healthy human females: evidence from the stop-signal paradigm Neuroscience 2010 19 709 715 doi: 10.1016/j.neuroscience.2010.02.029 20219635 · DOI
- Crosbie J Perusse D Barr CL Schachar RJ Validating psychiatric endophenotypes: inhibitory control and attention deficit hyperactivity disorder Neuroscience and Biobehavioral Reviews 2008 32 40 55 http://dx.doi.org/10.1016/j.neubiorev.2007.05.002 17976721 · DOI
- Cyders MA Smith GT Spillane NS Fischer S Annus AM Peterson C Integration of impulsivity and positive mood to predict risky behavior: development and validation of a measure of positive urgency Psychological Assessment 2007 19 107 118 doi: 10.1037/1040-3590.19.1.107 17371126 · DOI · Paper page
- de Wit H Crean J Richards JB Effects of d-amphetamine and ethanol on a measure of behavioral inhibition in humans Behavioral Neuroscience 2000 114 830 837 doi: 10.1037/0735-7044.114.4.830 10959541 · DOI
- Dick DM Smith G Olausson P Mitchell SH Leeman RF O'Malley SS Sher K Review: Understanding the construct of impulsivity and its relationship to alcohol use disorders Addiction Biology 2010 15 217 226 doi: 10.1111/j.1369-1600.2009.00190.x 20148781 PMC2895996 · DOI
- Dougherty DM Marsh-Richard DM Hatzis ES Nouvion SO Mathias CW A test of alcohol dose effects on multiple behavioral measures of impulsivity Drug and Alcohol Dependence 2008 96 111 120 doi: 10.1016/j.drugalcdep.2008.02.002 18378098 PMC2566966 · DOI
- Dougherty DM Moeller FG Steinberg JL Marsh DM Hines SE Bjork JM Alcohol increases commission error rates for a continuous performance test Alcoholism: Clinical and Experimental Research 1999 23 1342 1351 doi: 10.1111/j.1530-0277.1999.tb04356.x 10470977 · DOI
- Fernie G Cole JC Goudie AJ Field M Risk-taking but not response inhibition or delay discounting predict alcohol consumption in social drinkers Drug and Alcohol Dependence 2010 112 54 61 http://dx.doi.org/10.1016/j.drugalcdep.2010.05.011 20580495 · DOI
- Fillmore MT Rush CR Impaired inhibitory control of behavior in chronic cocaine users Drug and Alcohol Dependence 2002 66 265 273 http://dx.doi.org/10.1016/S0376-8716(01)00206-X 12062461 · DOI · Paper page
- Fillmore MT Rush CR Hays L Acute effects of oral cocaine on inhibitory control of behavior in humans Drug and Alcohol Dependence 2002 67 157 167 http://dx.doi.org/10.1016/S0376-8716(02)00062-5 12095665 · DOI
- Fillmore MT Rush CR Marczinski CA Effects of d-amphetamine on behavioral control in stimulant abusers: the role of prepotent response tendencies Drug and Alcohol Dependence 2003 71 143 152 http://dx.doi.org/10.1016/S0376-8716(03)00089-9 12927652 · DOI
- Fillmore MT Vogel-Sprott M An alcohol model of impaired inhibitory control and its treatment in humans Experimental and Clinical Psychopharmacology 1999 7 49 55 doi:10.1037/1064-1297.7.1.49 10036609 · DOI
- Fillmore MT Weafer J MacKillop J de Wit H Behavioral inhibition and addiction The Wiley-Blackwell Handbook of Addiction Psychopharmacology 2013 135 164 John Wiley and Sons, Ltd. West Sussex, UK
- Hamidovic A Dlugos A Palmer AA de Wit H Catechol-O-methyltransferase val158met genotype modulates sustained attention in both the drug-free state and in response to amphetamine Psychiatric Genetics 2010 20 85 92 doi: 10.1097/YPG.0b013e32833a1f3c 20414144 PMC2875066 · DOI
- Hamilton KR Potenza MN Relations among delay discounting, addictions, and money mismanagement: implications and future directions American Journal of Drug and Alcohol Abuse 2012 38 30 42 doi: 10.3109/00952990.2011.643978 22211535 PMC3691101 · DOI
- Hunt MK Hopko DR Bare R Lejuez C Robinson E Construct validity of the balloon analog risk task (BART) Assessment 2005 12 416 428 doi: 10.1177/1073191105278740 16244122 · DOI
- Iaboni F Douglas VI Baker AG Effects of reward and response costs on inhibition in ADHD children Journal of Abnormal Psychology 1995 104 232 doi:10.1037/0021-843X.104.1.232 7897047 · DOI
- Lake JI Meck WH Differential effects of amphetamine and haloperidol on temporal reproduction: Dopaminergic regulation of attention and clock speed Neuropsychologia 2013 51 284 292 http://dx.doi.org/10.1016/j.neuropsychologia.2012.09.014 22982605 · DOI
- Lejuez C Aklin W Daughters S Zvolensky M Kahler C Gwadz M Reliability and validity of the youth version of the Balloon Analogue Risk Task (BART-Y) in the assessment of risk-taking behavior among inner-city adolescents Journal of Clinical Child and Adolescent Psychology 2007 36 106 111 doi:10.1080/15374410709336573 17206886 · DOI
- Lejuez C Read JP Kahler CW Richards JB Ramsey SE Stuart GL Brown RA Evaluation of a behavioral measure of risk taking: The Balloon Analogue Risk Task (BART) Journal of Experimental Psychology: Applied 2002 8 75 84 doi: 10.1037/1076-898X.8.2.75 12075692 · DOI · Paper page
- Lejuez CW Aklin WM Jones HA Richards JB Strong DR Kahler CW Read JP The Balloon Analogue Risk Task (BART) differentiates smokers and nonsmokers Experimental and Clinical Psychopharmacology 2003 11 26 33 doi: 10.1037/1064-1297.11.1.26 12622341 · DOI · Paper page
- Leth-Steensen C Elbaz ZK Douglas VI Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach Acta Psychologica (Amst) 2000 104 167 190 http://dx.doi.org/10.1016/S0001-6918(00)00019-6 10900704 · DOI · Paper page
- Li CS Milivojevic V Kemp K Hong K Sinha R Performance monitoring and stop signal inhibition in abstinent patients with cocaine dependence Drug and Alcohol Dependence 2006 85 205 212 http://dx.doi.org/10.1016/j.drugalcdep.2006.04.008 16725282 · DOI
- Logan GD Schachar RJ Tannock R Impulsivity and inhibitory control Psychological Science 1997 8 60 64 doi: 10.1111/j.1467-9280.1997.tb00545.x · DOI
- Marczinski CA Fillmore MT Preresponse cues reduce the impairing effects of alcohol on the execution and suppression of responses Experimental and Clinical Psychopharmacology 2003 11 110 117 doi: 10.1037/1064-1297.11.1.110 12622349 · DOI
- McCloskey M Palmer AA de Wit H Are attention lapses related to d-amphetamine liking? Psychopharmacology (Berl) 2010 208 201 209 doi: 10.1007/s00213-009-1719-9 19936714 PMC4004179 · DOI
- Newman JP Widom CS Nathan S Passive avoidance in syndromes of disinhibition: Psychopathy and extraversion Journal of Personality and Social Psychology 1985 48 1316 1327 doi: 10.1037/0022-3514.48.5.1316 3998992 · DOI
- Odum AL Delay discounting: trait variable? Behavioral Processes 2011 87 1 9 doi: 10.1016/j.beproc.2011.02.007 PMC3266171 21385637 · DOI · Paper page
- Odum AL Delay discounting: I'm a k, you're a k Journal of the Experimental Analysis of Behavior 2012 96 427 439 doi: 10.1901/jeab.2011.96-423 22084499 PMC3213005 · DOI
- Ohmura Y Takahashi T Kitamura N Wehr P Three-month stability of delay and probability discounting measures Experimental and Clinical Psychopharmacology 2006 14 318 328 doi: 10.1037/1064-1297.14.3.318 16893275 · DOI
- Patton JH Stanford MS Barratt ES Factor structure of the Barratt impulsiveness scale Journal of Clinical Psychology 1995 51 768 774 8778124
- Richards JB Zhang L Mitchell SH de Wit H Delay or probability discounting in a model of impulsive behavior: effect of alcohol Journal of the Experimental Analysis of Behavior 1999 71 121 143 http://dx.doi.org/10.1901%2Fjeab.1999.71-121 10220927 PMC1284697 · DOI
- Rogers RD Moeller FG Swann AC Clark L Recent research on impulsivity in individuals with drug use and mental health disorders: implications for alcoholism Alcoholism: Clinical and Experimental Research 2010 34 1319 1333 doi: 10.1111/j.1530-0277.2010.01216.x PMC4777895 20528825 · DOI
- Rubio G Jimenez M Rodriguez-Jimenez R Martinez I Avila C Ferre F Palomo T The role of behavioral impulsivity in the development of alcohol dependence: a 4-year follow-up study Alcoholism: Clinical and Experimental Research 2008 32 1681 1687 doi: 10.1111/j.1530-0277.2008.00746.x 18631324 · DOI
- Smits RR Stein JS Johnson PS Odum AL Madden GJ Test-retest reliability and construct validity of the Experiential Discounting Task Experimental and Clinical Psychopharmacology 2013 21 155 163 doi: 10.1037/a0031725 23421359 PMC3959642 · DOI
- Tannock R Schachar R Logan G Methylphenidate and cognitive flexibility: dissociated dose effects in hyperactive children Journal of Abnormal Child Psychology 1995 23 235 266 7642836
- Verdejo-Garcia A Lawrence AJ Clark L Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies Neuroscience and Biobehavioral Reviews 2008 32 777 810 doi: 10.1016/j.neubiorev.2007.11.003 18295884 · DOI
- White TL Lejuez CW de Wit H Test-retest characteristics of the Balloon Analogue Risk Task (BART) Experimental and Clinical Psychopharmacology 2008 16 565 570 doi: 10.1037/a0014083 19086777 PMC4244869 · DOI
- Wostmann NM Aichert DS Costa A Rubia K Moller HJ Ettinger U Reliability and plasticity of response inhibition and interference control Brain and Cognition 2013 81 82 94 doi: 10.1016/j.bandc.2012.09.010 23174432 · DOI · Paper page
- Authors
- Weafer, J., Baggott, M. J., & de Wit, H.
- Affiliations
- University of Chicago (US)
- Venue
- Experimental and Clinical Psychopharmacology
- Published
- 2013
- Volume
- 21
- Issue
- 6
- Pages
- 475-481
- ISSN
- 1064-1297 (ISSN-L)
- 1936-2293
- PMC
- PMC4266373
- OpenAlex
- W2116615301
- Cited by
- 214
- References
- 55
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 19 · 2023: 21 · 2022: 19 · 2021: 17 · 2020: 23 · 2019: 23 · 2018: 19 · 2017: 18 · 2016: 13 · 2015: 13 · 2014: 6 · 2013: 1
- FWCI
- 6.03
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Experimental and Clinical Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (DA032015; DA002812; DA033756)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- impulsivity, test-retest reliability, impulsive choice, impulsive action, inattention, delay discounting, probability discounting, Balloon Analogue Risk Task, stop-signal task, go/no-go task, continuous performance test, mood, positive mood, arousal, endophenotypes, drug abuse
- MeSH terms
- Adult, Attention, Choice Behavior, Female, Humans, Impulsive Behavior, Male, Research Design, Risk-Taking, Task Performance and Analysis, Reproducibility of Results, Young Adult, Healthy Volunteers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review