An algorithm for identifying nonsystematic delay-discounting data.
Open accessAbstract
Several [corrected] discounting studies have use the R2 measure to identify data [corrected] with poor fits to a mathematical discounting model as nonsystematic data to be eliminated [corrected] Data from three previous delay-discounting studies (six separate groups, with a total of 161 individuals) were used to demonstrate why using R2 to assess the fits of discounting data is problematic. A significant, positive correlation between discounting rate parameter and R2 was found in most groups, showing that R2 is more stringent as a measure of fit for low discounting rates than for high discounting rates. Furthermore, it is suggested that identifying nonsystematic data based on any measure of fit to a mathematical discounting model may be problematic because it confounds discounting rate comparison with the issue of discounting model assessment. Therefore, a model-free method to identify nonsystematic data is needed. An algorithm for identifying nonsystematic data is presented that is based on the expectation of a monotonically decreasing discounting function. This algorithm identified 13 cases out of the 161 reanalyzed data sets as nonsystematic. These nonsystematic data are presented, along with examples of data not identified as nonsystematic. This algorithm, or modifications of it, may be useful in a variety of human and nonhuman animal discounting studies (e.g., delay discounting, probability discounting) as an alternative to the R2 measure for identifying nonsystematic data. The algorithm may be used in empirical investigations to improve discounting methodology, and may be used to identify outliers to be removed from analyses.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Delay Discounting data that failed three pre-specified validity criteria were treated as missing in analyses.
“Data that did not meet validity criteria were treated as missing in analyses.”
From Subtyping cognitive profiles in Autism Spectrum Disorder using a Functional Random Forest algorithm (2018) · cites this paper as [76]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Time Discounting and Time Preference: A Critical Review
Frederick, S., Loewenstein, G., & O’Donoghue, T. (2002) · Journal of Economic Literature · doi:10.1257/002205102320161311 · Cited by 6,106 · see citing works
Model Selection and Multimodel Inference
(2003) · Technometrics · doi:10.1198/tech.2003.s146 · Cited by 5,505 · see citing works
Delay of gratification in children.
Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989) · Science · doi:10.1126/science.2658056 · Cited by 3,397 · see citing works
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708 · see citing works
Some empirical evidence on dynamic inconsistency
Thaler, R. (1981) · Economics Letters · doi:10.1016/0165-1765(81)90067-7 · Cited by 2,394 · see citing works
Anomalies in Intertemporal Choice: Evidence and an Interpretation
Loewenstein, G., & Prelec, D. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118482 · Cited by 2,305 · see citing works
An adjusting procedure for studying delayed reinforcement.
Mazur, J. E. (1987) · doi:10.4324/9781315825502-11 · Cited by 2,189 · see citing works
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,142 · see citing works
Motulsky, H. J., & Christopoulos, A. (2004) · Cited by 1,999 · see citing works
Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers
Bickel, W. K., Odum, A. L., & Madden, G. J. (1999) · Psychopharmacology · doi:10.1007/pl00005490 · Cited by 1,433 · see citing works
Self-citationSUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341 · see citing works
COMMITMENT, CHOICE AND SELF‐CONTROL<sup>1</sup>
Rachlin, H., & Green, L. (1972) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1972.17-15 · Cited by 1,204 · see citing works
Discounting of Delayed Rewards: A Life-Span Comparison
Green, L., Fry, A. F., & Myerson, J. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00610.x · Cited by 1,165 · see citing works
WITHIN‐SUBJECT COMPARISON OF REAL AND HYPOTHETICAL MONEY REWARDS IN DELAY DISCOUNTING
Johnson, M. W., & Bickel, W. K. (2002) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2002.77-129 · Cited by 991 · see citing works
Self-citationDiscount rates inferred from decisions: an experimental study
Benzion, U., Israel, H., Rapoport, A., & Yagil, J. (1987) · Management Science · doi:10.1287/mnsc.35.3.270 · Cited by 967 · see citing works
Ainslie, G. W. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9781139164191 · Cited by 958 · see citing works
Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.5.3.256 · Cited by 911 · see citing works
Self-citationHow persuasive is a good fit? A comment on theory testing.
Roberts, S., & Pashler, H. (2000) · Psychological Review · doi:10.1037/0033-295x.107.2.358 · Cited by 879 · see citing works
DISCOUNTING OF DELAYED REWARDS: MODELS OF INDIVIDUAL CHOICE
Myerson, J., & Green, L. (1995) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1995.64-263 · Cited by 843 · see citing works
DELAY OR PROBABILITY DISCOUNTING IN A MODEL OF IMPULSIVE BEHAVIOR: EFFECT OF ALCOHOL
Richards, J. B., Zhang, L., Mitchell, S. H., & de Wit, H. (1999) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1999.71-121 · Cited by 792 · see citing works
Research on self-control: An integrating framework
Logue, A. W. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00053978 · Cited by 792 · see citing works
Handbook of Nonlinear Regression Models.
Giddings, D. R., & Ratkowsky, D. A. (1991) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347928 · Cited by 777 · see citing works
A review of delay-discounting research with humans: relations to drug use and gambling
Reynolds, B. (2006) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e3280115f99 · Cited by 711 · see citing works
Frames of mind in intertemporal choice
Loewenstein, G. (1988) · Management Science · doi:10.1287/mnsc.34.2.200 · Cited by 667 · see citing works
Delay discounting of real and hypothetical rewards.
Madden, G. J., Begotka, A. M., Raiff, B. R., & Kastern, L. L. (2003) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.11.2.139 · Cited by 660 · see citing works
Barkley, R. A., Edwards, G., Laneri, M., Fletcher, K., & Metevia, L. (2001) · Journal of Abnormal Child Psychology · doi:10.1023/a:1012233310098 · Cited by 638 · see citing works
Loewenstein, G. F., & Elster, J. (1992) · Medical Entomology and Zoology · Cited by 603 · see citing works
Baker, F., Johnson, M. W., & Bickel, W. K. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.3.382 · Cited by 602 · see citing works
Self-citationPathological gambling severity is associated with impulsivity in a delay discounting procedure.
Alessi, S. M., & Petry, N. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00150-5 · Cited by 549 · see citing works
CHOICE AND DELAY OF REINFORCEMENT1
Chung, S., & Herrnstein, R. J. (1967) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1967.10-67 · Cited by 540 · see citing works
Cross-Cultural Comparisons of Discounting Delayed and Probabilistic Rewards
Du, W., Green, L., & Myerson, J. (2002) · The Psychological Record · doi:10.1007/bf03395199 · Cited by 514 · see citing works
Rate of temporal discounting decreases with amount of reward
Green, L., Myerson, J., & McFadden, E. (1997) · Memory & Cognition · doi:10.3758/bf03211314 · Cited by 508 · see citing works
Temporal discounting in choice between delayed rewards: The role of age and income.
Green, L., Myerson, J., Lichtman, D., Rosen, S., & Fry, A. F. (1996) · Psychology and Aging · doi:10.1037//0882-7974.11.1.79 · Cited by 505 · see citing works
An Introduction to Model Selection
Zucchini, W. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1276 · Cited by 466 · see citing works
TEMPORAL DISCOUNTING: BASIC RESEARCH AND THE ANALYSIS OF SOCIALLY IMPORTANT BEHAVIOR
Critchfield, T. S., & Kollins, S. H. (2001) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2001.34-101 · Cited by 439 · see citing works
Krishnan-Sarin, S., Reynolds, B., Duhig, A. M., Smith, A., Liss, T., McFetridge, A., Cavallo, D. A., Carroll, K. M., & Potenza, M. N. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.09.006 · Cited by 436 · see citing works
Pitt, M. A., & Myung, I. J. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)01964-2 · Cited by 419 · see citing works
Temporal discounting and preference reversals in choice between delayed outcomes
Green, L., Fristoe, N. M., & Myerson, J. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03213979 · Cited by 418 · see citing works
Diergaarde, L., Pattij, T., Poortvliet, I., Hogenboom, F., de Vries, W., Schoffelmeer, A. N. M., & De Vries, T. J. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.07.011 · Cited by 391 · see citing works
Perry, J. L., Larson, E. B., German, J. P., Madden, G. J., & Carroll, M. E. (2005) · Psychopharmacology · doi:10.1007/s00213-004-1994-4 · Cited by 388 · see citing works
Key Concepts in Model Selection: Performance and Generalizability
Forster, M. R. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1284 · Cited by 385 · see citing works
Effects of THC on Behavioral Measures of Impulsivity in Humans
McDonald, J. M., Schleifer, L., Richards, J. B., & de Wit, H. (2003) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300176 · Cited by 369 · see citing works
The effect of delay and of intervening events on reinforcement value.
Commons, M. L. (1987) · Medical Entomology and Zoology · Cited by 361 · see citing works
Lagorio, C. H., & Madden, G. J. (2005) · Behavioural Processes · doi:10.1016/j.beproc.2005.02.003 · Cited by 359 · see citing works
Measuring state changes in human delay discounting: an experiential discounting task
Reynolds, B. A., & Schiffbauer, R. (2004) · Behavioural Processes · doi:10.1016/j.beproc.2004.06.003 · Cited by 354 · see citing works
Preference reversal and self control: choice as a function of reward amount and delay
Green, L., Fisher, E. B., Perlow, S., & Sherman, L. (1981) · Cited by 335 · see citing works
Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women.
Yoon, J. H., Higgins, S. T., Heil, S. H., Sugarbaker, R. J., Thomas, C. S., & Badger, G. J. (2007) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.15.2.186 · Cited by 322 · see citing works
Madden, G. J., Raiff, B. R., Lagorio, C. H., Begotka, A. M., Mueller, A. M., Hehli, D. J., & Wegener, A. A. (2004) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.12.4.251 · Cited by 314 · see citing works
Exponential versus hyperbolic discounting of delayed outcomes: Risk and waiting time.
GREEN, L., & MYERSON, J. (1996) · American Zoologist · doi:10.1093/icb/36.4.496 · Cited by 294 · see citing works
Three-month stability of delay and probability discounting measures.
Ohmura, Y., Takahashi, T., Kitamura, N., & Wehr, P. (2006) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.14.3.318 · Cited by 258 · see citing works
Green, L., Myerson, J., & Ostaszewski, P. (1999) · Behavioural Processes · doi:10.1016/s0376-6357(99)00021-2 · Cited by 258 · see citing works
Winstanley, C. A., Dalley, J. W., Theobald, D. E. H., & Robbins, T. W. (2003) · Psychopharmacology · doi:10.1007/s00213-003-1546-3 · Cited by 255 · see citing works
Reynolds, B., Richards, J. B., & de Wit, H. (2006) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2006.01.007 · Cited by 247 · see citing works
Reward discounting as a measure of impulsive behavior in a psychiatric outpatient population.
Crean, J., de Wit, H., & Richards, J. (2000) · Experimental and clinical psychopharmacology · doi:10.1037//1064-1297.8.2.155 · Cited by 218 · see citing works
Effects of sleep deprivation on impulsive behaviors in men and women
Acheson, A., Richards, J. B., & de Wit, H. (2007) · Physiology & Behavior · doi:10.1016/j.physbeh.2007.03.020 · Cited by 204 · see citing works
Delay discounting predicts cigarette smoking in a laboratory model of abstinence reinforcement
Dallery, J., & Raiff, B. R. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0627-5 · Cited by 191 · see citing works
Mitchell, S. H. (2004) · Nicotine & Tobacco Research · doi:10.1080/14622200412331296002 · Cited by 190 · see citing works
Reliability of a Measure of Temporal Discounting
Simpson, C. A., & Vuchinich, R. E. (2000) · The Psychological Record · doi:10.1007/bf03395339 · Cited by 181 · see citing works
Outcome Signs, Question Frames and Discount Rates
Shelley, M. K. (1993) · Management Science · doi:10.1287/mnsc.39.7.806 · Cited by 177 · see citing works
Comparison between two measures of delay discounting in smokers.
Epstein, L. H., Richards, J. B., Saad, F. G., Paluch, R. A., Roemmich, J. N., & Lerman, C. E. (2003) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.11.2.131 · Cited by 118 · see citing works
Hamidovic, A., Kang, U. J., & de Wit, H. (2008) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e3181602fab · Cited by 97 · see citing works
Is the delay discounting paradigm useful in understanding social anxiety?
Rounds, J., Beck, J. G., & Grant, D. M. (2006) · Behaviour Research and Therapy · doi:10.1016/j.brat.2006.06.007 · Cited by 84 · see citing works
Concave utility, transaction costs, and risk in measuring discounting of delayed rewards.
Kirby, K. N., & Santiesteban, M. (2003) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.29.1.66 · Cited by 79 · see citing works
Measurement of delay discounting using trial-by-trial consequences
Lane, S. D., Cherek, D. R., Pietras, C. J., & Tcheremissine, O. V. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00143-8 · Cited by 76 · see citing works
Functional parameters of delay discounting assessment tasks: Order of presentation
Robles, E., & Vargas, P. A. (2007) · Behavioural Processes · doi:10.1016/j.beproc.2007.02.014 · Cited by 72 · see citing works
Self-control and impulsiveness involving aversive events.
Deluty, M. Z. (1978) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.4.3.250 · Cited by 69 · see citing works
Delay discounting: A fundamental behavioral process of drug dependence.
Bickel, W. K., & Johnson, M. W. (2003) · Cited by 60 · see citing works
Self-citationAre some motives more linked to suicide proneness than others?
Holden, R. R., Kerr, P. S., Mendonca, J. D., & Velamoor, V. R. (1998) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199808)54:5 · Cited by 59 · see citing works
Dimensions of Deception in Personality Assessment: The Example of the MMPI-2
Nichols, D. S., & Greene, R. L. (1997) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6802_3 · Cited by 56 · see citing works
Experimental Analysis of Behavior
(2021) · Springer eBooks · doi:10.1007/978-3-319-19650-3_301644 · Cited by 56 · see citing works
A comparison of two algorithms in computerized temporal discounting procedures
Kowal, B. P., Yi, R., Erisman, A. C., & Bickel, W. K. (2007) · Behavioural Processes · doi:10.1016/j.beproc.2007.02.005 · Cited by 31 · see citing works
Self-citationTemporal discounting predicts individual competitive success in a human analogue of group foraging
Critchfield, T. S., & Atteberry, T. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00129-3 · Cited by 29 · see citing works
Flagged first, then by citations
1 of the 73 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Peters, J., & Büchel, C. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.026 · Cited by 871 · see citing works
A 5-trial adjusting delay discounting task: Accurate discount rates in less than one minute.
Koffarnus, M. N., & Bickel, W. K. (2014) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0035973 · Cited by 392 · see citing works
Self-citationIdentification and management of nonsystematic purchase task data: Toward best practice.
Stein, J. S., Koffarnus, M. N., Snider, S. E., Quisenberry, A. J., & Bickel, W. K. (2015) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000020 · Cited by 281 · see citing works
Self-citationPercent body fat is related to delay and probability discounting for food in humans
Rasmussen, E. B., Lawyer, S. R., & Reilly, W. (2009) · Behavioural Processes · doi:10.1016/j.beproc.2009.09.001 · Cited by 274 · see citing works
Unstuck in time: episodic future thinking reduces delay discounting and cigarette smoking
Stein, J. S., Wilson, A. G., Koffarnus, M. N., Daniel, T. O., Epstein, L. H., & Bickel, W. K. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4410-y · Cited by 267 · see citing works
Self-citationReliability and validity of a demand curve measure of alcohol reinforcement.
Murphy, J. G., MacKillop, J. M., Skidmore, J. R., & Pederson, A. A. (2009) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0017684 · Cited by 253 · see citing works
Episodic future thinking: expansion of the temporal window in individuals with alcohol dependence
Snider, S. E., LaConte, S. M., & Bickel, W. K. (2016) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.13112 · Cited by 241 · see citing works
Self-citationMyopic Discounting of Future Rewards after Medial Orbitofrontal Damage in Humans
Sellitto, M., Ciaramelli, E., & di Pellegrino, G. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2516-10.2010 · Cited by 229 · see citing works
Bobova, L., Finn, P. R., Rickert, M. E., & Lucas, J. (2009) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0014503 · Cited by 203 · see citing works
Johnson, M. W., & Bruner, N. R. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.09.032 · Cited by 204 · see citing works
Self-citationDelay Discounting in Current and Former Marijuana-Dependent Individuals
Johnson, M. W., Bickel, W., Baker, F., Moore, B. A., Badger, G., & Budney, A. (2010) · Experimental and clinical psychopharmacology · doi:10.1037/a0018333 · Cited by 213 · see citing works
Self-citationSubtyping cognitive profiles in Autism Spectrum Disorder using a Functional Random Forest algorithm
Feczko, E., Balba, N. M., Miranda-Dominguez, O., Cordova, M., Karalunas, S. L., Irwin, L., Demeter, D. V., Hill, A. P., Langhorst, B. H., Grieser Painter, J., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.044 · Cited by 173 · see citing works
Costa Dias, T. G., Wilson, V. B., Bathula, D. R., Iyer, S. P., Mills, K. L., Thurlow, B. L., Stevens, C. A., Musser, E. D., Carpenter, S. D., Grayson, D. S., et al. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.10.015 · Cited by 180 · see citing works
Sze, Y. Y., Stein, J. S., Bickel, W. K., Paluch, R. A., & Epstein, L. H. (2017) · Clinical Psychological Science · doi:10.1177/2167702617696511 · Cited by 165 · see citing works
Self-citationMechanical Turk data collection in addiction research: utility, concerns and best practices
Mellis, A. M., & Bickel, W. K. (2020) · Addiction · doi:10.1111/add.15032 · Cited by 164 · see citing works
Self-citationDelay discounting of reward in ADHD: application in young children
Wilson, V. B., Mitchell, S. H., Musser, E. D., Schmitt, C. F., & Nigg, J. T. (2011) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2010.02347.x · Cited by 158 · see citing works
Hendrickson, K. L., & Rasmussen, E. B. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.04.002 · Cited by 161 · see citing works
Further evidence of the heterogeneous nature of impulsivity
Caswell, A. J., Bond, R., Duka, T., & Morgan, M. J. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.11.059 · Cited by 157 · see citing works
Test–retest reliability of a group-administered paper–pencil measure of delay discounting.
Beck, R. C., & Triplett, M. F. (2009) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0017078 · Cited by 157 · see citing works
Internet Addiction and Delay Discounting in College Students
Saville, B. K., Gisbert, A., Kopp, J., & Telesco, C. (2010) · The Psychological Record · doi:10.1007/bf03395707 · Cited by 150 · see citing works
The Genetics of Impulsivity: Evidence for the Heritability of Delay Discounting
Anokhin, A. P., Grant, J. D., Mulligan, R. C., & Heath, A. C. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.10.022 · Cited by 144 · see citing works
Characterizing heterogeneity in children with and without ADHD based on reward system connectivity
Costa Dias, T. G., Iyer, S. P., Carpenter, S. D., Cary, R. P., Wilson, V. B., Mitchell, S. H., Nigg, J. T., & Fair, D. A. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.12.005 · Cited by 130 · see citing works
Demand curves for hypothetical cocaine in cocaine-dependent individuals
Bruner, N. R., & Johnson, M. W. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3312-5 · Cited by 131 · see citing works
Self-citationAltering Impulsive Decision Making With an Acceptance-Based Procedure
Morrison, K. L., Madden, G. J., Odum, A. L., Friedel, J. E., & Twohig, M. P. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.01.001 · Cited by 129 · see citing works
Herting, M. M., Schwartz, D., Mitchell, S. H., & Nagel, B. J. (2010) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2010.01244.x · Cited by 117 · see citing works
Dimensions of impulsive behavior in obese, overweight, and healthy-weight adolescents
Fields, S. A., Sabet, M., & Reynolds, B. A. (2013) · Appetite · doi:10.1016/j.appet.2013.06.089 · Cited by 115 · see citing works
Mitchell, S. H., & Wilson, V. B. (2009) · Behavioural Processes · doi:10.1016/j.beproc.2009.09.003 · Cited by 115 · see citing works
Berry, M. S., Sweeney, M. M., Morath, J., Odum, A. L., & Jordan, K. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0097915 · Cited by 114 · see citing works
Opportunity costs of reward delays and the discounting of hypothetical money and cigarettes
Johnson, P. S., Herrmann, E. S., & Johnson, M. W. (2014) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.110 · Cited by 112 · see citing works
Self-citationJohnson, M. W., Herrmann, E. S., Sweeney, M. M., LeComte, R. S., & Johnson, P. S. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4493-5 · Cited by 109 · see citing works
Self-citationKaralunas, S. L., Gustafsson, H. C., Dieckmann, N. F., Tipsord, J., Mitchell, S. H., & Nigg, J. T. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000292 · Cited by 104 · see citing works
Franck, C. T., Koffarnus, M. N., House, L., & Bickel, W. K. (2014) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.128 · Cited by 107 · see citing works
Self-citationDariotis, J. K., & Johnson, M. W. (2014) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0038399 · Cited by 108 · see citing works
Self-citationRisk, Reward, and Economic Decision Making in Aging
Roalf, D. R., Mitchell, S. H., Harbaugh, W. T., & Janowsky, J. S. (2011) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbr099 · Cited by 105 · see citing works
Berry, M. S., Repke, M. A., Nickerson, N. P., Conway, L. G., Odum, A. L., & Jordan, K. E. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141030 · Cited by 102 · see citing works
Herrmann, E. S., Hand, D. J., Johnson, M. W., Badger, G. J., & Heil, S. H. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.07.026 · Cited by 100 · see citing works
Self-citationClinical models of decision making in addiction
Koffarnus, M. N., & Kaplan, B. A. (2017) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2017.08.010 · Cited by 99 · see citing works
Rass, O., Schacht, R. L., Buckheit, K. A., Johnson, M. W., Strain, E. C., & Mintzer, M. Z. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.012 · Cited by 100 · see citing works
Self-citationProbability and delay discounting of hypothetical sexual outcomes
Lawyer, S. R., Williams, S. A., Příhodová, T., Rollins, J. D., & Lester, A. C. (2010) · Behavioural Processes · doi:10.1016/j.beproc.2010.04.002 · Cited by 96 · see citing works
The influence of episodic foresight on delay discounting and demand for alcohol
Bulley, A., & Gullo, M. J. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.11.003 · Cited by 95 · see citing works
Bailey, A. J., Romeu, R. J., & Finn, P. (2021) · Psychological Medicine · doi:10.1017/s0033291721002282 · Cited by 94 · see citing works
Lawyer, S. R., Schoepflin, F. J., Green, R. J., & Jenks, C. W. (2011) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0024141 · Cited by 93 · see citing works
Delaying gratification depends on social trust
Michaelson, L. E., de la Vega, A. I., Chatham, C. H., & Munakata, Y. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00355 · Cited by 95 · see citing works
Time preference and the importance of saving for retirement
Finke, M. S., & Huston, S. J. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2013.03.004 · Cited by 92 · see citing works
Skidmore, J. R., & Murphy, J. G. (2010) · Psychology of Addictive Behaviors · doi:10.1037/a0021118 · Cited by 92 · see citing works
Effects of selective dopaminergic compounds on a delay-discounting task
Koffarnus, M. N., Newman, A. H., Grundt, P., Rice, K. C., & Woods, J. H. (2011) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e3283473bcb · Cited by 91 · see citing works
Stein, J. S., Sze, Y. Y., Athamneh, L., Koffarnus, M. N., Epstein, L. H., & Bickel, W. K. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-017-9857-8 · Cited by 91 · see citing works
Self-citationJohnson, M. W., Johnson, P. S., Herrmann, E. S., & Sweeney, M. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0128641 · Cited by 91 · see citing works
Self-citationThe effects of the framing of time on delay discounting
DeHart, W. B., & Odum, A. L. (2015) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.125 · Cited by 90 · see citing works
Białaszek, W., Marcowski, P., & Ostaszewski, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0182353 · Cited by 87 · see citing works
Friedel, J. E., DeHart, W. B., Madden, G. J., & Odum, A. L. (2014) · Psychopharmacology · doi:10.1007/s00213-014-3597-z · Cited by 86 · see citing works
Positive urgency is related to difficulty inhibiting prepotent responses.
Johnson, S. L., Tharp, J. A., Peckham, A. D., Sanchez, A. H., & Carver, C. S. (2016) · Emotion · doi:10.1037/emo0000182 · Cited by 72 · see citing works
Smokers Report Greater Demand for Alcohol on a Behavioral Economic Purchase Task
Yurasek, A. M., Murphy, J. G., Clawson, A. H., Dennhardt, A. A., & MacKillop, J. M. (2013) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2013.74.626 · Cited by 76 · see citing works
Differential associations between obesity and behavioral measures of impulsivity
Lawyer, S. R., Boomhower, S. R., & Rasmussen, E. B. (2015) · Appetite · doi:10.1016/j.appet.2015.07.031 · Cited by 73 · see citing works
Stoeckel, L. E., Murdaugh, D. L., Cox, J. E., Cook, E. W., & Weller, R. E. (2012) · Brain Imaging and Behavior · doi:10.1007/s11682-012-9201-4 · Cited by 73 · see citing works
Working Memory Training Improves Alcohol Users’ Episodic Future Thinking: A Rate-Dependent Analysis
Snider, S. E., Deshpande, H. U., Lisinski, J. M., Koffarnus, M. N., LaConte, S. M., & Bickel, W. K. (2017) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.11.002 · Cited by 72 · see citing works
Self-citationAntonini, T. N., Becker, S. P., Tamm, L., & Epstein, J. N. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617715000752 · Cited by 72 · see citing works
Temporal and Probability Discounting by Cigarette Smokers Following Acute Smoking Abstinence
Yi, R., & Landes, R. D. (2012) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntr252 · Cited by 72 · see citing works
Johnson, M. W., & Bruner, N. R. (2013) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0033071 · Cited by 71 · see citing works
Self-citationValidation of a Novel Delay Discounting of Text Messaging Questionnaire
Reed, D. D., Becirevic, A., Atchley, P., Kaplan, B. A., & Liese, B. S. (2016) · The Psychological Record · doi:10.1007/s40732-016-0167-2 · Cited by 69 · see citing works
Discounting: A practical guide to multilevel analysis of indifference data
Young, M. E. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.265 · Cited by 69 · see citing works
Finn, P., Gunn, R. L., & Gerst, K. R. (2014) · Clinical Psychological Science · doi:10.1177/2167702614542279 · Cited by 67 · see citing works
Johnson, M. W. (2012) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0027088 · Cited by 67 · see citing works
Self-citationSymptoms of depression and PTSD are associated with elevated alcohol demand
Murphy, J. G., Yurasek, A. M., Dennhardt, A. A., Skidmore, J. R., McDevitt‐Murphy, M. E., MacKillop, J. M., & Martens, M. P. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.06.022 · Cited by 66 · see citing works
Lawyer, S. R., & Schoepflin, F. J. (2013) · Behavioural Processes · doi:10.1016/j.beproc.2013.03.001 · Cited by 68 · see citing works
Long-term test–retest reliability of delayed reward discounting in adolescents
Anokhin, A. P., Golosheykin, S., & Mulligan, R. C. (2015) · Behavioural Processes · doi:10.1016/j.beproc.2014.11.008 · Cited by 65 · see citing works
The Cambridge Handbook of Substance and Behavioral Addictions
Sussman, S. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591 · Cited by 63 · see citing works
Texting while driving as impulsive choice: A behavioral economic analysis
Hayashi, Y., Russo, C. T., & Wirth, O. (2015) · Accident Analysis & Prevention · doi:10.1016/j.aap.2015.07.025 · Cited by 64 · see citing works
Delay Discounting and Preference Reversals by Cigarette Smokers
Yi, R., Matusiewicz, A. K., & Tyson, A. (2016) · The Psychological Record · doi:10.1007/s40732-016-0165-4 · Cited by 63 · see citing works
Temporal discounting as a candidate behavioral marker of obesity
Bickel, W. K., Lemos, R. F., Tomlinson, D. C., Craft, W. H., Keith, D. R., Athamneh, L. N., Basso, J. C., & Epstein, L. H. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.035 · Cited by 62 · see citing works
Self-citationKoffarnus, M. N., & Woods, J. H. (2013) · Addiction Biology · doi:10.1111/j.1369-1600.2011.00361.x · Cited by 63 · see citing works
Krmpotich, T., Mikulich-Gilbertson, S., Sakai, J., Thompson, L., Banich, M. T., & Tanabe, J. (2015) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000129 · Cited by 61 · see citing works
Episodic future thinking reduces temporal discounting in healthy adolescents
Bromberg, U., Lobatcheva, M., & Peters, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0188079 · Cited by 60 · see citing works
Athamneh, L. N., Stein, M. D., Lin, E. H., Stein, J. S., Mellis, A. M., Gatchalian, K. M., Epstein, L. H., & Bickel, W. K. (2020) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000351 · Cited by 59 · see citing works
Self-citationCiaramelli, E., Luca, F. D., Kwan, D. T., Mok, J., Bianconi, F., Knyagnytska, V., Craver, C. F., Green, L., Myerson, J., & Rosenbaum, R. S. (2021) · eLife · doi:10.7554/elife.67387 · Cited by 61 · see citing works
Peters, J., Miedl, S. F., & Büchel, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047225 · Cited by 59 · see citing works
Johnson, P. S., Sweeney, M. M., Herrmann, E. S., & Johnson, M. W. (2016) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13079 · Cited by 59 · see citing works
Self-citationEffects of delay and probability combinations on discounting in humans
Cox, D. J., & Dallery, J. (2016) · Behavioural Processes · doi:10.1016/j.beproc.2016.08.002 · Cited by 59 · see citing works
Mellis, A. M., Snider, S. E., Deshpande, H. U., LaConte, S. M., & Bickel, W. K. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.06.010 · Cited by 59 · see citing works
Self-citationTian, M., Tao, R., Zheng, Y., Zhang, H., Yang, G., Li, Q., & Liu, X. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.10.018 · Cited by 59 · see citing works
Strickland, J. C., Reed, D. D., Hursh, S. R., Schwartz, L. P., Foster, R. N. S., Gelino, B. W., LeComte, R. S., Oda, F. S., Salzer, A. R., Schneider, T. D., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0258828 · Cited by 58 · see citing works
Self-citationDifferences in delay discounting between smokers and nonsmokers remain when both rewards are delayed
Mitchell, S. H., & Wilson, V. B. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2521-z · Cited by 52 · see citing works
Delay Discounting, Glycemic Regulation and Health Behaviors in Adults with Prediabetes
Epstein, L. H., Paluch, R. A., Stein, J. S., Quattrin, T., Mastrandrea, L. D., Bree, K. A., Sze, Y. Y., Greenawald, M. H., Biondolillo, M. J., & Bickel, W. K. (2020) · Behavioral Medicine · doi:10.1080/08964289.2020.1712581 · Cited by 53 · see citing works
Self-citationHendrickson, K. L., Rasmussen, E. B., & Lawyer, S. R. (2015) · Appetite · doi:10.1016/j.appet.2015.03.015 · Cited by 52 · see citing works
Delay discounting by depressed and non-depressed adolescent smokers and non-smokers
Imhoff, S., Harris, M., Weiser, J., & Reynolds, B. A. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.11.014 · Cited by 52 · see citing works
Epstein, L. H., Jankowiak, N., Lin, H. C., Paluch, R. A., Koffarnus, M. N., & Bickel, W. K. (2014) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.079772 · Cited by 51 · see citing works
Self-citationKaplan, B. A., Reed, D. D., & Jarmolowicz, D. (2016) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.277 · Cited by 45 · see citing works
Discounting: A practical guide to multilevel analysis of choice data
Young, M. E. (2018) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.316 · Cited by 51 · see citing works
Delay discounting and task performance consistency in patients with schizophrenia
Weller, R. E., Avsar, K. B., Cox, J. E., Reid, M. A., White, D. M., & Lahti, A. C. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2013.11.013 · Cited by 50 · see citing works
Comparing hyperbolic, delay-amount sensitivity and present-bias models of delay discounting
Mitchell, S. H., Wilson, V. B., & Karalunas, S. L. (2015) · Behavioural Processes · doi:10.1016/j.beproc.2015.03.006 · Cited by 48 · see citing works
Reed, D. D., Naudé, G. P., Gelino, B. W., & Amlung, M. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.011 · Cited by 48 · see citing works
Athamneh, L. N., Brown, J. M., Stein, J. S., Gatchalian, K. M., LaConte, S. M., & Bickel, W. K. (2021) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000460 · Cited by 50 · see citing works
Self-citationIncreased Delay Discounting on a Novel Real-Time Task among Girls, but not Boys, with ADHD
Rosch, K. S., & Mostofsky, S. H. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617715001071 · Cited by 50 · see citing works
Sexual discounting: A systematic review of discounting processes and sexual behavior.
Johnson, M. W., Strickland, J. C., Herrmann, E. S., Dolan, S. B., Cox, D. J., & Berry, M. S. (2020) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000402 · Cited by 49 · see citing works
Self-citationHerrmann, E. S., Johnson, P. S., & Johnson, M. W. (2015) · AIDS and Behavior · doi:10.1007/s10461-015-1107-x · Cited by 48 · see citing works
Self-citationThe future and me: Imagining the future and the future self in adolescent decision making
Mccue, R., McCormack, T., McElnay, J., Alto, A., & Feeney, A. (2019) · Cognitive development · doi:10.1016/j.cogdev.2019.04.001 · Cited by 47 · see citing works
The Prevention and Treatment of Gambling Disorders: Some Art, Some Science
Derevensky, J. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.024 · Cited by 45 · see citing works
Cortisol reactivity, delay discounting and percent body fat in Chinese urban young adolescents
Lu, Q., Tao, F., Hou, F., Zhang, Z., Sun, Y., Xu, Y., Xu, S., & Zhao, Y. (2013) · Appetite · doi:10.1016/j.appet.2013.09.019 · Cited by 44 · see citing works
The discounting model selector: Statistical software for delay discounting applications
Gilroy, S. P., Franck, C. T., & Hantula, D. A. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.257 · Cited by 46 · see citing works
Considering the Overlap and Nonoverlap of Compulsivity, Impulsivity, and Addiction
Blum, A. W., & Grant, J. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.038 · Cited by 44 · see citing works
- Authors
- Johnson, M. W., & Bickel, W. K.
- Affiliations
- Johns Hopkins University (US)
- University of Arkansas for Medical Sciences (US)
- Venue
- Experimental and Clinical Psychopharmacology
- Published
- 2008
- Volume
- 16
- Issue
- 3
- Pages
- 264-274
- ISSN
- 1064-1297 (ISSN-L)
- 1936-2293
- PMC
- PMC2765051
- OpenAlex
- W2092110116
- Cited by
- 555
- References
- 73
- Citations by year
- 2026: 28 · 2025: 33 · 2024: 35 · 2023: 37 · 2022: 39 · 2021: 40 · 2020: 81 · 2019: 34 · 2018: 32 · 2017: 40 · 2016: 31 · 2015: 36 · 2014: 28 · 2013: 18 · 2012: 11
- FWCI
- 6.51
- Type
- journal article
- Language
- en
- Update notices
- correction (2008-08-25)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Experimental and Clinical Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01 DA 11692; T32 DA07242)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- delay discounting, discount rate, model fit assessment, outlier detection, probability discounting
- MeSH terms
- Algorithms, Animals, Behavior, Humans, Motivation, Reinforcement, Psychology, Smoking, Time Factors, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
