The DOI matches its Crossref record; 72 of the 73 references it cites were found in a registry or an index.
An algorithm for identifying nonsystematic delay-discounting data.
Open accessAbstract
Several [corrected] discounting studies have use the R2 measure to identify data [corrected] with poor fits to a mathematical discounting model as nonsystematic data to be eliminated [corrected] Data from three previous delay-discounting studies (six separate groups, with a total of 161 individuals) were used to demonstrate why using R2 to assess the fits of discounting data is problematic. A significant, positive correlation between discounting rate parameter and R2 was found in most groups, showing that R2 is more stringent as a measure of fit for low discounting rates than for high discounting rates. Furthermore, it is suggested that identifying nonsystematic data based on any measure of fit to a mathematical discounting model may be problematic because it confounds discounting rate comparison with the issue of discounting model assessment. Therefore, a model-free method to identify nonsystematic data is needed. An algorithm for identifying nonsystematic data is presented that is based on the expectation of a monotonically decreasing discounting function. This algorithm identified 13 cases out of the 161 reanalyzed data sets as nonsystematic. These nonsystematic data are presented, along with examples of data not identified as nonsystematic. This algorithm, or modifications of it, may be useful in a variety of human and nonhuman animal discounting studies (e.g., delay discounting, probability discounting) as an alternative to the R2 measure for identifying nonsystematic data. The algorithm may be used in empirical investigations to improve discounting methodology, and may be used to identify outliers to be removed from analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Data that did not meet validity criteria were treated as missing in analyses.”
From Subtyping cognitive profiles in Autism Spectrum Disorder using a Functional Random Forest algorithm (2018) · cites this paper as [76]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Time Discounting and Time Preference: A Critical Review
Frederick, S., Loewenstein, G., & O’Donoghue, T. (2002) · Journal of Economic Literature · doi:10.1257/002205102320161311 · Cited by 6,106
Model Selection and Multimodel Inference
(2003) · Technometrics · doi:10.1198/tech.2003.s146 · Cited by 5,509
Delay of gratification in children.
Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989) · Science · doi:10.1126/science.2658056 · Cited by 3,397
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
Anomalies in Intertemporal Choice: Evidence and an Interpretation
Loewenstein, G., & Prelec, D. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118482 · Cited by 2,305
Some empirical evidence on dynamic inconsistency
Thaler, R. H. (1981) · Economics Letters · doi:10.1016/0165-1765(81)90067-7 · Cited by 2,282
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,142
Motulsky, H. J., & Christopoulos, A. (2004) · Cited by 1,972
An adjusting procedure for studying delayed reinforcement.
Commons, M. L., Mazur, J., Nevin, J. A., & Rachlin, H. C. (1987) · doi:10.4324/9781315825502-11 · Cited by 1,842
Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers
Bickel, W. K., Odum, A. L., & Madden, G. J. (1999) · Psychopharmacology · doi:10.1007/pl00005490 · Cited by 1,433
Self-citation
Cited by
Sorted by citations
Items 501–555 of 555
Gain-loss asymmetry in human experiential tasks
Asgarova, R. (2019) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17136776
Gain-loss asymmetry in human experiential tasks
Asgarova, R. (2019) · doi:10.26686/wgtn.17136776.v1
Clinical and Research Methods in the Addictions
Sussman, S. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.008
Levels of Analysis and Etiology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.014
Ongoing and Future Research Directions
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.030
Sussman, S. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.002
Srivastava, A. B., & Gold, M. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.033
Under what circumstances does autobiographical memory enhance self-control?
Duff, N. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17147285
Sussman, S. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.042
Interaction Design of Mobile-Based Product Display System
Xu, Y. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/7233677
In search of the preference reversal zone -- preprintPreprint
Glautier, S., Eisenbarth, H., & Macaskill, A. C. (2022) · doi:10.31219/osf.io/zg6fk
Sloan, M. E., Sanches, M., Tanabe, J., & Gowin, J. L. (2023) · medRxiv · doi:10.1101/2023.07.20.23292967
Diversidad en el neurodesarrollo
Leo-Jimenez, J. O. D., Rodríguez-Santillán, E., Valenzuela, C. C. C., Gomar, M. L. G., Alameda, A. J. C., Cortés, A. N., Moreno, M. B., Macedo, Z. B. N., Martínez, F. G., Carrillo, M. C., et al. (2024) · doi:10.52501/cc.143
Validation of the Sexual Discounting Task for Use in Adolescents
Thamotharan, S., Hahn, H. A., Ramos, A. M., Harris, B., Johnson, M. W., & Fields, S. A. (2024) · Archives of Sexual Behavior · doi:10.1007/s10508-024-02830-8 · Cited by 1
Self-citationBaca-Zeff, S., Rodriguez, L. R., Lee, Y., Robertson, S. H., & Rasmussen, E. B. (2024) · The Psychological Record · doi:10.1007/s40732-024-00609-w · Cited by 1
Effects of Observation of Different Health Behaviors on Surrogate Delay Discounting
Higginbotham, R., & Dallery, J. (2024) · The Psychological Record · doi:10.1007/s40732-024-00613-0
Hayashi, Y., Fisher, N. M., Hantula, D. A., & Washio, Y. (2025) · Substance Use & Misuse · doi:10.1080/10826084.2024.2445854
tempodisco: an R package for temporal discounting
Kinley, I. (2025) · The Journal of Open Source Software · doi:10.21105/joss.07472
Stress and episodic future thinking: Effects on temporal window and alcohol demand
Hoots, J. K., & Wardle, M. C. (2025) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.70058
Unpleasant mood reverses satiety’s effect on tobacco reinforcement
Loredo, V. M., & Ordóñez-Carrasco, J. L. (2025) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2025.112733
Human research methods for studying discounting
Koffarnus, M. N., Rzeszutek, M. J., Traxler, H. K., & Iglehart, S. E. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95745-8.00011-0
Policy implications of applied behavioral economics
Gelino, B. W., & Strickland, J. C. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95745-8.00005-5 · Cited by 1
Quantitative models of discounting
Franck, C. T. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95745-8.00004-3
Using Social Discounting to Measure Diabetes Discrimination
Gade, A., Hayashi, Y., & Romanowich, P. (2025) · The Psychological Record · doi:10.1007/s40732-025-00658-9
Role of trait impulsivity in distracted driving and walking: A Cluster analysis
Hayashi, Y., Romanowich, P., Hochmuth, J. M., & Wirth, O. (2025) · Journal of Safety Research · doi:10.1016/j.jsr.2025.08.004
Polysubstance use: delay discounting in relationship to remission
Quddos, F., Tomlinson, D. C., Fontes, R. M., Bickel, W. K., & Tegge, A. N. (2026) · Scientific Reports · doi:10.1038/s41598-026-56226-w
Self-citationTime estimation variability in delay discounting: Model comparison and considerations
Gelino, B. W., Graham, M. E., Strickland, J. C., Johnson, M. W., & Reed, D. D. (2025) · Behavioural Processes · doi:10.1016/j.beproc.2025.105281
Self-citationGolden, A., McLachlan, K., Amlung, M. T., Rasmussen, C., & Pei, J. R. (2025) · Advances in Neurodevelopmental Disorders · doi:10.1007/s41252-025-00467-9
Evaluating Future Thinking Priming Effects on Delay Discounting Among Young Adult Drinkers
García-Rangel, F., Huerta, H. E. R., dos Santos, C. V., Sosa, R., & Martínez, K. I. M. (2025) · International journal of psychological research · doi:10.21500/20112084.7551
Test–retest reliability for a social discounting of personal information task
Willson, S., Romanowich, P., Barba, K., & Chen, Q. (2025) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.70071
Bretz, M. N. (2012) · Cornerstone (Minnesota State University, Mankato)
Crandall, A. K., Madhudi, N., Osborne, B., Carter, A., Williams, A. K., & Temple, J. L. (2022) · Figshare · doi:10.6084/m9.figshare.20521650
Comparing Two Response Types during a Real Physical Effort Task: A Preliminary Study
Calvillo, A., Huerta, H. E. R., dos Santos, C., Escobar, G. G., & González, M. (2026) · The Psychological Record · doi:10.1007/s40732-025-00672-x
How Reinforcer Magnitude and Delay Interact in Delay Discounting: A Concatenated Choice Analysis
Newland, M. C., Brogan, K. M., & Rapp, J. T. (2026) · The Psychological Record · doi:10.1007/s40732-026-00673-4
Assessing Motivation for Condom Use Among MSM: Effort Discounting as a Novel Measure of Sexual Risk
Luehring‐Jones, P., Palfai, T. P., Simons, J. S., & Maisto, S. A. (2026) · AIDS and Behavior · doi:10.1007/s10461-026-05037-1
Effects of effort sequence and type of consequence in an effort discounting task
Macías-Navarrete, R., & dos Santos, C. V. (2026) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.70094
tempodisco: Temporal Discounting Models
Kinley, I. (2026) · doi:10.32614/cran.package.tempodisco
Fontes, R. M., Tomlinson, D. C., Tegge, A. N., Koffarnus, M. N., Stein, J. S., McClure, S. M., Myslowski, J., Faubion-Trejo, R., MacKillop, J. M., Kablinger, A. S., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9182511/v1 · Cited by 1
Self-citationLópez, P., Huerta, H. E. R., Pedroza, F. J., Cervantes, A., & Robles, E. (2026) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2026.106527
Impulsivity and pain attentional bias in veterans receiving care for chronic non-malignant pain
Bjork, J. M., Norris, P. J., & Trost, Z. (2026) · Frontiers in Pain Research · doi:10.3389/fpain.2026.1652567
Choice with ethical outcomes: Sign effect, commodity effect, and ethical theory preference
Cox, D. J., Diaz-Salvat, C. C., Weil, L., & Javed, A. (2026) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.70109
Behavioral Economics: Delay Discounting
Willis‐Moore, M. E., Callister, K. T., & Odum, A. L. (2026) · Springer eBooks · doi:10.1007/978-3-032-17450-5_8
Arias-Higuera, M., Hurtado‐Parrado, C., Brajcich, J., Pfeifer, E., Rodriguez, J., Roa, J. C., Sánchez, D. A., Acevedo, M., Sierra-Puentes, M. C., & Romanowich, P. (2026) · The Psychological Record · doi:10.1007/s40732-026-00692-1
Escobar, G. G., & Valero, C. Z. V. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1801136
Solomonov, N., Dayan, M., Argaman, R., Mama, Y., & Weinstein, A. M. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1828055
To linearize or not to linearize: That is the Mazur delay discounting question
Hinds, D., Tegge, A. N., Stein, J. S., LaConte, S. M., McClure, S. M., & Ferreira, M. A. R. (2026) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2026.103006
A behavioral measure for spite
Romanowich, P., Wilson, N. A., Wentz, A. M., Paz, G. E., & Sallee, I. (2026) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.70131
Carr, K. A., Hite, M. J., Dobiesz, O. J., Gailor, M., Paluch, R. A., Wang, L., Quattrin, T., Anzman‐Frasca, S., & Epstein, L. H. (2026) · JMIR Research Protocols · doi:10.2196/99962
Inducing forward head posture recalibrates the valuation of future rewards
Cohen, R. G., Billings, C. G., Hillend, C. L., & Baer, J. L. (2026) · Behavioural Brain Research · doi:10.1016/j.bbr.2026.116435
Type of Sexual Activity Impacts the Discounting of “Safe Sex”
Hawley, W. R., Griger, B. N., Cancilla, B. A., & Pinkerton, A. R. (2026) · The Journal of Sex Research · doi:10.1080/00224499.2026.2713073
Applying Behavioral Economics to HIV Prevention: Development of a Novel PrEP Demand Task
Yoon, J. H., Okafor, C. N., & de Dios, C. (2026) · AIDS and Behavior · doi:10.1007/s10461-026-05284-2
A novel method to assess delay discounting indicates greater ambivalence for delayed rewards
Kim, E., Kurnellas, R., Grunevski, S., Felton, J. W., & Yi, R. (2026) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.70140
Call, N. A., Scheithauer, M. C., Bernstein, A. M., Gillespie, S. E., Williams, C. L., McMahon, M. X. H., & Mitteer, D. R. (2026) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.70091
Metadata
- Authors
- Johnson, M. W., & Bickel, W. K.
- Affiliations
- Johns Hopkins University (US)
- University of Arkansas for Medical Sciences (US)
- Venue
- Experimental and Clinical Psychopharmacology
- Published
- 2008
- Volume
- 16
- Issue
- 3
- Pages
- 264-274
- ISSN
- 1064-1297 (ISSN-L)
- 1936-2293
- PMC
- PMC2765051
- OpenAlex
- W2092110116
- Cited by
- 555
- References
- 73
- Citations by year
- 2026: 28 · 2025: 33 · 2024: 35 · 2023: 37 · 2022: 39 · 2021: 40 · 2020: 81 · 2019: 34 · 2018: 32 · 2017: 40 · 2016: 31 · 2015: 36 · 2014: 28 · 2013: 18 · 2012: 11
- FWCI
- 6.51
- Type
- journal article
- Language
- en
- Update notices
- correction (2008-08-25)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Experimental and Clinical Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01 DA 11692; T32 DA07242)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- delay discounting, discount rate, model fit assessment, outlier detection, probability discounting
- MeSH terms
- Algorithms, Animals, Behavior, Humans, Motivation, Reinforcement, Psychology, Smoking, Time Factors, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review