Abstract
Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.
Similar content being viewed by others
Data availability
All data and additional analyses in the Online Supplementary Material are made available.
Code availability
All R scripts used to model the data will be made available along with the data.
References
Ainslie, G. W. (1974). Impulse control in pigeons. Journal of the Experimental Analysis of Behavior, 21(3), 485–489.
Bailey, C., Peterson, J. R., Schnegelsiepen, A., Stuebing, S. L., & Kirkpatrick, K. (2018). Durability and generalizability of time-based intervention effects on impulsive choice in rats. Behavioural Processes, 152, 54–62.
Bailey, C., Panfil, K., & Kirkpatrick, K. (2021). Hazard function effects on promoting self-control in variable interval time-based interventions in rats. Journal of the Experimental Analysis of Behavior, 116(3), 279–299.
Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H., Dai, B., Scheipl, F., Grothendieck, G., & Green, P. (2018). Package “lme4.” Version, 1, 17.
Bates, D., Kliegl, R., Vasishth, S., & Baayen, H. (2015). Parsimonious mixed models. arXiv preprint arXiv:1506.04967.
Baumann, A. A., & Odum, A. L. (2012). Impulsivity, risk taking, and timing. Behavioural Processes, 90, 408–414. https://doi.org/10.1016/j.beproc.2012.04.005
Berlin, H. A., & Rolls, E. T. (2004). Time perception, impulsivity, emotionality, and personality in self-harming borderline personality disorder patients. Journal of Personality Disorders, 18, 358–378.
Bickel, W. K., & Mueller, E. T. (2009). Toward the study of trans-disease processes: A novel approach with special reference to the study of Co-morbidity. Journal of Dual Diagnosis, 5(2), 131–138. https://doi.org/10.1080/15504260902869147
Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Koffarnus, M. N., & Gatchalian, K. M. (2012). Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: Emerging evidence. Pharmacology & Therapeutics, 134(3), 287–297. https://doi.org/10.1016/j.pharmthera.2012.02.004
Bickel, W. K., Athamneh, L. N., Basso, J. C., Mellis, A. M., DeHart, W. B., Craft, W. H., & Pope, D. (2019). Excessive discounting of delayed reinforcers as a trans-disease process. Current Opinion in Psychology, 30, 59–64.
Buhusi, C. V., & Meck, W. H. (2000). Timing for the absence of a stimulus: The gap paradigm reversed. Journal of Experimental Psychology: Animal Behavior Processes, 26(3), 305.
Church, R. M., & Deluty, M. Z. (1977). Bisection of temporal intervals. Journal of Experimental Psychology: Animal Behavior Processes, 3(3), 216–228. https://doi.org/10.1037/0097-7403.3.3.216
Craig, A. R., Maxfield, A. D., Stein, J. S., Renda, C. R., & Madden, G. J. (2014). Do the adjusting-delay and increasing-delay tasks measure the same construct: Delay discounting? Behavioural Pharmacology, 25, 306–315.
Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., & Zdanowski, D. M. (1998). Using a self-control training procedure to increase appropriate behavior. Journal of Applied Behavior Analysis, 31(2), 203–210.
Eisenberger, R., & Adornetto, M. (1986). Generalized self-control of delay and effort. Journal of Personality and Social Psychology, 51, 1020–1031. https://doi.org/10.1037/0022-3514.51.5.1020
Evenden, J. L., & Ryan, C. N. (1996). The pharmacology of impulsive behavior in rats: The effects of drugs on response choice with varying delays to reinforcement. Psychopharmacology (Berlin), 128, 161–170.
Fox, A. T., Hand, D. J., & Reilly, M. P. (2008). Impulsive choice in a rodent model of attention-deficit/hyperactivity disorder. Behavioural Brain Research, 187(1), 146–152.
Fox, A. E., Visser, E. J., & Nicholson, A. M. (2019). Interventions aimed at changing impulsive choice in rats: Effects of immediate and relatively long delay to reward training. Behavioural Processes, 158, 126–136.
Jimura, K., Myerson, J., Hilgard, J., Keighley, J., Braver, T. S., & Green, L. (2011). Domain independence and stability in young and older adults” discounting of delayed rewards. Behavioural Processes, 87(3), 253–259. https://doi.org/10.1016/j.beproc.2011.04.006
Johnson, M. W., Bickel, W. K., & Baker, F. (2007). Moderate drug use and delay discounting: A comparison of heavy, light, and never smokers. Experimental and Clinical Psychopharmacology, 15(2), 187–194. https://doi.org/10.1037/1064-1297.15.2.187
Lenth, R., Singmann, H., Love, J., Buerkner, P., & Herve, M. (2018). Emmeans: Estimated marginal means, aka least-squares means. R Package Version, 1(1), 3.
Madden, G. J., & Bickel, W. K. (2010). Impulsivity: The behavioral and neurological science of discounting. American Psychological Association.
Marshall, A. T., Smith, A. P., & Kirkpatrick, K. (2014). Mechanisms of impulsive choice: I. Individual differences in interval timing and reward processing. Journal of the Experimental Analysis of Behavior, 102(1), 86–101. https://doi.org/10.1002/jeab.88
Matusiewicz, A. K., Carter, A. E., Landes, R. D., & Yi, R. (2013). Statistical equivalence and test-retest reliability of delay and probability discounting using real and hypothetical rewards. Behavioural Processes, 100, 116–122. https://doi.org/10.1016/j.beproc.2013.07.019
Mazur, J. E., & Logue, A. W. (1978). Choice in a “self-control” paradigm: Effects of a fading procedure. Journal of the Experimental Analysis of Behavior, 30(1), 11–17.
Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 55–73). Hillsdale, NJ: Erlbaum.
McClure, J., Podos, J., & Richardson, H. N. (2014). Isolating the delay component of impulsive choice in adolescent rats. Frontiers in Integrative Neuroscience, 8(3), 1–9. https://doi.org/10.3389/fnint.2014.00003
McGuire, J. T., & Kable, J. W. (2012). Decision makers calibrate behavioral persistence on the basis of time-interval experience. Cognition, 124(2), 216–226. https://doi.org/10.1016/j.cognition.2012.03.008
McGuire, J. T., & Kable, J. W. (2013). Rational temporal predictions can underlie apparent failures to delay gratification. Psychological Review, 120(2), 395–430.
Mies, G. W., Ma, I., de Water, E., Buitelaar, J. K., & Scheres, A. (2018). Waiting and working for rewards: Attention-Deficit/Hyperactivity Disorder is associated with steeper delay discounting linked to amygdala activation, but not with steeper effort discounting. Cortex, 106, 164–173.
Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989). Delay of gratification in children. Science, 244, 933–938.
Odum, A. L. (2011). Delay discounting: Trait variable? Behavioural Processes, 87(1), 1–9.
Odum, A. L., Becker, R. J., Haynes, J. M., Galizio, A., Frye, C. C., Downey, H., Friedel, J. E., & Perez, D. (2020). Delay discounting of different outcomes: Review and theory. Journal of the Experimental Analysis of Behavior, 113(3), 657–679.
Ohmura, Y., Takahashi, T., Kitamura, N., & Wehr, P. (2006). Three-month stability of delay and probability discounting measures. Experimental and Clinical Psychopharmacology, 14, 318–328. https://doi.org/10.1037/1064-1297.14.3.318
Paasche, C., Weibel, S., Wittmann, M., & Lalanne, L. (2019). Time perception and impulsivity: A proposed relationship in addictive disorders. Neuroscience & Biobehavioral Reviews, 106, 182–201.
Panfil, K., Bailey, C., Davis, I., Mains, A., & Kirkpatrick, K. (2020). A time-based intervention to treat impulsivity in male and female rats. Behavioural Brain Research, 379, 112316.
Peck, S., Rung, J. M., Hinnenkamp, J. E., & Madden, G. J. (2019). Reducing impulsive choice: VI. Delay-exposure training reduces aversion to delay-signaling stimuli. Psychology of Addictive Behaviors, 34, 147-155.
Peterson, J. R., & Kirkpatrick, K. (2016). The effects of a time-based intervention on experienced middle-aged rats. Behavioural Processes, 133, 44–51. https://doi.org/10.1016/j.beproc.2016.11.002
Peterson, J. R., Hill, C. C., & Kirkpatrick, K. (2015). Measurement of impulsive choice in rats: Same- and alternate-form test-retest reliability and temporal tracking. Journal of the Experimental Analysis of Behavior, 103(1), 166–179. https://doi.org/10.1002/jeab.124
Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., Heisterkamp, S., Van Willigen, B., & Maintainer, R. (2017). Package “nlme”. Linear and nonlinear mixed effects models, version, 3, 274.
Rapport, M. D., Tucker, S. B., DuPaul, G. J., Merlo, M., & Stoner, G. (1986). Hyperactivity and frustration: The influence of control over and size of rewards in delaying gratification. Journal of Abnormal Child Psychology, 14(2), 191–204.
Renda, R. C., & Madden, G. J. (2016). Impulsive choice and pre-exposure to delays: III. Four-month test-retest outcomes in male wistar rats. Behavioural Processes, 126, 108–112. https://doi.org/10.1016/j.beproc.2016.03.014
Rubia, K., Halari, R., Christakou, A., & Taylor, E. (2009). Impulsiveness as a timing disturbance: neurocognitive abnormalities in attention-deficit hyperactivity disorder during temporal processes and normalization with methylphenidate. Philosophical Transactions of the Royal Society B: Biological Sciences, 364, 1919–1931.https://doi.org/10.1098/rstb.2009.0014
Rung, J. M., Buhusi, C. V., & Madden, G. J. (2018). Reducing impulsive choice: V. The role of timing in delay-exposure training. Behavioural Processes, 157, 557–561.
Rung, J. M., & Madden, G. J. (2018). Experimental reductions of delay discounting and impulsive choice: A systematic review and meta-analysis. Journal of Experimental Psychology: General, 147(9), 1349–1381.
Scholten, H., Scheres, A., de Water, E., Graf, U., Granic, I., & Luijten, M. (2019). Behavioral trainings and manipulations to reduce delay discounting: A systematic review. Psychonomic Bulletin & Review, 26, 1803–1849.
Smith, A. P., Marshall, A. T., & Kirkpatrick, K. (2015). Mechanisms of impulsive choice: II. Time-based interventions to improve self-control. Behavioural Processes, 112, 29–42. https://doi.org/10.1016/j.beproc.2014.10.010
Smith, T. R., Panfil, K., Bailey, C., & Kirkpatrick, K. (2019). Cognitive and behavioral training interventions to promote self-control. Journal of Experimental Psychology: Animal Learning and Cognition, 45(3), 259.
Smith, T. R., Panfil, K., & Kirkpatrick, K. (2022). Generalizability of time-based interventions: Effects of choice procedure and smaller-sooner delay. Behavioural Processes, 196, 104584.
Smith, T. R., Southern, R., & Kirkpatrick, K. (2023). Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain. Learning & Behavior, 51, 355–391.
Solanto, M. V., Abikoff, H., Sonuga-Barke, E. J. S., Schachar, R., Logan, G. D., Wigal, T., Hechtman, L., Hinshaw, S., & Turkel, E. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215–228.
Sonuga-Barke, E. J. S., Taylor, E., Sembi, S., & Smith, J. (1992). Hyperactivity and delay aversion: I. The effect of delay on choice. Child Psychology & Psychiatry & Allied Disciplines, 33(2), 387–398. https://doi.org/10.1111/j.1469-7610.1992.tb00874.x
Stuebing, S. L., Marshall, A. T., Triplett, A., & Kirkpatrick, K. (2018). Females in the forefront: Time-based intervention effects on impulsive choice and interval timing in female rats. Animal Cognition, 21(6), 759–772.
Toplak, M. E., Dockstader, C., & Tannock, R. (2006). Temporal information processing in ADHD: Findings to date and new methods. Journal of Neuroscience Methods, 151, 15–29.
Van Dessel, J., Sonuga-Barke, E., Mies, G., Lemiere, J., Van der Oord, S., Morsink, S., & Danckaerts, M. (2018). Delay aversion in attention deficit/hyperactivity disorder is mediated by amygdala and prefrontal cortex hyper-activation. Journal of Child Psychology and Psychiatry, 59(8), 888–899.
Vessells, J., Sy, J. R., Wilson, A., & Green, L. (2018). Effects of delay fading and signals on self-control choices by children. Journal of Applied Behavior Analysis, 51(2), 374–381.
Zauberman, G., Kim, B. K., Malkoc, S. A., & Bettman, J. R. (2009). Discounting time and time discounting: Subjective time perception and intertemporal preferences. Journal of Marketing Research, 46(4), 543–556.
Acknowledgements
We thank current and former members of the Reward, Timing, and Decision Laboratory who contributed to data collection.
Funding
Some of the research described in this review was supported by National Institutes of Health grants R01MH085739 and P20GM113109 to Dr. Kimberly Kirkpatrick and Kansas State University. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Author information
Authors and Affiliations
Contributions
TS, AF, AD, and KK conceived and drafted parts of the manuscript and edited the other parts. Relative author contribution is based on the relative proportion of the review that was conceived and/or drafted by each individual.
Corresponding author
Ethics declarations
Ethics approval
All procedures were approved by the institutional animal care and use committee at Kansas State University in protocol # 3944.
Consent to participate
Not applicable.
Consent for publication
All authors have contributed significantly to the article and consent to having their names on the article.
Conflicts of interest/Competing interests
There are no conflicts of interest to report.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Smith, T., Fitch, A., Deavours, A. et al. Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays. Learn Behav (2024). https://doi.org/10.3758/s13420-023-00622-z
Accepted:
Published:
DOI: https://doi.org/10.3758/s13420-023-00622-z