Neural and psychological mechanisms underlying appetitive learning: links to drug addiction
Section snippets
Introduction: the psychology of action
The study of motivated action is the study of instrumental conditioning — the process by which animals alter their behaviour when there is a contingency between their behaviour and a reinforcing outcome [1]. Instrumental conditioning is neither psychologically nor neurally simple. Rats and humans exhibit goal-directed action, which is based upon knowledge of the contingency between one’s actions and their outcomes, and knowledge of the value of those outcomes; these two psychological processes
Neural underpinnings of instrumental conditioning
Several limbic cortical and subcortical structures play a role in assessing the value of reinforcers and of stimuli that predict them, and in actions directed at obtaining those reinforcers or stimuli [7•]. The contribution of key elements of this circuitry, including the amygdala and orbitofrontal cortex, are discussed by Holland and Gallagher and Matsumoto and Tanaka (this volume), and in this review we will therefore restrict out discussion primarily to the role of the nucleus accumbens
Differences between drugs of abuse and natural reinforcement
Clearly, ‘natural’ reinforcers, such as food and sex, have their effects in very similar ways to ‘artificial’ reinforcers, such as drugs of abuse; there may be no sharp dividing line between the two. A behavioural economic view would liken addiction to that situation in which demand for a particular reinforcer (drug) has become relatively ‘inelastic’ — that is, it remains high in the face of increased price or other costs associated with drug-taking 57., 58., 59., 60.. Yet this could represent
Conclusions
Key questions remain as to what extent food and drug reinforcement are qualitatively or quantitatively different. Is sensitisation of a motivational system a specific property of drugs of abuse that gives them value above that of alternative reinforcers and renders the user hypersensitive to ‘wanting’ induced by environmental cues signalling the availability of those drugs? Does compulsive (or habitual) responding develop as a consequence of sensitisation, can it develop in the absence of
Update
Two recent studies have shed further light on the way in which habits are acquired and/or expressed. Rats with lesions of the dorsolateral striatum do not acquire habits normally [86•], while the infralimbic cortex may suppress goal-directed actions once behaviour has become habitual [87•].
References and recommended reading
Papers of particular interest, published within the annual period of review, have been highlighted as:
- •
of special interest
- ••
of outstanding interest
Acknowledgements
The work was supported by a UK Medical Research Council Programme Grant and the Medical Research Council Cambridge Centre for Behavioural and Clinical Neuroscience.
References (87)
- et al.
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Neurosci Biobehav Rev
(2002) - et al.
The role of withdrawal in heroin addiction: enhances reward or promotes avoidance?
Nat Neurosci
(2001) - et al.
The biological, social and clinical bases of drug addiction: commentary and debate
Psychopharmacology (Berl)
(1996) - et al.
Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens
Nat Neurosci
(2002) - et al.
Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour
Eur J Neurosci
(2001) - et al.
Auto-shaping of the pigeon’s keypeck
J Exp Anal Behav
(1968) - et al.
Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping performance in rats
Behav Neurosci
(2002) - et al.
Hyperdopaminergic mutant mice have higher ‘wanting’ but not ‘liking’ for sweet rewards
J Neurosci
(2003) - et al.
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Brain Res Brain Res Rev
(1998) - et al.
Differential control over drug-seeking behavior by drug-associated conditioned reinforcers and discriminative stimuli predictive of drug availability
Behav Neurosci
(2003)
The effects of nucleus accumbens core and shell lesions on intravenous heroin self-administration and the acquisition of drug-seeking behaviour under a second-order schedule of heroin reinforcement
Psychopharmacology (Berl)
Dissociable effects of antagonism of NMDA and AMPA/KA receptors in the nucleus accumbens core and shell on cocaine-seeking behavior
Neuropsychopharmacology
Molecular cloning and characterization of a novel dopamine receptor (D3) as a target for neuroleptics
Nature
A behavioral economic analysis of polydrug abuse in alcoholics: asymmetrical substitution of alcohol and cocaine
Drug Alcohol Depend
Intake of high-fat food is selectively enhanced by mu opioid receptor stimulation within the nucleus accumbens
J Pharmacol Exp Ther
Repeated nicotine exposure enhances reward-related learning in the rat
Neuropsychopharmacology
Behavioral sensitization in humans
J Addict Dis
Myths about the treatment of addiction
Lancet
Dopamine mediation of positive reinforcing effects of amphetamine in stimulant naive healthy volunteers: results from a large cohort
Eur Neuropsychopharmacol
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning
Eur J Neurosci
Motivational control of goal-directed action
Anim Learn Behav
Instrumental performance following reinforcer devaluation depends upon incentive learning
Q J Exp Psychol B
Variations in the sensitivity of instrumental responding to reinforcer devaluation
Q J Exp Psychol B
Modulation of taste affect by hunger, caloric satiety, and sensory-specific satiety in the rat
Appetite
Pleasure: the common currency
J Theor Biol
Conditioned effects of environmental stimuli paired with smoked cocaine in humans
Psychopharmacology (Berl)
Response-reinforcement learning is dependent on N-methyl-D-aspartate receptor activation in the nucleus accumbens core
Proc Natl Acad Sci U S A
Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning
J Neurosci
Appetitive instrumental learning is impaired by inhibition of cAMP-dependent protein kinase within the nucleus accumbens
Neurobiol Learn Mem
Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats
Exp Brain Res
Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action
Behav Brain Res
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Science
Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward ‘wanting’ without enhanced ‘liking’ or response reinforcement
J Neurosci
Incentive sensitization by previous amphetamine exposure: increased cue-triggered ‘wanting’ for sucrose reward
J Neurosci
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists
Behav Neurosci
Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive Pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by d-amphetamine
J Neurosci
Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens
Psychopharmacology (Berl)
6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine
Psychopharmacology (Berl)
Potentiation of the effects of reward-related stimuli by dopaminergic-dependent mechanisms in the nucleus accumbens
Psychopharmacology (Berl)
Cited by (198)
Homeostatic regulation of reward via synaptic insertion of calcium-permeable AMPA receptors in nucleus accumbens
2020, Physiology and BehaviorGut-brain axis and addictive disorders: A review with focus on alcohol and drugs of abuse
2019, Pharmacology and TherapeuticsFunctional and structural plasticity contributing to obesity: roles for sex, diet, and individual susceptibility
2018, Current Opinion in Behavioral SciencesNew vistas on cannabis use disorder
2017, NeuropharmacologySynergistic effect between D-AP5 and muscimol in the nucleus accumbens shell on memory consolidation deficit in adult male Wistar rats: An isobologram analysis
2017, Neurobiology of Learning and Memory