PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Learn Mem. Author manuscript; available in PMC 2008 May 27.
Published in final edited form as:
Published online 2007 April 27. doi:  10.1101/lm.534807
PMCID: PMC2396594
NIHMSID: NIHMS49197

Withdrawal from cocaine self-administration produces long-lasting deficits in orbitofrontal-dependent reversal learning in rats

Abstract

Drug addicts make poor decisions. These decision-making deficits have been modeled in addicts and laboratory animals using reversal-learning tasks. However, persistent reversal-learning impairments have been shown in rats and monkeys only after noncontingent cocaine injections. Current thinking holds that to represent the human condition effectively, animal models of addiction must utilize self-administration procedures in which drug is earned contingently; thus, it remains unclear whether reversal-learning deficits caused by noncontingent cocaine exposure are relevant to addiction. To test whether reversal learning deficits are caused by contingent cocaine exposure, we trained rats to self-administer cocaine, assessed cue-induced cocaine seeking in extinction tests after 1 and 30 d of withdrawal, and then tested for reversal learning more than a month later. We found robust time-dependent increases in cue-induced cocaine seeking in the two extinction tests (incubation of craving) and severe reversal-learning impairments.

Drug addicts make poor decisions. General decision-making deficits have been modeled in addicts and also in drug-exposed rats and monkeys using simple reversal-learning tasks and more complex “gambling” variants. In these tasks, subjects learn to associate different cues with different probabilities of reward and punishment; once subjects are responding appropriately, the meanings of the cues are reversed. Psychostimulant addicts and rats and monkeys exposed to cocaine have difficulty learning to stop responding to previously rewarded cues in these settings, despite adverse or undesirable consequences (Rogers et al. 1999; Grant et al. 2000; Bechara et al. 2001; Jentsch et al. 2002; Schoenbaum et al. 2004). In rats and monkeys, reversal-learning deficits have been demonstrated more than a month after cocaine treatment, and in rats these deficits have been linked to miscoding of associative information in orbitofrontal cortex and basolateral amygdala (Calu et al. 2005; Stalnaker et al. 2006b), areas implicated in reversal learning in normal animals (Rolls et al. 1994; Chudasama and Robbins 2003; Schoenbaum et al. 2003; Izquierdo et al. 2004; Stalnaker et al. 2006a). These observations have led to the suggestion that drug-induced changes in orbitofrontal processing might contribute to maladaptive decision-making in addicts (Jentsch and Taylor 1999; Volkow and Fowler 2000; Schoenbaum et al. 2006).

Findings from rats and monkeys are critical to this notion, because they show that reversal-learning deficits are not pre-existing but instead are caused by drug exposure. However, these deficits have only been demonstrated after noncontingent experimenter-administered cocaine. It has been argued that to represent the human condition accurately, animal models of addiction must utilize self-administration procedures in which the drug is earned contingently during daily extended access sessions or over extended time periods (Wolffgramm et al. 2000; Deroche-Gamonet et al. 2004; Koob and Le Moal 2005). Indeed, contingent and noncontingent cocaine exposure induce different effects on brain neurochemistry and behavior in rats (Dworkin et al. 1995; Hemby et al. 1997; Crespo et al. 2001; Kiyatkin and Brown 2003; Lu et al. 2003; Kalivas and Hu 2006). As a result, it is not universally accepted that reversal-learning deficits demonstrated in these animal studies hold significance for understanding the behavior of addicts.

To explore whether long-lasting deficits in reversal learning occur after contingent exposure to cocaine, we trained rats to self-administer cocaine, tested for time-dependent increases in cue-induced cocaine seeking (i.e., incubation of craving; Grimm et al. 2001), and then assessed reversal learning using procedures identical to those we have used previously to test effects of noncontingent cocaine exposure and orbitofrontal lesions (Schoenbaum et al. 2003, 2004). All testing was conducted at the University of Maryland School of Medicine in accordance with University and NIH guidelines. Male Long-Evans rats (n = 7, 300–350 g, Charles River Labs) were implanted with jugular venous catheters, using published procedures (Lu et al. 2004a, 2005b). Silastic catheters were inserted into the jugular vein and passed subcutaneously to the top of the skull, where they were attached to a modified 22-gauge cannula (Plastics One) and mounted to the rat’s skull with dental cement. After a one-week recovery period, these rats were trained to lever press for cocaine infusions, using published procedures Lu et al. 2004a,b; Lu et al. 2005a,b). Briefly, self-administration was conducted in chambers from Coulbourn Instruments equipped with two levers. Pressing on the active lever resulted in infusion of cocaine-HCl (0.75 mg/kg/infusion) accompanied by a 4-sec tone-light cue, with a 40-sec timeout period after each infusion. Pressing on the inactive lever had no programmed consequences. Sessions lasted 3 h, with 15-min timeout periods after each hour, and continued for 14 consecutive days.

As Figure 1A illustrates, the rats acquired cocaine self-administration, as indicated by a significant interaction between lever and day in the analysis of active and inactive lever presses (F(13,156) = 3.94, P < 0.01) and a significant effect of training day for the number of infusions (F(13,65) = 10.4, P < 0.01). One and 30 d after the end of cocaine self-administration, we assessed lever pressing behavior during extinction sessions, using published procedures (Lu et al. 2004a, 2005b). These procedures were identical to those used in self-administration training except that pressing on the active lever did not result in drug infusion, though it did earn presentation of the tone-light cue that had been associated with drug infusion during training. Figure 1B shows pressing on the active and inactive levers during these extinction sessions. A 3-factor ANOVA (lever × hour × day) showed that the rats pressed significantly more on the active lever on both days (F(1,10) = 49.9, P < 0.001) and significantly more on the active lever on day 30 than on day 1, as indicated by a significant three-way interaction between lever, hour, and day (F(2,20) = 6.4, P < 0.01). A direct comparison of responding on the active lever on days 1 and 30 revealed a significant increase across days in the first hour (F(1,10) = 19.1, P < 0.01) and also over the entire 3-h test period (F(1,10) = 14.4, P < 0.01).

Figure 1
Cocaine self-administration and incubation of cocaine craving. (A) Mean ± SEM number of cocaine infusions, responses (both infusion + timeout responses) on the active, cocaine lever, and responses on the inactive lever during the three 1-h cocaine ...

Approximately one month after completion of late withdrawal (day 30) testing, the rats were water-deprived and then trained in an odor-guided go, no-go odor discrimination task. Odor discrimination testing was conducted in custom chambers that differed from those used for self-administration training. Procedures were identical to those we have used previously to assess the effects of lesions and passive exposure to cocaine (Schoenbaum et al. 2003, 2004). Briefly, rats sampled an odor on each trial and then had 3 sec to decide whether to respond at a nearby fluid well; the “positive” odor predicted delivery of an appetitive 10% sucrose solution and the “negative” odor predicted delivery of an aversive 0.02 M quinine solution. The rats were trained until they met a criterion of 18 correct responses in a moving block of 20 trials. After reaching criterion on several problems, they were tested on two serial reversals of the final problem. For this, the rats were first required to demonstrate retention of the original problem (S1+/S2−), by meeting the behavioral criterion again, and then they were required to meet this same criterion again after the odor-outcome associations were switched (S1−/S2+). After the rats acquired the first reversal, retention of the reversed problem (S1−/S2+) was assessed the following day, after which the rats had to acquire a re-reversal of the problem (S1+/S2−). Note that rats also had to perform at 80% correct over a 60-trial block in order for reversals to proceed to further ensure accurate performance over a large number of trials. Their performance was compared to a set of male Long-Evans control rats (n = 11, 300–350 g, Charles River Labs) that underwent discrimination and reversal testing using identical procedures in conjunction with a separate study (Stalnaker et al. 2006a). This group of rats did not receive jugular venous catheters or self-administration training but otherwise had handling, surgical experience (anesthesia, skull exposure), and training (discrimination training and also exposure to the self-administration training environment for 1 h per day) that was similar to that of our experimental group. These rats acquired the problem to be reversed at the same rate as the rats trained to self-administer cocaine in the current study (P > 0.5) suggesting that training history, including instrumental training in the drug-treated rats several months earlier, did not interfere with discrimination performance prior to reversal. Moreover, as we will show next, their reacquisition rates were identical to those of the rats trained to self-administer cocaine.

Reversal performance of the rats in these two groups is illustrated in Figure 2. Rats that had been trained to self-administer cocaine required many more trials than controls to acquire the reversals. A 2-factor ANOVA (group × retention/reversal) confirmed this impression, revealing significant main effects of group (F(1,15) = 16.7, P < 0.001) and retention/reversal (F(1,15) = 158.4, P < 0.001) and a significant interaction (F(1,15) = 25.4, P < 0.001). Subsequent contrasts showed no difference in performance during retention of the problems (P > 0.10), indicating that both groups learned the original discriminations to the same degree, but a significant impairment in acquiring the reversals (P < 0.001).

Figure 2
Long-term effects of cocaine self-administration on reversal learning. Shown are mean trials ± SEM required by the rats in each group to twice retain and reverse a previously acquired odor discrimination problem. (*) Different from performance ...

We have replicated our prior finding that cocaine exposure causes long-lasting impairments in reversal learning in rats (Schoenbaum et al. 2004). Previously, deficits were demonstrated in rats, approximately a month and a half after 14 d of exposure to experimenter-administered cocaine (30 mg/kg/d, i.p.). In the present study, we show reversal-learning deficits in rats, ~3 mo after 14 d of exposure to self-administered cocaine (18.4 mg/kg/d, i.v.). Although deficits were demonstrated relative to controls that did not undergo the intravenous surgery or fluid infusion into the jugular vein, barring an unlikely long-lasting effect of these manipulations on reversal learning, these results indicate that contingent exposure to cocaine causes a reversal deficit in rats that is at least as severe and as long-lasting as that caused by noncontingent cocaine exposure (Schoenbaum et al. 2004). Furthermore, while comparisons across experiments should be done with caution, the magnitude of the reversal deficit caused by cocaine exposure (~200% of controls in both this and our earlier experiment) is similar to that caused by orbitofrontal lesions in this task (~200% of controls) (Schoenbaum et al. 2003). These results suggest that unique effects of contingent drug exposure cannot be the underlying basis of the decision-making deficits observed in addicts that are modeled by reversal learning. Thus, it should be possible to study the molecular and neurophysiological underpinnings of those deficits even after noncontingent drug exposure.

The reversal deficit was demonstrated in rats that exhibited a robust time-dependent increase in cue-induced cocaine seeking after withdrawal, a phenomenon termed incubation of cocaine craving (Grimm et al. 2001; Lu et al. 2004b). Reversal deficits are linked to orbitofrontal-amygdalar dysfunction (Rolls et al. 1994; Chudasama and Robbins 2003; Schoenbaum et al. 2003, 2006; Izquierdo et al. 2004; Stalnaker et al. 2006a), brain regions that show long-lasting effects of psychostimulants on neuroplasticity (Crombag et al. 2004; Goussakov et al. 2006). Notably, these same areas are also implicated in drug craving in humans and rats and in incubation of craving in rats (Volkow and Fowler 2000; Goldstein et al. 2001; Fuchs et al. 2004; Dom et al. 2005; Kalivas and Volkow 2005; Lu et al. 2005b). Since reversal learning was not assessed during early withdrawal from cocaine, the current report does not address whether or not these phenomena are directly related. It would be of great interest to determine whether the decision-making deficits demonstrated here reflect effects of cocaine on a similar neural substrate that mediates cocaine craving or incubation of craving.

Acknowledgments

This work was supported by R01-DA015718 (GS), T32-14074 (DC), and the Intramural Research Program of the National Institutes of Health, National Institute on Drug Abuse. We thank NIDA for providing the cocaine and Dr. Stephen Warrenburg at International Flavors and Fragrances for providing the odor compounds.

References

  • Bechara A, Dolan S, Denburg N, Hindes A, Andersen SW, Nathan PE. Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia. 2001;39:376–389. [PubMed]
  • Calu DJ, Stalnaker TA, Roesch MR, Franz TM, Schoenbaum G. Basolateral amygdala generates abnormally persistent representations of predicted outcomes and cue value after cocaine exposure. Society for Neuroscience Abstracts. 2005;35:112.1.
  • Chudasama Y, Robbins TW. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: Further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci. 2003;23:8771–8780. [PubMed]
  • Crespo JA, Manzanares J, Olivia JM, Corchero J, Palomo T, Ambrosio E. Extinction of cocaine self-administration produces a differential time related regulation of proenkephalin gene expression in rat brain. Neuropsychopharmacology. 2001;25:185–194. [PubMed]
  • Crombag HS, Gorny G, Li Y, Kolb B, Robinson TE. Opposite effects of amphetamine self-administration experience on dendritic spines in the medial and orbital prefrontal cortex. Cereb Cortex. 2004;15:341–348. [PubMed]
  • Deroche-Gamonet V, Belin D, Piazza PV. Evidence for addiction-like behavior in the rat. Science. 2004;305:951–953. [PubMed]
  • Dom G, Sabbe B, Hulstijn W, Van Den Brink W. Substance use disorders and the orbitofrontal cortex. Br J Psychiatry. 2005;187:209–220. [PubMed]
  • Dworkin SI, Mirkis S, Smith JE. Response-dependent versus response-independent presentation of cocaine: Differences in the lethal effects of the drug. Psychopharmacology. 1995;117:262–266. [PubMed]
  • Fuchs RA, Evans KA, Parker MP, See RE. Differential involvement of orbitofrontal cortex subregions in conditioned cue-induced and cocaine-primed reinstatement of cocaine seeking in rats. J Neurosci. 2004;24:6600–6610. [PubMed]
  • Goldstein RZ, Volkow ND, Wang GJ, Fowler JS, Rajaram S. Addiction changes orbitofrontal gyrus function: involvement in response inhibition. Neuroreport. 2001;12:2595–2599. [PMC free article] [PubMed]
  • Goussakov I, Chartoff EH, Tsvetkov E, Gerety LP, Meloni EG, Carlezon WAJ, Bolshakov VY. LTP in the lateral amygdala during cocaine withdrawal. Eur J Neurosci. 2006;23:239–250. [PubMed]
  • Grant S, Contoreggi C, London ED. Drug abusers show impaired performance in a laboratory test of decision making. Neuropsychologia. 2000;38:1180–1187. [PubMed]
  • Grimm JW, Hope BT, Wise RA, Shaham Y. Incubation of cocaine craving after withdrawal. Nature. 2001;412:141–142. [PubMed]
  • Hemby SE, Co C, Koves TR, Smith JE, Dworkin SI. Differences in extracellular dopamine concentrations in the nucleus accumbens during response-dependent and response-independent cocaine administration in the rat. Psychopharmacology. 1997;133:7–16. [PubMed]
  • Izquierdo AD, Suda RK, Murray EA. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci. 2004;24:7540–7548. [PubMed]
  • Jentsch JD, Taylor JR. Impulsivity resulting from frontostriatal dysfunction in drug abuse: Implications for the control of behavior by reward-related stimuli. Psychopharmacology. 1999;146:373–390. [PubMed]
  • Jentsch JD, Olausson P, De La Garza R, Taylor JR. Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology. 2002;26:183–190. [PubMed]
  • Kalivas PW, Hu XT. Exciting inhibition in psychostimulant addiction. Trends Neurosci. 2006;29:610–616. [PubMed]
  • Kalivas PW, Volkow ND. The neural basis of addiction: A pathology of motivation and choice. Am J Psychiatry. 2005;162:1403–1413. [PubMed]
  • Kiyatkin EA, Brown PL. Fluctuations in neural activity during cocaine self-administration: clues provided by brain thermorecording. Neuroscience. 2003;116:525–538. [PubMed]
  • Koob GF, Le Moal M. Plasticity of reward neruocircuitry and the ‘dark side’ of drug addiction. Nat Neurosci. 2005;8:1442–1444. [PubMed]
  • Lu L, Grimm JW, Shaham Y, Hope BT. Molecular neuroadaptations in the accumbens and ventral tegmental area during the first 90 days of forced abstinence from cocaine self-administration in rats. J Neurochem. 2003;85:1604–1613. [PubMed]
  • Lu L, Grimm JW, Dempsey J, Shaham Y. Cocaine seeking over extended withdrawal periods in rats: Different time courses of responding induced by cocaine cues versus cocaine priming over the first 6 months. Psychopharmacology. 2004a;176:101–108. [PubMed]
  • Lu L, Grimm JW, Hope BT, Shaham Y. Incubation of cocaine craving after withdrawal: A review of preclinical data. Neuropharmacology. 2004b;47(Suppl 1):214–226. [PubMed]
  • Lu L, Dempsey J, Shaham Y, Hope BT. Differential long-term neuroadaptations of glutamate receptors in the basolateral and central amygdala after withdrawal from cocaine self-administration in rats. J Neurochem. 2005a;94:161–168. [PubMed]
  • Lu L, Hope BT, Dempsey J, Liu SY, Bossert JM, Shaham Y. Central amygdala ERK signaling pathway is critical to incubation of cocaine craving. Nat Neurosci. 2005b;8:212–219. [PubMed]
  • Rogers RD, Everitt BJ, Baldacchino A, Blackshaw AJ, Swainson R, Wynne K, Baker NB, Hunter J, Carthy T, Booker E, et al. Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: Evidence for monoaminergic mechanisms. Neuropsychopharmacology. 1999;20:322–339. [PubMed]
  • Rolls ET, Hornak J, Wade D, McGrath J. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatr. 1994;57:1518–1524. [PMC free article] [PubMed]
  • Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem. 2003;10:129–140. [PubMed]
  • Schoenbaum G, Saddoris MP, Ramus SJ, Shaham Y, Setlow B. Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions. Eur J Neurosci. 2004;19:1997–2002. [PubMed]
  • Schoenbaum G, Roesch MR, Stalnaker TA. Orbitofrontal cortex, decision-making, and drug addiction. Trends Neurosci. 2006;29:116–124. [PMC free article] [PubMed]
  • Stalnaker TA, Franz TM, Schoenbaum G. Lesions of basolateral amygdala eliminate the reversal impairment caused by orbitofrontal cortex lesions. Society for Neuroscience Abstracts. 2006a;36:573.18.
  • Stalnaker TA, Roesch MR, Franz TM, Burke KA, Schoenbaum G. Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making. Eur J Neurosci. 2006b;24:2643–2653. [PMC free article] [PubMed]
  • Volkow ND, Fowler JS. Addiction, a disease of compulsion and drive: involvement of orbitofrontal cortex. Cereb Cortex. 2000;10:318–325. [PubMed]
  • Wolffgramm J, Galli G, Thimm F, Heyne A. Animal models of addiction: models for therapeutic strategies? J Neural Transm. 2000;107:649–668. [PubMed]