PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
J Neurosci. Author manuscript; available in PMC Nov 15, 2013.
Published in final edited form as:
PMCID: PMC3684445
NIHMSID: NIHMS480386
Genetic reconstruction of dopamine D1 receptor signaling in the nucleus accumbens facilitates natural and drug reward responses
Bryan B. Gore1 and Larry S. Zweifel1#
1Department of Pharmacology and Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA 98053
#To whom correspondence should be addressed: Larry S. Zweifel, 1959 NE Pacific St., Box 357280, Seattle, WA 98195 ; larryz/at/u.washington.edu
The dopamine D1 receptor (D1R) facilitates reward acquisition, and its alteration leads to profound learning deficits. However, its minimal functional circuit requirement is unknown. Using conditional reconstruction of functional D1R signaling in D1R knockout mice, we define distinct requirements of D1R in subregions of the nucleus accumbens (NAc) for specific dimensions of reward. We demonstrate D1R expression selectively in the core region of the NAc (NAcCore), but not the shell (NAcShell), enhances a unique form of Pavlovian conditioned approach and mediates D1R-dependent cocaine sensitization. However, D1R expression in either the NAcCore or the NAcShell improves instrumental responding for reward. In contrast, neither NAcCore nor NAcShell D1R is sufficient to promote motivation to work for reward in a progressive ratio task or for motor learning. These results highlight dissociated circuit requirements of D1R for dopamine-dependent behaviors.
Differential gene expression within discrete brain regions expands neural coding capacity and diversifies circuit function. This is exemplified in the striatum where two parallel circuits, the direct and indirect pathway, oppositely regulate thalamocortical loops. These pathways possess a similar neuronal cell type, the medium spiny neuron, yet differ dramatically in connectivity, neuropeptide expression, and genetic profiles. The balance of circuit activation between the direct and indirect pathway is necessary for numerous behaviors including reward processing (Lobo et al., 2010, Beutler et al., 2011). D1R, encoded by the Drd1a gene, is highly enriched in the direct pathway (Fig. 1A,B) where it facilitates numerous dopamine-dependent functions including appetitive behaviors. Global loss of D1R demonstrates its importance from feeding and reward acquisition to the general ability to thrive (Drago et al., 1994, Xu et al., 1994, Wall et al., 2011). A major unresolved question regarding genes with pleiotropic functions, such as Drd1a, is whether a minimal circuit requirement exists for specific behaviors.
Figure 1
Figure 1
Conditional viral restoration of D1R expression in either the NAcCore or the NAcShell.
Both genetic and pharmacological studies have investigated the necessity of D1R signaling in different brain regions for acquisition of rewards (Yin et al., 2008, Wall et al., 2011, Salamone et al., 2012). Genetic D1R inactivation in mice demonstrates that despite hyperactivity, these animals show poor motivation to perform instrumental tasks and lack basic Pavlovian learning, which illustrates D1R signaling is necessary somewhere within the brain (Wall et al., 2011). Pharmacological studies narrowed the potential candidate brain regions necessary for reward processing. Infusion of D1R antagonists into either the prefrontal cortex (Baldwin et al., 2002), dorsal striatum (Lovinger, 2010), amygdala (Berglind et al., 2006, Tye et al., 2010), or NAc (Smith-Roe and Kelley, 2000) each individually disrupts certain aspects of reward. However, whether any of these brain regions is minimally required for different dimensions of reward is unresolved.
One caveat to locally infusing antagonists to establish regional importance of receptor function is the potential to inactivate both postsynaptic and presynaptic receptors. In comparison, conditional gene inactivation provides cell selectivity, but does not typically permit regional selectivity, nor does it exclude necessary roles for the gene in other cells/regions. Alternatively, knockout mice are operationally a blank slate for a specific gene of interest, so conditional, anatomically restricted restoration to neurons endogenously expressing the gene can test its minimal circuit requirement. Here we developed a model system for global D1R inactivation and cell-selective, regional restoration to investigate whether D1R activation in either the NAcCore or the NAcShell is the minimal requisite to mediate distinct aspects of reward. We find exclusive expression of D1R in the NAcCore of D1R knockout mice promoted Pavlovian conditioned approach and facilitated behavioral sensitization to repeated cocaine administration, thus highlighting the essential role of this brain region for both natural and drug rewards. In contrast, NAcShell D1R expression did not alter Pavlovian conditioned approach, nor did it restore cocaine sensitization. However, either NAcCore or NAcShell D1R expression stimulated instrumental responding for reward, but neither improved motivation to work for reward or motor learning.
Mice
Generation of mice with inactivation of Drd1a by insertion of Cre recombinase are described elsewhere (Heusner et al., 2008). Drd1aCre/Cre mice were generated by crossing heterozygous Drd1aCre/+ mice and were born at the expected Mendelian ratio. An approximately equal number of male and female mice were used for all experiments. All experimental protocols were approved by the University of Washington Institutional Animal Care and Use Committee. Mice were housed on a 12:12 light:dark cycle and given ad libitum food and water except during food restriction to 85% of their ad libitum bodyweight.
Generation of AAV-FLEX-D1RGFP, viral injections, and experimental groups
The AAV-FLEX-D1RGFP was generated by PCR amplification of D1R from genomic DNA (C57Bl6/J) using primers, 5’-GATATCACCGGTATGGCTCCTAACACTTCTAC-3’ and 5’-GATATCGCGGCCGCGGTTGAATGCTGTCCGCTGT-3’. The 1.3kb PCR product was subcloned into AM/CBA-FLEX-EGFP-WPRE-bGH in frame with eGFP. AAV was generated as previously described (Zweifel et al., 2008). For stereotaxic viral injections, 0.5μl of AAV-FLEX-D1RGFP (titer ~1×1012/ml) or control AAV-FLEX-GFP (titer ~1×1012/ml) was bilaterally injected into the NAcCore (x =+/-1.0, y=+1.3*F, z=-4.25) or NAcShell (x=+/-0.4, y=+1.3*F, z=-5.0), F=(Lambda minus Bregma)/4.21. To control for effects of site-specific injections and viral-mediated D1R expression in restricted NAc subregions, we generated the following experimental groups: NAcCore, Het GFP-NAcCore (Drd1aCre/+; AAV-FLEX-GFP, NAcCore injected); Het D1R-NAcCore (Drd1aCre/+; AAV-FLEX-D1RGFP, NAcCore injected); Mutant GFP-NAcCore (Drd1aCre/Cre; AAV-FLEX-GFP, NAcCore injected); Mutant D1R-NAcCore (Drd1aCre/Cre; AAV-FLEX-D1RGFP, NAcCore injected). NAcShell, Het GFP-NAcShell (Drd1aCre/+; AAV-FLEX-GFP, NAcShell injected); Het D1R-NAcShell (Drd1aCre/+; AAV-FLEX-D1RGFP, NAcShell injected); Mutant GFP-NAcShell (Drd1aCre/Cre; AAV-FLEX-GFP, NAcShell injected); Mutant D1R-NAcShell (Drd1aCre/Cre; AAV-FLEX-D1RGFP, NAcShell injected). D1R-NAcCore and D1R-NAcShell mice were compared to their respective heterozygous and mutant control groups. Following surgery, mice recovered for two weeks before behavioral testing. Viral expression was confirmed with immunohistochemistry with the D1R antibody, or with the GFP antibody that detected either GFP or D1RGFP.
Pavlovian Conditioning
Training was performed in operant chambers (Med Associates) as previously described (Parker et al., 2010). Briefly, animals received daily Pavlovian training for seven days that included 25 trials per session. During each trial, two levers were presented for 10s, which co-terminated with a 20mg food pellet delivered non-contingently (Bio-serve). Video tracking was performed with Ethovision (Noldus) on the final day to score lever or food receptacle contacts.
Instrumental Conditioning
Four days of instrumental conditioning were performed with 50 trials per session where a single lever press delivered a single food reward pellet. Food receptacle head entries were required to start the next trial. The session continued until 50 trials were completed or two hours had elapsed. For progressive ratio testing, one reward pellet was delivered per completed trial where the lever press requirement increased with a nonarithmetic schedule (1,1,4,7,13,19,25,34,43,52,61,73...). The breakpoint was the last completed trial before 3 minutes of lever pressing inactivity or a total four hour session time-out.
Rotarod
Motor learning was measured on a rotarod (4 to 40 RPM over two minutes) with three trials per day for five days (Columbus Instruments).
Pharmacology studies in locomotion chambers
For D1R agonist studies, SKF-81297 was administered i.p. (intraperitoneal) at 7.5 mg/kg. Locomotor activity was measured for 90 minutes in locomotion chambers (Opto-M3; Columbus Instruments). For cocaine sensitization studies, baseline locomotion recordings were measured for 90 minutes. For two days, animals received injections of 0.9% saline, which were averaged. For the next five days, cocaine was administered s.c. (subcutaneous) at 20 mg/kg and locomotor activity measured for 90 minutes.
Immunohistochemistry
For measuring c-Fos expression, 90 minutes prior to euthanasia and 4% paraformaldehyde perfusion, animals received either 0.9% saline or 7.5 mg/kg of SKF-81297. 30 μm frozen sections were collected between +1.1 to +1.5 (relative to bregma, A-P axis) and stained with primary antibody: GFP, mouse monoclonal , 1:1000 (Invitrogen); c-Fos, rabbit polyclonal, 1:1000 (Calbiochem); D1R, rat monoclonal, 1:500 (Sigma-Aldrich); all secondary antibodies, 1:200 (Jackson ImmunoResearch). For c-Fos quantification, equal camera exposures were taken and c-Fos positive cells were counted with ImageJ (NIH) in three sections per animal at a defined ROI (350 × 500μm box centered on either the anterior commissure for the NAcCore injected groups or in the ventral medial portion of the NAcShell for the NAcShell injected groups). To measure the pattern of viral expression for D1R-NAcCore and D1R-NAcShell mice, Illustrator (Adobe) was used to trace the bilateral viral expression at the section closest to +1.3 (relative to bregma, A-P axis).
Statistical Analyses
Data was analyzed using Excel (Microsoft) and Matlab (Mathworks). Additional statistical calculations were performed in Prism (GraphPad). All data was analyzed by two-way repeated measures ANOVA or one-way ANOVA as indicated.
Functional restoration of D1R signaling in the NAc
To establish our model system, we exclusively expressed D1R in either the NAcCore or the NAcShell utilizing a mouse line where D1R expression was functionally inactivated by inserting a Cre recombinase expression cassette into the open reading frame of the Drd1a locus (Heusner et al., 2008). This results in selective expression of Cre in D1R containing cells. Mice homozygous for the Cre insertion are null mutants, Drd1aCre/Cre (D1R mutants), and do not have detectable D1R protein levels (Fig. 1C,D). Similar to previously published D1R knockout lines, D1R mutants generated by Cre insertion are indistinguishable from other D1R knockout mouse lines (Drago et al., 1994, Xu et al., 1994). To re-express D1R in an anatomically restricted manner, we generated an adeno-associated viral vector containing a Cre-conditional D1R-GFP expression cassette (AAV-FLEX-D1RGFP, Fig. 1A). D1R expression restricted to either the NAcCore (D1R-NAcCore) or the NAcShell (D1R-NAcShell) was achieved by bilateral stereotaxic injection of AAV-FLEX-D1RGFP into D1R mutants (Fig. 1C-F).
We next validated functional restoration of D1R in the NAc. D1R activation stimulates locomotor activity, and dopamine signaling exclusively in the NAc facilitates locomotor activation (Swanson et al., 1997, Heusner et al., 2003). Therefore, to confirm D1R activation in D1R-NAcCore and D1R-NAcShell mice, we measured locomotor responses to systemic administration of the D1R agonist SKF-81297 (7.5 mg/kg). In the NAcCore groups, GFP-NAcCore mutant mice (n=7) displayed little locomotor response to the drug (Fig. 2A). In contrast, D1R-NAcCore mice (n=7) showed a strong agonist effect, which was indistinguishable from heterozygous control groups (Het GFP-NAcCore, n=7; or Het D1R-NAcCore, n=8; two-way repeated measures ANOVA, genotype × time, F(63,525)=1.4, p=0.0282; Fig. 2A). D1R-NAcShell (n=9) mice also responded to SKF-81297 with significantly increased locomotor activity compared to GFP-NAcShell mutants (n=7; two-way repeated measures ANOVA, genotype × time, F(63,777)=3.5, p<0.0001; Fig. 2B), but did not respond as strongly as heterozygous control mice (Het GFP-NAcShell, n=12; or Het D1R-NAcShell, n=13; Fig.2B).
Figure 2
Figure 2
D1R in either the NAcCore or the NAcShell restores behavioral responsiveness and functional D1R signaling.
To further confirm signaling events downstream of D1R activation are present in D1R-NAcCore and D1R-NAcShell mice, we quantified c-Fos expression around the area of viral restoration following SKF-81297 administration (7.5 mg/kg; Fig. 2C-F). D1R-NAcCore (n=6) and control mice (Het GFP-NAcCore, n=5; or Het D1R-NAcCore, n=5) showed robust c-Fos induction (one-way ANOVA, F(4,25)=12.2 , p<0.0001; Fig. 2C). In contrast, saline injected controls (All genotypes, n=8) and SKF-81297 treated GFP-NAcCore mutants (n=6) showed negligible c-Fos expression (Fig. 2E). Similarly, D1R-NAcShell (n=7) and control mice (Het GFP-NAcShell, n=10; or Het D1R-NAcShell, n=10) also displayed strong induction of c-Fos compared to saline injected controls (All genotypes, n=9) and SKF-81297 treated GFP-NAcShell mutants (n=6; one-way ANOVA, F(4,37)=32.90 , p<0.0001; Fig. 2D,F). Therefore, re-expression of D1R to either the NAcCore or the NAcShell can restore signaling and behavioral responsiveness to D1R agonist.
Unique role of D1R in the NAc for Pavlovian conditioning
Having established the ability to regionally restrict expression of D1R to either the NAcCore or the NAcShell, we next examined D1R in these regions for reward processing. In Pavlovian conditioning, animals learn to associate a predictive cue with a reward outcome. These dopamine-dependent associations manifest behaviorally as conditioned approach to either the reward (goal-tracking) or the predictive conditioned stimulus (CS) cue (sign-tracking) (Flagel et al., 2011). To determine if D1R in the NAc is sufficient for Pavlovian conditioning, we trained mice to associate a reward-predictive cue (10 sec lever extension) with food pellet delivery. In mice, conditioned approach typically manifests as goal-tracking (Parker et al., 2010) measured by calculating the difference between the head entry rate during the CS presentation and the inter-trial interval. In contrast to heterozygous control mice in the NAcCore group (Het GFP-NAcCore, n=8; or Het D1R-NAcCore, n=8), we did not find the head entry rate in D1R-NAcCore mice (n=7) was significantly above their respective mutant control group (GFP-NAcCore, n=7) during CS presentation (two-way repeated measures ANOVA, genotype × time, F(18,156)=1.87, p=0.0222; Fig. 3A). Similarly, D1R-NAcShell mice (n=9) also failed to increase their head entry rate significantly above respective mutant controls (GFP-NAcShell, n=7; Fig. 3B). Intriguingly, while viewing the animals during conditioning, we observed D1R-NAcCore mice (Fig. 3C), but not D1R-NAcShell mice (Fig. 3D), exhibited a heightened approach behavior where they repeatedly shuttled between the food receptacle and levers, a behavior undetected by strictly measuring head entries. To quantify this behavior, on the final day of conditioning, we video recorded each trial (25 total) and scored conditioned approach to the food receptacle, lever, or both (Fig. 3E,F). We found GFP-NAcCore and GFP-NAcShell mutant mice made significantly fewer conditioned approaches compared to their respective heterozygous controls (Fig. 3E,F). However, D1R-NAcCore mice exhibited conditioned approach to either the food receptacle, lever, or both (one-way ANOVA, F(3,26)=19.68 , p<0.0001; Fig 3E). In very few trials did control or D1R-NAcCore mice solely approach the lever, indicating they are not exclusively sign-tracking, but performing a hybrid goal-tracking/sign tracking behavior. D1R-NAcShell mice did not display this behavior (one-way ANOVA, F(3,38)=113.1, p<0.0001; Fig 3F).
Figure 3
Figure 3
D1R in the NAcCore, but not the NAcShell, facilitates Pavlovian conditioned approach behavior.
Sufficiency of D1R in the NAc for instrumental conditioning
Conditioned approach to the lever by D1R-NAcCore mice during Pavlovian conditioning suggests these animals have assigned some value to the cue, so we asked whether they would perform an instrumental response (lever press) to acquire reward. Immediately following Pavlovian conditioning, mice were given a simple fixed ratio (FR) schedule of one lever press for one reward pellet (FR1). As reported previously (El-Ghundi et al., 2003, Caine et al., 2007, Wall et al., 2011), D1R null mice (GFP-NAcCore mutant, n=7) were severely deficient in this task relative to heterozygous controls (Het GFP-NAcCore n=8; or Het D1R-NAcCore, n=8; Fig. 4A). Remarkably, performance of D1R-NAcCore mice (n=7) was significantly more robust than GFP-NAcCore mutants (n=7; two-way repeated measures ANOVA, genotype × time, F(9,78)=4.11, p=0.0002; Fig. 4A). Surprisingly, despite previously displaying no Pavlovian conditioned approach behavior to the levers, D1R-NAcShell mice (n=9) also displayed significantly increased instrumental responding relative to their respective mutant controls (GFP-NAcShell mutant, n=7; two-way repeated measures ANOVA, effect of genotype, F(3,38)=14.20, p<0.0001; effect of time, F(3,114)=7.24, p=0.0002; Fig. 4B). Furthermore, cumulative reward acquisition in both D1R-NAcCore and D1R-NAcShell mice revealed both groups completed or nearly completed all lever presses (NAcCore experiment: two-way repeated measures ANOVA, genotype × time, F(720,6240)=4.33, p<0.0001; Fig. 4C; NAcShell experiment: two-way repeated measures ANOVA, genotype × time, F(720,9120)=8.97, p<0.0001; Fig. 4D).
Figure 4
Figure 4
D1R in either the NAcCore or the NAcShell promotes instrumental conditioning.
The improved performance of D1R-NAcCore and D1R-NAcShell mice in instrumental behavior compared to mutant mice suggests these animals are capable of performing an action required to attain reward. To explore whether their enhanced instrumental performance reflects increased incentive to perform work, we tested mice in a progressive ratio task, which measured the animal's breakpoint to an escalating increase in lever presses required to deliver a single reward pellet. Both D1R-NAcCore and D1R-NAcShell mice showed a marginal yet statistically insignificant increase in breakpoint compared to D1R mutants (Fig. 4E,F). However, D1R-NAcCore, D1R-NAcShell, and mutant control breakpoints were significantly smaller in comparison to heterozygous control mice (NAcCore experiment: one-way ANOVA, F(3,12)=7.029, p=0.0055; Fig. 4E; NAcShell experiment: one-way ANOVA, F(3,38)=16.96, p<0.0001; Fig.4F). Therefore, although D1R-NAcCore and D1R-NAcShell mice can perform a simple fixed ratio task (FR1), when challenged with escalating costs to obtain reward, they fail to perform at the level of controls.
To test whether instrumental performance by D1R-NAcCore and D1R-NAcShell mice simply reflects improved motor coordination, we assayed mice in a rotarod task. Similar to mutants (GFP-NAcCore, n=7; or GFP-NAcShell, n=7), both D1R-NAcCore (n=7) and D1R-NAcShell (n=9) mice failed to improve over five days of training and performed significantly worse than their respective heterozygous controls (NAcCore experiment: Het GFP-NAcCore, n=8; or Het D1R-NAcCore, n=8; two-way repeated measures ANOVA, genotype × time, F(12,104)=2.47, p=0.0071; Fig. 5A; NAcShell experiment: Het GFP-NAcShell, n=13; or Het D1R-NAcShell, n=13; two-way repeated measures ANOVA, genotype × time, F(12,152)=3.70, p<0.0001; Fig. 5B). Thus, D1R in either the NAcCore or the NAcShell can facilitate instrumental performance despite the inability to improve motor coordination, indicating a dissociable minimal requirement of D1R for these behaviors.
Figure 5
Figure 5
Neither D1R in the NAcCore nor the NAcShell improves rotarod performance.
Differential minimal requirement of D1R in the NAcCore and NAcShell for cocaine sensitization
The ability to assign value to cues or actions requires neuroplastic changes in the NAc that depends upon D1R signaling (Kelley, 2004). Drugs of abuse usurp this endogenous reward system leading to escalated incentive value for the drug, which can be observed as psychomotor sensitization to repeated drug administration (Robinson and Berridge, 2008). To explore whether D1R in either the NAcCore or the NAcShell is sufficient to mediate behavioral adaptation to elevated synaptic dopamine levels associated with repeated drug exposure, we measured locomotor sensitization in response to daily cocaine injections (Fig. 6A-D). Locomotor activity was monitored for 90 minutes prior to cocaine administration (20 mg/kg) and then for an additional 90 minutes (Fig. 6A,B). After five days of cocaine injections in the NAcCore mice, both D1R-NAcCore (n=7) and heterozygous control mice (Het GFP-NAcCore, n=7; or Het D1R-NAcCore, n=8) robustly sensitized, which was not observed in mutant control mice (GFP-NAcCore mutant, n=7; two-way repeated measures ANOVA, genotype × time, F(105,875)=4.10, p<0.0001; Fig. 6C). In contrast to D1R-NAcCore mice, D1R-NAcShell animals (n=9) failed to show acute responses or locomotor sensitization to cocaine; however, their respective heterozygous controls showed robust sensitization (Het GFP-NAcShell, n=12; or Het D1R-NAcShell, n=13; two-way repeated measures ANOVA, genotype × time, F(105,1295)=9.40, p<0.0001; Fig. 6D). Intriguingly, D1R-NAcCore, D1R-NAcShell and mutant controls showed hyper-novelty responses during the first 90 minutes of habituation to the locomotion chambers, indicating neither D1R in the NAcCore nor the NAcShell is sufficient to reverse this behavioral phenotype (Fig. 6A-D). To account for this hyperactivity, we normalized cumulative cocaine responses by subtracting the first 90 minutes from the last 90 minutes of activity, which further highlighted locomotor sensitization to cocaine in D1R-NAcCore, but not D1R-NAcShell mice (NAcCore experiment: two-way repeated measures ANOVA, genotype × time, F(15,125)=2.67, p=0.0015; Fig.6E; NAcShell experiment: two-way repeated measures ANOVA, genotype × time, F(15,185)=2.09, p=0.0121; Fig. 6F).
Figure 6
Figure 6
D1R in the NAcCore, but not the NAcShell, is sufficient for locomotor sensitization to cocaine.
Defining the minimal requirements for genes expressed within a neural circuit is essential to understand how circuits regulate different dimensions of behavior. Studying minimal gene requirements within a specific circuit node can be achieved using different strategies. For example, non-conditional viral vectors can be injected into a region of interest in a conventional global knockout (Carlezon et al., 1997), but this yields ectopic expression in cells that do not endogenously express the gene. In contrast, select promoters can drive more specific expression from a viral vector (Ferguson et al., 2011), but frequently the minimal promoter is too large for efficient viral packaging. Alternatively, utilizing the approach described here, the endogenous gene locus drives Cre expression and simultaneously creates a global knockout. Thus, conditional viral vectors can be introduced into select regions to re-express the gene only in cells endogenously expressing the gene. Numerous Cre-knockin lines have been generated, so this approach will prove broadly useful for studying minimal gene requirements.
Utilizing this strategy, we show functional D1R signaling can be regenerated in an anatomically restricted and cell-selective manner. This is illustrated by restoring locomotor activation and the induction of c-Fos in response to the D1R agonist SKF-81297. Although these results are consistent with functional re-expression of D1R, without ultrastructural analysis, we cannot unequivocally establish the protein is precisely targeted to the endogenous location within the cell or that levels are not excessive. However, immunolocalization of recombinant D1R in both D1R-NAcCore and D1R-NAcShell mice demonstrate the protein is largely localized to neural processes, remarkably similar to staining of the endogenous protein in heterozygous control mice. In addition, AAV-FLEX-D1RGFP delivered to the NAcCore or the NAcShell of heterozygous mice does not significantly alter behavior indicating expression does not perturb endogenous receptor function. Although D1RGFP in the NAcCore of heterozygous mice shifted these animals towards more hybrid tracking behavior during Pavlovian conditioning, it was not statistically significant; this is discussed further below.
Systemic administration of D1R agonist induced locomotion in both D1R-NAcCore and D1R-NAcShell mice. These results are consistent with a previously published report showing restoration of dopamine to the NAcCore in dopamine-deficient animals is sufficient to promote psychomotor activation by amphetamine, an effect blocked by D1- and D2-type receptor antagonist (Heusner et al., 2003). Furthermore, infusing dopamine into either the NAcCore or the NAcShell potentiates locomotor activity (Swanson et al., 1997), but in contrast to our findings, this study showed infusing D1R agonist had a greater effect in the NAcShell. Our results demonstrate D1R-dependent behavioral sensitization to cocaine can be mediated exclusively by D1R activation in the NAcCore but not the NAcShell. Previous studies have reported repeated cocaine administration enhances D1R sensitivity of NAc neurons (White et al., 1993) and increases dopamine release in both the NAcCore and the NAcShell (Addy et al., 2010). Glutamate plasticity within the NAcCore following repeated cocaine has also been reported and proposed to be dependent on D1R (Pierce et al., 1996). In contrast to our results, repeated cocaine administration has been shown to enhance sensitivity to amphetamine infusion into the NAcShell, but not the NAcCore. This effect was observed after long-term, but not short-term, withdrawal; however, early acquisition of sensitized responses was not investigated (Pierce and Kalivas, 1995). Temporal differences in electrophysiological (Kourrich and Thomas, 2009) and morphological changes (Dumitriu et al., 2012) have been found between the NAcCore and the NAcShell after cocaine sensitization, suggesting independent functions of these brain regions acting over different time courses for discrete facets of drug-related behavior. Consistent with this, D1R signaling in the NAcCore and the NAcShell is essential for distinct aspects of drug self-administration (Anderson et al., 2003, Bachtell et al., 2005, Bari and Pierce, 2005, Schmidt et al., 2006, Bossert et al., 2007, Laviolette et al., 2008, Shin et al., 2008, Suto and Wise, 2011), so future experiments with combined viral restoration in both the NAcCore and the NAcShell during various stages of drug-seeking will help to address this important question. We should also note that D1R antagonists infused into the prefrontal cortex can block cocaine sensitization (Sorg et al., 2001). One potential explanation for the apparent necessity of D1R in one scenario but not another is the D5 receptor, which is also inhibited by D1R antagonist and is highly expressed in the prefrontal cortex (Oda et al., 2010). Consistent with this, locomotor responding to cocaine has been shown to be attenuated dose-dependently in D5R knockout mice (Elliot et al., 2003); however, others have not reported similar findings (Karlsson et al., 2008). Finally, although it is possible developmental compensatory changes occur in D1R mutants allowing a smaller subset of D1R-expressing brain regions to be minimally sufficient, this is unlikely since re-expression of D1R in the NAcShell did not facilitate all behaviors restored by D1R in the NAcCore.
Restricted expression of D1R in the NAcCore reveals additional insight into the circuit level requirement for D1R during appetitive Pavlovian conditioning. The NAcCore is conventionally associated with preparatory Pavlovian conditioned approach (Flagel et al., 2011), CS-US associations during conditioned reinforcement (Parkinson et al., 1999), and the generalized form of Pavlovian-Instrumental transfer (Corbit and Balleine, 2011). We were initially surprised D1R-NAcCore animals failed to demonstrate “normal” conditioned approach behavior typically observed in mice. Instead, we observed a hybrid goal/sign tracking conditioned approach. Mice almost exclusively exhibit goal-tracking conditioned approach behavior, as evidenced by Het GFP-NAcCore mice that predominantly approached the food receptacle exclusively. In contrast to mice, rats show individual preference to either goal or sign-track, but importantly, only sign-tracking but not goal-tracking is sensitive to the broad spectrum dopamine receptor antagonist flupenthixol, and sign-tracking rats have higher levels of D1R in the NAc (Flagel et al., 2007). Notably, we find exclusive expression of D1R in the NAcCore promotes the highest degree of conditioned approaches to the lever, with Het D1R-NAcCore mice displaying a more intermediate level of hybrid tracking. These results indicate restoring D1R selectively to the NAcCore potentially overrides an innate goal-tracking preference in mice. Additionally, sign-tracking in rats is associated with enhanced sensitization to drugs of abuse (Flagel et al., 2010). In accordance, we find D1R-NAcCore mice have the highest levels of sensitization, further supporting the link between NAcCore D1R, sign-tracking, and drug sensitization. Altogether, these results suggest shifting the balance of D1R activation in the brain more heavily towards the NAcCore, or exclusively to the NAcCore, shifts behavior towards sign-tracking, a conditioned approach strategy more sensitive to dopamine levels and associated with enhanced behavioral responding to drugs of abuse.
The development of instrumental responding in D1R-NAcCore and D1R-NAcShell mice is consistent with these animals assigning value to the lever to perform simple action-outcome responses. Although both groups responded significantly better than mutant control mice, they may have done so through different mechanisms. D1R-NAcCore mice demonstrated conditioned approach to the levers, suggesting they assigned incentive salience to the levers, possibly strengthening the action-outcome association required in the subsequent instrumental conditioning sessions. This is consistent with observations that suppression of excitatory inputs to the NAcCore from the amygdala impairs cued reward retrieval, and activation of this projection facilitates instrumental responding, which is blocked by systemic administration of D1R antagonist (Stuber et al., 2011). In contrast, D1R-NAcShell mice demonstrated instrumental performance despite their lack of Pavlovian conditioned approach, suggesting D1R-NAcShell mice have elevated instrumental responding through a different mechanism compared to D1R-NAcCore mice. This is consistent with these animals having restored consummatory or hedonic processes (Yin et al., 2008) sufficient for action-outcome responding, but lacking the ability to form conditioned reward associations. Intriguingly, although D1R-NAcCore and D1R-NAcShell mice performed the simple instrumental response, they demonstrated profound motivational deficits to work for reward. These results suggest dissociable circuit requirements for performing tasks when costs are low versus high. One explanation for this finding is lack of D1R expression in other brain regions could make these mice more sensitive to extinction and/or contingency changes during a progressive ratio task. For example, these mice lack D1R in the prefrontal cortex, hippocampus, and amygdala, all structures known to be necessary for cost-benefit decision making (Floresco et al., 2008). In addition, dorsal striatum D1R signaling is necessary for habit formation (Lovinger, 2010), so lacking D1R in the dorsal striatum of D1R-NAcCore or D1R-NAcShell mice may prevent transforming goal-directed actions into habitual responses.
Failure of D1R-NAcCore and D1R-NAcShell mice to improve motor coordination and attenuate novelty-induced hyperactivity further highlights the selective nature of D1R function in circuits underlying distinct dopamine-dependent behaviors. Thus, our model allows for the systematic determination of the minimal requirements of D1R signaling in discrete brain regions to establish functional D1R-dependent circuit maps underlying dopamine-dependent behaviors. Establishing functional maps of where gene expression is minimally required to mediate specific functions is essential for therapeutic approaches requiring targeted intervention. Our approach provides a critical first step in establishing a method to define the minimal requirements for D1R in regulating complex behavior. Therefore, future experiments to define the minimal requirements of D1R for other behaviors will be essential for understanding the neural circuitry underlying dopamine-dependent processes and disease.
Acknowledgements
Drd1aCre mice were generously provided by Dr. Richard Palmiter. We thank Dr. Ali Gϋler for assistance with locomotion and sensitization experiments. We also thank all members of the Zweifel lab for their support and critical reading of the manuscript. This work was supported by the National Institutes of Health R01MH094536 (LSZ) and T32DA7278 (BBG).
Footnotes
Author Contributions
BG and LZ designed experiments. LZ designed and generated viral constructs. BG performed all experiments. BG and LZ wrote the manuscript.
Conflicts of Interest
The authors declare no conflicts of interests.
  • Addy NA, Daberkow DP, Ford JN, Garris PA, Wightman RM. Sensitization of rapid dopamine signaling in the nucleus accumbens core and shell after repeated cocaine in rats. Journal of neurophysiology. 2010;104:922–931. [PubMed]
  • Anderson SM, Bari AA, Pierce RC. Administration of the D1-like dopamine receptor antagonist SCH-23390 into the medial nucleus accumbens shell attenuates cocaine priming-induced reinstatement of drug-seeking behavior in rats. Psychopharmacology. 2003;168:132–138. [PubMed]
  • Bachtell RK, Whisler K, Karanian D, Self DW. Effects of intra-nucleus accumbens shell administration of dopamine agonists and antagonists on cocaine-taking and cocaine-seeking behaviors in the rat. Psychopharmacology. 2005;183:41–53. [PubMed]
  • Baldwin AE, Sadeghian K, Kelley AE. Appetitive instrumental learning requires coincident activation of NMDA and dopamine D1 receptors within the medial prefrontal cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2002;22:1063–1071. [PubMed]
  • Bari AA, Pierce RC. D1-like and D2 dopamine receptor antagonists administered into the shell subregion of the rat nucleus accumbens decrease cocaine, but not food, reinforcement. Neuroscience. 2005;135:959–968. [PubMed]
  • Berglind WJ, Case JM, Parker MP, Fuchs RA, See RE. Dopamine D1 or D2 receptor antagonism within the basolateral amygdala differentially alters the acquisition of cocaine-cue associations necessary for cue-induced reinstatement of cocaine-seeking. Neuroscience. 2006;137:699–706. [PubMed]
  • Beutler LR, Wanat MJ, Quintana A, Sanz E, Bamford NS, Zweifel LS, Palmiter RD. Balanced NMDA receptor activity in dopamine D1 receptor (D1R)- and D2R-expressing medium spiny neurons is required for amphetamine sensitization. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:4206–4211. [PubMed]
  • Bossert JM, Poles GC, Wihbey KA, Koya E, Shaham Y. Differential effects of blockade of dopamine D1-family receptors in nucleus accumbens core or shell on reinstatement of heroin seeking induced by contextual and discrete cues. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2007;27:12655–12663. [PMC free article] [PubMed]
  • Caine SB, Thomsen M, Gabriel KI, Berkowitz JS, Gold LH, Koob GF, Tonegawa S, Zhang J, Xu M. Lack of self-administration of cocaine in dopamine D1 receptor knock-out mice. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2007;27:13140–13150. [PMC free article] [PubMed]
  • Carlezon WA, Jr., Boundy VA, Haile CN, Lane SB, Kalb RG, Neve RL, Nestler EJ. Sensitization to morphine induced by viral-mediated gene transfer. Science. 1997;277:812–814. [PubMed]
  • Corbit LH, Balleine BW. The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2011;31:11786–11794. [PMC free article] [PubMed]
  • Dong HW. Allen reference atlas : a digital color brain atlas of the C57Black/6J male mouse. Wiley; Hoboken, N.J.: 2008.
  • Drago J, Gerfen CR, Lachowicz JE, Steiner H, Hollon TR, Love PE, Ooi GT, Grinberg A, Lee EJ, Huang SP, et al. Altered striatal function in a mutant mouse lacking D1A dopamine receptors. Proceedings of the National Academy of Sciences of the United States of America. 1994;91:12564–12568. [PubMed]
  • Dumitriu D, Laplant Q, Grossman YS, Dias C, Janssen WG, Russo SJ, Morrison JH, Nestler EJ. Subregional, dendritic compartment, and spine subtype specificity in cocaine regulation of dendritic spines in the nucleus accumbens. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2012;32:6957–6966. [PMC free article] [PubMed]
  • El-Ghundi M, O'Dowd BF, Erclik M, George SR. Attenuation of sucrose reinforcement in dopamine D1 receptor deficient mice. The European journal of neuroscience. 2003;17:851–862. [PubMed]
  • Elliot EE, Sibley DR, Katz JL. Locomotor and discriminative-stimulus effects of cocaine in dopamine D5 receptor knockout mice. Psychopharmacology. 2003;169:161–168. [PubMed]
  • Ferguson SM, Eskenazi D, Ishikawa M, Wanat MJ, Phillips PE, Dong Y, Roth BL, Neumaier JF. Transient neuronal inhibition reveals opposing roles of indirect and direct pathways in sensitization. Nature neuroscience. 2011;14:22–24. [PMC free article] [PubMed]
  • Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PE, Akil H. A selective role for dopamine in stimulus-reward learning. Nature. 2011;469:53–57. [PMC free article] [PubMed]
  • Flagel SB, Robinson TE, Clark JJ, Clinton SM, Watson SJ, Seeman P, Phillips PE, Akil H. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2010;35:388–400. [PMC free article] [PubMed]
  • Flagel SB, Watson SJ, Robinson TE, Akil H. Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmacology. 2007;191:599–607. [PubMed]
  • Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cognitive, affective & behavioral neuroscience. 2008;8:375–389. [PubMed]
  • Heusner CL, Beutler LR, Houser CR, Palmiter RD. Deletion of GAD67 in dopamine receptor-1 expressing cells causes specific motor deficits. Genesis. 2008;46:357–367. [PMC free article] [PubMed]
  • Heusner CL, Hnasko TS, Szczypka MS, Liu Y, During MJ, Palmiter RD. Viral restoration of dopamine to the nucleus accumbens is sufficient to induce a locomotor response to amphetamine. Brain research. 2003;980:266–274. [PubMed]
  • Karlsson RM, Hefner KR, Sibley DR, Holmes A. Comparison of dopamine D1 and D5 receptor knockout mice for cocaine locomotor sensitization. Psychopharmacology. 2008;200:117–127. [PMC free article] [PubMed]
  • Kelley AE. Memory and addiction: shared neural circuitry and molecular mechanisms. Neuron. 2004;44:161–179. [PubMed]
  • Kourrich S, Thomas MJ. Similar neurons, opposite adaptations: psychostimulant experience differentially alters firing properties in accumbens core versus shell. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2009;29:12275–12283. [PMC free article] [PubMed]
  • Laviolette SR, Lauzon NM, Bishop SF, Sun N, Tan H. Dopamine signaling through D1-like versus D2-like receptors in the nucleus accumbens core versus shell differentially modulates nicotine reward sensitivity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2008;28:8025–8033. [PubMed]
  • Lobo MK, Covington HE, 3rd, Chaudhury D, Friedman AK, Sun H, Damez-Werno D, Dietz DM, Zaman S, Koo JW, Kennedy PJ, Mouzon E, Mogri M, Neve RL, Deisseroth K, Han MH, Nestler EJ. Cell type-specific loss of BDNF signaling mimics optogenetic control of cocaine reward. Science. 2010;330:385–390. [PMC free article] [PubMed]
  • Lovinger DM. Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum. Neuropharmacology. 2010;58:951–961. [PMC free article] [PubMed]
  • Oda S, Funato H, Adachi-Akahane S, Ito M, Okada A, Igarashi H, Yokofujita J, Kuroda M. Dopamine D5 receptor immunoreactivity is differentially distributed in GABAergic interneurons and pyramidal cells in the rat medial prefrontal cortex. Brain research. 2010;1329:89–102. [PubMed]
  • Parker JG, Zweifel LS, Clark JJ, Evans SB, Phillips PE, Palmiter RD. Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning. Proceedings of the National Academy of Sciences of the United States of America. 2010;107:13491–13496. [PubMed]
  • Parkinson JA, Olmstead MC, Burns LH, Robbins TW, Everitt BJ. Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. The Journal of neuroscience : the official journal of the Society for Neuroscience. 1999;19:2401–2411. [PubMed]
  • Pierce RC, Bell K, Duffy P, Kalivas PW. Repeated cocaine augments excitatory amino acid transmission in the nucleus accumbens only in rats having developed behavioral sensitization. The Journal of neuroscience : the official journal of the Society for Neuroscience. 1996;16:1550–1560. [PubMed]
  • Pierce RC, Kalivas PW. Amphetamine produces sensitized increases in locomotion and extracellular dopamine preferentially in the nucleus accumbens shell of rats administered repeated cocaine. The Journal of pharmacology and experimental therapeutics. 1995;275:1019–1029. [PubMed]
  • Robinson TE, Berridge KC. Review. The incentive sensitization theory of addiction: some current issues. Philosophical transactions of the Royal Society of London Series B, Biological sciences. 2008;363:3137–3146. [PMC free article] [PubMed]
  • Salamone JD, Correa M, Nunes EJ, Randall PA, Pardo M. The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond. Journal of the experimental analysis of behavior. 2012;97:125–146. [PMC free article] [PubMed]
  • Schmidt HD, Anderson SM, Pierce RC. Stimulation of D1-like or D2 dopamine receptors in the shell, but not the core, of the nucleus accumbens reinstates cocaine-seeking behaviour in the rat. The European journal of neuroscience. 2006;23:219–228. [PubMed]
  • Shin R, Qin M, Liu ZH, Ikemoto S. Intracranial self-administration of MDMA into the ventral striatum of the rat: differential roles of the nucleus accumbens shell, core, and olfactory tubercle. Psychopharmacology. 2008;198:261–270. [PMC free article] [PubMed]
  • Smith-Roe SL, Kelley AE. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2000;20:7737–7742. [PubMed]
  • Sorg BA, Li N, Wu WR. Dopamine D1 receptor activation in the medial prefrontal cortex prevents the expression of cocaine sensitization. The Journal of pharmacology and experimental therapeutics. 2001;297:501–508. [PubMed]
  • Stuber GD, Sparta DR, Stamatakis AM, van Leeuwen WA, Hardjoprajitno JE, Cho S, Tye KM, Kempadoo KA, Zhang F, Deisseroth K, Bonci A. Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature. 2011;475:377–380. [PMC free article] [PubMed]
  • Suto N, Wise RA. Satiating effects of cocaine are controlled by dopamine actions in the nucleus accumbens core. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2011;31:17917–17922. [PMC free article] [PubMed]
  • Swanson CJ, Heath S, Stratford TR, Kelley AE. Differential behavioral responses to dopaminergic stimulation of nucleus accumbens subregions in the rat. Pharmacology, biochemistry, and behavior. 1997;58:933–945. [PubMed]
  • Tye KM, Tye LD, Cone JJ, Hekkelman EF, Janak PH, Bonci A. Methylphenidate facilitates learning-induced amygdala plasticity. Nature neuroscience. 2010;13:475–481. [PMC free article] [PubMed]
  • Wall VZ, Parker JG, Fadok JP, Darvas M, Zweifel L, Palmiter RD. A behavioral genetics approach to understanding D1 receptor involvement in phasic dopamine signaling. Molecular and cellular neurosciences. 2011;46:21–31. [PMC free article] [PubMed]
  • White FJ, Hu XT, Henry DJ. Electrophysiological effects of cocaine in the rat nucleus accumbens: microiontophoretic studies. The Journal of pharmacology and experimental therapeutics. 1993;266:1075–1084. [PubMed]
  • Xu M, Moratalla R, Gold LH, Hiroi N, Koob GF, Graybiel AM, Tonegawa S. Dopamine D1 receptor mutant mice are deficient in striatal expression of dynorphin and in dopamine-mediated behavioral responses. Cell. 1994;79:729–742. [PubMed]
  • Yin HH, Ostlund SB, Balleine BW. Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. The European journal of neuroscience. 2008;28:1437–1448. [PMC free article] [PubMed]
  • Zweifel LS, Argilli E, Bonci A, Palmiter RD. Role of NMDA receptors in dopamine neurons for plasticity and addictive behaviors. Neuron. 2008;59:486–496. [PMC free article] [PubMed]