PMCC PMCC

Search tips
Search criteria

Advanced
Results 1-25 (447177)

Clipboard (0)
None

Related Articles

1.  An aetiological Foxp2 mutation causes aberrant striatal activity and alters plasticity during skill learning 
Molecular Psychiatry  2011;17(11):1077-1085.
Mutations in the human FOXP2 gene cause impaired speech development and linguistic deficits, which have been best characterised in a large pedigree called the KE family. The encoded protein is highly conserved in many vertebrates and is expressed in homologous brain regions required for sensorimotor integration and motor-skill learning, in particular corticostriatal circuits. Independent studies in multiple species suggest that the striatum is a key site of FOXP2 action. Here, we used in vivo recordings in awake-behaving mice to investigate the effects of the KE-family mutation on the function of striatal circuits during motor-skill learning. We uncovered abnormally high ongoing striatal activity in mice carrying an identical mutation to that of the KE family. Furthermore, there were dramatic alterations in striatal plasticity during the acquisition of a motor skill, with most neurons in mutants showing negative modulation of firing rate, starkly contrasting with the predominantly positive modulation seen in control animals. We also observed striking changes in the temporal coordination of striatal firing during motor-skill learning in mutants. Our results indicate that FOXP2 is critical for the function of striatal circuits in vivo, which are important not only for speech but also for other striatal-dependent skills.
doi:10.1038/mp.2011.105
PMCID: PMC3481071  PMID: 21876543
Foxp2; in vivo recording; KE family; motor-skill learning; speech and language; striatum
2.  The Enemy within: Propagation of Aberrant Corticostriatal Learning to Cortical Function in Parkinson’s Disease 
Motor dysfunction in Parkinson’s disease is believed to arise primarily from pathophysiology in the dorsal striatum and its related corticostriatal and thalamostriatal circuits during progressive dopamine denervation. One function of these circuits is to provide a filter that selectively facilitates or inhibits cortical activity to optimize cortical processing, making motor responses rapid and efficient. Corticostriatal synaptic plasticity mediates the learning that underlies this performance-optimizing filter. Under dopamine denervation, corticostriatal plasticity is altered, resulting in aberrant learning that induces inappropriate basal ganglia filtering that impedes rather than optimizes cortical processing. Human imaging suggests that increased cortical activity may compensate for striatal dysfunction in PD patients. In this Perspective article, we consider how aberrant learning at corticostriatal synapses may impair cortical processing and learning and undermine potential cortical compensatory mechanisms. Blocking or remediating aberrant corticostriatal plasticity may protect cortical function and support cortical compensatory mechanisms mitigating the functional decline associated with progressive dopamine denervation.
doi:10.3389/fneur.2013.00134
PMCID: PMC3770942  PMID: 24062721
corticostriatal plasticity; striatopallidal pathway; dorsolateral striatum; cortical compensation; basal ganglia
3.  Creating new functional circuits for action via brain-machine interfaces 
Brain-machine interfaces (BMIs) are an emerging technology with great promise for developing restorative therapies for those with disabilities. BMIs also create novel, well-defined functional circuits for action that are distinct from the natural sensorimotor apparatus. Closed-loop control of BMI systems can also actively engage learning and adaptation. These properties make BMIs uniquely suited to study learning of motor and non-physical, abstract skills. Recent work used motor BMIs to shed light on the neural representations of skill formation and motor adaptation. Emerging work in sensory BMIs, and other novel interface systems, also highlight the promise of using BMI systems to study fundamental questions in learning and sensorimotor control. This paper outlines the interpretation of BMIs as novel closed-loop systems and the benefits of these systems for studying learning. We review BMI learning studies, their relation to motor control, and propose future directions for this nascent field. Understanding learning in BMIs may both elucidate mechanisms of natural motor and abstract skill learning, and aid in developing the next generation of neuroprostheses.
doi:10.3389/fncom.2013.00157
PMCID: PMC3817362  PMID: 24204342
brain-machine interfaces; motor learning; neural plasticity; volitional control; sensorimotor systems
4.  ADENYLYL CYCLASE TYPE 5 IS CRITICAL FOR CORTICOSTRIATAL PLASTICITY AND STRIATUM-DEPENDENT LEARNING 
Dopamine (DA)-dependent corticostriatal plasticity is thought to underlie incremental procedural learning. A primary effector of striatal DA signaling is cAMP, yet its role in corticostriatal plasticity and striatum-dependent learning remains unclear. Here, we show that genetic deletion of a striatum-enriched isoform of adenylyl cyclase, AC5 (AC5KO), impairs two forms of striatum-dependent learning and corticostriatal synaptic plasticity. AC5KO mice were severely impaired in acquisition of a response strategy in the cross maze, a striatum dependent task requiring a correct body turn to find a goal arm. In addition, AC5KO mice were impaired in acquisition of a motor skill, as assessed by the accelerated rotarod. Slice electrophysiology revealed a deficit in corticostriatal LTD following high frequency stimulation of tissue from AC5KO mice. LTD was rescued by activation of either presynaptic cannabinoid type 1 (CB1) receptors, or postsynaptic metabotropic glutamate receptors (mGluRs), suggesting a postsynaptic role of AC5-cAMP, upstream of endocannabinoid release. In striatopallidal projecting medium spiny neurons (MSNs), DA D2 receptors are negatively coupled to cAMP production and activation of these receptors is required for endocannabinoid release and corticostriatal LTD. Recordings from striatopallidal neurons indicated that this is mediated by AC5, as co-activation of D2 and mGluR receptors could induce LTD in WT, but not in AC5KO neurons. To further examine the role of cAMP in corticostriatal plasticity, we elevated cAMP in striatal neurons of wild-type mice via the recording electrode. Under these conditions corticostriatal LTD was eliminated. Together, these data suggest an AC5-cAMP-endocannabinoid-CB1 signaling pathway in corticostriatal plasticity and striatum-dependent learning.
doi:10.1523/JNEUROSCI.3343-09.2009
PMCID: PMC2782774  PMID: 19793969
Adenylyl cyclase; striatum; motor learning; plasticity; dopamine; LTD
5.  How do the basal ganglia contribute to categorization? Their role in generalization, response selection, and learning via feedback 
This article examines how independent corticostriatal loops linking basal ganglia with cerebral cortex contribute to visual categorization. The first aspect of categorization discussed is the role of the visual corticostriatal loop, which connects the visual cortex and the body/tail of the caudate, in mapping visual stimuli to categories, including evaluating the degree to which this loop may generalize across individual category members. The second aspect of categorization discussed is the selection of appropriate actions or behaviors on the basis of category membership, and the role of the visual corticostriatal loop output and the motor corticostriatal loop, which connects motor planning areas with the putamen, in action selection. The third aspect of categorization discussed is how categories are learned with the aid of feedback linked dopaminergic projections to the basal ganglia. These projections underlie corticostriatal synaptic plasticity across the basal ganglia, and also serve as input to the executive and motivational corticostriatal loops that play a role in strategic use of feedback.
doi:10.1016/j.neubiorev.2007.07.010
PMCID: PMC2376049  PMID: 17919725
6.  Auditory and motor imagery modulate learning in music performance 
Skilled performers such as athletes or musicians can improve their performance by imagining the actions or sensory outcomes associated with their skill. Performers vary widely in their auditory and motor imagery abilities, and these individual differences influence sensorimotor learning. It is unknown whether imagery abilities influence both memory encoding and retrieval. We examined how auditory and motor imagery abilities influence musicians' encoding (during Learning, as they practiced novel melodies), and retrieval (during Recall of those melodies). Pianists learned melodies by listening without performing (auditory learning) or performing without sound (motor learning); following Learning, pianists performed the melodies from memory with auditory feedback (Recall). During either Learning (Experiment 1) or Recall (Experiment 2), pianists experienced either auditory interference, motor interference, or no interference. Pitch accuracy (percentage of correct pitches produced) and temporal regularity (variability of quarter-note interonset intervals) were measured at Recall. Independent tests measured auditory and motor imagery skills. Pianists' pitch accuracy was higher following auditory learning than following motor learning and lower in motor interference conditions (Experiments 1 and 2). Both auditory and motor imagery skills improved pitch accuracy overall. Auditory imagery skills modulated pitch accuracy encoding (Experiment 1): Higher auditory imagery skill corresponded to higher pitch accuracy following auditory learning with auditory or motor interference, and following motor learning with motor or no interference. These findings suggest that auditory imagery abilities decrease vulnerability to interference and compensate for missing auditory feedback at encoding. Auditory imagery skills also influenced temporal regularity at retrieval (Experiment 2): Higher auditory imagery skill predicted greater temporal regularity during Recall in the presence of auditory interference. Motor imagery aided pitch accuracy overall when interference conditions were manipulated at encoding (Experiment 1) but not at retrieval (Experiment 2). Thus, skilled performers' imagery abilities had distinct influences on encoding and retrieval of musical sequences.
doi:10.3389/fnhum.2013.00320
PMCID: PMC3696840  PMID: 23847495
sensorimotor learning; auditory imagery; motor imagery; individual differences; music performance
7.  A hypothesis for basal ganglia-dependent reinforcement learning in the songbird 
Neuroscience  2011;198:152-170.
Most of our motor skills are not innately programmed, but are learned by a combination of motor exploration and performance evaluation, suggesting that they proceed through a reinforcement learning (RL) mechanism. Songbirds have emerged as a model system to study how a complex behavioral sequence can be learned through an RL-like strategy. Interestingly, like motor sequence learning in mammals, song learning in birds requires a basal ganglia (BG)-thalamocortical loop, suggesting common neural mechanisms. Here we outline a specific working hypothesis for how BG-forebrain circuits could utilize an internally computed reinforcement signal to direct song learning. Our model includes a number of general concepts borrowed from the mammalian BG literature, including a dopaminergic reward prediction error and dopamine mediated plasticity at corticostriatal synapses. We also invoke a number of conceptual advances arising from recent observations in the songbird. Specifically, there is evidence for a specialized cortical circuit that adds trial-to-trial variability to stereotyped cortical motor programs, and a role for the BG in ‘biasing’ this variability to improve behavioral performance. This BG-dependent ‘premotor bias’ may in turn guide plasticity in downstream cortical synapses to consolidate recently-learned song changes. Given the similarity between mammalian and songbird BG-thalamocortical circuits, our model for the role of the BG in this process may have broader relevance to mammalian BG function.
doi:10.1016/j.neuroscience.2011.09.069
PMCID: PMC3221789  PMID: 22015923
8.  Category Learning in the Brain 
Annual review of neuroscience  2010;33:203-219.
The ability to group items and events into functional categories is a fundamental characteristic of sophisticated thought. It is subserved by plasticity in many neural systems, including neocortical regions (sensory, prefrontal, parietal, and motor cortex), the medial temporal lobe, the basal ganglia, and midbrain dopaminergic systems. These systems interact during category learning. Corticostriatal loops may mediate recursive, bootstrapping interactions between fast reward-gated plasticity in the basal ganglia and slow reward-shaded plasticity in the cortex. This can provide a balance between acquisition of details of experiences and generalization across them. Interactions between the corticostriatal loops can integrate perceptual, response, and feedback-related aspects of the task and mediate the shift from novice to skilled performance. The basal ganglia and medial temporal lobe interact competitively or cooperatively, depending on the demands of the learning task.
doi:10.1146/annurev.neuro.051508.135546
PMCID: PMC3709834  PMID: 20572771
classification; concept learning; memory systems
9.  Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis 
Cerebral Cortex (New York, NY)  2011;22(3):509-526.
Growing evidence suggests that the prefrontal cortex (PFC) is organized hierarchically, with more anterior regions having increasingly abstract representations. How does this organization support hierarchical cognitive control and the rapid discovery of abstract action rules? We present computational models at different levels of description. A neural circuit model simulates interacting corticostriatal circuits organized hierarchically. In each circuit, the basal ganglia gate frontal actions, with some striatal units gating the inputs to PFC and others gating the outputs to influence response selection. Learning at all of these levels is accomplished via dopaminergic reward prediction error signals in each corticostriatal circuit. This functionality allows the system to exhibit conditional if–then hypothesis testing and to learn rapidly in environments with hierarchical structure. We also develop a hybrid Bayesian-reinforcement learning mixture of experts (MoE) model, which can estimate the most likely hypothesis state of individual participants based on their observed sequence of choices and rewards. This model yields accurate probabilistic estimates about which hypotheses are attended by manipulating attentional states in the generative neural model and recovering them with the MoE model. This 2-pronged modeling approach leads to multiple quantitative predictions that are tested with functional magnetic resonance imaging in the companion paper.
doi:10.1093/cercor/bhr114
PMCID: PMC3278315  PMID: 21693490
basal ganglia; computational model; hierarchical reinforcement learning; prefrontal cortex
10.  Dopamine-Dependent Motor Learning Insight into Levodopa’s Long-Duration Response 
Annals of neurology  2010;67(5):639-647.
Objective
Dopamine (DA) is critical for motor performance, motor learning, and corticostriatal plasticity. The relationship between motor performance and learning, and the role of DA in the mediation of them, however, remain unclear.
Methods
To examine this question, we took advantage of PITx3-deficient mice (aphakia mice), in which DA in the dorsal striatum is reduced by 90%. PITx3-deficient mice do not display obvious motor deficits in their home cage, but are impaired in motor tasks that require new motor skills. We used the accelerating rotarod as a motor learning task.
Results
We show that the deficiency in motor skill learning in PITx3(−/−) is dramatic and can be rescued with levodopa treatment. In addition, cessation of levodopa treatment after acquisition of the motor skill does not result in an immediate drop in performance. Instead, there is a gradual decline of performance that lasts for a few days, which is not related to levodopa pharmacokinetics. We show that this gradual decline is dependent on the retesting experience.
Interpretation
This observation resembles the long-duration response to levodopa therapy in its slow buildup of improvement after the initiation of therapy and gradual degradation. We hypothesize that motor learning may play a significant, underappreciated role in the symptomatology of Parkinson disease as well as in the therapeutic effects of levodopa. We suggest that the important, yet enigmatic long-duration response to chronic levodopa treatment is a manifestation of rescued motor learning.
doi:10.1002/ana.21947
PMCID: PMC3129617  PMID: 20437561
11.  Emergence of a Stable Cortical Map for Neuroprosthetic Control 
PLoS Biology  2009;7(7):e1000153.
In this article, the authors show that the neural representation for control of a neuroprosthetic device undergoes a process of consolidation, after which it is stable, readily recalled, and resistant to interference.
Cortical control of neuroprosthetic devices is known to require neuronal adaptations. It remains unclear whether a stable cortical representation for prosthetic function can be stored and recalled in a manner that mimics our natural recall of motor skills. Especially in light of the mixed evidence for a stationary neuron-behavior relationship in cortical motor areas, understanding this relationship during long-term neuroprosthetic control can elucidate principles of neural plasticity as well as improve prosthetic function. Here, we paired stable recordings from ensembles of primary motor cortex neurons in macaque monkeys with a constant decoder that transforms neural activity to prosthetic movements. Proficient control was closely linked to the emergence of a surprisingly stable pattern of ensemble activity, indicating that the motor cortex can consolidate a neural representation for prosthetic control in the presence of a constant decoder. The importance of such a cortical map was evident in that small perturbations to either the size of the neural ensemble or to the decoder could reversibly disrupt function. Moreover, once a cortical map became consolidated, a second map could be learned and stored. Thus, long-term use of a neuroprosthetic device is associated with the formation of a cortical map for prosthetic function that is stable across time, readily recalled, resistant to interference, and resembles a putative memory engram.
Author Summary
Brain–machine interfaces (BMIs) have the potential to revolutionize the care of neurologically impaired patients. Numerous studies have now shown the feasibility of direct “brain control” of a neuroprosthetic device, yet it remains unclear whether the neural representation for prosthetic control can become consolidated and remain stable over time. This question is especially intriguing given the evidence demonstrating that the neural representation for natural movements can be unstable: BMIs provide a window into the plasticity of cortical circuits in awake-behaving subjects. Here, we show that long-term neuroprosthetic control leads to the formation of a remarkably stable cortical map. Interestingly, this map has the putative attributes of a memory trace, namely, it is stable across time, readily recalled, and resistant to the storage of a second map. The demonstration of such a cortical map for prosthetic control indicates that neuroprosthetic devices could eventually be controlled through the effortless recall of motor memory in a manner that mimics natural skill acquisition and motor control.
doi:10.1371/journal.pbio.1000153
PMCID: PMC2702684  PMID: 19621062
12.  Spike-Timing Dependent Plasticity in the Striatum 
The striatum is the major input nucleus of basal ganglia, an ensemble of interconnected sub-cortical nuclei associated with fundamental processes of action-selection and procedural learning and memory. The striatum receives afferents from the cerebral cortex and the thalamus. In turn, it relays the integrated information towards the basal ganglia output nuclei through which it operates a selected activation of behavioral effectors. The striatal output neurons, the GABAergic medium-sized spiny neurons (MSNs), are in charge of the detection and integration of behaviorally relevant information. This property confers to the striatum the ability to extract relevant information from the background noise and select cognitive-motor sequences adapted to environmental stimuli. As long-term synaptic efficacy changes are believed to underlie learning and memory, the corticostriatal long-term plasticity provides a fundamental mechanism for the function of the basal ganglia in procedural learning. Here, we reviewed the different forms of spike-timing dependent plasticity (STDP) occurring at corticostriatal synapses. Most of the studies have focused on MSNs and their ability to develop long-term plasticity. Nevertheless, the striatal interneurons (the fast-spiking GABAergic, NO-synthase and cholinergic interneurons) also receive monosynaptic afferents from the cortex and tightly regulated corticostriatal information processing. Therefore, it is important to take into account the variety of striatal neurons to fully understand the ability of striatum to develop long-term plasticity. Corticostriatal STDP with various spike-timing dependence have been observed depending on the neuronal sub-populations and experimental conditions. This complexity highlights the extraordinary potentiality in term of plasticity of the corticostriatal pathway.
doi:10.3389/fnsyn.2010.00006
PMCID: PMC3059675  PMID: 21423492
spike-timing dependent plasticity; corticostriatal; striatum; GABAergic interneurons; cholinergic interneurons; LTP; LTD; basal ganglia
13.  Advances in Neuroprosthetic Learning and Control 
PLoS Biology  2013;11(5):e1001561.
This essay summarizes recent advances in the field of brain-machine interfaces, with a focus on the learning and acquisition of neuroprosthetic skills.
Significant progress has occurred in the field of brain–machine interfaces (BMI) since the first demonstrations with rodents, monkeys, and humans controlling different prosthetic devices directly with neural activity. This technology holds great potential to aid large numbers of people with neurological disorders. However, despite this initial enthusiasm and the plethora of available robotic technologies, existing neural interfaces cannot as yet master the control of prosthetic, paralyzed, or otherwise disabled limbs. Here I briefly discuss recent advances from our laboratory into the neural basis of BMIs that should lead to better prosthetic control and clinically viable solutions, as well as new insights into the neurobiology of action.
doi:10.1371/journal.pbio.1001561
PMCID: PMC3660243  PMID: 23700383
14.  Serotonin Induces Long-Term Depression at Corticostriatal Synapses 
The striatum has important roles in motor control and action learning and, like many brain regions, receives multiple monoaminergic inputs. We have examined serotonergic modulation of rat and mouse corticostriatal neurotransmission and find that serotonin (5-HT) activates 5-HT1b receptors resulting in a long-term depression (LTD) of glutamate release and striatal output that we have termed 5-HT-LTD. 5-HT-LTD is presynaptically mediated, cAMP pathway-dependent, and inducible by endogenous striatal 5-HT, as revealed by application of a selective 5-HT reuptake inhibitor (SSRI). 5-HT-LTD is mutually occlusive with dopamine/endocannabinoid-dependent LTD, suggesting that these two forms of LTD act on the same corticostriatal terminals. Thus, serotonergic and dopaminergic mechanisms exist that may interact to persistently sculpt corticostriatal circuits, potentially influencing action learning and striatal-based disorders.
doi:10.1523/JNEUROSCI.6250-10.2011
PMCID: PMC3113491  PMID: 21593324
15.  Contributions of ERK signaling in the striatum to instrumental learning and performance 
Behavioural brain research  2010;218(1):240-247.
The striatum is critical for learning and decision making; however, the molecular mechanisms that govern striatum function are not fully understood. The extracellular signal regulated kinase (ERK) cascade is an important signaling pathway that underlies synaptic plasticity, cellular excitability, learning and arousal. This review focuses on the role of ERK signaling in striatum function. ERK is activated in the striatum by coordinated dopamine and glutamate receptor signaling, where it underlies corticostriatal synaptic plasticity and influences striatal cell excitability. ERK activation in the dorsal striatum is necessary for action-outcome learning and performance of goal-directed actions. In the ventral striatum, ERK is necessary for the motivating effects of reward-associated stimuli on instrumental performance. Dysregulation of ERK signaling in the striatum by repeated drug exposure contributes to the development of addictive behavior. These results highlight the importance of ERK signaling in the striatum as a critical substrate for learning and as a regulator of ongoing behavior. Furthermore, they suggest that ERK may be a suitable target for therapeutics to treat disorders of learning and decision making that arise from compromised striatum function.
doi:10.1016/j.bbr.2010.12.010
PMCID: PMC3022085  PMID: 21147168
Nucleus accumbens; dorsomedial striatum; dorsolateral striatum; extracellular signal regulated kinase; devaluation; pavlovian-instrumental transfer
16.  Motor imagery and action observation: cognitive tools for rehabilitation 
Journal of Neural Transmission  2007;114(10):1265-1278.
Summary
Rehabilitation, for a large part may be seen as a learning process where old skills have to be re-acquired and new ones have to be learned on the basis of practice. Active exercising creates a flow of sensory (afferent) information. It is known that motor recovery and motor learning have many aspects in common. Both are largely based on response-produced sensory information. In the present article it is asked whether active physical exercise is always necessary for creating this sensory flow. Numerous studies have indicated that motor imagery may result in the same plastic changes in the motor system as actual physical practice. Motor imagery is the mental execution of a movement without any overt movement or without any peripheral (muscle) activation. It has been shown that motor imagery leads to the activation of the same brain areas as actual movement. The present article discusses the role that motor imagery may play in neurological rehabilitation. Furthermore, it will be discussed to what extent the observation of a movement performed by another subject may play a similar role in learning. It is concluded that, although the clinical evidence is still meager, the use of motor imagery in neurological rehabilitation may be defended on theoretical grounds and on the basis of the results of experimental studies with healthy subjects.
doi:10.1007/s00702-007-0763-z
PMCID: PMC2797860  PMID: 17579805
Keywords: Motor imagery; movement observation; motor learning; rehabilitation
17.  Neurotransmitter Roles in Synaptic Modulation, Plasticity and Learning in the Dorsal Striatum 
Neuropharmacology  2010;58(7):951-961.
The dorsal striatum is a large forebrain region involved in action initiation, timing, control, learning and memory. Learning and remembering skilled movement sequences requires the dorsal striatum, and striatal subregions participate in both goal-directed (action-outcome) and habitual (stimulus-response) learning. Modulation of synaptic transmission plays a large part in controlling input to as well as the output from striatal medium spiny projection neurons (MSNs). Synapses in this brain region are subject to short-term modulation, including allosteric alterations in ion channel function and prominent presynaptic inhibition. Two forms of long-term synaptic plasticity have also been observed in striatum, long-term potentiation (LTP) and long-term depression (LTD). LTP at glutamatergic synapses onto MSNs involves activation of NMDA-type glutamate receptors and D1 dopamine or A2A adenosine receptors. Expression of LTP appears to involve postsynaptic mechanisms. LTD at glutamatergic synapses involves retrograde endocannabinoid signaling stimulated by activation of metabotropic glutamate receptors (mGluRs) and D2 dopamine receptors. While postsynaptic mechanisms participate in LTD induction, maintained expression involves presynaptic mechanisms. A similar form of LTD has also been observed at GABAergic synapses onto MSNs. Studies have just begun to examine the roles of synaptic plasticity in striatal-based learning. Findings to date indicate that molecules implicated in induction of plasticity participate in these forms of learning. Neurotransmitter receptors involved in LTP induction are necessary for proper skill and goal-directed instrumental learning. Interestingly, receptors involved in LTP and LTD at glutamatergic synapses onto MSNs of the “indirect pathway” appear to have important roles in habit learning. More work is needed to reveal if and when synaptic plasticity occurs during learning and if so what molecules and cellular processes, both short- and long-term, contribute to this plasticity.
doi:10.1016/j.neuropharm.2010.01.008
PMCID: PMC2849868  PMID: 20096294
Long-term plasticity; Dopamine; Glutamate; Endocannabinoid; Instrumental learning; Skill Learning
18.  Impaired goal-directed behavioural control in human impulsivity 
Two dissociable learning processes underlie instrumental behaviour. Whereas goal-directed behaviour is controlled by knowledge of the consequences, habitual behaviour is elicited directly by antecedent Pavlovian stimuli without knowledge of the consequences. Predominance of habitual control is thought to underlie psychopathological conditions associated with corticostriatal abnormalities, such as impulsivity and drug dependence. To explore this claim, smokers were assessed for nicotine dependence, impulsivity, and capacity for goal-directed control over instrumental performance in an outcome devaluation procedure. Reduced goal-directed control was selectively associated with the Motor Impulsivity factor of Barrett's Impulsivity Scale (BIS), which reflects propensity for action without thought. These data support the claim that human impulsivity is marked by impaired use of causal knowledge to make adaptive decisions. The predominance of habit learning may play a role in psychopathological conditions that are associated with trait impulsivity.
doi:10.1080/17470218.2010.518242
PMCID: PMC3471322  PMID: 21077008
Outcome specific devaluation; Goal-directed learning; Habit; Drug dependence; Nicotine; Impulsivity
19.  Brief Subthreshold Events Can Act as Hebbian Signals for Long-Term Plasticity 
PLoS ONE  2009;4(8):e6557.
Background
Action potentials are thought to be determinant for the induction of long-term synaptic plasticity, the cellular basis of learning and memory. However, neuronal activity does not lead systematically to an action potential but also, in many cases, to synaptic depolarizing subthreshold events. This is particularly exemplified in corticostriatal information processing. Indeed, the striatum integrates information from the whole cerebral cortex and, due to the membrane properties of striatal medium spiny neurons, cortical inputs do not systematically trigger an action potential but a wide range of subthreshold postsynaptic depolarizations. Accordingly, we have addressed the following question: does a brief subthreshold event act as a Hebbian signal and induce long-term synaptic efficacy changes?
Methodology/Principal Findings
Here, using perforated patch-clamp recordings on rat brain corticostriatal slices, we demonstrate, that brief (30 ms) subthreshold depolarizing events in quasi-coincidence with presynaptic activity can act as Hebbian signals and are sufficient to induce long-term synaptic plasticity at corticostriatal synapses. This “subthreshold-depolarization dependent plasticity” (SDDP) induces strong, significant and bidirectional long-term synaptic efficacy changes at a very high occurrence (81%) for time intervals between pre- and postsynaptic stimulations (Δt) of −110<Δt<+110 ms. Such subthreshold depolarizations are able to induce robust long-term depression (cannabinoid type-1 receptor-activation dependent) as well as long-term potentiation (NMDA receptor-activation dependent).
Conclusion/Significance
Our data show the existence of a robust, reliable and timing-dependent bidirectional long-term plasticity induced by brief subthreshold events paired with presynaptic activity. The existence of a subthreshold-depolarization dependent plasticity extends considerably, beyond the action potential, the neuron's capabilities to express long-term synaptic efficacy changes.
doi:10.1371/journal.pone.0006557
PMCID: PMC2725411  PMID: 19675683
20.  Music Making as a Tool for Promoting Brain Plasticity across the Life Span 
Playing a musical instrument is an intense, multisensory, and motor experience that usually commences at an early age and requires the acquisition and maintenance of a range of skills over the course of a musician's lifetime. Thus, musicians offer an excellent human model for studying the brain effects of acquiring specialized sensorimotor skills. For example, musicians learn and repeatedly practice the association of motor actions with specific sound and visual patterns (musical notation) while receiving continuous multisensory feedback. This association learning can strengthen connections between auditory and motor regions (e.g., arcuate fasciculus) while activating multimodal integration regions (e.g., around the intraparietal sulcus). We argue that training of this neural network may produce cross-modal effects on other behavioral or cognitive operations that draw on this network. Plasticity in this network may explain some of the sensorimotor and cognitive enhancements that have been associated with music training. These enhancements suggest the potential for music making as an interactive treatment or intervention for neurological and developmental disorders, as well as those associated with normal aging.
doi:10.1177/1073858410377805
PMCID: PMC2996135  PMID: 20889966
auditory; diffusion tensor imaging; functional MRI; morphometry; motor; music; plasticity
21.  White Matter Microstructural Correlates of Superior Long-term Skill Gained Implicitly under Randomized Practice 
Cerebral Cortex (New York, NY)  2011;22(7):1671-1677.
We value skills we have learned intentionally, but equally important are skills acquired incidentally without ability to describe how or what is learned, referred to as implicit. Randomized practice schedules are superior to grouped schedules for long-term skill gained intentionally, but its relevance for implicit learning is not known. In a parallel design, we studied healthy subjects who learned a motor sequence implicitly under randomized or grouped practice schedule and obtained diffusion-weighted images to identify white matter microstructural correlates of long-term skill. Randomized practice led to superior long-term skill compared with grouped practice. Whole-brain analyses relating interindividual variability in fractional anisotropy (FA) to long-term skill demonstrated that 1) skill in randomized learners correlated with FA within the corticostriatal tract connecting left sensorimotor cortex to posterior putamen, while 2) skill in grouped learners correlated with FA within the right forceps minor connecting homologous regions of the prefrontal cortex (PFC) and the corticostriatal tract connecting lateral PFC to anterior putamen. These results demonstrate first that randomized practice schedules improve long-term implicit skill more than grouped practice schedules and, second, that the superior skill acquired through randomized practice can be related to white matter microstructure in the sensorimotor corticostriatal network.
doi:10.1093/cercor/bhr247
PMCID: PMC3377966  PMID: 21914632
consolidation; contextual interference; diffusion tensor imaging; magnetic resonance imaging; motor learning; motor sequence; online learning
22.  Neural Correlates of Skill Acquisition: Decreased Cortical Activity During a Serial Interception Sequence Learning Task 
NeuroImage  2011;58(4):1150-1157.
Learning of complex motor skills requires learning of component movements as well as the sequential structure of their order and timing. Using a Serial Interception Sequence Learning (SISL) task, participants learned a sequence of precisely timed interception responses through training with a repeating sequence. Following initial implicit learning of the repeating sequence, functional MRI data were collected during performance of that known sequence and compared with activity evoked during novel sequences of actions, novel timing patterns, or both. Reduced activity was observed during the practiced sequence in a distributed bilateral network including extrastriate occipital, parietal, and premotor cortical regions. These reductions in evoked activity likely reflect improved efficiency in visuospatial processing, spatio-motor integration, motor planning, and motor execution for the trained sequence, which is likely supported by nondeclarative skill learning. In addition, the practiced sequence evoked increased activity in the left ventral striatum and medial prefrontal cortex, while the posterior cingulate was more active during periods of better performance. Many prior studies of perceptual-motor skill learning have found increased activity in motor areas of frontal cortex (e.g., motor and premotor cortex, SMA) and striatal areas (e.g., the putamen). The change in activity observed here (i.e., decreased activity across a cortical network) may reflect skill learning that is predominantly expressed through more accurate performance rather than decreased reaction time.
doi:10.1016/j.neuroimage.2011.06.090
PMCID: PMC3171628  PMID: 21771663
sequence learning; implicit learning; nondeclarative memory; timing; motor control; fMRI
23.  Interference in Ballistic Motor Learning: Specificity and Role of Sensory Error Signals 
PLoS ONE  2011;6(3):e17451.
Humans are capable of learning numerous motor skills, but newly acquired skills may be abolished by subsequent learning. Here we ask what factors determine whether interference occurs in motor learning. We speculated that interference requires competing processes of synaptic plasticity in overlapping circuits and predicted specificity. To test this, subjects learned a ballistic motor task. Interference was observed following subsequent learning of an accuracy-tracking task, but only if the competing task involved the same muscles and movement direction. Interference was not observed from a non-learning task suggesting that interference requires competing learning. Subsequent learning of the competing task 4 h after initial learning did not cause interference suggesting disruption of early motor memory consolidation as one possible mechanism underlying interference. Repeated transcranial magnetic stimulation (rTMS) of corticospinal motor output at intensities below movement threshold did not cause interference, whereas suprathreshold rTMS evoking motor responses and (re)afferent activation did. Finally, the experiments revealed that suprathreshold repetitive electrical stimulation of the agonist (but not antagonist) peripheral nerve caused interference. The present study is, to our knowledge, the first to demonstrate that peripheral nerve stimulation may cause interference. The finding underscores the importance of sensory feedback as error signals in motor learning. We conclude that interference requires competing plasticity in overlapping circuits. Interference is remarkably specific for circuits involved in a specific movement and it may relate to sensory error signals.
doi:10.1371/journal.pone.0017451
PMCID: PMC3052297  PMID: 21408054
24.  Motor Skill Learning Induces Changes in White Matter Microstructure and Myelination 
The Journal of Neuroscience  2013;33(50):19499-19503.
Learning a novel motor skill is associated with well characterized structural and functional plasticity in the rodent motor cortex. Furthermore, neuroimaging studies of visuomotor learning in humans have suggested that structural plasticity can occur in white matter (WM), but the biological basis for such changes is unclear. We assessed the influence of motor skill learning on WM structure within sensorimotor cortex using both diffusion MRI fractional anisotropy (FA) and quantitative immunohistochemistry. Seventy-two adult (male) rats were randomly assigned to one of three conditions (skilled reaching, unskilled reaching, and caged control). After 11 d of training, postmortem diffusion MRI revealed significantly higher FA in the skilled reaching group compared with the control groups, specifically in the WM subjacent to the sensorimotor cortex contralateral to the trained limb. In addition, within the skilled reaching group, FA across widespread regions of WM in the contralateral hemisphere correlated significantly with learning rate. Immunohistological analysis conducted on a subset of 24 animals (eight per group) revealed significantly increased myelin staining in the WM underlying motor cortex in the hemisphere contralateral (but not ipsilateral) to the trained limb for the skilled learning group versus the control groups. Within the trained hemisphere (but not the untrained hemisphere), myelin staining density correlated significantly with learning rate. Our results suggest that learning a novel motor skill induces structural change in task-relevant WM pathways and that these changes may in part reflect learning-related increases in myelination.
doi:10.1523/JNEUROSCI.3048-13.2013
PMCID: PMC3858622  PMID: 24336716
25.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill 
Nature neuroscience  2009;12(3):333-341.
The learning of new skills is characterized by an initial phase of rapid improvement in performance and a phase of more gradual improvements as skills are automatized and performance asymptotes. Using in vivo striatal recordings, we observed region-specific changes in neural activity during the different phases of skill learning, with the associative or dorsomedial striatum being preferentially engaged early in training and the sensorimotor or dorsolateral striatum being engaged later in training. Ex vivo recordings from medium spiny striatal neurons in brain slices of trained mice revealed that the changes observed in vivo corresponded to regional- and training-specific changes in excitatory synaptic transmission in the striatum. Furthermore, the potentiation of glutamatergic transmission observed in dorsolateral striatum after extensive training was preferentially expressed in striatopallidal neurons, rather than striatonigral neurons. These findings demonstrate that region- and pathway-specific plasticity sculpts the circuits involved in the performance of the skill as it becomes automatized.
doi:10.1038/nn.2261
PMCID: PMC2774785  PMID: 19198605

Results 1-25 (447177)