PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of ploscompComputational BiologyView this ArticleSubmit to PLoSGet E-mail AlertsContact UsPublic Library of Science (PLoS)
 
PLoS Comput Biol. Nov 2010; 6(11): e1000961.
Published online Nov 4, 2010. doi:  10.1371/journal.pcbi.1000961
PMCID: PMC2973812
Intrinsic Stability of Temporally Shifted Spike-Timing Dependent Plasticity
Baktash Babadi1* and L. F. Abbott1,2
1Center for Theoretical Neuroscience, Department of Neuroscience, Columbia University, New York, New York, United States of America
2Department of Physiology and Cellular Biophysics, Columbia University College of Physicians and Surgeons, New York, New York, United States of America
Lyle J. Graham, Editor
Université Paris Descartes, Centre National de la Recherche Scientifique, France
* E-mail: bb2280/at/columbia.edu
Conceived and designed the experiments: BB LFA. Performed the experiments: BB LFA. Analyzed the data: BB LFA. Contributed reagents/materials/analysis tools: BB LFA. Wrote the paper: BB LFA.
Received April 23, 2010; Accepted September 17, 2010.
Spike-timing dependent plasticity (STDP), a widespread synaptic modification mechanism, is sensitive to correlations between presynaptic spike trains and it generates competition among synapses. However, STDP has an inherent instability because strong synapses are more likely to be strengthened than weak ones, causing them to grow in strength until some biophysical limit is reached. Through simulations and analytic calculations, we show that a small temporal shift in the STDP window that causes synchronous, or nearly synchronous, pre- and postsynaptic action potentials to induce long-term depression can stabilize synaptic strengths. Shifted STDP also stabilizes the postsynaptic firing rate and can implement both Hebbian and anti-Hebbian forms of competitive synaptic plasticity. Interestingly, the overall level of inhibition determines whether plasticity is Hebbian or anti-Hebbian. Even a random symmetric jitter of a few milliseconds in the STDP window can stabilize synaptic strengths while retaining these features. The same results hold for a shifted version of the more recent “triplet” model of STDP. Our results indicate that the detailed shape of the STDP window function near the transition from depression to potentiation is of the utmost importance in determining the consequences of STDP, suggesting that this region warrants further experimental study.
Synaptic plasticity is believed to be a fundamental mechanism of learning and memory. In spike-timing dependent synaptic plasticity (STDP), the temporal order of pre- and postsynaptic spiking across a synapse determines whether it is strengthened or weakened. STDP can induce competition between the different inputs synapsing onto a neuron, which is crucial for the formation of functional neuronal circuits. However, strong synaptic competition is often incompatible with inherent synaptic stability. Synaptic modification by STDP is controlled by a so-called temporal window function that determines how synaptic modification depends on spike timing. We show that a small shift, or random jitter, in the conventional temporal window function used for STDP that is compatible with the underlying molecular kinetics of STDP, can both stabilize synapses and maintain competition. The outcome of the competition is determined by the level of inhibitory input to the postsynaptic neuron. We conclude that the detailed shape of the temporal window function is critical in determining the functional consequences of STDP and thus deserves further experimental study.
Hebbian synaptic plasticity can effectively organize neural circuits in functionally useful ways, but only when implemented in a manner that induces competition among synapses [1]. Spike-timing dependent synaptic plasticity (STDP), which has been observed in a wide variety of preparations (see [2] for a review), appears to provide such an implementation by forcing synapses to compete for control of the timing of postsynaptic action potentials while being strengthened or weakened. In STDP, a synapse is potentiated when a presynaptic action potential precedes a postsynaptic spike, and depressed otherwise (see [3] for a review). STDP has been shown to induce a competitive form of Hebbian plasticity that is useful for a variety of neuro-computational problems (see [4] for a review). However, this form of STDP has an inherent instability in that strong synapses get stronger and weak synapses get weaker. This instability can be tamed by biophysical limitations on synaptic strengths, resulting in a U-shaped distribution of synaptic efficacies [5]. Nevertheless, it is interesting to examine models that do not require such constraints for stabilization and that generate unimodal distributions of synaptic strengths resembling those measured in cultured and cortical networks [6][8].
Synaptic competition and synaptic stability (meaning that synapses reach a stable equilibrium distribution independent of bounds on their strengths) are desirable but conflicting features of Hebbian synaptic plasticity. For example, the instability of STDP mentioned in the previous paragraph can be eliminated by introducing strength-dependent modification [9], [10], but at the expense of eliminating synaptic competition. By interpolating between stable and unstable models of STDP, it is possible to obtain both synaptic competition and stability, but over a limited parameter range [11]. Here we propose an alternative solution inspired by the slow kinetics of NMDA receptors. We show that STDP can be stabilized if the boundary separating potentiation and depression does not occur for simultaneous pre- and postsynaptic spikes, but rather for spikes separated by a small time interval. Through simulation as well as by solving the Fokker-Planck equation governing the distribution of synaptic strengths, we show that any positive shift of the STDP window can stabilize the distribution of synaptic strengths while preserving synaptic competition. These properties also hold for a multi-spike STDP rule in which triplets of pre- and postsynaptic spikes are the key events in determining the synaptic change [12], as opposed to pair-based STDP in which pairs of pre- and postsynaptic spikes govern the plasticity process. Moreover, our simulations show that even a random symmetric jitter of a few milliseconds in the STDP window can stabilize synaptic strengths while retaining these features.
To study the effects of STDP on synaptic strengths, we simulated a single spiking neuron that receives excitatory and inhibitory presynaptic spike trains with Poisson statistics at rates An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e001.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e002.jpg, respectively (Methods). The strengths of the excitatory synapses, denoted by An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e003.jpg, change due to STDP, while the strengths of the inhibitory synapses remain constant. We first consider the pair-based model of STDP. A more complicated multi-spike model will be studied afterward. In the pair-based model the change in synaptic strength, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e004.jpg, induced by a pair of pre- and postsynaptic action potentials with time difference An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e005.jpg is determined by
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e006.jpg
(1)
The parameters An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e007.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e008.jpg, both positive, determine the maximum amount of synaptic potentiation and depression, respectively. We define synaptic strengths in units of membrane potential depolarization (mV), so An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e009.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e010.jpg have mV units as well (Methods). The time constants An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e011.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e012.jpg determine the temporal extent of the STDP window for potentiation and depression. The parameter An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e013.jpg, also positive, introduces a shift in the STDP window such that even in cases where a presynaptic action potential precedes the postsynaptic spike by a short interval (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e014.jpg), the corresponding synapse gets depressed. Note that we recover conventional pair-based STDP by setting An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e015.jpg. Further details of the synaptic modification procedure appear in the Methods, and the numerical values of the STDP parameters are given in Table 1. An important feature of the pair-based model we use is that STDP arises solely from pairs of pre- and postsynaptic spikes that are nearest neighbors in time, in agreement with experimental results [13]. Specifically, each postsynaptic action potential can only potentiate a synapses on the basis of the interval to the presynaptic spike immediately preceding it, and each presynaptic action potential can only depress a synapses on the basis of the timing interval to the immediately preceding postsynaptic spike. This assumption is important for the results we obtain using the pair-based STDP model, as discussed below.
Table 1
Table 1
Neuronal, synaptic, and plasticity parameters.
Stability of synaptic strengths
With conventional, unshifted STDP (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e044.jpg), synaptic strengths grow or shrink indefinitely unless limits are imposed. These limits produce a U-shaped distribution of synaptic strengths (figure 1A, [5]). However, if we introduce a An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e045.jpg shift into the STDP window, the steady-state distribution of synaptic strengths is unimodal and stable even when no limits are imposed (figure 1B). Why does this occur?
Figure 1
Figure 1
Comparison of unshifted and shifted STDP.
The total effect of a sequence of pre- and postsynaptic action potentials on the strength of a synapse can be computed by multiplying the STDP window function by the probability of a spike pair appearing with time difference An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e048.jpg and then integrating over all values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e049.jpg. If we assume Poisson spike trains and ignore the effects of the synapse, the probability distribution of nearest-neighbor pre-post pairs is an exponentially decaying function of the magnitude of the interval between them (figure 1C). The decay rate of this exponential is equal to the sum of the pre- and postsynaptic firing rates (Methods). The presence of a synapse induces an additional contribution to this distribution for small positive An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e050.jpg arising from postsynaptic spikes induced by the synaptic input (figure 1C). The size of this “causal bump” is proportional to the probability of a presynaptic action potential evoking a postsynaptic response, and hence to the strength of the synapse. The stronger the synapse, the larger the bump. In addition, because the postsynaptic spike latency is shorter for stronger synapses, the bump moves closer to An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e051.jpg as the synaptic strength increases (figure 1D). These features of the pre-post interval distribution are crucial for our analyses.
When there is no shift in the STDP window, the causal bump falls entirely within the potentiation domain (figure 1E), which is why synaptic strengths grow until something else stops them (figure 1F). When the STDP window is shifted, part of the causal bump falls into the region where depression occurs (figure 1G). Furthermore as the synapse gets stronger, a larger portion of the causal bump falls into the depression domain, both because the causal bump gets bigger and because it moves closer to An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e052.jpg (figure 1H). This prevents further growth of the synaptic strength and explains why a shift stabilizes synaptic growth through STDP. Stabilization of synaptic weights occurs for any positive value of the delay (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e053.jpg), but larger delays result in lower mean values and sharper distributions for the weights (figure 2).
Figure 2
Figure 2
Shifted STDP stabilizes the distribution of synaptic strengths.
For a more quantitative evaluation of shifted STDP, we computed the steady-state solution of the Fokker-Planck equation governing the distribution of synaptic strengths [14][16] (Methods). With a few reasonable approximations and ignoring any limits or bounds, the steady-state distribution of synaptic strengths has the form of a gamma distribution,
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e054.jpg
(2)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e055.jpg is a normalization constant and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e056.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e057.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e058.jpg are computed parameters. If either An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e059.jpg or An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e060.jpg is negative, this distribution cannot be normalized, implying unstable synaptic strengths. The calculations indicate that An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e061.jpg is positive for any positive shift (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e062.jpg, Methods). Positivity of An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e063.jpg requires that An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e064.jpg. Note that this is opposite to the condition required of conventional, unshifted STDP (see for example [5]). Because it is easier to do the analytic calculations without imposing strict boundary conditions on the synaptic strengths, the analytic formula sometimes includes a small probability for negative strength synapses, which is not allowed in the simulations. Other than this small discrepancy, the agreement between the analytic distribution and the simulation results is good (figures 2 & 3). In what follows, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e065.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e066.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e067.jpg, and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e068.jpg, unless stated otherwise.
Figure 3
Figure 3
The steady-state postsynaptic firing rate.
Steady-state firing rate
STDP has an interesting regulatory effect on the steady-state firing rate of a neuron [5], [15]. With unshifted STDP, this is a buffering effect making the steady-state postsynaptic firing rate relatively insensitive to the firing rates of excitatory and inhibitory inputs. Shifted STDP also buffers the postsynaptic firing rate, but the residual dependence on the presynaptic rates displays an interesting effect. Although the steady-state firing rate decreases when the inhibitory input rates are increased, it has a surprising non-monotonic dependence on the rates of excitatory inputs (figure 3).
The stabilization of synaptic strengths discussed in the previous section arises from the change of size and shape of the causal bump seen in figure 1C & D. Buffering of the steady-state postsynaptic firing rate is affected primarily by the shape of the symmetric, non-causal component of the spike-timing probability. As mentioned previously, this component falls off exponentially, for either positive or negative spike-timing differences, at a rate given by the sum of the presynaptic and postsynaptic firing rates (Methods). If this sum grows, the acausal part of the distribution gets more peaked near zero, bringing more spike pairs into the region of the STDP window where the shift leads to synaptic depression. The resulting reduction in synaptic strength then lowers the postsynaptic firing rate. This form of buffering would not be present if all spike pairs, rather than only nearest-neighbor pairs, were involved in STDP. If we allowed all spike pairs to induce synaptic plasticity the relevant symmetric, non-causal distribution would be flat, rather than exponentially decaying. In this case, there is no analogous stabilization and, in fact, postsynaptic rates slowly rise, making the plasticity unstable, even with shifted STDP. This is why we require shifted STDP to be based only on nearest-neighbor spike pairs.
In general, we expect the firing rate of a neuron to increase when its excitatory inputs fire more rapidly, and this is exactly what occurs for excitatory input rates below about 10 Hz in figure 3. However, for excitatory input rates higher than this, the steady-state (after STDP has equilibrated) postsynaptic firing rate decreases. This occurs for the reason outlined in the previous paragraph. Increasing the presynaptic rate causes the acausal distribution to sharpen and induces synaptic depression. This slows the postsynaptic rate, broadening the acausal distribution until the spike intervals in the delay region are sufficiently reduced in number. This is what causes the steady-state postsynaptic firing rate to drop when the excitatory presynaptic rates are raised to high levels.
Shifted STDP also has a buffering property on changes in the inhibitory input rate. In presence of strong inhibitory input, the postsynaptic firing rate falls. This broadens the acausal part of the spike-pair distribution, lowering the chance for pairs to fall into the depression domain caused by the shift and, thus, resulting in more potentiation. However, in this case, the effect is not strong enough to overcome the expected tendency of the postsynaptic rate to be suppressed by inhibition (figure 3).
Synaptic competition
Hebbian plasticity in general and STDP in particular allows neurons to become selective to correlated subsets of their inputs, but this requires synaptic competition [1]. We call synaptic plasticity “competitive” if correlating a subset of synaptic inputs causes both that set and the remaining synapses to change their strengths in an opposing manner, so than either the correlated or the uncorrelated set of synapses gains control of the postsynaptic firing (see for example [11]). In particular, if STDP is competitive, the strengths of either the correlated or uncorrelated subgroup of synapses should cluster near zero. To determine whether the necessary competition exists with shifted STDP, we imposed pairwise correlations with a coefficient of 0.2 on one half of the incoming excitatory spike trains while leaving the other half uncorrelated (Methods). With unshifted STDP, this arrangement induces a competition that correlated synapses always win [5]. In other words, the synapses receiving correlated input become stronger and those receiving uncorrelated input get weaker.
Interestingly, with shifted STDP the outcome of the competition depends on the rate of inhibitory input to the neuron. When the rate of inhibitory input is 10 Hz for the parameters we use, the synapses receiving correlated spikes end up weaker than the synapses receiving uncorrelated spikes (figure 4A). This behavior is “anti-Hebbian” in that it is opposite to what is expected from normal Hebbian modification. However, when the rate of the inhibitory inputs is increased to 20 Hz, we obtain the usual Hebbian result in which correlated synapses win the competition and become stronger than uncorrelated synapses (figure 4B). Results obtained over a range of inhibitory input rates show a transition from anti-Hebbian to Hebbian modification (figure 4C). Choosing other values for the correlation coefficient within a range from 0.1 to 0.9 yielded qualitatively similar results. Competition also occurs between two correlated subgroups with different correlation coefficients, with the more correlated synapses dominating over the less correlated ones in the Hebbian (high inhibition) case and vice versa in the anti-Hebbian (low inhibition) mode. If the correlation coefficients for the two groups are the same, no competition takes place.
Figure 4
Figure 4
Synaptic competition through shifted STDP.
These results were obtained using spike trains with zero time-lag correlations, meaning that for any two correlated spike trains, a subset of spikes is perfectly synchronous. More realistic spike correlations can be generated by including a small random jitter in the timing of the synchronous spikes. The mean of this jitter determines the correlation time constant. Breaking perfect synchrony does not change the above results qualitatively. However, the rate of inhibitory input needed to transition from anti-Hebbian to Hebbian competition is sensitive to the correlation time constant (figure 4D). When the correlation time constant increases, the inhibitory rate at the transition decreases, until the correlation time constant becomes greater than the shift of the STDP window (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e074.jpg). Further increase in the correlation time constant does not lead to any more lowering of the transitional inhibitory rate (figure 4D).
The dependence of the outcome of synaptic competition on the level of inhibitory input can be explained by evaluating the effect of inhibition on the firing regime of the postsynaptic neuron. When the inhibitory input to a neuron is low, it operates in a “mean-driven” regime, meaning that the time-averaged “free-running” membrane potential (that is, the membrane potential if the spike generation mechanism is turned off) is above the firing threshold [17]. In the mean-driven regime, integrate-and-fire neurons spike regularly, so the coefficient of variation of the inter-spike-intervals (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e075.jpg), which is a measure of the irregularity of firing, is small [18]. On the other hand, when the inhibitory input to the neuron is high, the mean membrane potential is below the firing threshold. In this case, large deviations in the membrane potential from its mean are required to make the neuron fire, and the neuron is said to be in the “fluctuation-driven” regime [17][19]. This makes firing times irregular, resulting in a larger An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e076.jpg.
The model neuron we study traverses these regimes as the firing rate of its inhibitory inputs is varied (figure 5A). When the inhibitory input is small, the neuron operates in the mean-driven regime, with its mean free-running membrane potential above threshold and a small An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e077.jpg. When the inhibitory input rates increase beyond 14 Hz, the neuron suddenly switches to a fluctuation-driven regime in which the mean membrane potential is below threshold and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e078.jpg is large. The transition between the mean-driven and fluctuation-driven regimes occurs exactly where synaptic competition switches from being anti-Hebbian to Hebbian (compare figure 4C with with5A).5A). Thus, the key feature determining whether plasticity is anti-Hebbian or Hebbian is whether the postsynaptic neuron is in a mean-driven or fluctuation-driven state.
Figure 5
Figure 5
The effect of the inhibitory input on synaptic competition.
Recall that the causal bump is the excess probability of postsynaptic firing caused by an incoming input spike. As mentioned previously, the effect of shifted STDP on the distribution of synaptic strengths can be explained by considering the shape of the postsynaptic causal bump in relation to the STDP temporal window. When the postsynaptic neuron is in the mean-driven regime, the membrane potential rises rapidly to the threshold. As a result, presynaptic action potentials can only enhance postsynaptic firing if they occur during a relatively short time-interval prior to the postsynaptic spike. This means that the causal bump decays rapidly for longer intervals. The causal bump also has a higher amplitude and decays more rapidly for stronger synapses (figure 5B). Furthermore, the causal bump due to correlated inputs is even narrower and sharper (and more inside the depression region) than the bump due to uncorrelated inputs (figure 5B, magenta traces), because correlated spikes are more likely to induce a postsynaptic spike rapidly when they occur in unison. As a result, the uncorrelated synapses win the synaptic competition when the level of inhibition is low.
When the postsynaptic neuron fires in the fluctuation-driven regime, the membrane potential spends a considerable time near but below the firing threshold before spiking. As a result, presynaptic input can affect postsynaptic firing over a longer time interval than in the mean-driven regime. This makes the causal bump broader than in the mean-driven case (figure 5C). Furthermore, the causal bump is even broader for correlated than for uncorrelated inputs because the simultaneous arrival of correlated spikes generates a stronger depolarization transient that makes it possible for subsequent weaker inputs to push the postsynaptic neuron above threshold over a longer time interval. This gives the causal bump for the correlated inputs a long tail that extends well into the potentiation domain of the STDP window (figure 5C, magenta traces), allowing them to win the competition in this case.
The transition from the mean-driven to the fluctuation-driven regime and correspondingly from anti-Hebbian to Hebbian competition is quite abrupt. This may be due to the interplay between the correlated inputs and the firing mode of the neuron. Correlated inputs increase membrane potential fluctuations and spiking irregularity [20]. Therefore, within the context of shifted STDP, there is positive feedback between the fluctuation-driven regime and the dominance of correlated inputs. As the neuron transitions to the fluctuation-driven regime through increased inhibition, the correlated synapses start to strengthen more than the uncorrected ones which, in turn, increases the fluctuations of the membrane potential and pushes the neuron further into the fluctuation-driven regime. This positive feedback continues until the correlated synapses dominate over the uncorrelated ones and the neuron falls completely into the fluctuation-driven mode.
Jittered STDP window
It is not necessary to introduce an explicit shift into the STDP window to assure stability. Any mechanism that causes depression to dominate over potentiation for short positive pairing intervals will have the same qualitative effect. One such mechanism is a symmetric random jitter introduced into an unshifted STDP window that has An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e081.jpg. By jitter we mean that the time An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e082.jpg used to determine the effect of STDP for any given pair of pre- and postsynaptic spikes, is not simply the difference between the times of their occurrence, but instead a random term is added. In other words, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e083.jpg, where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e084.jpg is a random variable drawn from a distribution with zero mean and a certain variance (we use a Gaussian distribution). Although the STDP window has no explicit shift in this case (figure 6A, top), the effective window obtained by averaging over the symmetric random jitter (figure 6A, bottom), exhibits the required feature that depression occurs for small positive pairing intervals.
Figure 6
Figure 6
Jittered STDP.
Simulations show that jittered STDP has all the qualitative properties of shifted STDP, although the maximum depression must be set to be greater rather than the maximum potentiation (we take An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e087.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e088.jpg, although see [21]). To keep An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e089.jpg, as required for stability, the time constant of potentiation must be larger than that of depression (we take An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e090.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e091.jpg). If the standard deviation of the jitter is less than An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e092.jpg, the steady-state distribution of synaptic weights is not inherently stable and we obtain a U-shaped distribution of synaptic strengths (figure 6B). However, for larger standard deviations of the jitter, the steady-state distribution is stable and unimodal as in the case of shifted STDP (figure 6B). Other features of shifted STDP are also reproduced. The steady-state firing rate of the postsynaptic neuron decreases when the rate of presynaptic input increases (figure 6C), and either anti-Hebbian or Hebbian competition occurs depending on the rate of inhibitory input to the neuron (figure 6D).
Shifted STDP with multi-spike interactions
A pair-based STDP model cannot account for all experimentally observed spike-timing dependent synaptic modifications. When bursts of spikes are induced in the pre- and postsynaptic neurons, frequency dependence is observed for both pre-after-post and post-after-pre pairings. The magnitude of LTP, but not LTD, increases with burst frequency and, at high burst frequency, LTP is induced regardless of the ordering of the pre- and postsynaptic spikes [13], [22]. Similarly, the dependence of synaptic modification on triplets and quadruplets of spikes cannot be fully explained by pair-based STDP models [23], [24]. Recent results from experiments that used complex spike patterns have led to STDP models that take into account interactions between multiple pre- and postsynaptic spikes. The details of the multi-spike interactions vary among different models. In the “suppression model” the plasticity-inducing effect of each pre- or postsynaptic spike is suppressed by the preceding spikes in the same neuron [22], [23]. In the “triplet model”, in addition to the effect of neighboring pre-post pairings there is an extra depression exerted by the preceding presynaptic spikes and an extra potentiation by the preceding postsynaptic spikes [12]. The triplet model can account for most of the observed synaptic modifications induced by complex spike patterns [12], including the dependency of plasticity on burst frequency [13] and triplet effects in hippocampal culture [24] where pre-post-pre ensembles with the same timing difference lead to insignificant changes but post-pre-post ensemble induces a strong potentiation of synapse. The triplet model can also be mapped to a Bienenstock-Cooper-Munro learning rule [25], which has several interesting functional properties. Nevertheless, the triplet model suffers from the same instability as pair-based STDP. Therefore, we examine the effect of introducing a shift into this model.
In the triplet model, a “2 pre/1 post” ensemble of spikes exerts an extra depression (the triplet depression) in addition to the usual pre-post pairing effect. The triplet depression has its maximum value An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e093.jpg immediately after the first presynaptic spike and decays exponentially as a function of the interval between the two presynaptic spikes, with time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e094.jpg. Similarly, a “1 pre/2 post” ensemble of spikes exerts an extra potentiation (the triplet potentiation) with the maximum value An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e095.jpg and decay time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e096.jpg (see Methods for details). The value of these triplet parameters vary in different neuronal preparations [12]. Here, we set the time constants An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e097.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e098.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e099.jpg and examine the model with a range of parameters An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e100.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e101.jpg. The window of the pre-post pairing is shifted by An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e102.jpg as before and all other parameters are the same as in Table 1.
Simulations show that the final distribution of weights is stable and unimodal (figure 7A) using the triplet model, unless the triplet depression is extremely high, which causes the firing rate of the postsynaptic neuron to go to zero, terminating plasticity. After finding that the shifted STDP in the triplet model stabilizes weights for a wide range of parameters, we set An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e103.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e104.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e105.jpg and examined other properties of shifted STDP in this model. Further simulations showed that shifted STDP within the framework of the triplet model has all the qualitative properties of the shifted pair-based STDP model. A shift as low as 0.1 milliseconds is sufficient to stabilize the weights, with larger delays resulting in lower mean values and sharper distributions for the weights (figure 7B). The steady-state firing rate of the postsynaptic neuron decreases when the rate of the excitatory and/or inhibitory presynaptic input increases (figure 7C). Finally, either anti-Hebbian or Hebbian competition occurs depending on the rate of inhibitory input to the neuron (figure 7D).
Figure 7
Figure 7
The shifted triplet model.
We have shown that a slight shift in the effective STDP temporal window, such that postsynaptic spikes occurring shortly after presynaptic action potentials cause synaptic depression, can stabilize the distribution of synaptic strengths without loss of competition, both in pair-based and triplet-based models. The shift can be explicitly implemented in the STDP window or achieved by other means such as a symmetric spike-by-spike random jitter. In fact, any mechanism that causes synaptic depression for small but causal (positive by our convention) pre-post spike intervals should lead to the stabilization and other effects we report. What biophysical mechanisms could cause this to occur?
The sharp transition between depression and potentiation in STDP appears to be due to the abrupt onset of long-term potentiation [26], [27]. It is believed that the CaAn external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e111.jpg influx through NMDA receptors is responsible for this potentiation [28] and that the abrupt onset arises because the NMDA channel be in an open but blocked configuration before subsequent depolarization removes the MgAn external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e112.jpg block [29]. To assure a large CaAn external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e113.jpg influx and subsequent potentiation, it seems reasonable to assume that the depolarization that removes the MgAn external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e114.jpg block should occur near the peak of the NMDA activation. The MgAn external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e115.jpg removal by postsynaptic depolarization is extremely rapid [30] but the NMDA activation has a finite rise time, so the peak of NMDA activation occurs a few milliseconds after the arrival of the presynaptic spike [31]. Therefore, it seems likely that the maximum potentiation should occur when the presynaptic spike precedes the postsynaptic action potential by several milliseconds, and that depression could result from timing differences shorter than this. Thus, the biophysics of the NMDA receptor appears to support the idea of a temporal shift in the STDP window. The shape of the STDP window has been inferred from models of NMDA receptor kinetics and back-propagating action potentials [32], [33]. However, the millisecond timing of the transition from depression to potentiation was not investigated systematically, because its significance was not evident at that time. Nevertheless, in some parameterizations of such models a small depression domain for short positive pairing intervals has been reported [33].
Typically in electrophysiological recordings, action potentials are measured at the soma, but what matters for STDP is the timing of the events at the synapse. More precisely, the timing of the postsynaptic EPSP and that of the backpropagating action potential to the synapse control plasticity. Transmission delays may have their own interesting computational properties. For example, it has been shown that STDP in the presence of axonal transmission delays can have a desynchronizing effect on population bursts and a synchronizing effect on random spiking in a recurrent network [34]. The transmission delay of the EPSP to the soma and that of the backpropagating action potential subtract from the delay we need for shifted STDP. For distal synapses where these delays are longer, there may be a higher probability that the causal bump falls out of the depression domain caused by the shift. This might be a mechanism for counterbalancing the attenuation of the EPSPs arising from distal dendrites [35], [36] along with other proposed mechanisms [37], [38]. It may explain the enhancement of LTD reported in studies of STDP at distal sites [21], [39], [40]. If the delay becomes longer than the shift for very distal synapses, other mechanisms such as limits on synaptic strength must serve to stabilize STDP. Finally, if the speed of backpropagating action potential can be increased through modification of voltage-dependent conductances, the model predicts that synapses should be more readily depressed.
The most direct test of the shifted STDP hypothesis would be to observe the effect of almost synchronous pre- and postsynaptic spikes on synaptic strength. However, the results of such experiments could be difficult to interpret because of confounding factors such as the physiological delays mentioned above. For example, if the pre- and postsynaptic spikes are induced exactly at the same time, the timing of their arrival at the synapse is not necessarily synchronous. If a shift in the STDP window function acts as a stabilizing mechanism, synapses should get depressed when postsynaptic spikes are generated by presynaptic spikes with short latency. Therefore, as an alternative experiment we suggest inducing spikes only in the presynaptic neuron and allowing the postsynaptic firing to be affected by this presynaptic activity. One possible way to perform such an experiment is to hold the voltage of the postsynaptic neuron close to its firing threshold, so that individual EPSPs can induce a postsynaptic spike. In this case, if there is a stabilizing shift in the STDP window, strong synapses that induce short-latency postsynaptic action potentials abruptly should get depressed.
Shifted STDP results in a unimodal distribution of synaptic strengths. This finding is in agreement with the measurements of quantal synaptic currents [6], [7] and from paired recordings [8]. However, the observed distribution of peak EPSP amplitudes has a heavier tail than the gamma distribution obtained from shifted STDP (see also [36], [41]). STDP is unlikely to be the only mechanisms involved in shaping the distribution of synaptic strengths. Nevertheless, figure 4 shows that in presence of correlated input, this distribution can be quite broad. Thus, in the context of shifted STDP, a heavy-tailed distribution may be a sign of multiple correlated subgroups of input spike trains.
The synapses in the model we considered were current-based, meaning that each excitatory or inhibitory input injects a current waveform to the neuron regardless of the value of its membrane potential. We have also studied an analogous model with conductance-based synapses, and this does not qualitatively change the reported results. These results show that the outcome of competition between correlated and uncorrelated spike trains with shifted STDP depends on the firing state of the postsynaptic neuron, which can be controlled by the rate of its inhibitory inputs. This allows for a dynamic switching between anti-Hebbian and Hebbian forms of plasticity, and it might be related to the role of local inhibitory interneurons in switching the activity-dependent development of visual cortical circuits during the critical period [42]. We also showed that a shifted version of the triplet model is stable and implements both Hebbian and anti-Hebbian competitions, as in the shifted pair-based model. It is worth noting that the suppression model [22], [23] is inherently stable without any shift and shows solely anti-Hebbian competition between correlated and uncorrelated inputs [43].
In conclusion, a slightly shifted STDP window stabilizes synaptic strength, buffers firing rates, and can implement different modes of synaptic competition. The required shift may arise from properties of the NMDA receptor, or from random jitter. In light of their importance in determined the outcome of synaptic plasticity, we argue that the properties of STDP for short pairing intervals, which have not yet been clearly resolved, warrant a more detailed investigation.
Neural and synaptic models
The membrane potential of the integrate-and-fire model neuron obeys
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e116.jpg
(3)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e117.jpg is the membrane time constant, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e118.jpg is the resting potential, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e119.jpg is the excitatory input and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e120.jpg is the inhibitory input. Note that although these inputs appear as currents, they are actually measured in units of the membrane potential (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e121.jpg) because a factor of the membrane resistance has been absorbed into their definition. When the membrane potential An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e122.jpg reaches the firing threshold An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e123.jpg, the neuron fires an action potential and the membrane potential resets to the resting value. The numerical values of all parameters are given in Table 1.
Each presynaptic action potential at an excitatory or inhibitory synapse induces an abrupt jump into the corresponding synaptic input (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e124.jpg or An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e125.jpg), which decays exponentially afterwards. The time course of the synaptic inputs can thus be expressed as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e126.jpg
(4)
Here, the first sums run over all excitatory (inhibitory) synapses (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e127.jpg or An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e128.jpg, respectively). The second sums run over all the presynaptic spike times An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e129.jpg, indexed by An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e130.jpg, reaching synapse An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e131.jpg before time An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e132.jpg. The synaptic time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e133.jpg is taken to be the same for excitatory and inhibitory synapses. The inhibitory synaptic strength An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e134.jpg is fixed and is the same for all inhibitory synapses. The excitatory synaptic strengths An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e135.jpg change due to STDP.
In all simulations, the synaptic strengths were initialized randomly from a uniform distribution over the range 1–5 mV. For each parameter regime, the simulations were run for An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e136.jpg seconds of simulated time. The steady-state nature of the synaptic strengths was established when the first, second, and third moments of the distribution, as well as the average firing rate of the neuron, remained constant.
Shifted triplet model
The triplet model [12] includes a presynaptic detector for each synapse An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e137.jpg and a single postsynaptic detector An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e138.jpg. In the absence of incoming presynaptic spikes to synapse An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e139.jpg, the value of the detector An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e140.jpg decays exponentially with the time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e141.jpg. Likewise, the value of the postsynaptic detector An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e142.jpg decreases exponentially in the absence of postsynaptic spikes with the time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e143.jpg. When a presynaptic spike reaches synapse An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e144.jpg at time An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e145.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e146.jpg is set to 1, and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e147.jpg is set to 1 if there is a postsynaptic spike at time An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e148.jpg. Formally,
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e149.jpg
(5)
For each excitatory synapse An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e150.jpg, the change in synaptic strength, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e151.jpg, induced by a pair of pre- and postsynaptic action potentials with time difference An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e152.jpg is determined by
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e153.jpg
(6)
The infinitesimally small parameter An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e154.jpg ensures that the values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e155.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e156.jpg before their update by the immediate pre- or postsynaptic spikes are used.
Correlated spike trains
To study synaptic competition, half of the excitatory input spike trains were correlated. To generate Poisson spike trains with homogeneous pairwise (zero-lag) correlations, we used the method developed by Kuhn et al [44]. First, a “generating” Poisson spike train with rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e157.jpg was produced. The correlated spike trains were then obtained by thinning the generating spike train, i.e. by randomly deleting spikes with probability An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e158.jpg. The resulting spike trains all have rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e159.jpg, with each pair having the correlation coefficient An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e160.jpg. To introduce a non-zero lag to the spike trains, a random value drawn from an exponential distribution is added to each spike time. The mean of the exponential distribution is the correlation time constant.
Derivation of the steady-state distribution of weights
The evolution of the distribution of synaptic strengths is described by the Fokker-Planck equation [14][16].
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e161.jpg
(7)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e162.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e163.jpg are drift and diffusion terms, respectively. To derive equilibrium distributions of synaptic strengths, we need the steady-state solution, obtained by setting the right side of equation 7 to zero. Solving the resulting ordinary differential equation for An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e164.jpg, we obtain
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e165.jpg
(8)
where, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e166.jpg is a normalization constant.
The terms An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e167.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e168.jpg can be written as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e169.jpg
(9)
Here, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e170.jpg is the probability density of a synaptic modification that changes the strength of a given synapse from An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e171.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e172.jpg.
When the synaptic strengths are changing due to STDP, the only relevant stochastic variable is the interval between the pre- and postsynaptic spike pairs. If a pairing of pre- and postsynaptic spikes occurs with interval An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e173.jpg, then An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e174.jpg, where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e175.jpg is the STDP window function (equation 1). To simplify the notation, we use An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e176.jpg to denote An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e177.jpg in the following equations. If the probability density of a pairing interval An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e178.jpg is An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e179.jpg, then the transitional probability density can be written as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e180.jpg
(10)
With the transformations An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e181.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e182.jpg, the terms An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e183.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e184.jpg can be re-expressed as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e185.jpg
(11)
Thus, to determine An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e186.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e187.jpg in terms of the parameters of the model, we only need to know the probability density of pairing intervals An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e188.jpg.
We approximate the spiking behavior of the integrate-and-fire neuron by that of a linear Poisson neuron firing at the same rate [11], [15]. We first consider the case that the presynaptic spike follows the postsynaptic spike (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e189.jpg). In this case, the timing of the presynaptic spike has no causal effect on the postsynaptic spike time. If we assume that both the presynaptic and postsynaptic spike trains are Poisson, the probability density of nearest-neighbor pairing intervals is
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e190.jpg
(12)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e191.jpg is the sum of the excitatory presynaptic firing rate (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e192.jpg) and the steady-state postsynaptic firing rate (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e193.jpg). For an integrate-and-fire neuron, the steady-state firing rate can be approximated as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e194.jpg
(13)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e195.jpg is the mean of the excitatory synaptic strengths. Now consider the case in which the postsynaptic spike follows a presynaptic spike (An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e196.jpg). In this case, the arrival of the presynaptic spike increases the postsynaptic firing rate transiently. For an integrate-and-fire neuron, the instantaneous firing rate upon arrival of a presynaptic spike can be approximated as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e197.jpg
(14)
where An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e198.jpg is the strength of the synapse at which the presynaptic spike arrived. The second term in equation 14 accounts for the correlation between pre- and postsynaptic spikes as calculated by Gütig et al [11] for a linear Poisson neuron, except that we have a synaptic time constant An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e199.jpg. If we assume that both the presynaptic and postsynaptic spike trains are Poisson, the probability density of pairing intervals is
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e200.jpg
(15)
If we assume that An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e201.jpg, we can Taylor expand equation 15 to first order in An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e202.jpg and, together with equation 14, the probability density of pairing intervals can be expressed as (see figure 1C & D)
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e203.jpg
(16)
Note that the second term in equation 16 for An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e204.jpg corresponds to the causal bump in figure 1C & D. The shape of the causal bump resembles that calculated by Cateau & Fukai [16] from the equation for the first passage time of a noisy integrate-and-fire neuron.
If we substitute 16 into equation 9, we obtain An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e205.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e206.jpg in terms of the parameters of the model. Because An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e207.jpg is linear in An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e208.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e209.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e210.jpg are also linear and can be written as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e211.jpg
(17)
Assuming that An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e212.jpg, these coefficients can be written as
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e213.jpg
(18)
Finally, by inserting equations 17 into equation 8, we obtain the steady-state distribution
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e214.jpg
(19)
with
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e215.jpg
(20)
Equation 19 is the same as equation 2 of the Results.
For the above distribution 19 to be normalizable, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e216.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e217.jpg must be positive. Equations 20 indicate that these conditions are met if An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e218.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e219.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e220.jpg, as given by equations 18, are all positive and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e221.jpg is negative. Provided that An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e222.jpg is less than of order An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e223.jpg (which it always is at steady-state), An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e224.jpg if An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e225.jpg is sufficiently greater than An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e226.jpg, which is the condition stated in the text. Over the range we consider, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e227.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e228.jpg without requiring any further conditions. When An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e229.jpg is greater than of order An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e230.jpg, which it is at steady state, An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e231.jpg, so stability is achieved.
If An external file that holds a picture, illustration, etc.
Object name is pcbi.1000961.e232.jpg is positive, the mean synaptic strength is approximately
A mathematical equation, expression, or formula.
 Object name is pcbi.1000961.e233.jpg
(21)
Solving the above equation simultaneously with equation 13, gives the steady-state firing rate of the neuron, as depicted in figure 3 (inset). Having solved for the steady-state postsynaptic firing rate and the mean synaptic strength, the parameters of the distribution (equation 2) are fully expressed in terms of the model parameters.
Acknowledgments
We thank Steve Siegelbaum for helpful comments.
Footnotes
The authors have declared that no competing interests exist.
Research supported by the National Institute of Mental Health (MH-58754) and by an NIH Director's Pioneer Award, part of the NIH Roadmap for Medical Research, through grant number 5-DP1-OD114-02. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
1. Miller K. Synaptic economics: Competition and cooperation in correlation-based synaptic plasticity. Neuron. 1996;17:371–374. [PubMed]
2. Bi G, Poo M. Synaptic modification by correlated activity: Hebb's postulate revisited. Annu Rev Neurosci. 2001;24:139–166. [PubMed]
3. Caporale N, Dan Y. Spike timing-dependent plasticity: a hebbian learning rule. Annu Rev Neurosci. 2008;31:25–46. [PubMed]
4. Dan Y, Poo M. Spike timing-dependent plasticity: From synapse to perception. Physiol Rev. 2006;86:1033–1048. [PubMed]
5. Song S, Miller K, Abbott L. Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci. 2000:919–926. [PubMed]
6. Turrigiano G, Leslie K, Desai N, Rutherford L, Nelson S. Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature. 1998;391:892–895. [PubMed]
7. O'Brien R, Kamboj S, Ehlers M, Rosen K, Fischbach G, et al. Activity-dependent modulation of synaptic ampa receptor accumulation. Neuron. 1998;21:1067–1078. [PubMed]
8. Song S, Sjostrom P, Reigl M, Nelson S, Chklovskii D. Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol. 2005;3:e68. [PMC free article] [PubMed]
9. van Rossum M, Bi G, Turrigiano G. Stable hebbian learning from spike timing-dependent plasticity. J Neurosci. 2000;20:8812–8821. [PubMed]
10. Rubin J, Lee D, Sompolinsky H. Equilibrium properties of temporally asymmetric hebbian plasticity. Physical Review Letters. 2001;86:364–367. [PubMed]
11. Gütig R, Aharonov R, Rotter S, Sompolinsky H. Learning input correlations through nonlinear temporally asymmetric hebbian plasticity. J Neurosci. 2003;23:3697–3714. [PubMed]
12. Pfister J, Gerstner W. Triplets of spikes in a model of spike timing-dependent plasticity. J Neurosci. 2006;26:9673–9682. [PubMed]
13. Sjöström P, Turrigiano G, Nelson S. Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron. 2001;32:1149–1164. [PubMed]
14. Risken H. The Fokker-Planck equation. New York: Springer-Verlag; 1996.
15. Kempter R, Gerstner W, van Hemmen J. Intrinsic stabilization of output rates by spike-based hebbian learning. Neural Comput. 2001;13:2709–2741. [PubMed]
16. Cateau H, Fukai T. A stochastic method to predict the consequence of arbitrary forms of spike-timing-dependent plasticity. Neural Comput. 2003;15:597–620. [PubMed]
17. Gerstein GL, Mandelbrot B. Random walk models for the spike activity of a single neuron. Biophys J. 2006;4:41–68. [PubMed]
18. Shadlen M, Newsome W. The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci. 1998;18:3870–3896. [PubMed]
19. Troyer T, Miller K. Physiological gain leads to high isi variability in a simple model of a cortical regular spiking cell. Neural Comput. 1997;9:971–983. [PubMed]
20. Salinas E, Sejnowski T. Impact of correlated synaptic input on output firing rate and variability in simple neuronal models. J Neurosci. 2000;20:6193–6209. [PubMed]
21. Froemke R, Poo M, Dan Y. Spike-timing-dependent synaptic plasticity depends on dendritic location. Nature. 2005;434:221–225. [PubMed]
22. Froemke R, Tsay I, Raad M, Long J, Dan Y. Contribution of individual spikes in burst-induced long-term synaptic modification. J Neurophysiol. 2006;95:1620–1629. [PubMed]
23. Froemke RC, Dan Y. Spike-timing-dependent synaptic modification induced by natural spike trains. Nature. 2002;416:433–238. [PubMed]
24. Wang HX, Gerkin RC, Nauen DW, Bi GQ. Coactivation and timing-dependent integration of synaptic potentiation and depression. Nat Neurosci. 2005;8:187–193. [PubMed]
25. Bienenstock E, Cooper L, Munro P. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci. 1982;2:32–48. [PubMed]
26. Sjöström P, Turrigiano G, Nelson S. Neocortical ltd via coincident activation of presynaptic nmda and cannabinoid receptors. Neuron. 2003;39:641–654. [PubMed]
27. Bender V, Bender K, Brasier D, Feldman D. Two coincidence detectors for spike timing-dependent plasticity in somatosensory cortex. J Neurosci. 2006;26:4166. [PMC free article] [PubMed]
28. Malenka R, Bear M. Ltp and ltd:: An embarrassment of riches. Neuron. 2004;44:5–21. [PubMed]
29. Nowak L, Bregestovski P, Ascher P, Herbet A, Prochiantz A. Magnesium gates glutamate-activated channels in mouse central neurones. Nature. 1984;307:462–465. [PubMed]
30. Jahr C, Stevens C. A quantitative description of nmda receptor-channel kinetic behavior. J Neurosci. 1990;10:1830–1837. [PubMed]
31. Destexhe A, Mainen Z, Sejnowski T. Synthesis of models for excitable membranes, synaptic transmission and neuromodulation using a common kinetic formalism. J Comput Neurosci. 1994;1:195–230. [PubMed]
32. Shouval H, Bear M, Cooper L. A unified model of nmda receptor-dependent bidirectional synaptic plasticity. Proc Natl Acad Sci U S A. 2002;99:10831–10836. [PubMed]
33. Karmarkar UR, Najarian MT, Buonomano DV. Mechanisms and significance of spike-timing dependent plasticity. Biol Cybern. 2002;87:373–382. [PubMed]
34. Lubenov E, Siapas A. Decoupling through synchrony in neuronal circuits with propagation delays. Neuron. 2008;58:118–131. [PubMed]
35. Magee J, Cook E. Somatic epsp amplitude is independent of synapse location in hippocampal pyramidal neurons. Nat Neurosci. 2000;3:895–903. [PubMed]
36. Andrasfalvy B, Magee J. Distance-dependent increase in ampa receptor number in the dendrites of adult hippocampal ca1 pyramidal neurons. J Neurosci. 2001;21:9151–9159. [PubMed]
37. Rumsey C, Abbott L. Equalization of synaptic efficacy by activity-and timing-dependent synaptic plasticity. J Neurophysiol. 2004;91:2273–2280. [PubMed]
38. Gidon A, Segev I. Spike-timing-dependent synaptic plasticity and synaptic democracy in dendrites. J Neurophysiol. 2009;101:3226–3234. [PubMed]
39. Sjöström P, Häusser M. A cooperative switch determines the sign of synaptic plasticity in distal dendrites of neocortical pyramidal neurons. Neuron. 2006;51:227–238. [PubMed]
40. Letzkus JJ, Kampa BM, Stuart GJ. Learning rules for spike timing-dependent plasticity depend on dendritic synapse location. J Neurosci. 2006;26:10420–10429. [PubMed]
41. Katz Y, Menon V, Nicholson DA, Geinisman Y, Kath WL, et al. Synapse distribution suggests a two-stage model of dendritic integration in ca1 pyramidal neurons. Neuron. 2009;63:171–177. [PMC free article] [PubMed]
42. Hensch T. Critical period plasticity in local cortical circuits. Nat Rev Neurosci. 2005;6:877–888. [PubMed]
43. Babadi B, Abbott LF. Stability and competition in multi-spike models of spike-timing dependent plasticity. 2010. Computational and Systems Neuroscience meeting (Cosyne 2010) abstract, Salt Lake City, Utah.
44. Kuhn A, Aertsen A, Rotter S. Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput. 2003;15:67–101. [PubMed]
Articles from PLoS Computational Biology are provided here courtesy of
Public Library of Science