PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Curr Opin Behav Sci. Author manuscript; available in PMC 2017 April 1.
Published in final edited form as:
PMCID: PMC4772165
NIHMSID: NIHMS761349

Timing in the visual cortex and its investigation

Abstract

While many high-level cortical areas have been implicated in timing, timing activity has also been observed even in the earliest cortical stages of the visual system over the past decade. This activity has been formally modeled as one arising from a reinforcement signal, leading to testable hypotheses with recent experimental support, demonstrating the necessity and sufficiency of that reinforcement signal. As observed in other cortical areas implicated in timing, interval timing activity within the visual cortex abides by the temporal scalar property. Finally, perturbations of the visual cortex during interval timing results in lawful shifts in timing. These and related observations advance the notion that visual cortex is a substrate for learning and expressing visually-associated temporal expectations governing behaviorally-relevant actions.

Introduction

An understanding of how the brain apprehends the passage of time, remembers relevant intervals, and produces those intervals to inform appropriately timed actions remains elusive despite much progress towards this goal, as reviewed within this issue, at the experimental, computational, and theoretical levels [14]. While it is recognized that any time varying neural process could in principle serve to mark the passage of time [5], one of the fundamental challenges faced by experimenters is in distinguishing between neural activity arising from any ongoing process from that which is truly used as a timing signal. Below we identify a number of qualities observable experimentally that increase the likelihood that a neural pattern of activity in visual cortex―and in cortex generally―is an expression of how the brain apprehends, remembers, and produces temporal intervals; namely, a 1) Phenomenological description of activity subtending and/or marking the expiry of the interval to be timed, 2) Dissociation between putative neural- and behavioral-timing activity, 3) Formalization of how, in principle, such neural timing may arise, 4) Manipulation of the biological instantiation of that theorized process, 5) Localization of that process to the area of interest, 6) generation of neural activity that can give rise to the Temporal Scalar Property, and 7) a causal demonstration of the Behavioral relevance of that neural activity (see Figure 1). Using reports of cued-interval timing in the visual cortex and its mechanistic investigation as a vehicle, we identify general challenges to, and potential approaches for, identifying and understanding the genesis of cortical timing signals.

Figure 1
Six criteria for establishing a brain region’s role in informing timing

Phenomenological report of interval timing and dissociation of neural/behavioral activity

Identifying candidate interval timing signals in cortex begins with phenomenological reports of neural activity that modulate predictably in time in response to a cue (such as in reporting a hazard function) or subtends/demarcates the expiry of an interval of interest (such as a delay to reward). Within visual cortical areas, examples of neural activity tracking visually-cued hazard functions have been observed in modulations of single unit spiking in monkey V4 [6], gamma oscillations in monkey V1 [7], and BOLD signaling in human V1,2&3 [8]. With respect to reporting the expiry of an interval of interest, such as a delayed reward, is the report of “reward timing” in V1 of rodents, wherein pairing visual cues with subsequent reward leads to the emergence of cue-evoked neural responses that express the typical delay to reward [912]. Trials in which reward is expected but withheld can then be used to assess whether changes in neural activation at the time of expected reward is a consequence of the interval elapsing (as observed in V1), or, more trivially, as a direct response to the acquisition of reward itself. As noted, however, an abiding challenge is in distinguishing between putative timing signals and those that may arise as a consequence of actions [1315], measured or not, that are used during the report of the expiry of the interval. Therefore, the candidacy of a timing signal can be further advanced by assessing whether it can be evoked (as in the case of reward timing [11] even in the absence of producing task-relevant actions (e.g. licking for reward), or otherwise dissociating those actions from neurally encoded intervals [9, 10, 15]. The identification of candidate timing signals expressing 1) a relation to the interval of interest, 2) an insensitivity to the presence/absence of outcomes, and/or 3) an insensitivity to the actions terminating the interval, then well-motivate a computational investigation into how such neural response profiles may come about.

Formalization and Manipulation

Having characterized at the phenomenological level candidate interval timing signals, can their acquisition and expression be successfully formalized to capture key features in a parsimonious and biologically plausible way? A family of timing models propose potential solutions to how, in principle, a network could learn and express temporal intervals (see [16], for review). One such model describes the emergence of cued-interval timing activity observed in V1 as resulting from a process of reinforcement learning occurring within V1 itself [15, 1720]. In it, a signal conveying behavioral outcome permits recently active synapses within V1 to be modified (or, as in [19], the intrinsic excitability of single cells) so as to come to encode the cue-reward delay. Having rationalized, formally, how timing signals may emerge and be expressed in the cortex, the merit of any model can then be challenged by assessing whether its minimal assumptions are satisfied within the area of interest, and, if so, by demonstrating the necessity and sufficiency of those critical elements.

Since a signal conveying behavioral outcome is an essential provision of the model regarding reward timing in V1, what input may reasonably serve to convey such a signal, and can it be disrupted to show its necessity in learning a cued-interval? And, complementary, can such a signal be activated to show its sufficiency in establishing, neurally, the cued-interval response? As neuromodulatory systems have been widely implicated in governing synaptic plasticity and responding to behaviorally relevant events [21, 22], we conjectured that one or more such systems may convey the acquisition of reward to V1, serving as the hypothesized reinforcement signal. By selectively lesioning cholinergic innervation of V1, we demonstrated that it is indeed necessary for reward timing activity to learn novel cue-reward delays [9]. We also demonstrated that optogenetically-commandeering cholinergic basal forebrain input to V1 is sufficient to condition cued-interval timing activity in V1, mimicking that which is observed following behavioral conditioning [10]. Together, these observations advance the case that the cholinergic system serves as a reinforcement signal governing the learning in V1 of cue-reward associations and their interceding intervals.

Localization

Manipulations as that above demonstrate how a cortical area can be implicated as generating interval timing by showing how given inputs—themselves not the source of the interval—are critical to the emergence of observing timing activity within that area of interest. That the manipulations of cholinergic innervation were localized to V1 increases the likelihood that interval timing arises from processes occurring within it, rather than simply reflecting timing which might be learned elsewhere, such as described in mPFC [23], LIP [24], medial agranular cortex [25], or striatum [26], amongst others, though this may also occur. Indeed, Makino and Komiyama recently provided evidence in support of retrosplenial cortex sourcing aversively conditioned timing information to V1 [27]. In general, lesion and/or inactivation, has advanced the case that many cortical areas are involved in timing [2830], typically by assessing the impact on behavioral reports of timing. Yet definitive evidence that any area expressing timing activity can do so as a consequence of its own internal processes poses a challenge, for how can such a case be made without removing all its inputs?

Rather than lesioning an area of interest and observing a deficiency, an area of interest could be assessed in isolation as to whether it, nonetheless, is capable of generating timing activity mimicking that observed in the fully intact preparation. In this extreme, the use of in vitro preparations has done much to advance our understanding of how a given region could, in principle, learn and express time. Isolated recurrent networks have been reported to produce repeatable temporally-evolving patterns [31, 32] that could embody the passage of time [5]. Cortical networks in vitro have even been demonstrated to adapt such temporally-evolving patterns in accordance with conditioned temporal intervals [33]. With respect to interval timing in V1, it has been demonstrated in a slice preparation of V1 that stimulus-evoked responses can be conditioned by delayed cholinergic agonist application following electrical stimulation [9] to produce, in response to subsequent electrical stimulation, the conditioned interval. Together, these studies address how the dynamics of local recurrent networks can represent the passage of time, and how they can be modified to produce temporal intervals experienced by the animal.

Neural representations of time and the temporal scalar property

Should a neural process observed within an area serve to inform the perception or production of temporal intervals, the form that it takes must be reconcilable with the patterns and errors generated when estimating or producing reports of time behaviorally [3437]. In regards to errors in behavioral timing is the observation that the distribution of times produced for a given target interval proportionally scales with the magnitude of the target time, the so called Temporal Scalar Property [1, 2, 38, 39] (a strong form of Weber’s law in the temporal domain which holds, more generally, that the magnitude of timing errors are directly proportional to the magnitude of the interval to be timed). This proffers the question as to whether putative cortical representations of temporal intervals similarly express a variability that scales with the interval to report (or, if not, if some read-out process of those temporal patterns observed would so scale [40]). Scaling of neural responses with target intervals has been observed in a number of cortical regions implicated in timing, exemplified by recordings made in monkey LIP [24], prefrontal cortex[41], motor cortex[42], and in rat prefrontal cortex [23]. With regards to the visual cortex, behaviorally as well as optogenetically conditioned cue-evoked signaling of temporal intervals has been shown to exhibit a multiplicative scaling of their temporal distributions [10]. That a scalar variabiltiy observed in neural timing accords with the variability generally observed behaviorally further advances the case that cortical regions are involved in timing, as is apparently true of even the primary visual cortex.

Behavioral relevance of neural timing signals and the establishment of causality by perturbation

While any neural signature of interval timing is potentially useful as a model of the world, its biological relevance remains uncertain in the absence of ultimately relating it, phenomenologically, to some timed behavior. Further, should a brain area generate timing activity and inform timed actions, perturbations to that activity should lawfully affect the timing of those actions. For example, following the observation that neural response functions within mPFC scaled to target intervals (noted above), Xu and colleagues proceeded to demonstrate that cooling mPFC resulted in a delay in the timing of the behavior of the animal, consistent with mPFC informing upon those timed actions [23]. Similarly, perturbations to visual cortical areas have advanced the case that they contribute to the perception and generation of temporal intervals, apart from their recognized roles in image processing. For instance, transcranial magnetic stimulation (TMS) of V5 has been demonstrated to affect discrimination of the duration of visual targets [43] and to shift the timing of response to intercept moving targets [44]. Subsequent work from the Bueti laboratory demonstrated that TMS of not only V5/MT, but also of V1, affects the apprehension and memory of experienced visually-cued intervals [45].

With respect to reward timing activity observed in V1 in the spiking activity of single neurons, a general critique has been that its biological relevance is uncertain in the absence of relating it to timed behavior on a trial-to-trial basis, as has been demonstrated in other cortical areas [23, 41, 42]. These observations motivated us to address whether visually-evoked signals informing timed actions may also be observed within V1 when timed actions following a visual cue are required of the animal [15]. Under these conditions, while reward timing (the reporting of the average time of expected reward) continues to be observed, another population of V1 neurons is observed to express the interval to the timed action on a per trial basis, as if informing the animal when the target interval has expired (“action timing responses”). Importantly, this correlation is present only on trials in which the animal is using the visual cues to time the response (visually-timed trials), and not on those trials in which those cues are not being used to time the response (non-visually-timed trials). To test the hypothesis that such activity may inform the animal as to when the target interval has expired, we optogenetically perturbed V1 activity for a brief period during the interval between the visual cue and the behavioral report of the interval, and assessed its effect on the timing of the behavioral report. Perturbing activity in V1 during the interceding interval consistently shifted the timing behavior of animals within an experimental session. Further, this shift was present only on visually-timed trials and not on non-visually-timed trials, even though both trial types contain the exact same visual stimulus, laser and action [15]. Collectively, these observations indicate that V1 is a site that expresses interval timing activity that informs behavioral timing.

Summary

Predicting outcomes, evaluating options, and producing timed actions that are behavioral beneficial requires an ability to apprehend, remember, and produce temporal intervals. This collection of reviews comprehensively synthesizes current advances in the experimental, computational, and theoretical investigation of timing in the brain, focusing on those brain areas with the preponderance of evidence in support of their roles in timing. Here we advance the case that even early visual cortical areas may be involved in these temporal processes, beyond their recognized role in responding to the features of visual inputs. The observations reviewed here collectively satisfy a broad set of criteria (see figure 1) for establishing an area as expressing, as well as being a substrate for learning to express interval timing activity. Visual cortical areas exhibit 1) the phenomenology of timing signals that can be 2) disassociated from ongoing behaviors, and can be 3) formalized conceptually with models that have garnered experimental support by 4) manipulating critical components. Visual cortex is also demonstrated to possess minimal requirements for it to 5) locally generate timing signals. As with other areas implicated in timing, visual cortical areas can exhibit timing responses that accord with the 6) Temporal Scalar Property, furthering the case that such activity is of 7) behavioral relevance, as directly tested by perturbing these areas and observing effects of visually-cued timing behavior. Future goals in assessing the role of visual cortical areas in timing will be to make a reckoning of why subjective time takes the form it does [46], and how various sources of noise are contended with and shape those processes [36].

Highlights

Visual cortical areas are implicated in interval timing

Timing activity within visual cortex can be formally rationalized

Necessity and sufficiency of essential components of a timing model are demonstrated

Neural reports within visual cortex abide by the temporal scalar property

Perturbations implicate visual cortex in informing timed actions

Acknowledgments

This work was funded by NIMH (R01 MH093665) to M.G.H.S.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Disclosures

Nothing declared.

References

1. Matell MS, Meck WH. Neuropsychological mechanisms of interval timing behavior. BioEssays. 2000;22:94–103. [PubMed]
2. Buhusi CV, Meck WH. What makes us tick? Functional and neural mechanisms of interval timing. Nat Rev Neurosci. 2005;6:755–765. [PubMed]
3. Coull J, Nobre A. Dissociating explicit timing from temporal expectation with fMRI. Curr Opin Neurobiol. 2008;18:137–144. [PubMed]
4. Namboodiri V, Mihalas S, Hussain Shuler M. Rationalizing decision-making: Understanding the cost and perception of time. Timing Time Percept Rev. 2014;1(4)
5. Goel A, Buonomano DV. Timing as an intrinsic property of neural networks: Evidence from in vivo and in vitro experiments. Philos Trans R Soc Lond B Biol Sci. 2014;369:20120460. [PMC free article] [PubMed]
6. Ghose GM, Maunsell JH. Attentional modulation in visual cortex depends on task timing. Nature. 2002;419:616–620. [PubMed]
7. Lima B, Singer W, Neuenschwander S. Gamma responses correlate with temporal expectation in monkey primary visual cortex. J Neurosci. 2011;31:15919–15931. [PubMed]
8. Bueti D, Bahrami B, Walsh V, Rees G. Encoding of temporal probabilities in the human brain. J. Neurosci. 2010;30:4343–4352. [PubMed]
9. Chubykin AA, Roach EB, Bear MF, Shuler MG. A cholinergic mechanism for reward timing within primary visual cortex. Neuron. 2013;77:723–735. [PubMed] *[9]: Selective lesion, in vivo, of cholinergic basal forebrain innervation of V1 demonstrates that it is necessary for the acquisition, but not the expression, of reward timing in V1. In vitro, stimulus-evoked timing activity can be conditioned by delayed muscarinic receptor activation, implicating acetylcholine as a reinforcement signal engendering cued-interval timing locally within V1.
10. Liu CH, Coleman JE, Davoudi H, Zhang K, Hussain Shuler MG. Selective activation of a putative reinforcement signal conditions cued interval timing in primary visual cortex. Curr Biol. 2015;25:1551–1561. [PubMed] **[10]: By optogenetically-hijacking basal forebrain innervation of V1, generally, and cholinergic innervation of V1, specifically, visually-cued interval timing activity can be engendered within V1, demonstrating sufficiency as the hypothesized reinforcement signal. Optogenetically-conditioned responses, like behaviorally-conditioned responses, are also shown to exhibit a multiplicative scaling, thereby according with the temporal scalar property, implicating this activity in informing visually-cued timed actions.
11. Shuler MG, Bear MF. Reward timing in the primary visual cortex. Science. 2006;311:1606–1609. [PubMed]
12. Zold CL, Hussain Shuler MG. Theta oscillations in visual cortex emerge with experience to convey expected reward time and experienced reward rate. J Neurosci. 2015;35:9603–9614. [PMC free article] [PubMed]
13. Niell CM, Stryker MP. Modulation of visual responses by behavioral state in mouse visual cortex. Neuron. 2010;65:472–479. [PMC free article] [PubMed]
14. Kim J, Ghim JW, Lee JH, Jung MW. Neural correlates of interval timing in rodent prefrontal cortex. J Neurosci. 2013;33:13834–13847. [PubMed]
15. Namboodiri VM, Huertas MA, Monk KJ, Shouval HZ, Hussain Shuler MG. Visually cued action timing in the primary visual cortex. Neuron. 2015;86:319–330. [PubMed] **[15]: This paper advances the case that visually-evoked timing activity in V1 informs upon the timing of actions by demonstrating that it co-varies with visually-timed actions on a trial-by-trial basis, and that perturbing V1 during the timed interval lawfully shifts the timing of actions. These shifts in timing can be rationalized in accordance with a formal model of V1 that produces timed actions from having learned to express reward timing activity.
16. Hass J, Durstewitz D. Neurocomputational models of time perception. Adv Exp Med Biol. 2014;829:49–71. [PubMed]
17. Gavornik JP, Shuler MG, Loewenstein Y, Bear MF, Shouval HZ. Learning reward timing in cortex through reward dependent expression of synaptic plasticity. Proc Natl Acad Sci U S A. 2009;106:6826–6831. [PubMed]
18. Gavornik JP, Shouval HZ. A network of spiking neurons that can represent interval timing: mean field analysis. J Comput Neurosci. 2011;30:501–513. [PMC free article] [PubMed]
19. Shouval HZ, Gavornik JP. A single spiking neuron that can represent interval timing: analysis, plasticity and multi-stability. J Comput Neurosci. 2011;30:488–499. [PubMed]
20. Huertas MA, Hussain Shuler MG, Shouval HZ. A simple network architecture accounts for diverse reward time responses in primary visual cortex. J Neurosci. 2015;35:12659–12672. [PubMed] *[20]: Elaborating on prior computational modeling, this work provides a formal solution as to how, in principle, visual cortex may come to express the variety of visually-cued interval timing responses observed experimentally through the use of simple learning and network connectivity rules.
21. Hangya B, Ranade SP, Lorenc M, Kepecs A. Central cholinergic neurons are rapidly recruited by reinforcement feedback. Cell. 2015;162:1155–1168. [PMC free article] [PubMed]
22. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol. 1998;80:1–27. [PubMed]
23. Xu M, Zhang SY, Dan Y, Poo MM. Representation of interval timing by temporally scalable firing patterns in rat prefrontal cortex. Proc Natl Acad Sci U S A. 2013;111:480–485. [PubMed]
24. Leon MI, Shadlen MN. Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron. 2003;38:317–327. [PubMed]
25. Matell MS, Shea-Brown E, Gooch C, Wilson AG, Rinzel J. A heterogeneous population code for elapsed time in rat medial agranular cortex. Behav Neurosci. 2011;125:54–73. [PMC free article] [PubMed]
26. Matell MS, Meck WH, Nicolelis MA. Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. Behav Neurosci. 2003;117:760–773. [PubMed]
27. Makino H, Komiyama T. Learning enhances the relative impact of top-down processing in the visual cortex. Nat Neurosci. 2015;18:1116–1122. [PubMed] **[27]: By reversibly inactivating retrosplenial cortex while functionally imaging Ca2+ in V1 neuronal populations, Makino and Komiyama recently provided evidence that retrosplenial cortex may source aversively conditioned interval-timing information to V1. Following RSC inactivation, V1 reverts to uniformly representing the passage of time during stimulus presentation, as observed in the naïve state.
28. Harrington DL, Haaland KY, Knight RT. Cortical networks underlying mechanisms of time perception. J Neurosci. 1998;18:1085–1095. [PubMed]
29. Meck WH. Neuroanatomical localization of an internal clock: A functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems. Brain Res. 2006;1109:93–107. [PubMed]
30. Narayanan NS, Horst NK, Laubach M. Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus. Neuroscience. 2006;139:865–876. [PubMed]
31. MacLean JN, Watson BO, Aaron GB, Yuste R. Internal dynamics determine the cortical response to thalamic stimulation. Neuron. 2005;48:811–823. [PubMed]
32. Luczak A, Maclean JN. Default activity patterns at the neocortical microcircuit level. Front Integr Neurosci. 2012;6:30. [PMC free article] [PubMed]
33. Johnson HA, Goel A, Buonomano DV. Neural dynamics of in vitro cortical networks reflects experienced temporal patterns. Nat Neurosci. 2010;13:917–919. [PMC free article] [PubMed]
34. Simen P, Balci F, de Souza L, Cohen JD, Holmes P. A model of interval timing by neural integration. J Neurosci. 2011;31:9238–9253. [PMC free article] [PubMed]
35. Reutimann J, Yakovlev V, Fusi S, Senn W. Climbing neuronal activity as an event-based cortical representation of time. J Neurosci. 2004;24:3295–3303. [PubMed]
36. Namboodiri VM, Mihalas S, Hussain Shuler MG. Analytical calculation of errors in time and value perception due to a subjective time accumulator: A mechanistic model and the generation of Weber's law. Neural Computation. 2016;28(1):89–117. [PubMed]
37. Shouval HZ, Hussain Shuler MG, Agarwal A, Gavornik JP. What does scalar timing tell us about neural dynamics? Front Hum Neurosci. 2014;8:438. [PMC free article] [PubMed]
38. Gibbon J. Scalar expectancy-theory and Webers law in animal timing. Psychol Rev. 1977;84:279–325.
39. Gibbon J, Church RM, Meck WH. Scalar timing in memory. Ann N Y Acad Sci. 1984;423:52–77. [PubMed]
40. Killeen PR, Fetterman JG. A behavioral theory of timing. Psychol Rev. 1988;95:274–295. [PubMed]
41. Brody CD, Hernandez A, Zainos A, Romo R. Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cereb Cortex. 2003;13:1196–1207. [PubMed]
42. Renoult L, Roux S, Riehle A. Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimation. Eur J Neurosci. 2006;23:3098–3108. [PubMed]
43. Bueti D, Bahrami B, Walsh V. Sensory and association cortex in time perception. J Cogn Neurosci. 2008;20:1054–1062. [PubMed]
44. Bosco G, Carrozzo M, Lacquaniti F. Contributions of the human temporoparietal junction and MT/V5+ to the timing of interception revealed by transcranial magnetic stimulation. J Neurosci. 2008;28:12071–12084. [PubMed]
45. Salvioni P, Murray MM, Kalmbach L, Bueti D. How the visual brain encodes and keeps track of time. J Neurosci. 2013;33:12423–12429. [PubMed] **[45]: By disrupting V1 activity during and following the lapse of a visually-cued interval, Salvioni et al., were the first to casually determine that V1—apart from its role in processing features of the visual world—contributes to time perception.
46. Namboodiri VMK, Mihalas S, Marton T, Hussain Shuler MG. A general theory of intertemporal decision-making and the perception of time. Front Behav Neurosci. 2014;8:61. [PMC free article] [PubMed]