PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
 
Curr Biol. 2010 April 27; 20(8-6): 757–762.
PMCID: PMC2861164

A Bayesian Model of Perceived Head-Centered Velocity during Smooth Pursuit Eye Movement

Summary

During smooth pursuit eye movement, observers often misperceive velocity. Pursued stimuli appear slower (Aubert-Fleishl phenomenon [1, 2]), stationary objects appear to move (Filehne illusion [3]), the perceived direction of moving objects is distorted (trajectory misperception [4]), and self-motion veers away from its true path (e.g., the slalom illusion [5]). Each illusion demonstrates that eye speed is underestimated with respect to image speed, a finding that has been taken as evidence of early sensory signals that differ in accuracy [4, 6–11]. Here we present an alternative Bayesian account, based on the idea that perceptual estimates are increasingly influenced by prior expectations as signals become more uncertain [12–15]. We show that the speeds of pursued stimuli are more difficult to discriminate than fixated stimuli. Observers are therefore less certain about motion signals encoding the speed of pursued stimuli, a finding we use to quantify the Aubert-Fleischl phenomenon based on the assumption that the prior for motion is centered on zero [16–20]. In doing so, we reveal an important property currently overlooked by Bayesian models of motion perception. Two Bayes estimates are needed at a relatively early stage in processing, one for pursued targets and one for image motion.

Keywords: SYSNEURO

Highlights

► Pursuit-based velocity illusions can be explained by Bayesian inference ► Speed discrimination is worse when stimuli are pursued by eye ► Separate (and early) Bayes estimates are needed for pursued targets and image motion

Results

Figure 1A demonstrates a consistent finding across a number of studies that eye velocity is often underestimated with respect to image velocity. This finding could reflect differences in the accuracy of underlying motion signals, especially given that sensory information encoding eye speed is likely to be based on motor commands [21] in the situations described in the figure. However, differences in accuracy imply a visual system that has failed to remove systematic errors between early sensory signals, despite evidence that adaptation and calibration lie at the heart of most visual function [22]. The alternative view is that sensory evidence is unbiased (i.e., accurate) but can vary in uncertainty (i.e., precision). In a Bayesian framework, the uncertain sensory evidence is combined with prior expectations about particular properties of the world [12–14]. For motion perception, a plausible prior is that objects are largely at rest [16–20]. The prior is therefore centered on 0, in which case perceived speed decreases as uncertainty rises (Figure 1B). To investigate whether this idea could account for the illusions described in Figure 1A, we measured thresholds for discriminating the speed of pursued and fixated stimuli. At the same time we also measured the size of the Aubert-Fleischl phenomenon in order to see whether the discrimination data could predict the underestimation of eye speed.

Figure 1
Pursuit-Based Velocity Illusions and Bayesian Inference

In the main experiment, observers judged which of two stimulus intervals (Figure 2A) appeared faster over a series of trials. Fixation intervals (F) consisted of a moving stimulus and a stationary fixation target. The stimulus moved behind a static circular window to ensure that approximately the same region of retina was stimulated during fixation and pursuit. Eye pursuit intervals (E) consisted of the target, window, and stimulus all moving together. The two types of interval were combined in three different ways. Discrimination trials contained F-F or E-E intervals. These two types of trial therefore allowed us to evaluate the precision of signals accompanying fixated and pursued stimuli, respectively. Perceived-speed trials contained E-F or F-E intervals. Trials of this third type allowed us to quantify the size of the Aubert-Fleischl phenomenon because they determined the relative difference in perceived speed between fixated and pursued stimuli.

Figure 2
Methods and Main Results

Figure 2B shows the results of the experiment (symbols) and the model fitting (lines). Each row corresponds to one of the five observers who took part. The discrimination data in the left column show that thresholds were higher for pursued stimuli, meaning that the speed of pursued stimuli was harder to discriminate than the speed of fixated stimuli. Observers were therefore less certain about the sensory evidence defining pursued stimuli, and so their judgments were less precise. The poorer discrimination could have potentially been due to the absence of relative motion, because unlike the fixation intervals, the dot pattern, target, and window all moved together in the pursuit intervals. However, relative motion only influences thresholds at slow speeds [23, 24], a finding we confirmed in a control experiment reported in Figure S1 available online. We therefore conclude that the presence or absence of eye movement is paramount in driving the differences in precision.

According to a Bayesian explanation, greater thresholds during pursuit mean that pursued stimuli should appear slower than fixated stimuli because of the greater influence of the zero-motion prior (Figure 1B). Analysis of E-F and F-E trials supported this prediction (Figure 2B, right column). For all observers, fixated motion needed to be slowed by around 50% to achieve the perceived-speed match. Moreover, the accuracy of eye movements during fixation or pursuit could not explain the data (Figure 2C). The results therefore provide excellent qualitative agreement with the requirements of a Bayesian explanation.

Model

To determine the extent to which the discrimination data predicts the perceived-speed data, we implemented the Bayesian model shown in Figure 3 (see Supplemental Experimental Procedures for details). The model is designed to account for the type of perceptual errors represented by the four illusions identified in Figure 1A. It therefore recovers perceived motion with respect to the head (as opposed to motion with respect to the scene; see [25]). In keeping with the consistency between illusions, the model does not differentiate between how image motion and eye motion are arranged in time. It therefore does not care whether the two motion types are compared consecutively (the Aubert-Fleischl phenomenon) or simultaneously (the Filehne illusion, trajectory misperception, slalom illusion).

Figure 3
Schematic of the Bayesian Model

The model differs from traditional accounts of head-centered motion perception in two important ways. First, it treats motion measurements and motion estimates separately. In comparison, traditional accounts assume that motion estimates are based on sensory signals alone. Second, it emphasizes the role of relative image motion (between background object and target) and pursuit target motion. Traditional accounts emphasize absolute retinal motion and eye velocity. The eye movements were extremely accurate in our experiments, so relative motion was approximately equal to absolute image motion, and target motion was equal to eye velocity. But not all observers do so well—for instance, pursuit slows by around 10%–20% between 20 and 60+ years of age [26]. The model is therefore designed to account for situations in which pursuit is inaccurate and imprecise (see Discussion).

The model consists of a measurement stage (Figure 3, bottom left) and an estimation stage (Figure 3, top left). The measurement stage contains separate internal noise sources, one for relative motion (R) and one for pursuit target motion (T). The standard deviation of the internal noise was defined as σ(v) = avb + c (see [27, 28] and Supplemental Experimental Procedures). The estimation stage implements separate Bayes estimators for R and T via the same principle described earlier in Figure 1B. The model assumes two priors, both centered on a speed of 0. The priors represent the observer's expectations about target motion and relative motion. They are both based on the assumption that objects tend to be at rest. In the absence of reliable sensory information, the observer expects target objects to not move and hence for there to be no relative motion between one object (the target) and another.

The inputs to the estimation stage (the sensory measurements Rm and Tm) vary over intervals and trials as a result of internal noise. Hence, the Bayes estimates R′ and T′ vary as well, as does their sum H′, which yields the observer's estimate of head-centered motion. For a two-interval task, two distributions of H′ are produced, one for each interval (Figure 3, right). Straightforward application of signal detection theory links the model to data. It does so by combining the two intervals into a single “decision” variable. The probability of choosing one interval over the other can then be determined. For discrimination, the two intervals consist of image motion or eye motion (plus the small contribution of the noise term “c” when the input is 0). For the perceived-speed condition, the decision variable combines the two different types of motion. The combination is therefore independent of temporal order, reiterating the fact that how the different types of motion are arranged in time does not matter to the model.

Figure 2B shows that thresholds were approximately constant for faster speeds when expressed as a proportion of the standard. This is known as Weber's law and is thought to reflect an early nonlinearity in the coding of speed, combined with fixed internal noise (i.e., noise independent of speed) [17, 29, 30]. However, as analogous work on contrast discrimination has shown [31, 32], similar results can be obtained if an early nonlinearity is combined with variable noise, a point we confirmed in earlier implementations of our model. Our data also show that Weber's law breaks down at slow speeds, a finding well known for image-motion processing [33] and one that our results now extend to pursued stimuli. To account for this latter behavior, the early nonlinearity can be augmented in a number of ways (see [17] for an example). However, from a Bayesian perspective, it turns out that early nonlinearities may not be necessary. Using a combination of variable internal noise and a zero-motion prior, we were able to reproduce the thresholds we found very well, as can be seen by comparing the model and data in Figure 2B. Indeed, invoking early nonlinearities presents problems for Bayesian accounts of head-centered motion perception. If different nonlinearities for R and T were used, the Bayes estimation stage is unnecessary—changes in velocity estimates would be captured by differences in signal accuracy that result from the separate nonlinearities at the measurement stage (see [6, 8] for demonstration). The alternative is to enforce identical nonlinearities. But this is unlikely, given that the measurements of image motion and eye velocity are based on different types of motion signal.

The second way in which the model differs from previous Bayesian accounts of motion perception is the use of two estimators based on separate likelihoods for R and T. An alternative is to sum signals at the measurement stage and so yield a single head-centered likelihood. However, this could never produce a Filehne illusion, assuming that the signals are unbiased. When smooth pursuit is made over a stationary background, observers typically report that the background appears to move against the eye movement. In this situation, pursuit produces equal and opposite motion in the image (Figure 4A). Hence, the sum of unbiased measurements of eye motion (Tm) and image motion (Rm) must be centered on 0. Importantly, the sum defines the location of the putative head-centered likelihood. Given that the prior is also centered on 0, the posterior distribution defining the observer's estimate must be, too, so no Filehne illusion can result. Similar reasoning shows why trajectory misperception cannot occur (Figure 4B). Of course, one way to fix this alternative Bayesian account is to introduce biases into the initial sensory measurements. But as discussed above, this eliminates the need for a Bayes estimation stage. We conclude that in order to account for pursuit-based velocity illusions, two Bayes estimates are needed, one for R and one for T.

Figure 4
Unbiased Sensory Measurements Cannot Lead to Pursuit-Based Velocity Illusions

For modeling purposes, we assumed that the two priors had the same standard deviation, a justifiable assumption given that both depend on the idea that objects tend to be at rest. The estimation stage therefore consisted of a single parameter (the standard deviation of the prior), whereas the measurement stage consisted of six (one set each of three internal noise parameters for R and T). The seven-parameter model was fit simultaneously to all ten psychometric functions of each observer via a maximum-likelihood technique. The lines in Figure 2B show the model's discrimination thresholds and perceived speeds. The model predicts the data extremely well. Allowing the priors to have different standard deviations would not substantially improve the fit.

Discussion

The new Bayesian model of head-centered motion perception presented here is able to explain a range of pursuit-based velocity illusions. The model is based on the idea that sensory signals encoding the speed of eye motion and image motion differ in precision, not accuracy. The model raises a number of issues that need to be considered when applying Bayes theory to motion perception. First, the model emphasizes the role of pursuit-target motion and relative motion, in part because this formulation guarantees that the priors are properties of the world. Second, the Bayes estimates must be made before information about eye motion and image motion is combined, otherwise no illusions can result. Third, separate Bayes estimates for relative motion and pursuit-target motion are required to explain these illusions. Finally, the combination of unbiased signals, variable internal noise, and a prior centered on zero is sufficient to predict the discrimination performance we found.

The Aubert-Fleischl phenomenon is known to decline as the contrast of fixated stimuli is lowered [34]. Because contrast does not affect the perceived speed of pursued stimuli, the change to the Aubert-Fleischl phenomenon must be driven solely by the lower estimates of image motion brought about by decreasing contrast. This effect is easy to capture in the model because manipulating contrast is one way of influencing the precision of image motion measurements—indeed, the effect of contrast provides the bulk of the evidence supporting Bayesian models of motion perception [17, 19, 20] (although see [35] for evidence that the relationship between perceived speed and contrast may be more complex than often described; see also [36]). At present it is unknown whether contrast influences the Filehne illusion, trajectory misperception, or slalom illusion in a similar way. It may be that variations in stimulus dimensions like contrast help explain why the degree of underestimation of eye speed varies across the studies shown in Figure 1A.

Unlike traditional accounts of head-centered motion perception, our new model emphasizes the role of relative motion and pursuit-target motion. There are good empirical reasons for doing so. Recent evidence suggests that relative motion overrides the use of absolute retinal motion during pursuit, even when trial-by-trial feedback is given on the latter [37]. Relative motion therefore appears paramount for these types of motion judgment. The use of pursuit-target motion may stem from the fact that pursuit eye movements are not always accurate and also vary over time [26, 38]. Hence, estimating target motion solely on the basis of extraretinal eye velocity information [21] would be subject to the same inaccuracies and temporal variability. These are easily offset by adding localized image motion information related to the movement of the pursuit in the image (retinal slip), an idea supported by the recent finding that discriminating the motion of pursued targets is best predicted by the combination of retinal slip and eye velocity [39] (see also evidence of cells in the medial superior temporal area that respond to eye velocity and retinal slip [40]). Indeed, the combination of slip and eye velocity may explain why the sensory measurement of pursuit-target motion is less precise than corresponding measures of relative motion. By summing eye velocity information with retinal slip, the internal noise related to pursuit-target motion originates from two disparate sources. The internal noise related to relative motion, however, derives from a single source, namely the retinal image. On many occasions, this single noise source can be reduced further by integrating over larger areas.

Acknowledgments

The authors would like to thank M. Banks, M. Georgeson, S. Rushton, P. Sumner, K. Langley, J. Solomon, and two anonymous reviewers for helpful discussion, and also T. Haarmeier for providing data for Figure 1. The research was supported by a grant from the Wellcome Trust.

Notes

Published online: April 15, 2010

Footnotes

Supplemental Information includes Supplemental Experimental Procedures, three figures, and one table and can be found with this article online at doi:10.1016/j.cub.2010.02.059.

Supplemental Information

Document S1. Supplemental Experimental Procedures, Three Figures, and One Table:

References

1. Fleischl E.V. Physiologisch-optische Notizen, 2. Mitteilung. Sitzung Wiener Bereich der Akademie der Wissenschaften. 1882;3:7–25.
2. Aubert H. Die Bewegungsempfindung. Pflugers Arch. 1886;39:347–370.
3. Filehne W. Uber das optische Wahrnehmen von Bewegungen. Zeitschrift für Sinnephysiologie. 1922;53:134–145.
4. Souman J.L., Hooge I.T.C., Wertheim A.H. Frame of reference transformations in motion perception during smooth pursuit eye movements. J. Comput. Neurosci. 2006;20:61–76. [PubMed]
5. Freeman T.C.A., Banks M.S., Crowell J.A. Extraretinal and retinal amplitude and phase errors during Filehne illusion and path perception. Percept. Psychophys. 2000;62:900–909. [PubMed]
6. Freeman T.C.A. Transducer models of head-centred motion perception. Vision Res. 2001;41:2741–2755. [PubMed]
7. Wertheim A.H. Motion perception during self-motion: The direct versus inferential controversy revisited. Behav. Brain Sci. 1994;17:293–311.
8. Turano K.A., Massof R.W. Nonlinear contribution of eye velocity to motion perception. Vision Res. 2001;41:385–395. [PubMed]
9. Beintema J.A., van den Berg A.V. Pursuit affects precision of perceived heading for small viewing apertures. Vision Res. 2001;41:2375–2391. [PubMed]
10. Perrone J.A., Krauzlis R.J. Vector subtraction using visual and extraretinal motion signals: A new look at efference copy and corollary discharge theories. J. Vis. 2008;8:1–14. [PubMed]
11. Souman J.L., Freeman T.C.A. Motion perception during sinusoidal smooth pursuit eye movements: Signal latencies and non-linearities. J. Vis. 2008;8:1–14. [PubMed]
12. Ernst M.O., Bülthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 2004;8:162–169. [PubMed]
13. MacNeilage P.R., Banks M.S., Berger D.R., Bülthoff H.H. A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Exp. Brain Res. 2007;179:263–290. [PubMed]
14. Ma W.J., Beck J.M., Latham P.E., Pouget A. Bayesian inference with probabilistic population codes. Nat. Neurosci. 2006;9:1432–1438. [PubMed]
15. Clark J.J., Yuille A.L. Kluwer Academic; Boston: 1990. Data Fusion for Sensory Information Processing Systems.
16. Welchman A.E., Lam J.M., Bülthoff H.H. Bayesian motion estimation accounts for a surprising bias in 3D vision. Proc. Natl. Acad. Sci. USA. 2008;105:12087–12092. [PubMed]
17. Stocker A.A., Simoncelli E.P. Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. 2006;9:578–585. [PubMed]
18. Weiss Y., Simoncelli E.P., Adelson E.H. Motion illusions as optimal percepts. Nat. Neurosci. 2002;5:598–604. [PubMed]
19. Hürlimann F., Kiper D.C., Carandini M. Testing the Bayesian model of perceived speed. Vision Res. 2002;42:2253–2257. [PubMed]
20. Ascher D., Grzywacz N.M. A Bayesian model for the measurement of visual velocity. Vision Res. 2000;40:3427–3434. [PubMed]
21. von Holst E. Relations between the central nervous system and the peripheral organs. Br. J. Anim. Behav. 1954;2:89–94.
22. Burge J., Ernst M.O., Banks M.S. The statistical determinants of adaptation rate in human reaching. J. Vis. 2008;8:1–19. [PMC free article] [PubMed]
23. Snowden R.J. Sensitivity to relative and absolute motion. Perception. 1992;21:563–568. [PubMed]
24. Baker C.L., Jr., Braddick O.J. Does segregation of differently moving areas depend on relative or absolute displacement? Vision Res. 1982;22:851–856. [PubMed]
25. Warren P.A., Rushton S.K. Optic flow processing for the assessment of object movement during ego movement. Curr. Biol. 2009;19:1555–1560. [PubMed]
26. Kolarik A.J., Margrain T.H., Freeman T.C.A. Precision and accuracy of ocular following: Influence of age and type of eye movement. Exp. Brain Res. 2010;201:271–282. [PubMed]
27. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 1993;10:1157–1169. [PubMed]
28. Dakin S.C., Mareschal I., Bex P.J. Local and global limitations on direction integration assessed using equivalent noise analysis. Vision Res. 2005;24:3027–3049. [PubMed]
29. Nover H., Anderson C.H., DeAngelis G.C. A logarithmic, scale-invariant representation of speed in macaque middle temporal area accounts for speed discrimination performance. J. Neurosci. 2005;25:10049–10060. [PubMed]
30. Zanker J.M. Does motion perception follow Weber's law? Perception. 1995;24:363–372. [PubMed]
31. Kontsevich L.L., Chen C.-C., Tyler C.W. Separating the effects of response nonlinearity and internal noise psychophysically. Vision Res. 2002;42:1771–1784. [PubMed]
32. Georgeson M.A., Meese T.S. Fixed or variable noise in contrast discrimination? The jury's still out. Vision Res. 2006;46:4294–4303. [PubMed]
33. De Bruyn B., Orban G.A. Human velocity and direction discrimination measured with random dot patterns. Vision Res. 1988;28:1323–1335. [PubMed]
34. Sumnall J.H., Freeman T.C.A., Snowden R.J. Optokinetic potential and the perception of head-centred speed. Vision Res. 2003;43:1709–1718. [PubMed]
35. Thompson P., Brooks K.R., Hammett S.T. Speed can go up as well as down at low contrast: Implications for models of motion perception. Vision Res. 2006;46:782–786. [PubMed]
36. Hammett S.T., Champion R.A., Thompson P.G., Morland A.B. Perceptual distortions of speed at low luminance: Evidence inconsistent with a Bayesian account of speed encoding. Vision Res. 2007;47:564–568. [PubMed]
37. Freeman T.C.A., Champion R.A., Sumnall J.H., Snowden R.J. Do we have direct access to retinal image motion during smooth pursuit eye movements? J. Vis. 2009;9:1–11. [PubMed]
38. Rasche C., Gegenfurtner K.R. Precision of speed discrimination and smooth pursuit eye movements. Vision Res. 2009;49:514–523. [PubMed]
39. Welchman A.E., Harris J.M., Brenner E. Extra-retinal signals support the estimation of 3D motion. Vision Res. 2009;49:782–789. [PubMed]
40. Ilg U.J., Schumann S., Thier P. Posterior parietal cortex neurons encode target motion in world-centered coordinates. Neuron. 2004;43:145–151. [PubMed]
41. Freeman T.C.A. Path perception and Filehne illusion compared: Model and data. Vision Res. 1999;39:2659–2667. [PubMed]
42. Haarmeier T., Thier P., Repnow M., Petersen D. False perception of motion in a patient who cannot compensate for eye movements. Nature. 1997;389:849–852. [PubMed]
43. Haarmeier T., Bunjes F., Lindner A., Berret E., Thier P. Optimizing visual motion perception during eye movements. Neuron. 2001;32:527–535. [PubMed]