Your Visual System is Lying

A Tale of Two Visions

Does a hill appear steeper when you are already exhausted? Is it true that baseballs appear larger to players when they are hitting well?

You may have some suspicions that your perception is greatly affected by your context and may not always be correct.

I want to describe an interesting set of experiments dealing with perception and action.

The Slant Experiments

In the slant experiment1Witt, J. K.,&Proffitt, D.R., “Perceived slant: A dissociation between perception and action,” Perception, vol. 36, pp. 249-257, 2007. http://wexler.free.fr/library/files/witt%20%282007%29%20perceived%20slant.%20a%20dissociation%20between%20perception%20and%20action.pdf, subjects were asked to estimate the slope of a hill with two different visual tasks:

  1. Visual matching: Adjust a line on a flat disk to indicate the slant.
    disk diagram
  2. Haptic: Adjust the slant of a movable board with your hands without looking at the hands.
    haptic diagram

The two tasks in the experiment are supposed to be absolute, in that the slant of the hill is measured of itself, not compared to anything else. They had a third task used in previous experiments which was relative in that it compared the slant to the ground plane. So the new “absolute” disk was introduced to attempt to filter out task differences from the results.

Experiment 1 had the subjects look at the hill head on (pitch). Task 1 (matching) was not very accurate: 31 degrees was perceived steeper, around 50 degrees, and 22 degrees was perceived as steeper also (in between 30 and 40 degrees).  However, Task 2 (haptic) was accurate.

In previous studies, visual matching and verbal reports were even more inaccurate when the subjects were encumbered, tired, unhealthy, or elderly, yet the haptic task was not influenced.

In Experiment 2, the subjects could see the slant of hill from the side (a cross-section). Yet they still over-estimated the slant with visual matching despite that they could actually hold the disk up in their visual field and match the line to the slant. The haptic tasks were still accurate.

The researchers concluded that these results support the theory that we have two independent visual systems, one for explicit awareness, and one that is visuomotor for immediate actions.

As another scientist not involved in the experiments explained2Koch, C., “Looks Can Deceive: Why Perception and Reality Don’t Always Match Up,” Scientific American Mind, July 2010.:

Proffitt [one of the researchers] argues that perception is not fixed: it is flexible, reflecting a person’s physiological state. Your conscious perception of slant depends on your current ability to walk up or down hills—hard work that should not be undertaken lightly. If you are tired, frail, scared or carrying a load, your assessment of the hill—the one that guides your actions—will differ from what you see. Not by choice, but by design. It is the way you are wired.

The Enactive Approach to Perception

In the book Action in Perception philosopher Alva Noë said3Noë, A., Action in Perception, Cambridge, MA: MIT Press, 2004.:

Perceptual experience, according to the enactive approach, is an activity of exploring the environment drawing on knowledge of sensorimotor dependencies and thought.

It seems that the slant perception experiments mesh with the enactive approach. Again, from Noë:

To see that something is flat is precisely to see it as giving rise to certain possibilities of sensorimotor contingency.  To feel a surface as flat is precisely to perceive it as impeding or shaping one’s possibilities of movement.

Noë argued that we always have dual experiences even if we don’t realize it:

  1. How things are to us in experience.
  2. How things look.

The Two Vision Systems Theory

As psychologists and neuroscientists have discovered over the past several decades, our consciousness provides a stable interface to a dizzyingly rich sensory world. Underneath this interface lurk two vision systems that work in parallel. Both are fed by the same two sensors, the eyeballs, yet they serve different functions. One system is responsible for visual perception and is necessary for identifying objects—such as approaching cars and potential mates—independent of their apparent size or location in our visual field. The other is responsible for action: it transforms visual input into the movements of our eyes, hands and legs. We consciously experience only the former, but we depend for our survival on both.2Koch, C., “Looks Can Deceive: Why Perception and Reality Don’t Always Match Up,” Scientific American Mind, July 2010.

Argument: Doesn’t that explain things better and annihilate the enactive approach?

Noë addressed the two visual systems theory, but spent little more than a page on it, dismissing it as orthogonal to the enactive approach. Noë states that both visual streams depend on deployment of sensorimotor skills.

However, there are sensorimotor relations to both the visuomotor stream and the explicit awareness stream. The awareness perceptions are probably modulated by sensorimotor skills as they apply to a person’s current context, which is why Task 1 results in inaccurate perceptions.  Meanwhile, I think the visuomotor stream is tied into in a quicker, tighter loop that skips the slower type of aware perceptual processing that the other stream uses, which is why Task 2 is accurate.

In other words, both visual systems use sensorimotor skills, but in different ways, thus giving support to the enactive approach.