Neuroscience

A Note on Holt on Visual Illusions (Heft, 2001)

This is a visual illusion. When you look at it, there appears to be a great deal of motion as things rotate in various directions. But there's no actual motion; this isn't an animated display and you can verify this by fixating the centre or touching your computer screen - no motion. I just fooled your visual system.

But Andrew, you say, you've been talking all this time about how great perception is! It's direct, functional, reflects experience, and lawful: if perception is all these things, how can it be fooled so easily by some pixels? Direct realism surely cannot handle this: perception is flawed, and readily shown not to correspond to the way things really are. Clearly this James Gibson is a mad man and we can go back to 'knowing' that perception is clearly mediated by pretty good but fallible representations.

You're in plentiful (if not especially good) company. This is a common way to dismiss ecological psychology and it does need to be addressed. Fortunately, it has been, extensively, so it's time to remind the representational camp of exactly why they are wrong, again. Holt has a few choice words on this, in a chapter from The New Realism entitled 'The Place of Illusory Experience in a Realistic World'. Gibson will want a word as well, but I'll leave that to the ongoing Gibson (1979) reading group. I'll focus on Holt because a) he went after this obvious objection to a realist ontology early and hard, and b) it was discussed in the chapter from Heft's book on Holt - I left it from there out because it's worth a post by itself.

Remember, James, Holt, Gibson et al are all engaged in a very specific game, namely redefining the metaphysics underpinning psychology. When you're working at this level, the first step in any counter argument is to examine the metaphysical assumptions of the opposing claim: it is often that case that you can simply define the problem away. This is essentially what Holt does here.

The excitement about visual illusions comes from a simple dualistic assumption: there is an objective true state of affairs, and our perception of this, and that in the case of illusion, these do not correspond. The perception is therefore in error and illusions reveal the assumptions mental representations are making in order to be of any use. But James and Holt and the rest of the New Realists have been making that case that experience does not reside 'in the head'; it is a functional relation that we enter into. Correspondence ceases to be a problem because there are no longer two things (world and represented-world) to be placed in alignment; there is only the relation.

Visual illusions, then, don't reside in the head: they live in the relation between the perceiver and perceived. To quote Heft's summary:

Perceptual errors and illusions are real parts of experience. Illusions arise under particular specifiable, objective conditions. The problem is not one of correspondence, or a lack thereof, but one in which circumstances lead to a lack of coherence or consistency within perceptual experience (Heft, 2001, pp 80).

James, Holt and Gibson all consider experience to arise from a dynamic process of selection, extended over both time and space. From this perspective, the illusory status of the motion in the above image is revealed by inconsistencies in the perceptual experience of it: the motion vanishes if we fix our eyes, we cannot feel the motion if we touch the image, we can continue to explore the computer display showing the image to confirm that nothing is changing, etc.

But surely this implies that the perception of visual motion is still an error, as revealed by further exploration? Not so, says Holt. Exploration has simply revealed the limits of the scope of the true visual experience, which, for a realist, is always occurring in a broad context. Take the commonly cited case of the straight stick that appears bent when placed in water; this appearance is surely an error. For Holt, the error is with the analysis: psychologists fail to notice that the context of the experience has changed, which has naturally led to a different visual experience. One case (when the stick is out of the water) leads to the true visual experience that the stick, when viewed under these circumstances, appears straight; the other case (when the stick is half in water, half in the air) leads to the equally true but different visual experience that the stick, when viewed under these circumstances, appears bent (a consequence of the behaviour of light as it moves across boundaries between media). Recall the account of the man walking past the window; context is everything.

All visual illusions depend on a trick to work. The Ames Room, for example, is a trick of static perspective depth information that only works from one location; moving from there breaks the illusion, although it is compelling when you're in the right place. Visual illusions are getting more compelling: there's a regular competition at the Vision Sciences Society meeting to show of new illusions, with the emphasis on making them more and more stable over wider and wider viewing conditions. But because they all depend on a trick, they don't actually tell us about vision in the wild; they do reveal certain boundary conditions, but no more. Given the opportunity (i.e. the space and the time to explore) they are revealed to be illusions when they lead to inconsistencies in our experience. This is a necessary condition for perception to succeed, and Gibson will insist on allowing motion and exploration to be fundamental parts of the senses considered as perceptual systems.Illusions arise when a necessary condition has been violated, and are therefore not as interesting as people think for the study of perception. Indeed, Gibson will dismiss them as entirely useless because they depend on breaking the rules under which perception actually occurs.

Summary: illusions do pose an important question to direct realist accounts of perception that must be answered, but the challenge has been met; illusions create true visual experiences under artificially constrained circumstances and are only problems for a perceiver when the constraint is successfully concealed. Illusions reveal only the role a given constraint plays in allowing perception to succeed normally, but do not reveal the contents of the hypothesised mental representations that supposedly mediate vision.

References

Holt, E.B. (1912). The place of illusory experience in a realistic world. In E. B. Holt et al. (Eds.), The New Realism: Cooperative studies in philosophy (pp. 303-377). New York: MacMillan. Download

- Visual Illusions And Direct Perception
A while back I reviewed a bunch of papers by Rob Withagen who is currently arguing that while perception is not typically based in specifying variables, it can and should still be ecological in nature. While we are also developing an account of information...

- Gibson Vs Physics: Gibson Wins, At The Ecological Scale
One of the interesting questions that popped out of our discussions with Ken Aizawa about Runeson and the Ames Room is this: did Gibson and his followers banish physics and geometry from his psychology? And if so, is Runeson breaking this prohibition...

- Reading Group - Heft (2001) On Gibson (pt Iia)
Time for a break on affordances, and a quick check in with Heft. In the last chapter Heft laid out the key contributions Gibson made to the radical empiricist programme. In Chapter 4, Heft focuses on the specific consequences for Gibson of being a realist...

- Reading Group - Heft (2001) On Gibson
Part II of Heft moves on from James and Holt and into Gibson's ecological approach. The point of Part I, as I've discussed, was to establish the roots of Gibson in the radical empiricism of James, conveyed via the molar behaviourism of Holt. Part...

- Reading Group: Gibson (1979) And Heft (2001)
I'm going to take advantage of the fact I'm doing this blog to re-read Gibson 1979 and take notes. I'm going to post these chapter by chapter as I go, I also found a copy of Harry Heft's book in the library and I've been meaning to...

Neuroscience