Muybridge Reloaded

Posted in culture on September 7th, 2010 by Samuel Kenyon

I just realized that Eadweard Muybridge, in the 1800s, could have achieved the time-slice effect as it was used for bullet time in the movie The Matrix.

photo of Eadweard Muybridge

Eadweard Muybridge

For instance, he could have arranged his trip-wire cameras in a circle around a subject to get the effect.

From wikipedia:

The method used for creating these effects involved a technically expanded version of an old art photography technique known as time-slice photography, in which a large number of cameras are placed around an object and triggered nearly simultaneously.[14] Each camera is a still-picture camera, and not a motion picture camera, and it contributes just one frame to the video sequence. When the sequence of shots is viewed as in a movie, the viewer sees what are in effect two-dimensional “slices” of a three-dimensional moment. Watching such a “time slice” movie is akin to the real-life experience of walking around a statue to see how it looks from different angles.

image: a sequence of still photos that make up a motion picture by Muybridge

Walking and turning around rapidly with a satchel in one hand, a cane in the other

The only problem with Muybridge’s technique is you need a Zoopraxiscope to watch the movie.  Somebody make a digital interface…

photo of a zoopraxiscope

The Zoopraxiscope


Image credits:

  1. Virtual Museum of the City of San Francisco
  2. Random Kikiness
  3. UK Screen Heritage Network

Tags: ,

Your Visual System is Lying

Posted in artificial intelligence, philosophy on September 6th, 2010 by Samuel Kenyon
Photo of a view uphill of a road.

Does a hill feel steeper when you are already exhausted?  Does a hill appear steeper when you are afraid to roll down it?  Is it true that baseballs appear larger to players when they are hitting well? You may have some suspicions that your perception is greatly affected by your context and may not always be correct.

Psychologists Dennis R. Proffitt (University of Virginia) and Jessica Witt (now at Purdue University) have done performed some interesting experiments in recent years dealing with perception and action.  Christof Koch, professor of biology and engineering at the California Institute of Technology and popular writer, described some of them in his column in the July 2010 issue of Scientific American Mind [1].

In the slant experiments [2], subjects were asked to estimate the slope of a hill with two different visual tasks:

  1. Visual matching: Adjust a line on a flat disk to indicate the slant.

    Diagram of a disk consisting of a circle with a black line diameter.

  2. Haptic: Adjust the slant of a movable board with your hands without looking at the hands.

    Diagram of haptic device, consisting of a rotating board mounted to a stand, with a hand resting palm down on the board.

Koch didn’t mention this, but according to Witt and Proffitt, the two tasks in the experiment are supposed to be absolute, in that the slant of the hill is measured of itself, not compared to anything else.  They had a third task used in previous experiments which was relative in that it compared the slant to the ground plane.  So the new “absolute” disk was introduced to attempt to filter out task differences from the results.

Experiment 1 had the subjects look at the hill head on (pitch).  Task 1 (matching) was not very accurate: 31 degrees was perceived steeper, around 50 degrees, and 22 degrees was perceived as steeper also (in between 30 and 40 degrees).  However, Task 2 (haptic) was accurate.

In previous studies, visual matching and verbal reports were even more inaccurate when the subjects were encumbered, tired, unhealthy, or elderly, yet the haptic task was not influenced.

In experiment 2, the subjects could see the slant of hill from the side (a cross-section).  Yet they still over-estimated the slant with visual matching despite that they could actually hold the disk up in their visual field and match the line to the slant.  The haptic tasks were still accurate.

The researchers concluded that these results support the theory that we have two independent visual systems, one for explicit awareness, and one that is visuomotor for immediate actions.

As Koch explains [1]:

Proffitt argues that perception is not fixed: it is flexible, reflecting a person’s physiological state. Your conscious perception of slant depends on your current ability to walk up or down hills—hard work that should not be undertaken lightly. If you are tired, frail, scared or carrying a load, your assessment of the hill—the one that guides your actions—will differ from what you see. Not by choice, but by design. It is the way you are wired.

The Enactive Approach to Perception

Photo of path going uphill in the woods, with a warning sign about that.

I am reminded of the book Action in Perception, in which philosopher Alva Noë said [3, p.228]:

Perceptual experience, according to the enactive approach, is an activity of exploring the environment drawing on knowledge of sensorimotor dependencies and thought.

It seems that the slant perception experiments mesh with the enactive approach.  Again, from Noë [3, p.105]:

To see that something is flat is precisely to see it as giving rise to certain possibilities of sensorimotor contingency.  To feel a surface as flat is precisely to perceive it as impeding or shaping one’s possibilities of movement.

But, you might argue, the enactive approach doesn’t account for why Task 2 (haptic) is more accurate–wouldn’t the enactive approach predict that Task 2 is as skewed as Task 1?  However, one of the things Noë attempted to argue was that we always have dual experiences even if we don’t realize it:

  1. How things are to us in experience.
  2. How things look.  Normally this is transparent, but one can, with some effort, see how things present themselves visually, e.g. when an artist is painting a depiction.

So, this hypothetical solution indicates that the Task 2, operating on the action-oriented visuomotor stream, provides data as one can achieve with the techniques of artists.

Turning the Tables
Koch started off his column by invoking the two vision systems theory (which is what the slant experiment was trying to prove) [1]:

As psychologists and neuroscientists have discovered over the past several decades, our consciousness provides a stable interface to a dizzyingly rich sensory world. Underneath this interface lurk two vision systems that work in parallel. Both are fed by the same two sensors, the eyeballs, yet they serve different functions. One system is responsible for visual perception and is necessary for identifying objects—such as approaching cars and potential mates—independent of their apparent size or location in our visual field. The other is responsible for action: it transforms visual input into the movements of our eyes, hands and legs. We consciously experience only the former, but we depend for our survival on both.

So isn’t that enough of a description–doesn’t it annihilate the enactive approach?  Noë addressed the two visual systems theory, but spent little more than a page on it, dismissing it as orthogonal to the enactive approach.  Noë states that both visual streams depend on deployment of sensorimotor skills [3, p.19].

However, the slant perception studies actually lend support to the enactive approach–there are sensorimotor relations to both the visuomotor stream and the explicit awareness stream.  The awareness perceptions are modulated by sensorimotor skills as they apply to a person’s current context, which is why Task 1 results in inaccurate perceptions.   Meanwhile, the visuomotor stream is tied into in a quicker, tighter loop that skips the slower type of aware perceptual processing that the other stream uses, which is why Task 2 is accurate.

In other words, both visual systems use sensorimotor skills, but in different ways, thus giving support to the enactive approach.

References

[1] Koch, C., “Looks Can Deceive: Why Perception and Reality Don’t Always Match Up,” Scientific American Mind, July 2010.
[2] Witt, J. K.,&Proffitt, D.R., “Perceived slant: A dissociation between perception and action,” Perception, vol. 36, pp. 249-257, 2007.
[3] Noë, A., Action in Perception, Cambridge, MA: MIT Press, 2004.

Image Credits

  1. Stefan Jannson
  2. Samuel H. Kenyon
  3. Samuel H. Kenyon
  4. most uncool

Crosspost with my other blog, In the Eye of the Brainstorm.
Tags: , , , , , ,