Computing motion on the basis of the time-varying image intensity is a difficult problem for both artificial and biological vision systems. We will show how one well-known gradient-based computer algorithm for estimating visual motion can be implemented within the primate's visual system. This relaxation algorithm computes the optical flow field by minimizing a variational functional of a form commonly encountered in early vision, and is performed in two steps. In the first stage, local motion is computed, while in the second stage spatial integration occurs. Neurons in the second stage represent the optical flow field via a population-coding scheme, such that the vector sum of all neurons at each location codes for the direction and magnitude of the velocity at that location. The resulting network maps onto the magnocellular pathway of the primate visual system, in particular onto cells in the primary visual cortex (V1) as well as onto cells in the middle temporal area (MT). Our algorithm mimics a number of psychophysical phenomena and illusions (perception of coherent plaids, motion capture, motion coherence) as well as electrophysiological recordings. Thus, a single unifying principle ‘the final optical flow should be as smooth as possible’ (except at isolated motion discontinuities) explains a large number of phenomena and links single-cell behavior with perception and computational theory.
Computing motion in the primate's visual system
C. Koch, H. T. Wang, B. Mathur; Computing motion in the primate's visual system. J Exp Biol 1 September 1989; 146 (1): 115–139. doi: https://doi.org/10.1242/jeb.146.1.115
Download citation file:
Advertisement
Cited by
In the field: an interview with Harald Wolf
(update)-Conversation.jpg?versionId=3747)
In our new Conversation, Harald Wolf talks about his fieldwork experiences working with desert ants in Tunisia to understand their navigation.
Propose a new Workshop
-GSWorkshop.png?versionId=3747)
Our Workshops bring together leading experts and early-career researchers from a range of scientific backgrounds. Applications are now open to propose Workshops for 2024, one of which will be held in a Global South country.
Julian Dow steps down and John Terblanche joins the JEB team
-NewEditor.png?versionId=3747)
After 15 years with the journal, Julian Dow from University of Glasgow, UK, is stepping down as a Monitoring Editor. We wish Julian all the best for the future and welcome John Terblanche, Stellenbosch University, South Africa, who is joining the team. Julian talks about his long association with The Company of Biologists and the journal and John tells us about his life and career in this News article.
The capture of crude oil droplets by filter feeders at high and low Reynolds numbers
-FilterFeeders.jpg?versionId=3747)
Researchers from the University of Montreal, Canada, reveal how tiny filter feeding barnacles and Daphnia entrap and consume minute droplets of crude oil, introducing the pollutant at the bottom of the food chain.
Patterns and processes in amphibious fish
-Review.png?versionId=3747)
In their Review, Keegan Lutek, Cassandra Donatelli and Emily Standen discuss the biomechanics and neural control of terrestrial locomotion in amphibious fish. They explore how locomotor mode depends on body shape, physical constraints and phylogeny.