Trends in Cognitive Sciences
How parallel is visual processing in the ventral pathway?
Section snippets
Isolated objects and the binding problem
In laboratory conditions, when the visual system is stimulated with a single object, it seems that there is no binding problem, because all low-level elements in the visual field belong to the same object. However, one still needs a mechanism to organize correctly those elements in space. Indeed, a large number of TE neurons appear to be sensitive to specific element configurations such that a neuron might respond to element A above B (e.g. a circle and a square), but not to B above A 4, 5. It
Spatial information in TE
The ventral pathway is able to build very rapidly the representation of an isolated object, finally encoded in TE neurons. But because TE neurons have large RFs, ranging from about 10° to 30° and often more (e.g. 17, 18, 19), one might question whether the ventral pathway is able to deal with two or more objects simultaneously. Indeed, it is tempting to assume that spatial information is lost in the large RFs of TE neurons, making it impossible to combine the elements from different objects
Representation of two or more stimuli
Overall, the responses of TE neurons might incorporate enough spatial information to be able to encode the identity of several objects in parallel. Several studies have investigated the behavior of TE neurons in response to two stimuli (e.g. 28, 30, 31, 32). Two stimuli typically enter into competitive interactions following two important rules. First, at the level of a single neuron, competition is most likely to occur when both stimuli appear in the RF of a neuron and not when one stimulus is
Low-level and high-level constraints
The evidence reviewed so far suggest that the ventral stream might be able to encode high-level diagnostic information about objects in parallel, but competitive interactions would then strongly limit the number of detailed representations available. In this section, we consider two other important constraints that might limit parallel object processing.
Conclusions
Recent advances in monkey neurophysiology and computational neuroscience highlight the sophistication of the mechanisms implemented in the ventral pathway. Contrary to the claim that the large RFs in TE prevent object-recognition mechanisms from dealing with more than one object at a time, there is now clear evidence that the ventral pathway is well equipped for parallel processing in cluttered scenes. However, local competition, and low-level and high-level constraints considerably limit the
Acknowledgements
The authors would like to thank the Cognitique program, the Integrative and Computational Neuroscience Initiative and the CNRS for support. G.A.Rousselet is supported by a Tier I Canada Research Chair grant to Patrick J. Bennett.
References (80)
Functions of the primate temporal lobe cortical visual areas in invariant visual object and face recognition
Neuron
(2000)- et al.
Neural mechanisms of object recognition
Curr. Opin. Neurobiol.
(2002) - et al.
Invariant face and object recognition in the visual system
Prog. Neurobiol.
(1997) - et al.
Parallel versus serial processing: new vistas on the distributed organization of the visual system
Curr. Opin. Neurobiol.
(1995) Computations in the early visual cortex
J. Physiol. (Paris)
(2003)Shape representation in the inferior temporal cortex of monkeys
Curr. Biol.
(1995)- et al.
Tools for the body (schema)
Trends Cogn. Sci.
(2004) - et al.
A neurodynamical cortical model of visual attention and invariant object recognition
Vision Res.
(2004) - et al.
Interacting roles of attention and visual salience in V4
Neuron
(2003) Taking the MAX from neuronal responses
Trends Cogn. Sci.
(2003)
Surfing a spike wave down the ventral stream
Vision Res.
The implementation of visual routines
Vision Res.
Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons?
J. Physiol. (Paris)
Processing of one, two or four natural scenes in humans: the limits of parallelism
Vision Res.
The psychophysics of visual search
Vision Res.
Cortical image density determines the probability of target discovery during active search
Vision Res.
Parietal mechanisms of target representation
Curr. Opin. Neurobiol.
Perceptual awareness and its loss in unilateral neglect and extinction
Cognition
Spike-based strategies for rapid processing
Neural Netw.
Visual object recognition
Annu. Rev. Neurosci.
The what and why of binding: the modeler's perspective
Neuron
Impact of learning on representation of parts and wholes in monkey inferotemporal cortex
Nat. Neurosci.
Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities
Cereb. Cortex
Time course of neural responses discriminating different views of the face and head
J. Neurophysiol.
Seeking categories in the brain
Science
Learning optimized features for hierarchical models of invariant object recognition
Neural Comput.
(Coarse coding of shape fragments)+(retinotopy) approximately=representation of structure
Spat. Vis.
Invariant recognition of feature combinations in the visual system
Biol. Cybern.
Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex
J. Neurosci.
Past and present ideas about how the visual scene is analyzed by the brain
Visual topography of area TEO in the macaque
J. Comp. Neurol.
Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex
J. Neurophysiol.
Spatial sensitivity of macaque inferior temporal neurons
J. Comp. Neurol.
Eye position-sensitive units in hippocampal formation and in inferotemporal cortex of the macaque monkey
Eur. J. Neurosci.
Size and position invariance of neuronal responses in monkey inferotemporal cortex
J. Neurophysiol.
Coding visual images of objects in the inferotemporal cortex of the macaque monkey
J. Neurophysiol.
Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position
J. Neurophysiol.
Inferior temporal mechanisms for invariant object recognition
Cereb. Cortex
Contribution of GABAergic inhibition to receptive field structures of monkey inferior temporal neurons
Cereb. Cortex
The receptive fields of inferior temporal cortex neurons in natural scenes
J. Neurosci.
Cited by (150)
Stimulus novelty and emotionality interact in the processing of visual distractors
2022, Biological PsychologyHierarchical cortical gradients in somatosensory processing
2020, NeuroImage