Cognitive Science 36 (2):305-332 (2012)

Abstract
How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments
Keywords Bayesian modeling  Rational analysis  Multisensory perception  Learning
Categories (categorize this paper)
DOI 10.1111/j.1551-6709.2011.01216.x
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 65,593
Through your library

References found in this work BETA

Vision.David Marr - 1982 - W. H. Freeman.
Judgement Under Uncertainty: Heuristics and Biases.Daniel Kahneman, Paul Slovic & Amos Tversky - 1985 - British Journal for the Philosophy of Science 36 (3):331-340.
Rational Models of Cognition.M. Oaksford & N. Chater (eds.) - 1998 - Oxford University Press UK.

View all 11 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles

Modality, Quo Vadis?K. Sathian - 2004 - Behavioral and Brain Sciences 27 (3):413-414.
The Unity of Haptic Touch.Matthew Fulkerson - 2011 - Philosophical Psychology 24 (4):493 - 516.
Probability Rather Than Logic as the Basis of Perception.Thomas J. Anastasio - 2003 - Behavioral and Brain Sciences 26 (3):283-284.
The Multisensory Perception of Flavor.Malika Auvray & Charles Spence - 2008 - Consciousness and Cognition 17 (3):1016-1031.
Active Perception and the Representation of Space.Mohan Matthen - 2014 - In Dustin Stokes, Mohan Matthen & Stephen Biggs (eds.), Perception and Its Modalities. Oxford University Press. pp. 44-72.

Analytics

Added to PP index
2011-12-06

Total views
99 ( #111,981 of 2,462,067 )

Recent downloads (6 months)
1 ( #448,768 of 2,462,067 )

How can I increase my downloads?

Downloads

My notes