Graduate studies at Western
Cognitive Science 36 (2):305-332 (2012)
|Abstract||How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments|
|Keywords||Bayesian modeling Rational analysis Multisensory perception Learning|
|Categories||categorize this paper)|
|Through your library||Configure|
Similar books and articles
K. Sathian (2004). Modality, Quo Vadis? Behavioral and Brain Sciences 27 (3):413-414.
Matthew Fulkerson (2011). The Unity of Haptic Touch. Philosophical Psychology 24 (4):493 - 516.
D. LegranD, C. Brozzoli, Y. Rossetti & A. FArne (2007). Close to Me: Multisensory Space Representations for Action and Pre-Reflexive Consciousness of Oneself-in-the-World. Consciousness and Cognition 16 (3):687-699.
Berit Brogaard (forthcoming). Synesthetic Binding and the Reactivation Model of Memory. In Ophelia Deroy (ed.), Sensory Blendings: New essays on synaesthesia. Oxford University Press.
Joost X. Maier, Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex.
Harry Farmer & Manos Tsakiris (2012). The Bodily Social Self: A Link Between Phenomenal and Narrative Selfhood. Review of Philosophy and Psychology 3 (1):125-144.
Thomas J. Anastasio (2003). Probability Rather Than Logic as the Basis of Perception. Behavioral and Brain Sciences 26 (3):283-284.
Kelvin S. Oie & John J. Jeka (2001). Input-Driven Behavior: One Extreme of the Multisensory Perceptual Continuum. Behavioral and Brain Sciences 24 (2):232-233.
M. Auvray & C. SpenCe (2008). The Multisensory Perception of Flavor. Consciousness and Cognition 17 (3):1016-1031.
Keith Stenning & Robert Inder (1995). Applying Semantic Concepts to the Media Assigment Problem in Multi-Media Communication. In [Book Chapter].
Donna M. Lloyd, Elizabeth Lewis, Jacob Payne & Lindsay Wilson (2012). A Qualitative Analysis of Sensory Phenomena Induced by Perceptual Deprivation. Phenomenology and the Cognitive Sciences 11 (1):95-112.
Gwendolyn E. Roberson, Mark T. Wallace & James A. Schirillo (2001). The Sensorimotor Contingency of Multisensory Localization Correlates with the Conscious Percept of Spatial Unity. Behavioral and Brain Sciences 24 (5):1001-1002.
Mohan Matthen (forthcoming). Active Perception and the Representation of Space. In Dustin Stokes, Stephen Biggs & Mohan Matthen (eds.), Perception and Its Modalities. Oxford University Press.
Claudio Brozzoli, Alessandro Farnè & Yves Rossetti (2007). Divide Et Impera? Towards Integrated Multisensory Perception and Action. Behavioral and Brain Sciences 30 (2):202-203.
Added to index2011-12-06
Total downloads9 ( #122,521 of 739,366 )
Recent downloads (6 months)1 ( #61,680 of 739,366 )
How can I increase my downloads?