David Bourget (Western Ontario)
David Chalmers (ANU, NYU)
Rafael De Clercq
Jack Alan Reynolds
Learn more about PhilPapers
Cognitive Science 36 (2):305-332 (2012)
How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments.
|Keywords||Bayesian modeling Rational analysis Multisensory perception Learning|
|Categories||categorize this paper)|
Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
|Through your library|
References found in this work BETA
Daniel Kahneman, Paul Slovic & Amos Tversky (eds.) (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press.
David Marr (1982). Vision. Freeman.
David Marr (1982). Vison. W. H. Freeman.
Nick Chater & Mike Oaksford (eds.) (2008). The Probabilistic Mind: Prospects for Bayesian Cognitive Science. OUP Oxford.
Beatrice de Gelder & Jean Vroomen (2000). The Perception of Emotions by Ear and by Eye. Cognition and Emotion 14 (3):289-311.
Citations of this work BETA
No citations found.
Similar books and articles
K. Sathian (2004). Modality, Quo Vadis? Behavioral and Brain Sciences 27 (3):413-414.
Matthew Fulkerson (2011). The Unity of Haptic Touch. Philosophical Psychology 24 (4):493 - 516.
D. LegranD, C. Brozzoli, Y. Rossetti & A. FArne (2007). Close to Me: Multisensory Space Representations for Action and Pre-Reflexive Consciousness of Oneself-in-the-World. Consciousness and Cognition 16 (3):687-699.
Berit Brogaard (forthcoming). Synesthetic Binding and the Reactivation Model of Memory. In Ophelia Deroy (ed.), Sensory Blendings: New essays on synaesthesia. Oxford University Press
Joost X. Maier, Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex.
Harry Farmer & Manos Tsakiris (2012). The Bodily Social Self: A Link Between Phenomenal and Narrative Selfhood. Review of Philosophy and Psychology 3 (1):125-144.
Thomas J. Anastasio (2003). Probability Rather Than Logic as the Basis of Perception. Behavioral and Brain Sciences 26 (3):283-284.
Kelvin S. Oie & John J. Jeka (2001). Input-Driven Behavior: One Extreme of the Multisensory Perceptual Continuum. Behavioral and Brain Sciences 24 (2):232-233.
M. Auvray & C. SpenCe (2008). The Multisensory Perception of Flavor. Consciousness and Cognition 17 (3):1016-1031.
Keith Stenning & Robert Inder (1995). Applying Semantic Concepts to the Media Assigment Problem in Multi-Media Communication. In [Book Chapter].
Donna M. Lloyd, Elizabeth Lewis, Jacob Payne & Lindsay Wilson (2012). A Qualitative Analysis of Sensory Phenomena Induced by Perceptual Deprivation. Phenomenology and the Cognitive Sciences 11 (1):95-112.
Gwendolyn E. Roberson, Mark T. Wallace & James A. Schirillo (2001). The Sensorimotor Contingency of Multisensory Localization Correlates with the Conscious Percept of Spatial Unity. Behavioral and Brain Sciences 24 (5):1001-1002.
Mohan Matthen (2014). Active Perception and the Representation of Space. In Dustin Stokes, Mohan Matthen & Stephen Biggs (eds.), Perception and Its Modalities. Oxford University Press 44-72.
Claudio Brozzoli, Alessandro Farnè & Yves Rossetti (2007). Divide Et Impera? Towards Integrated Multisensory Perception and Action. Behavioral and Brain Sciences 30 (2):202-203.
Added to index2011-12-06
Total downloads19 ( #145,010 of 1,725,417 )
Recent downloads (6 months)2 ( #268,739 of 1,725,417 )
How can I increase my downloads?