A Rational Analysis of the Acquisition of Multisensory Representations

Cognitive Science 36 (2):305-332 (2012)
How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments
Keywords Bayesian modeling  Rational analysis  Multisensory perception  Learning
Categories (categorize this paper)
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index
Download options
PhilPapers Archive

Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 9,351
External links
  •   Try with proxy.
  • Through your library Configure
    References found in this work BETA

    View all 8 references

    Citations of this work BETA

    No citations found.

    Similar books and articles
    K. Sathian (2004). Modality, Quo Vadis? Behavioral and Brain Sciences 27 (3):413-414.
    Matthew Fulkerson (2011). The Unity of Haptic Touch. Philosophical Psychology 24 (4):493 - 516.
    M. Auvray & C. SpenCe (2008). The Multisensory Perception of Flavor. Consciousness and Cognition 17 (3):1016-1031.
    Mohan Matthen (forthcoming). Active Perception and the Representation of Space. In Dustin Stokes, Stephen Biggs & Mohan Matthen (eds.), Perception and Its Modalities. Oxford University Press.

    Monthly downloads

    Added to index


    Total downloads

    9 ( #128,813 of 1,088,396 )

    Recent downloads (6 months)

    1 ( #69,601 of 1,088,396 )

    How can I increase my downloads?

    My notes
    Sign in to use this feature

    Start a new thread
    There  are no threads in this forum
    Nothing in this forum yet.