Rethinking the Mechanisms Underlying the McGurk Illusion

Frontiers in Human Neuroscience 15 (2021)
  Copy   BIBTEX

Abstract

The McGurk illusion occurs when listeners hear an illusory percept, resulting from mismatched pairings of audiovisual speech stimuli. Hearing a third percept—distinct from both the auditory and visual input—has been used as evidence of AV fusion. We examined whether the McGurk illusion is instead driven by visual dominance, whereby the third percept, e.g., “da,” represents a default percept for visemes with an ambiguous place of articulation, like/ga/. Participants watched videos of a talker uttering various consonant vowels with and without audios of/ba/. Individuals transcribed the CV they saw or heard. In the V-only condition, individuals predominantly saw “da”/“ta” when viewing CVs with indiscernible POAs. Likewise, in the AV condition, upon perceiving an illusion, they predominantly heard “da”/“ta” for CVs with indiscernible POAs. The illusion was stronger in individuals who exhibited weak/ba/auditory encoding. In Experiment2, we attempted to replicate these findings using stimuli recorded from a different talker. The V-only results were not replicated, but again individuals predominately heard “da”/“ta”/“tha” as an illusory percept for various AV combinations, and the illusion was stronger in individuals who exhibited weak/ba/auditory encoding. These results demonstrate that when visual CVs with indiscernible POAs are paired with a weakly encoded auditory/ba/, listeners default to hearing “da”/“ta”/“tha”—thus, tempering the AV fusion account, and favoring a default mechanism triggered when both AV stimuli are ambiguous.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,829

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Is the Auditory System Cognitively Penetrable?Dimitria Electra Gatzia & Berit Brogaard - 2015 - Multisensory Integration: Brain, Body, and the World.
Perciving Two Levels of the Flow of Time.R. P. Gruber, M. Bach & R. A. Block - 2015 - Journal of Consciousness Studies 22 (5-6):7-22.
The grand grand illusion illusion.Jonathan Cohen - 2002 - Journal of Consciousness Studies 9 (5-6):141-157.
The dominance of the visual.Dustin Stokes & Stephen Biggs - 2014 - In D. Stokes, M. Matthen & S. Biggs (eds.), Perception and Its Modalities. Oxford University Press.
There is no stream of consciousness.Susan J. Blackmore - 2002 - Journal of Consciousness Studies 9 (5-6):17-28.
Is there a dynamic illusion effect in the motor system?Volker H. Franz - 2004 - Behavioral and Brain Sciences 27 (1):34-35.
The tinkerbell effect: Motion, perception and illusion.Frank H. Durgin - 2002 - Journal of Consciousness Studies 9 (5-6):88-101.

Analytics

Added to PP
2021-04-01

Downloads
17 (#867,741)

6 months
9 (#307,343)

Historical graph of downloads
How can I increase my downloads?