Interaction Studies 18 (3):465-488 (2017)

A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual and multimodal. Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
DOI 10.1075/is.18.3.08zla
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 64,209
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Philosophical investigations.Ludwig Wittgenstein & G. E. M. Anscombe - 1953 - Revue Philosophique de la France Et de l'Etranger 161:124-124.
So You Think Gestures Are Nonverbal?David McNeill - 1985 - Psychological Review 92 (3):350-371.

View all 11 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles

Models for Anodic and Cathodic Multimodalities.Juliana Bueno-Soler - 2012 - Logic Journal of the IGPL 20 (2):458-476.
The Multimodal Experience of Art.Bence Nanay - 2012 - British Journal of Aesthetics 52 (4):353-363.
Multimodal Logic for Syntax.Alain Lecomte - 1998 - Logica Trianguli 2:49-72.
Chapter 16. The Role of Non-Verbal Sound and Music in Multimodal Metaphor.Eduardo Urios-Aparisi & Charles J. Forceville - 2009 - In Eduardo Urios-Aparisi & Charles J. Forceville (eds.), Multimodal Metaphor. Mouton de Gruyter.
Chapter 9. Image Alignment in Multimodal Metaphor.Norman Y. Teng - 2009 - In Eduardo Urios-Aparisi & Charles J. Forceville (eds.), Multimodal Metaphor. Berlin, New York: Mouton de Gruyter. pp. 197–212.


Added to PP index

Total views
41 ( #263,951 of 2,455,350 )

Recent downloads (6 months)
1 ( #449,153 of 2,455,350 )

How can I increase my downloads?


My notes