Discourse coherence and gesture interpretation
In face-to-face interaction, speakers make multimodal contributions that exploit both the linguistic resources of spoken language and the visual and spatial affordances of gesture. In this paper, we argue that, in formulating and understanding such multimodal contributions, interlocutors apply the same principles of coherence that characterize the interpretation of natural language discourse. In particular, we use a close analysis of a series of naturally-occurring embodied discourses to argue for two key generalizations. First, communicators and their audiences draw on coherence relations to establish interpretive connections between successive gestures and between gestures and speech. Second, coherence relations facilitate meaning-making by resolving the underspecified meaning of each communicative act through constrained inference over entities, propositions, and spatial frames made salient in the prior discourse. Our approach to gesture interpretation improves on previous work in better accounting for its flexibility, in capturing its constraints, and in laying the groundwork for formal and computational models. At the same time, it shows that gesture provides an important source of evidence to sharpen the theory of coherence relations and contextual resolution.
|Keywords||No keywords specified (fix it)|
|Categories||categorize this paper)|
References found in this work BETA
No references found.
Citations of this work BETA
Deixis.Una Stojnic, Matthew Stone & Ernie Lepore - 2013 - Philosophical Perspectives 27 (1):502-525.
Meaning and Demonstration.Matthew Stone & Una Stojnic - 2015 - Review of Philosophy and Psychology 6 (1):69-97.
Similar books and articles
Formal Models of Coherence and Legal Epistemology.Amalia Amaya - 2007 - Artificial Intelligence and Law 15 (4):429-447.
The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis.Jan P. de Ruiter, Adrian Bangerter & Paula Dings - 2012 - Topics in Cognitive Science 4 (2):232-248.
Word and Gesture: On Xuan-School Hermeneutics of the Analects.Robert Ashmore - 2004 - Philosophy East and West 54 (4):458-488.
Temporal Interpretation, Discourse Relations and Commonsense Entailment.Alex Lascarides & Nicholas Asher - 1993 - Linguistics and Philosophy 16 (5):437 - 493.
Ellipsis and Discourse Coherence.Lyn Frazier & Charles Clifton - 2006 - Linguistics and Philosophy 29 (3):315-346.
Speech and Gesture in Spatial Language and Cognition Among the Yucatec Mayas.Olivier le Guen - 2011 - Cognitive Science 35 (5):905-938.
Gesture-First, but No Gestures?David McNeill, Bennett Bertenthal, Jonathan Cole & Shaun Gallagher - 2005 - Behavioral and Brain Sciences 28 (2):138-139.
Sorry, there are not enough data points to plot this chart.
Added to index2009-01-28
Total downloads1 ( #885,439 of 2,171,976 )
Recent downloads (6 months)0
How can I increase my downloads?