Discourse coherence and gesture interpretation
Graduate studies at Western
|Abstract||In face-to-face interaction, speakers make multimodal contributions that exploit both the linguistic resources of spoken language and the visual and spatial affordances of gesture. In this paper, we argue that, in formulating and understanding such multimodal contributions, interlocutors apply the same principles of coherence that characterize the interpretation of natural language discourse. In particular, we use a close analysis of a series of naturally-occurring embodied discourses to argue for two key generalizations. First, communicators and their audiences draw on coherence relations to establish interpretive connections between successive gestures and between gestures and speech. Second, coherence relations facilitate meaning-making by resolving the underspecified meaning of each communicative act through constrained inference over entities, propositions, and spatial frames made salient in the prior discourse. Our approach to gesture interpretation improves on previous work in better accounting for its flexibility, in capturing its constraints, and in laying the groundwork for formal and computational models. At the same time, it shows that gesture provides an important source of evidence to sharpen the theory of coherence relations and contextual resolution.|
|Keywords||No keywords specified (fix it)|
|Categories||categorize this paper)|
|External links||This entry has no external links. Add one.|
|Through your library||Only published papers are available at libraries|
Similar books and articles
Jonathan Cole, Shaun Gallagher & David McNeill (2002). Gesture Following Deafferentation: A Phenomenologically Informed Experimental Study. [REVIEW] Phenomenology and the Cognitive Sciences 1 (1):49-67.
David McNeill, Bennett Bertenthal, Jonathan Cole & Shaun Gallagher (2005). Gesture-First, but No Gestures? Behavioral and Brain Sciences 28 (2):138-139.
Olivier le Guen (2011). Speech and Gesture in Spatial Language and Cognition Among the Yucatec Mayas. Cognitive Science 35 (5):905-938.
Lyn Frazier & Charles Clifton (2006). Ellipsis and Discourse Coherence. Linguistics and Philosophy 29 (3):315 - 346.
Robert Ashmore (2004). Word and Gesture: On. Philosophy East and West 54 (4).
Alex Lascarides & Nicholas Asher (1993). Temporal Interpretation, Discourse Relations and Commonsense Entailment. Linguistics and Philosophy 16 (5):437 - 493.
Robert Ashmore (2004). Word and Gesture: On Xuan-School Hermeneutics of the Analects. Philosophy East and West 54 (4):458-488.
Jan P. de Ruiter, Adrian Bangerter & Paula Dings (2012). The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis. Topics in Cognitive Science 4 (2):232-248.
Amalia Amaya (2007). Formal Models of Coherence and Legal Epistemology. Artificial Intelligence and Law 15 (4):429-447.
Sorry, there are not enough data points to plot this chart.
Added to index2009-01-28
Total downloads1 ( #292,381 of 739,352 )
Recent downloads (6 months)0
How can I increase my downloads?