The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis
David Bourget (Western Ontario)
David Chalmers (ANU, NYU)
Rafael De Clercq
Jack Alan Reynolds
Learn more about PhilPapers
Topics in Cognitive Science 4 (2):232-248 (2012)
The tradeoff hypothesis in the speech–gesture relationship claims that (a) when gesturing gets harder, speakers will rely relatively more on speech, and (b) when speaking gets harder, speakers will rely relatively more on gestures. We tested the second part of this hypothesis in an experimental collaborative referring paradigm where pairs of participants (directors and matchers) identified targets to each other from an array visible to both of them. We manipulated two factors known to affect the difficulty of speaking to assess their effects on the gesture rate per 100 words. The first factor, codability, is the ease with which targets can be described. The second factor, repetition, is whether the targets are old or new (having been already described once or twice). We also manipulated a third factor, mutual visibility, because it is known to affect the rate and type of gesture produced. None of the manipulations systematically affected the gesture rate. Our data are thus mostly inconsistent with the tradeoff hypothesis. However, the gesture rate was sensitive to concurrent features of referring expressions, suggesting that gesture parallels aspects of speech. We argue that the redundancy between speech and gesture is communicatively motivated
|Keywords||Referring expressions Gesture–speech redundancy Speech production Gesture–speech tradeoff Gesture Iconic gestures Pointing|
|Categories||categorize this paper)|
Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
|Through your library|
References found in this work BETA
Herbert H. Clark & Deanna Wilkes-Gibbs (1986). Referring as a Collaborative Process. Cognition 22 (1):1-39.
Paul M. Fitts (1954). The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology 47 (6):381.
G. Kempen (1983). The Lexicalization Process in Sentence Production and Naming: Indirect Election of Words. Cognition 14 (2):185-209.
Ardi Roelofs (1992). A Spreading-Activation Theory of Lemma Retrieval in Speaking. Cognition 42 (1-3):107-142.
Wing Chee So, Sotaro Kita & Susan Goldin‐Meadow (2009). Using the Hands to Identify Who Does What to Whom: Gesture and Speech Go Hand‐in‐Hand. Cognitive Science 33 (1):115-125.
Citations of this work BETA
Kees van Deemter, Albert Gatt, Roger P. G. van Gompel & Emiel Krahmer (2012). Toward a Computational Psycholinguistics of Reference Production. Topics in Cognitive Science 4 (2):166-183.
Similar books and articles
Jerry H. Gill (2010). Language as Gesture. International Philosophical Quarterly 50 (1):25-37.
David McNeill (2005). Gesture and Thought. University of Chicago Press.
Susan Goldin-Meadow & Martha Wagner Alibali (1999). Does the Hand Reflect Implicit Knowledge? Yes and No. Behavioral and Brain Sciences 22 (5):766-767.
Max M. Louwerse & Adrian Bangerter (2010). Effects of Ambiguous Gestures and Language on the Time Course of Reference Resolution. Cognitive Science 34 (8):1517-1529.
David McNeill, Bennett Bertenthal, Jonathan Cole & Shaun Gallagher (2005). Gesture-First, but No Gestures? Behavioral and Brain Sciences 28 (2):138-139.
Anna M. Barrett, Anne L. Foundas & Kenneth M. Heilman (2005). Speech and Gesture Are Mediated by Independent Systems. Behavioral and Brain Sciences 28 (2):125-126.
Olivier le Guen (2011). Speech and Gesture in Spatial Language and Cognition Among the Yucatec Mayas. Cognitive Science 35 (5):905-938.
Spencer D. Kelly (2003). From Past to Present: Speech, Gesture, and Brain in Present-Day Human Communication. Behavioral and Brain Sciences 26 (2):230-231.
Michael A. Arbib (2005). The Mirror System Hypothesis Stands but the Framework is Much Enriched. Behavioral and Brain Sciences 28 (2):149-159.
Michael C. Corballis (2003). From Mouth to Hand: Gesture, Speech, and the Evolution of Right-Handedness. Behavioral and Brain Sciences 26 (2):199-208.
Amir Raz & Opher Donchin (2003). A Zetetic's Perspective on Gesture, Speech, and the Evolution of Right-Handedness. Behavioral and Brain Sciences 26 (2):237-238.
Rick Dale, Daniel C. Richardson & Michael J. Owren (2003). Pumping for Gestural Origins: The Well May Be Rather Dry. Behavioral and Brain Sciences 26 (2):218-219.
Added to index2012-03-03
Total downloads14 ( #122,921 of 1,140,265 )
Recent downloads (6 months)1 ( #142,694 of 1,140,265 )
How can I increase my downloads?