The tradeoff hypothesis in the speech–gesture relationship claims that (a) when gesturing gets harder, speakers will rely relatively more on speech, and (b) when speaking gets harder, speakers will rely relatively more on gestures. We tested the second part of this hypothesis in an experimental collaborative referring paradigm where pairs of participants (directors and matchers) identified targets to each other from an array visible to both of them. We manipulated two factors known to affect the difficulty of speaking to assess (...) their effects on the gesture rate per 100 words. The first factor, codability, is the ease with which targets can be described. The second factor, repetition, is whether the targets are old or new (having been already described once or twice). We also manipulated a third factor, mutual visibility, because it is known to affect the rate and type of gesture produced. None of the manipulations systematically affected the gesture rate. Our data are thus mostly inconsistent with the tradeoff hypothesis. However, the gesture rate was sensitive to concurrent features of referring expressions, suggesting that gesture parallels aspects of speech. We argue that the redundancy between speech and gesture is communicatively motivated. (shrink)

Compared to other animals, humans appear to have a special motivation to share experiences and mental states with others (Clark, 2006; Grice, 1975), which enables them to enter a condition of ‘we’ or shared intentionality (Tomasello & Carpenter, 2005). Shared intentionality has been suggested to be an evolutionary response to unique problems faced in complex joint action coordination (Levinson, 2006; Tomasello, Carpenter, Call, Behne, & Moll, 2005) and to be unique to humans (Tomasello, 2014). The theoretical and empirical bases for (...) this claim, however, present several issues and inconsistencies. Here, we suggest that shared intentionality can be approached as an interactional achievement, and that by studying how our closest relatives, the great apes, coordinate joint action with conspecifics, we might demonstrate some correlate abilities of shared intentionality, such as the appreciation of joint commitment. We provide seven examples from bonobo joint activities to illustrate our framework. (shrink)

Two eye-tracking experiments investigated how and when pointing gestures and location descriptions affect target identification. The experiments investigated the effect of gestures and referring expressions on the time course of fixations to the target, using videos of human gestures and human voice, and animated gestures and synthesized speech. Ambiguous, yet informative pointing gestures elicited attention and facilitated target identification, akin to verbal location descriptions. Moreover, target identification was superior when both pointing gestures and verbal location descriptions were used. These findings (...) suggest that gesture not only operates as a context to verbal descriptions, or that verbal descriptions operate as a context to gesture, but that they complement one another in reference resolution. (shrink)

Compared to other animals, humans appear to have a special motivation to share experiences and mental states with others (Clark, 2006; Grice, 1975), which enables them to enter a condition of ‘we’ or shared intentionality (Tomasello & Carpenter, 2005). Shared intentionality has been suggested to be an evolutionary response to unique problems faced in complex joint action coordination (Levinson, 2006; Tomasello, Carpenter, Call, Behne, & Moll, 2005) and to be unique to humans (Tomasello, 2014). The theoretical and empirical bases for (...) this claim, however, present several issues and inconsistencies. Here, we suggest that shared intentionality can be approached as an interactional achievement, and that by studying how our closest relatives, the great apes, coordinate joint action with conspecifics, we might demonstrate some correlate abilities of shared intentionality, such as the appreciation of joint commitment. We provide seven examples from bonobo joint activities to illustrate our framework. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2017 Heft: 215 Seiten: 1-42.