Krifka (The origin of topic/comment structure, of predication, and of focusation in asymmetric bimanual coordination, 2006, Interdisciplinary Studies on Information Structure (ISIS): Working Papers of SFB 632 08: 61–96, 2007b) suggests that asymmetric bimanual coordination and ultimately the evolution of lateralization in humans may be the cognitive basis of linguistic topic-comment structure and foreground-background structures in general. As asymmetric bimanual constructions abound in sign languages and are also found in their possible precursors, cospeech gesture and homesign, sign languages (...) may serve as a test ground for the hypothesis. Asymmetric bimanual constructions are indeed used for differentiating foreground and background in sign languages, but some of these constructions are derived from indexical gestures, not manipulation, i.e., they draw on visual attention. Signed topics may be marked by nonmanual features derived from signals of visual attention, and the defining feature of signed topics is eye contact with the addressee, needed to establish a communicative common ground. There, thus, seems to be not one embodied origin of topic-comment structures, but several. Finally, signed topic-comment structure demonstrates how attention shifts in the course of the entire structure, thereby explaining how topics can be described alternately as foreground (e.g., Talmy, Attention phenomena, Oxford University Press, 2007: 265) and background (Jacobs, Linguistics 39: 641–681, 2001). (shrink)

When young children learn to use language, they start to use their hands in co‐verbal gesturing. There are, however, considerable differences between children, and it is not completely understood what these individual differences are due to. We studied how children at 4 years of age employ speech and iconic gestures to convey meaning in different kinds of spatial event descriptions, and how this relates to their cognitive abilities. Focusing on spontaneous illustrations of actions, we applied a semantic feature (SF) analysis (...) to characterize combinations of speech and gesture meaning and related them to the child's visual‐spatial abilities or abstract/concrete reasoning abilities (measured using the standardized SON‐R test). Results show that children with higher cognitive abilities convey significantly more meaning via gesture and less solely via speech. These findings suggest that young children's use of cospeech representational gesturing is positively related to their mental representation and reasoning abilities. (shrink)

Zinacantec Family Homesign is a new sign language emerging spontaneously over the past three decades in a single family in a remote Mayan Indian village. Three deaf siblings, their Tzotzil-speaking age-mates, and now their children, who have had contact with no other deaf people, represent the first generation of Z signers. I postulate an augmented grammaticalization path, beginning with the adoption of a Tzotzil cospeech holophrastic gesture—meaning “come!”—into Z, and then its apparent stylization as an attention-getting sign, followed (...) by grammatical regimentation and pragmatic generalization as an utterance initial change of speaker or turn marker. (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor (...) movements should support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

Developed through a series of conceptual analyses (Edmund Husserl, Vilém Flusser, Ludwig Wittgenstein and Walter Benjamin) and case studies (Fernando Lopes’s Belarmino and Jeff Wall’s Mimic), this article delves into the relationship between gesture, attunement and atmosphere and how it unfolds in photographic works dealing with urban space. The first section focuses on the role played by photography in the film Belarmino, which raises questions about both the representation of urban phenomena and issues related to expression and gesture (...) in boxing. The second section discusses Husserl’s thinking on image consciousness and his surprising reference to a “photograph” of a boxer, which reveals the relevance of his phenomenological approach when it comes to defining the aesthetic properties of gesture-images. The third section examines the principles of Flusser’s philosophy of gestures, focusing on the semantic field of attunement and its connection with various elements related to photography, gesture, moods and affects. The question of gesture in photography—both the gestures of the photographed and those of the photographer—can be articulated with the notions of attunement and atmosphere, which go beyond semiological, psychological and communicational approaches and are important for our understanding of aesthetic and artistic experiences. Finally, if photography is a privileged way of studying atmospheres and gestures (as suggested by the Benjaminian notion of optical unconscious) and their connection with the inner life of the subject, in relation to urban space this study often acquires an intersubjective, social and political dimension, as in Jeff Wall’s Mimic. (shrink)

In Gesture and Thought he brings together years of this research, arguing that gesturing, an act which has been popularly understood as an accessory to speech, ...

In this paper, we intend to discuss how, according to Peirce’s semiotics, gestures can be conceptualized and described as diagrams. We are not concerned with answering when, why or how gestures emerged as semiotic motor activities. As a prerequisite for the very formulation of these problems, we are rather interested in discussing the theoretical conditions which should be fulflled for gestures to be characterized as iconic processes - and more specifcally as diagrammatic processes. The frst step is to summarize a (...) systematic analysis of the variety of iconic signs, elaborated by Peirce, followed by his typology of hypoicons in order to describe the hypoiconic class of diagrams. After that, we present some tentative answers to the question of how to describe gestures as diagrammatic signs. (shrink)

A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co‐vary with other non‐verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer‐generated animated pedagogical agent to control both verbal and non‐verbal behavior. Children viewed lessons on mathematical equivalence (...) in which an avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non‐verbal behavior in controlled experiments. (shrink)

Es handelt sich um eine sozialpsychologische Untersuchung, die unter der Leitung von Franz Boas, dem Vorstand des Department of Anthropology an der Columbia University, New York, unternommen worden ist.Die Hauptmerkmale des Gebärdenspiels zweier verschiedener sogenannter rassischer Gruppen (Italiener und Juden) sind unter verschiedenen und ähnlichen Umgebungsbedingungen mit Hilfe von Filmaufnahmen untersucht worden. Das Ziel der Untersuchung war, festzustellen :a) ob es hinsichtlich des Gebärdenspiels irgendwelche durchgängigen Gruppenunterschiede zwischen noch nicht amerikanisierten jüdischen und italienischen Schichten gibt, und, falls ja,b) welches Schicksal (...) solche Merkmale unter dem Einfluss der sozialen Anpassung erfahren. — Die Ergebnisse geben auf die erste Frage eine bejahende Antwort : Das Gebärdenspiel beim Gespräch der nicht-assimilierten Italiener und Juden ist recht verschieden, und zwar sowohl hinsichtlich der räumlichen und zeitlichen als auch der sprachtechnischen Gestaltung ihrer Gebärden. Für die zweite Frage zeigen die Ergebnisse, dass die Unterschiede, die bei den noch traditionell gebundenen Gruppen angetroffen wurden, bei ihren amerikanisierten Nachkommen zu verschwinden trachten, deren Gesten untereinander und den angelsächsischen Gruppen angenähert werden. Ferner hat sich herausgestellt, dass der Prozess der Angleichung des Gebärdenspiels entsprechend der sozialen Situation verläuft, in welcher sich der Nachkomme der noch nicht assimilierten Familie befindet.L'article traite d’une enquête de psychologie sociale, entreprise sous la direction de M. Franz Boas, président du Department of Anthropology à l’université de Columbia, New York.Les caractères propres à la mimique de deux groupes, considérés vulgairement comme racialement différents, juifs et italiens, ont été étudiés par le procédé de prises de vue cinématographiques, dans des milieux tantôt semblables, tantôt différents. Le but de l’enquête était : *1° d’établir s’il existait, dans la mimique, des différences spécifiques entre italiens et juifs non encore américanisés ; et, dans le cas d’une réponse affirmative :2° d’étudier ce que devenaient ces différences sous l’action de l’adaptation sociale. Les résultats donnent à la première question une réponse affirmative : la mimique des juifs et des italiens non encore américanisés, dans la conversation, est très différente — différences qui s’expriment aussi bien dans la figuration spaciale et temporelle des gestes que dans la technique du langage. Pour la deuxième question, les résultats montrent que les différences observées sur des groupes cohérents, encore soumis à la tradition, tendent à disparaître dans les générations américanisées ; les gestes s’uniformisent et se rapprochent de ceux des anglo-saxons. D’autre part, il s’est révélé que l’adaptation de la mimique se déroule d’une manière qui varie avec la situation sociale dans laquelle se trouve le descendant d’une famille non encore américanisée. (shrink)

A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co-vary with other non-verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer-generated animated pedagogical agent to control both verbal and non-verbal behavior. Children viewed lessons on mathematical equivalence (...) in which an avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non-verbal behavior in controlled experiments. (shrink)

This study aims to corroborate Merleau-Ponty’s interpretations of fundamental ideas from Saussure’s linguistics by linking them to works that were independently elaborated by Jan Mukařovský, Czech structuralist aesthetician and literary theorist. I provide a comparative analysis of the two authors’ theories of language and their interpretations of thought as fundamentally determined by language. On this basis, I investigate how they conceive linguistic innovation and its translation into changes in the constituted language and other social codes and institutions. I explain how (...) they elaborate on Saussure’s idea of language as a system of oppositions by interpreting cultural innovation as a systematic variation of pre-established social norms and, similarly, linguistic innovation as gesturing within language. Connectedly, I show how Mukařovský’s works help clarify Merleau-Ponty’s focus on the gestural dimension of language. By discussing the two thinkers’ arguments in favour of linguistic innovation, I explore what could be called phenomenological limits of structuralism. (shrink)

Using a cross‐modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

During face‐to‐face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face‐to‐face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co‐speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that depict or (...) refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face‐to‐face conversation. (shrink)

David McNeill, a pioneer in the ongoing study of the relationship between gesture and language, here argues that gestures are active participants in both speaking and thinking. He posits that gestures are key ingredients in an “imagery-language dialectic” that fuels speech and thought. The smallest unit of this dialectic is the growth point, a snapshot of an utterance at its beginning psychological stage. In _Gesture and Thought,_ the central growth point comes from a Tweety Bird cartoon. Over the course (...) of twenty-five years, the McNeill Lab showed this cartoon to numerous subjects who spoke a variety of languages, and a fascinating pattern emerged. The shape and timing of gestures depends not only on what speakers see but on what they take to be distinctive; this, in turn, depends on the context. Those who remembered the same context saw the same distinctions and used similar gestures; those who forgot the context understood something different and changed gestures or used none at all. Thus, the gesture becomes part of the growth point—the building block of language and thought. _Gesture and Thought _is an ambitious project in the ongoing study of how we communicate and how language is connected to thought. (shrink)

Adults and children spontaneously produce gestures while they speak, and such gestures appear to support and expand on the information communicated by the verbal channel. Little research, however, has been carried out to examine the role played by gesture in the listener's representation of accumulating information. Do listeners attend to the gestures that accompany narrative speech? In what kinds of relationships between gesture and speech do listeners attend to the gestural channel? If listeners do attend to information received (...) in gesture, how is this information represented— is it 'tagged' as originating in the gestural channel? In this article research is described that addresses these questions. Results show that listeners do attend to information conveyed in gesture, when that information supplements or even contradicts the information conveyed by speech. And information received via gesture is available for retelling in speech. These results are taken to demonstrate that gesture is not taken by the listener to be epiphenomenal to the act of speaking, or a simple manual translation of speech. But they also suggest that the information conveyed in a discourse may be represented in a manner that is neither gesture nor language, although accessible to both channels. (shrink)

In this paper I propose to read and understand gestures as logical tools within a synthetic paradigm of knowledge. This interpretation of gesture is drawn from a new pragmatist reading of reasoning in general, and synthetic reasoning in particular. Complete gestures are actions with a beginning and an end that bear a meaning. It is our regular way to embody vague ideas into singular actions with general meaning. The tool is forged by a dense blending of icons, indices, and (...) symbols and by a complexity of phenomenological characteristics as feelings, actual actions, general concepts and habits. The paper illustrates this new way to look at gestures and different kinds of complete and incomplete gestures. (shrink)

The article argues in favour of a pragmatist enactive interpretation of the emergence of the symbolic and contentful mind from a basic form of social communicative interaction in which basic cognitive capacities are involved. Through a critical overview of Radical Enactivists (RECers)’ view about language, the article focuses on Mead’s pragmatist behavioural theory of meaning that refers to the gestural conversation as the origin of the evolution of linguistic conversation. The article develops as follows. After exposing the main elements of (...) REC’s theory of cognition and language that involve the construction of a theory of natural signs (teleosemiotics) and basic directionality (Ur-intentionality), some critical points of Hutto and Myin’s proposal will be highlighted. To foster a continuist perspective of language, the behavioural theory of meaning and language that Mead develops from the notion of gesture will be analysed. His theory is akin to REC and could augment the bare bones of REC’s sketched perspective, helping to include Ur-intentionality in a broader non-dualistic phylogenetic and ontogenetic theory of symbolic language from gestural communication, thus helping to overcome the distinction between a content-less intentionality and a content-involving intentionality, i.e., a semantic propositional intentionality. Furthermore, a recent revival of Mead’s theory testifies to its up-to-date relevance to explain the innate social dimension of human and non-human animals, and the human communicative capacity through the conditioning of bio-social canons and structures. (shrink)

This paper explores how Wundt’s and Bühler’s respective conceptions of gestural expression have implications for how each conceives of what, in broad terms, may be understood as a ‘grammar of gestures’: that is, the rules for the formation and performance of gestures with and without speech. Unlike previous scholarship that has looked at the relationship of Wundt and Bühler, the aim here will be to give particular attention to the relevance of their respective accounts for current philosophical and linguistic research (...) on gesture. Building off of Bühler, we can offer an alternative to the psychologistic and solipsistic model of gestural expression that can be found in Wundt and that seems to be resurgent today in work by McNeil and others. Via Bühler’s notions of diacrisis and of the underlying functions that guide human communication, we propose an understanding of the relationship between gestures and speech that aims to render accurately both the highly contextualised and the highly structured conditions of their mutual employment. (shrink)

Georges Didi-Huberman, Uprisings (Paris: Gallimard, 2016), 232 pp, ISBN 9782072697296 Georges Didi-Huberman's Uprisings is at once heavy and light. It weaves complex (and sometimes burdensome) political traditions and histories of thought concerned with uprising, rebellion and revolution, with bursts of poetry which, it seems, are meant to take flight off the page like the butterfly tracts that Didi-Huberman so admires. It is also vast in its scale and depth, tracing histories of uprising and rebellion from Atlas, Prometheus and Eve, through (...) to future uprisings which are as yet unknown and, as the author reminds us, endless: 'the uprising is a gesture without end' (p. 17). (shrink)

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

The goal of the article is to offer a framework against which relations between gesture and sign can be systematically explored beyond the current literature. It does so by a) reconstructing the history of the discussion in the field of gesture studies, focusing on three leading positions (Kendon, McNeill, Goldin-Meadow); and b) by formulating a position to illustrate how this can be achieved. The paper concludes by emphasizing the need for systematic cross-linguistic research on multimodal use of language (...) in its signed and spoken forms. (shrink)

How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate (...) the relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier to blur the distinction between sign and gesture, we argue that distinguishing between sign and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

사진은 사진의 발명 이전의 이미지들과 비교할 때, 무엇을 지시하고 있는지가 너무나 명확하게 드러나 있는 것처럼 보여서, 이미지를 생산한 사람의 의도가 그 이면에 숨겨져 있을 여지가 없는 것으로 여겨졌다. 다시 말해 사진 역시 전통적 그림과 같은 이차원 평면의 이미지이긴 하지만, 전통적 그림의 의미가 다의적(konnotativ)일 수 있는 것과 달리, 사진은 마치 숫자처럼 그 지시대상이 명확한 일의적(denotativ) 이미지로 간주되어왔다. 이는 예술적 측면에서는 특히 회화와 비교되며 폄하되는 요소로 작용해 왔고, 기술적 측면에서는 때때로 과장되게 수용되어 사진을 마치 세상을 투영하고 있는 창문처럼 여기게 하는 근거가 되어왔다.BR빌렘 (...) 플루서(Vilém Flusser)는 이러한 현상에 대해 사진을 전통적 그림과 동일한 존재 층위에 위치시킨 결과로 인한 오해라고 보았다. 이는 이미지와 실재라는 관계항 속에서 새로운 이미지인 사진에 대해, 새로운 존재론적 질문이 제기되어야 함을 의미하는 것이라 하겠다. 기존의 사진 이론들이 사진에 대해 ‘어떻게 실제적으로 사진이 존재하는가’라던지, 혹은 ‘하나의 보편적인 사진 언어가 존재하는가’와 같은 질문에 집중해왔던 것 모두, 사진 의미의 일의성이라는 특징이 전제되어 있기 때문이며, 이러한 전제는 사진이 그 원본과의 관계, 즉 지표성(Indexikalität)이라는 관점에서 해석되어 왔음을 보여주는 예라 하겠다.BR그러나 플루서는 이러한 방식의 사진 이해에 비판적 견해를 가지고서, 사진을 지표성의 관점에서가 아니라, 현상학적 관점에서 관찰하고자 하였다. 그리고 이를 통해 사진을 통한 새로운 철학적 방법론을 모색하고자 하였다. 이는 후설의 현상학적 개념, 예를 들어 지향성이나 판단중지와 같은 개념들을 자신의 사진 철학에 수용함으로써 이뤄졌다.BR이에 본고는 ‘사진 촬영자의 몸짓(fotografische Geste)’ 개념을 통해 플루서가 사진을 지표성이라는 관점에서 벗어나, 어떻게 후설의 현상학에 접목시키고 있는지에 대해서 분석함으로써, 플루서에 의해 시도된 사진에 대한 새로운 철학적 해석에 대해 고찰하는 것을 목적으로 한다. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

Speakers of different languages (e.g., English vs. Turkish) show a binary split in how they package and order components of a motion event in speech and co‐speech gesture but not in silent gesture. In this study, we focused on Mandarin Chinese, a language that does not follow the binary split in its expression of motion in speech, and asked whether adult Chinese speakers would follow the language‐specific speech patterns in co‐speech but not silent gesture, thus showing a (...) pattern akin to Turkish and English adult speakers in their description of animated motion events. Our results provided evidence for this pattern, with Chinese—as well as English and Turkish—speakers following language‐specific patterns in speech and co‐speech gesture but not in silent gesture. Our results provide support for the “thinking‐for‐speaking” account, namely that language influences thought only during online, but not offline, production of speech. (shrink)

Gestures is a collection of essays that proposes a daring and ambitious new conception of human behavior. Defining gesture as “a movement of the body or of a tool attached to the body for which there is no satisfactory causal explanation,” Flusser moves around the topic from different points of view, angles and distances: sometimes he zooms in on a modest, ordinary movement like taking a photograph, shaving, or smoking a pipe. Sometimes he pulls back to look at something (...) as vast and varied as human “making,” embracing everything from the fashioning of simple tools to mass manufacturing. Holding firmly to basic phenomenological principles – that consciousness is always consciousness of something, that we know others by reference to ourselves, he claims that we constantly “read” states of mind, i.e. thoughts, intentions, emotions, from gestures; still we lack a theory about how this happens. Gestures takes a first step. It offers alternatives to theories by now so veiled by habit and myth that we are hardly conscious of them, and so hardly realize that they are failing. These include the assumption that we can “know” something without being affected by it, the belief that science is value-free, and the common conviction that science and art are fundamentally different activities. (shrink)

Temporal perspectives allow us to place ourselves and temporal events on a timeline, making it easier to conceptualize time. This study investigates how we take different temporal perspectives in our temporal gestures. We asked participants (n = 36) to retell temporal scenarios written in the Moving‐Ego, Moving‐Time, and Time‐Reference‐Point perspectives in spontaneous and encouraged gesture conditions. Participants took temporal perspectives mostly in similar ways regardless of the gesture condition. Perspective comparisons showed that temporal gestures of our participants resonated (...) better with the Ego‐ (i.e., Moving‐Ego and Moving‐Time) versus Time‐Reference‐Point distinction instead of the classical Moving‐Ego versus Moving‐Time contrast. Specifically, participants mostly produced more Moving‐Ego and Time‐Reference‐Point gestures for the corresponding scenarios and speech; however, the Moving‐Time perspective was not adopted more than the others in any condition. Similarly, the Moving‐Time gestures did not favor an axis over the others, whereas Moving‐Ego gestures were mostly sagittal and Time‐Reference‐Point gestures were mostly lateral. These findings suggest that we incorporate temporal perspectives into our temporal gestures to a considerable extent; however, the classical Moving‐Ego and Moving‐Time classification may not hold for temporal gestures. (shrink)

In dynamic theories of presupposition, a trigger pp′ with presupposition p and at-issue component p′ comes with a requirement that p should be entailed by the local context of pp′. We argue that some co-speech gestures should be analyzed within a presuppositional framework, but with a twist: an expression p co-occurring with a co-speech gesture G with content g comes with the requirement that the local context of p should guarantee that p entails g; we call such assertion-dependent presuppositions (...) ‘cosuppositions’. We show that this analysis can be combined with earlier theories of local contexts to account for complex patterns of gesture projection in quantified and in attitudinal contexts, and we compare our account to two potential alternatives: one based on supervaluations, and one, due to Cornelia Ebert, that treats co-speech gestures as supplements. We argue that the latter is correct, but for ‘post-speech’ gestures, rather than for co-speech gestures. (shrink)

There has long been interest in why languages are shaped the way they are, and in the relationship between sign language and gesture. In sign languages, entity classifiers are handshapes that encode how objects move, how they are located relative to one another, and how multiple objects of the same type are distributed in space. Previous studies have shown that hearing adults who are asked to use only manual gestures to describe how objects move in space will use gestures (...) that bear some similarities to classifiers. We investigated how accurately hearing adults, who had been learning British Sign Language for 1–3 years, produce and comprehend classifiers in locative and distributive constructions. In a production task, learners of BSL knew that they could use their hands to represent objects, but they had difficulty choosing the same, conventionalized, handshapes as native signers. They were, however, highly accurate at encoding location and orientation information. Learners therefore show the same pattern found in sign-naïve gesturers. In contrast, handshape, orientation, and location were comprehended with equal accuracy, and testing a group of sign-naïve adults showed that they too were able to understand classifiers with higher than chance accuracy. We conclude that adult learners of BSL bring their visuo-spatial knowledge and gestural abilities to the tasks of understanding and producing constructions that contain entity classifiers. We speculate that investigating the time course of adult sign language acquisition might shed light on how gesture became conventionalized during the genesis of sign languages. (shrink)

Speakers frequently perform representational gestures to depict concepts in an iconic fashion. For example, a speaker may hold her index finger and thumb apart to indicate the size of a matchstick. However, the process by which a physical handshape is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which we call “gesture form.” We provide quantitative (...) evidence for several key properties that play a role in this process. First, “profiling,” the ability to focus on a structural subunit within the complex form of the physical hand. Second, “perspective,” for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity,” the fact that gestures focus on specific spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible. (shrink)

For Greek antiquity, the question of right or fitting measure constituted the very heart of both ethics and politics. But can the Good of the ethical life and the Justice of the political be reduced to measurement and calculation? If they are matters of measure, are they not also absolutely immeasurable? In critical dialogue with texts by Plato, Hölderlin, Rilke, Heidegger, Benjamin, Adorno, Marx, Merleau-Ponty, Levinas, and Levi, the author argues that the question of measure has become ever more urgent (...) in the context of a modernity pressured by the conditions of a technological economy and a relativism that threatens to destroy a vital sense of moral responsibility and the commitment to justice that underlies the possibility of freedom. Conceived as a task for the “metaphysics” of memory, this book explores the normative problematic of measure, bringing its deeply buried redemptive promise to appearance in our gestures, uses and abuses of the hands, the dialectic of tact, and the manners of social existence. (shrink)

The ubiquitous human practice of spontaneously gesturing while speaking demonstrates the embodiment, embeddedness, and sociality of cognition. The present essay takes gestural practice to be a paradigmatic example of a more general claim: human cognition is social insofar as our embedded, intelligent, and interacting bodies select and construct meaning in a way that is intersubjectively constrained and defeasible. Spontaneous co-speech gesture is markedly interesting because it at once confirms embodied aspects of linguistic meaning-making that formalist and linguistic turn-type philosophical (...) approaches fail to appreciate, and it also forefronts intersubjectivity as an inherent and inherently normative dimension of communicative action. Co-speech hand gestures, as linguistically meaningful speech acts, demonstrate both sedimentation and spontaneity (in the sense of Maurice Merleau-Ponty’s dialectic of linguistic expression ( 2002 )), or features of convention and nonconvention in a Gricean sense ( 1989 ). Yet neither pragmatic nor classic phenomenological approaches to communication can accommodate the practice of co-speech hand gesturing without some rehabilitation and reorientation. Pragmatic criteria of intersubjectivity, normativity, and rationality need to confront the non-propositional and nonverbal meaning-making of embodied encounters. Phenomenological treatments of expression and intersubjectivity must consider the normative nature of high-order social practices like language use. Reciprocally critical exchanges between these traditions and gesture studies yield an improved philosophy that treats language as a multi-modal medium for collaborative meaning achievement. The proper paradigm for these discussions is found in enactive approaches to social cognition. Co-speech hand gestures are first and foremost emergent elements of social interaction, not the external whirring of an isolated internal consciousness. In contrast to current literature that frequently presents gestures as uncontrollable bodily upsurge or infallible imagistic phenomenon that drives and dances with verbal or “linguistic” convention (McNeill 1992 , 2005 ), I suggest that we study gestures as dynamic, embodied, and shared tools for collaborative sense-making. (shrink)

Analogy researchers do not often examine gesture, and gesture researchers do not often borrow ideas from the study of analogy. One borrowable idea from the world of analogy is the importance of distinguishing between attributes and relations. Gentner observed that some metaphors highlight attributes and others highlight relations, and called the latter analogies. Mirroring this logic, we observe that some metaphoric gestures represent attributes and others represent relations, and propose to call the latter analogical gestures. We provide examples (...) of such analogical gestures and show how they relate to the categories of iconic and metaphoric gestures described previously. Analogical gestures represent different types of relations and different degrees of relational complexity, and sometimes cohere into larger analogical models. Treating analogical gestures as a distinct phenomenon prompts new questions and predictions, and illustrates one way that the study of gesture and the study of analogy can be mutually informative. (shrink)

This paper presents a proposal for the description of gesture phases derived from articulatory characteristics observable in their execution. Based on the results of an explorative study examining the execution of gesture phases of ten German speakers, the paper presents two sets of articulatory features, i.e., distinctive and additional features by which gesture phases are characterized from a context-independent and context-sensitive point of view. It will be shown that gesture phases show a particular distribution of the (...) features, thus distinguishing one phase from another. Furthermore, changes in the execution of phases in linear successions can be described by means of features. Contrary to other accounts, whose focus on gesture phases is primarily in relation to speech and/or adjacent phases, this proposal concentrates on the visible physical characteristics of gesture phases. (shrink)

Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that (...) higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS—a form of congenital bilateral facial paralysis—can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI’s prediction and show how MS cases offer compelling reasons for instead adopting MI’s pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition. (shrink)

Empirical studies of gesture in a subject who has lost proprioception and the sense of touch from the neck down show that specific aspects of gesture remain normal despite abnormal motor processes for instrumental movement. The experiments suggest that gesture, as a linguistic phenomenon, is not reducible to instrumental movement. They also support and extend claims made by Merleau-Ponty concerning the relationship between language and cognition. Gesture, as language, contributes to the accomplishment of thought.

Most language learners have difficulties acquiring the phonemes of a second language (L2). Unfortunately, they are often judged on their L2 pronunciation, and segmental inaccuracies contribute to miscommunication. Therefore, we aim to determine how to facilitate phoneme acquisition. Given the close relationship between speech and co-speech gesture, previous work unsurprisingly reports that gestures can benefit language acquisition, e.g., in (L2) word learning. However, gesture studies on L2 phoneme acquisition present contradictory results, implying that both specific properties of gestures (...) and phonemes used in training, and their combination, may be relevant. We investigated the effect of phoneme and gesture complexity on L2 phoneme acquisition. In a production study, Dutch natives received instruction on the pronunciation of two Spanish phonemes, /u/ and /θ/. Both are typically difficult to produce for Dutch natives because their orthographic representation differs between both languages. Moreover, /θ/ is considered more complex than /u/, since the Dutch phoneme inventory contains /u/ but not /θ/. The instruction participants received contained Spanish examples presented either via audio-only, audio-visually without gesture, audio-visually with a simple, pointing gesture, or audio-visually with a more complex, iconic gesture representing the relevant speech articulator(s). Preceding and following training, participants read aloud Spanish sentences containing the target phonemes. In a perception study, Spanish natives rated the target words from the production study on accentedness and comprehensibility. Our results show that combining gesture and speech in L2 phoneme training can lead to significant improvement in L2 phoneme production, but both gesture and phoneme complexity affect successful learning: Significant learning only occurred for the less complex phoneme /u/ after seeing the more complex iconic gesture, whereas for the more complex phoneme /θ/, seeing the more complex gesture actually hindered acquisition. The perception results confirm the production findings and show that items containing /θ/ produced after receiving training with a less complex pointing gesture are considered less foreign-accented and more easily comprehensible as compared to the same items after audio-only training. This shows that gesture can facilitate task performance in L2 phonology acquisition, yet complexity affects whether certain gestures work better for certain phonemes than others. (shrink)

Gottlob Frege’s conception of works of art has received scant notice in the literature. This is a pity since, as this paper undertakes to reveal, his innovative philosophy of language motivated a theoretically and historically consequential, yet unaccountably marginalized Wittgenstinian line of inquiry in the domain of aesthetics. The element of Frege’s approach that most clearly inspired this development is the idea that only complete sentences articulate thoughts and that what sentences in works of drama and literary art express are (...) ‘mock thoughts’ (Schiengedanken). The early Wittgenstein closely followed Frege’s lead on this theme. One sees this, for example, in the Tractatus, where Wittgenstein announces that only sentential propositions model (‘picture’) states of affairs whereas works of art are objects we perceive sub specie aeternitatis (1961, 83). By the 1930s, however, Wittgenstein began to revise his view beyond his initial Frege-inspired standpoint. He came to insist that works of art can convey thoughts as well, but that thoughts do not model (picture) the world of facts and hence do not convey information about measurable objects and events. Rather, his contention was that aesthetically configured thoughts that artworks communicate impart information about our perspective on reality and reconfigure our view of life. To be more explicit, successful (gelungene) or ‘good’ works of art (ibid.), in Wittgenstein’s view, can supply aesthetically instructive ‘gestures’ that open to living experience promising new ways of being. It is in this respect, he held, that artists ‘have something to teach’ (1980, 36). (shrink)

In debates about the proper analysis of demonstrative expressions, ostensive gestures and speaker intentions are often seen as competing for primary importance in securing reference. Underlying some of these debates is the mistaken assumption that ostensive gestures always make the demonstrated object maximally salient to interlocutors. When we abandon this assumption and focus on an object’s mutually-recognized salience itself, rather than on how the object came to be salient, we can work towards a more promising analysis with a uniform treatment (...) of demonstrative reference whether or not there is an ostensive gesture, and whether reference is ordinary or deferred. (shrink)

Language and speech depend on a relatively well defined neural circuitry, located predominantly in the left hemisphere. In this article, I discuss the origin of the speech circuit in early humans, as an expansion of an auditory-vocal articulatory network that took place after the last common ancestor with the chimpanzee. I will attempt to converge this perspective with aspects of the Mirror System Hypothesis, particularly those related to the emergence of a meaningful grammar in human communication. Basically, the strengthening of (...) auditory-vocal connectivity via the arcuate fasciculus and related tracts generated an expansion of working memory capacity for vocalizations, that was key for learning complex utterances. This process was concomitant with the development of a robust interface with visual working memory, both in the dorsal and ventral streams of auditory and visual processing. This enabled the bidirectional translation of sequential codes into hierarchical visual representations, through the development of a multimodal interface between both systems. (shrink)