I argue that an evolutionary adaptation for bodily mimesis, the volitional use of the body as a representational devise, is the “small difference” that gave rise to unique and yet pre-linguistic features of humanity such as imitation, pedagogy, intentional communication and the possibility of a cumulative, representational culture. Furthermore, it is this that made the evolution of language possible. In support for the thesis that speech evolved atop bodily mimesis and a transitional multimodal protolanguage, I review evidence for the extensive (...) presence of sound-symbolism in modern languages, for its psychological reality in adults, and for its contribution to language acquisition in children. On a meta-level, the argument is that dividing human cognitive-semiotic evolution into a sequence of stages is crucial for resolving classical dichotomies concerning human nature and language, which are both natural and cultural, both continuous with and discontinuous from those of animals. (shrink)
It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the Peircian (...) notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)
This article addresses a classical question: Can a machine use language meaningfully and if so, how can this be achieved? The first part of the paper is mainly philosophical. Since meaning implies intentionality on the part of the language user, artificial systems which obviously lack intentionality will be `meaningless'. There is, however, no good reason to assume that intentionality is an exclusively biological property and thus a robot with bodily structures, interaction patterns and development similar to those of human beings (...) would constitute a system possibly capable of meaning – a conjecture supported through a Wittgenstein-inspired thought experiment. The second part of the paper focuses on the empirical and constructive questions. Departing from the principle of epigenesis stating that during every state of development new structure arises on the basis of existing structure plus various sorts of interaction, a model of human cognitive and linguistic development is proposed according to which physical, social and linguistic interactions between the individual and the environment have their respective peaks in three consecutive stages of development: episodic, mimetic and symbolic. The transitions between these stages are qualitative, and bear a similarity to the stages in phylogenesis proposed by Donald and Deacon. Following the principle of epigenetic development, robotogenesis could possibly recapitulate ontogenesis, leading to the emergence of intentionality, consciousness and meaning. (shrink)
Experientialist semantics has contributed to a broader notion of linguistic meaning by emphasizing notions such as construal, perspective, metaphor, and embodiment, but has suffered from an individualist concept of meaning and has conflated experiential motivations with conventional semantics. We argue that these problems can be redressed by methods and concepts from phenomenology, on the basis of a case study of sentences of non-actual motion such as “The mountain range goes all the way from Mexico to Canada.” Through a phenomenological reanalysis (...) of proposals of Talmy, Langacker, and Matlock, we show that non-actual motion is both experientially and linguistically non-unitary. At least three different features of human consciousness—enactive perception, visual scanning, and imagination—constitute experiential motivations for non-actual motion sentences, and each of these could be related to phenomenological analyses of human intentionality. The second problem is addressed by proposing that the experiential motivations of non-actual motion sentences can be viewed as sedimented through “passive” processes of acquisition and social transmission and that this implies an interactive loop between experience and language, yielding losses in terms of original experience, but gains in terms of communal signification. Something that is underestimated by phenomenology is that what is sedimented are not only intentional objects such as states of affairs, but aspects of how they are given, i.e., the original, temporal, bodily experiences themselves. Since cognitive semantics has emphasized such aspects of meaning, we suggest that phenomenology can itself benefit from experientialist semantics, especially when it turns its focus from prepredicative to predicative, linguistic intentionality. (shrink)
A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of (...) interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual and multimodal. Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario. (shrink)
The first hurdle to overcome in approaching the complex topic of the relation between language and consciousness is terminology. So let me begin, in good philosophical style, by explaining the senses in which I use the three lexical terms in the title. Luckily I need not explain those of the three grammatical words the, of, and on: there is probably a minor library of semantic literature devoted to that. I need not, since I both know their meanings pre-theoretically, and know (...) that my readers, as users of English, know them. The significance of this simple fact concerning the meaning of all everyday words, in everyday constructs, is something that I will return to, since it plays a central role in the argument in Section 2. However, with abstract, theoretically loaded nominalizations such as dependence, language, and most of all consciousness, we need to beware since we cannot assume common knowledge -- myriads of misunderstandings arise since we mean somewhat different 'things' by them. I start with the easiest, by which I mean specifically ' dependence of language on consciousness', explaining only afterward what I mean by the latter terms. I ask the reader to bear this circularity with me. (shrink)
We find that the nature and origin of the proposed “dialogical cognitive representations” in the target article is not sufficiently clear. Our proposal is that (triadic) bodily mimesis and in particular mimetic schemas – prelinguistic representational, intersubjective structures, emerging through imitation but subsequently interiorized – can provide the necessary link between private sensory-motor experience and public language. In particular, we argue that shared intentionality requires triadic mimesis.
We focus on two problems with the evolutionary scenario proposed: (1) It bypasses the question of the origins of the communicative and semiotic features that make language distinct from, say, pleasant but meaningless sounds. (2) It does little to explain the absence of language in, for example, chimpanzees: Most of the selection pressures invoked apply just as strongly to chimps. We suggest how these problems could possibly be amended.
The goal of the present deliverable is to provide a developmental analysis of attentional intersubjectivity, which, as we show below, is a more inclusive notion than the more commonly used term ‘joint attention’. The use of the term ‘joint attention’ is not consistent in the literature, sometimes referring to the general phenomenon when two or more subjects attend to the same target, sometimes to more reciprocal situations in which the subjects also are aware of attending to the same target. Most (...) often solely visual attention has been described, but implicitly the descriptions have been thought to generalize to other modalities. The concepts introduced in this deliverable constitute an attempt to construct a coherent framework that will allow for distinguishing and comparing the range of behaviours that in the literature have been addressed as ‘joint attention’ behaviours. By attentional intersubjectivity we refer to the general case when two or more subjects simultaneously focus their attention on the same target. Attentional intersubjectivity will be further divided into types, according to which behaviours that are typically associated with attentional intersubjectivity occur during the interaction, and in which combinations. The result is that the over-all behaviour of the subjects during different types of attentional intersubjectivity differs. Our contentions are that: a) the types of attentional intersubjectivity identified in this report build on each other cumulatively and constitute different levels, and b) these levels correspond to evolutionary and developmental stages. In saying that the types are cumulative we mean that there is a progress by successive stages where each type is causally dependent on the type preceding it, and, furthermore, has increased in complexity as compared to previous types. While attentional intersubjectivity involves several perceptual modalities, for practical reasons, this study primarily concerns the visual modality. Our analysis is, however, intended also to be applicable to these other modalities. (shrink)
Human communication can be either monosemiotic or polysemiotic, depending on whether it combines ensembles of representations from one or more semiotic systems such as language, gesture and depiction. Each semiotic system has its unique storytelling potentials, which makes intersemiotic translation from one system to another challenging. We investigated the influence of the source semiotic system, realised in speech and a sequence of pictures, respectively, on the way the same story was retold using speech and co-speech gestures. The story was the (...) content of the picture book Frog, Where Are You?. A group of Finnish speakers saw the story in pictures, and another group heard it in matched oral narration. Each participant retold the story to an addressee and all narrations were video-recorded and analysed for both speech and gestures. Given the high degree of iconicity in depiction, we expected more iconic gestures in the narratives translated from pictures than in those translated from speech. Conversely, we expected greater narrative coherence in the narratives translated from speech. The results showed that more iconic gestures were produced in the narratives translated from speech, but these were primarily not from the enactment subtype. As expected, iconic enactments were more frequent in the narratives translated from the story presented in pictures. The narratives produced by participants who had only heard the story did not have a greater variety of connective devices, yet the type of devices differed slightly between the groups. Together with some additional differences between the groups that had not been anticipated, the results indicate that a story presented in different semiotic systems tends to be translated into different polysemiotic narratives. (shrink)
Gasparyan sketches a semiotic theory where world, mind and language - the latter a stand-in for all semiosis - collapse into one “recursive” whole. In contrast, cognitive semiotics ….
