It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the Peircian (...) notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)

This article addresses a classical question: Can a machine use language meaningfully and if so, how can this be achieved? The first part of the paper is mainly philosophical. Since meaning implies intentionality on the part of the language user, artificial systems which obviously lack intentionality will be `meaningless'. There is, however, no good reason to assume that intentionality is an exclusively biological property and thus a robot with bodily structures, interaction patterns and development similar to those of human beings (...) would constitute a system possibly capable of meaning – a conjecture supported through a Wittgenstein-inspired thought experiment. The second part of the paper focuses on the empirical and constructive questions. Departing from the principle of epigenesis stating that during every state of development new structure arises on the basis of existing structure plus various sorts of interaction, a model of human cognitive and linguistic development is proposed according to which physical, social and linguistic interactions between the individual and the environment have their respective peaks in three consecutive stages of development: episodic, mimetic and symbolic. The transitions between these stages are qualitative, and bear a similarity to the stages in phylogenesis proposed by Donald and Deacon. Following the principle of epigenetic development, robotogenesis could possibly recapitulate ontogenesis, leading to the emergence of intentionality, consciousness and meaning. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 4 Seiten: 559-572.

Experientialist semantics has contributed to a broader notion of linguistic meaning by emphasizing notions such as construal, perspective, metaphor, and embodiment, but has suffered from an individualist concept of meaning and has conflated experiential motivations with conventional semantics. We argue that these problems can be redressed by methods and concepts from phenomenology, on the basis of a case study of sentences of non-actual motion such as “The mountain range goes all the way from Mexico to Canada.” Through a phenomenological reanalysis (...) of proposals of Talmy, Langacker, and Matlock, we show that non-actual motion is both experientially and linguistically non-unitary. At least three different features of human consciousness—enactive perception, visual scanning, and imagination—constitute experiential motivations for non-actual motion sentences, and each of these could be related to phenomenological analyses of human intentionality. The second problem is addressed by proposing that the experiential motivations of non-actual motion sentences can be viewed as sedimented through “passive” processes of acquisition and social transmission and that this implies an interactive loop between experience and language, yielding losses in terms of original experience, but gains in terms of communal signification. Something that is underestimated by phenomenology is that what is sedimented are not only intentional objects such as states of affairs, but aspects of how they are given, i.e., the original, temporal, bodily experiences themselves. Since cognitive semantics has emphasized such aspects of meaning, we suggest that phenomenology can itself benefit from experientialist semantics, especially when it turns its focus from prepredicative to predicative, linguistic intentionality. (shrink)

I argue that an evolutionary adaptation for bodily mimesis, the volitional use of the body as a representational devise, is the “small difference” that gave rise to unique and yet pre-linguistic features of humanity such as imitation, pedagogy, intentional communication and the possibility of a cumulative, representational culture. Furthermore, it is this that made the evolution of language possible. In support for the thesis that speech evolved atop bodily mimesis and a transitional multimodal protolanguage, I review evidence for the extensive (...) presence of sound-symbolism in modern languages, for its psychological reality in adults, and for its contribution to language acquisition in children. On a meta-level, the argument is that dividing human cognitive-semiotic evolution into a sequence of stages is crucial for resolving classical dichotomies concerning human nature and language, which are both natural and cultural, both continuous with and discontinuous from those of animals. (shrink)

A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of (...) interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual and multimodal. Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario. (shrink)

Following the levels of intentionality and semiosis distinguished by the Semiotic Hierarchy, and the distinction between original agency and enhanced agency, we propose a model of an agency hierarchy, consisting of six layers. Consistent with the phenomenological orientation of cognitive semiotics, a central claim is that agency and subjectivity are complementary aspects of intentionality. Hence, there is no agency without at least the minimal sense/feeling of agency. This perspective rules out all artefacts as genuine agents, as well as simple organisms, (...) since it is highly unlikely that e.g. bacteria have any first-person perspective. Using this model, we review and assess recent proposals on the nature of agency from cognitive science, and neuroscience, and draw conclusions on how to incorporate aspects of them within a synthetic cognitive-semiotic framework. (shrink)

The first hurdle to overcome in approaching the complex topic of the relation between language and consciousness is terminology. So let me begin, in good philosophical style, by explaining the senses in which I use the three lexical terms in the title. Luckily I need not explain those of the three grammatical words the, of, and on: there is probably a minor library of semantic literature devoted to that. I need not, since I both know their meanings pre-theoretically, and know (...) that my readers, as users of English, know them. The significance of this simple fact concerning the meaning of all everyday words, in everyday constructs, is something that I will return to, since it plays a central role in the argument in Section 2. However, with abstract, theoretically loaded nominalizations such as dependence, language, and most of all consciousness, we need to beware since we cannot assume common knowledge -- myriads of misunderstandings arise since we mean somewhat different 'things' by them. I start with the easiest, by which I mean specifically ' dependence of language on consciousness', explaining only afterward what I mean by the latter terms. I ask the reader to bear this circularity with me. (shrink)

Human communication can be either monosemiotic or polysemiotic, depending on whether it combines ensembles of representations from one or more semiotic systems such as language, gesture and depiction. Each semiotic system has its unique storytelling potentials, which makes intersemiotic translation from one system to another challenging. We investigated the influence of the source semiotic system, realised in speech and a sequence of pictures, respectively, on the way the same story was retold using speech and co-speech gestures. The story was the (...) content of the picture book Frog, Where Are You?. A group of Finnish speakers saw the story in pictures, and another group heard it in matched oral narration. Each participant retold the story to an addressee and all narrations were video-recorded and analysed for both speech and gestures. Given the high degree of iconicity in depiction, we expected more iconic gestures in the narratives translated from pictures than in those translated from speech. Conversely, we expected greater narrative coherence in the narratives translated from speech. The results showed that more iconic gestures were produced in the narratives translated from speech, but these were primarily not from the enactment subtype. As expected, iconic enactments were more frequent in the narratives translated from the story presented in pictures. The narratives produced by participants who had only heard the story did not have a greater variety of connective devices, yet the type of devices differed slightly between the groups. Together with some additional differences between the groups that had not been anticipated, the results indicate that a story presented in different semiotic systems tends to be translated into different polysemiotic narratives. (shrink)

We find that the nature and origin of the proposed “dialogical cognitive representations” in the target article is not sufficiently clear. Our proposal is that (triadic) bodily mimesis and in particular mimetic schemas – prelinguistic representational, intersubjective structures, emerging through imitation but subsequently interiorized – can provide the necessary link between private sensory-motor experience and public language. In particular, we argue that shared intentionality requires triadic mimesis.

Every day we make choices, but our degree of investment in them differs, both in terms of pre-verbal experience and verbal justification. In an earlier experimental study, participants were asked to pick the more attractive one among two human faces, and among two abstract figures, and later to provide verbal motivations for these choices. They did not know that in some of the cases their choices were manipulated. Against claims about our unreliability as conscious agents, the study found that in (...) about half the cases the manipulations were detected. In the present study, we investigated whether varying degrees of choice investment could be an explanatory factor for such findings. We analysed the verbal justifications of the participants along a set of semantic categories, based on theoretical ideas from phenomenology and cognitive linguistics, and formulated a matrix of eleven markers of choice investment. We predicted a greater degree of investment when motivating choices of faces than figures, manipulated than actual choices, and detected than non-detected manipulations. These predictions were confirmed, but with various strength. This allows us to argue for both consilience and differences between pre-verbal choice investment and the corresponding verbal motivations of the choices made, and thus for conscious awareness of choice making. (shrink)

We focus on two problems with the evolutionary scenario proposed: (1) It bypasses the question of the origins of the communicative and semiotic features that make language distinct from, say, pleasant but meaningless sounds. (2) It does little to explain the absence of language in, for example, chimpanzees: Most of the selection pressures invoked apply just as strongly to chimps. We suggest how these problems could possibly be amended.

The goal of the present deliverable is to provide a developmental analysis of attentional intersubjectivity, which, as we show below, is a more inclusive notion than the more commonly used term ‘joint attention’. The use of the term ‘joint attention’ is not consistent in the literature, sometimes referring to the general phenomenon when two or more subjects attend to the same target, sometimes to more reciprocal situations in which the subjects also are aware of attending to the same target. Most (...) often solely visual attention has been described, but implicitly the descriptions have been thought to generalize to other modalities. The concepts introduced in this deliverable constitute an attempt to construct a coherent framework that will allow for distinguishing and comparing the range of behaviours that in the literature have been addressed as ‘joint attention’ behaviours. By attentional intersubjectivity we refer to the general case when two or more subjects simultaneously focus their attention on the same target. Attentional intersubjectivity will be further divided into types, according to which behaviours that are typically associated with attentional intersubjectivity occur during the interaction, and in which combinations. The result is that the over-all behaviour of the subjects during different types of attentional intersubjectivity differs. Our contentions are that: a) the types of attentional intersubjectivity identified in this report build on each other cumulatively and constitute different levels, and b) these levels correspond to evolutionary and developmental stages. In saying that the types are cumulative we mean that there is a progress by successive stages where each type is causally dependent on the type preceding it, and, furthermore, has increased in complexity as compared to previous types. While attentional intersubjectivity involves several perceptual modalities, for practical reasons, this study primarily concerns the visual modality. Our analysis is, however, intended also to be applicable to these other modalities. (shrink)

Would metaphors used in the context of psychotherapy by people who experience various forms of anxiety disorders differ from those used by people who experience stress? We investigated this question with the help of the Motivation & Sedimentation Model (MSM), a theory of meaning-making developed within the synthetic new discipline of cognitive semiotics. The analysis of a sample of ten transcripts of psychotherapy sessions concerning the topic of anxiety, and a comparable sample concerning stress, showed a significantly stronger proportion of (...) conventionalized metaphors in the stress sample, and a marginally significant difference in the number of innovative metaphors in the anxiety sample. These results suggest that lived experience of an anxiety disorder or another form of maladaptive anxiety affects metaphorical meaning-making, and manifests itself in spontaneous metaphor use. Furthermore, as a result of the conceptual and the empirical investigations of the topic, we propose novel theoretical and operational definitions of the notion of metaphoricity. (shrink)

Gasparyan sketches a semiotic theory where world, mind and language - the latter a stand-in for all semiosis - collapse into one “recursive” whole. In contrast, cognitive semiotics ….