Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 4 Seiten: 559-572.

Following the levels of intentionality and semiosis distinguished by the Semiotic Hierarchy, and the distinction between original agency and enhanced agency, we propose a model of an agency hierarchy, consisting of six layers. Consistent with the phenomenological orientation of cognitive semiotics, a central claim is that agency and subjectivity are complementary aspects of intentionality. Hence, there is no agency without at least the minimal sense/feeling of agency. This perspective rules out all artefacts as genuine agents, as well as simple organisms, (...) since it is highly unlikely that e.g. bacteria have any first-person perspective. Using this model, we review and assess recent proposals on the nature of agency from cognitive science, and neuroscience, and draw conclusions on how to incorporate aspects of them within a synthetic cognitive-semiotic framework. (shrink)

This article addresses a classical question: Can a machine use language meaningfully and if so, how can this be achieved? The first part of the paper is mainly philosophical. Since meaning implies intentionality on the part of the language user, artificial systems which obviously lack intentionality will be `meaningless'. There is, however, no good reason to assume that intentionality is an exclusively biological property and thus a robot with bodily structures, interaction patterns and development similar to those of human beings (...) would constitute a system possibly capable of meaning – a conjecture supported through a Wittgenstein-inspired thought experiment. The second part of the paper focuses on the empirical and constructive questions. Departing from the principle of epigenesis stating that during every state of development new structure arises on the basis of existing structure plus various sorts of interaction, a model of human cognitive and linguistic development is proposed according to which physical, social and linguistic interactions between the individual and the environment have their respective peaks in three consecutive stages of development: episodic, mimetic and symbolic. The transitions between these stages are qualitative, and bear a similarity to the stages in phylogenesis proposed by Donald and Deacon. Following the principle of epigenetic development, robotogenesis could possibly recapitulate ontogenesis, leading to the emergence of intentionality, consciousness and meaning. (shrink)

We discuss four interconnected issues that we believe have hindered investigations into how language may affect thinking. These have had a tendency to reappear in the debate concerning linguistic relativity over the past decades, despite numerous empirical findings. The first is the claim that it is impossible to disentangle language from thought, making the question concerning “influence” pointless. The second is the argument that it is impossible to disentangle language from culture in general, and from social interaction in particular, so (...) it is impossible to attribute any differences in the thought patterns of the members of different cultures to language per se. The third issue is the objection that methodological and empirical problems defeat all but the most trivial version of the thesis of linguistic influence: that language gives new factual information. The fourth is the assumption that since language can potentially influence thought from “not at all” to “completely,” the possible forms of linguistic influence can be placed on a cline, and competing theories can be seen as debating the actual position on this cline. We analyze these claims and show that the first three do not constitute in-principle objections against the validity of the project of investigating linguistic influence on thought, and that the last one is not the best way to frame the empirical challenges at hand. While we do not argue for any specific theory or mechanism for linguistic influence on thought, our discussion and the reviewed literature show that such influence is clearly possible, and hence in need of further investigations. (shrink)

A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of (...) interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual and multimodal. Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario. (shrink)

It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be (perceived) similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the (...) Peircian notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)

I argue that an evolutionary adaptation for bodily mimesis, the volitional use of the body as a representational devise, is the “small difference” that gave rise to unique and yet pre-linguistic features of humanity such as imitation, pedagogy, intentional communication and the possibility of a cumulative, representational culture. Furthermore, it is this that made the evolution of language possible. In support for the thesis that speech evolved atop bodily mimesis and a transitional multimodal protolanguage, I review evidence for the extensive (...) presence of sound-symbolism in modern languages, for its psychological reality in adults, and for its contribution to language acquisition in children. On a meta-level, the argument is that dividing human cognitive-semiotic evolution into a sequence of stages is crucial for resolving classical dichotomies concerning human nature and language, which are both natural and cultural, both continuous with and discontinuous from those of animals. (shrink)

Would metaphors used in the context of psychotherapy by people who experience various forms of anxiety disorders differ from those used by people who experience stress? We investigated this question with the help of the Motivation & Sedimentation Model (MSM), a theory of meaning-making developed within the synthetic new discipline of cognitive semiotics. The analysis of a sample of ten transcripts of psychotherapy sessions concerning the topic of anxiety, and a comparable sample concerning stress, showed a significantly stronger proportion of (...) conventionalized metaphors in the stress sample, and a marginally significant difference in the number of innovative metaphors in the anxiety sample. These results suggest that lived experience of an anxiety disorder or another form of maladaptive anxiety affects metaphorical meaning-making, and manifests itself in spontaneous metaphor use. Furthermore, as a result of the conceptual and the empirical investigations of the topic, we propose novel theoretical and operational definitions of the notion of metaphoricity. (shrink)

Experientialist semantics has contributed to a broader notion of linguistic meaning by emphasizing notions such as construal, perspective, metaphor, and embodiment, but has suffered from an individualist concept of meaning and has conflated experiential motivations with conventional semantics. We argue that these problems can be redressed by methods and concepts from phenomenology, on the basis of a case study of sentences of non-actual motion such as “The mountain range goes all the way from Mexico to Canada.” Through a phenomenological reanalysis (...) of proposals of Talmy, Langacker, and Matlock, we show that non-actual motion is both experientially and linguistically non-unitary. At least three different features of human consciousness—enactive perception, visual scanning, and imagination—constitute experiential motivations for non-actual motion sentences, and each of these could be related to phenomenological analyses of human intentionality. The second problem is addressed by proposing that the experiential motivations of non-actual motion sentences can be viewed as sedimented through “passive” processes of acquisition and social transmission and that this implies an interactive loop between experience and language, yielding losses in terms of original experience, but gains in terms of communal signification. Something that is underestimated by phenomenology is that what is sedimented are not only intentional objects such as states of affairs, but aspects of how they are given, i.e., the original, temporal, bodily experiences themselves. Since cognitive semantics has emphasized such aspects of meaning, we suggest that phenomenology can itself benefit from experientialist semantics, especially when it turns its focus from prepredicative to predicative, linguistic intentionality. (shrink)

Human communication is by defaultpolysemiotic: it involves the spontaneous combination of two or moresemiotic systems, the most important ones beinglanguage,gesture, anddepiction. We formulate an original cognitive-semiotic framework for the analysis of polysemiosis, contrasting this with more familiar systems based on the ambiguous term “multimodality.” To be fully explicit, we developed a coding system for the analysis of polysemiotic utterances containing speech, gesture, and drawing, and implemented this in the ELAN video annotation software. We used this to analyze 23 video-recordings of (...) sand drawing performances on Paama, Vanuatu and 20 sand stories of the Pitjantjatjara culture in Central Australia. Methodologically we used theconceptual-empirical loopof cognitive semiotics: our theoretical framework guided general considerations, such as distinguishing between the “tiers” of gesture and depiction, and the three kinds of semiotic grounds (iconic, indexical, symbolic), but the precise decisions on how to operationalize these were made only after extensive work with the material. We describe the coding system in detail and provide illustrative examples from the Paamese and Pitjantjatjara data, remarking on both similarities and differences in the polysemiosis of the two cultural practices. We conclude by summarizing the contributions of the study and point to some directions for future research. (shrink)

Human communication can be either monosemiotic or polysemiotic, depending on whether it combines ensembles of representations from one or more semiotic systems such as language, gesture and depiction. Each semiotic system has its unique storytelling potentials, which makes intersemiotic translation from one system to another challenging. We investigated the influence of the source semiotic system, realised in speech and a sequence of pictures, respectively, on the way the same story was retold using speech and co-speech gestures. The story was the (...) content of the picture book Frog, Where Are You?. A group of Finnish speakers saw the story in pictures, and another group heard it in matched oral narration. Each participant retold the story to an addressee and all narrations were video-recorded and analysed for both speech and gestures. Given the high degree of iconicity in depiction, we expected more iconic gestures (especially enactments) in the narratives translated from pictures than in those translated from speech. Conversely, we expected greater narrative coherence in the narratives translated from speech. The results showed that more iconic gestures were produced in the narratives translated from speech, but these were primarily not from the enactment subtype. As expected, iconic enactments were more frequent in the narratives translated from the story presented in pictures. The narratives produced by participants who had only heard the story did not have a greater variety of connective devices, yet the type of devices differed slightly between the groups. Together with some additional differences between the groups that had not been anticipated, the results indicate that a story presented in different semiotic systems tends to be translated into different polysemiotic narratives. (shrink)

The first hurdle to overcome in approaching the complex topic of the relation between language and consciousness is terminology. So let me begin, in good philosophical style, by explaining the senses in which I use the three lexical terms in the title. Luckily I need not explain those of the three grammatical words the, of, and on: there is probably a minor library of semantic literature devoted to that. I need not, since I both know their meanings pre-theoretically, and know (...) that my readers, as users of English, know them. The significance of this simple fact concerning the meaning of all everyday words, in everyday constructs, is something that I will return to, since it plays a central role in the argument in Section 2. However, with abstract, theoretically loaded nominalizations such as dependence, language, and most of all consciousness, we need to beware since we cannot assume common knowledge -- myriads of misunderstandings arise since we mean somewhat different 'things' by them. I start with the easiest, by which I mean specifically ' dependence of language on consciousness', explaining only afterward what I mean by the latter terms. I ask the reader to bear this circularity with me. (shrink)

In cognitive semiotics, metaphor and metonymy are crucially treated as special forms of sign use. In contrast, researchers in cognitive linguistics have extended the scope of metaphor and metonymy far beyond the traditional understanding of these semiotic figures based on, respectively, iconicity and contiguity into purely mental processes. I argue that this has led to unbounded over-extension, and general confusion about what metaphor and metonymy actually are, and thus on how to be able to reliably identify them in language and (...) other semiotic systems like gesture and depiction. There is therefore an urgent need to constrain the concepts of metaphor and metonymy to more reasonable proportions, and in this article I propose such a more constrained approach, using the Motivation & Sedimentation Model (MSM) of meaning-making. For the purpose, I spell out an integrated definition of metaphor and metonymy along traditional lines, but not limiting them to language. I illustrate the applicability of this definition by offering analyses of political cartoons, showing how the two semiotic figures interact in complex ways, sometimes allowing for different interpretations. (shrink)

We focus on two problems with the evolutionary scenario proposed: (1) It bypasses the question of the origins of the communicative and semiotic features that make language distinct from, say, pleasant but meaningless sounds. (2) It does little to explain the absence of language in, for example, chimpanzees: Most of the selection pressures invoked apply just as strongly to chimps. We suggest how these problems could possibly be amended.

Phenomenology is often mistakenly understood as both introspectionist and anthropocentric and thus as incapable of providing us with objective knowledge. While clearly wrong, such critiques force us to spell out how the _life world_ that is given in human experience is in fact not anthropocentric and not incompatible with science. In this article we address this by adapting a recent proposal to extend the key methodological principle of cognitive semiotics, _phenomenological triangulation_, along two planes. The first is horizontal and concerns (...) the dimensions of Self, Others and Things, as irreducibly interrelated dimensions of the life world. The second is vertical, and deals with the way phenomena are accessed: from a first-person (philosophical), second-person (empirical in a qualitative sense) and third-person (scientific in a quantitative sense) perspective. With each perspective, the life world becomes correspondingly extended beyond direct experience. It is thus neither static nor confining. We exemplify each step with corresponding research, also providing examples of how non-human animals and not only human beings may serve as Others, thus addressing the critique of anthropocentrism. We conclude by pointing out how, despite some theoretical differences, the focus on subjectivity and the explicit or implicit adoption of the principle of phenomenological triangulation can serve as common ground for cognitive semiotics and biosemiotics. (shrink)

The goal of the present deliverable is to provide a developmental analysis of attentional intersubjectivity, which, as we show below, is a more inclusive notion than the more commonly used term ‘joint attention’. The use of the term ‘joint attention’ is not consistent in the literature, sometimes referring to the general phenomenon when two or more subjects attend to the same target, sometimes to more reciprocal situations in which the subjects also are aware of attending to the same target. Most (...) often solely visual attention has been described, but implicitly the descriptions have been thought to generalize to other modalities. The concepts introduced in this deliverable constitute an attempt to construct a coherent framework that will allow for distinguishing and comparing the range of behaviours that in the literature have been addressed as ‘joint attention’ behaviours. By attentional intersubjectivity we refer to the general case when two or more subjects simultaneously focus their attention on the same target. Attentional intersubjectivity will be further divided into types, according to which behaviours that are typically associated with attentional intersubjectivity occur during the interaction, and in which combinations. The result is that the over-all behaviour of the subjects during different types of attentional intersubjectivity differs. Our contentions are that: a) the types of attentional intersubjectivity identified in this report build on each other cumulatively and constitute different levels, and b) these levels correspond to evolutionary and developmental stages. In saying that the types are cumulative we mean that there is a progress by successive stages where each type is causally dependent on the type preceding it, and, furthermore, has increased in complexity as compared to previous types. While attentional intersubjectivity involves several perceptual modalities, for practical reasons, this study primarily concerns the visual modality. Our analysis is, however, intended also to be applicable to these other modalities. (shrink)

Few other social technologies and institutions are more consequential to human societies than money. Yet money remains a deeply perplexing phenomenon. On the one hand, it is a pan-human system of valuation, but on the other, it is conventional and variable in its uses. While it is controversial if money instantiates a fully-fledged sign system, it is rife with semiotic capacities. To present an illuminating analysis of money is thus a test case for the Motivation & Sedimentation Model (MSM) of (...) meaning making, with roots in the phenomenology of Husserl and Merleau-Ponty. Using MSM, we analyze two origin accounts of money: the commodity money account evidenced in archaic and classical Greek coinage, and the credit money account exemplified by early findings in Mesopotamia. Both accounts focus on the interactions between the three levels of MSM: the pre-signitive Embodied, the cultural Sedimented, and the interactional Situated levels of meaning and propose different series of “loops” to account for the genesis of money. Despite key differences in the two origins, both imply semiotic processes operating according to motivated, and hence non-arbitrary, conventions developing within institutional formations that ultimately influenc present-day concepts of money. (shrink)

We find that the nature and origin of the proposed “dialogical cognitive representations” in the target article is not sufficiently clear. Our proposal is that (triadic) bodily mimesis and in particular mimetic schemas – prelinguistic representational, intersubjective structures, emerging through imitation but subsequently interiorized – can provide the necessary link between private sensory-motor experience and public language. In particular, we argue that shared intentionality requires triadic mimesis.

Every day we make choices, but our degree of investment in them differs, both in terms of pre-verbal experience and verbal justification. In an earlier experimental study, participants were asked to pick the more attractive one among two human faces, and among two abstract figures, and later to provide verbal motivations for these choices. They did not know that in some of the cases their choices were manipulated. Against claims about our unreliability as conscious agents, the study found that in (...) about half the cases the manipulations were detected. In the present study, we investigated whether varying degrees of choice investment could be an explanatory factor for such findings. We analysed the verbal justifications of the participants along a set of semantic categories, based on theoretical ideas from phenomenology and cognitive linguistics, and formulated a matrix of eleven markers of choice investment. We predicted a greater degree of investment when motivating choices of faces than figures, manipulated than actual choices, and detected than non-detected manipulations. These predictions were confirmed, but with various strength. This allows us to argue for both consilience and differences between pre-verbal choice investment and the corresponding verbal motivations of the choices made, and thus for conscious awareness of choice making. (shrink)

Gasparyan sketches a semiotic theory where world, mind and language - the latter a stand-in for all semiosis - collapse into one “recursive” whole. In contrast, cognitive semiotics ….