Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

This study investigates whether there is a relation between the semantics of linguistic expressions that indicate temporal distance and the spatial properties of their co-speech gestures. To this date, research on time gestures has focused on features such as gesture axis, direction, and shape. Here we focus on a gesture property that has been overlooked so far: the distance of the gesture in relation to the body. To achieve this, we investigate two types of temporal linguistic expressions are addressed: proximal (...) (e.g., near future, near past) and distal (e.g., distant past, distant future). Data was obtained through the NewsScape library, a multimodal corpus of television news. A total of 121 co-speech gestures were collected and divided into the two categories. The gestures were later annotated in terms of gesture space and classified in three categories: (i) center, (ii) periphery, and (iii) extreme periphery. Our results suggest that gesture and language are coherent in the expression of temporal distance: when speakers locate an event far from them, they tend to gesture further from their body; similarly, when locating an event close to them, they gesture closer to their body. These results thus reveal how co-speech gestures also reflect a space-time mapping in the dimension of distance. (shrink)

The paper analyses Peirce’s hypoiconicity through the lens of Husserlian intentionality. Peirce’s triple structure of hypoiconicity as resemblance relation, diagrammatical reasoning and metaphoric displacement is shown to require intentional acts in its production and interpretation. Regarding hypoiconicity as a semiotic schematization of Vorstellung, the paper places it in the context of Husserl’s conception of intentionality in which iconicity appears as a stepping-stone towards the skeletonization of resemblance in diagrammatical abstraction and as schematic displacement in metaphor. As such, hypoiconic intentionality is (...) argued to play a role also in Peirce’s community conception of language. The paper’s core claim is that intentionality provides an avenue for revealing hypoiconicity as a major, critical concept of semiotics, functioning as paradigm case for investigating the convergence of semiotics and phenomenology. (shrink)

Aspects of phronetic social science and phronetic organization research have been much debated over the recent years. So far, the visual aspects of communicating phronesis have gained little attention. Still organizations try to convey a desirable image of respectability and success, both internally and externally to the public. A channel for such information is corporate reporting, and particularly CSR reporting embrace values like fairness, goodness, and sustainability. This study explores how visual portrayals of supposedly wise and discerning values (phronesis) are (...) used to reinforce the verbal features of CSR reporting. The two propositions underlying this study is (1) that visual images form some of the major parts of the structures of contemporary corporate reporting (particularly CSR reporting) and (2) that phronetic action in organizations is subjected not only to textual documentation, but also to visual expressions. This study also discusses how the Aristotelian concept of phronesis can be linked to contemporary concerns about responsibility, and how this is visually represented in CSR reporting. Finally, this study addresses the symbolic and contextual signification of images in corporate accounts of wisdom and responsibility. (shrink)

How should one describe the irreducible relationships in photopoetry observed in intermedial literary photobooks? According to most authors, in literary photobooks, the verbal sign system is linked to the photographic image as a bidirectional interaction, creating a coupled system that can be seen as a new sign system. Mutually modulatory influences link verbal text and photography. But the nature of such influences needs to be explained in detail and with accuracy. What kind of relation are we dealing with? Many authors (...) have tried to explain this phenomenon through several epistemic metaphors. The problem is that these metaphors are rarely subjected to any general theory of meaning. Surprisingly, this is not even mentioned as a problem. In this article, we propose a general semiotic model to describe the irreducible photography-poetry relation, derived from C. S. Peirce’s pragmatic theory of signs, and we also present some preliminary results of the analysis of Quarenta Clics em Curitiba, a photobook by Paulo Leminski and Jack Pires. Our purpose here is to introduce and explore this model to describe the photography-poetry relationship in coupled systems. This relationship is decomposed, in the functional roles occupied by poems and photographs, into a sign-object-interpretant relation. The triadic irreducibility that characterizes semiosis (à la Peirce) is the main property applied to photograph-poetry coupling in Quarenta Clics em Curitiba. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

This paper argues, contrary to Fodor’s well-known position, that the iconic and discursive modes of representation are not mutually exclusive categories. It is argued that there exists at least a third kind of representation which blends the semantic properties of icons and the syntactic properties of discourses. We reason that this iconic-discursive genus behaves differently from other representational formats, such as distributed representations or maps, previously put forward as challenging Fodor’s basic distinction. A reflection follows about how this kind of (...) representation impacts on the Fodorian issues for which the original dual distinction was argumentatively instrumental, namely, the kinds of codes and possible inter-code relations accessible to the representational mind. The suggestion is put forward that iconic-discursive representations may facilitate trade-offs between the world and the representational mind, as well as between the differently complex levels of representation that mediate between percepts and concepts. We conclude that such aspects of the computational mind, which until now appeared to be stubbornly resistant with respect to a conciliation of Hume’s empiricism and Fodor’s computationalism, may be more easily accessed and understood taking advantage of the biosemiotics perspective and acknowledging the richness of the biosemiotics codes accessible to cognition. (shrink)

This paper argues, contrary to Fodor’s well-known position, that the iconic and discursive modes of representation are not mutually exclusive categories. It is argued that there exists at least a third kind of representation which blends the semantic properties of icons and the syntactic properties of discourses. We reason that this iconic-discursive genus behaves differently from other representational formats, such as distributed representations or maps, previously put forward as challenging Fodor’s basic distinction. A reflection follows about how this kind of (...) representation impacts on the Fodorian issues for which the original dual distinction was argumentatively instrumental, namely, the kinds of codes and possible inter-code relations accessible to the representational mind. The suggestion is put forward that iconic-discursive representations may facilitate trade-offs between the world and the representational mind, as well as between the differently complex levels of representation that mediate between percepts and concepts. We conclude that such aspects of the computational mind, which until now appeared to be stubbornly resistant with respect to a conciliation of Hume’s empiricism and Fodor’s computationalism, may be more easily accessed and understood taking advantage of the biosemiotics perspective and acknowledging the richness of the biosemiotics codes accessible to cognition. (shrink)

As a field of scientific expertise, semiotics has the interesting property of being a relevant tool for understanding how scientists represent any domain of research, including the semiotic domain itself. This feature is particularly expressive in the case of biology, as it appears to be the case that a certain range of biological phenomena are of a semiotic character. However, it is not consensual the extent to which semiotics pervades biology. This paper deals with this issue for the particular case (...) of developmental biology, stressing the role of semiotics-as-a-discipline in delimiting the extent of semiotics-as-a-natural-phenomenon and, specifically, in disentangling semiotic mechanisms from semiotic metaphors aimed at clarifying non-semiotic developmental mechanisms. (shrink)