Evidence from adult studies of deaf signers supports the dissociation between neural systems involved in processing visual linguistic and non-linguistic body actions. The question of how and when this specialization arises is poorly understood. Visual attention to these forms is likely to change with age and be affected by prior language experience. The present study used eye-tracking methodology with infants and children as they freely viewed alternating video sequences of lexical American sign language (ASL) signs and non-linguistic (...) body actions (self-directed grooming action and object-directed pantomime). In Experiment 1, we quantified fixation patterns using an area of interest (AOI) approach and calculated face preference index (FPI) values to assess the developmental differences between 6 and 11-month-old hearing infants. Both groups were from monolingual English-speaking homes with no prior exposure to sign language. Six-month-olds attended the signer’s face for grooming; but for mimes and signs, they were drawn to attend to the “articulatory space” where the hands and arms primarily fall. Eleven-month-olds, on the other hand, showed a similar attention to the face for all body action types. We interpret this to reflect an early visual language sensitivity that diminishes with age, just before the child’s first birthday. In Experiment 2, we contrasted 18 hearing monolingual English-speaking children (mean age of 4.8 years) vs. 13 hearing children of deaf adults (CODAs; mean age of 5.7 years) whose primary language at home was ASL. Native signing children had a significantly greater face attentional bias than non-signing children for ASL signs, but not for grooming and mimes. The differences in the visual attention patterns that are contingent on age (in infants) and language experience (in children) may be related to both linguistic specialization over time and the emerging awareness of communicative gestural acts. (shrink)

It seems obvious that signs in visual art and musical notation are static carriers of visual and acoustic information. Both types of sign, however, represent dynamic processes. In real space-time, there exists no static visible thing or static audible sound. The sources of visible or audible information are dynamic – i.e. complementary substantialenergetic-informational – entities extending in space-time. The same is true of an artificial or organic receiver and processor of visual or audible information. Reality and (...) semiosis – to be, to be perceived, and to be understood or to communicate – are dynamic processes. From a semiotic point of view, thus, pictures, photographic or artistic sign structures can’t be icons – in any case, if icons in a Peirceian manner are understood as signs representing objects for an interpretant by similarity . Similarity between icon and object is not a static precondition but a dynamic result of visual semiosis, i.e. of categorizing. Seeing something or hearing something is, as a consequence, not an “intuitive” or instantaneous Gestalt shift between representamen and object ongoing in an interpretant. And so, according to Fernande SaintMartin 1990: “visual semiotics … has to adopt an epistemology which is more in agreement with the dynamics of observed phenomena. It will recognize that matter is not inertness, but energy.” If the material carrier of semiosis, the representamen, already is to be understood as energy or dynamic process, all the more the whole complementary triadic sign-relation – object-representamen-interpretant – has to be understood as energetic information flow. This is being recognized in the transition from naturalistic, i.e. reproducing or mapping art, to modern, i.e. processing or interpreting/transducing art. Paul Klee 1990 for example says about the semiotic function of visual art: “Art doesn’t reproduce the visible but makes visible” . And he correlates the artistic activity of visualizing with the primordial, cosmogonic process of formation: “Reduced to the primordial process of formation, to creation, the process of cell division emerges” . Visual artistic semiosis is, thus, obviously to be understood as the process of emerging dynamic sign structures. It is the skill of the painter that makes the static results of dynamic semiosis “readable” for the viewer as signs – lines and surfaces - of the dynamic visual meaning of the picture. (shrink)

For humans, the ability to communicate and use language is instantiated not only in the vocal modality but also in the visual modality. The main examples of this are sign languages and gestures. Sign languages, the natural languages of Deaf communities, use systematic and conventionalized movements of the hands, face, and body for linguistic expression. Co-speech gestures, though non-linguistic, are produced in tight semantic and temporal integration with speech and constitute an integral part of language together with (...) speech. The articles in this issue explore and document how gestures and sign languages are similar or different and how communicative expression in the visual modality can change from being gestural to grammatical in nature through processes of conventionalization. As such, this issue contributes to our understanding of how the visual modality shapes language and the emergence of linguistic structure in newly developing systems. Studying the relationship between signs and gestures provides a new window onto the human ability to recruit multiple levels of representation in the service of using or creating conventionalized communicative systems. (shrink)

The multi-modal tasks have started to play a significant role in the research on artificial intelligence. A particular example of that domain is visual–linguistic tasks, such as visual question answering. The progress of modern machine learning systems is determined, among other things, by the data on which these systems are trained. Most modern visual question answering data sets contain limited type questions that can be answered either by directly accessing the image itself or by using external data. (...) At the same time, insufficient attention is paid to the issues of social interactions between people, which limits the scope of visual question answering systems. In this paper, we propose criteria by which images suitable for social interaction visual question answering can be selected for composing such questions, based on psychological research. We believe this should serve the progress of visual question answering systems. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2016 Heft: 210 Seiten: 209-214.

1. To list Pound’s triumphs of recognition in the realm of art, music, or literature is by itself no more enlightening than to catalog his oversights. Thus, for example, his instant and almost uncanny responsiveness to the work of Henri Gaudier-Brzeska is not more informative than his bizarre ranking of Francis Picabia’s paintings above those of Picasso or Matisse. Clearly it is essential to know, with as much specificity as possible, exactly what Pound said about a particular work of art (...) or literature and, equally important, given the frequent shifts of emphasis and interest throughout his long career, just when these opinions were first formulated. Like every reader of the The Cantos, I am conscious of the enormous service rendered by Pound scholars whose research is giving us a more complete inventory of the poet’s various statements and positions, and it would be foolish to take my point here as a derogation of such efforts. But a list, no matter how complete, is not an argument, and an inventory, no matter how scrupulously assembled, is not an explanation; a recurrent problem in Pound studies is that too often the compoilation of discrete items of information is seen as a sufficient answer to problems of interpretation and understanding. In other words, I think it essential that discussions of pound and the Visual Arts move beyond the quagmire resulting from still another frain-storm of “factual atoms” chronicling his various passions and dislikes.2. Far from implying, however, that we must therefore simply accept Pound’s brilliant discoveries and pass over his “howling blunders,” my position would emphasize the need to take his ideas seriously enough to confront them, to test them against the material to which they are a response and for which they often seek to provide an explanatory account. There are times, as I have argued in an analogous context, when it is less demeaning to give a man credit for his worst errors than to remove from him the capacity to err.3. What we require, I believe, is less a catalog of all of Pound’s specific statements about various artists, with each utterance assigned a positive or negative prefix depending upon our own personal and currently sanctioned hierarchy of values, than a careful study of the place of those statements in the logic and texture of Pound’s own work. The attempt to focus attention on The Cantos’ network of artistic references—its invocation of masterpieces and privileged moments of cultural achievement—will yield only trivial results unless the inner dynamic linking Pound’s various exampla and the actual role these play in the poem’s argument become clearer in the process. Michael André Bernstein, associate professor of English and comparative literature at the University of California, Berkeley, is the author of The Tale of the Tribe: Ezra Pound and the Modern Verse Epic and Prima della Rivoluzione , a volume of verse. He is currently completing a study of the Abject Hero and literary genealogy. His previous contribution to. (shrink)

The analysis of works of visual art illustrates typical groups of elements and interrelations, which form semiotic systems of these works. Specific systems of connotations and their relations with semantic structures, paradigmatics, and typical signal structures are described. Like in linguistic texts, different levels are formed in complex images. The following basic level types are distinguished: sems and other units of semantic level; signs subdivided into: icons of represented objects and connotative sign formations; representamens of basic signs as (...) interpreted by Charles Peirce, including those of connotations, and signals referred to as basic perceptive integer units forming an individual level. (shrink)

Infants are endowed with a proclivity to acquire language, whether it is presented in the auditory or visual modality. Moreover, in the first months of life, listening to language supports fundamental cognitive capacities, including infants’ facility to form object categories. Recently, we have found that for English-acquiring infants as young as 4 months of age, this precocious interface between language and cognition is sufficiently broad to include not only their native spoken language, but also sign language. In the (...) current study, we take this work one step further, asking how “sign-naïve” infants—hearing infants with no prior exposure to sign language—deploy their attentional and social strategies in the context of episodes involving either spoken or sign language. We adopted a now-standard categorization task, presenting 4- to 6-month-old infants with a series of exemplars from a single category. Each exemplar was introduced by a woman who appeared on the screen together with the object. What varied across conditions was whether this woman introduced the exemplar by speaking or signing. We coded infants’ visual attentional strategies and their spontaneous vocalizations during this task. Infants’ division of attention and visual switches between the woman and exemplar varied as a function of language modality. In contrast, infants’ spontaneous vocalizations revealed similar patterns across languages. These results, which advance our understanding of how infants allocate attentional resources and engage with communicative partners across distinct modalities, have implications for specifying our theories of language acquisition. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

Natural languages come in two different modalities. The impact of modality on the grammatical structure and linguistic theory has been discussed at great length in the last 20 years. By contrast, the impact of modality on linguistic data elicitation and collection, corpus studies and experimental (psycholinguistic) studies is still underinvestigated (van Herreweghe/Vermeerbergen 2012; Orfanidou et al. 2015). In this paper, we address specific challenges that arise in judgement data elicitation and experimental studies of sign languages. These challenges are related (...) to the socio-linguistic status of the Deaf community and the larger variability across signers within the same community, to the social status of sign languages, to properties of ;he visual-gestural modality and its interface with gesture, to methodological aspects of handling sign language data, and to specific linguistic features of sign languages. While some of these challenges also pertain to (some varieties of) spoken languages, other challenges are more modality-specific. In addition, the special combination of the challenges discussed in this paper seems to be a specific facet empirical research on sign languages is faced with. In addition, we discuss the complementarity of theoretical approaches and experimental studies and show how the interaction of both approaches contributes to a better understanding of sign languages in particular and linguistic structures in general. (shrink)

This study investigated visual statistical learning (VSL) in 24 deaf signers and 24 hearing non‐signers. Previous research with hearing individuals suggests that SL mechanisms support literacy. Our first goal was to assess whether VSL was associated with reading ability in deaf individuals, and whether this relation was sustained by a link between VSL and sign language skill. Our second goal was to test the Auditory Scaffolding Hypothesis, which makes the prediction that deaf people should be impaired in sequential (...) processing tasks. For the VSL task, we adopted a modified version of the triplet learning paradigm, with stimuli presented sequentially across space and time. Results revealed that measures of sign language skill (sentence comprehension/repetition) did not correlate with VSL scores, possibly due to the sequential nature of our VSL task. Reading comprehension scores (PIAT‐R) were a significant predictor of VSL accuracy in hearing but not deaf people. This finding might be due to the sequential nature of the VSL task and to a less salient role of the sequential orthography‐to‐phonology mapping in deaf readers compared to hearing readers. The two groups did not differ in VSL scores. However, when reading ability was taken into account, VSL scores were higher for the deaf group than the hearing group. Overall, this evidence is inconsistent with the Auditory Scaffolding Hypothesis, suggesting that humans can develop efficient sequencing abilities even in the absence of sound. (shrink)

El presente artículo interroga de la naturaleza semiótica de la educación inclusiva y sus problemas de regulación ontológicos, visuales y epistémicos. Este problema comienza a evidenciarse cuando, buena parte, de la consciencia heurística de la educación especial se toma literalmente como la lengua natural de un espacio intelectual en blanco pero altamente generador en la transformación del conocimiento pedagógico. Tal transferencia, devino en la cristalización de un modelo semiótico universal que alcanza su efectividad a través de la castración de la (...) identidad semiológica de lo inclusivo, lo que afianza un sistema de edipización de sus signos y, con ello, coloca de manifestando un sistema de desviación sobre sus propiedades ontológicas implícitas. Producto de esta operación, es que, sus diferentes tipos de agenciamientos de enunciación son objeto de confusión y tervigersación, especialmente, sobre sus unidades semiológicas auténticas. Estamos en presencia de una operación estratégicamente intencionada que contribuye a castrar la pregunta por los signos de lo inclusivo y, por consiguiente, a instalar un sistema de edipización sobre su objeto. El método empleado es el de revisión documental crítica. El trabajo concluye que, al imponer el rostro de la educación especial como parte del corazón de la educación inclusiva se omite la intención de colocar en conexión sus dos tipos de representaciones, las que, también pueden ser interpretadas como formaciones particulares del poder, por medio de las cuales, se designa un modo particular de funcionamiento que es afianzado a través de un sistema de descodificación generalizada de sus signos y flujos semióticos. (shrink)

“Black Star” music video was released two days before Bowie’s death. It bears various implications of dying and the notion of mortality is both literal and metaphorical. It is highly autobiographical and serves as a theatrical stage for Bowie to act both as a music performer and as a self-conscious human being. In this paper, we discuss the signs of mortality in Bowie’s “Black Star” music video-clip. We focus on video’s cinematic techniques and codes, on its motivic elements and on (...) its narrative in relation with music, lyrics, characters, and gestures. We also discuss the video’s intertextual references and the broader signification of the black star figure. We adopt a quasi-semiotic approach considering “Black Star” music video-clip as a text which can be investigated through its signs, codes, and conventions of the musical, visual, and cinematic languages as well. Our interdisciplinary tools derive from visual semiotics and audiovisual analysis models, without leaving outside Bowie’s musical-artistic and personal history. As it turns out, Bowie created a video clip that is philosophical in nature and poetic in structure, preserving the role of protagonist. With the visuals creating a psychedelic atmosphere, the lyrics often are heard as a personal confession. They both generate cognitive and emotional responses that influence the way the viewers-listeners may experience, decompose, and interpret Bowie’s artistic endeavor bridging life and death. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Reviewed by:Exploring Visual Culture: Definitions, Concept, ContextsPaul DuncumExploring Visual Culture: Definitions, Concept, Contexts, edited by Matthew Rampley. Edinburgh: Edinburgh University Press, 2005, 257 pp., $32.00 paper.I review this new introductory text in light of its competition as a textbook for undergraduates and as an introduction for graduate students. Other such texts include Barnard, Elkins, Mirzeoff, Walker and Chaplin, and Sturken and Cartwright,1 which appears to be the (...) most widely used. Rampley's anthology stands up well among these competitors, especially for those who wish to transition from art to contemporary popular visual culture rather more gently than other texts that, for many students, might come as too abrupt a disjuncture from mainstream practice in schools of art and design. As Matthew Rampley states in his excellent introduction, if the book has an original contribution to make, it is to situate an acknowledgment of traditional practices and issues into the makeup of visual culture studies. Unlike other texts, mentioned above, which tend to stress screen and print media, Rampley's agenda is to remind readers of the historical origins of many recent developments as well as the contribution of cultural forms other than two-dimensional ones. Thus, chapters are included that trace the history and continuing contribution of traditional media; art, design, craft, and architecture each receive individual chapters. MacDonald, for example, describes the complex meanings of craft and its relationship to fine art and design from classical times to today, as well as summarizes the characteristics and politics of craft today. Furthermore, the influence of technology is charted principally through conventional art, and the chapters on photography, film, and fashion are likewise cast largely in terms of historical accounts of whether these forms should be considered to be art.The historical bias is equally evident in the pictures used to illustrate the text. While, for example, there are contemporary popular images, such [End Page 118] as a cover of the Sun newspaper and a photograph of Punks, there are as many crossover images—postcards of famous art portraits and a Michelangelo on a T shirt—as well as many conventional artworks. Delacroix, Corbert, Rauschenberg, David, Fuseli, and Van Goyen are each featured. Some of the popular images are also historical, such as George Mêlées 1902 classic film Voyage to Moon and advertisements from the1930s.Sometimes the historical material takes up much of the space, with recent developments given only cursory treatment, and sometimes the material is dealt with in ways that seem rather old-fashioned to this reader. For example, Glyn Davis's chapter on photography and film is primarily a potted historical account of the relationships between these two cultural forms and art. Further, Davis does not just describe the arguments for and against their inclusion as art but is clearly engaged with these issues himself, an engagement that many proponents of visual culture would find rather quaint—that is, rather less interesting than the particular contribution that these forms make to contemporary life and for whom the question, "Is it art?" is no longer of any particular interest. This art orientation also colors Davis's view of Hollywood films. Clearly preferring "art" films, he completely ignores the role of popular film in exploring the fears, anxieties, beliefs, and so on of the wider public. By contrast, Richard Williams argues against architecture as a form of art, with its limited concerns with aesthetics, style, and canonical buildings, in favor of architecture as discourse and spatial experience. He is more interested in the reception of architecture than its production—first with architecture as signs, as meanings that are mutable, contingent, and arbitrary; and, secondly, as ordinary urban lived experience, with how architecture is but one element within the experience of urban environments.Typical of the avoidance of technical terms in the book as a whole, Williams beautifully describes the difference between structuralism and poststructuralism without once mentioning either of these terms, and in a chapter on architecture he manages to use the term "postmodern" only once. Similarly, in Neil Mulholland's chapter on representation and realism, cultural border crossing and indigenization are both described, albeit briefly, though without recourse to these terms... (shrink)

We are told modernity's end will destabilize familiar ways of knowing, doing, and being, but are these changes we should dread--or celebrate? Four significant events catalyze this question: the consecration of openly gay Episcopalian Bishop Gene Robinson, the mistreatment of prisoners at Abu Ghraib prison, the politicization of the death of Terri Schiavo, and the disastrous response to Hurricane Katrina. Framed by an original appropriation of Michel Foucault, and drawing on resources in visual culture theory and the history of (...) photography, Ellen T. Armour explores the anxieties, passions, and power dynamics bound up in the photographic representation and public reception of these events. Together, these phenomena expose modernity's benevolent and malevolent disruptions and reveal the systemic fractures and fissures that herald its end, for better and for worse. In response to these signs and wonders, Armour lays the groundwork for a theology and philosophy of life better suited to our modern moment: one that owns up to the vulnerabilities that modernity sought to disavow and better enables us to navigate the ethical issues we now confront. (shrink)

Child visual discourse: The use of language, gestures, and vocalizations by deaf preschoolers1 This exploratory study examined the linguistic activity and conversational skills of deaf preschoolers by observing child-child dyads in free-play situations. Deaf child of deaf parents - deaf child of deaf parents pairs were compared with deaf child of hearing parents - deaf child of hearing parents pairs. Children from the two groups were videotaped during dyadic peer interactions in a naturalistic play situation. The findings indicated that (...) deaf children were able to engage in successful communicative interaction. However, statistically significant differences were found between the two groups of deaf preschoolers with regard to some categories of communicative behaviors from the point of view of sign and spoken languages. For example, DCHP were found to be less actively than DCDP through using speech. The results of this study suggest that intervention efforts should be focused on improving the language learning environment by facilitating signing by the parents and increasing their skills in visual-gestural strategies. (shrink)

The present article discusses different basic semiotic-scientific postulates regarding mammals’ sign activity. On the one hand, there are arguments denying animals sign activity, according to which mammals are not capable of semantic generalization on the basis of conventional linguistic values. According to another approach, mammals’ sign activity can be considered as means of ecological adaptation, that is, the features of animal behaviour based on the information, received by them through their habitat characteristics without direct visual contacts (...) with their kind. Movement elements, behavioural reactions of similar motivation and parameters of the sign field, which represents an animal’s sign-information environment, may have some numerical expression and can becalculated depending on the research tasks. Formalization of the animal activity implies simultaneous consideration of the following parameters: magnitude,intensity, anisotropy and the value of a given sign object. (shrink)

Experimental studies report positive effects of signing for language acquisition and communication in children with and without language development delays. However, little data are available on natural kindergarten settings. Therefore, our study used questionnaire data to investigate the sign learning in hearing children with and without language development delays in an inclusive kindergarten group with a co-enrolled deaf child and a deaf signing educator. We observed that the hearing children in this co-enrollment group learned more signs than the hearing (...) children from groups with only hearing educators who learned signs in a training program. Hearing children’s sign learning showed a tendency toward correlating positively with their level of spoken language development. However, the individual background for children with language development delays impacted this relationship. Additionally, we examined the modality use of all children in interactions with hearing and deaf educators and peers using questionnaire and video data. Despite acquiring signs, hearing children predominantly used spoken language with hearing educators and predominantly nonverbal communication strategies with the deaf educator and the deaf child. Children with language development delays used code-blending with hearing educators in a few cases. The deaf child used mainly sign language for interactions with the deaf educator and mainly nonverbal communication with hearing educators and peers. Overall, our results suggest that the presence of a deaf educator increases sign learning in hearing children. However, in interactions during free play, they barely used signs making it particularly challenging for the deaf child to participate. This reveals that, in addition to a deaf role model, more sign language competent peers and targeted approaches increasing the use of the visual modality are required. (shrink)

We focus on a key IR Theory article by Alexander Wendt (1992) and two Jackson Pollock paintings. Our aim is to identify meanings Pollock’s art communicates and reveals for Wendt (1992). It derives from an appeal to visual imagination and a desire for semiotic interpretation of Constructivist view of anarchy. The visual sign is an association such that there is Wendt’s theoretical claim on the one hand and an abstract painting on the other. We do not gaze (...) at Wendt’s claim, we read it. We do not read a painting, look at it. This remark does not imply a one-way relationship. We can argue that a specific painting comes to life in our mind where colored movements are inextricably mixed up when we read the constructivist claim. Both Pollock paintings selected for our sign-making effort confirm the dynamic character of Constructivism and reveal not only three but countlessly many anarchies in international relations. They foment our assessments of abrupt changes of intersubjectivity among states. Cyclicality of dripped paints provides an anchor to fix Wendt’s anarchy conceptualization in these structural-abstract paintings. As to Wendt’s concept of anarchy, it acts as a helper, as a standard, against which interpretations of Pollock’s artwork construct meanings. (shrink)

By means of Vivian Sobchack’s semiotic film phenomenology, we may examine our immediate perceptual acts in film experience in order to determine the ways that the primordial language of embodied existence found at this primary level grounds the secondary level of the more explicit interpretations we give to the film’s elements. Although Gilles Deleuze is openly defiant toward the phenomenological tradition, his studies of film experience can serve this purpose as well, because he is interested in the direct and pre-verbal (...) significance of cinematic images. To bring his observations more fruitfully into film phenomenological studies, I will examine his notion of the discordantly operating body and offer a phenomenological interpretation for his notion of cinematic signs. I then apply this Deleuzian semiotic film phenomenology to his analysis of deep focus cinematography in Orson Welles’ Citizen Kane. When watching one particular scene, different layers of our film experience, namely, those of visual and of temporal depth, collide in such a way that they provide the phenomenal basis for us to produce a temporal interpretation of the spatial relations held between the displayed images. (shrink)

In spoken interactions, interlocutors carefully plan and time their utterances, minimising gaps and overlaps between consecutive turns. Cross-linguistic comparison has indicated that spoken languages vary only minimally in terms of turn-timing, and language acquisition research has shown pre-linguistic vocal turn-taking in the first half year of life. These observations suggest that the turn-taking system may provide a fundamental basis for our linguistic capacities. The question remains however to what extent our capacity for rapid turn-taking is determined by modality constraints. The (...) avoidance of overlapping turns could be motivated by the difficulty of hearing and speaking at the same time. If so, turn-taking in sign might show greater toleration for overlap. Alternatively, signed conversations may show a similar distribution of turn-timing as spoken languages, thus avoiding both gaps and overlaps. To address this question we look at turn-timing in question-answer sequences in spontaneous conversations of Sign Language of the Netherlands. The findings indicate that although there is considerable overlap in two or more signers' articulators in conversation, when proper allowance is made for onset preparation, post-utterance retraction and the intentional holding of signs for response, turn-taking latencies in sign look remarkably like those reported for spoken language. This is consistent with the possibility that, at least with regard to responses to questions, speakers and signers follow similar time courses in planning and producing their utterances in on-going conversation. This suggests that turn-taking systems may well be a shared cognitive infrastructure underlying all modern human languages, both spoken and signed. (shrink)

Can we find different means of communicative visual solutions to aid societies in the development of multicultural global communities? This means not revolving only around a particular language or even human language, but rather the concept and structure of communication. This transforms any kind of sign, body gesture or visual element into a method of communication, not simple phenomena. The aim of the research is to use media art and new technology to establish a better (wide) (...) class='Hi'>visual communicative language in multicultural societies and provide a solid bridge between east and west, through in-depth visual/technological experimentation, seeking a transcultural visual solution to the problem of visual integration. Can any perceivable phenomenon become a conveyor of meaning? While language is based very much on common agreements, the way each of us responds to a message can be entirely different. Communication therefore creates diversity from uniformity: the idea of mixing setups of humans and machines (robots, computers, etc.) that are somehow able to communicate. The communication would give rise to some sort of choreography of movements that is synchronized because of the communication but diverse because of different responses to the communication. (shrink)

The present paper is aimed at showing some correlations between Charles Peirce’s life, his intellectual habits as a logician and mathematician, his semiotic theory and his practice as a geodesist. For this purpose, it makes use of Peirce’s ideas about the nature of visual experience, some facts of his intellectual biography, and his definitions of sign and the term “virtual.” It appears that Peirce’s mature pragmatist and semiotic ideas find some support in his early practice as a scientist (...) and a mathematician, thus providing an interesting example of the intersection of scientific practice and philosophical speculation. (shrink)

Disability has been perceived as a social conditioning phenomenon and a sign system marking the body and mind. Accordingly, photographs of disability could shape our cultural perceptions about disability and disabled persons. In response to this position, we engage in a critical semiotic inquiry into press photographs of disability from The Star, a Malaysian mainstream English newspaper. We adapted Van Leeuwen’s social and visual actor networks to understand the visual techniques employed in depicting disabled actors in these (...) images. The depiction is examined in relation to their absence and/or presence in these published photographs. If absent, the inclusion of non-disabled is analyzed. When present, the social categorizations of roles, grouping and specific/generic depictions are investigated. Findings reveal disabled persons have been symbolically excluded and thus, socially othered. These exclusionary strategies imply disabling journalistic practices which should be cautioned as they could could potentially undermine the advocacy for an inclusive society. (shrink)

Silent gesture is not considered to be linguistic, on par with spoken and sign languages. It is claimed that silent gestures, unlike language, represent events holistically, without compositional structure. However, recent research has demonstrated that gesturers use consistent strategies when representing objects and events, and that there are behavioral and clinically relevant limits on what form a gesture may take to effect a particular meaning. This systematicity challenges a holistic interpretation of silent gesture, which predicts that there should be (...) no stable form‐meaning correspondence across event representations. Here, we demonstrate to the contrary that untrained gesturers systematically manipulate the form of their gestures when representing events with and without a theme (e.g., Someone popped the balloon vs. Someone walked), that is, transitive and intransitive events. We elicited silent gestures and annotated them for manual features active in coding transitivity distinctions in sign languages. We trained linear support vector machines to make item‐by‐item transitivity predictions based on these features. Prediction accuracy was good across the entire dataset, thus demonstrating that systematicity in silent gesture can be explained with recourse to subunits. We argue that handshape features are constructs co‐opted from cognitive systems subserving manual action production and comprehension for communicative purposes, which may integrate into the linguistic system of emerging sign languages. We further suggest that nonsigners tend to map event participants to each hand, a strategy found across genetically and geographically distinct sign languages, suggesting the strategy's cognitive foundation. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Visual EmpireSusan Buck-Morss (bio)1 The Sovereign IconThe Question of SovereigntyJust when the nation-state appeared to be waning in significance, national sovereignty is back in the spotlight. The issue takes on special urgency in the United States, where sovereign right has been proclaimed persistently by the president in an attempt to justify policies of military aggression and violations of international and domestic law, executing these policies with disregard for (...) traditional judicial and constitutional procedures.1 Giorgio Agamben’s recently translated book State of Exception has touched off a small case of collective hysteria among American academics by claiming that by their intrinsic nature, democracies undermine themselves, that dictatorship is an ontological necessity of modern politics, and that the sovereign’s power to declare a state of emergency and with it a state exception to the law places potentially the whole world under the sign of the concentration camp.Agamben’s revelation, however, is not the scandal. It is a logical truism that something cannot be a member of its own set, that constituting power (pouvoir constituens) cannot be synonymous with constituted power (pouvoir constituent).Plato in the Timaeus described a self-eating, circular being as the first living thing in the universe–an immortal, perfectly constructed animal [image 1]. Agamben seems shocked to find that such an animal does not exist. If democracies could be self-constituting and self-reproducing, if they could realize the perfect closure of the Oroborus (snake consuming its tail), there would be no decay and no history—but also no hope, no escape from the magic circle of power that is capable of mystifying any political regime, no matter how democratically conceived. The historical event that ruptures the circle’s mythic repetition is also the possibility of a better future.Unlike both Walter Benjamin and Carl Schmitt, upon whom he relies, Agamben uses history ahistorically, in order to abstract from it a timeless ontology of power. In contrast, Benjamin is attentive to historical concreteness, as is Schmitt—this attention is their common bond. But when Benjamin criticizes the parliamentary democracy of the early Weimar Republic, it is not, as it is for Schmitt, out of yearning for a strong executive to cut through parliamentary legalism and compromise.2 Rather, it reminds twentieth-century [End Page 171] parliaments of their own violent origins. A present-day executive leader who, in using the emergency powers of his office, fails to be reminded of the historical origins of representative governments no longer feels It necessary to submit to democratic rule. Benjamin believed that the watered-down versions of democracy in his own time had become little more than bourgeois governing cliques, and for that reason, he might have appreciated Thomas Jefferson’s suggestion that every generation needs a new revolution. The sovereign who declares a state of exception would then be the citizens themselves.The question we need to ask is why Thomas Jefferson’s call for permanent revolution is not predictive of the history of democracies in modern times—why it is so difficult to cut off the head of the king so that it stays off, why popular sovereignty consistently resurrects an aura of quasi-mystical power around the sovereign figure—which since Hobbes’s Leviathan has been recognized as a human artifact, a merely mortal god [see image 2]. In a democracy where only the citizens have the legitimate right to declare a state of exception to the law, the real scandal occurs when an executive branch usurps that power and is allowed to get away with it.More than the sum of merely empirical individuals of which Hobbes’s Leviathan is composed, sovereignty is a transcendent category. The sovereign is an icon in the theological sense. He (or she) embodies an enigma—precisely the power of the collective to constitute itself. The sovereign figure as personification of the collective demonstrates the power of the visible image to close the circle between constituting and constituted power, explaining why even when the illegalities of an individual sovereign are exposed, the faith of the believer is still not shaken. As long as the circle appears closed, sovereign power remains intact; likewise, and... (shrink)

The links which connect the nature of the medium to the methods of access and to the objects of knowledge, relationships between form and content, are a broad continuum whose interlinked facts require a transdisciplinary study.Nowadays, attempts to discern these links seem to concern two central groups of correlations, which have been analysed from the perspective of different disciplines.In the foreground of correlations we find the relationship between the material characteristics of the mediums and the methods of access to their (...) contents; in this field of cultural technologies, the history of verbal language is punctuated first by the ‘invention’ of writing and its different systems, then by a series of transformations of manuscripts and the printed word, and finally by electronic communication. In the study of this first relationship, the history, psychology and physiology of reading establish a relationship between several parameters: on the one hand, the system of signs and spaces in the organization of the written code, and on the other hand, the methods of appropriation of this code by the reader (both reading aloud and silent reading), linear progression or freedom of selection of the contents, degree of speed, amount of information” habits of memorization, etc. (shrink)

Against the background of studies on redundancy in law that completely omit the visual element in law and of studies on traffic signs that are laconic about their redundancies, the present study proposes more focused investigation into the redundancies of traffic signs. After presentation of the broader context of existing studies on traffic signs and on redundancy in law, and following a discussion of the direct inspiration for embarking upon research into this topic, the article moves to present and (...) discuss six proposed types of redundancies of signs. Utilizing Franciszek Studnicki’s distinction between sign-types and sign-realizations, and given that traffic signs exist in various complicated relationships with each other, with written formulations in legal texts, and with the environments in which they are placed, the study comments on six types of redundancy: sign-type–basic task of road traffic law; of sign-type’s elements; sign-type–sign-type; sign-type–legal text; sign-realization–sign-realization; and sign-realization–environment. Analysis of each type is supported through examples, various subdivisions, and additional lines of inquiry. The study has value for both strictly theoretical and more practical enterprises related both to traffic signs themselves and to the wider realm of visualization of norms. (shrink)

Salvador Dalí’s oilpainting Hallucination partielle. Six apparitions de Lénine sur un piano (1931) has been considered to be one of the most difficult works to interpret. O. Zaslavskii has analyzed it, using the sound of the words in title and the items depicted on the masterpiece, “the phonetic subtext”. Obviously, Zaslavskii’s interpretation is based on Osip Mandelstam’s poem “Grand piano” (1931), that in the context of Russian language associates the piano ( ) with the French Revolution. Nevertheless, Zaslavskii’s final conclusion (...) of the connections between Dalí’s painting and the French Revolution turns to be accurate, because it is possible to find iconographic parallels between Dalí’s “Partial hallucination…” and Jacques-Louis David’s “The death of Marat” (1793). On at least four most significant oil paintings from the beginning of Dalí’s surreal period we can observe his “emblem of love and death” as the combination of fellatio and bleeding. Obviously, he understood in the same code also Marat’s murdering by the knife of a woman. This allows us to insist, that Dalí was inspired to paint“Partial hallucination…” by “The death of Marat”. The shadow of a grand piano on his painting “Diurnal illusion: the shadow of a grand piano approaching” (1931) directly bears the meaning of “terror” and “fear”. In such motif combination and graphic parallel, the complex cultural metaphoric relations of these two paintings can be viewed. This complex can be considered as rhetorical in the sense of Juri Lotman’s conception. But it is evidently a case of “pure visual metaphor”, not an illustration of verbal metaphors. (shrink)

Salvador Dalí’s oilpainting Hallucination partielle. Six apparitions de Lénine sur un piano (1931) has been considered to be one of the most difficult works to interpret. O. Zaslavskii has analyzed it, using the sound of the words in title and the items depicted on the masterpiece, “the phonetic subtext”. Obviously, Zaslavskii’s interpretation is based on Osip Mandelstam’s poem “Grand piano” (1931), that in the context of Russian language associates the piano ( ) with the French Revolution. Nevertheless, Zaslavskii’s final conclusion (...) of the connections between Dalí’s painting and the French Revolution turns to be accurate, because it is possible to find iconographic parallels between Dalí’s “Partial hallucination…” and Jacques-Louis David’s “The death of Marat” (1793). On at least four most significant oil paintings from the beginning of Dalí’s surreal period we can observe his “emblem of love and death” as the combination of fellatio and bleeding. Obviously, he understood in the same code also Marat’s murdering by the knife of a woman. This allows us to insist, that Dalí was inspired to paint“Partial hallucination…” by “The death of Marat”. The shadow of a grand piano on his painting “Diurnal illusion: the shadow of a grand piano approaching” (1931) directly bears the meaning of “terror” and “fear”. In such motif combination and graphic parallel, the complex cultural metaphoric relations of these two paintings can be viewed. This complex can be considered as rhetorical in the sense of Juri Lotman’s conception. But it is evidently a case of “pure visual metaphor”, not an illustration of verbal metaphors. (shrink)