Music is the carrier through which human beings express their emotions. It can clean up their hearts and seek emotional resonance. The combination of music and artificial intelligence, when music meets artificial intelligence, the mathematical logic part of data and algorithm replaces the image thinking, resulting in automatic music production. The basic principle of music creation is to use artificial intelligence technology to conduct in-depth training on a large number of songs, and then build a database. Then, within a certain (...) period of time, extract a segment from several songs, and then decompose it to form a new melody. The automatic music production is the collision of music and technology. With the flying of code and notes, it creates a different kind of beauty. Music culture is a new field of music application. With its refreshing audio-visual effect, it has made people have a new understanding of music and has become a hot topic in current mass cultural activities. The sound quality characteristics of music culture programs determine the characteristics of simple, fast and efficient design. However, the current audio and video design still stays in the traditional audio and video form design, with low design efficiency, long cycle, high cost and high requirements for designers. In view of the fact that the traditional audio and video design mode in China's music and cultural programs cannot meet the needs of performance programs at present, this paper proposes a design scheme of audio and visual effects of music and cultural programs with intelligent devices as the core, and develops a complete set of audio and visual effects aided design system on this basis. (shrink)

Our research aimed to investigate the effectiveness of auditory, visual, and audiovisual warning signals for capturing the attention of the pilot, and how stimulus onset asynchronies in audiovisual stimuli affect pilots perceiving the bimodal warning signals under different perceptual load conditions. In experiment 1 of the low perceptual load condition, participants discriminated the location of visual targets preceded by five different types of warning signals. In experiment 2 of high perceptual load, participants completed the location task identical to (...) a low load condition and a digit detection task in a rapid serial visual presentation stream. The main effect of warning signals in two experiments showed that visual and auditory cues presented simultaneously could effectively and efficiently arouse the attention of the pilots in high and low load conditions. Specifically, auditory, AV, and visual preceding auditory stimulus by 100 ms increased the spatial orientation to a valid position in low load conditions. With the increase in visual perceptual load, auditory preceding the visual stimulus by 100 ms and A warning signals had stronger spatial orientation. The results are expected to theoretically support the optimization design of the cockpit display interface, contributing to immediate flight crew awareness. (shrink)

We assessed how synchronous speech listening and lipreading affects speech recognition in acoustic noise. In simple audiovisual perceptual tasks, inverse effectiveness is often observed, which holds that the weaker the unimodal stimuli, or the poorer their signal-to-noise ratio, the stronger the audiovisual benefit. So far, however, inverse effectiveness has not been demonstrated for complex audiovisual speech stimuli. Here we assess whether this multisensory integration effect can also be observed for the recognizability of spoken words. To that (...) end, we presented audiovisual sentences to 18 native-Dutch normal-hearing participants, who had to identify the spoken words from a finite list. Speech-recognition performance was determined for auditory-only, visual-only (lipreading) and auditory-visual conditions. To modulate acoustic task difficulty, we systematically varied the auditory signal-to-noise ratio. In line with a commonly-observed multisensory enhancement on speech recognition, audiovisual words were more easily recognized than auditory-only words (recognition thresholds of -15 dB and -12 dB, respectively). We here show that the difficulty of recognizing a particular word, either acoustically or visually, determines the occurrence of inverse effectiveness in audiovisual word integration. Thus, words that are better heard or recognized through lipreading, benefit less from bimodal presentation. Audiovisual performance at the lowest acoustic signal-to-noise ratios (45%) fell below the visual recognition rates (60%), reflecting an actual deterioration of lipreading in the presence of excessive acoustic noise. This suggests that the brain may adopt a strategy in which attention has to be divided between listening and lipreading. (shrink)

Bistable figures provide a fascinating window through which to explore human visual awareness. Here we demonstrate for the first time that the semantic context provided by a background auditory soundtrack can modulate an observer’s predominant percept while watching the bistable “my wife or my mother-in-law” figure . The possibility of a response-bias account—that participants simply reported the percept that happened to be congruent with the soundtrack that they were listening to—was excluded in Experiment 2. We further demonstrate that this crossmodal (...) semantic effect was additive with the manipulation of participants’ visual fixation , while it interacted with participants’ voluntary attention . These results indicate that audiovisual semantic congruency constrains the visual processing that gives rise to the conscious perception of bistable visual figures. Crossmodal semantic context therefore provides an important mechanism contributing to the emergence of visual awareness. (shrink)

This contribution focuses on legal issues raised by the audiovisual broadcasting of performing arts, which has significantly increased due to the SARS-CoV-2 pandemic. First, we contextualize this practice and briefly present the emergence and evolution of the practice of “filmed theater”, as well as any other form of performances (e.g., concert, ballet, opera) originally conceived for the stage but subsequently diffused through other channels. Secondly, we address the current legal issues that have arisen because of the increase of such (...) practice due to the containment measures taken by government. Two axes are of particular attention: the matter of copyrights and related rights, on the one hand, and the question of public financing, on the other. Concerning intellectual property, audiovisual broadcasting leads to several legal consequences and issues: effectiveness of related rights, emergence of new modes of exploitation and new authors, recognition of the recording as an original work, etc. This new practice is, moreover, likely to disrupt the categories established by public funding legal mechanisms, which are often poorly adapted to hybrid artistic objects. The objective of this part is therefore to analyze the new legal issues raised by the audiovisual distribution of performances. Finally, we go beyond exclusively legal issues to examine the very specificities of performing arts and, more specifically, the possible loss that would result from a fixation of a production on a reproducible medium, making its diffusion possible beyond the stage. (shrink)

Two experiments examined how affective values from visual and auditory modalities are integrated. Experiment 1 paired music and videos drawn from three levels of valence while holding arousal constant. Experiment 2 included a parallel combination of three levels of arousal while holding valence constant. In each experiment, participants rated their affective states after unimodal and multimodal presentations. Experiment 1 revealed a congruency effect in which stimulus combinations of the same extreme valence resulted in more extreme state ratings than component (...) stimuli presented in isolation. An interaction between music and video valence reflected the greater influence of negative affect. Video valence was found to have a significantly greater effect on combined ratings than music valence. The pattern of data was explained by a five parameter differential weight averaging model that attributed greater weight to the visual modality and increased weight with decreasing values of valence. Experiment 2 revealed a congruency effect only for high arousal combinations and no interaction effects. This pattern was explained by a three parameter constant weight averaging model with greater weight for the auditory modality and a very low arousal value for the initial state. These results demonstrate key differences in audiovisual integration between valence and arousal. (shrink)

For more than a century now, researchers have acknowledged the existence of seemingly arbitrary crossmodal congruency effects between dimensions of sensory stimuli in the general population. Such phenomena, known by a variety of terms including 'crossmodal correspondences', involve individual stimulus properties, rely on a crossmodal mapping of unisensory features, and appear to be shared by the majority of individuals. In other words, members of the general population share underlying preferences for specific pairings across the senses. Crossmodal correspondences between complementary sensory (...) cues have often been referred to as synesthetic correspondences but, we would argue, differ from full-blown synesthetic experiences in a number of important ways, including the fact that there are no idiosyncratic concurrent sensations. Recent psychophysical evidence suggests that such crossmodal correspondences can modulate multisensory integration by helping to resolve the crossmodal binding problem. Here, we propose a model to account for the effects of crossmodal correspondences between complementary auditory and visual cues and critically review their relation to full-blown synesthesia. (shrink)

Background Speech understanding may rely not only on auditory, but also on visual information. Non-invasive functional neuroimaging techniques can expose the neural processes underlying the integration of multisensory processes required for speech understanding in humans. Nevertheless, noise (from fMRI) limits the usefulness in auditory experiments, and electromagnetic artefacts caused by electronic implants worn by subjects can severely distort the scans (EEG, fMRI). Therefore, we assessed audio-visual activation of temporal cortex with a silent, optical neuroimaging technique: functional near-infrared spectroscopy (fNIRS). Methods (...) We studied temporal cortical activation as represented by concentration changes of oxy- and deoxy-hemoglobin in four, easy-to-apply fNIRS optical channels of 33 normal-hearing adult subjects and 5 post-lingually deaf cochlear implant (CI) users in response to supra-threshold unisensory auditory and visual, as well as to congruent auditory-visual speech stimuli. Results Activation effects were not visible from single fNIRS channels. However, by discounting physiological noise through reference channel subtraction, auditory, visual and audiovisual speech stimuli evoked concentration changes for all sensory modalities in both cohorts (p<0.001). Auditory stimulation evoked larger concentration changes than visual stimuli (p<0.001). A saturation effect was observed for the audiovisual condition. Conclusions Physiological, systemic noise can be removed from fNIRS signals by reference channel subtraction. The observed multisensory enhancement of an auditory cortical channel can be plausibly described by a simple addition of the auditory and visual signals with saturation. (shrink)

Cognitive scientists routinely distinguish between controlled and automatic mental processes. Through learning, practice, and exposure, controlled processes can become automatic; however, whether automatic processes can become deautomatized – recuperated under the purview of control – remains unclear. Here we show that a suggestion derails a deeply ingrained process involving involuntary audiovisual integration. We compared the performance of highly versus less hypnotically suggestible individuals in a classic McGurk paradigm – a perceptual illusion task demonstrating the influence of visual facial movements (...) on auditory speech percepts. Following a posthypnotic suggestion to prioritize auditory input, HSIs but not LSIs manifested fewer illusory auditory perceptions and correctly identified more auditory percepts. Our findings demonstrate that a suggestion deautomatized a ballistic audiovisual process in HSIs. In addition to guiding our knowledge regarding theories and mechanisms of automaticity, the present findings pave the road to a more scientific understanding of top-down effects and multisensory integration. (shrink)

Opera is a performing art in which music plays the leading role, and the acting of singers has a synergistic effect with the music. The mirror neuron system represents the neurophysiological mechanism underlying the coupling of perception and action. Mirror neuron activity is modulated by the appropriateness of actions and clarity of intentions, as well as emotional expression and aesthetic values. Therefore, it would be reasonable to assume that an opera performance induces mirror neuron activity in the audience so (...) that the performer effectively shares an embodied performance with the audience. However, it is uncertain which aspect of opera performance induces mirror neuron activity. It is hypothesized that although auditory stimuli could induce mirror neuron activity, audiovisual perception of stage performance is the primary inducer of mirror neuron activity. To test this hypothesis, this study sought to correlate opera performance with brain activity as measured by electroencephalography in singers while watching an opera performance with sounds or while listening to an aria without visual stimulus. We detected mirror neuron activity by observing that the EEG power in the alpha frequency band was selectively decreased in the frontal-central-parietal area when watching an opera performance. In the auditory condition, however, the alpha-band power did not change relative to the resting condition. This study illustrates that the audiovisual perception of an opera performance engages the mirror neuron system in its audience. (shrink)

Much writing on, first, analogue and, later, digital archives has focused on related power-dynamics and the structuring effects of archives and their technologies on discursive freedom and cultural dynamics. In recent years, however, work within the media archaeology domain, especially by Wolfgang Ernst, has addressed how the specific materialities of digital archives, and the nature of their algorithms and particular functions, could be seen to facilitate dynamics in cultures. This article sets this work in dialogue with the cultural semiotics of (...) Juri Lotman, whose late work focused on how communicative processes between and within different subsystems of culture facilitate their dynamic change and the production of new forms and cultural systems. The article suggests further interdisciplinary dialogue between media archaeology and cultural semiotics in order to understand the role of archives in facilitating communicative processes and interlinking in culture and the emergence of novelties – that is, for understanding the ‘creativity’ of archives. (shrink)

Dubbing Dark Humour: A Case Study in Audiovisual Translation In an attempt to analyze the ways in which dark humour travels cross-culturally in audiovisual translation, the present study takes into consideration the processes involved in dubbing humour from English into Italian as observed in the English- and Italian-language versions of ten British and American dark comedies from the 1940s to the 2000s. In order to identify some of the main mechanisms of the dark humour genre, the humorous content (...) of the films was analyzed in terms of the elements on which specific scenes are based, mainly the non-verbal and verbal components. In the cases in which verbal elements were involved, i.e. the examples of verbally expressed humour, the analysis was concerned with the translation strategies adopted and with possible effects of alteration of the dark humour content as a result of translation. (shrink)

In social interactions, emotional biases can arise when the emotional state of oneself and another person are incongruent. A person’s ability to judge the other’s emotional state can then be biased by their own emotional state, leading to an emotional egocentric bias (EEB). Alternatively, a person’s perception of their own emotional state can be biased by the other’s emotional state leading to an emotional altercentric bias (EAB). Using a modified audiovisual paradigm, we examined in three studies (n = 171; (...) two online & one lab-based study) whether emotional biases can be considered traits by measuring two timepoints within participant and relating empathy trait scores to emotional biases, as well as the electrophysiological correlates of emotional biases. In all studies, we found a congruency effect, reflecting an EEB and EAB of small size. Both biases failed to correlate significantly within participants across timepoints and did not display significant relationships with empathy trait scores. On the electrophysiological level, we did not find any neural emotional bias effects in the time–frequency domain. Our results suggest that EEB and EAB effects are strongly task sensitive. Caution is warranted when studying interindividual differences in emotional biases using this paradigm, as they did not show significant test-retest reliabilities. (shrink)

The purpose of this research is the analysis of a specific cultural and political tension, through two decisive concepts: imagocracy and imagomaquia. Our aim is to define the political battlefield in the arena of audiovisual communication. In the case of Latin America, we have identified two significant moments, in which the popular audiovisual strategies had crucial importance. Our material of research has been both the New Latin American Cinema and the sociology of the decolonial image. We have studied (...) them in depth in order to define the effectiveness of popular audiovisual strategies as nuclei of creation and aesthetic-political resistance, which opposes the hegemonic audiovisual order. (shrink)

The coronavirus pandemic has resulted in the recommended/required use of face masks in public. The use of a face mask compromises communication, especially in the presence of competing noise. It is crucial to measure the potential effects of wearing face masks on speech intelligibility in noisy environments where excessive background noise can create communication challenges. The effects of wearing transparent face masks and using clear speech to facilitate better verbal communication were evaluated in this study. We evaluated listener word identification (...) scores in the following four conditions: (1) type of mask condition (i.e., no mask, transparent mask, and disposable face mask), (2) presentation mode (i.e., auditory only and audiovisual), (3) speaking style (i.e., conversational speech and clear speech), and (4) with two types of background noise (i.e., speech shaped noise and four-talker babble at −5 signal-to-noise ratio). Results indicate that in the presence of noise, listeners performed less well when the speaker wore a disposable face mask or a transparent mask compared to wearing no mask. Listeners correctly identified more words in the audiovisual presentation when listening to clear speech. Results indicate the combination of face masks and the presence of background noise negatively impact speech intelligibility for listeners. Transparent masks facilitate the ability to understand target sentences by providing visual information. Use of clear speech was shown to alleviate challenging communication situations including compensating for a lack of visual cues and reduced acoustic signals. (shrink)

Kijkwijzer is the name of the new Dutch rating system in use since early 2001 to provide information about the possible harmful effects of movies, home videos and television programs on young people. The rating system is meant to provide audiovisual productions with both age-based and content-based ratings. It is designed to enable self-regulation by the audio-visual sector. The development of Kijkwijzer, which took place under the auspices of NICAM, the Netherlands Institute for the Classification of Audiovisual Media, (...) is based on consumer research among Dutch parents, as well as theories and research on children and the media. The consumer survey that preceded the development of Kijkwijzer revealed that 70% of Dutch parents indicated that they would use a rating system. The majority of parents liked to receive information on the content of media productions, particularly about violence, frightening content, sexual depictions, discrimination, drug abuse, and coarse language. Parents also wanted age categories. Kijkwijzer distinguishes four age categories: All Ages, 6, 12 and 16. This article gives an overview and account of the various principles underlying Kijkwijzer version 1.1. It also offers suggestions for improvement of future versions of Kijkwijzer. (shrink)

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of (...) IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. (shrink)

Multisensory integration can alter information processing, and previous research has shown that such processes are modulated by sensory switch costs and prior experience. Here we report an incidental finding demonstrating, for the first time, the interplay between these processes and experimental factors, specifically the presence of the experimenter in the testing room. Experiment 1 demonstrates that multisensory motor facilitation in response to audiovisual stimuli is higher in those trials in which the sensory modality switches than when it repeats. Those (...) participants who completed the study while alone exhibited increased RT variability. Experiment 2 replicated these findings using the letters “b” and “d” presented as unisensory stimuli or congruent and incongruent multisensory stimuli. Multisensory enhancements were inflated following a sensory switch; that is, congruent and incongruent multisensory stimuli resulted in significant gains following a sensory switch in the monitored condition. However, when the participants were left alone, multisensory enhancements were only observed for repeating incongruent multisensory stimuli. These incidental findings therefore suggest that the effects of letter congruence and sensory switching on multisensory integration are partly modulated by the presence of an experimenter. (shrink)

The COVID-19 pandemic has brought the live music industry to an abrupt halt; subsequently, musicians are looking for ways to replicate the live concert experience virtually. The present study sought to investigate differences in aesthetic judgments of a live concert vs. a recorded concert, and whether these responses vary based on congruence between musical artist and piece. Participants made continuous ratings of their felt pleasure either during a live concert or while viewing an audiovisual recorded version of the same (...) joint concert given by a university band and a United States Army band. Each band played two pieces: a United States patriotic piece and a non-patriotic piece. Results indicate that, on average, participants reported more pleasure while listening to pieces that were congruent, which did not vary based on live vs. lab listening context: listeners preferred patriotic music when played by the army band and non-patriotic music when played by the university band. Overall, these results indicate that felt pleasure in response to music may vary based on listener expectations of the musical artist, such that listeners prefer musical pieces that “fit” with the particular artist. When considering implications for concerts during the COVID-19 pandemic, our results indicate that listeners may experience similar degrees of pleasure even while viewing a recorded concert, suggesting that virtual concerts are a reasonable way to elicit pleasure from audiences when live performances are not possible. (shrink)

It is often assumed that the reaction time of a saccade toward visual and/or auditory stimuli reflects the sensitivities of our oculomotor-orienting system to stimulus saliency. Endogenous factors, as well as stimulus-related factors, would also affect the saccadic reaction time. However, it was not clear how these factors interact and to what extent visual and auditory-targeting saccades are accounted for by common mechanisms. The present study examined the effect of, and the interaction between, stimulus saliency and audiovisual spatial (...) congruency on the SRT for visual- and for auditory-target conditions. We also analyzed pre-target pupil size to examine the relationship between saccade preparation and pupil size. Pupil size is considered to reflect arousal states coupling with locus-coeruleus activity during a cognitive task. The main findings were that the pattern of the examined effects on the SRT varied between visual- and auditory-auditory target conditions, the effect of stimulus saliency was significant for the visual-target condition, but not significant for the auditory-target condition, Pupil velocity, not absolute pupil size, was sensitive to task set, and there was a significant correlation between the pre-saccade absolute pupil size and the SRTs for the visual-target condition but not for the auditory-target condition. The discrepancy between target modalities for the effect of pupil velocity and between the absolute pupil size and pupil velocity for the correlation with SRT may imply that the pupil effect for the visual-target condition was caused by a modality-specific link between pupil size modulation and the SC rather than by the LC-NE system. These results support the idea that different threshold mechanisms in the SC may be involved in the initiation of saccades toward visual and auditory targets. (shrink)

La mondialisation a pour effet de rendre indispensable non seulement le recours à la traduction, mais souvent aussi à l’adaptation. C’est en particulier le cas pour les ressources audiovisuelles numériques et leur republication, dont l’importance ne fait que croître. Le texte audio-visuel est en réalité à considérer comme un objet sémiotique pouvant avoir une extrême complexité, en raison des différentes strates dont il se compose. En particulier, chacun des plans que l’on peut y distinguer peut être l’objet d’une traduction culturelle (...) spécifique, car autrement les informations véhiculées risqueraient d’être mal interprétées par les récepteurs. Pour aborder cette problématique, l’article s’appuie notamment sur les travaux effectués dans le cadre du projet de recherche « Atelier sémiotique audiovisuel » financé par l’Agence nationale de la recherche .One effect of globalisation has been to make not only translation essential, but also adaptation. This is particularly true in the case of digital audiovisual resources and their re-publication, which are greatly increasing in importance. Audiovisual text should in fact be considered as a many-layered semiotic object whose complexity can be extreme. Each of these layers may require a specific cultural translation, failing which the information conveyed can be wrongly interpreted by those receiving it. In addressing this problem, this paper draws in particular on the work carried out under the “Audiovisual Semiotics Workshop” research project financed by the French National Research Agency. (shrink)

Imagery Rehearsal Therapy is effective for trauma-related nightmares and is also a challenge to patients in finding access to their traumatic memories, because these are saved in non-verbal, visual, or audiovisual language. Art therapy is an experiential treatment that addresses images rather than words. This study investigates the possibility of an IRT-AT combination. Systematic literature review and field research was conducted, and the integration of theoretical and practice-based knowledge resulted in a framework for Imagery Rehearsal-based Art Therapy. The added (...) value of AT in IRT appears to be more readily gaining access to traumatic experiences, living through feelings, and breaking through avoidance. Exposure and re-scripting take place more indirectly, experientially and sometimes in a playlike manner using art assignments and materials. In the artwork, imagination, play and fantasy offer creative space to stop the vicious circle of nightmares by changing theme, story line, ending, or any part of the dream into a more positive and acceptable one. IR-AT emerges as a promising method for treatment, and could be especially useful for patients who benefit least from verbal exposure techniques. This description of IR-AT offers a base for further research. (shrink)

Merging the information from different senses is essential for successful interaction with real-life situations. Indeed, sensory integration can reduce perceptual ambiguity, speed reactions, or change the qualitative sensory experience. It is widely held that integration occurs at later processing stages and mostly in higher association cortices; however, recent studies suggest that sensory convergence can occur in primary sensory cortex. A good model for early convergence proved to be the auditory cortex, which can be modulated by visual and tactile stimulation; however, (...) given the large number and small size of auditory fields, neither human imaging nor microelectrode recordings have systematically identified which fields are susceptible to multisensory influences. To reconcile findings from human imaging with anatomical knowledge from nonhuman primates, we exploited high-resolution imaging (functional magnetic resonance imaging) of the macaque monkey to study the modulation of auditory processing by visual stimulation. Using a functional parcellation of auditory cortex, we localized modulations to individual fields. Our results demonstrate that both primary (core) and nonprimary (belt) auditory fields can be activated by the mere presentation of visual scenes. Audiovisual convergence was restricted to caudal fields [prominently the core field (primary auditory cortex) and belt fields (caudomedial field, caudolateral field, and mediomedial field)] and continued in the auditory parabelt and the superior temporal sulcus. The same fields exhibited enhancement of auditory activation by visual stimulation and showed stronger enhancement for less effective stimuli, two characteristics of sensory integration. Together, these findings reveal multisensory modulation of auditory processing prominently in caudal fields but also at the lowest stages of auditory cortical processing. (shrink)

Humans coordinate their focus of attention with others, either by gaze following or prior agreement. Though the effects of joint attention on perceptual and cognitive processing tend to be examined in purely visual environments, they should also show in multisensory settings. According to a prevalent hypothesis, joint attention enhances visual information encoding and processing, over and above individual attention. If two individuals jointly attend to the visual components of an audiovisual event, this should affect the weighing of visual information (...) during multisensory integration. We tested this prediction in this preregistered study, using the well-documented sound-induced flash illusions, where the integration of an incongruent number of visual flashes and auditory beeps results in a single flash being seen as two (fission illusion) and two flashes as one (fusion illusion). Participants were asked to count flashes either alone or together, and expected to be less prone to both fission and fusion illusions when they jointly attended to the visual targets. However, illusions were as frequent when people attended to the flashes alone or with someone else, even though they responded faster during joint attention. Our results reveal the limitations of the theory that joint attention enhances visual processing as it does not affect temporal audiovisual integration. (shrink)

L’émergence de l’installation au milieu du xxe siècle se fait de manière concomitante avec l’art de la performance et de la vidéo. Les artistes de l’installation se sont donc emparés de l’image en mouvement et ont développé des dispositifs au caractère performatif vis-à-vis du visiteur. Dans les années 1970, Dan Graham révèle la visibilité et la perception d’un « invu », à savoir le temps comme matière et l’espace comme vecteur proprioceptif dans ses installations vidéographiques reposant sur l’effet de time (...) delay. Face à l’enregistrement et à la retransmission en décalé de sa propre image, le visiteur prend conscience de son existence et de son rapport aux autres. Plus récemment, les installations « post-cinématographiques » ont permis de renouveler ces questionnements. L’exposition Servitudes de Jesper Just témoigne de ce dialogue entre installation audiovisuelle, espace architectural et perception du visiteur. Projeté sur des écrans, disséminé dans les sous-sols du Palais de Tokyo, le film de Just n’est visible que par fragments, le visiteur devenant le « monteur » d’une narration ambiguë et hétérodoxe, et devant pour cela se déplacer à travers les enchevêtrements de rampes métalliques, créant une « architecture spectatorielle de l’installation ». The emergence of installation art in the middle of the twentieth century is concomitant with the art of performance and video. The artists therefore took possession of the moving image and developed devices with a performative character vis-à-vis the visitor. In the 1970s, Dan Graham manifests the visibility and the perception of an “invu” which is time as matter and space as a proprioceptive vector in his video installations based on the effect of time delay. Faced with the recording and retransmission of his/her own image, the visitor becomes aware of his/her existence and its relationship to others. More recently, the “post-cinematographic” installations made it possible to investigate anew these questions. The exhibition Servitudes by Jesper Just testify of this dialogue between an audiovisual installation, an architectural space and the visitor’s perception. Shown on screens, scattered in the basements of the Palais de Tokyo, the film of Just was visible only in fragments. Hence the visitor became the “editor” of an ambiguous and heterodox narration. To do so he/she had to move through the entanglements of metal ramps, creating a “spectatorial architecture of the installation”. (shrink)

In this reply to Robrecht Vanderbeeken’s essay ‘The Screen as an In-Between’ questions are raised concerning the three distinctive effects the authors attributes to contemporary audiovisual media—eclipsing, interpassivity and truth procedure—and argued that they fail to highlight the specificity of the new media referred to.

In Brazil, every study involving human beings is required to produce an informed consent form that must be signed by study participants: this is stated in Resolution 196/96. 1 Consent must be obtained through a specific structured process. Objective: To present the opinions of women regarding how the process of obtaining informed consent should be conducted when women are invited to participate in studies on contraceptive methods. Subjects and Methods: Eight focus groups were conducted, involving a total of 51 women (...) living in the metropolitan region of Campinas. The women involved in the study were either participating in a clinical trial in the area of women's health or had participated in such a trial in the previous 12 months. A thematic guide was used to conduct the focus group discussions; the discussions were recorded, transcribed and a thematic analysis performed. Results: In general, the person who invites a woman to participate in a study should be a member of the research team but not the principal investigator. Information relating to the study should be given orally and in writing, both individually and in the group setting. Study volunteers should be informed about, among other things, the risks, possible side effects and discomforts, including long-term effects. The use of audiovisual aids to provide information was suggested. Conclusion: The process for obtaining informed consent was seen as a means of establishing a relationship between the volunteers and the investigator/research team. The information that the study participants expected to be given coincides with the requirements established under Resolution 196/96. The use of audiovisual aids would improve understanding of the information provided. (shrink)

This collection brings together artists and theoreticians to provide the first anthology of a new field: Practical Aesthetics. A work of art already contains its own criticism, a knowledge of its own which need not be conceptual or propositional. Yet today, there are many approaches to different forms of art that work on the brink between science and art, 'sensible cognition' and proposition, aesthetic knowledge and rational knowledge, while thinking with art (or the artistic material) rather than about it. This (...) volumes presents ways of thinking with different forms of art (film, sound, dance, literature, etc), as well as new forms of aesthetic research and presentation such as Media Philosophy, the audiovisual essay, fictocriticism, the audio paper, and Artistic Research. It reveals how writing about art can become 'artistic' or 'poetic' in its own right: not only writing about artistic effects, but producing them in the first place. This takes art not as an object of (external) analysis, but as a subject with a knowledge in its own right, creating a co-composing 'conceptual interference pattern' between theory and practice. A 'practical aesthetics' thus understood, can be described as thinking with art, in order to find new ways to create worlds and thus to make the world perceivable in different ways. (shrink)

Background: The intrauterine hearing experience differs from the extrauterine hearing exposure within a neonatal intensive care unit (NICU) setting. Also, the listening experience of a neonate drastically differs from that of an adult. Several studies have documented that the sound level within a NICU exceeds the recommended threshold by far, possibly related to hearing loss thereafter. The aim of this study was, firstly, to precisely define the dynamics of sounds within an incubator and, secondly, to give clinicians and caregivers an (...) idea about what can be heard “inside the box.” Methods: Audio recordings within an incubator were conducted at the Pediatric Simulation Center of the Medical University Vienna. They contained recorded music, speech and synthesized sounds. To understand the dynamics of sounds around and within the incubator the following stimuli were used: broadband noise with decreasing sound level in ten steps of 6 dB, sine waves (62.5, 125, 250, 500, 1000, 2000, 4000, 8000 and 16000 Hz), logarithmic sweep (Chirp) over the frequency band 20 Hz to 21 kHz, singing male voice, singing and whispering female voice. Results: Our results confirm a protective effect of the incubator from noises above 500 Hz in conditions of “no-flow” and show almost no protective effect of an incubator cover. We, furthermore, observed a strong boost of low frequencies below 125 Hz within the incubator, as well as a notable increase of higher frequency noises with open access doors, a significant resonant effect of the incubator, and a considerable masking effect of the respiratory support against any other source of noise or sound stimulation even for “low-flow” conditions. Conclusion: Our study reveals high noise levels of air supply at high flow rates and the boost of low frequencies within the incubator. Education of medical staff and family members as well as modifications of the physical environment should aim at reducing noise exposure of preterm infants in the incubator. Audiovisual material is provided as supplementary material. (shrink)

The subject of the study is the process of many aspects of audiovisual creativity that must be taken into account when creating a video. The object of the work is to create a movie trailer through the use of design elements and graphics in the video sequence. The study examines the trailer of a post-apocalyptic fantasy genre called "Genesis", in which the two main characters are depicted as opposites. The work examines and describes in detail all the stages of (...) creating a video trailer for the film, including visual representation, audio accompaniment of the video sequence. The paper notes that the main goal of all the stages of trailer development considered in the article is to create an audiovisual project of professional quality. The main methods used in the study are visual effects modeling and 3D modeling in Houdini, creating realistic matte paintings in Photoshop and video compositing in Nuke. The main conclusions of the study are those specialized programs that allow you to create a high-quality author's product. This software will become the core of the project, since it is in it that all the elements will be combined into one final clip due to the high-quality integration of various objects of the scene. The novelty of the research lies in the fact that within the framework of the work, the characteristics of the possibilities of working with various video editors and graphic programs were carried out, which together help the creators of movie trailers and other similar products to realize the tasks of entertainment and quality of the projects produced. (shrink)

Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients’ knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of items to (...) forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts’ opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. The ClinicalTrials.gov Identifier is NCT01338480. The date of registration was April 18, 2011. (shrink)

Background Ensuring adequate informed consent for surgery in a trauma setting is challenging. We developed and pilot tested an educational video containing information regarding the informed consent process for surgery in trauma patients and a knowledge measure instrument and evaluated whether the audiovisual presentation improved the patients’ knowledge regarding their procedure and aftercare and their satisfaction with the informed consent process. Methods A modified Delphi technique in which a panel of experts participated in successive rounds of shared scoring of (...) items to forecast outcomes was applied to reach a consensus among the experts. The resulting consensus was used to develop the video content and questions for measuring the understanding of the informed consent for debridement surgery in limb trauma patients. The expert panel included experienced patients. The participants in this pilot study were enrolled as a convenience sample of adult trauma patients scheduled to receive surgery. Results The modified Delphi technique comprised three rounds over a 4-month period. The items given higher scores by the experts in several categories were chosen for the subsequent rounds until consensus was reached. The experts reached a consensus on each item after the three-round process. The final knowledge measure comprising 10 questions was developed and validated. Thirty eligible trauma patients presenting to the Emergency Department were approached and completed the questionnaires in this pilot study. The participants exhibited significantly higher mean knowledge and satisfaction scores after watching the educational video than before watching the video. Conclusions Our process is promising for developing procedure-specific informed consent and audiovisual aids in medical and surgical specialties. The educational video was developed using a scientific method that integrated the opinions of different stakeholders, particularly patients. This video is a useful tool for improving the knowledge and satisfaction of trauma patients in the ED. The modified Delphi technique is an effective method for collecting experts’ opinions and reaching a consensus on the content of educational materials for informed consent. Institutions should prioritize patient-centered health care and develop a structured informed consent process to improve the quality of care. Trial registration The ClinicalTrials.gov Identifier is NCT01338480. The date of registration was April 18, 2011. (shrink)

Disparate theoretical viewpoints construe hypnotic suggestibility either as a stable trait, largely determined by underlying cognitive aptitude, or as a flexible skill amenable to attitudinal factors including beliefs and expectations. Circumscribed findings support both views. The present study attempted to consolidate these orthogonal perspectives through the lens of expectancy modification. We surreptitiously controlled light and sound stimuli to convince participants that they were responding strongly to hypnotic suggestions for visual and auditory hallucinations. Extending our previous findings, we indexed hypnotic suggestibility (...) by de-automatizing an involuntary audiovisual phenomenon—the McGurk effect. Here we show that, regardless of expectancy modification, the experimental procedure led to heightened expectations concerning future hypnotic response. We found little effect of expectation, however, on actual response to suggestion. Our findings intimate that, at least in the present experimental context, expectation hardly correlates with—and is unlikely to be a primary determinant of—high hypnotic suggestibility. (shrink)

Most language learners have difficulties acquiring the phonemes of a second language (L2). Unfortunately, they are often judged on their L2 pronunciation, and segmental inaccuracies contribute to miscommunication. Therefore, we aim to determine how to facilitate phoneme acquisition. Given the close relationship between speech and co-speech gesture, previous work unsurprisingly reports that gestures can benefit language acquisition, e.g., in (L2) word learning. However, gesture studies on L2 phoneme acquisition present contradictory results, implying that both specific properties of gestures and phonemes (...) used in training, and their combination, may be relevant. We investigated the effect of phoneme and gesture complexity on L2 phoneme acquisition. In a production study, Dutch natives received instruction on the pronunciation of two Spanish phonemes, /u/ and /θ/. Both are typically difficult to produce for Dutch natives because their orthographic representation differs between both languages. Moreover, /θ/ is considered more complex than /u/, since the Dutch phoneme inventory contains /u/ but not /θ/. The instruction participants received contained Spanish examples presented either via audio-only, audio-visually without gesture, audio-visually with a simple, pointing gesture, or audio-visually with a more complex, iconic gesture representing the relevant speech articulator(s). Preceding and following training, participants read aloud Spanish sentences containing the target phonemes. In a perception study, Spanish natives rated the target words from the production study on accentedness and comprehensibility. Our results show that combining gesture and speech in L2 phoneme training can lead to significant improvement in L2 phoneme production, but both gesture and phoneme complexity affect successful learning: Significant learning only occurred for the less complex phoneme /u/ after seeing the more complex iconic gesture, whereas for the more complex phoneme /θ/, seeing the more complex gesture actually hindered acquisition. The perception results confirm the production findings and show that items containing /θ/ produced after receiving training with a less complex pointing gesture are considered less foreign-accented and more easily comprehensible as compared to the same items after audio-only training. This shows that gesture can facilitate task performance in L2 phonology acquisition, yet complexity affects whether certain gestures work better for certain phonemes than others. (shrink)

Word learning is basic to foreign language acquisition, however time consuming and not always successful. Empirical studies have shown that traditional (visual) word learning can be enhanced by gestures. The gesture benefit has been attributed to depth of encoding. Gestures can lead to depth of encoding because they trigger semantic processing and sensorimotor enrichment of the novel word. However, the neural underpinning of depth of encoding is still unclear. Here, we combined an fMRI and a behavioral study to investigate word (...) encoding online. In the scanner, participants encoded 30 novel words of an artificial language created for experimental purposes and their translation into the subjects’ native language. Participants encoded the words three times visually, audiovisually, and by additionally observing semantically related gestures performed by an actress. Hemodynamic activity during word encoding revealed the recruitment of cortical areas involved in stimulus processing. In this study, depth of encoding can be spelt out in terms of sensorimotor brain networks that grow larger the more sensory modalities are linked to the novel word. Word retention outside the scanner documented a positive effect of gestures in a free recall test in the short-term. (shrink)

Infants have been shown to rely both on auditory and visual cues when processing speech. We investigated the impact of COVID-related changes, in particular of face masks, in early word segmentation abilities. Following up on our previous study demonstrating that, by 4 months, infants already segmented targets presented auditorily at utterance-edge position, and, using the same visual familiarization paradigm, 7–9-month-old infants performed an auditory and an audiovisual word segmentation experiment in two conditions: without and with an FFP2 face mask. (...) Analysis of acoustic and visual cues showed changes in face-masked speech affecting the amount, weight, and location of cues. Utterance-edge position displayed more salient cues than utterance-medial position, but the cues were attenuated in face-masked speech. Results revealed no evidence for segmentation, not even at edge position, regardless of mask condition and auditory or visual speech presentation. However, in the audiovisual experiment, infants attended more to the screen during the test trials when familiarized with without mask speech. Also, the infants attended more to the mouth and less to the eyes in without mask than with mask. In addition, evidence for an advantage of the utterance-edge position in emerging segmentation abilities was found. Thus, audiovisual information provided some support to developing word segmentation. We compared 7–9-monthers segmentation ability observed in the Butler and Frota pre-COVID study with the current auditory without mask data. Mean looking time for edge was significantly higher than unfamiliar in the pre-COVID study only. Measures of cognitive and language development obtained with the CSBS scales showed that the infants of the current study scored significantly lower than the same-age infants from the CSBS normative data. Our results suggest an overall effect of the pandemic on early segmentation abilities and language development, calling for longitudinal studies to determine how development proceeds. (shrink)

Misophonia has been characterized as intense negative reactions to specific trigger sounds. However, recent research suggests high-level, contextual, and multisensory factors are also involved. We recently demonstrated that neurotypicals’ negative reactions to aversive sounds are attenuated when the sounds are synced with positive attributable video sources. To assess whether this effect generalizes to misophonic triggers, we developed a Sound-Swapped Video database for use in misophonia research. In Study 1, we created a set of 39 video clips depicting common trigger (...) sounds and a corresponding set of 39 PAVS temporally synchronized with the OVS videos. In Study 2, participants rated the 39 PAVS videos for their audiovisual match and pleasantness. We selected the 20 PAVS videos with best match scores for use in Study 3. In Study 3, a new group of participants observed the 20 selected PAVS and 20 corresponding OVS and judged the pleasantness or unpleasantness of each sound in the two contexts accompanying each video. Afterward, participants completed the Misophonia Questionnaire. The results of Study 3 show a robust attenuating effect of PAVS videos on the reported unpleasantness of trigger sounds: trigger sounds were rated as significantly less unpleasant when paired with PAVS with than OVS. Moreover, this attenuating effect was present in nearly every participant regardless of their score on the MQ. In fact, we found a moderate positive correlation between the PAVS-OVS difference and misophonia severity scores. Overall our results provide validation that the SSV database is a useful stimulus database to study how misophonic responses can be modulated by visual contexts. Here, we release the SSV database with the best 18 PAVS and 18 OVS videos used in Study 3 along with aggregate ratings of audio-video match and pleasantness. We also provide detailed instructions on how to produce these videos, with the hope that this database grows and improves through collaborations with the community of misophonia researchers. (shrink)

This article explores the way Levinas communicates his ethical message through the media at work in his work: speech, writing, and rare references to modern media. Levinas's ethical message concerns the import of the relation with the other, a relation that interrupts any attempt at its thematization, including Levinas's own philosophy. Levinas's text serves as an exemplary medium for this ethical message in conveying the teaching of ethics along with the interruption it advocates. The article then extends the logic of (...) the ethical message beyond the two key media present in Levinas's work—speech and writing—to speculate on whether the interruption it effects can be carried over to audiovisual media. Running throughout is the question of mediation, which takes the discussion outside the context of the face to face, where Levinas's thought is typically situated, to the context of the third and of justice. Levinas's thought may thus lead toward a radical ethics of media—radical in the sense that it posits the act of mediation itself as the root of such ethics. (shrink)

Introduction. In the context of the COVID-19 pandemic, which spread around the world in early 2020, special attention is paid to external transformations in human life: forced staying at home, using personal protective equipment in public places, social distance, etc. Nevetheless, the inner world of a man is susceptible to serious transformations. Another necessary element that structures the world of self (J. Deleuze’s point of view) is turning into a potential carrier of the virus. Therefore, the problem of human reflection (...) with the goal of taking care of oneself in a crisis situation is of particular relevance. The aim of the study is to substantiate the effectiveness of spiritual practices of the period of Antiquity and the early Middle Ages as forms of caring of the internal in a person in the pandemic. Methods. The author uses general scientific methods: analysis and synthesis, induction, deduction, abstraction. In addition, a comparative historical method, an interpretation method and a systematic approach are applied. With the help of the dialectical approach, the connection between the external and the internal in a person was designated. Scientific novelty of the study. Three scenarios of human responses to self-isolation in the context of an event (external) – meaning (internal) are outlined: orientation to an external event; creating an external event; appeal to the self. Results. In the context of self-isolation, staying alone with himself, a person faced a problem, a crisis of identity (empirical evidence for this problem was provided by psychologists and psychotherapists in Chelyabinsk and the Chelyabinsk region). This problem is due to the fact that the pandemic has reduced many of the person’s connections with the outside world (work, study, relationships with friends and relatives) and / or transferred them to a remote format. Therefore, consciously or optionally, at the level of an unreasonable request, a person has a need to rethink his self. Rethinking is a reflexive procedure when a person re-learns to communicate with his self. M. Foucault analyzed and systematized examples of spiritual work with I, looking into the practices of care of the self in ancient thinkers’ and early Christians’ studies. Conclusion. The COVID-19 virus has made significant adjustments to human life. No less adjustments were made to the events (F. Girenok) that fill the life of a person. A man’s replies to changes in his being can be laid between two poles: event and meaning. Even while at home, many continue to focus on the external, creating something of their own (for example, audiovisual production) or consuming the results of others. At the same time, orientation to meaning involves focusing on oneself. Philosophers and theologians who practiced self-care about two millennia ago, proposed different forms of reflection, pursuing one goal, to learn to talk with oneself. (shrink)

continent. 1.1 (2011): 22-25. The Author gratefully acknowledges the financial support of CAPES (Coordenação de Aperfeiçoamento do Ensino Superior), Brazil. From the multifarious subdivisions of semiotics, be they naturalistic or culturalistic, the realm of semiotics of value is a ?eld that is getting more and more attention these days. Our entire political and economic systems are based upon structures of symbolic representation that many times seem not only to embody monetary value but also to determine it. The connection between monetary (...) and linguistic exchanges is self-evident: the former requires the latter and develops in direct relation to it. Creative experimentation and design of digital systems of value exchange are blossoming on the web. Dr. Gilson Schwartz, an economist turned media theorist and professor at the University of São Paulo, adopted the concept of Iconomics, originally created by Michael Kaplan, an author concerned with the linguistics of economic value. Empowering local communities and unlocking new levels of value creation and representation via digital technologies are the main goals of Dr. Schwartz’s projects, aiming at the re-designing of our relationship to the economic value of imagination and the social control of property. Schwartz is Assistant Professor at the School of Communication and Arts of the University of São Paulo, a former Chief Economist at BankBoston, Brazil and Advisor to the President of the National Social and Economic Development Bank (BNDES). FURTHER READING: Kaplan, Michael. “Iconomics: The Rhetoric of Speculation.” Public Culture . 15.3 (2003): 477-493. Renata Lemos-Morais: You have recently produced and directed a short documentary about Creative Currencies in Latin America. Could you tell us a bit about its process and its findings? Gilson Schwartz: The “Creative Currencies” project is a work-in-progress platform which unfolds as an action research agenda connected both to the production of audiovisual content and the development of social currency software. The initiative dates back to 2003 when I led an experimental project supported by the Presidency of Brazil. At that time, we issued paper currency in a small, touristic village in the Northeast Region which stimulated local cultural projects. But it was only in 2009 that the Central Bank of Brazil acknowledged “social currencies” as a legitimate economic agenda, calling for more debate at the I Financial Inclusion Forum. This year, the monetary authorities organized a second forum that also opened the room to discussions on mobile payment systems and new perspectives on poverty alleviation via State subsidies. The Ministry of Culture funded the “Creative Currencies” project in 2009-2010 and our next stage in this discovery process is to be supported by the National Social and Economic Development Bank (BNDES). In short, there is genuine interest among public officials in different areas and public funding for social currencies is on the rise in Brazil. However, after all these years we are still at a very early stage of research and practice. Some of the most successful initiatives (such as Banco Palmas) actually evolved out of local monetary creation to become correspondent banking operations for commercial banks and other financial groups. After eight years of price stability and social inclusion, Brazil stands out as a major opportunity for social experimentation, even the Grameen Bank is now entering the Brazilian market and many NGOs are geared towards different forms of entrepreneurialism in the base of the pyramid, riding solidarity economic models, microfinance and microcredit for local development. It is yet to be seen, however, whether these developments are just one more stage of “bankarization”, that is to say, an extension of regular banking services or actually a new form of social and symbolic self-determination at the local level. So far, the Central Bank of Brazil is open to new forms of credit and local finance as long as they are strictly territorial and very close to barter among the poor. In other words, whether the process of monetary creation could be made to fit an open source paradigm is yet to be seen. Community banking and social currencies might as well end up as just another channel for access to and use of banking services. The “Creative Currencies” project aims at promoting the discussion of more fundamental issues, such as the limits of central banking, the prospects for local financial development and the possibility of creating and managing financial icons as cultural assets. The purpose of this project is to produce short documentaries that will bear testimony to this evolving regulatory framework while inducing more discussion about the fundamental iconomic issues concealed in the process of money and wealth creation. RLM: What new potential is there in applying digital technologies to currency creation? GS: Globalization is a result of the virtualization of money, that is, the overcoming of illusions such as the “gold standard”. Money is an icon created by institutions, not on supposedly natural or material foundations but out of political and financial interests. The “dollar standard” is an outstanding evidence of this phenomenon and Kaplan´s paper, the first to use the expression “iconomics”, insists on the rhetoric and semiotic effects associated to a supposedly scientific model of money creation and management. This is a fundamental change that was perceived and discussed much before the digitalization of the world by unorthodox economists such as John Maynard Keynes since the early 20th century. The digitalization of global financial flows accelerated this immateriality and the creation of the Euro was yet another evidence of the political foundations of currencies. The banking establishment, however, is keen on the idea that scientific formulae hold the key to sound money creation. Keynesianism has been repeatedly associated to “inflationism” while the supposedly sound monetary policies of the Orthodoxy serve well the political and financial interests of a technocratic elite. Corporate media also serve this fictitious depiction of the monetary process despite the cyclical bust of monetary rules and financial regulations. The internet, however, has created numerous opportunities for the disintermediation in industries such as film, music and commodities. There is no reason to doubt that the financial industry can also be transformed by Peer-to-Peer (P2P) infrastructures. Money is media as well. Credit is but confidence. Once people realize that the distributed computing power of networks can also be the platform to weave new monetary and credit operations, there is room for grassroots emancipation out of the established owners of monetary institutions. So far, however, there has been a privatization of monetary management and there is not a clear path or model for the emergent (P2P) property democratization that is inherent to the internet. Digital assets, however, clearly have an inherent potential to escape central control and proprietary regulatory frameworks. RLM: How are social networks transforming the ways in which we exchange value? Do you believe that online influence and reputation might be translated into a new kind of currency? GS: The foundation for social currencies as envisaged by solidarity economics is the territory. Authorities are willing to concede local monetary creation as long as it is restricted to poor neighborhoods, as a proxy to barter. In this relevant but limited context, reputation, personal knowledge and informal ties form the matrix of local or “proximity” finance which are expected to keep credit and leverage to a sustainable level. Anything beyond that should and would lead to an integration of local finance into the established banking system. However, inasmuch as the internet promotes virtual territories and reputation is now subject to all sorts of digital manipulation and stardom becomes an everyday cultural process among teenagers and elders alike, the territorial “foundation” is substituted for more complex patterns of solidarity, cooperation and exchange that reach beyond the physical territory and even the “human.” Digital assets embody knowledge, technology, cultural and educational values that are exchanged at a global scale beyond the control of democratic States (Chinese-like intervention is the exception, not the rule). Hacktivism is unstoppable and so is monetary hacktivism. Especially in the Third World, mobile communications fast became conveyors of money transfers and other appropriation strategies. Banking and telecom sectors already battle for the control of these emerging markets and, as a matter of fact, have so far contributed to the containment of these processes. Governments serve these moguls and have usually adopted a wait-and-see attitude. If open source hardware and grassroots social movements combine to challenge these proprietary battles, then social networks may evolve into new forms of social capital and thus form the ground on which to design and implement social currencies. The global financial crisis, as well as the dollar demise, are an event of such a proportion that social networks may open the path for emancipator subjects to seize the opportunity. RLM: What are some of the social experiments that you think are revolutionizing the way in which value is exchanged? GS: There is a broad evolution of economic systems towards the valuation of intangible assets such as knowledge, reputation and sustainability. There are many examples of local as well as global events that call the traditional systems of exchange into question, from carbon credits to educational bonuses, digital barter frameworks and locally based solidarity and fair trade networks. These emerging examples, no matter how different in nature or scale, represent a challenge to the traditional value creation schemes and theories which are based on use and exchange value, supply and demand. This is not to say that utility and labour or scarcity are to be totally dismissed, but there is now an emerging perception that value is also a function of behavioral codes, symbolic patterns and the energy of institutional frameworks. The plasticity of digital platforms is relevant insofar as intellectual property becomes the central source of value creation. But when you discuss the property rights of public goods such as the environment or basic social rights (of minorities or localities), then a new paradigm seems to emerge. RLM: Are gaming and online storytelling digital practices that might have an impact on the way new currencies are created and developed? GS: “Play money” has been one of the early and most intriguing phenomena associated to the diffusion of virtual worlds. These virtual currencies have also been prone to “boom and bust” dynamics, speculation and pure theft (Second Life scams were common and led to “intervention” by the owners of the game). Storytelling is a major source of value, that is, the value of attention and the markets for audience. There are plenty of private monies created and managed by corporate entertainment groups, telecom operators (via mobile virtual network operators) and marketing frameworks. The casino economy, as already depicted by Keynes and other unorthodox economists, is always storytelling about future states of the world, confidence building and leverage of animal spirits. The novelty of current events is not the fictitious nature of any form of capital, but the potential for digital democratization of controls over the imaginary nature of value creation. But this is just a potential, a possibility, a figment that more often than not is appropriated by centralized and opaque private powers. The game industry is a testbed for new connections between storytelling and money creation. RLM: Monetary value was originally connected to the scarcity of precious metals, such as gold. Our entire monetary system seems therefore to function according to a logic of scarcity. Do you believe it is possible to reverse this logic into a logic of abundance? GS: The gold standard was a fiction itself, the “scarcity” is always produced by institutions that regulate confidence and access to credit. The key issue is not to fabricate abundance, but to question the institutions which produce scarcity out of any standard, gold or whatever. Central banks are at the service of private banks in the creation and management of scarcity. RLM: The promise that nanotechnology holds for our future is one of radical abundance (or so say transhumanists). The possibility of creating any kind of material substance through nanoengineering seems each day more feasible. What would this possibility entail in terms of systems of value exchange? GS: Nanotechnology, environmental concerns and grassroots appropriation of distributed knowledge are the frontiers of a new horizon of energy creation and management. Social groups in charge of managing scarcity for the sake of wealth and power concentration must be held accountable for the destruction of our future. Once this key political conundrum is accounted for, new systems of value exchange and even a non-mercantile society will come into existence. Revolutionary theorists such as Marx envisaged transformation via the extreme clash of contradictions between capital and labour. This approach has never led to a change in the systemic logic of scarcity for the sake of social control. We are once again facing the threshold of large scale societal change, but the outcome of the current crisis should come from our imagination, not from yet another paradox of abundance and scarcity. As long as we remain attached to the materiality of value, the illusion of freedom will but reinforce the massive manipulation of necessity. RLM: What do you think is the role of crowdfunding in this context? GS: Crowdsourcing as well as crowdfunding are examples of the peer to peer opportunities that come along with distributed computer power. However, the power structure behind wealth and scarcity creation may or may not be changed by crowd management. But it should not be taken at face value, so to speak. The stock market of course is an early form of crowdfunding without calling into question the proprietary framework of the companies offering their investment projects to the market. Any market is a form of crowdsourcing, that is to say, of distributed forms of supply and demand matchmaking. The wealth of networks, however, depends on the contractual ecosystem, the institutional framework, the channeling of social imagination, not on the purely quantitative distribution of bids and offers. I see economics as supply, demand and code. Once you have access to the code, once openness becomes part of the game, then there is a chance of crowd behavior becoming collective intelligence and sustainable imagination. RLM: Is the development of digital currencies headed towards a pluralistic ecology in which many micro currency systems co-exist, or is it penetrating the mainstream monetary system? If it is affecting the mainstream financial system, what would be its effect in the long-term? GS: The same issue is at stake both at local and global levels. The global system is, as a matter of fact, an unstable ecosystem of “micro currencies” whereas the dollar has so far exerted an overwhelming influence. Local currencies and private monies coexist with national currencies only to the extent that the Central Bank admits, for instance, that grassroots monetary emissions remain territorial and strictly connected to poverty. However, the question of how new developments in digital technologies and nanotechnologies might alter not only our current monetary systems but also our understanding of value in itself, is still an open question. (shrink)