Consciousness and Psychology

Constructing a self model with universal cultural adaptability is a common concern of cultural psychologists. These models can be divided into two types: one is the self model based on Western culture, represented by the self theory of Marsh, Cooley, Fitts, etc.; the other is the non-self model based on Eastern culture, represented by the Mandela model of Hwang Kwang Kuo and the Taiji model of Zhen Dong Wang. However, these models do not fully explain the self structure and development (...) of Chinese people in the context of Chinese Buddhist culture. Based on the self theory of Chinese Buddhism and inspired by the famous Buddhist work Awakening of Faith in the Mahāyāna, this article constructs the “one mind, two aspects” self model. This model not only can properly represent the self structure of Chinese people in the context of Chinese Buddhism but also can explain the self-cultivation process and the realm of practice of Chinese Buddhist believers and thus has satisfactory cultural validity. (shrink)

Situated approaches to affectivity overcome an outdated individualistic perspective on emotions by emphasizing the role embodiment and environment play in affective dynamics. Yet, accounts which provide the conceptual toolbox for analyses in the philosophy of emotions do not go far enough. Their focus falls on the present situation, abstracting from the broader historico-cultural context, and on adopting a largely functionalist approach by conceiving of emotions and the environment as resources to be regulated or scaffolds to be used. In this paper, (...) I argue that we need to take situatedness seriously: We need to acknowledge that emotions are not situated in undetermined “contexts” but in concrete socio-culturally specific practices referring to forms of living; and to agree that not only are context and emotions used for the sake of something else but also that the meaning-disclosive dimension of affective intentionality is structured by situatedness as well. To do so, I offer a multidimensional approach to situatedness that integrates the biographical and cultural dimensions of contextualization within the analysis of situated affective dynamics. This approach suggests that humans affectively disclose meaning which is at once product and producer of specific forms of living – and these are always already subjects of critique. (shrink)

Autism spectrum disorder is characterized by atypical perception, including processing that is biased toward local details rather than global configurations. This bias may impact on memory. The present study examined the effect of this perception on both implicit and explicit memory in conditions that promote either local or global processing. The first experiment consisted of an object identification priming task using two distinct encoding conditions: one favoring local processing and the other favoring global processing of drawings. The second experiment focused (...) on episodic memory with two different cartoon recognition tasks that favored either local or a global processing. In addition, all the participants underwent a general clinical cognitive assessment aimed at documenting their cognitive profile and enabling correlational analyses with experimental memory tasks. Seventeen participants with ASD and 17 typically developing controls aged from 10 to 16 years participated to the first experiment and 13 ASD matched with 13 TD participants were included for the second experiment. Experiment 1 confirmed the preservation of priming effects in ASD but, unlike the Comparison group, the ASD group did not increase his performance as controls after a globally oriented processing. Experiment 2 revealed that local processing led to difficulties in discriminating lures from targets in a recognition task when both lures and targets shared common details. The correlation analysis revealed that these difficulties were associated with processing speed and inhibition. These preliminary results suggest that natural perceptual processes oriented toward local information in ASD may impact upon their implicit memory by preventing globally oriented processing in time-limited conditions and induce confusion between explicit memories that share common details. (shrink)

Some things look more complex than others. For example, a crenulate and richly organized leaf may seem more complex than a plain stone. What is the nature of this experience—and why do we have it in the first place? Here, we explore how object complexity serves as an efficiently extracted visual signal that the object merits further exploration. We algorithmically generated a library of geometric shapes and determined their complexity by computing the cumulative surprisal of their internal skeletons—essentially quantifying the (...) “amount of information” within each shape—and then used this approach to ask new questions about the perception of complexity. Experiments 1–3 asked what kind of mental process extracts visual complexity: a slow, deliberate, reflective process (as when we decide that an object is expensive or popular) or a fast, effortless, and automatic process (as when we see that an object is big or blue)? We placed simple and complex objects in visual search arrays and discovered that complex objects were easier to find among simple distractors than simple objects are among complex distractors—a classic search asymmetry indicating that complexity is prioritized in visual processing. Next, we explored the function of complexity: Why do we represent object complexity in the first place? Experiments 4–5 asked subjects to study serially presented objects in a self‐paced manner (for a later memory test); subjects dwelled longer on complex objects than simple objects—even when object shape was completely task‐irrelevant—suggesting a connection between visual complexity and exploratory engagement. Finally, Experiment 6 connected these implicit measures of complexity to explicit judgments. Collectively, these findings suggest that visual complexity is extracted efficiently and automatically, and even arouses a kind of “perceptual curiosity” about objects that encourages subsequent attentional engagement. (shrink)

Amodal completion is the representation of those parts of the perceived object that we get no sensory stimulation from. While amodal completion is rife and plays an essential role in all sense modalities, philosophical discussions of this phenomenon have almost entirely been limited to vision. The aim of this paper is to examine in what sense we can talk about amodal completion in olfaction. We distinguish three different senses of amodal completion – spatial, temporal and feature-based completion – and argue (...) that all three are present and play a significant role in olfaction. (shrink)

This paper explores a Rastafari perspective on consciousness development and relates this to developmental stage theories of consciousness evolution from the psychology of religion. The empirical material is from fieldwork on an online Rastafari community with global reach but run by a group based in Trinidad. The people on this particular forum align with the “spiritual, but not religious” trend in contemporary religiosity, which means they are more focused on interior questions of consciousness raising than on religious externals. This paper (...) interprets empirical material from the dialogues on this forum in light of Rastafari theorist Dennis Forsythe. It compares this Rastafari theory of stages of consciousness, symbolized by the animals Anancy, lion, and lamb, to developmental theories of consciousness evolution. These are drawn from psychology and the psychology of religion (Maslow 1970; Kohlberg 1981; Fowler 1981; Gilligan 1982; Wilber 2007), which focus on preconventional, traditional, modern, pluralist, and integral stages. (shrink)

Justin D’Arms and Daniel Jacobson have argued that to evaluate the funniness of a joke based on the consideration of whether it is morally appropriate to feel amused commits the “moralistic fallacy.” We offer a new and empirically informed reply. We argue that there is a way to take morality into consideration without committing this fallacy, that is, it is legitimate to say that for some people, witty but immoral jokes can fail to be funny because they are immoral. In (...) our account, one has an intramural moral reason not to feel amused if one focuses on the moral feature itself of a joke rather than the moral consequence implied in one’s reaction to the joke. When one judges a joke as not funny because of the intramural moral reason, one is in a negative emotional state with high arousal, for example, moral disgust or anger. This state is psychologically incompatible with amusement. That one has an intramural reason not to feel amused thus implies that one does not have a reason to feel amused. Moral consideration thus plays an indirect and appropriate role in the evaluation of the funniness of a joke. (shrink)

One of the most challenging issues in cognitive science is whether attention is necessary for consciousness. It is said if we want to become conscious of something, we should already pay attention to it. But some studies have shown in some conditions, one of which iconic memory, consciousness happens without attention. Iconic memory results have shown that subjects report less than half items in the whole report but report nearly all the cued items. Although all the items in iconic memory (...) are not reportable at once, all of them are consciously represented before we pay attention. In the previous studies, using iconic memory dual tasks in which attention is locally diverted to peripheral task in order to examine consciousness in the central task has caused the problem of expectation and previous knowledge in perception of the stimuli. Regarding these studies’ methodological shortcomings, the purpose of the present study was to suggest and use Stroop's modified paradigm to study attention necessity for consciousness in iconic memory. Material and Methods: Thirty subjects were voluntarily selected and randomly assigned to partial and whole report groups. The data were analyzed by the T-dependent method. Findings showed that in the partial report group, participants had significantly more correct responses compared to the whole report group both in congruent and incongruent conditions meaning that attentional bias to word processing in incongruent condition did not decrease the correct responses compared to congruent condition both in the partial and whole report groups. Conclusion: Attention is not necessary for consciousness in iconic memory. (shrink)

Is blue food desirable or disgusting? The answer, it would seem, is both, but it really depends on the food in which the color happens to be present. It turns out that the oft-cited aversive response to blue meat may not even have been scientifically validated, despite the fact that blue food coloring is often added to discombobulate diners. In the case of drinks, however, there has been a recent growth of successful new blue product launches in everything from beer (...) to tea, and from wine to gin, arguing that coloring food products blue is more than simply a contemporary fad. In fact, the current interest in blue food coloring builds on the color's earlier appearance in everything from blue curacao to blue-raspberry candyfloss, and thereafter a number of soft drinks. Over the years, the combination of blue coloring with raspberry flavoring has also appeared in everything from bubble-gum to patriotic pop rocks. Ultimately, it is the rarity of naturally-blue foods that is likely what makes this color so special. As such, blue food coloring can both work effectively to attract the visual attention of the shopper while, at the same time, being linked to a range of different flavors depending on the food format in which it happens to appear. Note also that the basic descriptor “blue” covers a wide range of hues having a range of different associations, hence eliciting different reactions. While blue was once associated with artificiality, a growing number of natural blue food colorings have come onto the market in recent years thus perhaps changing the dominant associations that many consumers may have with this most unusual of food colors. (shrink)

Pain is often used as the paradigmatic example of a phenomenal kind with a phenomenal quality common and unique to its instantiations. Philosophers have intensely discussed the relation between the subjective feeling, which unites pains and distinguishes them from other experiences, and the phenomenal properties of sensory, affective, and evaluative character along which pains typically vary. At the center of this discussion is the question whether the phenomenal properties prove necessary and/or sufficient for pain. In the empirical literature, sensory, affective, (...) and evaluative properties have played a decisive role in the investigation of psychophysical correspondence and clinical diagnostics. This paper addresses the outlined philosophical and empirical issues from a new perspective by constructing a multidimensional phenomenal space for pain. First, the paper will construe the phenomenal properties of pains in terms of a property space whose structure reflects phenomenal similarities and dissimilarities by means of spatial distance. Second, philosophical debates on necessary and sufficient properties are reconsidered in terms of whether there is a phenomenal space formed of dimensions along which all and only pains vary. It is concluded that there is no space of this kind and, thus, that pain constitutes a primitive phenomenal kind that cannot be analyzed entirely in terms of its varying phenomenal properties. Third, the paper addresses the utility of continued reference to pain and its phenomenal properties in philosophical and scientific discourses. It is argued that numerous insights into the phenomenal structure of pain can be gained that have thus far received insufficient attention. (shrink)

Previous research has demonstrated that duration of implied motion was dilated, whereas hMT+ activity related to perceptual processes on IM stimuli could be modulated by their motion coherence. Based on these findings, the present study aimed to examine whether subjective time perception of IM stimuli would be influenced by varying coherence levels. A temporal bisection task was used to measure the subjective experience of time, in which photographic stimuli showing a human moving in four directions were presented as probe stimuli. (...) The varying coherence of these IM stimuli was manipulated by changing the percentage of pictures implying movement in one direction. Participants were required to judge whether the duration of probe stimulus was more similar to the long or short pre-presented standard duration. As predicted, the point of subjective equality was significantly modulated by the varying coherence of the IM stimuli, but not for no-IM stimuli. This finding suggests that coherence level might be a key mediating factor for perceived duration of IM images, and top-down perceptual stream from inferred motion could influence subjective experience of time perception. (shrink)

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues provide (...) a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar cross-modal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior. (shrink)

We investigate individual, developmental, and cultural differences in self-control in relation to children's changing belief in “free will” – the possibility of acting against and inhibiting strong desires. In three studies, 4- to 8-year-olds in the U.S., China, Singapore, and Peru (N = 441) answered questions to gauge their belief in free will and completed a series of self-control and inhibitory control tasks. Children across all four cultures showed predictable age-related improvements in self-control, as well as changes in their free (...) will beliefs. Cultural context played a role in the timing of these emerging free will beliefs: Singaporean and Peruvian children's beliefs changed at later ages than Chinese and U.S. children. Critically, culture moderated the link between self-control abilities and free will beliefs: Individual differences in self-control behaviors were linked to individual differences in free will beliefs in U.S. children, but not in children from China, Singapore or Peru. There was also evidence of a causal influence of self-control performance on free will beliefs in our U.S. sample. In Study 2, a randomly assigned group of U.S. 4- and 5-year-olds who failed at two self-control tasks showed reduced belief in free will, but a group of children who completed free will questions first did not show changes to self-control. Together these results suggest that culturally-acquired causal-explanatory frameworks for action, along with observations of one's own abilities, might influence children's emerging understanding of free will. (shrink)

Questions of how we know our own and other minds, and whether metacognition and mindreading rely on the same processes, are longstanding in psychology and philosophy. In Experiment 1, children/adolescents with autism (who tend to show attenuated mindreading) showed significantly lower accuracy on an explicit metacognition task than neurotypical children/adolescents, but not on an allegedly metacognitive implicit one. In Experiment 2, neurotypical adults completed these tasks in a single-task condition or a dual-task condition that required concurrent completion of a secondary (...) task that tapped mindreading. Metacognitive accuracy was significantly diminished by the dual-mindreading-task on the explicit task but not the implicit task. In Experiment 3, we included additional dual-tasks to rule out the possibility that any secondary task (regardless of whether it required mindreading) would diminish metacognitive accuracy. Finally, in both Experiments 1 and 2, metacognitive accuracy on the explicit task, but not the implicit task, was associated significantly with performance on a measure of mindreading ability. These results suggest that explicit metacognitive tasks (used frequently to measure metacognition in humans) share metarepresentational processing resources with mindreading, whereas implicit tasks (which are claimed by some comparative psychologists to measure metacognition in nonhuman animals) do not. (shrink)

Among all their sensations, agents need to distinguish between those caused by themselves and those caused by external causes. The ability to infer agency is particularly challenging under conditions of uncertainty. Within the predictive processing framework, this should happen through active control of prediction error that closes the action-perception loop. Here we use a novel, temporally-sensitive, behavioural proxy for prediction error to show that it is minimised most quickly when volatility is high and when participants report agency, regardless of the (...) accuracy of the judgement. We demonstrate broad effects of uncertainty on accuracy of agency judgements, movement, policy selection, and hypothesis switching. Measuring autism traits, we find differences in policy selection, sensitivity to uncertainty and hypothesis switching despite no difference in overall accuracy. (shrink)

Starting from Proust’s distinction between the self-attributive and self-evaluative views on metacognition, this paper presents a third view: self-mindshaping. Based on the notion of mindshaping as the core of social cognition, the self-mindshaping view contends that mindshaping abilities can be turned on one’s own mind. Against the self-attributive view, metacognition is not a matter of accessing representations to metarepresent them but of giving shape to those representations themselves. Against the self-evaluative view, metacognition is not blind to content but relies heavily (...) on it. We characterize our view in terms of four issues that, according to Proust, distinguish the previous approaches, namely, whether metacognitive mechanisms are the same as those employed to access other minds, whether metacognitive control requires conceptual representation, whether metacognition is propositional, and whether metacognitive access is linked to mental action. After describing some of the mechanisms for self-mindshaping, we show how this view regards metacognition as grounded on social interaction mechanisms, conceptually driven, possibly, but not necessarily, propositional, and engaged in the practical regulation of mental states. Finally, we examine the prospects for the primacy of self-mindshaping as the primary metacognitive function. We argue that self-attributive processes typically subserve the practical goals emphasized by the mindshaping view, and that the evaluative role played by procedural metacognition can be grounded on social cues rather than on experiential feelings. Even if this is not enough to claim the primacy of self-mindshaping, it still appears as a third kind of metacognition, not reducible to the other two. (shrink)

Adopting the perspective of another person is an important aspect of social cognition and has been shown to depend on multisensory signals from one’s own body. Recent work suggests that interoceptive signals not only contribute to own-body perception and self-consciousness, but also to empathy. Here we investigated if social cognition – in particular adopting the perspective of another person – can be altered by a systematic manipulation of interoceptive cues and further, if this effect depends on empathic ability. The own-body (...) transformation task – wherein participants are instructed to imagine taking the perspective and position of a virtual body presented on a computer screen – offers an effective way to measure reaction time differences linked to the mental effort of taking an other’s perspective. Here, we adapted the OBT with the flashing of a silhouette surrounding the virtual body, either synchronously or asynchronously with the timing of participants’ heartbeats. We evaluated the impact of this cardio-visual synchrony on reaction times and accuracy rates in the OBT. Empathy was assessed with the empathy quotient questionnaire. Based on previous work using the cardio-visual paradigm, we predicted that synchronous cardio-visual stimulation would increase self-identification with the virtual body and facilitate participants’ ability to adopt the virtual body’s perspective, thereby enhancing performance on the task, particularly in participants with higher empathy scores. We report that participants with high empathy showed significantly better performance during the OBT task during synchronous versus asynchronous cardio-visual stimulation. Moreover, we found a significant positive correlation between empathic ability and the synchrony effect. We conclude that synchronous cardio-visual stimulation between the participant’s body and a virtual body during an OBT task makes it easier to adopt the virtual body’s perspective, presumably based on multisensory integration processes. However, this effect depended on empathic ability, suggesting that empathy, interoception and social perspective taking are inherently linked. (shrink)

In this paper, we investigate the informativeness of 4- to 6-year-old children’s questions using a combined qualitative and quantitative approach. Children were presented with a hierarchical version of the 20-questions game, in which they were given an array of objects that could be organized into three category levels based on shared features. We then tested whether it is possible to scaffold children’s question-asking abilities without extensive training. In particular, we supported children’s categorization performance by providing the object-related features needed to (...) ask effective constraint-seeking questions. We found that with both age and scaffolding children asked more effective questions, targeting higher category levels and therefore reaching the solution with fewer questions. We discuss the practical and theoretical implications of these results. (shrink)

The mental representation of brief temporal durations, when assessed in standard laboratory conditions, is highly accurate. Here we show that adding or subtracting temporal durations systematically results in strong and opposite biases, namely over-estimation for addition and under-estimation for subtraction. The difference with respect to a baseline temporal reproduction task changed across durations in an operation-specific way and survived correcting for the effect due to operation sign alone, indexing a reliable signature of arithmetic processing on time representation. A second experiment (...) replicated these findings with a different set of stimuli. This novel behavioral marker conceptually mirrors in the time domain the representational momentum found with motion, whereby the estimated spatial position of a visual target is displaced in the direction of motion itself. This momentum effect in temporal arithmetic suggests a striking analogy between time processing and visuospatial processing, which might index the presence of common computational principles. (shrink)

Previous studies have provided evidence that automatic emotion regulation, which is primed by control goals, can change emotion trajectory unconsciously. However, the cognitive mechanism and associated changes in depression remain unclear. The current study aimed to examine whether subliminal goal priming could change the emotional response inhibition among patients with major depressive disorder and their healthy controls. A group of patients with depression and a healthy control group were both primed subliminally by playing control goal related or neutral words for (...) 20 ms each; afterward, they judged the gender of happy or angry faces in an emotional Go/No-Go task. A group of depressed patients and a healthy control group both were both primed subliminally with control goal-related words or neutral words, and they judged the gender of happy or angry faces in an emotional Go/No-Go task. Among patients with depression, there were fewer false alarms of the No-Go response to emotional stimulus after priming with control goal rather than neutral words. Meanwhile, patients with MDD in the subliminal regulation goal priming condition reacted faster to happy rather than angry faces; no significant difference was found in the subliminal neutral priming condition. These findings suggest the malleability of inhibitory control in depression using subliminal priming goals. (shrink)

The perception of being located within one’s body is an essential feature of everyday self-experience. However, by manipulating exteroceptive input, healthy participants can easily be induced to perceive themselves as being spatially dislocated from their physical bodies. It has previously been suggested that interoception, i.e., the processing of inner physiological signals, contributes to the stability of body representations; however, this relationship has not previously been tested for different dimensions of interoception and bodily self-location. In the present study, using an advanced (...) automatized setup, we systematically manipulated participants’ perspective of their own body as well as the synchrony of visuotactile stimulation. The malleability of bodily self-location was assessed using a questionnaire targeting in-body and out-of-body experiences. Participants also performed a heartbeat discrimination task to assess their interoceptive accuracy, interoceptive sensibility, and interoceptive awareness. Bodily self-location was significantly influenced by perspective, with third-person perspective being associated with stronger out-of-body experiences compared to first-person perspective. Furthermore, there was a significant perspective × stimulation interaction, with subsequent analyses showing that participants reported out-of-body experiences particularly under third-person perspective combined with synchronous visuotactile stimulation. Correlation and regression analyses revealed that meta-cognitive interoceptive awareness was specifically and negatively related to the exteroceptively mediated malleability of body experiences. These results indicate that the perception of the self being located within one’s body relies on the interaction of exteroceptive input and higher-order interoceptive abilities. This has implications for theoretical considerations about the bodily self in health as well as for the understanding of disturbed bodily self-processing in clinical contexts. (shrink)

Alterations in consciousness are among the most common transdiagnostic psychopathological symptoms. Therefore clinical practice would benefit from a clear conceptual framework that guides the recognition, comprehension, and treatment of consciousness disorders. However, contemporary psychopathology lacks such a framework. We describe how pathology of consciousness is currently being addressed in clinical psychology and psychiatry so far, and how the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and International Classification of Diseases, Tenth Edition (ICD-10) refer to this subject. A (...) brief review of the literature on consciousness is then given. After describing psychological perspectives on consciousness and discussing theoretical issues involved in exploring consciousness, we offer a practical clinical working definition of consciousness and we illustrate its connections with a variety of diagnoses. Making use of Jean-Paul Sartre’s distinctions among: states, functions, qualities, and structure, provide a conceptual framework to understand consciousness, to refine diagnostics and to guide the development of therapeutic possibilities in clinical practice. (shrink)

Sense of Agency, the phenomenology associated with causing one's own actions and corresponding effects, is a cornerstone of human experience. Social Agency can be defined as the Sense of Agency experienced in any situation in which the effects of our actions are related to a conspecific. This can be implemented as the other's reactions being caused by our action, joint action modulating our Sense of Agency, or the other's mere social presence influencing our Sense of Agency. It is currently an (...) open question how such Social Agency can be conceptualized and how it relates to its nonsocial variant. This is because, compared with nonsocial Sense of Agency, the concept of Social Agency has remained oversimplified and underresearched, with disparate empirical paradigms yielding divergent results. Reviewing the empirical evidence and the commonalities and differences between different instantiations of Social Agency, we propose that Social Agency can be conceptualized as a continuum, in which the degree of cooperation is the key dimension that determines our Sense of Agency, and how it relates to nonsocial Sense of Agency. Taking this perspective, we review how the different factors that typically influence Sense of Agency affect Social Agency, and in the process highlight outstanding empirical questions within the field. Finally, concepts from wider research areas are discussed in relation to the ecological validity of Social Agency paradigms, and we provide recommendations for future methodology. (shrink)

How can we tell whether an incident counts as a microaggression? How do we draw the boundary between microaggressions and weightier forms of oppression, such as hate crimes? I address these questions by exploring the ontology and epistemology of microaggression, in particular the constitutive relationship between microaggression and systemic social oppression. I argue that we ought to define microaggression in terms of the ambiguous experience that its victims undergo, focusing attention on their perspectives while providing criteria for distinguishing microaggression.

This study investigates whether addressees visually attend to speakers’ gestures in interaction and whether attention is modulated by changes in social setting and display size. We compare a live face-to-face setting to two video conditions. In all conditions, the face dominates as a fixation target and only a minority of gestures draw fixations. The social and size parameters affect gaze mainly when combined and in the opposite direction from the predicted with fewer gestures fixated on video than live. Gestural holds (...) and speakers’ gaze at their own gestures reliably attract addressees’ fixations in all conditions. The attraction force of holds is unaffected by changes in social and size parameters, suggesting a bottom-up response, whereas speaker-fixated gestures draw significantly less attention in both video conditions, suggesting a social effect for overt gaze-following and visual joint attention. The study provides and validates a video-based paradigm enabling further experimental but ecologically valid explorations of cross-modal information processing. (shrink)