The detection of a human’s intended behavior is one of the most important skills that a social robot should have in order to become acceptable as a part of human society, because humans are used to understand the actions of other humans in a goal-directed manner and they will expect the social robot to behave similarly. A breakthrough in this area can advance several research branches related to social intelligence such as learning by imitation and mutual adaptation. To achieve this (...) goal the robot needs to integrate all possible evidence of intention and neglect the unintended behavior, and a complete solution should use low-level signal processing and high-level reasoning. This work explores the low-level signal processing part of the solution by proposing an interactive adaptive perception scheme that uses four important features of human behavior to amplify the signals originating from intended behavior with respect to signals originating from unintended behavior and other noise sources such as instrumental noise. This work follows the vision that intelligence is not only a function of a centralized sophisticated artificial brain, but can be presented in different forms in the entire robot including its perception and motion systems (the mind is not contained in the brain, but distributed in every cell in the body). A simple example of using the proposed scheme was implemented and the results of two experiments with it are also presented. (shrink)

A concrete proposal is presented as to how semantics should be naturalized. Rather than attempting to naturalize propositions, they are treated as abstract entities that index concrete cognitive states. In turn the relevant concrete cognitive states are identified via perceptual classifications of worldly states, with the aid of an interactive theory of perception. The approach enables a broadly realist theory of propositions, truth and cognitive states to be preserved, with propositions functioning much as abstract mathematical constructs do in (...) the nonsemantic sciences, but with a much more specific propositional indexing scheme than previous naturalistic proposals were able to achieve. (shrink)

In a seminal 1977 article, Rumelhart argued that perception required the simultaneous use of multiple sources of information, allowing perceivers to optimally interpret sensory information at many levels of representation in real time as information arrives. Building on Rumelhart's arguments, we present the Interactive Activation hypothesis—the idea that the mechanism used in perception and comprehension to achieve these feats exploits an interactive activation process implemented through the bidirectional propagation of activation among simple processing units. We then (...) examine the interactive activation model of letter and word perception and the TRACE model of speech perception, as early attempts to explore this hypothesis, and review the experimental evidence relevant to their assumptions and predictions. We consider how well these models address the computational challenge posed by the problem of perception, and we consider how consistent they are with evidence from behavioral experiments. We examine empirical and theoretical controversies surrounding the idea of interactive processing, including a controversy that swirls around the relationship between interactive computation and optimal Bayesian inference. Some of the implementation details of early versions of interactive activation models caused deviation from optimality and from aspects of human performance data. More recent versions of these models, however, overcome these deficiencies. Among these is a model called the multinomial interactive activation model, which explicitly links interactive activation and Bayesian computations. We also review evidence from neurophysiological and neuroimaging studies supporting the view that interactive processing is a characteristic of the perceptual processing machinery in the brain. In sum, we argue that a computational analysis, as well as behavioral and neuroscience evidence, all support the Interactive Activation hypothesis. The evidence suggests that contemporary versions of models based on the idea of interactive activation continue to provide a basis for efforts to achieve a fuller understanding of the process of perception. (shrink)

This paper comments on Gallagher’s recently published direct perception proposal about social cognition [Gallagher, S.. Direct perception in the intersubjective context. Consciousness and Cognition, 17, 535–543]. I show that direct perception is in danger of being appropriated by the very cognitivist accounts criticised by Gallagher. Then I argue that the experiential directness of perception in social situations can be understood only in the context of the role of the interaction process in social cognition. I elaborate on (...) the role of social interaction with a discussion of participatory sense-making to show that direct perception, rather than being a perception enriched by mainly individual capacities, can be best understood as an interactional phenomenon. (shrink)

Luminance and color are strong and self-sufficient cues to pictorial depth in visual scenes and images. The present study investigates the conditions Under which luminance or color either strengthens or overrides geometric depth cues. We investigated how luminance contrasts associated with color contrast interact with relative height in the visual field, partial occlusion, and interposition in determining the probability that a given figure is perceived as ‘‘nearer’’ than another. Latencies of ‘‘near’’ responses were analyzed to test for effects of attentional (...) selection. Figures in a pair were supported by luminance contrast or isoluminant color contrast and combined with one of the three geometric cues. The results of Experiment 1 show that luminance contrasts associated with hue, when it does not interact with other hues, produces the same effects as achromatic luminance contrasts: The probability of‘‘near’’ increases with luminance contrast while the latencies for ‘‘near’’ responses decrease. Partial occlusion is found to be a strong enough pictorial cue to support a weaker red luminance contrast. Interposition cues lose out against cues of spatial position and partial occlusion. The results of Experiment 2, with isoluminant displays of varying color contrast, reveal that red color contrast on a light background supported by any of the three geometric cues wins over green or white supported by any of the three geometric cues. On a dark background, red color contrast supported by the interposition cue loses out against green or white color contrast supported by partial occlusion. These findings reveal that color is not an independent depth cue, but is strongly influenced by luminance contrast and stimulus geometry. Systematically shorter response latencies for stronger ‘‘near’’ percepts demonstrate that selective visual attention reliably detects the most likely depth cue combination in a given configuration. (shrink)

People are adept at perceiving interactions from movements of simple shapes, but the underlying mechanism remains unknown. Previous studies have often used object movements defined by experimenters. The present study used aerial videos recorded by drones in a real-life environment to generate decontextualized motion stimuli. Motion trajectories of displayed elements were the only visual input. We measured human judgments of interactiveness between two moving elements and the dynamic change in such judgments over time. A hierarchical model was developed to account (...) for human performance in this task. The model represents interactivity using latent variables and learns the distribution of critical movement features that signal potential interactivity. The model provides a good fit to human judgments and can also be generalized to the original Heider–Simmel animations. The model can also synthesize decontextualized animations with a controlled degree of interactiveness, providing a viable tool for studying animacy and social perception. (shrink)

Researchers have emphasized the value of authenticity, but not much is known about what makes a person authentic in the eyes of others. Our research takes an interpersonal perspective to examine the determinants of followers’ perceptions of leader authenticity. Building on social identity theory, we propose that two fundamental self-identifications–a leader’s sense of uniqueness and sense of belongingness–interact to influence followers’ perceptions of a leader’s authenticity via perceptions of a leader’s self-concept consistency. In a field study conducted among leader–follower dyads (...) and in a controlled laboratory experiment, we find that when a leader feels a low sense of belongingness, there is a positive relationship between a leader’s sense of uniqueness and perceptions of leader authenticity. When a leader feels a low sense of uniqueness, there is a positive relationship between a leader’s sense of belongingness and perceptions of leader authenticity. This is because followers perceive this leader as having high self-concept consistency. (shrink)

Apart from references to perception, words such as see and listen have shared, non-literal meanings across diverse languages. Such cross-linguistic meanings have not been systematically investigated as they appear in their natural home — informal spoken interaction. We present a qualitative examination of the semantic associations of perception verbs based on recorded everyday conversation in thirteen diverse languages. Across these diverse communities, spontaneous interaction provides evidence for two commonly-discussed extensions of perception verbs — perception~cognition, hearing~linguistic communication (...) — as well as illustrating other meanings and functions that have been less appreciated heretofore. The range of usage that is readily observable in informal conversation makes it clear that this type of data must take center stage for the empirically grounded study of semantics. Moreover, these data suggest that commonalities in polysemous meanings may rely not only on universal cognition, but also on the universal exigencies of social interaction. (shrink)

Speech perception under adverse conditions is a multistage process involving a dynamic interplay among acoustic, cognitive, and linguistic factors. Nevertheless, prior research has primarily focused on factors within this complex system in isolation. The primary goal of the present study was to examine the interaction between processing depth and the acoustic challenge of noise and its effect on processing effort during speech perception in noise. Two tasks were used to represent different depths of processing. The speech recognition task (...) involved repeating back a sentence after auditory presentation, while the tiredness judgment task entailed a subjective judgment of whether the speaker sounded tired. The secondary goal of the study was to investigate whether pupil response to alteration of dynamic pitch cues stems from difficult linguistic processing of speech content in noise or a perceptual novelty effect due to the unnatural pitch contours. Task-evoked peak pupil response from two groups of younger adult participants with typical hearing was measured in two experiments. Both tasks were implemented in both experiments, and stimuli were presented with background noise in Experiment 1 and without noise in Experiment 2. Increased peak pupil dilation was associated with deeper processing, particularly in the presence of background noise. Importantly, there is a non-additive interaction between noise and task, as demonstrated by the heightened peak pupil dilation to noise in the speech recognition task as compared to in the tiredness judgment task. Additionally, peak pupil dilation data suggest dynamic pitch alteration induced an increased perceptual novelty effect rather than reflecting effortful linguistic processing of the speech content in noise. These findings extend current theories of speech perception under adverse conditions by demonstrating that the level of processing effort expended by a listener is influenced by the interaction between acoustic challenges and depth of linguistic processing. The study also provides a foundation for future work to investigate the effects of this complex interaction in clinical populations who experience both hearing and cognitive challenges. (shrink)

Previous research has shown that the perception that one’s partner is investing effort in a joint action can generate a sense of commitment, leading participants to persist longer despite increasing boredom. The current research extends this finding to human-robot interaction. We implemented a 2-player version of the classic snake game which became increasingly boring over the course of each round, and operationalized commitment in terms of how long participants persisted before pressing a ‘finish’ button to conclude each round. Participants (...) were informed that they would be linked via internet with their partner, a humanoid robot. Our results reveal that participants persisted longer when they perceived what they believed to be cues of their robot partner’s effortful contribution to the joint action. This provides evidence that the perception of a robot partner’s effort can elicit a sense of commitment to human-robot interaction. (shrink)

The Theory of Event Coding (TEC) provides a preliminary account of the interaction between perception and action, which is consistent with several recent findings in the area of motor control. Significant issues require integration and elaboration, however; particularly, distractor interference, automatic motor corrections, internal models of action, and neuroanatomical bases for the link between perception and action.

This study examines the interaction effects of Machiavellianism and organizational ethical culture on two components of a marketer''s ethical decision — perceptions of an ethical problem and perceptions of remedial alternatives. The results suggest that certain aspects of ethical perceptions are related to the interaction between Machiavellianism and organizational ethical culture.

We urge caution in generalising from content words to function words, in which lexical-to-phonemic feedback might be more likely. Speech perception involves more than word recognition; feedback might be outside the narrow logic of word identification but still be present for other purposes. Finally, we raise the issue of evidence from imaging studies of auditory hallucination.

We investigate the dynamics of sensory integration for perceiving musical performance, a complex natural behavior. Thirty musically trained participants saw, heard, or both saw and heard, performances by two clarinetists. All participants used a sliding potentiometer to make continuous judgments of tension (a measure correlated with emotional response) and continuous judgments of phrasing (a measure correlated with perceived musical structure) as performances were presented. The data analysis sought to reveal relations between the sensory modalities (vision and audition) and to quantify (...) the effect of seeing the performances on participants' overall subjective experience of the music. In addition to traditional statistics, functional data analysis techniques were employed to analyze time-varying aspects of the data. The auditory and visual channels were found to convey similar experiences of phrasing but different experiences of tension through much of the performances. We found that visual information served both to augment and to reduce the experience of tension at different points in the musical piece (as revealed by functional linear modeling and functional significance testing). In addition, the musicians' movements served to extend the sense of phrasing, to cue the beginning of new phrases, to indicate musical interpretation, and to anticipate changes in emotional content. Evidence for an interaction effect suggests that there may exist an emergent quality when musical performances are both seen and heard. The investigation augments knowledge of human communicative processes spanning language and music, and involving multiple modalities of emotion and information transfer. (shrink)

Dijkerman & de Haan (D&dH) study perception and action as two independent processes. However, in all daily activities the processes are completely intertwined, so it is difficult to separate one from the other. Humans perceive in order to move and also move in order to perceive. Understanding first how perception and action are coordinated, leads us then to determine how each component works independently.

Prior research has examined consumer intentions to purchase fakes, branding strategies and anti-counterfeiting actions, but little attention seems to have been paid to the role of consumers’ ability to discern fakes and branding strategies against counterfeiting. This article, thus, based on a study of 128 multinational managers’ experience in China, examines these inter-relationships. As a result, we address how knowledgeable and experienced managers in branding, consumer consumption and anti-counterfeiting effort perceive consumers’ ability to discriminate fakes from originals interacts with branding (...) strategies, and how such relationship influences the effectiveness of anti-counterfeiting effort. Our findings suggest that consumer discrimination itself has no significant effect on anti-counterfeiting success. However, it significantly interacts with branding strategies to predict a means to mitigate brand damage. That is, consumers’ ability to discriminate fakes from originals appears to undermine efforts to mitigate brand damage from counterfeiting, at least in China when branding is based on improving product features or advertising and promotion. However, if branding emphasises after sales service, consumers’ ability to discriminate was found to enhance firms’ ability to limit counterfeiting damage to brands. Such interactions, however, did not help stop counterfeiting, except that branding based on reliability appears to have such a positive effect. (shrink)

Previous research with speech and non-speech stimuli suggested that in audiovisual perception, visual information starting prior to the onset of corresponding sound can provide visual cues, and form a prediction about the upcoming auditory sound. This prediction leads to audiovisual interaction. Auditory and visual perception interact and induce suppression and speeding up of the early auditory event-related potentials such as N1 and P2. To investigate AV interaction, previous research examined N1 and P2 amplitudes and latencies in response to (...) audio only, video only, audiovisual, and control stimuli, and compared AV with auditory perception based on four AV interaction models. The current study addresses how different models of AV interaction express N1 and P2 suppression in music perception. Furthermore, the current study took one step further and examined whether previous musical experience, which can potentially lead to higher N1 and P2 amplitudes in auditory perception, influenced AV interaction in different models. Musicians and non-musicians were presented the recordings of a keyboard /C4/ key being played, as well as CO stimuli. Results showed that AV interaction models differ in their expression of N1 and P2 amplitude and latency suppression. The calculation of model and has consequences for the resulting N1 and P2 difference waves. Furthermore, while musicians, compared to non-musicians, showed higher N1 amplitude in auditory perception, suppression of amplitudes and latencies for N1 and P2 was similar for the two groups across the AV models. Collectively, these results suggest that when visual cues from finger and hand movements predict the upcoming sound in AV music perception, suppression of early ERPs is similar for musicians and non-musicians. Notably, the calculation differences across models do not lead to the same pattern of results for N1 and P2, demonstrating that the four models are not interchangeable and are not directly comparable. (shrink)

Everyday media consumption leaves no doubt that the perception of moving images from various media is characterized by experience and understanding. Corresponding research in this field has shown that the stimulus patterns flooding in on us are not only processed mentally, but also bodily. Building on this, the following study argues that incoming stimuli are processed not only visually, but multimodally, with all senses, and moreover affectively. The classical binding of a sensory organ to a medium, on whose delimitation (...) the common understanding of multimodality is based, is thus abolished. Can arguments for this assumption be found? Building on the research of cultural anthropologist Ernst Cassirer and his successors, the two American philosophers Susanne K. Langer and John M. Krois, and supported by research from the life sciences in which, in parallel, the arts also play an important role in understanding image formation, as in the work of Heinz Werner and, following on from this, in the more recent research of the child psychologist Daniel N. Stern in collaboration with mirror neuron research by the group of neuroscientists around Giacomo Rizzolatti in Parma, justifications for this will be provided. What the multimodal processing of film images is concretely based on will finally be made clear by means of an exemplary analysis of a video film by the Swiss artist Pipilotti Rist. It aims to prove, that the prerequisites for the thesis can only lie in the fact, that both the modes of perception (visual, tactile, auditory, olfactory, gustatory) as well as the medially conditioned modes of image formation are based on non-discursive, formal-abstract structures that are also processed affectively. At the same time, the analysis thus shows how the selection and composition of the vital experienced forms can provide information about the socio-culturally shaped self-image of the producer and the viewer. (shrink)

Aesthetic perception is one of the most interesting topics for philosophers and scientists who investigate how it influences our interactions with objects and states of affairs. Over the last few years, several studies have attempted to determine “how aesthetics is represented in an object,” and how a specific feature of an object could evoke the respective feelings during perception. Despite the vast number of approaches and models, we believe that these explanations do not resolve the problem concerning the (...) conditions under which aesthetic perception occurs, and what constitutes the content of these perceptions. Adopting a naturalistic perspective, we here view aesthetic perception as a normative process that enables agents to enhance their interactions with physical and socio-cultural environments. Considering perception as an anticipatory and preparatory process of detection and evaluation of indications of potential interactions, we argue that the minimal content of aesthetic perception is an emotionally valued indication of interaction potentiality. Aesthetic perception allows an agent to normatively anticipate interaction potentialities, thus increasing sense making and reducing the uncertainty of interaction. This conception of aesthetic perception is compatible with contemporary evidence from neuroscience, experimental aesthetics, and interaction design. The proposed model overcomes several problems of transcendental, art-centered, and objective aesthetics as it offers an alternative to the idea of aesthetic objects that carry inherent values by explaining “the aesthetic” as emergent in perception within a context of uncertain interaction. (shrink)

Multisensory integration allows us to link sensory cues from multiple sources and plays a crucial role in speech development. However, it is not clear whether humans have an innate ability or whether repeated sensory input while the brain is maturing leads to efficient integration of sensory information in speech. We investigated the integration of auditory and somatosensory information in speech processing in a bimodal perceptual task in 15 young adults (age 19 to 30) and 14 children (age 5 to 6). (...) The participants were asked to identify if the perceived target was the sound /e/ or /ø/. Half of the stimuli were presented under a unimodal condition with only auditory input. The other stimuli were presented under a bimodal condition with both auditory input and somatosensory input consisting of facial skin stretches provided by a robotic device, which mimics the articulation of the vowel /e/. The results indicate that the effect of somatosensory information on sound categorization was larger in adults than in children. This suggests that integration of auditory and somatosensory information evolves throughout the course of development. (shrink)

Comparisons are drawn between two theories of visual perception and two modes of information processing. Characteristics delineating dorsal and ventral visual systems lack internal consistency, probably because they are not completely separable. Mechanism is inherent when distinguishing these systems, and becomes more apparent with different processing domains. What is lacking is a more explicit means of linking these theories.

The white sclera is important in facilitating gaze perception in humans. Iris color may likewise influence gaze perception but no previous studies have directly assessed its effect. We therefore examined how the interaction between sclera and iris color influences human gaze perception. We recorded the eye movements of human participants as they performed a visual search task with human faces exhibiting directed or averted gaze. The faces either exhibited light or dark irises. In addition, the faces had (...) sclera that were depigmented or pigmented. We found that participants were quick and accurate in evaluating gaze regardless of iris color in faces with depigmented sclera. When the sclera were pigmented, participants were slower to evaluate the gaze of faces with both light and dark irises but these effects were most pronounced in the faces with dark irises. Furthermore, participants were generally less accurate in assessing faces with pigmented sclera when the irises were dark rather than light. Our results suggest that depigmented sclera are especially important for gaze perception in faces with dark irises. Because depigmented sclera likely evolved at a time when ancestral humans exhibited dark irises, the depigmented sclera may have been crucial for efficient and accurate gaze perception in ancestral humans. (shrink)

An error that medicine has long shared is to attribute to a desire or an effect of the mother’s imagination during gestation, the deformities, growths or spots that a child bears at birth. The imagination would be capable of imprinting external modifications on a matter and would have an impact on the perceptions and sensory development of the fetus. Returning briefly to the genealogy and posterity of the topos, this article focuses on the successes and refutations of the Malebranchist paradigm (...) in the 18th century, through a corpus of medical popularization texts where the debates oppose the supporters of the imagination for whom emotion alters the organs of the fetus and the detractors of this thesis who only see it as prejudice. Mechanistic systems had in common that they avoided the soul to explain life. Although each era has its hermeneutic system of representations, and that medicine—closely dependent on the philosophical and moral conceptions of its time—is also a cultural production, it is nevertheless not uninteresting to question on the fortune of a motive and the scientific topicality of the question. What does the baby perceive in utero? Does he feel his mother’s pain? If so, what is the biological impact? To what extent can the maternal imagination and experience mark the child’s body? Informed by functional imaging technologies, recent research returns to the symbiotic link of mother-fetus interactions. Convergences appear between this 18th century and our 21st century. In no case did we want to contrast today’s scientists who are firmly in touch with reality and their predecessors who are prey to imagination. Science, whatever the era, always feeds on imagination. (shrink)

This paper proposes a theory of how conscious emotional experience is produced by the brain as the result of many interacting brain areas coordinated in working memory. These brain areas integrate perceptions of bodily states of an organism with cognitive appraisals of its current situation. Emotions are neural processes that represent the overall cognitive and somatic state of the organism. Conscious experience arises when neural representations achieve high activation as part of working memory. This theory explains numerous phenomena concerning emotional (...) consciousness, including differentiation, integration, intensity, valence, and change. Ó 2007 Elsevier Inc. All rights reserved. (shrink)

There is a task-specificity in the visual-tactile interaction for perception: The polymodal posterior parietal cortex is related to the comparison of the shapes coded by different sensory modalities, whereas the lateral occipital complex is the part of the network for multimodal shape identification. These interactions may be mediated by some latent pathways potentiated by sensory deprivation or learning.