Facial muscle activities are essential for the appearance and communication of human beings. Therefore, exploring the activation patterns of facial muscles can help understand facial neuromuscular disorders such as Bell’s palsy. Given the irregular shape of the facial muscles as well as their different locations, it should be difficult to detect the activities of whole facial muscles with a few electrodes. In this study, a high-density surface electromyogram system with 90 electrodes was used to record EMG signals (...) of facial muscles in both healthy and Bell’s palsy subjects when they did different facial movements. The electrodes were arranged in rectangular arrays covering the forehead and cheek regions of the face. The muscle activation patterns were shown on maps, which were constructed from the Root Mean Square values of all the 90-channel EMG recordings. The experimental results showed that the activation patterns of facial muscles were distinct during doing different facial movements and the activated muscle regions could be clearly observed. Moreover, two features of the activation patterns, 2D correlation coefficient and Centre of Gravity were extracted to quantify the spatial symmetry and the location of activated muscle regions respectively. Furthermore, the deviation of activated muscle regions on the paralyzed side of a face compared to the healthy side was quantified by calculating the distance between two sides of CGs. The results revealed that corr2 of the activated facial muscle region in Bell’s palsy subjects was significantly lower than that in healthy subjects, while CG distance of activated facial region in Bell’s palsy subjects was significantly higher than that in healthy subjects. The correlation between corr2 of these regions and Bell’s palsy [assessed by the Facial Nerve Grading Scale 2.0] was also significant in Bell’s palsy subjects. The spatial information on activated muscle regions may be useful in the diagnosis and treatment of Bell’s palsy in the future. (shrink)

Research on facial emotion expression has mostly focused on emotion recognition, assuming that a small number of discrete emotions is elicited and expressed via prototypical facial muscle configurations as captured in still photographs. These are expected to be recognized by observers, presumably via template matching. In contrast, appraisal theories of emotion propose a more dynamic approach, suggesting that specific elements of facial expressions are directly produced by the result of certain appraisals and predicting the facial patterns to be expected for (...) certain appraisal configurations. This approach has recently been extended to emotion perception, claiming that observers first infer individual appraisals and only then make categorical emotion judgments based on the estimated appraisal patterns, using semantic inference rules. Here we report two related studies to empirically investigate the facial action unit configurations that are used by actors to convey specific emotions in short affect bursts and to examine to what extent observers can infer a person’s emotions from the predicted facial expression configurations. The results show that 1) professional actors use many of the predicted facial action unit patterns to enact systematically specified appraisal outcomes in a realistic scenario setting, and 2) naïve observers infer the respective emotions based on highly similar facial movement configurations with a degree of accuracy comparable to earlier research findings. Based on estimates of underlying appraisal criteria for the different emotions we conclude that the patterns of facial action units identified in this research correspond largely to prior predictions and encourage further research on appraisal-driven expression and inference. (shrink)

To characterize human emotions, researchers have increasingly utilized Automatic Facial Expression Analysis (AFEA), which automates the Facial Action Coding System (FACS) and translates the facial muscular positioning into the basic universal emotions. There is broad interest in the application of FACS for assessing consumer expressions as an indication of emotions to consumer product-stimuli. However, the translation of FACS to characterization of emotions is elusive in the literature. The aim of this systematic review is to give an overview of how FACS (...) has been used to investigate human emotional behavior to consumer product-based stimuli. The search was limited to studies published in English after 1978, conducted on humans, using FACS or its action units to investigate affect, where emotional response is elicited by consumer product-based stimuli evoking at least one of the five senses. The search resulted in an initial total of 1,935 records, of which 55 studies were extracted and categorized based on the outcomes of interest including (i) method of FACS implementation; (ii) purpose of study; (iii) consumer product-based stimuli used; and (iv) measures of affect validation. Most studies implemented FACS manually (73%) to develop products and/or software (20%) and used consumer product-based stimuli that had known and/or defined capacity to evoke a particular affective response, such as films and/or movie clips (20%); minimal attention was paid to consumer products with low levels of emotional competence or with unknown affective impact. The vast majority of studies (53%) did not validate FACS-determined affect and, of the validation measures that were used, most tended to be discontinuous in nature and only captured affect as it holistically related to an experience. This review illuminated some inconsistencies in how FACS is carried out as well as how emotional response is inferred from facial muscle activation. This may prompt researchers to consider measuring the total consumer experience by employing a variety of methodologies in addition to FACS and its emotion-based interpretation guide. Such strategies may better conceptualize consumers' experience with products of low, unknown, and/or undefined capacity to evoke an affective response such as product prototypes, line extensions, etc. (shrink)

Facial expressions are a vital way for humans to show their perceived emotions. It is convenient for detecting and recognizing expressions or micro-expressions by annotating a lot of data in deep learning. However, the study of video-based expressions or micro-expressions requires that coders have professional knowledge and be familiar with action unit coding, leading to considerable difficulties. This paper aims to alleviate this situation. We deconstruct facial muscle movements from the motor cortex and systematically sort out the relationship among facial (...) muscles, AU, and emotion to make more people understand coding from the basic principles: We derived the relationship between AU and emotion based on a data-driven analysis of 5,000 images from the RAF-AU database, along with the experience of professional coders.We discussed the complex facial motor cortical network system that generates facial movement properties, detailing the facial nucleus and the motor system associated with facial expressions.The supporting physiological theory for AU labeling of emotions is obtained by adding facial muscle movements patterns.We present the detailed process of emotion labeling and the detection and recognition of AU.Based on the above research, the video's coding of spontaneous expressions and micro-expressions is concluded and prospected. (shrink)

With a few yet increasing number of exceptions, the cognitive sciences enthusiastically endorsed the idea that there are basic facial expressions of emotions that are created by specific configurations of facial muscles. We review evidence that suggests an inherent role for context in emotion perception. Context does not merely change emotion perception at the edges; it leads to radical categorical changes. The reviewed findings suggest that configurations of facial muscles are inherently ambiguous, and they call for a different (...) approach towards the understanding of facial expressions of emotions. Prices of sticking with the modal view, and advantages of an expanded view, are succinctly reviewed. (shrink)

Facial electromyography research shows that corrugator supercilii ('frowning muscle') activity tracks the emotional valence of linguistic stimuli. Grounded or embodied accounts of language processing take such activity to reflect the simulation or ‘reenactment’ of emotion, as part of the retrieval of word meaning (e.g., of “furious”) and/or of building a situation model (e.g., for “Mark is furious”). However, the same muscle also expresses our primary emotional evaluation of things we encounter. Language-driven affective simulation can easily be at odds with the (...) reader’s affective evaluation of what language describes (e.g., when we like Mark being furious). To examine what happens in such cases, we independently manipulated simulation valence and moral evaluative valence in short narratives. Participants first read about characters behaving in a morally laudable or objectionable fashion: this immediately led to corrugator activity reflecting positive or negative affect. Next, and critically, a positive or negative event befell these same characters. Here, the corrugator response did not track the valence of the event, but reflected both simulation and moral evaluation. This highlights the importance of unpacking coarse notions of affective meaning in language processing research into components that reflect simulation and evaluation. Our results also call for a re-evaluation of the interpretation of corrugator EMG, as well as other affect-related facial muscles and other peripheral physiological measures, as unequivocal indicators of simulation. Research should explore how such measures behave in richer and more ecologically valid language processing, such as narrative; refining our understanding of simulation within a framework of grounded language comprehension. (shrink)

Social exclusion influences how expressions are perceived and the tendency of the perceiver to mimic them. However, less is known about social exclusion’s effect on one’s own facial expressions. The aim of the present study was to identify the effects of social exclusion on Duchenne smiling behaviour, defined as activity of both zygomaticus major and the orbicularis oculi muscles. Utilising a within-subject’s design, participants took part in the Cyberball Task in which they were both included and excluded while facial (...) electromyography was measured. We found that during the active experience of social exclusion, participants showed greater orbicularis oculi activation when compared to the social inclusion condition. Further, we found that across both conditions, participants showed greater zygomaticus major muscle activation the longer they engaged in the Cyberball Task. Order of condition also mattered, with those who experienced social exclusion before social inclusion showing the greatest overall muscle activation. These results are consistent with an affiliative function of smiling, particularly as social exclusion engaged activation of muscles associated with a Duchenne smile. (shrink)

I offer a novel view of the mechanisms underlying the spontaneous facial expression of emotion. According to my Social Amplification View, facial expressions result from the interplay of two processes: an emotional process that activates specific facial muscles, though not always to the point of visible contraction, followed by a social cognitive process that amplifies these activations so that they may function more effectively as social signals. I argue that SAV outperforms both the Neurocultural View and the Behavioral Ecology (...) View, as well as previously proposed syntheses of these views, in accounting for various empirical findings. (shrink)

We highlight the need to focus on the underlying determinants and production mechanisms to fully understand the nature of facial expression of emotion and to settle the theoretical debate about the meaning of motor expression. Although emotion theorists have generally remained rather vague about the details of the process, this has been a central concern of componential appraisal theories. We describe the fundamental assumptions and predictions of this approach regarding the patterning of facial expressions for different emotions. We also review (...) recent evidence for the assumption that specific facial muscle movements may be reliable symptoms of certain appraisal outcomes and that facial expressions unfold over time on the basis of a sequence of appraisal check results. (shrink)

James A Edwards1, David W Mathes21Department of Plastic and Reconstructive Surgery, Skagit Valley Hospital, Mount Vernon, WA, USA; 2Division of Plastic Surgery, University of Washington Medical Center, Seattle, WA, USA: The surgical history of transplantation in the modern era begins in 1956 with the successful transplantation of a kidney between identical twins. Since then the field of transplantation has seen remarkable advancements in both surgical techniques and our understanding and ability to manipulate the immune response. Composite tissue allotransplantation involves the (...) transplantation of any combination of vascularized skin, subcutaneous tissue, blood vessels, nerves, muscle, and bone. Orthotopic hand transplantation is considered the first clinical example of CTA and has seen success at many different centers worldwide. Facial allotransplantation is a recent development in the field of CTA and the first successful case was performed as recently as November 2005. Since then there have been a number of successful facial transplants. The purpose of this paper is to examine some of the issues surrounding facial transplantation including the complex ethical issues, the surgical and clinical issues, cost and administrative issues, and future directions for this new, exciting, and controversial field.Keywords: composite tissue allograft, facial transplantation. (shrink)

We are defined by our faces. They give identity but, equally importantly, reveal our moods and emotions through facial expression. So what happens when the face cannot move? This book is about people who live with Mbius Syndrome, which has as its main feature an absence of movement of the muscles of facial expression from birth.

Several studies have reported impairment in the recognition of facial expressions of disgust in patients with Huntington's disease (HD) and preclinical carriers of the HD gene. The aim of this study was to establish whether impairment for disgust in HD patients extended to include the ability to express the emotion on their own faces. Eleven patients with HD, and 11 age and education matched healthy controls participated in three tasks concerned with the expression of emotions. One task assessed the spontaneous (...) production of disgust-like facial expressions during the smelling of offensive odorants. A second assessed the production of posed facial expressions during deliberate attempts to communicate emotion. The third task evaluated HD patients’ ability to imitate the specific facial configurations associated with each emotion. Foul odours induced fewer disgust-like facial reactions in HD patients than in controls, and patients’ posed facial expressions of disgust were less accurate than the posed disgust expressions of controls. The effect was selective to disgust; patients had no difficulty posing expressions of other emotions. These impairments were not explained by compromised muscle control: HD patients had no difficulty imitating the facial movements required to display disgust. Viewed together with evidence of difficulty in other aspects of disgust in HD, the findings suggest that a common substrate might participate in both the processing and the expression of this emotion. (shrink)

Dr. Stephen Hawking was the most renowned scientist since Einstein, known both for his groundbreaking work in physics and cosmology and for his mischievous sense of humor. He educated millions of readers about the origins of the universe and the nature of black holes, and inspired millions more by defying a terrifying early prognosis of ALS, which originally gave him only two years to live. In later life he could communicate only by using a few facial muscles, but he (...) continued to advance his field and serve as a revered voice on social and humanitarian issues. Hawking not only unraveled some of the universe's greatest mysteries but also believed science plays a critical role in fixing problems here on Earth. Now he turns his attention to the most urgent issues facing us. Will humanity survive? Should we colonize space? Does God exist? These are just a few of the questions Hawking addresses in this wide-ranging, passionately argued final book from one of the greatest minds in history. Featuring a foreword by Eddie Redmayne, who won an Oscar playing Stephen Hawking, an introduction by Nobel Laureate Kip Thorne, and an afterword from Hawking's daughter, Lucy. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Soldiers of the Invisible Front: How Ukrainian Therapists Are Fighting for the Mental Health of the Nation Under FireIrina Deyneka and Eva RegelIrina DeynekaWhen the Russian army attacked my country, I became a volunteer for a hotline offering psychological support to those in crisis; refugees, those who were under the shelling, those who were hiding in bomb shelters, and who were directly in the zone of fighting. People were (...) lost and disoriented by constant bombing, by the fact that their country was under attack. Once, I had a woman who lived in Mariupol on one of these calls. I was living then in another city, Odessa, but was experiencing the same horrors of war that my client was—the shelling, uncertainty, and despair. We were processing my client’s feelings of grief and anxiety when I heard the sirens on her end. I offered to stop our session so she could seek shelter. She told me she would not have time to find shelter and wanted to continue our meeting. And so, we continued... But soon, Odessa’s sirens broke the silence, and it was my turn to decide what to do; should I continue our session or try to find a bomb shelter for myself? I decided to stay because I thought that was the right thing to do morally, professionally, and personally.I eventually left Odessa, but only after a bomb destroyed a house next to mine, and I saw a family, my neighbors, perish in the destruction. I am now a member of one of Slovakia’s Non-Governmental Organizations (NGOs) and work in a mobile brigade providing medical and psychological support to refugees. I can remember every one of my clients. Children, adults... I can remember their stories, their traumas, their memories of the horrors of war and devastation. Sometimes I meet with them only once, and they move on to another refugee center or are on their way to a Western part of Ukraine, trying to escape the war. And frequently, I do not know how many sessions I will be able to have with clients. Sometimes it is only one time, and sometimes we can meet for many months. Initially, I thought, What can I do in one therapy session? Now, I know that I can do a lot. I can provide people who survived the most inhuman conditions and witnessed death and destruction around them with a space and time to talk through and process their experiences. I am their support, and they lean on me as they try to make sense of what has happened to them and their country. I always tell my clients that my goal as a psychotherapist is to help them withstand, survive, and hold on while still being able to continue to function in a country at war. All I can do is treat each of the therapy sessions as our last one and try to provide as many strategies and skills as possible to cope with anxiety and depression, to be able to function, and to live in the present.Every session is about installing hope, moving slowly forward, and away from traumatic events. One of my clients, a 14-year-old boy, was diagnosed with a neurological condition, involuntary facial muscle spasm, or tics. He was barely talking when I first saw him, and I decided to use art therapy as a trauma-processing tool during one of the therapy sessions. He was drawing an explosion, fire, and destruction of his neighbor’s house. He blacked out the horrors of his experience to preserve his strength. Yet, he began slowly remembering his experiences, re-creating the story of his trauma, and making memories. I was fortunate to work with [End Page E4] him for many months, carefully and thoughtfully helping him re-create the sorry of his trauma, helping to become its witness. Ultimately, it was great to see that he could control his memories and his emotional stress; he felt empowered and in control.Eva RegelThis is the story of Irina Deyneka, one of many Ukrainian psychotherapists working in Ukraine, providing mental health support to a nation ravaged by... (shrink)

In this review, we highlight evidence suggesting that concepts represented in language are used to create a perception of emotion from the constant ebb and flow of other people’s facial muscle movements. In this “construction hypothesis,” (cf. Gendron, Lindquist, Barsalou, & Barrett, 2012) (see also Barrett, 2006b; Barrett, Lindquist, & Gendron, 2007; Barrett, Mesquita, & Gendron, 2011), language plays a constitutive role in emotion perception because words ground the otherwise highly variable instances of an emotion category. We demonstrate that language (...) plays a constitutive role in emotion perception by discussing findings from behavior, neuropsychology, development, and neuroimaging. We close by discussing implications of a constructionist view for the science of emotion. (shrink)

In the current opinion paper, we provide a comparative perspective on specific aspects of primate empathic abilities, with particular emphasis on the mirror neuron system associated with mouth/face actions and expression. Mouth and faces can be very salient communicative classes of stimuli that allow an observer access to the emotional and physiological content of other individuals. We thus describe patterns of activations of neural populations related to observation and execution of specific mouth actions and emotional facial expressions in some species (...) of monkeys and in humans. Particular attention is given to dynamics of face-to-face interactions in the early phases of development and to the differences in the anatomy of facial muscles among different species of primates. We hypothesize that increased complexity in social environments and patterns of social development have promoted specializations of facial musculature, behavioral repertoires related to production and recognition of facial emotional expression, and their neural correlates. In several primates, mirror circuits involving parietal-frontal regions, insular regions, cingulate cortices, and amygdala seem to support automatic forms of embodied empathy, which probably contribute to facial mimicry and behavioural synchrony. In humans these circuits interact with specific prefrontal and temporo-parietal cortical regions, which facilitates higher order cognitive functions such as cognitive empathy and mental state attribution. Our analysis thus suggests that the evolution of higher forms of empathy, such as mentalizing, is also linked to the coupling between the perceptual and motor system related to face processing, which may have undergone a process of exaptation during primate phylogeny. (shrink)

Current theories assume that perception and affect are separate realms of the mind. In contrast, we argue that affect is a genuine online-component of perception instantaneously mirroring the success of different perceptual stages. Consequently, we predicted that the success (failure) of even very early and cognitively encapsulated basic visual Processing steps would trigger immediate positive (negative) affective responses. To test this assumption, simple visual stimuli that either allowed or obstructed early visual processing stages without participants being aware of this were (...) presented briefly. Across 5 experiments, we found more positive affective responses to stimuli that allowed rather than obstructed Gestalt completion at certain early visual stages (Experiments 1–3; briefest presentation 100 ms with post-mask), and visual disambiguation in possible vs. impossible Necker cubes (Experiments 4 and 5; briefest presentation 100 ms with post-mask). This effect was observed both on verbal preference ratings (Experiments 1, 2, and 4) and as facial muscle responses occurring within 2–4 s after stimulus onset (zygomaticus activity; Experiments 3 and 7). For instance, in participants unaware of spatial possibility we found affective discrimination between possible and impossible Necker cubes (the famous Freemish Crate) for 100 ms presentation timings, although a conscious discrimination took more than 2000 ms (Experiment 4). (shrink)

Frustration in traffic is one of the causes of aggressive driving. Knowledge whether a driver is frustrated may be utilized by future advanced driver assistance systems to counteract this source of crashes. One possibility to achieve this is to automatically recognize facial expressions of drivers. However, only little is known about the facial expressions of frustrated drivers. Here, we report the results of a driving simulator study investigating the facial muscle activity that comes along with frustration. Twenty-eight participants were video-taped (...) during frustrated and non-frustrated driving situations. Their facial muscle activity was manually coded according to the Facial Action Coding System. Participants showed significantly more facial muscle activity in the mouth region. Thus, recording facial muscle behavior potentially provides traffic researchers and assistance system developers with the possibility to recognize frustration while driving. (shrink)

Facial electromyography (EMG) was used to investigate patterns of facial mimicry in response to partial facial expressions in two contexts that differ in how naturalistic and socially significant the faces are. Experiment 1 presented participants with either the upper- or lower-half of facial expressions and used a forced-choice emotion categorisation task. This task emphasises cognition at the expense of ecological and social validity. Experiment 2 presented whole heads and expressions were occluded by clothing. Additionally, the emotion recognition task is more (...) open-ended. This context has greater social validity. We found mimicry in both experiments, however mimicry differed in terms of which emotions were mimicked and the extent to which the mimicry involved muscle sites that were not observed. In the more cognitive context, there was relatively more motor matching (i.e. mimicking only what was seen). In the more socially valid context, participants were less likely to mimic only what they saw – and instead mimicked what they knew. Additionally, participants mimicked anger in the cognitive context but not the social context. These findings suggest that mimicry involves multiple mechanisms and that the more social the context, the more likely it is to reflect a mechanism of social regulation. (shrink)

Our prior research demonstrated that the right temporoparietal junction exerted a modulatory role in ingroup bias in emotional mimicry. In this study, two experiments were conducted to further explore whether the rTPJ is a neural region for emotional mimicry or for the modulation of emotional mimicry by group membership in a sham-controlled, double-blinded, between-subject design. Both experiments employed non-invasive transcranial direct current stimulation to temporarily change the cortical excitability over the rTPJ and facial electromyography to measure facial muscle activations as (...) an index of emotional mimicry. After the anodal or sham stimulation, participants in Experiment 1 passively viewed a series of happy clips, while participants in Experiment 2 viewed happy clips performed by ethnic ingroup and outgroup models. fEMG analyses revealed that participants in Experiment 1 showed the same degree of happy mimicry for both tDCS conditions and participants in Experiment 2 showed an ingroup bias in happy mimicry in the sham condition, which disappeared in the anodal condition. Taken together, the present study demonstrated that rTPJ plays a role in the modulation of emotional mimicry by group membership. (shrink)

We investigate whether smile mimicry and emotional contagion are evident in non-text-based computer-mediated communication (CMC). Via an ostensibly real-time audio-visual CMC platform, participants interacted with a confederate who either smiled radiantly or displayed a neutral expression throughout the interaction. Automatic analyses of expressions displayed by participants indicated that smile mimicry was at play: A higher level of activation of the facial muscle that characterises genuine smiles was observed among participants who interacted with the smiling confederate than among participants who interacted (...) with the unexpressive confederate. However, there was no difference in the self-reported level of joviality between participants in the two conditions. Our findings demonstrate that people mimic smiles in audio-visual CMC, but that even though the diffusion of emotions has been documented in text-based CMC in previous studies, we find no convincing support for the phenomenon of emotional contagion in non-text-based CMC. (shrink)

I love cafés. It’s where academic life meets passion. The noise and tumult veils the soul from the world and enables deeper concentration than a large, wellappointed office affords. There’s just one problem: I hate coffee. The aroma gives me a headache. The bitter taste makes my facial muscles contract. My ideal coffee recipe would be: take a quarter teaspoon of coffee from the large round red container (the one that replaced the blue container as a symbol of Zionism), (...) add a bit of milk and fill to the brim with boiling water. (shrink)

Tracking emotional responses as they unfold has been one of the hallmarks of applied neuroscience and related disciplines, but recent studies suggest that automatic tracking of facial expressions have low validation. In this study, we focused on the direct measurement of facial muscles involved in expressions such as smiling. We used single-channel surface electromyography to evaluate the muscular activity from the Zygomaticus Major face muscle while participants watched music videos. Participants were then tasked with rating each video with regard (...) to their thoughts and responses to each of them, including their judgment of emotional tone, personal preference and rating of whether the video displayed strength and impression. Using a minimal recording setup, we employed three ways to characterize muscular activity associated with spontaneous smiles. The total time spent smiling, the average duration of smiles, and instances of high valence. Our results demonstrate that Valence was the emotional dimension that was most related to the Zygomaticus activity. Here, the ZygoNum had higher discriminatory power than ZygoLen for Valence quantification. An additional investigation using fractal properties of sEMG time series confirmed previous studies of the Facial Action Coding System documenting a smoother contraction of facial muscles for enjoyment smiles. Further analysis using ZygoTrace responses over time to the video events discerned “high valence” stimuli with a 76% accuracy. Additional validation of this approach came against previous findings on valence detection using features derived from a single channel EEG setup. We discuss these results in light of both the recent replication problems of facial expression measures, and in relation to the need for methods to reliably assess emotional responses in more challenging conditions, such as Virtual Reality, in which facial expressions are often covered by the equipment used. (shrink)

People dedicate significant attention to others’ facial expressions and to deciphering their meaning. Hence, knowing whether such expressions are genuine or deliberate is important. Early research proposed that authenticity could be discerned based on reliable facial muscle activations unique to genuine emotional experiences that are impossible to produce voluntarily. With an increasing body of research, such claims may no longer hold up to empirical scrutiny. In this article, expression authenticity is considered within the context of senders’ ability to produce convincing (...) facial displays that resemble genuine affect and human decoders’ judgments of expression authenticity. This includes a discussion of spontaneous vs. posed expressions, as well as appearance- vs. elicitation-based approaches for defining emotion recognition accuracy. We further expand on the functional role of facial displays as neurophysiological states and communicative signals, thereby drawing upon the encoding-decoding and affect-induction perspectives of emotion expressions. Theoretical and methodological issues are addressed with the aim to instigate greater conceptual and operational clarity in future investigations of expression authenticity. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Reviewed by:Deeper Than Reason: Emotion and Its Role in Literature, Music, and ArtSusan FeaginDeeper Than Reason: Emotion and Its Role in Literature, Music, and Art, by Jenefer Robinson; 516 pp. Oxford: Clarendon Press, 2005, $35.00.Jenefer Robinson's lucid yet closely-argued book has four parts. The first part presents a theory of the emotions in general. The second part develops and defends the view that "some works of literature... need to (...) be experienced emotionally if they are to be properly understood" (p. 3) and draws some implications for other arts. Part Three develops a new theory of expression, and Part Four examines the expression of emotion in and listeners' emotional responses to music. Robinson applies her theory of emotions and how they arise and are expressed in response to individual works of art throughout, and the extended discussions of Edith Wharton's The Reef and one of the intermezzi from Brahms's Opus 117 set are not to be missed.Robinson's use of psychological research to develop a philosophical theory of emotion is characteristic of an increasingly popular practice in the philosophy of mind. Her descriptions of this often highly technical literature are among the best with respect to accuracy and clarity. On most accounts, emotions are mental states; on Robinson's, they are mental processes. These processes are always initiated by "an automatic 'affective appraisal' [that] induces characteristic physiological and behavioral changes and is succeeded by... 'cognitive monitoring' of the situation" (p. 3). The appraisal is also referred to as a 'non-cognitive' appraisal, which may sound like an oxymoron. Robinson explains: these appraisals are non-cognitive "in the sense that they occur without any conscious deliberation or awareness, and that they do not involve any complex information processing" (p. 45; see also p. 59). Appraisals have a valence, positive or negative, sufficient to induce a characteristic pattern of physiological and (roughly, involuntary) behavioral responses, such as alterations in galvanic skin response and movements of facial muscles. These changes are succeeded by cognitive monitoring of the situation, resulting in conceptually more sophisticated assessments of one's initial response with respect to its suitability to the circumstances and in relation to one's beliefs. Thus, cognitive monitoring generates the more cognitively complex emotions, and here she is in agreement [End Page 420] with the "judgment theorists" (p. 90) that these emotions are individuated by cognitions. Robinson seeks a univocal account of emotions for humans and other sentient creatures, though with humans it is possible for a "complex cognition" to trigger the process that constitutes having an emotion and cognitive feedback may occur in general throughout the process in ways that are not possible for creatures lacking the relevant complex mental capacities (p. 93).The fact that complex cognitions can constitute the initial stage of an emotion makes it possible to respond emotionally to literature. As in emotional situations in real life, emotions are initiated by automatic affective appraisals that have to do with one's own wants and interests, calling our attention to something important in the novel, which may lay down its own memory system, linked with bodily feelings, which is then subject to cognitive appraisal and reappraisal. Cognitive reflection facilitates the understanding of narratives as well as characters, and with respect to the latter, she argues, deploys the same mental systems that are engaged in understanding people. Further, it is not merely the beliefs that one may acquire as a result of the process that is educational, but the process of emotional understanding itself (p. 155). Indeed, Robinson endorses the strong claim that for at least some novels, those that are part of the "Great Tradition" of nineteenth-century realistic British and American literature, it is necessary to experience them emotionally to understand them.Part Three exposits a theory of the expression of emotion simpliciter and then makes adjustments to it to build a theory of expression in art, taking advantage of Romantic theories of expression developed in the works of, for example, Collingwood. Reflection on ordinary expression allows an artist to clarify and articulate "what it is like to go through the emotion process," which may be revealed both in the... (shrink)

The current paper investigates the value and application of a range of physiological and neuroscientific techniques in applied marketing research and consumer science, highlighting new insights from research in social psychology and neuroscience. We review measures of sweat secretion, heart rate, facial muscle activity, eye movements, and electrical brain activity, using techniques including skin conductance, pupillometry, eyetracking and magnetic brain imaging. For each measure, after a brief explanation of the underlying technique, we illustrate concepts and mechanisms that the measure allows (...) researchers in marketing and consumer science to investigate, with a focus on consumer attitudes and behavior. By providing reviews on recent research that applied these methods in consumer science and relevant related fields, we also highlight methodological and theoretical strengths and limitations, with an emphasis on ecological validity. We argue that the inclusion of physiological and neuroscientific techniques can advance consumer research by providing insights into the often unconscious mechanisms underlying consumer behavior. Therefore, such technologies can help researchers and marketing practitioners understand the mechanisms of consumer behavior and improve predictions of consumer behavior. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:MIMESIS AND EMPATHY IN HUMAN BIOLOGY William B. Hurlbut, M.D. Stanford University Thou shalt not avenge, nor bear any grudge against the children of thy people, but thou shalt love thy neighbor as thyself: I am the Lord. (Leviticus. 19:18) The light of the body is the eye: if therefore thine eye be single, thy whole body shall be full of light. But if thine eye be evil, thy (...) whole body shall be full of darkness. If therefore the light that is in thee be darkness, how great is that darkness! (Matthew. 6:22-23) On the levels both ofcommon discourse and scientific description, the concept of empathy has found renewed popularity. Like a bridge that spans disparate realms, the idea of empathy can reconnect neurophysiology with psychology and social theory, and reestablish the grounds for a natural concept of ethics. Specifically, it can connect mimetic theory with a possible basis in biology, since empathy seems to represent an extension ofmimetic processes across the animal kingdom. For this reason, empathy/mimesis might be the grounds for a concept of ethics based on natural observation. Drawn from a German term Einfühlung, which means "feeling into," empathy carries the concept of "getting into the feelings of someone else" (deWaal 79). As a medium for the formation of meaningful bonds and William Hurlbut15 sensitive associations, the concept of empathy has taken on, in popular discourse, the somewhat sentimental notion ofsympathy. In the scientific description, however, empathy is seen as the highest human expression of a broader biological capacity for mimesis that seems inextricable from the very progress ofthe phylogenetic process. Among the earliest life forms, organisms drew information from one another to pattern and coordinate such basic biological functions as reproduction and nurture. But with the increased complexity of multicellular creatures, new means of communication arose, making possible more flexible adaptation and sociability. Gradually the direct chemical coordination suitable for collectives or swarms gave way to richer and more individual communication between organisms of higher forms of differentiation. The externally evident demarcation ofthe head region, with its organs ofsensory perception and communication, evolved in parallel with internal cerebral structures capable ofprocessing more complex impressions of the surrounding environment and coordinating greater freedom of motion. These vital powers of action and awareness in turn came to be governed, guided and integrated by an inner felt sense of need, goal or purpose. As Leon Kass says, "desire, not DNA, is the deepest principle of life" (Kass 1994, 48). This quality of "inwardness" is paralleled by an equally complex differentiation and integration of the external "look" ofthe animal. This "look," which is the literal translation of the Latin root of our word species, is the result of a genetically determined plan as important as any internal vital organ. It provides the unity of form that reveals or selectively conceals the inner life of the organism. It communicates and coordinates vital information regarding sexual and other social interactions. This upward process ofcomplex integrated organization of the "inner life" and the external action and presentation of selfreaches its fullest expression in the human form. Along with upright posture and its freeing ofthe hands as tools of "gnostic touching," comes a reordering of the senses and a highly flexible, furless canvas of selfpresentation we call the face (Kass 1985, 287). Upwards through mammalian evolution there is a progressive refinement of the structures of the face that facilitate active and increasingly subtle communication and penetration into the life of the other. With more than 30 finely tuned muscles of facial expression and vocal control, human beings are capable of a wide array of communicative 16 Mimesis andEmpathy expressions of emotions and intentions. Paul Ekman claims to have discerned more than 1 8 forms of smiling, each with a distinct meaning (66). With upright posture came a retraction ofthe snout and bilateral stereoscopic vision. Sight replaced smell as the prominent sense. Whereas smell required direct chemical contact, and sound gave formless information, sight gave a knowing and accurate encounter with the form and unity ofwholes. Sight allowed rapid perception ofobjects and actions at distant horizons. The detached beholding of sight allowed a deeper and more accurate apprehension of... (shrink)

Plan-ahead becomes necessary for those movements which are over-and-done in less time than it takes for the feedback loop to operate. Natural selection for one of the ballistic movements (hammering, clubbing, and throwing) could evolve a plan-ahead serial buffer for hand-arm commands that would benefit the other ballistic movements as well. This same circuitry may also sequence other muscles (children learning handwriting often screw up their faces and tongues) and so novel oral-facial sequences may also benefit (as might kicking (...) and dancing). An elaborated version of the sequencer may constitute a Darwin Machine that spins scenarios, evolves sentences, and facilitates insight by offline simulation. An example is given of an evolutionary scenario from an apelike ancestor, demonstrating the transition behaviors and growth curve considerations that any such theory needs to have; this particular scenario (involving throwing improvements) also suggests an explanation for the puzzling design of the Acheulean "handaxe.". (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Standing at the Intersections: Navigating Life as a Black Intersex ManSean Saifa WallAs I sit down to write this narrative, my mind is reflecting on the past year. This year has seen numerous protests against state–sanctioned violence with the declaration that “Black Lives Matter”. As a Black intersex man, I have witnessed the impact of state–sanctioned violence on my family and my community, both from the police state and (...) medical community. I charge the police state and the medical community with state– sanctioned violence: Each targets non–normative bodies—the former through incarceration and execution, and the latter by means of surgical and hormonal intervention. As a Black intersex man, I stand at the intersection bearing witness to how this violence has incarcerated my friends and loved ones as well as being subjected to medically unnecessary surgical intervention. Although this is where I stand now, both socially and politically, I have not always existed here.I was born in the winter of 1978 at Columbia–Presbyterian Hospital in New York City. I was the youngest of five children and one of three children in my family who were born with an intersex trait now known as androgen insensitivity syndrome (AIS). At the time, AIS was referred to as “testicular [End Page 117] feminization syndrome.” Upon receiving my medical records years later at the age of twenty–five, I noticed scribbling and a barrage of notes indicating the process by which the doctors assigned my gender as female. Although I had ambiguous genitalia, which caused some initial confusion among the doctors, XY chromosomes were not enough for me to be raised as male. My mother was told I would be raised as a girl and, according to the medical records, “function as such.”Unlike my sisters who were also born with AIS, my mom was not swayed by the surgical recommendations doctors made about my body. As a matter of protocol, my sisters’ gonads were removed in infancy, however, my mom made the decision that my testes would remain with me until they had to be removed.Because of intense pain in my groin area, my testicles were removed when I was thirteen years old. The pain that I felt following the surgery was perhaps the worst pain that I have experienced in my entire life. After surgery, my pediatrician prescribed estrogen and Provera as a hormonal replacement regimen. Fatty deposits changed the shape and contours of my face. Once robust and chiseled thighs now harbored cellulite. The beginnings of facial hair and prominent body hair became wispy and nonexistent. What was hard and defined became soft.At no point did anyone ask me what I wanted to do with my body.I actually missed the effects of my natural testosterone such as a deepening voice, increased hair and muscle mass; when I asked if I could take both testosterone and estrogen after surgery, my mother remarked, “You would look too weird.”The hormone therapy was coupled with intense social conditioning. I feel as if the social conditioning for young women raised with AIS is suffocating. When doctors prescribed hormones for me to take, my mother constantly reminded me how “beautiful” the little yellow pills would make me. As a means of reassurance, my pediatrician told my mom that “a lot of fashion models” have AIS and that I would most certainly be beautiful. In our dominant US culture, gender norms can already be oppressive, but for women with AIS, there is the impact of gender norms and the underlying fear that women with AIS are not really women since they have XY chromosomes. I did not succumb to the pressure to be more feminine, but actually gravitated toward masculinity. Before transitioning to live as a man, I considered myself a butch woman. When I came out of the closet at fourteen years old and presented as a masculine young woman, I never felt safe. Because I dated women who were more feminine than I, my relationship with these women seemed threatening to men who repeatedly reminded me through harassment and threats that “I was not a man.” Of course, I wasn’t trying to be a... (shrink)

To controlforceaccurately under a wide range of behavioral conditions, the central nervous system would either require a detailed, continuously updated representation of the state of each muscle (and the load against which each is acting) or else force feedback with sufficient gain to cope with variations in the properties of the muscles and loads. The evidence for force feedback with adequate gain or for an appropriate central representation is not sufficient to conclude that force is the major controlled variable (...) in normal limb movements.Morton's hypothesis, thatlengthis controlled by a follow-up servo, has a number of difficulties related to the delays, gains, variability, and specificity in feedback pathways comprising potential servo loops. However, experimental evidence is consistent with these pathways providing servo assistance for some movements produced by coactivation of α- and static γ-motoneurons. Dynamic γ-motoneurons may provide an additional input for adaptive control of different types of movements.The idea that feedback is used to compensate for changes in musclestiffnesshas received experimental support under static postural conditions. However, reflexes tend to increase rather than decrease the range of variation in muscle stiffness during some cyclic movements. Theoretical problems associated with the regulation of stiffness are also discussed. The possibilities of separate control systems forvelocityorviscosityare considered, but the evidence is either negative or lacking. I conclude that different physical variables can be controlled depending on the type of limb movement required. The concept of stiffness regulation is also useful under some conditions, but should probably be extended to the regulation of the visco-elastic properties (i.e., the mechanical impedance) of a muscle or joint. (shrink)

Background: Clinical and experimental findings have suggested that insomnia is associated with altered emotion processing, such as facial emotion recognition and impairments in executive functions. However, the results still appear non-consensual and have recently been presented by a few number of studies. Accordingly, the aim of the present study was to investigate whether patients with Insomnia disorder will present alterations in recognition of facial emotions and that such alterations will be related to Executive Functions and that Insomnia Disorder patients will (...) exhibit a lower Executive Functions performance when compared to normal controls individuals. Method: A total of 11 individuals diagnosed with insomnia disorder and 15 control participants took part in the present cross-sectional study. They completed questionnaires covering socio-demographic data, a sleep and mood evaluation, and a cognitive assessment. Moreover, they underwent a computerized Facial Emotional Recognition test, consisting of facial emotion labeling and facial emotion matching. Results: Individuals with insomnia presented a lower recognition of facial expressions of fear and sadness in comparison to control volunteers. Perceptual Organization Index was found to be statistically significant lower in the insomnia group compared to the control group. There was a statistically significant association between facial recognition emotional and cognitive processes of in executive functions performance, especially in processes related to the inhibitory control, planning capacity, problem solving and cognitive flexibility in insomnia group. Conclusions: Insomnia disorder impairs the facial emotion recognition of the fear and sadness. Insomniacs with impairment in the facial emotion recognition had impaired performance of executive functions. There is a negative impact on processes related to cognitive-emotional capacity than on processes related to social-emotional recognition. Keywords: insomnia, facial emotional recognition, sleep deprivation, cognition, executive functions. (shrink)

There are many ways to assess face perception skills. In this study, we describe a novel task battery FEAST (Facial Expression Action Stimulus Test) developed to test recognition of identity and expressions of human faces as well as stimulus control categories. The FEAST consists of a neutral and emotional face memory task, a face and object identity matching task, a face and house part-to-whole matching task, and a human and animal facial expression matching task. The identity and part-to-whole matching tasks (...) contain both upright and inverted conditions. The results provide reference data of a healthy sample of controls in two age groups for future users of the FEAST. (shrink)

The idea that the brain is a representational organ has roots in the nineteenth century, when neurologists began drawing conclusions about what the brain represents from clinical and experimental studies. One of the earliest controversies surrounding representation in the brain was the “muscles versus movements” debate, which concerned whether the motor cortex represents complex movements or rather fractional components of movement. Prominent thinkers weighed in on each side: neurologists John Hughlings Jackson and F.M.R. Walshe in favor of complex movements, (...) neurophysiologist Charles Sherrington and neurosurgeon Wilder Penfield in favor of movement components. This essay examines these and other brain scientists’ evolving notions of representation during the first eighty years of the muscles versus movements debate (c. 1873–1954). Although participants agreed about many of the superficial features of representation, their inferences reveal deep-seated disagreements about its inferential role. Divergent epistemological commitments stoked conflicting conceptions of what representational attributions imply and what evidence supports them. (shrink)

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by observers. Voluntary control (...) over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute an attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it. (shrink)

While numerous studies have examined the relationships between facial actions and emotions, they have yet to account for the ways that specific spontaneous facial expressions map onto emotional experiences induced without expressive intent. Moreover, previous studies emphasized that a fine-grained investigation of facial components could establish the coherence of facial actions with actual internal states. Therefore, this study aimed to accumulate evidence for the correspondence between spontaneous facial components and emotional experiences. We reinvestigated data from previous research which secretly recorded (...) spontaneous facial expressions of Japanese participants as they watched film clips designed to evoke four different target emotions: surprise, amusement, disgust, and sadness. The participants rated their emotional experiences via a self-reported questionnaire of sixteen emotions. These spontaneous facial expressions were coded using the Facial Action Coding System, the gold standard for classifying visible facial movements. We corroborated each facial action that was present in the emotional experiences by applying stepwise regression models. The results found that spontaneous facial components occurred in ways that cohere to the their evolutionary functions based on the rating values of emotional experiences (e.g., the inner brow raiser might be involved in the evaluation of novelty). This study provided new empirical evidence for the correspondence between each spontaneous facial component and first-person internal states of emotion as reported by the expresser. (shrink)

We discuss here one of our projects, aimed at developing an automatic facial expression interpreter, mainly in terms of signaled emotions. We present some of the relevant findings on facial expressions from cognitive science and psychology that can be understood by and be useful to researchers in Human-Computer Interaction and Artificial Intelligence. We then give an overview of HCI applications involving automated facial expression recognition, we survey some of the latest progresses in this area reached by various approaches in computer (...) vision, and we describe the design of our facial expression recognizer. We also give some background knowledge about our motivation for understanding facial expressions and we propose an architecture for a multimodal intelligent interface capable of recognizing and adapting to computer users' affective states. Finally, we discuss current interdisciplinary issues and research questions which will need to be addressed for further progress to be made in the promising area of computational facial expression recognition. (shrink)

In the wake of Clark and Chalmers famous argument for extended cognition some people have argued that willpower equally can extend into the environment (e.g. Heath and Anderson in The thief of time: philosophical essays on procrastination. Oxford University Press, New York, pp 233–252, 2010). In a recent paper Fabio Paglieri (Consciousness in interaction: the role of the natural and social context in shaping consciousness. John Benjamins, Amsterdam, pp 179–206, 2012) provides an interesting argument to the effect that there might (...) well be extended self control, but that willpower does not lend itself to extension. This paper argues that Paglieri is right in claiming that previous attempts to extend the will are flawed. It then provides an argument for extending the will that does not fall foul of Paglieri’s argument and actually provides us with an even stronger case for extension than the one that Clark and Chalmers provide for cognition. (shrink)

The lack of access to gender-affirming surgery represents a significant unmet health care need within the transgender community, frequently resulting in depression and self-destructive behavior. While some transgender people may have access to gender reassignment surgery, an overwhelming majority cannot afford facial feminization surgery. The former may be covered as a “medical necessity,” but FFS is considered “cosmetic” and excluded from insurance coverage. This demarcation between “necessity” and “cosmetic” in transgender health care based on specific body parts is in direct (...) opposition to the scientific community’s understanding of gender dysphoria and professional guidelines for transgender health. GRS affects one’s ability to function in an intimate relationship, while FFS has the same impact on social interactions an, therefore may have a far greater implication for one’s quality of life. FFS is a cost-effective intervention that needs to be covered by insurance policies. The benefits of such coverage far exceed the insignificant costs. (shrink)

It is hypothesized that human faces judged to be attractive by people possess two features—averageness and symmetry—that promoted adaptive mate selection in human evolutionary history by way of production of offspring with parasite resistance. Facial composites made by combining individual faces are judged to be attractive, and more attractive than the majority of individual faces. The composites possess both symmetry and averageness of features. Facial averageness may reflect high individual protein heterozygosity and thus an array of proteins to which parasites (...) must adapt. Heterozygosity may be an important defense of long-lived hosts against parasites when it occurs in portions of the genome that do not code for the essential features of complex adaptations. In this case heterozygosity can create a hostile microenvironment for parasites without disrupting adaptation. Facial bilateral symmetry is hypothesized to affect positive beauty judgments because symmetry is a certification of overall phenotypic quality and developmental health, which may be importantly influenced by parasites. Certain secondary sexual traits are influenced by testosterone, a hormone that reduces immunocompetence. Symmetry and size of the secondary sexual traits of the face (e.g., cheek bones) are expected to correlate positively and advertise immunocompetence honestly and therefore to affect positive beauty judgments. Facial attractiveness is predicted to correlate with attractive, nonfacial secondary sexual traits; other predictions from the view that parasite-driven selection led to the evolution of psychological adaptations of human beauty perception are discussed. The view that human physical attractiveness and judgments about human physical attractiveness evolved in the context of parasite-driven selection leads to the hypothesis that both adults and children have a species-typical adaptation to the problem of identifying and favoring healthy individuals and avoiding parasite-susceptible individuals. It is proposed that this adaptation guides human decisions about nepotism and reciprocity in relation to physical attractiveness. (shrink)

Muscle synergies reflect the presence of a common neural input to multiple muscles. Steering small sets of synergies is commonly believed to simplify the control of complex motor tasks like walking and running. When these locomotor patterns emerge, it is likely that synergies emerge as well. We hence hypothesized that in children learning to run the number of accompanying synergies increases and that some of the synergies’ activities display a temporal shift related to a reduced stance phase as observed (...) in adults. We investigated the development of locomotion in 23 children aged 2–9 years of age and compared them with seven young adults. Muscle activity of 15 bilateral leg, trunk, and arm muscles, ground reaction forces, and kinematics were recorded during comfortable treadmill walking and running, followed by a muscle synergy analysis. We found that toddlers and preschoolers utilize a “walk-run strategy” when learning to run: they managed the fastest speeds on the treadmill by combining double support and flight phases. In particular the activity duration of the medial gastrocnemius muscle was weakly correlated with age. The number of synergies across groups and conditions needed to cover sufficient data variation ranged between four and eight. The number of synergies tended to be smaller in toddlers than it did in preschoolers and school-age children but the adults had the lowest number for both conditions. Against our expectations, the age groups did not differ significantly in the timing or duration of synergies. We believe that the increase in the number of muscle synergies in older children relates to motor learning and exploration. The ability to run with a FP is clearly associated with an increase in the number of muscle synergies. (shrink)