Abstract
Can we read emotions in faces? Many studies suggest that we can, yet skeptics contend that these studies employ methods that unwittingly help subjects in matching faces with emotions. Some studies present subjects with posed faces, which may be more exaggerated than spontaneous ones. And some studies provide subjects with a list of emotion words to choose from, which forces them to interpret faces in specific emotion terms. I argue that the skeptics’ challenge rests on a false assumption: that once subjects leave the lab, they no longer receive help in matching faces with emotions. I contend that people receive as much help in the wild as they do in the lab. People unconsciously amplify their spontaneous expressions in the presence of others, thereby making them easier to read. And people teach children to interpret faces in the same specific emotion terms found in the experimenters’ word lists. I argue that we are good at readings emotions in faces because we can normally count on a little help from our friends.
Similar content being viewed by others
Notes
I define my terms later in the paper. As a preview, I define “emotionreading” as the process of rapidly and reliably associating faces (or other behaviors) with emotions. These associations need not be correct.
Most subjects from the U.S., Japan, and Brazil also labeled the same faces as afraid and surprised, but many subjects from New Guinea and Borneo reversed these labels. There was also less agreement as to which faces correspond to disgust.
Naab & Russell observe that “posed expressions were created with the sole purpose of conveying a single specific emotion, typically with exaggerated individual features,” (2007, 736). Barrett adds that “In real life, faces and bodies don’t move in this cartoonish fashion” (2020). Gendron et al. suggest that “To address this concern, it is instructive to compare emotion perception based on covertly acquired spontaneous facial actions…with actions that are posed” (2013, 47). Indeed, some studies that feature spontaneous faces find substantially lower agreement than studies featuring posed faces (e.g. Naab and Russell 2007).
Aviezer et al. (2011) took a photograph of a facial expression of disgust and superimposed it onto photographs of bodies performing gestures indicative of different emotions. Subjects were instructed to ignore the gestures and to focus solely on the facial expressions. Yet, when the disgust face was superimposed onto bodies performing fearful, sad, and angry gestures, subjects were less likely to match the face with disgust, and more likely to match it with the emotion indicated by the gestures. This study suggests that context influences the interpretation of faces.
An alternative to the judgment task—in which subjects are presented with photographs of faces and asked to label them with emotion words—is the sorting task—in which subjects are given photographs of faces and asked to sort them into different piles, based on whatever similarities strike them as most salient. Gendron et al. (2014) found that whereas U.S. subjects tend to sort faces by emotion, Himba subjects from Namibia tend to sort faces in behavioral or situational terms.
Griffiths and Scarantino (2009) develop a situated perspective on emotion. I develop a situated perspective on emotionreading. I compare these two perspectives in the final section of the paper.
I limit my focus to present-tense attributions of emotion, but emotion attributions can also be past- or future-tense (“Tom was sad” or “Tom will be sad”), as well as counterfactual (“Tom would be sad”).
The emotionreading hypothesis should not be taken to imply that emotions are the only states we associate with faces. Faces have myriad meanings, many unrelated to emotion. The claim that we are natural emotionreaders is consistent with the claim that we also read intentions, beliefs, and other states in faces.
Jack et al. (2014) find that some expressions take longer to read because they involve a more complex set of movements. That may be why it takes longer to discern anger in a face than a dog in a photograph.
A question that has occupied psychologists for the last century is whether associations between faces and emotions are universal, culturally specific, or perhaps even more individualized. If you were to show a photograph of a face to people all around the globe, would they tend to think of the same emotion? Let’s say that emotionreading is convergent to the extent that people associate the same faces with the same emotions and divergent to the extent that people associate the same faces with different emotions. Although we can make sense of the idea of divergent emotionreading, let’s stipulate that by “emotionreading” we mean convergent emotionreading. Thus, if people from different cultures classify faces differently, then they are not classifying faces on the basis of emotionreading—but on the basis of some other cognitive process.
Many Constructionists agree that some faces are characteristic components of emotions, and that these faces express those emotions. They claim, however, that the emotion is psychologically and/or socially constructed. See Glazer (2018) for a critical discussion of this view.
Park et al. (2020) report that while posed and spontaneous faces can be distinguished physiologically, each involves some muscles being contracted more intensely than the other. Posed faces tend to involve greater contractions of lower-face muscles, while spontaneous faces tend to involve greater contractions of upper-face muscles.
Research finds that the left side of the face is generally more expressive than the right. This asymmetry is found in both spontaneous and posed faces (Dopson et al. 1984). My point here is that amplified spontaneous expressions are less asymmetrical than non-amplified spontaneous expressions.
I thank an anonymous referee for bringing this worry to my attention.
By “contextual cues” I mean any additional information that accompanies the facial expression, construed narrowly as a set of muscle contractions, which might influence the observer’s interpretation of the expression. Wieser and Brosch (2012) helpfully group contextual cues into four categories—within-face features (e.g., eye gaze), within-sender features (e.g., hand gestures), external features (e.g. visual scene), and within-perceiver features (e.g., racial bias)—and review existing research on each. This research program is still in its infancy; important empirical and conceptual work remains to be done.
Context can be ambiguous in the same way that faces can. Grieving people visit cemeteries, but so do tourists. In some circumstances, the context may help observers to disambiguate faces. But in others, faces may help observers to disambiguate contexts.
Smith in fact uses the term “sympathy,” but he has in mind what we mean by “empathy,” namely the sharing of feeling.
Suri & Gross are careful to describe emotion regulation in a way that is consistent with competing theories of emotion. Their research does not assume or support any particular theory.
This idea is controversial. Famously, the finding that performing a “power stance” can temporarily boost one’s confidence (Carney et al. 2010) seems to have failed attempts at replication.
Hochschild (1983) argues that employees in the service industry do not merely engage in “surface acting,” producing socially expected expressions without having the corresponding emotions, but regularly engage in “deep acting,” producing the socially expected expression by up-regulating the corresponding emotion. Van Kleef (2016, 69–70, 150–153) discusses several empirical studies that support Hochschild’s claim.
I would like to thank Michael Roche and an anonymous referee for bringing this objection to my attention.
To be clear, sorting faces by emotion is not more “correct” than sorting faces by behavior. Faces have multiple meanings. Prompting subjects from different cultures to sort faces by social intention may result in similar piles, too.
This is not to say that the piles were identical. Most noticeably, Himba participants did not place the disgust faces into a single pile, but rather distributed them among four of the six piles. If one were to remove the disgust faces, however, then the piles would look even more similar to those produced by U.S. participants. Indeed, Widen and Russell (2010b; Lawrence et al. (2016) find that the ability to distinguish disgust faces from other faces develops later in life, and is influenced by cultural norms related to disgust. So it is not too surprising that disgust would be the emotion that most defies the predicted categorizations.
I thank an anonymous referee for raising this concern.
Bibliography
Abramson L, Petranker R, Marom I, Aviezer H (2020) Social interaction context shapes emotion recognition through body language, not facial expressions. Emotion. https://doi.org/10.1037/emo0000718
Aviezer H, Bentin S, Dudarev V, Hassin RR (2011) The automaticity of emotional face-context integration. Emotion 11(6):1406–1414
Bar-On D (2004) Speaking my mind. Oxford University Press, New York
Barrett LF (2006) Are emotions natural kinds? Perspect Psychol Sci 1(1):28–58
Barrett LF (2017) How emotions are made. Houghton Mifflin Harcourt, Boston
Barrett LF (2020) Emotional intelligence needs a rewrite. Nautilus 83, https://nautil.us/issue/83/intelligence/emotional-intelligence-needs-a-rewrite-rp (accessed 16 February 2021)
Brady TF, Shafer-Skelton A, Alvarez GA (2017) Global ensemble texture representations are critical to rapid scene perception. J Exp Psychol Hum Percept Perform 43(6):1160–1176. https://doi.org/10.1037/xhp0000399
Carney DR, Cuddy AJC, Yap AJ (2010) Power posing: Brief nonverbal displays affect neuroendocrine levels and risk tolerance. Psychol Sci 21(10):1363–1368
Castro VL, Halberstadt AG, Lozada FT, Craig AB (2015) Parents’ emotion-related beliefs, behaviors, and skills predict children’s recognition of emotion. Infant and child development 24(1):1–22. https://doi.org/10.1002/icd.1868
Croker V, McDonald S (2005) Recognition of emotion from facial expression following traumatic brain injury. Brain Injury 19(10):787–799. https://doi.org/10.1080/02699050500110033
Crivelli C, Fridlund AJ (2018) Facial displays are tools for social influence. Trends Cogn Sci 22(5):388–399. https://doi.org/10.1016/j.tics.2018.02.006
Darwin C (1872) The expression of the emotions in man and animals. John Murray, London
Davis W (2003) Meaning, expression, and thought. Cambridge University Press, New York
Dopson WG, Beckwith BE, Tucker DM, Bullard-Bates PC (1984) Asymmetry of facial expression in spontaneous emotion. Cortex 20:243–251
Dunn J, Brown J, Beardsall L (1991) Family talk about feeling states and children’s later understanding of others’ emotions. Dev Psychol 27(3):448–455. https://doi.org/10.1037/0012-1649.27.3.448
Ekman P (2016) What scientists who study emotion agree about. Perspect Psychol Sci 11(1):31–34
Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3/4):169–200
Ekman P, Sorenson ER, Friesen WV (1969) Pan-cultural elements in facial display of emotions. Science 164:86–88
Fernández-Dols JM, Ruiz-Belda MA (1997) Spontaneous facial behavior during intense emotional episodes: Artistic truth and optical truth. In: Russell JA, Fernández-Dols JM (eds) The psychology of facial expression. Cambridge University Press, New York, pp 255–274
Fridlund AJ, Schwartz GE, Fowler SC (1984) Pattern recognition of self-reported emotional state from multiple‐site facial EMG activity during affective imagery. Psychophysiology 21(6):622–637
Fridlund AJ (1991) Sociality of solitary smiling: Potentiation by an implicit audience. J Personal Soc Psychol 60(2):229–240
Gallagher S, Zahavi D (2012) The phenomenological mind. Routledge, New York
Gendron M, Mesquita B, Barrett LF (2013) Emotion perception: Putting the face in context. In: Reisberg D (ed) The Oxford handbook of cognitive psychology. Oxford University Press, New York, pp 539–556
Gendron M, Roberson D, van der Vyver JM, Barrett LF (2014) Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture. Emotion 14:251–262. https://doi.org/10.1037/a0036052
Glazer T (2017) Looking angry and sounding sad: The perceptual analysis of emotional expression. Synthese 194(9) 3619–3643. https://doi.org/10.1007/s11229-016-1113-1
Glazer T (2018) The part-whole perception of emotion. Conscious Cogn 58:34–43
Glazer T (2019) The social amplification view of facial expression. Biol Philos 34:33. https://doi.org/10.1007/s10539-019-9686-y
Glazer T (2020) To express or not to express? Ambivalence about emotional expression. In: Gatzia D, Brogaard B (eds) The philosophy and psychology of ambivalence: Being of two minds. Routledge, New York, pp 175–196
Green MS (2007) Self-expression. Oxford University Press, New York
Griffiths P, Scarantino A (2009) Emotions in the wild: The situated perspective on emotion. In: Robbins P, Aydede M (eds) Cambridge Handbook of Situated Cognition. Cambridge University Press, Cambridge, pp 437–453
Grinspan D, Hemphill A, Nowicki S Jr (2003) Improving the ability of elementary school-age children to identify emotion in facial expression. J Genet Psychol 164(1):88–100
Hess U, Banse R, Kappas A (1995) The intensity of facial expression is determined by underlying affective state and social situation. J Personal Soc Psychol 69(2):280–288
Hochschild AR (1983) The managed heart. University of California Press, Berkeley, CA
Hoemann K, Crittenden AN, Msafiri S, Liu Q, Li C, Roberson D, Ruark GA, Gendron M, Barrett LF (2019) Context facilitates performance on a classic cross-cultural emotion perception task. Emotion 19(7):1292–1313
Hutto DD, Robertson I, Kirchhoff MD (2018) A new, better BET: Rescuing and revising basic emotion theory. Front Psychol 9:1217
Jack RE, Garrod O, Schyns PG (2014) Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Curr Biol 24(2):187–192. https://doi.org/10.1016/j.cub.2013.11.064
Kraut RE, Johnston RE (1979) Social and emotional messages of smiling: An ethological approach. J Personal Soc Psychol 37:1539–1553
Krueger J (2014) Emotions and the social niche. In: von Scheve C, Salmela M (eds) Collective emotions. Oxford University Press, New York, pp 156–171
Krueger J, Osler L (2019) Engineering affect: Emotion regulation, the internet, and the techno-social niche. Philosophical Top 47(2):205–231
Lawrence K, Campbell R, Skuse D (2016) Can children see emotions in faces? Front. Young Minds 4:15. https://doi.org/10.3389/frym.2016.00015
Limbrecht-Ecklundt K, Scheck A, Jerg-Bretzke L, Walter S, Hoffmann H, Traue HC (2013) The effect of forced choice on facial emotion recognition: a comparison to open verbal classification of emotion labels. Psycho-social Med 10:Doc04. https://doi.org/10.3205/psm000094
Lorenz K (1966) Evolution of ritualization in the biological and cultural spheres. Philos Trans R Soc Lond Ser B 251:273–284
Martinez A, Du S (2010) How fast can we recognize facial expressions of emotion? J Vis 10(7):607. https://doi.org/10.1167/10.7.607
Matsumoto D, Olide A, Schug J, Willingham B, Callan M (2009) Cross-cultural judgments of spontaneous facial expressions of emotion. J Nonverbal Behav 33(4):213–238. https://doi.org/10.1007/s10919-009-0071-4
Matsumoto D, Keltner D, Shiota MN, Frank MG, O’Sullivan M (2008) What’s in a face? Facial expressions as signals of discrete emotions. In: Lewis M, Haviland JM, Barrett LF (eds) Handbook of emotions, 3rd edition. Guilford Press, New York, pp 211–234
Montague DP, Walker-Andrews AS (2001) Peekaboo: A new look at infants’ perception of emotion expressions. Dev Psychol 37(6):826–838
Naab PJ, Russell JA (2007) Judgments of emotion from spontaneous facial expressions of New Guineans. Emotion 7(4):736–744
Park S, Lee K, Lim JA, Ko H, Kim T, Lee JI, Kim H, Han SJ, Kim JS, Park S, Lee JY, Lee EC (2020) Differences in facial expressions between spontaneous and posed smiles: Automated method by action units and three-dimensional facial landmarks. Sensors 20(4):1199. https://doi.org/10.3390/s20041199
Rajhans P, Jessen S, Missana M, Grossmann T (2016) Putting the face in context: Body expressions impact facial emotion processing in human infants. Dev Cogn Neurosci 19:115–121. https://doi.org/10.1016/j.dcn.2016.01.004
Rowlands M (2010) The new science of the mind. MIT Press, Boston
Russell JA (1994) Is there universal recognition of emotion from facial expression? A review of cross-cultural studies. Psychol Bull 115(1):102–141
Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110(1):145–172
Sauter DA, Fischer AH (2018) Can perceivers recognise emotions from spontaneous expressions? Cogn Emot 32(3):504–515. https://doi.org/10.1080/02699931.2017.1320978
Scarantino A (2017) How to do things with emotional expressions: The theory of affective pragmatics. Psychol Inq 28(2–3):165–185
Shariff AF, Tracy JL (2011) What are emotion expressions for? Curr Dir Psychol Sci 20(6):395–399
Smith A (1982) The theory of moral sentiments. Liberty Fund, Indiana
Smith J (2015) The phenomenology of face-to-face mindreading. Philos Phenomenol Res 90(2):274–293
Stearns PN (1994) American cool. New York University Press, New York
Stearns PN, Stearns CZ (1985) Emotionology: Clarifying the history of emotion and emotional standards. Am Hist Rev 90(4):813–836
Suri G, Gross J (2016) Emotion regulation: A valuation perspective. In: Barrett LF, Lewis M, Haviland-Jones JM (eds) Handbook of emotions, fourth edition. Guilford Press, New York, pp 453–466
Taumoepeau M, Ruffman T (2006) Mother and infant talk about mental states relates to desire language and emotion understanding. Child Dev 77(2):465–481
Taylor C (1979) Action as expression. In: Diamond C, Teichmann J (eds) Intention and intentionality: Essays in honour of G.E.M. Anscombe. Harvester Books, Brighton, pp 73–89
Tormey A (1971) The concept of expression. Princeton University Press, New Jersey
Van Kleef GA (2016) The interpersonal dynamics of emotion. Cambridge University Press, New York
Vygotsky LS (1978) Mind in society: The development of higher psychological processes. Harvard University Press, Cambridge, MA
Widen SC, Russell JA (2010a) Children’s scripts for social emotions: Causes and consequences are more central than are facial expressions. Br J Dev Psychol 28:565–581
Widen SC, Russell JA (2010b) Differentiation in preschooler’s categories of emotion. Emotion 10(5):651–661. https://doi.org/10.1037/a0019005
Wieser MJ, Brosch T (2012) Faces in context: a review and systematization of contextual influences on affective face processing. Front Psychol 3:471. doi: https://doi.org/10.3389/fpsyg.2012.00471
Wood D, Bruner J, Ross G (1976) The role of tutoring in problem solving. J Child Psychol Child Psychiatry 17:89–100
Zawidzki T (2013) Mindshaping. MIT Press, Boston
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Glazer, T. Emotionshaping: a situated perspective on emotionreading. Biol Philos 37, 13 (2022). https://doi.org/10.1007/s10539-022-09842-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10539-022-09842-5