Thursday, July 01, 2004

About Faces, in Art and in the Brain

By: Robert L. Solso Ph.D.

Did the human brain evolve to reflect the life-and-death importance of perceiving and reading faces?

art_v6n3solso_2Look at the four images above. You probably recognize each image as a face, all of the faces mean something to you, and each produces some reaction. In some cases, you clearly recognize the person portrayed, such as George Washington. In other cases, such as the abstraction by Pablo Picasso, you may understand that a face is being depicted but realize that it does not look like any real person. Faces have long been considered special as social signals, and, from prehistoric amulets to many modern painters, faces are central to art. Now, we have striking new neurologic evidence that faces are special in the brain, as well. As you view the faces on this page, just as when you look at the faces of people around you, you are engaging a part of your cerebrum that seems to be dedicated to facial perception, and there is a measurable increase in blood flow to an area in the brain’s right hemisphere called the fusiform facial area (FFA).  

FACES AND SURVIVAL

Almost all creatures, from dogs to canaries, gorillas to penguins, salamanders to crocodiles, kangaroos to spiders, and certainly members of our human family, manifest the same formula for facial composition: a forehead, two eyes, a nose, a mouth, and a chin that are in the same relative positions. Why was nature so consistent in composing faces? Essentially, the arrangement optimizes survival: the eyes located high for a commanding view of the world, the nose turned down to avoid the rain, and the mouth situated to ingest food that has been perused by the nose and eyes above it. 

Faces are usually the first thing we notice in other people. Faces tell us more about a person than any other physical attribute and have always been socially important to humans. More often than not, we evaluate each other from first impressions based largely on facial expressions. In general, faces we find attractive or trustworthy, we bond with; faces we find offensive or deceitful, we avoid. Just below this behavioral act, however, lies a more profound reason for our response to faces. 

Throughout the long course of human evolution, recognizing and evaluating people on the basis of their faces made an important contribution to survival. Knowing whom to trust and whom to suspect saved many of our ancestors from needless bloodshed, so they could live to obtain food and mate another day. As cooperative societies emerged and people relied on each other for working together in hunting, food gathering, or constructing shelter, it was helpful to rely on bodily and facial expressions as much as on words to comprehend intentions and emotions. The formation of alliances, vitally important in what we might call the “hive-life” of social people, depended on communicating trustworthiness, which could be done, in part, through the always conspicuous face. Ability to read faces became a tool for human survival.

 art_v6n3solso_3
Darwin’s dog: a facial display clearly understood by an antagonist. © Steve McCurry / Magnum Photos
 

Charles Darwin’s classic book, The Expression of the Emotions in Man and Animals,1 pointed out that facial gestures, as well as some postures, were part of the survival kit of some animals. Discussing aggressive expressions of animals, Darwin wrote: “When a dog is on the point of springing on his antagonist, he utters a savage growl; the ears are pressed closely backwards, and the upper lip is retracted out of the way of his teeth, especially of his canines.” Species from menacing cobras to laughing baboons to play-acting birds such as the common killdeer (which tries to draw predators away from its nest with cries of “killdeee, killdeee” and a “broken wing” charade) have survived another day by demonstrating aggressive or distracting behaviors. 

 art_v6n3solso_4
According to Paul Ekman, facial expressions of emotion—anger, happiness, disgust, surprise, sadness, fear—are universal across cultures. Anne Solso, courtesy of Robert L. Solso

THE UNIVERSALITY OF FACIAL EXPRESSION

Human facial expressions are also designed to arouse reactions from others. The early work of Darwin (who took full advantage of the British Empire’s broad geography) indicated that people all over the world both express and perceive facial expression in similar ways. These early observations were confirmed recently by Paul Ekman, Ph.D., of the University of California Medical School at San Francisco, who enlarged Darwin’s observations, using more sophisticated methods.2,3 Traveling to exotic locations such as Papua New Guinea where the residents had little contact with outsiders, Ekman showed the natives photographs of people expressing anger, happiness, disgust, surprise, sadness, and fear and asked them to say what emotion was being expressed. He found wide general agreement in the emotions identified, which he interpreted as meaning “our evolution gives us universal expressions, which tell others some important information about us.” In these universal signals we are able to read another’s emotions, attitudes, and truthfulness. Of course, exceptions abound, such as the everyday deceptions put forward for our benefit by, for example, actors on stage and salespeople who have learned to mimic genuine facial expressions. Although culture shapes the nuances of facial expressions, nature seems to endow us with a limited number of basic emotions and ways to convey them, much like a language, which is basically the same everywhere it is used but is subject to local dialects.

LEARNING FROM FACE BLINDNESS

If nature has furnished us with special adaptive skills for facial expression, how are these skills manifested in our brains? Do we have neural systems just for reading faces? Both clinical medicine and cognitive neuroscience can help to answer these questions. 

Since ancient times, physicians noticed that some patients exhibit a type of visual agnosia (a-gnosis, “non-knowledge”) in which visual information in general is not understood. Related to this problem is another more specialized condition in which a person is unable to process facial information. The 19th-century French neurologist Jean Martin Charcot recognized a type of “face blindness” in an otherwise healthy person who had difficulty recognizing a close friend by his face. In the mid-20th century, this disorder was given the name “prosopagnosia,” which literally means “facial non-knowledge.” 

In classic cases of prosopagnosia, the person’s behavior is striking. He notes and understands all other types of sensory information—such as what type of perfume someone might be wearing, what color scarf she has on, and the sound of her voice— yet, cannot recognize even a close relative by that person’s face. One celebrated case of prosopagnosia is reported by the physician Oliver Sacks, M.D., in his popular book The Man Who Mistook His Wife for a Hat.4 Sacks’s patient could recognize his wife if she wore a well-known hat or some other familiar item, but, by facial information alone, he was mystified as to the identity of this nice lady visitor. 

Prosopagnosia’s narrow and specific deficit suggested to scientists that either a specialized part of the brain was involved in facial perception or some general impairment existed in the way the brain put together perceptual components to compose the gestalt of an object such as a face. A first hypothesis was that prosopagnosia was caused by brain lesions, trauma, or damage to the temporal lobe. We now know that the neurologic reason for this selective blindness is that a cluster of specialized cortical cells vital for facial processing are damaged, making normal facial identification difficult but sparing vision for other things (such as a hat). Scientists learned through postmortem examinations and, more recently, neuroimaging studies that a specialized part of the right hemisphere is involved in facial processing. We can understand this better by looking at how visual information in general is processed by the brain.*  

 

 art_v6n3solso_5

A normal view of a face (top), and the same face as a prosopagnosiac might see it. Anne Solso, courtesy of Robert L. Solso

VISUAL PROCESSING IN THE BRAIN

Understanding the neuronal pathways involved in vision—from the eye to the brain to the achievement of object recognition—once seemed terribly complicated, engaging a multitude of perceptual and cognitive elements. Now, we have a good overview of this visual processing system. It begins when sensory information from the eye enters the primary visual cortex in the posterior part of the brain, activating a series of neurons upward in the dorsal stream and downward in the ventral stream. Each pathway has a distinct function in processing. The dorsal stream largely identifies where an object is; the ventral stream is involved in identifying what an object is. In the ventral stream, forms, colors, and faces are found. We call this process “the streaming of visual information,” although the metaphor of streams is an oversimplification of a brain teeming with cross-circuit communication in which object identification and the rules of processing are intricately entwined.

 

 art_v6n3solso_6
Some areas of the brain show increases in blood flow, indicating stepped-up activity, when we process visual information. Information travels from the primary visual cortex, labeled PVC, in two streams, dorsal (“where”) and ventral (“what”). The red areas, especially the fusiform gyrus, are most active in recognizing faces. Anne Solso, courtesy of Robert L. Solso

On the hilly topography of the brain is a region called the occipitotemporal cortex, which processes visual information. Located within that region is a specific outcropping called the fusiform gyrus, or the fusiform facial area (FFA). By means of measuring regional cerebral blood with positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) scans, scientists have discovered that this part of the brain is active when people look at faces. The exact nature of the FFA is still being studied, with some researchers hypothesizing that faces are conceptualized as holistic configurations, while others suggest that faces are processed as a composite of features. 

This divergence of opinion is part of a larger debate in neuroscience. On one hand, it has been suggested that the brain consists of domain-specific modules that are specialized for carrying out explicit functions, such as processing sensory events (in this case, faces)—the so-called “Swiss Army knife” model. Others, however, argue that the brain consists of more general mechanisms that are broad enough to handle a variety of different processing operations (for example, faces but also other visual signals). Faces, according to this latter view, would acquire their special status through repeated exposure. The considerable evidence gathered using neuroimaging, specialized electroencephalograms, and other techniques to study the processing of faces and face facsimiles favors the domain-specific hypothesis: faces are unique and seem to occupy a distinct cerebral space or module. 

INVERTED FACES

Look at the face to the right. Do you recognize this popular figure? Now, turn the page and see how much easier it is to recognize him when the picture is upright.

 art_v6n3solso_7
Do you recognize this well-known person? © Douglas Kirkland / Corbis

This phenomenon is called the facial inversion effect. Because inverted faces convey the same information as upright faces— all features and relationships are identical, only the orientation differs—one might expect similar visual processing patterns and cerebral involvement. But experiments show that different cortical locations are involved in processing inverted faces, providing further evidence that the FFA is a module dedicated to the processing of upright faces. Frank Tong, Ph.D., showed subjects a series of upright and inverted faces and objects similar to the ones below and used fMRI to measure cerebral blood flow, an indication of neurologic activity.5 Looking at the upright faces produced a considerable increase in cerebral blood flow, whereas the inverted cartoon of Mickey Mouse and the cow produced less activity. 

 v6n3cartoon
These upright and inverted figures were used to test brain activity when recognizing faces. Both upright faces on the left showed increased blood flow to the FFA, while the inverted Mickey Mouse and the cow on the right did not. Courtesy of Robert L. Solso

Curiously, people with prosopagnosia tend to do relatively better identifying inverted faces than upright ones, which suggests that upright normally viewed faces are processed by a different cluster of neurons than are inverted faces. Processing inverted faces seems similar to processing other complex visual stimuli, for example, a painting of a pastoral scene by Monet— that is, it appears to involve a partial decomposition of a whole face into components. 

 art_v6n3solso_9
Notice how much easier it is to recognize a face, in this case Arnold Schwartzenegger, when it is presented in an upright position. © Douglas Kirkland / Corbis

Further evidence that upright faces are processed by a specialized brain module, while inverted faces are processed by an analysis of components, is found in the “Thatcher Effect,” so called because a particularly off-putting picture of the former prime minister of Britain was used in an experiment that demonstrated it. Here, we illustrate the effect below with Tom Cruise. At first glance, there is nothing peculiar about this picture, but, if you turn it right side up, you will see it is grotesque.

 art_v6n3solso_10
Invert this picture of Tom Cruise for a startling view. © Peter Kramer / Getty Images

INSIDE THE ARTIST’S MIND

The depiction of human faces has been a theme of artists from ancient Egyptian wall paintings, to early Hebrew and Christian representations, to Renaissance portraits, to modern abstract paintings. Some contemporary artists present us with distorted faces such as the disturbing portrait by Francis Bacon on the next page. This “face” stymies our psychological need to understand the emotion being conveyed as well as processing by the neurologic cluster in our brain’s FFA to make sense of what we see. In frustrating our normal propensity to understand and process, Bacon forces us to look deeper into the picture. 

 art_v6n3solso_11

Francis Bacon distorts the most important part of this painting, Study of a Man Talking (1981). Looking at the man’s disfigured face, we are baffled as to who he is and what he might be thinking or saying.

Francis Bacon, Study of a Man Talking, 1981. Oil on canvas, 78 x 58 inches. Hess Collection, Napa (California), Bern, © 2004
Estate of Francis Bacon / Artists Rights Society (ARS), New York

We know little about the way an artist’s brain works while painting a face—although, if attention to faces involves increased blood flow to the FFA, then common sense would tell us that artists throughout the ages must have experienced a veritable flood in that brain region. Although facial perception is associated with increased blood flow to the FFA, expert facial artists may actually show less blood flow as contrasted with novice painters. 

 art_v6n3solso_12

Here we see the stages of visual-cerebral processing when we look at Raphael’s Madonna of the Meadow (1506). First, we focus on different parts of the painting such as the faces, colors, forms, and perspective. These visual images are initially processed by the primary visual cortex in the rear of the brain and are then routed dorsally and vertically. Form, color, and faces (see Mary’s face) appear to be processed in the vertical stream.[top]

 Kunsthistorisches Museum, Vienna, Austria © Erich Lessing / Art Resource, NY, [bottom] Anne Solso, courtesy of Robert L. Solso

Consider a famous artist such as Raphael, arguably the most important portrait painter of the Renaissance. What cerebral activity might be going on as he composed Madonna of the Meadow (1506)? From recent discoveries in cognitive neuroscience, it is possible to recreate the activity of Raphael’s brain as well as the activity of those who view this classic piece of art. 

Look first at the exquisite faces painted by Raphael. Now, consider the areas of the brain activated by various components of the painting. A visual scene is viewed bit-bybit as our eyes focus on one part and then move (in little jumps called “saccades”) to another point, and so on. In the case of Madonna of the Meadow, one might focus on the face of Mary, then on the colors, then on a geometric form, and then on cues to perspective, such as distance. Each of these features has specific loci in the cortex as shown in the dorsal (“where”) and the ventral (“what”) streams. Note the location of Mary’s face in the FFA. 

Although looking into Raphael’s brain with the use of modern imaging techniques is impossible, we can apply such techniques to today’s artists. Several years ago, I undertook a project called “The Artist’s Brain” to see what cerebral structures might be involved in the production of art. Initially, I tested the feasibility of the study by modifying an MRI machine so I could copy a portrait of a face while having my brain scanned. The results indicated that successful data could be collected this way, and a detailed study was launched in which a leading portrait painter drew a series of faces while undergoing fMRI analysis. 

Humphrey Ocean, named by the National Portrait Gallery in London as one of the foremost portrait artists of the 20th century, consented to having his brain scanned as he drew a series of faces. Measures of his brain activity6 were contrasted with a control subject who had no particular training in art. The results are shown on the next page. It appears that a novice artist requires greater cerebral “effort,” as indicated by increased regional cerebral brain flow in the FFA than does an experienced portrait painter, who spends hours each day over years looking at and analyzing faces. Perhaps Ocean is so well practiced at facial perception that he is less likely than a novice to ponder the features and gestalt of a face. Furthermore, if Ocean’s brain is especially efficient at processing faces, he may be able to allocate more cerebral effort to deeper aspects of a person’s face. My preliminary results did indicate that Ocean showed greater activation in the right frontal area (see upper right two scans) than did the novice painter, which suggests that the expert painter used “higher order” cognitive processing. In effect, he could be “thinking” a face, as well as “seeing” it.

 art_v6n3solso_13
This sketch of a face was drawn by Humphrey Ocean while a functional magnetic resonance imaging (fMRI) scan of his brain was made. Courtesy of Robert L. Solso

 art_v6n3solso_14
Scans of Humphrey Ocean’s brain (top) show more activity in the right prefrontal cortex and less in the FFA (lower right of brain) while he draws a portrait than comparable scans of a non-artist. Courtesy of Robert L. Solso
 

THE IMPORTANT FUNCTION OF FACES

Our faces, which we take so much for granted as we shave or apply makeup each morning, are a powerful and privileged component of our nature, with an important role in evolution, social life, and art. For centuries, artists implicitly understood this significance of the face by arousing our perceptions and reactions with portraits of all kinds. With modern techniques we are now beginning to understand how the brain’s structure and operation reflect the centrality of faces in daily lives—a lesson first learned many thousands of years ago on the Serengeti Plains as early humans grappled with urgent issues of self-preservation based on the non-linguistic gestures of other humans. 

* Prosopagnosia and other disorders involving recognition of the self are also discussed elsewhere in this issue

References

  1. Darwin, C. The Expression of the Emotions in Man and Animals. New York. D. Appleton & Company, 1872: 115-145.
  2. Ekman, P, “Cross-Cultural Studies in Facial Expression.” In P. Ekman (Ed). Darwin and Facial Expressions: A Century of Research in Review. New York. Academic Press, 1973.
  3. Ekman, P. “Facial expressions.” In T. Dalgleish and M. Power (Eds). Handbook of cognition and emotion. New York. John Wiley & Sons, 1999.
  4. Sacks, O. The Man Who Mistook His Wife For a Hat. New York. Summit Books, 1985.
  5. Tong, E, Nakayama, K, Moscovitch, M, et al. “Response properties of the human fusiform face area.” Cognitive Neuropsychology 1999: 17: 257-279.
  6. Solso, RL. “The cognitive neuroscience of art: A preliminary fMRI observation.” Journal of Consciousness Studies 2000, 7: 75-85.



About Cerebrum

 
Bill Glovin, editor
Carolyn Asbury, Ph.D., consultant

Scientific Advisory Board
Joseph T. Coyle, M.D., Harvard Medical School
Kay Redfield Jamison, Ph.D., The Johns Hopkins University School of Medicine
Pierre J. Magistretti, M.D., Ph.D., University of Lausanne Medical School and Hospital
Robert Malenka, M.D., Ph.D., Stanford University School of Medicine
Bruce S. McEwen, Ph.D., The Rockefeller University
Donald Price, M.D., The Johns Hopkins University School of Medicine

Do you have a comment or question about something you've read in CerebrumContact Cerebrum Now.