This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
|
Facial coding is the process of measuring human emotions through facial expressions. Emotions can be detected by computer algorithms for automatic emotion recognition that record facial expressions via webcam. This can be applied to better understanding of people’s reactions to visual stimuli.
History
editIn 1872, Charles Darwin published The Expression of the Emotions in Man and Animals. In this book, he compared numerous images of humans and animals in different emotional states and suggested that some basic emotions, like anger, fear and sadness, are universal and present across ethnicities, cultures and even species. According to Darwin, facial expressions were inborn (not learned) and common to humans and animals (some human characteristics like clenching teeth in anger or tears in eyes when sad have animal origin).[1][2][3]
Despite Darwin’s theory, in 1950 the prevailing belief was that facial expressions were determined by cultural background and learning process. In 1960s, Paul Ekman an American psychologist, set out to visit people from different nations (including an isolated indigenous tribe in Papua New Guinea) to study non-verbal behavior across cultures. His research supported Darwin's findings–that facial expressions and emotions are universal–as people from diverse cultural backgrounds had similar interpretations of expressions in photo. Ekman’s work indicated the existence of 7 basic emotions: happiness, surprise, fear, anger, disgust, sadness, and neutral.[4][5][6]
In 1978 Ekman and Friesen updated Facial Action Coding System (FACS), originally developed by a Swedish anatomist Carl-Herman Hjortsjö.[7][8] FACS is a tool for classification of all facial expressions that humans can make. Each component of facial movement is called an action unit (AU) and all facial expressions can be broken down to action units. Ekman and Friesen identified 46 different units to describe each facial movement.[9][10][11]
Technology
editThe computer algorithm for facial coding extracts the main features of face (mouth, eyebrows etc.) and analyzes movement, shape and texture composition of these regions to identify facial action units. Therefore, it is possible to track tiny movements of facial muscles in individuals’ face and translate them into universal facial expressions that convey happiness, surprise, sadness, anger and others. An algorithm developed by EyeSee can detect the following seven emotions: happiness, surprise, puzzle, disgust, fear, sadness and neutral.
Outcomes
editThe results of facial coding provide insight into viewers’ spontaneous, unfiltered reactions to visual content, by recording and automatically analyzing facial expressions during the process. It enables moment-by-moment emotional and cognitive metrics. Facial expressions are tracked in real time using key points on the viewer’s face to recognize a rich array of both emotional and cognitive states such as enjoyment, attention and confusion. Many of the users’ responses are so quick and fleeting that viewers may not even remember them, let alone be able to objectively report about them.
Application
editProgress in facial coding technology and its accessibility enabled application in the field of market research. It can be used to test marketing communication such as advertising, shopper and digital campaigns. Respondents are exposed to visual stimuli (TV Commercial, Animatic, Pre-roll, Website, DM etc.) while algorithm registers and records their facial expressions via their webcam. The obtained data can be analyzed and results indicate valence over time, engagement level, emotional peaks and possibilities for improvement. Some companies complete this type of research internally, while others engage private companies specialized in facial coding services such as Affectiva, Realeyes and EyeSee.
References
edit- ^ C. Darwin, The expression of the Emotions in Man and Animals. J. Murray, London. (1872)
- ^ Dalgleish, Tim (July 2004). “The emotional brain”. www.nature.com. Retrieved October 6, 2015.
- ^ Jabr, Ferris (May 24, 2010). “The evolution of emotion: Charles Darwin's little-known psychology experiment”.Scientific American. Retrieved October 6, 2015.
- ^ "Paul Ekman". Paul Ekman Group, LLC. Retrieved April 3, 2016.
- ^ P. Ekman, Universal Facial Expressions of Emotion. California Mental Health Research Digest, Vol. 8. (1970)
- ^ P. Ekman, Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life, Times Books. (2003)
- ^ Hjortsjö, CH (1969). Man's face and mimic language Archived 2022-08-06 at the Wayback Machine.
- ^ Hjortsjö, CH (1969). Man's face and mimic language.
- ^ P. Ekman, W.V. Friesen, Facial Action Coding System Investigator’s Guide, Consulting Psychologist Press. Palo Alto, CA. (1978)
- ^ Facial Action Coding System. Retrieved October 6, 2015.
- ^ Hamm, J.; Kohler, C. G.; Gur, R. C.; Verma, R. (2011). "Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders". Journal of Neuroscience Methods. Retrieved October 6, 2015.