Facial Action Coding System

Muscles of head and neck.

Facial Action Coding System (FACS) is a system to taxonomize human facial movements by their appearance on the face, based on a system originally developed by a Swedish anatomist named Carl-Herman Hjortsjö.[1] It was later adopted by Paul Ekman and Wallace V. Friesen, and published in 1978.[2] Ekman, Friesen, and Joseph C. Hager published a significant update to FACS in 2002.[3] Movements of individual facial muscles are encoded by FACS from slight different instant changes in facial appearance.[4] It is a common standard to systematically categorize the physical expression of emotions, and it has proven useful to psychologists and to animators. Due to subjectivity and time consumption issues, FACS has been established as a computed automated system that detects faces in videos, extracts the geometrical features of the faces, and then produces temporal profiles of each facial movement.[4]. The pioneer F-M Facial Action Coding System 3.0 (F-M FACS 3.0) [5] was created in 2018 by Dr. Freitas-Magalhães, and presents 4,000 segments in 4K, using 3D technology and automatic and real-time recognition (FaceReader 7.1).The F-M FACS 3.0 features 8 pioneering action units (AUs) and 22 pioneering tongue movements (TMs), in addition to functional and structural nomenclature [6].

Uses

Using FACS,[7] human coders can manually code nearly any anatomically possible facial expression, deconstructing it into the specific action units (AU) and their temporal segments that produced the expression. As AUs are independent of any interpretation, they can be used for any higher order decision making process including recognition of basic emotions, or pre-programmed commands for an ambient intelligent environment. The FACS Manual is over 500 pages in length and provides the AUs, as well as Ekman's interpretation of their meaning.

FACS defines AUs, which are a contraction or relaxation of one or more muscles. It also defines a number of Action Descriptors, which differ from AUs in that the authors of FACS have not specified the muscular basis for the action and have not distinguished specific behaviors as precisely as they have for the AUs.

For example, FACS can be used to distinguish two types of smiles as follows:[8]

Although the labeling of expressions currently requires trained experts, researchers have had some success in using computers to automatically identify FACS codes, and thus quickly identify emotions.[9] Computer graphical face models, such as CANDIDE or Artnatomy, allow expressions to be artificially posed by setting the desired action units.

The use of FACS has been proposed for use in the analysis of depression,[10] and the measurement of pain in patients unable to express themselves verbally.[11]

FACS is designed to be self-instructional. People can learn the technique from a number of sources including manuals and workshops,[12] and obtain certification through testing.[13] The original FACS has been modified to analyze facial movements in several non-human primates, namely chimpanzees,[14] rhesus macaques,[15] gibbons and siamangs,[16] and orangutans.[17] More recently, it was adapted for a domestic species, the dog.[18]

Thus, FACS can be used to compare facial repertoires across species due to its anatomical basis. A study conducted by Vick and others (2006) suggests that FACS can be modified by taking differences in underlying morphology into account. Such considerations enable a comparison of the homologous facial movements present in humans and chimpanzees, to show that the facial expressions of both species result from extremely notable appearance changes. The development of FACS tools for different species allows the objective and anatomical study of facial expressions in communicative and emotional contexts. Furthermore, a cross-species analysis of facial expressions can help to answer interesting questions, such as which emotions are uniquely human.[19]

EMFACS (Emotional Facial Action Coding System)[20] and FACSAID (Facial Action Coding System Affect Interpretation Dictionary)[21] consider only emotion-related facial actions. Examples of these are:

EmotionAction units
Happiness6+12
Sadness1+4+15
Surprise1+2+5B+26
Fear1+2+4+5+7+20+26
Anger4+5+7+23
Disgust9+15+16
ContemptR12A+R14A

Codes for action units

For clarification, FACS is an index of facial expressions, but does not actually provide any bio-mechanical information about the degree of muscle activation. Though muscle activation is not part of FACS, the main muscles involved in the facial expression have been added here for the benefit of the reader.

Action units (AUs) are the fundamental actions of individual muscles or groups of muscles.

Action descriptors (ADs) are unitary movements that may involve the actions of several muscle groups (e.g., a forward‐thrusting movement of the jaw). The muscular basis for these actions hasn't been specified and specific behaviors haven't been distinguished as precisely as for the AUs.

For most accurate annotation, FACS suggests agreement from at least two independent certified FACS encoders.

Intensity scoring

Intensities of FACS are annotated by appending letters A–E (for minimal-maximal intensity) to the action unit number (e.g. AU 1A is the weakest trace of AU 1 and AU 1E is the maximum intensity possible for the individual person).

  • A Trace
  • B Slight
  • C Marked or pronounced
  • D Severe or extreme
  • E Maximum

Other letter modifiers

There are other modifiers present in FACS codes for emotional expressions, such as "R" which represents an action that occurs on the right side of the face and "L" for actions which occur on the left. An action which is unilateral (occurs on only one side of the face) but has no specific side is indicated with a "U" and an action which is unilateral but has a stronger side is indicated with an "A."

List of action units and action descriptors (with underlying facial muscles)

Main codes

AU numberFACS nameMuscular basis
0Neutral face
1Inner brow raiserfrontalis (pars medialis)
2Outer brow raiserfrontalis (pars lateralis)
4Brow lowererdepressor glabellae, depressor supercilii, corrugator supercilii
5Upper lid raiserlevator palpebrae superioris, superior tarsal muscle
6Cheek raiserorbicularis oculi (pars orbitalis)
7Lid tightenerorbicularis oculi (pars palpebralis)
8Lips toward each otherorbicularis oris
9Nose wrinklerlevator labii superioris alaeque nasi
10Upper lip raiserlevator labii superioris, caput infraorbitalis
11Nasolabial deepenerzygomaticus minor
12Lip corner pullerzygomaticus major
13Sharp lip pullerlevator anguli oris (also known as caninus)
14Dimplerbuccinator
15Lip corner depressordepressor anguli oris (also known as triangularis)
16Lower lip depressordepressor labii inferioris
17Chin raisermentalis
18Lip puckerincisivii labii superioris and incisivii labii inferioris
19Tongue show
20Lip stretcherrisorius w/ platysma
21Neck tightenerplatysma
22Lip funnelerorbicularis oris
23Lip tightenerorbicularis oris
24Lip pressororbicularis oris
25Lips partdepressor labii inferioris, or relaxation of mentalis or orbicularis oris
26Jaw dropmasseter; relaxed temporalis and internal pterygoid
27Mouth stretchpterygoids, digastric
28Lip suckorbicularis oris

Head movement codes

AU numberFACS nameAction
51Head turn left
52Head turn right
53Head up
54Head down
55Head tilt left
M55Head tilt leftThe onset of the symmetrical 14 is immediately preceded or accompanied by a head tilt to the left.
56Head tilt right
M56Head tilt rightThe onset of the symmetrical 14 is immediately preceded or accompanied by a head tilt to the right.
57Head forward
M57Head thrust forwardThe onset of 17+24 is immediately preceded, accompanied, or followed by a head thrust forward.
58Head back
M59Head shake up and downThe onset of 17+24 is immediately preceded, accompanied, or followed by an up-down head shake (nod).
M60Head shake side to sideThe onset of 17+24 is immediately preceded, accompanied, or followed by a side to side head shake.
M83Head upward and to the sideThe onset of the symmetrical 14 is immediately preceded or accompanied by a movement of the head, upward and turned and/or tilted to either the left or right.

Eye movement codes

AU numberFACS nameAction
61Eyes turn left
M61Eyes leftThe onset of the symmetrical 14 is immediately preceded or accompanied by eye movement to the left.
62Eyes turn right
M62Eyes rightThe onset of the symmetrical 14 is immediately preceded or accompanied by eye movement to the right.
63Eyes up
64Eyes down
65Walleye
66Cross-eye
M68Upward rolling of eyesThe onset of the symmetrical 14 is immediately preceded or accompanied by an upward rolling of the eyes.
69Eyes positioned to look at other personThe 4, 5, or 7, alone or in combination, occurs while the eye position is fixed on the other person in the conversation.
M69Head and/or eyes look at other personThe onset of the symmetrical 14 or AUs 4, 5, and 7, alone or in combination, is immediately preceded or accompanied by a movement of the eyes or of the head and eyes to look at the other person in the conversation.

Visibility codes

AU numberFACS name
70Brows and forehead not visible
71Eyes not visible
72Lower face not visible
73Entire face not visible
74Unsociable

Gross behavior codes

These codes are reserved for recording information about gross behaviors that may be relevant to the facial actions that are scored.

AU numberFACS nameMuscular basis
29Jaw thrust
30Jaw sideways
31Jaw clenchermasseter
32[Lip] bite
33[Cheek] blow
34[Cheek] puff
35[Cheek] suck
36[Tongue] bulge
37Lip wipe
38Nostril dilatornasalis (pars alaris)
39Nostril compressornasalis (pars transversa) and depressor septi nasi
40Sniff
41Lid droopLevator palpebrae superioris (relaxation)
42SlitOrbicularis oculi muscle
43Eyes closedRelaxation of Levator palpebrae superioris
44SquintCorrugator supercilii and orbicularis oculi muscle
45BlinkRelaxation of Levator palpebrae superioris; contraction of orbicularis oculi (pars palpebralis)
46Winkorbicularis oculi
50Speech
80Swallow
81Chewing
82Shoulder shrug
84Head shake back and forth
85Head nod up and down
91Flash
92Partial flash
97*Shiver/tremble
98*Fast up-down look

See also

References

  1. Hjorztsjö, CH (1969). Man's face and mimic language. free download: Carl-Herman Hjortsjö, Man's face and mimic language"
  2. P. Ekman and W. Friesen. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, 1978.
  3. Paul Ekman, Wallace V. Friesen, and Joseph C. Hager. Facial Action Coding System: The Manual on CD ROM. A Human Face, Salt Lake City, 2002.
  4. 1 2 Hamm, J.; Kohler, C. G.; Gur, R. C.; Verma, R. (2011). "Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders". Journal of Neuroscience Methods. 200 (2): 237–256. doi:10.1016/j.jneumeth.2011.06.023. PMC 3402717. PMID 21741407.
  5. Freitas-Magalhães, A. (2018). Facial Action Coding System 3.0: Manual of Scientific Codification of the Human Face. Porto: FEELab Science Books. ISBN 978-989-8766-86-1.
  6. Freitas-Magalhães, A. (2018).Scientific measurement of the human face:F-M FACS 3.0 - pioneer and revolutionary. In A. Freitas-Magalhães (Ed.), Emotional expression: the Brain and the face (Vol. 10, pp. 21-94). Porto: FEELab Science Books. ISBN 978-989-8766-98-4
  7. Freitas-Magalhães, A. (2012). Microexpression and macroexpression. In V. S. Ramachandran (Ed.), Encyclopedia of Human Behavior (Vol. 2, pp. 173–183). Oxford: Elsevier/Academic Press. ISBN 978-0-12-375000-6
  8. Del Giudice, M.; Colle, L. (2007). "Differences between children and adults in the recognition of enjoyment smiles". Developmental Psychology. 43 (3): 796–803. doi:10.1037/0012-1649.43.3.796. PMID 17484588.
  9. Facial Action Coding System. Retrieved July 21, 2007.
  10. Reed, L. I.; Sayette, M. A.; Cohn, J. F. (2007). "Impact of depression on response to comedy: A dynamic facial coding analysis". Journal of Abnormal Psychology. 116 (4): 804–809. doi:10.1037/0021-843X.116.4.804. PMID 18020726.
  11. Lints-Martindale, A. C.; Hadjistavropoulos, T.; Barber, B.; Gibson, S. J. (2007). "A Psychophysical Investigation of the Facial Action Coding System as an Index of Pain Variability among Older Adults with and without Alzheimer's Disease". Pain Medicine. 8 (8): 678–689. doi:10.1111/j.1526-4637.2007.00358.x. PMID 18028046.
  12. Example and web site of one teaching professional: Erika L. Rosenberg, Ph.D
  13. Archived December 23, 2008, at the Wayback Machine.
  14. Parr, L. A.; Waller, B. M.; Vick, S. J.; Bard, K. A. (2007). "Classifying chimpanzee facial expressions using muscle action". Emotion. 7 (1): 172–181. doi:10.1037/1528-3542.7.1.172. PMC 2826116. PMID 17352572.
  15. Parr, L. A.; Waller, B. M.; Burrows, A. M.; Gothard, K. M.; Vick, S. J. (2010). "Brief communication: MaqFACS: A muscle-based facial movement coding system for the rhesus macaque". American Journal of Physical Anthropology. 143 (4): 625–630. doi:10.1002/ajpa.21401. PMC 2988871. PMID 20872742.
  16. Waller, B. M.; Lembeck, M.; Kuchenbuch, P.; Burrows, A. M.; Liebal, K. (2012). "GibbonFACS: A Muscle-Based Facial Movement Coding System for Hylobatids". International Journal of Primatology. 33 (4): 809. doi:10.1007/s10764-012-9611-6.
  17. Caeiro, C. T. C.; Waller, B. M.; Zimmermann, E.; Burrows, A. M.; Davila-Ross, M. (2012). "OrangFACS: A Muscle-Based Facial Movement Coding System for Orangutans (Pongo spp.)". International Journal of Primatology. 34: 115. doi:10.1007/s10764-012-9652-x.
  18. Waller, B. M.; Peirce, K.; Caeiro, C. C.; Scheider, L.; Burrows, A. M.; McCune, S.; Kaminski, J. (2013). "Paedomorphic Facial Expressions Give Dogs a Selective Advantage". PLoS ONE. 8 (12): e82686. doi:10.1371/journal.pone.0082686. PMC 3873274. PMID 24386109.
  19. Vick, S. J.; Waller, B. M.; Parr, L. A.; Smith Pasqualini, M. C.; Bard, K. A. (2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 1–20. doi:10.1007/s10919-006-0017-z. PMC 3008553. PMID 21188285.
  20. Friesen, W.; Ekman, P. (1983). EMFACS-7: Emotional Facial Action Coding System. Unpublished manual, University of California, California.
  21. Facial Action Coding System Affect Interpretation Dictionary (FACSAID)
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.