HIGH-LEVEL FUZZY LINGUISTIC FEATURES OF FACIAL COMPONENTS IN HUMAN EMOTION RECOGNITION

Authors

  • Dewi Yanti Liliana Universitas Indonesia
  • Tarzan Basaruddin, Professor Universitas Indonesia
  • Muhammad Rahmat Widyanto, DR. Universitas Indonesia
  • Imelda Ika Dian Oriza, DR. Universitas Indonesia

DOI:

https://doi.org/10.32890/jict2020.19.1.5

Keywords:

Basic emotion, emotion recognition, facial expression, facial component, fuzzy system, high-level linguistic features

Abstract

Emotion is an important element in an interaction since it conveys Emotion is an important element in an interaction since it conveys human perception and response of an event. Unlike verbal words that can be manipulated, emotion is brief, spontaneous and provides more honest information. There are several classes of basic primary human emotions that differ from one another. These classes are happy, sad, fearful, surprised, disgusted, and angry. Meanwhile, a psychologist has developed a set of rules to recognize emotions based on facial expressions. This research aims to develop an artificial intelligent model based on psychological knowledge to recognize emotions by analyzing facial expressions. Moreover, the proposed model has defined high-level fuzzy linguistic features of facial components which distinguish it from existing methods that commonly use low-level image features (e.g. color, intensity, histogram, texture). High-level linguistic features (e.g. opened eyes, wrinkled nose) are better at representing human minds than low-level features which are only understood by machines. The model functions by detecting facial points first to locate important facial components; then extracting geometric facial components features which are then applied to a fuzzy facial components features which are then applied to a fuzzy facial components inference system resulting in high-level linguistic facial features. In the last step, the high-level linguistic features are applied to a fuzzy emotion inference system which classifies the input image into its respective emotion class based on psychological rules. Experiments conducted using facial expression dataset gave a high accuracy rate of 98.26% for fuzzy facial components linguistic identification. The proposed model also outperformed other classifiers (Fuzzy C-Means, Fuzzy Inference System, and Support Vector Machine). This intelligent model can contribute in various fields, including psychology, health, and education, especially in helping people with emotional disorders (e.g.Alexithymia, Asperger syndrome, and Autism) to recognize emotions.

 

Metrics

Metrics Loading ...

Author Biographies

Tarzan Basaruddin, Professor, Universitas Indonesia

Professor at Faculty of Computer Science, Universitas Indonesia

Muhammad Rahmat Widyanto, DR., Universitas Indonesia

Faculty of Computer Science, Universitas Indonesia

Imelda Ika Dian Oriza, DR., Universitas Indonesia

Faculty of Psychology, Universitas Indonesia

Additional Files

Published

23-12-2019

How to Cite

Liliana, D. Y., Basaruddin, T., Widyanto, M. R., & Oriza, I. I. D. (2019). HIGH-LEVEL FUZZY LINGUISTIC FEATURES OF FACIAL COMPONENTS IN HUMAN EMOTION RECOGNITION. Journal of Information and Communication Technology, 19(1), 103–129. https://doi.org/10.32890/jict2020.19.1.5