The recent boom of mass media communication (such as social media and mobiles) has boosted more applications of automatic facial expression recognition (FER). Thus, human facial expressions have to be encoded and recognized through digital devices. However, this process has to be done under recurrent problems of image illumination changes and partial occlusions. Therefore, in this paper, we propose a fully automated FER system based on Local Fourier Coefficients and Facial Fourier Descriptors. The combined power of appearance and geometric features is used for describing the specific facial regions of eyes-eyebrows, nose and mouth. All based on the attributes of the Fourier Transform and Support Vector Machines. Hence, our proposal overcomes FER problems such as illumination changes, partial occlusion, image rotation, redundancy and dimensionality reduction. Several tests were performed in order to demonstrate the efficiency of our proposal, which were evaluated using three standard databases: CK+, MUG and TFEID. In addition, evaluation results showed that the average recognition rate of each database reaches higher performance than most of the state-of-the-art techniques surveyed in this paper.
References
[1]
Ekman, P. (1972) Universal and Cultural Differences in Facial Expression of Emotion. Proceeding of Symposium on Motivation, Nebraska University Press, Lincoln, Nebraska, 19, 9-15.
[2]
Tian, Y., Kanade, T. and Cohn, J.F. (2011) Facial Expression Recognition. In: Li, S.Z. and Jain, A.K., Eds., Handbook of Face Recognition, Springer, London, 487-519. https://doi.org/10.1007/978-0-85729-932-1_19
[3]
Sariyanidi, E., Gunes, H. and Cavallaro, A. (2015) Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 1113-1133.
https://doi.org/10.1109/TPAMI.2014.2366127
[4]
Deshmukh, S., Patwardhan, M. and Mahajan, A. (2016) Survey on Real-Time Facial Expression Recognition Techniques. IET Biometrics, 6, 155-163.
[5]
Li, Z., Imai, J.I. and Kaneko, M. (2010) Facial Expression Recognition Using Facial-Component-Based Bag of Words and PHOG Descriptors. Journal of ITE, 64, 230-236. https://doi.org/10.3169/itej.64.230
[6]
Gu, W., Xiang, C., Venkatesh, Y.V., Huang, D. and Lin, H. (2012) Facial Expression Recognition Using Radial Encoding of Local Gabor Features and Classifier Synthesis. Pattern Recognition, 45, 80-91. https://doi.org/10.1016/j.patcog.2011.05.006
[7]
Rahulamathavan, Y., Phan, R.C.W., Chambers, J.A. and Parish, D.J. (2013) Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis. IEEE Transactions on Affective Computing, 4, 83-92.
https://doi.org/10.1109/T-AFFC.2012.33
[8]
Shan, C., Gong, S. and McOwan, P.W. (2009) Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study. Image and Vision Computing, 27, 803-816. https://doi.org/10.1016/j.imavis.2008.08.005
[9]
Lopes, A.T., de Aguiar, E., De Souza, A.F. and Oliveira-Santos, T. (2017) Facial Expression Recognition with Convolutional Neural Networks: Coping with Few Data and the Training Sample Order. Pattern Recognition, 61, 610-628.
https://doi.org/10.1016/j.patcog.2016.07.026
[10]
Pu, X., Fan, K., Chen, X., Ji, L. and Zhou, Z. (2015) Facial Expression Recognition from Image Sequences Using Twofold Random Forest Classifier. Neurocomputing, 168, 1173-1180. https://doi.org/10.1016/j.neucom.2015.05.005
[11]
Ghimire, D., Lee, J., Li, Z.N. and Jeong, S. (2017) Recognition of Facial Expressions Based on Salient Geometric Features and Support Vector Machines. Multimedia Tools and Applications, 76, 7921-7946. https://doi.org/10.1007/s11042-016-3428-9
[12]
Jain, S., Hu, C. and Aggarwal, J.K. (2011) Facial Expression Recognition with Temporal Modeling of Shapes. Proceedings of 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 6-13 November 2011, Barcelona, 1642-1649. https://doi.org/10.1109/ICCVW.2011.6130446
[13]
Maximiano da Silva, F.A. and Pedrini, H. (2016) Geometrical Features and Active Appearance Model Applied to Facial Expression Recognition. International Journal of Image and Graphics, 16, 17. https://doi.org/10.1142/S0219467816500194
[14]
Jung, H., Lee, S., Yim, J., Park, S. and Kim, J. (2015) Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, 7-13 December 2015, 2983-2991. https://doi.org/10.1109/ICCV.2015.341
[15]
Ghimire, D., Jeong, S., Lee, J. and Park, S.H. (2016) Facial Expression Recognition Based on Local Region Specific Features and Support Vector Machines. Multimedia Tools and Applications, 76, 7803-7821. https://doi.org/10.1007/s11042-016-3418-y
[16]
Kanade, T., Cohn, J.F. and Tian, Y. (2000) Comprehensive Database for Facial Expression Analysis. Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), Washington DC, 28-30 March 2000, 46-53. https://doi.org/10.1109/AFGR.2000.840611
[17]
Aifanti, N., Papachristou, C. and Delopoulos, A. (2010) The MUG Facial Expression Database. Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano, 12-14 April 2010, 1-4.
[18]
Chen, L.F. and Yen, Y.S. (2007) Taiwanese Facial Expression Image Database. Brain Mapping Laboratory, Institute of Brain Science, National Yang-Ming University, Taipei.
[19]
Benitez-Garcia, G., Nakamura, T. and Kaneko, M. (2017) Methodical Analysis of Western-Caucasian and East-Asian Basic Facial Expressions of Emotions Based on Specific Facial Regions. Journal of Signal and Information Processing, 8, 78-98.
https://doi.org/10.4236/jsip.2017.82006
[20]
Yi, J., Mao, X., Chen, L., Xue, Y. and Compare, A. (2014) Facial Expression Recognition Considering Individual Differences in Facial Structure and Texture. IET Computer Vision, 8, 429-440. https://doi.org/10.1049/iet-cvi.2013.0171
[21]
Asthana, A., Zafeiriou, S., Cheng, S. and Pantic, M. (2014) Incremental Face Alignment in The Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 1859-1866.
[22]
Chrysos, G.G., Antonakos, E., Snape, P., Asthana, A. and Zafeiriou, S. (2016) A Comprehensive Performance Evaluation of Deformable Face Tracking “In-the-Wild”. International Journal of Computer Vision, 1-35.
https://doi.org/10.1007/s11263-017-0999-5
[23]
Hwang, W., Wang, H., Kim, H., Kee, S.C. and Kim, J. (2011) Face Recognition System Using Multiple Face Model of HYBRID FOURIER FEATURE under Uncontrolled Illumination Variation. IEEE Transactions on Image Processing, 20, 1152-1165. https://doi.org/10.1109/TIP.2010.2083674
[24]
Benitez-Garcia, G., Olivares-Mercado, J., Sanchez-Perez, G., Nakano-Miyatake, M. and Perez-Meana, H. (2013) A Sub-Block-Based Eigenphases Algorithm with Optimum Sub-Block Size. Knowledge-Based Systems, 37, 415-426.
https://doi.org/10.1016/j.knosys.2012.08.023
[25]
Benitez-Garcia, G., Sanchez-Perez, G., Perez-Meana, H., Takahashi, K. and Kaneko, M. (2014) Facial Expression Recognition Based on Facial Region Segmentation and Modal Value Approach. IEICE Transactions on Information and Systems, 97, 928-935. https://doi.org/10.1587/transinf.E97.D.928
[26]
Rahtu, E., Heikkila, J., Ojansivu, V. and Ahonen, T. (2012) Local Phase Quantization for Blur-Insensitive Image Analysis. Image and Vision Computing, 30, 501-512. https://doi.org/10.1016/j.imavis.2012.04.001
[27]
Mohammadi, M.R., Fatemizadeh, E. and Mahoor, M.H. (2014) PCA-Based Dictionary Building for Accurate Facial Expression Recognition via Sparse Representation. Journal of Visual Communication and Image Representation, 25, 1082-1092.
https://doi.org/10.1016/j.jvcir.2014.03.006
[28]
Chang, C.C. and Lin, C.J. (2011) LIBSVM: A Library for Support Vector Machines. ACM Transactions on Intelligent Systems and Technology (TIST), 2, 1-27.
https://doi.org/10.1145/1961189.1961199
[29]
Wei, W. and Jia, Q. (2016) Weighted Feature Gaussian Kernel SVM for Emotion Recognition. Computational Intelligence and Neuroscience, 2016, 11-17.
https://doi.org/10.1155/2016/7696035
[30]
da Silva, F.A.M. and Pedrini, H. (2015) Effects of Cultural Characteristics on Building an Emotion Classifier through Facial Expression Analysis. Journal of Electronic Imaging, 24, Article ID: 0230151. https://doi.org/10.1117/1.JEI.24.2.023015
[31]
Goyani, M. and Patel, N. (2017) Multi-Level Haar Wavelet Based Facial Expression Recognition Using Logistic Regression. Indian Journal of Science and Technology, 10, 1-9. https://doi.org/10.17485/ijst/2017/v10i9/108944
[32]
Farajzadeh, N., Pan, G. and Wu, Z. (2014) Facial Expression Recognition Based on Meta Probability Codes. Pattern Analysis & Applications, 17, 763-781.
https://doi.org/10.1007/s10044-012-0315-5
[33]
Ashir, A.M. and Eleyan, A. (2017) Facial Expression Recognition Based on Image Pyramid and Single-Branch Decision Tree. Signal, Image and Video Processing, 1-8. https://doi.org/10.1007/s11760-016-1052-9
[34]
Kung, H.W., Tu, Y.H. and Hsu, C.T. (2015) Dual Subspace Nonnegative Graph Embedding for Identity-Independent Expression Recognition. IEEE Transactions on Information Forensics and Security, 10, 626-639.
https://doi.org/10.1109/TIFS.2015.2390138
[35]
Zhang, L., Tjondronegoro, D. and Chandran, V. (2014) Random Gabor Based Templates for Facial Expression Recognition in Images with Facial Occlusion. Neurocomputing, 145, 451-464. https://doi.org/10.1016/j.neucom.2014.05.008
