The Quantification of Human facial expression Using Fuzzy
Logic.
Dileep M R 1
and Ajit Danti 2
N E S Research Foundation,
Department of Computer Applications,
Jawaharlal Nehru National College of Engineering, Shimoga, Karnataka, India
1
dileep.kurunimakki@gmail.com
2
ajitdanti@yahoo.com
Abstract: Fuzzy logic is an interesting theory that allows the natural description, in linguistic terms, of
problems that should be solved rather than in terms of relationships between precise numerical values. In
this paper, an effective approach is proposed that quantifies the human facial expression using Mamdani
implication based fuzzy logic system. The new technique involves in extracting mathematical data from
the face and fed to a fuzzy rule-based system. Fuzzification and Defuzzification operation issues
trapezoidal membership functions for both input and output. The distinct feature of a system is its
simplicity and high accuracy. Experimental results on Image dataset indicate good performance of the
proposed technique. Comparative analysis reveal that the proposed technique is uniqueness and robust
with reference to other state of the art methods.
In this paper, a legitimate procedure proposed for quantification of human facial expression
recognition from Facial features using Mamdani-type fuzzy system. It is Fuzzy Inference System (FIS),
which is capable to set up an easy membership relation between the different dimensions of the happy
expression. The FIS recognizes three levels of same happy expression namely No happy, Bit Smiley and
Loud Laugh based on membership function modeled on different psychological studies and surveys.
Index Terms – Fuzzy Rule, Quantification of Expression, Membership Function
1. INTRODUCTION
Facial expression is one of the most important subjects in the field of biometric,
which has wide range of applications such as Business, Managerial, Organizational, Cultural
contexts, Telecommunication, Medical, Human Computer Interactions (HCI). The ideal human
computer interaction system is the one that the computer is able to communicate and respond to
the user actions, based on emotional state of human's face. In this way the user will be able to
communicate with it more effectively. For this aim, automatic recognition of human's facial
expressions has been very active research area in machine vision within the last several years.
Facial expressions are generated by movement of face muscles that makes facial features such as
stretching corner lips, raising eyebrows, opening eyes, etc.
The traditional approach to building any system controllers requires a prior model of the
system. The quality of the model, that is, loss of precision from linearization and/or uncertainties
in the system’s parameters negatively influences the quality of the resulting control. At the same
time, methods of soft computing such as fuzzy logic possess non-linear mapping capabilities, do
not require an analytical model and can deal with uncertainties in the system’s parameters.
Although fuzzy logic deals with imprecise information, the information is processed in sound
mathematical theory. Based on the nature of fuzzy human thinking, Zadeh, originated the “fuzzy
logic” or “fuzzy set theory”, in 1965. Fuzzy logic deals with the problems that have fuzziness or
vagueness. In fuzzy set theory based on fuzzy logic a particular object has a degree of
membership in a given set that may be anywhere in the range of 0 (completely not in the set) to 1
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, August 2017
119 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
(completely in the set). For this reason fuzzy logic is often defined as multi-valued logic (0 to 1),
compared to bi-valued Boolean logic.
Facial expression process usually extract facial expression parameters from a static face
image. This process is called as “Quantification” of expression. These extracted features are
then fed to a classifier system for facial expression quantification by defining the range of
expression with their membership function. In this paper, a complete system for quantification of
facial expression i,e different range of happy faces is proposed. The core of our system is a
Mamdani-type Fuzzy Rule Based system which is used to quantify facial expression from facial
features. The comparison of proposed methodology with other state of the art methods is carried
out.
Aruna Chakraborty et al, 2009, introduced a method for emotion recognition from facial
expressions and its control using fuzzy logic, where the expressions of the human face would be
recognized by applying the fuzzy rule implementation. An effective application is invented by
B. K. Bose, 1994, about the expert systems, fuzzy logic, and neural network application in power
electronics and motion control. It was a multiple application system. Dae-Jin Kim and
Zeungnam Bien, 2003, developed an algorithm of Fuzzy Neural Networks (FNN) - based
approach for Personalized Facial Expression Recognition with Novel Feature Selection Method,
where this method was the combination of Artificial Neural Network and Fuzzy Inference
System. This method was used to recognize the different expressions of the human face. Dennis
Gillette and Ping Zhang did an effective survey on Human-Computer Interaction And
Management Information Systems: Applications. S. Dongcheng, J. Jieqing , 2010, introduced a
method of facial expression recognition based on DWT-PCA/LDA, the multiple application
approach. Esau N, et al, 2007, given an approach for Real-Time Facial Expression Recognition
using a Fuzzy Emotion Model, that effectively recognizes the emotions of the human face.
Francisco Herrera and Luis Magdalena, 1997, published a tutorial on genetic Fuzzy Systems
gives a detailed description on biological features of human faces using fuzzy logic. P. S.
Hiremath and Ajit Danti, 2005, developed a methodology on fuzzy-rule based method for human
face detection, that effectively detects the human faces by applying fuzzy inference system. A.
Jamshidnezhad, 2011, designed an approach that learns Fuzzy Model for Emotion Recognition
that recognizes the emotions of the human face. B. Jaychandra, simulated Speed Sensorless
Operation of Vector Controlled Induction Motor Using Neural Networks. Khanum A et al,
2009, contributed a research on Fuzzy case-based reasoning for facial expression recognition,
that efficiently recognizes the human facial expressions based on Fuzzy rule. G. Klir and B.
Yuan, 2010, published a study material on Fuzzy sets and Fuzzy Logic – Theory and
Applications, that gives a detailed description on the applications and usage of the fuzzy rule.
Kyoung- Man Lim et al, designed an algorithm for face recognition system using Fuzzy Logic
and Artificial neural network, that effectively recognizes the face in a given still image. S. Y.
Lee et al, 1996, introduced a method that recognizes the human front faces using knowledge
based feature extraction and neuro-fuzzy algorithm, a multiple application approach, that uses
geometrical facial features of the face along with Artificial neural networks plus fuzzy inference
systems. Maedeh Rasoulzadeh, 2012, did a research on facial expression recognition using
Fuzzy Inference System. Milki et al, 1991, designed an effective application for Vector control
of induction motor with fuzzy P-I controller. Muid Mufti and Assia Khanum, 1991, proposed an
approach on Fuzzy Rule-Based Facial Expression Recognition in a precise manner. Mufti M and
Khanam A, 2006, solved an unique problem on Fuzzy Rule Based Facial Expression
Recognition. M. Nasir Uddin, 2002, pursued a study on performances of Fuzzy-Logic-Based
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
120 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
Indirect Vector Control for Induction Motor Drive, an effective approach on fuzzy logic.
Ralescu A and Hartani R, 1995, studied some issues in Fuzzy and Linguistic Modeling. D. H.
Rao and S. S. Saraf, 2007, conducted a detailed study of Defuzzification Methods of Fuzzy
Logic Controller for Speed Control of a DC Motor.
Several researchers contributed their work on emotions, emoticon recognition using
facial expressions using fuzzy inference system and neural networks etc. namely M.S.Ratliff and
E. Patterson, 2008; T. A. Runkler, 1996; M. Schmidt et al, 2010; N.Sebe et al, 2005; Starostenko
O et al, 2010; TakKuen John Koo, 1996; T. Takagi and M. Sugeno, 1985; L. H. Tsoukalas and
R. E. Uhrig, 1997; Ushida H et al, 1993; M. Usman Akram, et al, 2008; V. P. Vishwakarma et al,
2010; T. Xiang et al, 2008;
1.1 Fuzzy Inference System
Fuzzy inference is the process of formulating the mapping from a given input faces to an
output facial expressions using fuzzy logic and membership function. In this paper, Mamdani's
fuzzy inference method is used and it expects the output membership functions to be fuzzy sets.
After the aggregation process and defuzzification, crisp decision is made on facial expression as
shown in Figure-1.
1.2 Face Database
The proposed methodology is experimented on database of the faces of people of
different dimensions of happy expressions viz Normal, Bit smiley and Loud Laugh. There are
1000 facial images in this database, among them 700 images were used for training and
remaining 300 images were used for testing purpose. Each image is normalized to a size of 64 ×
64 dimensions for optimum computational cost. Sample facial expression images are shown in
figure-2.
Figure-1:Fuzzy Inference System for facial expressions.
Expressions
Output
Faces
I
N
P
U
T
Fuzzification DefuzzificationRule Evaluation
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
121 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
The rest of this paper is organized as follows. The Proposed Methodology is explained in
Section 2. The Proposed Algorithm is described in section 3. In Section 4, Experimental results
are presented and Conclusions are drawn in section 5.
2. PROPOSED METHODOLOGY
This paper proposes an effective method for quantification of human facial expressions from
facial images. Block diagram of the proposed method is given in Figure-3.
Figure-3 :Block diagram of the proposed Methodology
The Proposed algorithm has been implemented to classify input images into one of three
happy expression using Mamdani-type Fuzzy Rule Based system In order to improve the
Figure-2: Samples of the facial images in the dataset
Input Face Image
Rule Evaluation
Fuzzification
Defuzzification
Expression
Recognition
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
122 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
efficiency of the performance, mean vector is obtained for each image is used in the fuzzy
inference system as shown infigure-1.
2.1Quantification of Facial Expressions
It is assumed that every human face is having the same geometrical configuration.
Feature extraction method uses the mean of the image as input to the fuzzy system. This
improves the efficiency of the performance. Geometrical features of the face are fed to mamdani-
type fuzzy system for quantification using trapezoidal membership functions. This system is
capable of quantifying 3 basic forms of happy expressions that are No Happy, Bit Smiley, Loud
Laugh as shown in Figure-4 & 5.
The output of the fuzzy system is defuzzified to depict either the given face is in happy,
or bit happy or loud laugh. This can be represented by the equation(1).
				 ≤ 													 ≤ ≤ b≤ ≤ b≤ ≤ d ≤ d
Figure-5 : Representation of Quantification of Happy Expression
Figure-5: Representation of Trapezoidal Membership Function
No Happy No Happy
Loud Laugh
a b c d
Bit Happy Bit Happy
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
123 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
, , , , =
0 ≤
−
−
≤ ≤
1 ≤ ≤ 	 ℎ
−
−
≤ ≤
0 ≥
(1)
Where a,b,c,d values are determined empirically for quantification of expression.
The experimental results of quantification of happy expressions are shown in the figure-6.
3. PROPOSED ALGORITHM
Proposed algorithm for expression quantification from the given image is as given below:
Input: Query face
Output: Quantification of happy expression into No happy, Bit happy or Loud laugh
Step 1: To Train: Input all n face images to the Fuzzy Inference System.
Step 2:Define the Trapezoidal membership function for different expressions and compute
membership values for a,b,c,d as shown in Figure 5
Step 3: To Test: Compute membership value x for the query face using equation (1)
Step 4: Evaluate facial expression using equation (1).
4. EXPERIMENTAL RESULTS
In this research, there are 1000 gray-scale facial images used for experiment in which 300
images are used as training data and the remaining are used as test images. Each image size is
normalized to 64×64 dimensions. The proposed Algorithm have shown good robustness and
The person is not happyThe person is not happyThe person is not happyThe person is not happyThe person is not happy
The person is bit smileyThe person is bit smileyThe person is bit smileyThe person is bit smileyThe person is bit smiley
The person is laughing The person is laughing The person is laughing The person is laughing The person is laughing
Figure-6 : Sample Experimental Results of happy expression
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
124 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
reasonable accuracy for the test set with low complexity and is suitable for real time facial
animation, image surveillance, mood analysis applications.
The success rate for quantification of happy expressions are 94.00%, 95.00% and 96.00%
for no happy, bit happy and loud laugh respectively. Therefore, the overall success rate for test
images is 95.00% as shown in the below graph. The average recognition time of each test image
is 0.30 seconds on a Pentium Quad Core processor with 2 GB RAM.
Figure-7 :Comparison of proposed method with other existing methods
As shown in the above graph, the proposed method has 95% of success rate when
compared to all others existing methods. The below table shows the details of comparison of the
proposed method and the other state of the art techniques and their respective success rates.
Sl.No Authors Method used Success
Rate(%)
1 Maedeh Rasoulzadeh [10] FIS 92.3
2 Akanksha Chaturvedi and AlpikaTripathi
[1]
Fuzzy Rule-based System 87.6
3 The Duy Bui et al [24] Fuzzy Rule Based System 80.8
4 Aleix Martinez and Shichuan Du [2] Emotion Model 94.1
5 Ashutosh Saxena, et al [5] Geometric model 90
6 Jyoti Mahajan and Rohini Mahajan [18] ANN 70
7 Prasad M and Ajit Danti [30] SUSAN Edge Operator 44
8 Jiequan Liet.al [17] Emotion recognition system 90
9 Anissa Bouzalmatet.al [3] Neural Network and
Fourier Gabor Filters
87
10 Hiroshi Kobayashi et.al [14] Neural Network 90
0
10
20
30
40
50
60
70
80
90
100
Comparison
Comparison
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
125 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
11 Proposed Method
Dileep M R and Ajit Danti
FIS 95
Table-1 : Comparison with state of the art methods
However, proposed method fails to detect the side-view faces, occluded faces and partial
face images as shown in figure-8.This is due to missing facial features in the process of
recognition of facial expressions.
5. CONCLUSIONS AND DISCUSSIONS
In this paper, a fast and efficient quantification of expression system is proposed to
classify a facial image into different modes of happy expression groups using Mamdani-type
fuzzy system. Mamdani-type fuzzy rule based system recognizes three levels of same happy
expression namely No Happy, Bit Happy and Loud Laugh. The proposed method is better in
terms of speed and accuracy with success rate of 95% and performance is comparable to other
state of the art methods.
In future studies, misclassifications are reduced by further improvement in the proposed
system so that it becomes more pertinent to the design of a real-time video surveillance system.
ACKNOWLEDGEMENT
I would like to thank my guide Dr Ajit Danti, Director, Dept of Computer Applications,
J N N College of Engg, for helping me to carry out this analysis. I appreciate the helpful
comments and suggestions of Dr T Devi, Dept of Computer Applications, Bharathiar University
and all the anonymous reviewers.
REFERENCES
[1] Akanksha Chaturvedi, Alpika Tripathi, Emotion Recognition using Fuzzy Rule-based System,International
Journal of Computer Applications, Volume 93 – No.11, May 2014, ISSN 0975 – 8887
[2] Aleix Martinez, Shichuan Du, A Model of the Perception of Facial Expressions of Emotion by Humans:
Research Overview and Perspectives, Journal of Machine Learning Research 13 (2012) 1589-1608
[3] AnissaBouzalmat, Naouar Beghini, Arsalane Zarghili, Jamal Kharroubi,” Face detection and Recognition using
base propagation Neural Network and Fourier Gabor Filters” SIPIJ Vol 2, No.3 Sep 2011.
[4] Aruna Chakraborty, Amit Konar, Uday Kumar Chakraborty, and Amita Chatterjee, Emotion Recognition From
Facial Expressions and Its Control Using Fuzzy Logic, IEEE Transactions on Systems, Man, and Cybernetics—Part
a: Systems and Humans, vol. 39, no. 4, July 2009.
Figure-8 :sample results for mis-detection
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
126 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
[5] Ashutosh Saxena, Ankit Anand, Prof. Amitabha Mukerjee, Robust facial expression recognition using
spatially localized geometric model, International Conference on Systemics, Cybernetics and Informatics, February
12–15, 2004
[6] B. K. Bose, “Expert systems, fuzzy logic, and neural network application in power electronics and motion
control”, Proceeding of the IEEE, vol.82,Aug. 1994.
[7] Dae-Jin Kim and Zeungnam Bien, Fuzzy Neural Networks (FNN) - based approach for Personalized Facial
Expression Recognition with Novel Feature Selection Method, the IEEE Conference on Fuzzy Systems,2003.
[8] Dennis Gillette, Ping Zhang, Human-Computer Interaction And Management Information Systems:
Applications, Advances in Management Information Systems Series Editor.
[9] S. Dongcheng, J. Jieqing, “The method of facial expression recognition based on DWT-PCA/LDA, “
International congress on Image and Signal Processing (CISP), Volume: 4, pp. 1970 – 1974, 2010.
[10] The Duy Bui, Dirk Heylen, Mannes Poel, and Anton Nijholt, Generation of Facial Expressions from Emotion
Using a Fuzzy Rule Based System, Springer-Verlag Berlin Heidelberg , M. Brooks, D. Corbett, and M. Stumptner
(Eds.): AI 2001, LNAI 2256, pp. 83–94, 2001.
[11]Esau N., Wetzel, E., Kleinjohann, L. & Kleinjohann, B. (2007). Real-Time Facial Expression Recognition
Using a Fuzzy Emotion Model. IEEE International Fuzzy Systems Conference, London, England, 1–6.
[12] Francisco Herrera, Luis Magdalena, Genetic Fuzzy Systems: A Tutorial. Tatra Mt. Math.Publ,
(Slovakia),(1997).
[13] P. S. Hiremath and Ajit Danti, A fuzzy-rule based method for human face detection, Proceedings of NVGIP-
05, 2nd -3rd March 2005, Dept. of CS&E, JNNCE, Shimoga
[14]Hiroshi Kobayashi and Fuimio Haro "Analysis of Neural Network Recognition characteristics at Basic Facial
Expression" IEEE International Workshop on Robot and Human Communication 0- 7803-2002-6/94, 1994 IEEE.
[15]A. Jamshidnezhad, “A Learning Fuzzy Model for Emotion Recognition, “European Journal of Scientific
Research ISSN 1450-216X Vol.57 No.2, pp.206-211, 2011.
[16] B. Jaychandra, simulation studies on “Speed Sensorless Operation of Vector Controlled Induction Motor
Drives Using Neural Networks”, Ph.D. Thesis, IIT, Madras, Chennai.
[17] Jiequan Li, Oussalah M, ”Automatic Face emotion recognition system” Cybernet Intelligent Systems (CIS)
2010 IEEE 9th International Conference Vol 1,Pg 1-6.
[18] Jyoti Mahajan and Rohini Mahajan, FCA: A Proposed Method for an Automatic Facial Expression Recognition
System using ANN, International Journal of Computer Applications (0975 – 8887) Volume 84 – No 4, December
2013.
[19]Khanum, A., Mufti, M. & Javed, M.Y. (2009).Fuzzy case-based reasoning for facial expression recognition.
Journal of Fuzzy Sets and Systems, 160(2), 231–250.
[20] G. Klir and B. Yuan, Fuzzy sets and Fuzzy Logic – Theory and Applications, Prentice-Hall, 2010.
[21] G. J. Klir, and B. Yuan, “Fuzzy sets and fuzzy logic,” Prentice hall of India, Pvt, Ltd, New Delhi, 2000.
[22] Kyoung- Man Lim, Young- ChulSim and Kyoung – Whan Oh, “A Face Recognition System Using Fuzzy
Logic and Artificial neural network”, Artificial Intelligence Research Lab, Dept. Of Computer Science, SoGang
University, Korea.
[23] S. Y. Lee, Y. K. Ham and R. H. Park, “Recognition of human front faces using knowledge based feature
extraction and neuro-fuzzy algorithm,” Pattern Recognition, vol. 29(11), pp. 1863-1876, 1996.
[24] Maedeh Rasoulzadeh, Facial Expression recognition using Fuzzy Inference System, International Journal of
Engineering and Innovative Technology (IJEIT) Volume 1, Issue 4, April 2012, ISSN: 2277-3754
[25] Math Works, Fuzzy Logic Toolbox User’s Guide, Jan., 1998.
[26] I. Milki, N. Nagai, S. Nishigama, and T. Yamada, “Vector control of induction motor with fuzzy P-I
controller”, IEEE IAS Annu. Meet. Conf. Rec., pp. 342-346, 1991.
[27] Muid Mufti, Assia Khanum, Fuzzy Rule-Based Facial Expression Recognition, CIMCA-2006, Sydney,
Australia.
[28] Mufti M., & Khanam, A. (2006). Fuzzy Rule Based Facial Expression Recognition, International conference on
Computational Intelligence for Modeling, Control and Automation, Sydney Australia, 57.
[29] M. Nasir Uddin, Tawfik S. Radwan and M. Azizur Rahman, “Performances of Fuzzy-Logic-Based Indirect
Vector Control for Induction Motor Drive”, IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, VOL. 38,
NO.5, SEPTEMBER/OCTOBER 2002, P1219.
[30] Prasad M and Ajit Danti, Classification of Human Facial Expression based on Mouth Feature using SUSAN
Edge Operator, International Journal of Advanced Research in Computer Science and Software Engineering,
Volume 4, Issue 12, December 2014, ISSN: 2277 128X
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
127 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
[31] Ralescu, A., and Hartani, R., Some Issues in Fuzzy and Linguistic Modeling, IEEE Proc. of International
Conference on Fuzzy Systems, 1995.
[32] D. H. Rao, S. S. Saraf, ”Study of Defuzzification Methods of Fuzzy Logic Controller for Speed Control of a
DC Motor”, IEEE Transactions,2007, pp. 782-787.
[33] M.S.Ratliff, E. Patterson, “Emoticon Recognition Using Facial Expressions with Active Appearance Model,
“HCI '08 Proceedings of the 3rd IASTED International Conference on Human Computer Interaction, pp.138-143,
2008.
[34] T. A. Runkler, Extended Defuzzification Methods and Their Properties, IEEE Transactions, 1996, pp. 694-700.
[35] M. Schmidt, M. Schels, and F. Schwenker, “A hidden markov model based approach for facial expression
recognition in image sequences,“ ANNPR'10 Proceedings of the 4th IAPR TC3 conference on Artificial Neural
Networks in Pattern Recognition, ISBN:3-642-12158-6 978-3-642-12158-6, 2010.
[36] N.Sebe, I. Cohen ; T.S. Huang ; and T. Gevers, ,“Human-computer interaction: a Bayesian network approach,
“International Symposium on Signals, Circuits and Systems, ISSCS, 2005.
[37]Starostenko O., Contreras, R. & Alarcon-Aquino, V. (2010). Facial Feature Model for Emotion Recognition
Using Fuzzy Reasoning. Advances in pattern Recognition. Lecture Notes in Computer Science, 6256, 11–21.
[38] TakKuen John Koo, Construction of Fuzzy Linguistic Model, Proceedings of the 35th Conference on Decision
and Control, Kobe, Japan, 1996, pp.98-103.
[39] T. Takagi and M. Sugeno, “Fuzzy identification of a system and its application to modeling and control”, IEEE
Trans. Syst. Man and Cybern., vol.15, pp.116-132, Jan./Feb. 1985.
[40] L. H. Tsoukalas and R. E. Uhrig, “Fuzzy and Neural Approches in Engineering”, John Wiley, NY, 1997.
[41] Ushida, H., Takagi, T., and Yamaguchi, T., Recognition of Facial Expressions Using Conceptual Fuzzy Sets,
Proc. of the 2nd IEEE International Conference on Fuzzy Systems, pp. 594-599, 1993.
[42] M. Usman Akram, Irfan Zafar, Wasim Siddique Khan and Zohaib Mushtaq “Facial Expression Recognition
Based On Fuzzy Logic“ International Conference on Computer Vision Theory and Applications, P.383-388, 2008.
[43] V. P. Vishwakarma, S. Pandey, and M. N. Gupta “Fuzzy based Pixel wise Information Extraction for Face
Recognition,“ IACSIT International Journal of Engineering and Technology Vol. 2, No.1, ISSN: 1793-8236,
February, 2010.
[44] T. Xiang, M.K.H. Leung, and S.Y. Cho, “Expression recognition using fuzzy patio-temporal modeling, “Pattern
Recognition, vol. 41, pp. 204-216, 2008.
[45] L.A. Zadeh, “Fuzzy sets”, Information and Control, Vol. 8, pp. 338- 353, 1965.
AUTHOR’S PROFILE
Mr. Dileep M R is currently working as Lecturer in the Dept. of Computer Science, Alva’s College, a unit of Alva’s
Education Foundation, Moodbidri, Karnataka, India. He has 4 years of experience in various capacities such as
Teaching, Administration and Research. Research interest includes Image Processing, Neural Networks, Fuzzy
Inference Systems, Database Applications, Software Engineering, Data Mining and so on. He has presented
number of research papers in National and International Conferences and Published number of research papers in
the reputed International Journals including SCI, SCOPUS indexed journals and IEEE Xplore digital library which
are freely available online. He has Completed Master of Computer Applications (MCA) from Visvesvaraya
Technological University, Belgaum, Karnataka, in the year 2013.
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
128 https://sites.google.com/site/ijcsis/
ISSN 1947-5500
Dr. Ajit Danti is currently working as Director and Professor in the Dept. of Computer Applications, Jawaharlal
Nehru National College of Engineering, Shimoga, Karnataka, India. He has 26 years of experience in various
capacities such as Teaching, Administration and Research. Research interests include Image Processing, Pattern
Recognition and Computer Vision. He has published more than 75 research papers in the International Journals and
Conferences. He has authored 3 books published by Advance Robotics International, Austria(AU) and Lambert
Academic Publishing, German which are freely available online. He has more than 250 citation index in the google
scholar and several papers are indexed in DBLP, SCI, Scopus, IEEE Explore etc. He has Completed Ph.D degree
from Gulbarga University in the year 2006. He has Completed Masters Degree in Computer Management from
Shivaji University, Maharashtra in the year 1991 and M.Tech from KSOU, Mysore in the year 2011 and Bachelor of
Engineering from Bangalore University in the year 1988.
International Journal of Computer Science and Information Security (IJCSIS),
Vol. 15, No. 8, Augus 2017
129 https://sites.google.com/site/ijcsis/
ISSN 1947-5500

The Quantification of Human Facial Expression Using Fuzzy Logic

  • 1.
    The Quantification ofHuman facial expression Using Fuzzy Logic. Dileep M R 1 and Ajit Danti 2 N E S Research Foundation, Department of Computer Applications, Jawaharlal Nehru National College of Engineering, Shimoga, Karnataka, India 1 dileep.kurunimakki@gmail.com 2 ajitdanti@yahoo.com Abstract: Fuzzy logic is an interesting theory that allows the natural description, in linguistic terms, of problems that should be solved rather than in terms of relationships between precise numerical values. In this paper, an effective approach is proposed that quantifies the human facial expression using Mamdani implication based fuzzy logic system. The new technique involves in extracting mathematical data from the face and fed to a fuzzy rule-based system. Fuzzification and Defuzzification operation issues trapezoidal membership functions for both input and output. The distinct feature of a system is its simplicity and high accuracy. Experimental results on Image dataset indicate good performance of the proposed technique. Comparative analysis reveal that the proposed technique is uniqueness and robust with reference to other state of the art methods. In this paper, a legitimate procedure proposed for quantification of human facial expression recognition from Facial features using Mamdani-type fuzzy system. It is Fuzzy Inference System (FIS), which is capable to set up an easy membership relation between the different dimensions of the happy expression. The FIS recognizes three levels of same happy expression namely No happy, Bit Smiley and Loud Laugh based on membership function modeled on different psychological studies and surveys. Index Terms – Fuzzy Rule, Quantification of Expression, Membership Function 1. INTRODUCTION Facial expression is one of the most important subjects in the field of biometric, which has wide range of applications such as Business, Managerial, Organizational, Cultural contexts, Telecommunication, Medical, Human Computer Interactions (HCI). The ideal human computer interaction system is the one that the computer is able to communicate and respond to the user actions, based on emotional state of human's face. In this way the user will be able to communicate with it more effectively. For this aim, automatic recognition of human's facial expressions has been very active research area in machine vision within the last several years. Facial expressions are generated by movement of face muscles that makes facial features such as stretching corner lips, raising eyebrows, opening eyes, etc. The traditional approach to building any system controllers requires a prior model of the system. The quality of the model, that is, loss of precision from linearization and/or uncertainties in the system’s parameters negatively influences the quality of the resulting control. At the same time, methods of soft computing such as fuzzy logic possess non-linear mapping capabilities, do not require an analytical model and can deal with uncertainties in the system’s parameters. Although fuzzy logic deals with imprecise information, the information is processed in sound mathematical theory. Based on the nature of fuzzy human thinking, Zadeh, originated the “fuzzy logic” or “fuzzy set theory”, in 1965. Fuzzy logic deals with the problems that have fuzziness or vagueness. In fuzzy set theory based on fuzzy logic a particular object has a degree of membership in a given set that may be anywhere in the range of 0 (completely not in the set) to 1 International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, August 2017 119 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 2.
    (completely in theset). For this reason fuzzy logic is often defined as multi-valued logic (0 to 1), compared to bi-valued Boolean logic. Facial expression process usually extract facial expression parameters from a static face image. This process is called as “Quantification” of expression. These extracted features are then fed to a classifier system for facial expression quantification by defining the range of expression with their membership function. In this paper, a complete system for quantification of facial expression i,e different range of happy faces is proposed. The core of our system is a Mamdani-type Fuzzy Rule Based system which is used to quantify facial expression from facial features. The comparison of proposed methodology with other state of the art methods is carried out. Aruna Chakraborty et al, 2009, introduced a method for emotion recognition from facial expressions and its control using fuzzy logic, where the expressions of the human face would be recognized by applying the fuzzy rule implementation. An effective application is invented by B. K. Bose, 1994, about the expert systems, fuzzy logic, and neural network application in power electronics and motion control. It was a multiple application system. Dae-Jin Kim and Zeungnam Bien, 2003, developed an algorithm of Fuzzy Neural Networks (FNN) - based approach for Personalized Facial Expression Recognition with Novel Feature Selection Method, where this method was the combination of Artificial Neural Network and Fuzzy Inference System. This method was used to recognize the different expressions of the human face. Dennis Gillette and Ping Zhang did an effective survey on Human-Computer Interaction And Management Information Systems: Applications. S. Dongcheng, J. Jieqing , 2010, introduced a method of facial expression recognition based on DWT-PCA/LDA, the multiple application approach. Esau N, et al, 2007, given an approach for Real-Time Facial Expression Recognition using a Fuzzy Emotion Model, that effectively recognizes the emotions of the human face. Francisco Herrera and Luis Magdalena, 1997, published a tutorial on genetic Fuzzy Systems gives a detailed description on biological features of human faces using fuzzy logic. P. S. Hiremath and Ajit Danti, 2005, developed a methodology on fuzzy-rule based method for human face detection, that effectively detects the human faces by applying fuzzy inference system. A. Jamshidnezhad, 2011, designed an approach that learns Fuzzy Model for Emotion Recognition that recognizes the emotions of the human face. B. Jaychandra, simulated Speed Sensorless Operation of Vector Controlled Induction Motor Using Neural Networks. Khanum A et al, 2009, contributed a research on Fuzzy case-based reasoning for facial expression recognition, that efficiently recognizes the human facial expressions based on Fuzzy rule. G. Klir and B. Yuan, 2010, published a study material on Fuzzy sets and Fuzzy Logic – Theory and Applications, that gives a detailed description on the applications and usage of the fuzzy rule. Kyoung- Man Lim et al, designed an algorithm for face recognition system using Fuzzy Logic and Artificial neural network, that effectively recognizes the face in a given still image. S. Y. Lee et al, 1996, introduced a method that recognizes the human front faces using knowledge based feature extraction and neuro-fuzzy algorithm, a multiple application approach, that uses geometrical facial features of the face along with Artificial neural networks plus fuzzy inference systems. Maedeh Rasoulzadeh, 2012, did a research on facial expression recognition using Fuzzy Inference System. Milki et al, 1991, designed an effective application for Vector control of induction motor with fuzzy P-I controller. Muid Mufti and Assia Khanum, 1991, proposed an approach on Fuzzy Rule-Based Facial Expression Recognition in a precise manner. Mufti M and Khanam A, 2006, solved an unique problem on Fuzzy Rule Based Facial Expression Recognition. M. Nasir Uddin, 2002, pursued a study on performances of Fuzzy-Logic-Based International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 120 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 3.
    Indirect Vector Controlfor Induction Motor Drive, an effective approach on fuzzy logic. Ralescu A and Hartani R, 1995, studied some issues in Fuzzy and Linguistic Modeling. D. H. Rao and S. S. Saraf, 2007, conducted a detailed study of Defuzzification Methods of Fuzzy Logic Controller for Speed Control of a DC Motor. Several researchers contributed their work on emotions, emoticon recognition using facial expressions using fuzzy inference system and neural networks etc. namely M.S.Ratliff and E. Patterson, 2008; T. A. Runkler, 1996; M. Schmidt et al, 2010; N.Sebe et al, 2005; Starostenko O et al, 2010; TakKuen John Koo, 1996; T. Takagi and M. Sugeno, 1985; L. H. Tsoukalas and R. E. Uhrig, 1997; Ushida H et al, 1993; M. Usman Akram, et al, 2008; V. P. Vishwakarma et al, 2010; T. Xiang et al, 2008; 1.1 Fuzzy Inference System Fuzzy inference is the process of formulating the mapping from a given input faces to an output facial expressions using fuzzy logic and membership function. In this paper, Mamdani's fuzzy inference method is used and it expects the output membership functions to be fuzzy sets. After the aggregation process and defuzzification, crisp decision is made on facial expression as shown in Figure-1. 1.2 Face Database The proposed methodology is experimented on database of the faces of people of different dimensions of happy expressions viz Normal, Bit smiley and Loud Laugh. There are 1000 facial images in this database, among them 700 images were used for training and remaining 300 images were used for testing purpose. Each image is normalized to a size of 64 × 64 dimensions for optimum computational cost. Sample facial expression images are shown in figure-2. Figure-1:Fuzzy Inference System for facial expressions. Expressions Output Faces I N P U T Fuzzification DefuzzificationRule Evaluation International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 121 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 4.
    The rest ofthis paper is organized as follows. The Proposed Methodology is explained in Section 2. The Proposed Algorithm is described in section 3. In Section 4, Experimental results are presented and Conclusions are drawn in section 5. 2. PROPOSED METHODOLOGY This paper proposes an effective method for quantification of human facial expressions from facial images. Block diagram of the proposed method is given in Figure-3. Figure-3 :Block diagram of the proposed Methodology The Proposed algorithm has been implemented to classify input images into one of three happy expression using Mamdani-type Fuzzy Rule Based system In order to improve the Figure-2: Samples of the facial images in the dataset Input Face Image Rule Evaluation Fuzzification Defuzzification Expression Recognition International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 122 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 5.
    efficiency of theperformance, mean vector is obtained for each image is used in the fuzzy inference system as shown infigure-1. 2.1Quantification of Facial Expressions It is assumed that every human face is having the same geometrical configuration. Feature extraction method uses the mean of the image as input to the fuzzy system. This improves the efficiency of the performance. Geometrical features of the face are fed to mamdani- type fuzzy system for quantification using trapezoidal membership functions. This system is capable of quantifying 3 basic forms of happy expressions that are No Happy, Bit Smiley, Loud Laugh as shown in Figure-4 & 5. The output of the fuzzy system is defuzzified to depict either the given face is in happy, or bit happy or loud laugh. This can be represented by the equation(1). ≤ ≤ ≤ b≤ ≤ b≤ ≤ d ≤ d Figure-5 : Representation of Quantification of Happy Expression Figure-5: Representation of Trapezoidal Membership Function No Happy No Happy Loud Laugh a b c d Bit Happy Bit Happy International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 123 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 6.
    , , ,, = 0 ≤ − − ≤ ≤ 1 ≤ ≤ ℎ − − ≤ ≤ 0 ≥ (1) Where a,b,c,d values are determined empirically for quantification of expression. The experimental results of quantification of happy expressions are shown in the figure-6. 3. PROPOSED ALGORITHM Proposed algorithm for expression quantification from the given image is as given below: Input: Query face Output: Quantification of happy expression into No happy, Bit happy or Loud laugh Step 1: To Train: Input all n face images to the Fuzzy Inference System. Step 2:Define the Trapezoidal membership function for different expressions and compute membership values for a,b,c,d as shown in Figure 5 Step 3: To Test: Compute membership value x for the query face using equation (1) Step 4: Evaluate facial expression using equation (1). 4. EXPERIMENTAL RESULTS In this research, there are 1000 gray-scale facial images used for experiment in which 300 images are used as training data and the remaining are used as test images. Each image size is normalized to 64×64 dimensions. The proposed Algorithm have shown good robustness and The person is not happyThe person is not happyThe person is not happyThe person is not happyThe person is not happy The person is bit smileyThe person is bit smileyThe person is bit smileyThe person is bit smileyThe person is bit smiley The person is laughing The person is laughing The person is laughing The person is laughing The person is laughing Figure-6 : Sample Experimental Results of happy expression International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 124 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 7.
    reasonable accuracy forthe test set with low complexity and is suitable for real time facial animation, image surveillance, mood analysis applications. The success rate for quantification of happy expressions are 94.00%, 95.00% and 96.00% for no happy, bit happy and loud laugh respectively. Therefore, the overall success rate for test images is 95.00% as shown in the below graph. The average recognition time of each test image is 0.30 seconds on a Pentium Quad Core processor with 2 GB RAM. Figure-7 :Comparison of proposed method with other existing methods As shown in the above graph, the proposed method has 95% of success rate when compared to all others existing methods. The below table shows the details of comparison of the proposed method and the other state of the art techniques and their respective success rates. Sl.No Authors Method used Success Rate(%) 1 Maedeh Rasoulzadeh [10] FIS 92.3 2 Akanksha Chaturvedi and AlpikaTripathi [1] Fuzzy Rule-based System 87.6 3 The Duy Bui et al [24] Fuzzy Rule Based System 80.8 4 Aleix Martinez and Shichuan Du [2] Emotion Model 94.1 5 Ashutosh Saxena, et al [5] Geometric model 90 6 Jyoti Mahajan and Rohini Mahajan [18] ANN 70 7 Prasad M and Ajit Danti [30] SUSAN Edge Operator 44 8 Jiequan Liet.al [17] Emotion recognition system 90 9 Anissa Bouzalmatet.al [3] Neural Network and Fourier Gabor Filters 87 10 Hiroshi Kobayashi et.al [14] Neural Network 90 0 10 20 30 40 50 60 70 80 90 100 Comparison Comparison International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 125 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 8.
    11 Proposed Method DileepM R and Ajit Danti FIS 95 Table-1 : Comparison with state of the art methods However, proposed method fails to detect the side-view faces, occluded faces and partial face images as shown in figure-8.This is due to missing facial features in the process of recognition of facial expressions. 5. CONCLUSIONS AND DISCUSSIONS In this paper, a fast and efficient quantification of expression system is proposed to classify a facial image into different modes of happy expression groups using Mamdani-type fuzzy system. Mamdani-type fuzzy rule based system recognizes three levels of same happy expression namely No Happy, Bit Happy and Loud Laugh. The proposed method is better in terms of speed and accuracy with success rate of 95% and performance is comparable to other state of the art methods. In future studies, misclassifications are reduced by further improvement in the proposed system so that it becomes more pertinent to the design of a real-time video surveillance system. ACKNOWLEDGEMENT I would like to thank my guide Dr Ajit Danti, Director, Dept of Computer Applications, J N N College of Engg, for helping me to carry out this analysis. I appreciate the helpful comments and suggestions of Dr T Devi, Dept of Computer Applications, Bharathiar University and all the anonymous reviewers. REFERENCES [1] Akanksha Chaturvedi, Alpika Tripathi, Emotion Recognition using Fuzzy Rule-based System,International Journal of Computer Applications, Volume 93 – No.11, May 2014, ISSN 0975 – 8887 [2] Aleix Martinez, Shichuan Du, A Model of the Perception of Facial Expressions of Emotion by Humans: Research Overview and Perspectives, Journal of Machine Learning Research 13 (2012) 1589-1608 [3] AnissaBouzalmat, Naouar Beghini, Arsalane Zarghili, Jamal Kharroubi,” Face detection and Recognition using base propagation Neural Network and Fourier Gabor Filters” SIPIJ Vol 2, No.3 Sep 2011. [4] Aruna Chakraborty, Amit Konar, Uday Kumar Chakraborty, and Amita Chatterjee, Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic, IEEE Transactions on Systems, Man, and Cybernetics—Part a: Systems and Humans, vol. 39, no. 4, July 2009. Figure-8 :sample results for mis-detection International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 126 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 9.
    [5] Ashutosh Saxena,Ankit Anand, Prof. Amitabha Mukerjee, Robust facial expression recognition using spatially localized geometric model, International Conference on Systemics, Cybernetics and Informatics, February 12–15, 2004 [6] B. K. Bose, “Expert systems, fuzzy logic, and neural network application in power electronics and motion control”, Proceeding of the IEEE, vol.82,Aug. 1994. [7] Dae-Jin Kim and Zeungnam Bien, Fuzzy Neural Networks (FNN) - based approach for Personalized Facial Expression Recognition with Novel Feature Selection Method, the IEEE Conference on Fuzzy Systems,2003. [8] Dennis Gillette, Ping Zhang, Human-Computer Interaction And Management Information Systems: Applications, Advances in Management Information Systems Series Editor. [9] S. Dongcheng, J. Jieqing, “The method of facial expression recognition based on DWT-PCA/LDA, “ International congress on Image and Signal Processing (CISP), Volume: 4, pp. 1970 – 1974, 2010. [10] The Duy Bui, Dirk Heylen, Mannes Poel, and Anton Nijholt, Generation of Facial Expressions from Emotion Using a Fuzzy Rule Based System, Springer-Verlag Berlin Heidelberg , M. Brooks, D. Corbett, and M. Stumptner (Eds.): AI 2001, LNAI 2256, pp. 83–94, 2001. [11]Esau N., Wetzel, E., Kleinjohann, L. & Kleinjohann, B. (2007). Real-Time Facial Expression Recognition Using a Fuzzy Emotion Model. IEEE International Fuzzy Systems Conference, London, England, 1–6. [12] Francisco Herrera, Luis Magdalena, Genetic Fuzzy Systems: A Tutorial. Tatra Mt. Math.Publ, (Slovakia),(1997). [13] P. S. Hiremath and Ajit Danti, A fuzzy-rule based method for human face detection, Proceedings of NVGIP- 05, 2nd -3rd March 2005, Dept. of CS&E, JNNCE, Shimoga [14]Hiroshi Kobayashi and Fuimio Haro "Analysis of Neural Network Recognition characteristics at Basic Facial Expression" IEEE International Workshop on Robot and Human Communication 0- 7803-2002-6/94, 1994 IEEE. [15]A. Jamshidnezhad, “A Learning Fuzzy Model for Emotion Recognition, “European Journal of Scientific Research ISSN 1450-216X Vol.57 No.2, pp.206-211, 2011. [16] B. Jaychandra, simulation studies on “Speed Sensorless Operation of Vector Controlled Induction Motor Drives Using Neural Networks”, Ph.D. Thesis, IIT, Madras, Chennai. [17] Jiequan Li, Oussalah M, ”Automatic Face emotion recognition system” Cybernet Intelligent Systems (CIS) 2010 IEEE 9th International Conference Vol 1,Pg 1-6. [18] Jyoti Mahajan and Rohini Mahajan, FCA: A Proposed Method for an Automatic Facial Expression Recognition System using ANN, International Journal of Computer Applications (0975 – 8887) Volume 84 – No 4, December 2013. [19]Khanum, A., Mufti, M. & Javed, M.Y. (2009).Fuzzy case-based reasoning for facial expression recognition. Journal of Fuzzy Sets and Systems, 160(2), 231–250. [20] G. Klir and B. Yuan, Fuzzy sets and Fuzzy Logic – Theory and Applications, Prentice-Hall, 2010. [21] G. J. Klir, and B. Yuan, “Fuzzy sets and fuzzy logic,” Prentice hall of India, Pvt, Ltd, New Delhi, 2000. [22] Kyoung- Man Lim, Young- ChulSim and Kyoung – Whan Oh, “A Face Recognition System Using Fuzzy Logic and Artificial neural network”, Artificial Intelligence Research Lab, Dept. Of Computer Science, SoGang University, Korea. [23] S. Y. Lee, Y. K. Ham and R. H. Park, “Recognition of human front faces using knowledge based feature extraction and neuro-fuzzy algorithm,” Pattern Recognition, vol. 29(11), pp. 1863-1876, 1996. [24] Maedeh Rasoulzadeh, Facial Expression recognition using Fuzzy Inference System, International Journal of Engineering and Innovative Technology (IJEIT) Volume 1, Issue 4, April 2012, ISSN: 2277-3754 [25] Math Works, Fuzzy Logic Toolbox User’s Guide, Jan., 1998. [26] I. Milki, N. Nagai, S. Nishigama, and T. Yamada, “Vector control of induction motor with fuzzy P-I controller”, IEEE IAS Annu. Meet. Conf. Rec., pp. 342-346, 1991. [27] Muid Mufti, Assia Khanum, Fuzzy Rule-Based Facial Expression Recognition, CIMCA-2006, Sydney, Australia. [28] Mufti M., & Khanam, A. (2006). Fuzzy Rule Based Facial Expression Recognition, International conference on Computational Intelligence for Modeling, Control and Automation, Sydney Australia, 57. [29] M. Nasir Uddin, Tawfik S. Radwan and M. Azizur Rahman, “Performances of Fuzzy-Logic-Based Indirect Vector Control for Induction Motor Drive”, IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, VOL. 38, NO.5, SEPTEMBER/OCTOBER 2002, P1219. [30] Prasad M and Ajit Danti, Classification of Human Facial Expression based on Mouth Feature using SUSAN Edge Operator, International Journal of Advanced Research in Computer Science and Software Engineering, Volume 4, Issue 12, December 2014, ISSN: 2277 128X International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 127 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 10.
    [31] Ralescu, A.,and Hartani, R., Some Issues in Fuzzy and Linguistic Modeling, IEEE Proc. of International Conference on Fuzzy Systems, 1995. [32] D. H. Rao, S. S. Saraf, ”Study of Defuzzification Methods of Fuzzy Logic Controller for Speed Control of a DC Motor”, IEEE Transactions,2007, pp. 782-787. [33] M.S.Ratliff, E. Patterson, “Emoticon Recognition Using Facial Expressions with Active Appearance Model, “HCI '08 Proceedings of the 3rd IASTED International Conference on Human Computer Interaction, pp.138-143, 2008. [34] T. A. Runkler, Extended Defuzzification Methods and Their Properties, IEEE Transactions, 1996, pp. 694-700. [35] M. Schmidt, M. Schels, and F. Schwenker, “A hidden markov model based approach for facial expression recognition in image sequences,“ ANNPR'10 Proceedings of the 4th IAPR TC3 conference on Artificial Neural Networks in Pattern Recognition, ISBN:3-642-12158-6 978-3-642-12158-6, 2010. [36] N.Sebe, I. Cohen ; T.S. Huang ; and T. Gevers, ,“Human-computer interaction: a Bayesian network approach, “International Symposium on Signals, Circuits and Systems, ISSCS, 2005. [37]Starostenko O., Contreras, R. & Alarcon-Aquino, V. (2010). Facial Feature Model for Emotion Recognition Using Fuzzy Reasoning. Advances in pattern Recognition. Lecture Notes in Computer Science, 6256, 11–21. [38] TakKuen John Koo, Construction of Fuzzy Linguistic Model, Proceedings of the 35th Conference on Decision and Control, Kobe, Japan, 1996, pp.98-103. [39] T. Takagi and M. Sugeno, “Fuzzy identification of a system and its application to modeling and control”, IEEE Trans. Syst. Man and Cybern., vol.15, pp.116-132, Jan./Feb. 1985. [40] L. H. Tsoukalas and R. E. Uhrig, “Fuzzy and Neural Approches in Engineering”, John Wiley, NY, 1997. [41] Ushida, H., Takagi, T., and Yamaguchi, T., Recognition of Facial Expressions Using Conceptual Fuzzy Sets, Proc. of the 2nd IEEE International Conference on Fuzzy Systems, pp. 594-599, 1993. [42] M. Usman Akram, Irfan Zafar, Wasim Siddique Khan and Zohaib Mushtaq “Facial Expression Recognition Based On Fuzzy Logic“ International Conference on Computer Vision Theory and Applications, P.383-388, 2008. [43] V. P. Vishwakarma, S. Pandey, and M. N. Gupta “Fuzzy based Pixel wise Information Extraction for Face Recognition,“ IACSIT International Journal of Engineering and Technology Vol. 2, No.1, ISSN: 1793-8236, February, 2010. [44] T. Xiang, M.K.H. Leung, and S.Y. Cho, “Expression recognition using fuzzy patio-temporal modeling, “Pattern Recognition, vol. 41, pp. 204-216, 2008. [45] L.A. Zadeh, “Fuzzy sets”, Information and Control, Vol. 8, pp. 338- 353, 1965. AUTHOR’S PROFILE Mr. Dileep M R is currently working as Lecturer in the Dept. of Computer Science, Alva’s College, a unit of Alva’s Education Foundation, Moodbidri, Karnataka, India. He has 4 years of experience in various capacities such as Teaching, Administration and Research. Research interest includes Image Processing, Neural Networks, Fuzzy Inference Systems, Database Applications, Software Engineering, Data Mining and so on. He has presented number of research papers in National and International Conferences and Published number of research papers in the reputed International Journals including SCI, SCOPUS indexed journals and IEEE Xplore digital library which are freely available online. He has Completed Master of Computer Applications (MCA) from Visvesvaraya Technological University, Belgaum, Karnataka, in the year 2013. International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 128 https://sites.google.com/site/ijcsis/ ISSN 1947-5500
  • 11.
    Dr. Ajit Dantiis currently working as Director and Professor in the Dept. of Computer Applications, Jawaharlal Nehru National College of Engineering, Shimoga, Karnataka, India. He has 26 years of experience in various capacities such as Teaching, Administration and Research. Research interests include Image Processing, Pattern Recognition and Computer Vision. He has published more than 75 research papers in the International Journals and Conferences. He has authored 3 books published by Advance Robotics International, Austria(AU) and Lambert Academic Publishing, German which are freely available online. He has more than 250 citation index in the google scholar and several papers are indexed in DBLP, SCI, Scopus, IEEE Explore etc. He has Completed Ph.D degree from Gulbarga University in the year 2006. He has Completed Masters Degree in Computer Management from Shivaji University, Maharashtra in the year 1991 and M.Tech from KSOU, Mysore in the year 2011 and Bachelor of Engineering from Bangalore University in the year 1988. International Journal of Computer Science and Information Security (IJCSIS), Vol. 15, No. 8, Augus 2017 129 https://sites.google.com/site/ijcsis/ ISSN 1947-5500