Muhammad Mahad Mufeez

IT (7)

mianmahad1998@gmail.com

Department of Computer Science

Bahria University Lahore Campus

Facial Expression Recognition

Abstract

Facial Expression depicts non-verbal signs, which plays a necessary role in interpersonal relations.
The Facial Expression Recognition is the process of identifying the emotion of a person. In this
procedure caught picture is contrasted and the prepared dataset and afterward passionate condition
of the picture will be shown. This framework depends on picture preparing and AI. For structuring
a powerful facial element, we apply the Local Binary Pattern. Local Binary Pattern (LBP) is a
basic and exceptionally effective surface administrator which names the pixels of a picture by
thresholding the area of every pixel and thinks about the outcome as a double number. The
histogram will be shaped by utilizing the administrator mark of LBP. The acknowledgment
execution of the proposed technique will be assessed by utilizing the prepared database with the
assistance of Support Vector Machine. Exploratory outcomes with prototypic articulations
demonstrate the predominance of the LBP descriptor against some outstanding appearance-based
element portrayal techniques.

Keywords:
Facial expression recognition (FER), Local Binary pattern (LBP), Support Vector Machine (SVM)

I. Introduction expectations and feelings through nonverbal

A Facial appearance is the obvious indication
of the full of feeling state, psychological
movement, goal, identity and
psychopathology of an individual and
assumes an open job in relational relations. In
spite of the fact that much advancement has
been made, perceiving Facial appearance
with a high exactness stays to be troublesome
because of the unpredictability and
assortments of Facial appearances [2]. For
the most part individuals can pass on
ways, for example, signals, Facial
appearances and automatic dialects. This
framework can be essentially helpful,
nonverbal path for individuals to speak with
one another. The critical thing is the means
by which easily the framework identifies or
extricates the Facial appearance from picture.
The framework is developing consideration
since this could be generally utilized in
numerous fields like falsehood location,
medicinal evaluation and human PC
interface. The Facial Action Coding System
(FACS), which was proposed in 1978 by
Ekman and refined in 2002, is an
exceptionally prevalent Facial appearance
investigation device [3].
II. Non-Emotions
In his 1991 book, Emotion and Adaptation,
Richard Lazarus lists several mental states
that may be emotion related, but are not
themselves actual emotions. The list includes
the complex states of: grief and depression;
the ambiguous positive states of:
expansiveness, awe, confidence, challenge,
determination, satisfaction, and being
pleased; the ambiguous negative states of:
threat, frustration, disappointment,
helplessness, meaningless, and awe; the
mental confusion states of bewilderment and
confusion; the arousal states of: excitement,
upset, distress, nervousness, tension, and
agitation; and finally the pre-emotions of:
interest, curiosity, amazement, anticipation,
alertness, and surprise.
III. Universal Emotions
Scientific research in the 19th century stated
that the young and the old of wide different
races, both with man and animals, press the
same state of mind by the same movements.
Still, up to the mid-20th century most
anthropologists believed that facial
expressions were entirely learned and could
therefore differ among cultures. Studies
eventually supported Darwin's belief to a
large degree, particularly for expressions of
anger, sadness, fear, surprise, disgust,
contempt, happiness and caring. Recent
psychological research has classified six
facial expressions which correspond to
distinct universal emotions: disgust, sadness,
happiness, fear, anger, surprise. These
expressions are manifestations of particular
emotions, regardless of cultural background,
and regardless of whether or not the culture
has been isolated or exposed to the
mainstream.
IV. Literature Reviews
Research in the fields of face discovery and
following has been extremely dynamic and
there is thorough writing accessible on the
equivalent. The significant test that the
scientists face is the non-accessibility of
unconstrained appearance information [1].
Catching unconstrained articulations on
pictures and video is one of the greatest
difficulties ahead [2]. Numerous endeavors
have been made to perceive Facial
appearances. Zhang et al examined two sorts
of highlights, the geometry-based highlights
and Gabor wavelets-based highlights, for
Facial appearance acknowledgment.
Appearance based techniques, include
invariant strategies, learning based
techniques, Template based techniques are
the face identification procedures though
Local Binary Pattern stage connection, Hear
classifier, AdaBoost, Gabor Wavelet are the
demeanor recognition methodologies in
related field [3]. Face peruse is the head for
programmed examination of Facial
appearance acknowledgment and Emotion,
Affective, Kairos and so forth are a portion of
the API's for demeanor acknowledgment.
Programmed Facial appearance
acknowledgment incorporates two
imperative viewpoints: facial component
portrayal and classifier issue [2]. Histogram
of Oriented Gradient (HOG), SIFT, Gabbor
Fitters and Local Binary Pattern (LBP) are
the calculations utilized for facial component
portrayal [3,4]. For classifier issue we use
calculations like Machine learning, Neural
Network, Support Vector Machine, Deep
learning, Naive Bayes. The development of
histogram by utilizing any of facial
component portrayal will utilize Support
Vector Machine (SVM) for appearance
acknowledgment. SVM fabricates a
hyperplane to isolate the high dimensional
space. A perfect detachment is accomplished
when the separation between the hyper plane
and the preparation information of any class
is the biggest [4].
V. Problem Statement
Human feelings and goals are communicated
through Facial appearances and inferring a
productive and viable element is the crucial
segment of Facial appearance framework.
Face acknowledgment is imperative for the
understanding of Facial appearances in
applications, for example, shrewd, man-
machine interface and correspondence, smart
visual observation, video chat and constant
liveliness from live movement pictures. The
Facial appearances are valuable for proficient
cooperation Most research and framework in
Facial appearance acknowledgment are
restricted to six essential articulations
(happiness, pitiful, outrage, nauseate, dread,
shock. It is discovered that it is inadequate to
depict every single Facial appearance and
these articulations are sorted dependent on
facial activities [7]. Distinguishing face and
perceiving the Facial appearance is a
muddled assignment when it is an
indispensable to focus on essential segments
like: face design, introduction, area where the
face is set. Histogram of Oriented Gradient
(HOG), SIFT, Gabbor Fitters and Local
Binary Pattern (LBP) are the calculations
utilized for facial component portrayal [3,4].
For classifier issue we use calculations like
Machine learning, Neural Network, Support
Vector Machine, Deep learning, Naive
Bayes. The development of histogram by
utilizing any of facial component portrayal
will utilize Support Vector Machine (SVM)
for appearance acknowledgment. SVM
manufactures a hyperplane to isolate the high
dimensional space. A perfect partition is
accomplished when the separation between
the hyper plane and the preparation
information of any class is the biggest [4].
VI. Working Model
VII. Support Vector Machines
SVM is broadly utilized in different example
acknowledgment errands. SVM is a cutting-
edge AI approach dependent on the advanced
measurable learning hypothesis. SVM can
accomplish a close ideal division among
classes. SVMs is prepared to perform Facial
appearance order utilizing the highlights
proposed. When all is said in done, SVM are
the maximal hyperplane characterization
strategy that depends on results from factual
learning hypothesis to ensure high
speculation execution. Piece capacities are
utilized to proficiently outline information
which may not be directly detachable to a
high dimensional element space where
straight techniques would then be able to be
connected. SVMs display great
characterization exactness notwithstanding
when just an unobtrusive measure of
preparing information is accessible, making
them especially appropriate to a dynamic,
intuitive way to deal with articulation
acknowledgment [10]. A perfect partition is
accomplished when the hyper plane and the
preparation information of any class is the
biggest. This isolating hyper plane functions
as the choice surface. SVM has been
effectively utilized for various
characterization errands, for example,
content classification, hereditary
investigation and face recognition [11].
VIII. OpenCV
OpenCV (Open Source Computer Vision
Library) is an open source PC vision and AI
programming library. OpenCV was worked
to give a typical foundation to PC vision
applications and to quicken the utilization of
machine observation in the business items.
Being a BSD-authorized item, OpenCV
makes it simple for organizations to use and
change the code. The library has more than
2500 upgraded calculations, which
incorporates a thorough arrangement of both
exemplary and cutting-edge PC vision and AI
calculations. These calculations can be
utilized to distinguish and perceive faces,
recognize objects, order human activities in
recordings, track camera developments, track
moving articles, separate 3D models of items,
produce 3D point mists from stereo cameras,
fasten pictures together to create a high goals
picture of a whole scene, find comparative
pictures from a picture database, expel red
eyes from pictures taken utilizing streak,
pursue eye developments, perceive landscape
and set up markers to overlay it with
expanded reality, and so forth. It has C++, C,
Python, Java and MATLAB interfaces and
supports Windows, Linux, Android and Mac
OS.
IX. Why Using Python
Python in combination with NumPy, SciPy
and Matplotlib can be used as a replacement
for MATLAB. The combination of NumPy,
SciPy and Matplotlib is a free (meaning both
"free" as in "free beer" and "free" as in
"freedom") alternative to MATLAB. Even
though MATLAB has a huge number of
additional toolboxes available, NumPy has
the advantage that Python is a more modern
and complete programming language and - as
we have said already before - is open source.
SciPy adds even more MATLAB-like
functionalities to Python. Python is rounded
out in the direction of MATLAB with the
module Matplotlib, which provides
MATLAB-like plotting functionality.
X. Artificial Neural Networks:
The idea of ANNs is based on the belief that
working of human brain by making the right
connections, can be imitated using silicon
and wires as living neurons and dendrites.
The human brain is composed of 86 billion
nerve cells called neurons. They are
connected to other thousand cells by Axons.
Stimuli from external environment or inputs
from sensory organs are accepted by
dendrites. These inputs create electric
impulses, which quickly travel through the
neural network. A neuron can then send the
message to other neuron to handle the issue
or does not send it forward.
XI. Conclusion
It is important to note that there is no specific
formula to build a neural network that would
guarantee to work well. Different problems
would require different network architecture
and a lot of trail and errors to produce
desirable validation accuracy. This is the
reason why neural nets are often perceived as
"black box algorithms.". In this project we
References
[1] Bettadapura, V. (2012). Face expression
recognition and analysis: the state of the art.
arXiv preprint arXiv:1203.6722.
[2] Shan, C., Gong, S., & McOwan, P. W.
(2005, September). Robust facial expression
recognition using local binary patterns. In Image
Processing, 2005. ICIP 2005. IEEE International
Conference on (Vol. 2, pp. II-370). IEEE.
[3] Bhatt, M., Drashti, H., Rathod, M., Kirit, R.,
Agravat, M., & Shardul, J. (2014). A Studyof
Local Binary Pattern Method for Facial
Expression Detection. arXiv preprint
arXiv:1405.6130.
[4] Chen, J., Chen, Z., Chi, Z., & Fu, H. (2014,
August). Facial expression recognition based on
facial components detection and hog features. In
International Workshops on Electrical and
Computer Engineering Subfields (pp. 884-888).
got an accuracy of almost 70% and we have
to work more to get better results.
[9] Sokolova, M., Japkowicz, N., & Szpakowicz,
S. (2006, December). Beyond accuracy, F-score
and ROC: a family of discriminant measures for
performance evaluation. In Australasian Joint
Conference on Artificial Intelligence (pp. 1015-
1021). Springer Berlin Heidelberg.
[10] Michel, P., & El Kaliouby, R. (2005).
Facial expression recognition using support
vector machines. In The 10th International
Conference on Human-Computer Interaction,
Crete, Greece.
[11] Michel, P., & El Kaliouby, R. (2003,
November). Real time facial expression
recognition in video using support vector
machines. In Proceedings of the 5th international
conference on Multimodal interfaces (pp. 258-
264). ACM.

[5] Ahmed, F., Bari, H., & Hossain, E. (2014).

Person-independent facial expression
recognition based on compound local binary
pattern (CLBP). Int. Arab J. Inf. Technol., 11(2),
195-203.

[6] Happy, S. L., George, A., & Routray, A.

(2012, December). A real time facial expression
classification system using Local Binary
Patterns. In Intelligent Human Computer
Interaction (IHCI), 2012 4th International
Conference on (pp. 1-5). IEEE.

[7] Zhang, S., Zhao, X., & Lei, B. (2012). Facial

expression recognition based on local binary
patterns and local fisher discriminant analysis.
WSEAS Trans. Signal Process, 8(1), 21-31.
30

[8] Chibelushi, C. C., & Bourel, F. (2003).

Facial expression recognition: A brief tutorial
overview. CVonline: On-Line Compendium of
Computer Vision, 9.