A Facial-Expression Monitoring System for

Improved Healthcare in Smart Cities

Abstract:
Human facial expressions change with different states of health; therefore, a facial-
expression recognition system can be beneficial to a healthcare framework. In this paper, a
facial-expression recognition system is proposed to improve the service of the healthcare in a
smart city. The proposed system applies a bandlet transform to a face image to extract sub-bands.
Then, a weighted, center-symmetric local binary pattern is applied to each sub-band block by
block. The CS-LBP histograms of the blocks are concatenated to produce a feature vector of the
face image. An optional feature-selection technique selects the most dominant features, which
are then fed into two classifiers: a Gaussian mixture model and a support vector machine. The
scores of these classifiers are fused by weight to produce a confidence score, which is used to
make decisions about the facial expression's type. Several experiments are performed using a
large set of data to validate the proposed system. Experimental results show that the proposed
system can recognize facial expressions with 99.95% accuracy.

Existing System
 expression system was existing for people suffering from Asperger Syndrome in
however, the system was tested in the smart scenario.
 An audio-visual emotion recognition system was designed in, where some kinds of
transformations were applied to the input data.
 MPEG-7 low-level audio and IDP, for processing speech signals, using machine-learning
algorithms to classify the signal as normal or pathological
 emotional recognition system derived from a large pool of social networks using active
learning; however, how it could be used in healthcare was not mentioned.
 The effect of age, gender, and puberty on emotional recognition was analyzed.
 Surrey Audio- Visual Expressed Emotion Database (SAVEE), and Speech under
Simulated and Actual Stress (SUSAS).
  They obtained the recognition rates in the range of 90.31%_99.47% (BES database),
62.50%_78.44% (SAVEE database) and 85.83%_98.70% (SUSAS database).
Disadvantages
 Low quality data image shapes
 minimize energy function including data and shape priors
 training shapes are distributed according to a unimodal
 The technique cannot model more complex multimodal shape

Proposed System
 The proposed facialexpression recognition system is a smart video or a smart camera
constantly takes images of the patient in the smart home.
 The input to the system is the image taken by these sensors. Once an image is captured, a
face detector locates the facial region in the image.
 The detected face image is then transferred to the cloud. In the cloud server, the bandlet
transform decomposes the image into several sub-bands at different scales.
 A facial-expression recognition system using a bandlet transform and weighted CS-LBP
was proposed. The scores of two classifiers (the GMM and the SVM) were combined
using a weighted coefficient to make the recognition decision.
 Experiments were performed using three datasets: one locally recorded and the two
others public.
 the local dataset, the system achieved 99.95% accuracy, obtaining 99.9% accuracy with
the two public datasets.
 The proposed facial-expression recognition system can be used in a smart healthcare
framework.With this system, registered doctors and caregivers can constantly monitor
patients' feelings remotely and take appropriate actions as required.
 The system can also give stakeholders automatic feedback from patients without needing
to ask them for feedback.

Advantages
 Maximum a posteriori estimation framework.
  High energy functional for segmentation.using clasifiers GMM & SVM
 High quality & accuracy data image shapes using CS-LBP
 training shapes are distributes multimodal densities

Hardware Requirement Specification

Processor : Intel Pentium III or later

Main Memory(RAM) : 256 MB

Monitor : 17 inch Color Monitor

Keyboard : 108 Keys

Mouse : Optical Mouse

Hard Disk : 160 GB

Software Requirement Specification
Front End/Language : Matlab

Operating System : Windows Family