Face Recognition Using

Neural Networks
BY
SAJAL MAHAJAN UE 7561
 What is Face Recognition?
 A face recognition system is a computer application for automatically
identifying or verifying a person from a digital image or a video frame
from a video source. One of the ways to do this is by comparing selected
facial features from the image and a facial database.

 Feature to be compared for face recognition:

1. Inter-ocular distance
2. distance between the lips and the nose
3. distance between the nose tip and the eyes
4. distance between the lips and the line joining the two eyes
5. eccentricity of the face
6. ratio of the dimensions of the bounding box of the face
7. width of the lips
 What are Neural Network?
 A Neural Network is a system of programs and data structures
that approximates the operation of the human brain.
 A neural network usually involves a large number of
processors operating in parallel, each with its own small
sphere of knowledge and access to data in its local memory.
 Typically, a neural network is initially "trained" or fed large
amounts of data and rules about data relationships (for
example, "A grandfather is older than a person's father").
 A program can then tell the network how to behave in
response to an external stimulus or can initiate activity on its
own.
MODEL OF NEURON
 Neural Network Architecture
 Single layer feed forward network.

 Multilayer Feedforward Network

 Back-Propagation

 Self Organizing Map(Unsupervised Learning)

 Recurrent Network
Single layer feedforward
network
Multilayer Feedforward
Network
Recurrent Networks
 Learning Algorithms
 Supervised learning

 Unsupervised learning

 Reinforcement Learning
 Approaches to Feature Extraction
 Appearance Based
 Feature Based (Component Based)
 Appearance Based Methods
 Principle Component Analysis
 Linear Discriminant Analysis
Block Diagram of Different
Training Methods
PCA based Face Recognition

PCA
 Disadvantages of PCA
 Problems with Eigenfaces (PCA)
• Different illumination
• Different alignment
• Different facial expression

14
Block Diagram of LDA-NN Face
Recognition System
Steps For Face Recognition Using
LDA-NN
 Assumptions
• Square images with W=H=N
• M is the number of images in the
database
• P is the number of persons in the
database
 Algorithm For LDA-NN Face
Recognition.
 The database

 We compute the average of all faces

 Compute the average face of each person

 And subtract them from the training faces

We build scatter matrices S1, S2, S3, S4

And the within-class scatter matrix SW

From this scatter matrix we calculate the Fisher

face vectors.
 Fisherfaces, the algorithm
 The database
 a1   b1   c1   d1 
       
a2  b c d
      
2 2 2
      
 
       
a b c d
 N 
 N 
2
 N 2
 N 2 2

 e1   f1   g1   h1 
       
e f2  g h

2 
 
2 
 
2

        
       
e  f N 2  g h
 N2   N 2
 N 2
 Fisherfaces, the algorithm
 We compute the average of all faces

 a1  b1    h1 
 
 1  a2  b2    h2 
m , where M  8
M   
 
 aN 2  bN 2    hN 2 
 Fisherfaces, the algorithm
 Compute the average face of each
person
 a1  b1   c1  d1 
   
 1  a2  b2   1  c2  d2 
x , y ,
2    2   
   
 aN 2  bN 2   cN 2  dN 2 
 e1  f1   g1  h1 
   
 1  e2  f2   1  g2  h2 
z , w
2    2   
   
 eN 2  f N 2   gN 2  hN 2 
 Fisherfaces, the algorithm
 And subtract them from the training
faces
 a1  x1   b1  x1   c1  y1   d1  y1 
        
a  x b  x c  y  d  y
am  
2 
, bm  
2 
, cm  
2 
, dm  
 2 2  2 2 2 
,
              
       
 a N 2  xN 2   bN 2  xN 2   cN 2  y N 2   d N 2  yN 2 

 e1  z1   f1  z1   g1  w1   h1  w1 
         
e  z f 2  z2  g  w h  w
em  
2 
, gm  
2 
, hm  
 2  2 2 2 
, fm 
            
       
e
 N2  z N2   f N 2  z N 2  g
 N2  w N2 
h
 N2  w N2 
 Fisherfaces, the algorithm
 We build scatter matrices S1, S2, S3,
S4
   
       
S1  am am  bm bm , S 2  cm cm  d m d m ,

   
       
S3  em em  f m f m , S 4  g m g m  hm hm

 And the within-class

SW  S1  S 2  Sscatter
3  S4 matrix
SW
How is Face Recognition using LDA-NN performed
 Advantages of LDA-NN

 Faster than Eigen faces

 Has lower error rates
 Works well even if different illumination
 Works well even if different facial expressions.
 Works well with different allignment.

25
 Comparison
 FERET database

Best Identification rate: eigenfaces(or PCA)

80.0%, fisherfaces(or LDA) 93.2%
26
Comparison of Different Methods
of Face Recognition
 PROJECT OBJECTIVE
• To implement the concept of Neural Networks for the purpose of
Face Recognition.
• Further Recognition of unclear images by removing the
background noise.
• To improve the accuracy of Face recognition by reducing the
number of false rejection and false acceptance errors.
• To use Face Thermogram that is output of an infrared camera to
detect the faces in dark environments.
• Recognition of images captured while in motion.
• Recognition of faces in videos (motion picture).
 Advantages
 When an element (Artificial neuron) of the neural network
fails, it can continue without any problem by their parallel
nature.

 A neural network learns and does not need to be

reprogrammed.

 It can be implemented in any application.

 If there is plenty of data and the problem is poorly understood

to derive an approximate model, then neural network
technology is a good choice.
 Advantages (contd..)
 There is no need to assume an underlying data distribution
such as usually is done in statistical modeling.

 Neural networks are applicable to multivariate non-linear

problems.

 The transformations of the variables are automated in the

computational process.

 A neural network can perform tasks that a linear program can

not.
 Applications of Face
Recognition
• Passport control at terminals in airports
• Participant identification in meetings
• System access control
• Scanning for criminal persons

31
Thank you