Binu M Nair

PhD Student
Electrical and Computer
Engineering
nairb1@udayton.edu

Regression based Time-Invariant Modelling for Human Action/Gesture Recognition

Objectives

Learning Mechanism and Classification

To develop a mathematical model to recognize human actions/gestures Computation of Action Basis (Training)
in real time (from 10-15 frames).
Collection of all action features of class from training.

To find an appropriate actions basis on which no normalization of action

= : 1 ; :
cycle is required and is invariant to speed of motion.
Perform PCA on for action class to get Eigen action basis

and corresponding projections = { : 1 ; }.

Proposed Methodology
Learn mapping using generalized regression neural
network (GRNN).
Extract Features per frame:
Classification of action sequences (Testing)
Hierarchical Histogram of Flow (HHOF) :
,
Compute test projections
and estimate,
Local distribution of local motion vectors.
,
,
= (

)
Local Binary Flow Patterns( LBFP) :
Relationship between motion vectors.
Experiments
R-Transform :
Weizmann Action
Cambridge Hand Gesture
Gives shape representation of human pose.
Training Phase:
Accumulate all frames.
Extract Features.
Learn Eigen action basis
through PCA/GRNN.
Testing Phase:
Extract features
from few frames.
Find GRNN/Eigen
basis with lowest
discrepancy.

C
O
N
F
U
S
I
O
N

M
A
T
R
I
X