Motion Analysis of Pedestrians

for Behavior and Activity

Recognition
Binu M Nair
06/19/2013

Introduction

Applications of activity/action recognition

Gaming (Kinect)

Autonomous Visual Control of Fighter Jets by Air Crew hand gestures (ongoing research work)

Research Objectives

To detect and recognize harmful activities of individuals of interest from a set/pair of surveillance cameras at long range.

Motivation: Monitoring a crowded environment and locating suspicious activities by security personnel

Security personnel creates a temporary signature of people in the scene (type of clothing, the shape etc..)

Identifies the action of the person (walking, running etc..)

Locates the individual with suspicious action and then observes him closely of what he is doing( from the joints movements etc)

Introduction

To have an automated system to perform these tasks, there are 4 different entities
Automatic Pedestrian Unique ID tagger

Security personnel fairly knowing what each person looked like

Human Action Recognition

Seeing what action each one does : walking, running, bending etc..

Automatic Detection and Tracking of Specific body joints.

Examining a particular individual(performing a suspicious action) closely of what he/she does

Inference of what activity is performed by joint trajectory analysis based on context

Eg: Bending down to place a suitcase or pick up a box or tying his shoe lace etc..

Automatic Unique ID Tag

Detect
People
using
Generic
Human
Detector

Input Frame
from Camera

Extract Color
Descriptor

Human Detector

Using Histogram of Oriented Gradients

OpenCV implementation

Human Body region segmentation

Use a Foreground Extraction methodology

Use a fixed human body mask

Segmentation
of Human
Body Region

Extract Texture
Descriptor (LBP)

Need to use different poses of the human body mask

Feature Descriptors (Signature of Individual)

Texture Descriptor : Local Binary Pattern Histogram (LBPH)

Color Descriptor : Global Color Histogram in YCbCr space.

Check
for
Match

Yes

No

Update
descriptor
of Detected
Individual
Store
Descriptor of
New
Individual and
Assign Unique
ID

Results

Results