G S S S Institute of Engineering and Technology for Women

Department of Computer Science &

Engineering

VIDEO BASED HUMAN

INTERACTION 4D TOUCHPAD
by:

Ranjana H(4GW10CS059)
Under the guidance of:

Mr.Sumal Raj M
Associate Professor
Dept of CSE
1

Contents
Current Human Interaction Technique
WIMP MODEL

4D Touchpad
Structure and working
Visual Touchpad
System Overview
Conclusion
References
2

Current Human Computer Interaction Technique

Human computer interaction is a discipline concerned with the

design , evaluation and implementation of interactive computing

systems for human use.
An interaction model is a set of principles, rules and properties

guiding an interfaces design.

TYPES OF HCI
Command Based HCI :

various commands are used to interact with the system.

GUI :

uses mouse for the interaction.

Vision Based System :

It is the most user-friendly technique based on visual

interaction cue.
4

WIMP MODEL

Principles of direct manipulation interaction model

Continuous representation of objects of interest.
Physical actions or labeled button.
Rapid ,incremental, reversible operations.

Limitations of wimp
Limits the number of active users to one at any given time.
Restricts the actions a user can perform on an interface

component to click and drag.

6

4D TOUCHPAD An overview
We live in a world of three dimensions.
The fourth dimension can be:
Fragrance
Sense of touch
Time
Concept of 4D combines space and time .

What is 4D Touchpad?
A touchpad is a device for pointing on a computer display screen.
Direct interaction with interface components through intuitive actions and

gestures.

A picture of first prototype 4DT.

Structure of 4D Touchpad

Schematics of 4DT
9

Working of 4D Touchpad
Based on 3D-2D projection-based mode of the VICs (visual

interaction cue) framework.

Expensive global image processing with user modelling and

tracking is not necessary in general vision-based HCI.

10

Visual Touchpad
Low-cost vision-based input device ,allows for fluid two-handed

interactions .
Advantages
Enjoyable and efficient than using a mouse and keyboard .
User can focus more on the task.

Increased degree of control as well as comfort.

11

Example configurations for the Visual Touchpad

(a)Desktop setup; (b) Laptop setup; (c) Hand-held setup.

12

System overview
Hardware: we use a piece of paper with a large black

rectangle region-touchpad
Homography computation: corners of touchpad map to the

corners of the display.

Touchpad detection: (a) Original frame; (b)Threshold binary image;

(c) Corners detected.

13

Hand Tracking
Applies low-level image processing operations to each frame of

video in order to detect the locations of the fingertips.

Image Rectification
Background Subtraction
Hand Blob Detection
Fingertip Detection
(a) Original image; (b) Warped image; (c) After background subtraction;
(d) Finger tip positions and orientations detected.
14

Fingertip Labeling: If a single fingertip is detected it is always

labeled as the index finger.
Postures and Gestures:
Pointing posture
Pinching posture
L-posture
Five-finger posture
Posture set: (a) Pointing; (b) Pinching; (c) L-posture; (d) Five-finger

15

Conclusion
A new interface platform based on proposed VICs framework :

the 4D Touchpad.
The robustness of the processing and the marginal load on the

host system for the idle processing of the VICs interface proves
the usefulness of the simple-to-complex processing in a local
ROI of each VICon.

16

References
D.Gavrila and L.Davis Towards 3-d model-based tracking an

recognition of human movement.

http://en.wikipedia.org/wiki/WIMP (computing)
http://en.wikipedia.org/wiki/Fourth dimension
A Introductory Techniques for 3-D Computer Vision.
Corso J:The 4D Touch pad, Unencumbered HCI with VICs.

17

18