Presented By: Sibarama Panigrahi(11040056) VSSUT, Burla

Human Eye

Eye Tracking: Localization of Pupil of eye in an image or in a video from frame to frame.

Contents
Human Computer Interaction(HCI) Literature Review of Eye tracking How Human eye help in HCI Why Artificial Neural Network System Overview Working of System Advantage Limitations Conclusion Reference

Human Computer Interaction

Keyboard

Printer

Touch

Mouse Speech

Joystick

Scanner Eye Tracking

BCI

Literature Review
The study of eye movements pre-dates the widespread use of computers by almost 100 years (Javal, 1878/1879). Beyond mere visual observation, initial methods for tracking the location of eye fixations were quite invasive involving direct mechanical contact with the eye Dodge and Cline (1901) developed the first precise, non-invasive eye tracking technique, using light reflected from the cornea. Judd, McAllister & Steel (1905) applied motion picture photography to record the temporal aspects of eye movements in two dimensions. Cornsweet and Crane, 1973 uses multiple reflections from the eye could be used to dissociate eye rotations from head movement. Starker & Bolt, 1990 uses eye tracking to serve as a computer input device.

How Eye tracking help in HCI

Curser Control with out mouse
(Much Research is going on)

Using Eye blinking for event handling

(Not yet been much Explored)

Why Artificial Neural Network

Accurate Fast Affordable. Modest Hardware Requirement Allows for a fair range of head movements.

Desktop With a Camera Contact Lenses with Head Mounted Devices Skin Electrodes Mechanical Devices Using ANN

System Overview

Eye tracking device/Camera

Working
1. Eye Tracking (i.e. Finding of pupil position)[3][6] 2. Conversion between pupil position & Cursor Position.[1][2][4] 3. Event handling using Eye Blinking[Proposed]

1.Eye Tracking [3][6]

Frame in
Update frame Search Region Frame Search Region

Pre-Processing

Update Means And Covariance.

Bayesian Classifier

Clustering

Post-Processing

Yes
Location Of Eye.

Eyes Located Successfully?

No

2.Conversion between pupil position & Cursor Position.

2.1. Data Acquisition Phase (To Train the Artificial Neural Network(ANN))[2][4]
2.2. ANN For Curser positioning[1][2]

2.1. Data Acquisition Phase

2.1. Data Acquisition Phase

The training set is divided into sample Frames of 1/6th of sec.

In each Frame the pupil and its corresponding mouse curser position in terms of (x,y) co-ordinates are found and stored as training set.

These mouse curser positions(x,y) are multiplied by a interconnection weight and passed into first hidden layer.

The number of sample frames depends on duration of data acquisition.

Mathematically

nf = t / fs

Where nf =No. of Frames t=time of data acquisition fs =Rate at which sample frames are taken Hence No. of frames in a sec=6

2.2. ANN For Curser positioning

t= Time at which curser changes its position= (let 1sec ) fs =Rate at which sample frames are taken=1/6th of Sec n= Number of frames captured in t= 6 Number of eye positions 6 (x,y) co-ordinates

2. ANN For Curser positioning

ANN uses Back propagation algorithm for learning where the user wants to move the curser.

where
XIN and YIN= Final inputs of the neural network. NOX and NOY = Outputs calculated by the neural networks x and y = Coordinates of the eye position Xscreen and Yscreen =width and the height of the screen, respectively, each in pixels.

Event handling using Eye Blinking[Proposed]

Two eyes blink purposefully to perform double click. Left eye blinking can be used for left click of mouse. Right click of mouse can be used for right click of mouse.

Advantages
Eye tracking can allow people to use their eyes to communicate leading to Faster Interaction. Modest hardware requirement. Reduced cost. Its users include people with Brain injuries Cerebral palsy Multiple sclerosis Muscular dystrophy Spinal cord injuries Spinal muscular atrophy

Disadvantages
Number of eye images are required to train the neural network. Voluntary closure of eyes would result in the algorithms failing to track the eyes. Another inherent assumption is that the speakers eyes are always in the field of view of the camera.

Conclusion
Although eye tracking for human Computer Interaction is a technology over the last 20 years but still a lot of aspects like eye blinking can be used for handling events , head position movement, etc will help in designing more interactive interfaces leading to ambient intelligence.

References
1.

2.

3.

4.

5.

6.

E. DEMJN1, V. ABOSI2, Z. TOMORI1 , Eye Tracking Using Artificial Neural Networks for Human Computer Interaction Physiol. Res. 60: 841-844, 2011 . Anaelis Sesin, PhD; Malek Adjouadi, PhD;* Mercedes Cabrerizo, PhD; Melvin Ayala, PhD; Armando Barreto, PhD, Adaptive eye-gaze tracking using neuralnetwork-based user profiles to assist people with motor disability, Journal of Rehabilitation Research & Development Volume 45,Pages 801818 , Number 6, 2008. A. Haro, M. Flicker and I. Essa, Detection and tracking eyes by using their physiological properties, dynamics and appearance, Proceedings of IEEE CVPR 2002. Adjouadi M, Sesin A, Ayala M, Cabrerizo M. Remote eye gaze tracking system as a computer interface for persons with severe motor disability. In: Lecture notes in computer science. Vol. 3118. Berlin (Germany): Springer; 2004. p. 76169. Robert J.K. Jacob, Ph.D., Keith S. Karn, Ph.D. Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. Subramanya Amarnag, Raghunandan S. Kumaran and John N. Gowdy, REAL TIME EYE TRACKING FOR HUMAN COMPUTER INTERFACES Proceedings of IEEE CVPR 2006.