An Emergency alert and smart home

automation using eye blinking

signals for patients with severe
disorder.
 Scope of the project
• The scope of the project is to develop a EOG
based HMI for smart home environmental
control with the purpose of providing daily
assistance for severe spinal cord injury
patients.
 Abstract
• Smart home automation is is one of the key
fields in Robotics.
• Efficient alternative controlling capabilities are
important for people with severe disorder.
• Human eye movements have been recently
used with success in human-computer
interaction
 Abstract
• This project proposes a new approach to real-
time smart home appliances controlling by
integrating an Electrooculography (EOG)
measuring device within human-robot
interaction (HRI).
• A new EOG-based HMI paradigm has been
developed on the specific defined problem of
eye blinking.
 Introduction
• Severe spinal cord patients are unable to
normally communicate with their environment.
• For these patients, the only part of their body
that is under their control, in terms of muscular
movement, is their eyeballs.
• The biggest problem that paralyzed patients
face is leading their own life without anyone
else‟s help.
 Introduction
• This includes basic day to day operations like
switching on an appliance or increasing the
speed of fan.
• Most of the existing system use sophisticated
hardware and software to make the control
easier and efficient.
• But the biggest problem which a paralyzed
patient faces while using these system is
accessibility.
 Introduction
• To address these issues, a novel EOG based
HMI is going to develop for home
environment control
 Existing System
• Joystick.
• Finger movement.
• Speech.
• Wifi based smart home automation system.
• IoT based automation system.
• Eye blink Sensor based.
 Disadvantages
• These existing system are applicable only for
the normal person or with simple disorders.
 Proposed System
• With eye blinks as gestures, our objective is to
develop a BrainComputer Interface (BCI) with
a single channel EOG Signal.
• By using an eye blink as an input device, a
person may be able to communicate with
Visual cue to get simple chores done.
 Advantages
• Communication is simpler
• low cost eye movement based detection.
• inexpensive
 Problem Description
Once the system is started, menu is shown to
the display by system, in which focus is rotating
between every menu option. Patient can enter in
particular menu by eye signal, when focus is on
menu that he/she wants to select. Same way
he/she can make selection in sub menu. All
question or selection on screen is controlled by
eye signal. This way patient can control home
appliances (like, light, fan, TV etc. - ON/OFF)
without need of anyone.
 Literature Survey
1. Grave de Peralta Menendez, R., Noirhomme, Q., Cincotti, F.,
Mattia, D., Aloise, F., Andino, S.G.: Modern
Electrophysiological Methods for Brain-Computer Interfaces.
Computational Intelligence and Neuroscience Journal, vol.
2007, Hindawi Publishing Corporation (2007).
EEG-based brain-computer interfaces
(BCI) still employ as control modality
relatively slow brain rhythms or features
derived from preselected frequencies and scalp
locations.
2. Ali Bulent Usakli and Serkan Gurkan, “Design of a
Novel Efficient Human–Computer Interface: An
Electrooculogram Based Virtual Keyboard”, IEEE
Transactions on Instrumentation and Measurement ,
VOL. 59, NO. 8, PP 2099-2108.,AUGUST 2015.
EOG-based systems are more efficient than
electroencephalogram (EEG)-based systems in some
cases. By using a realized virtual keyboard, it is
possible to notify in writing the needs of the patient in a
relatively short time. Considering the biopotential
measurement pitfalls, the novel EOG-based HCI
system allows people to successfully communicate with
their environment by using only eye movements.
 System Requirements
Hardware
• Processor (CPU) : Intel Core i5 or i7
• Memory : 4GB+
• Hard Drive : 100GB+ SSD
Software
• Windows Family
• Java SE 7 Software Development Kit
• Eclipse 3.7.2 (Classic) IDE for Java Developers
 System Architecture
Training Phase Testing Phase

Preprocessing Preprocessing

Feature Extraction Feature Extraction Visual Cue

Eye Blink Detection Eye Blink Detection

Home Appliances

Database Emergency alert

Decision Making
 Modules List
Eye Blink Detection Phase
1. EOG Signal Acquisition
2. Feature Selection
3. Blink Detection
4. Decision Making
GUI Phase
5. Visual Cue
Controlling Phase
6. Home Appliances
7. Emergency Alert
 Module Description
Eye Blink Detection Phase
1. EOG Signal Acquisition
This module has designed EOG
acquisition hardware and eye movement
analysis software for real-time data. Noise
affecting the EOG signal and its removal
techniques are also applied. open and close eye
movements are detected as negative and
positive.
 Contd..
2. Feature Extraction
In this module, EOG signals obtained from
NuAmps device with two directional eye
movements were employed: open and close.
Maximum peak amplitude value (PAV): It is a
measure of the EOG signal amplitude value at
the highest point, maximum positive value, in
both V and H channels
 Contd..
3. Blink Detection
In this module an efficient and robust eyeblink
detection algorithm based on nonlinear analysis of
the electrooculogram (EOG) signal. The binary
classification was performed on the two acquired
set of detail coefficients to distinguish between
blinks and non-blink eye movements using linear,
polynomial and Radial Basis Function (RBF)
kemelized Support Vector Machine (SVM)
classifier.
 Contd…
4. Decision Making
In this module the button flash in the first
round, if a blink is detected, this button is
termed a potential target and a weighted value
of 1 is assigned. Furthermore for those button
flashes in this round where no blinks detected,
the weighted values are set to 0.
 GUI Phase
5. Visual Cue
In this module, the visual cues buttons are
created for helping people to focus their
attention to important information on a
display.Each flash of the button function as a
visual cue for the user to blink.
 Controlling Phase
6. Home Appliances
In this module, the household electrical
appliances in a room are controlled via eye
blink using EOG Signals.
 Contd..
7. Emergency Alert
This Alert Visual cue is working as a
transmission medium between System,
guardian and doctor. Whenever if any
abnormality comes in the health of the patient
then the visual cue detect that and give the
miss call and alert message via this sms
service provider to the Doctor’s and guardian
cell phone.
 Conclusion
• This project is fully depend on lighting
condition and also this application is very
helpful for paralyzed person which are not able
to control appliances. In Future, It can also be
used for variety of other functions.