rtual Keyboard and mous

using webcam

Presented By:
Archana Pawar
41
Jayasurya Pillai
43
Pooja More
37

Introduction
A virtual keyboard is a new technology of key inputs to a
computer, laptop, smart phones or any mobile devices, which
discards the need of a traditional physical button. Thus, it
enables users of a small handheld device such as a smart
cellular telephone, PDA or tablet to have full keyboard
capability. Currently, there are many types of virtual
keyboards, and one of them is projected keyboard.

Existing System and its disadvantages :

Physical QUERTY Keyboard

Bulky in Size

Offer little in terms of their ability

to modify hence where the size of
desktops and laptops is becoming
smaller, the traditional keyboard acts
as a hindrance to further
miniaturization
On-screen virtual keyboards

it is difficult to accommodate full

sized
keyboard on the screen as it
creates hindrance to see the
documents being typed
Other types of virtual keyboard
requires specialized devices such as
3D cameras.

Proposed System:
The ground breaking Virtual
Keyboard, uses state of the art
infrared & laser technology to project
a full-size keyboard onto any flat
surface.
For the first time mobile device users
can actually type normally on a
virtual keyboard , enabling them to
work quickly and effectively, taking
the pain and frustration out of
existing minuscule keyboards and
handwriting recognition software

Wo r k i n g
In the proposed system projected
keyboard should consist of three basic
modules:
projecting, sensing, and illuminating
Projecting will be done using laser
projector
(but due to budget constraint The
keyboard image Is drawn on a paper in a
conventional manner)
Sensing is done by web cam which is
used to detect red light reflected
from a keystroke
illuminating is done by red laser . This
is used to emit a thin layer of red light
across the keyboard area.

Ke y P r e s s e d D e t e c t i o n :
The first step in key press detection is processing the
images obtained from the camera to remove background
noise and emphasize the projected line.
Two frames are captured before processing occurs, one with
the laser module active and one with only the
environmental light.
The absolute difference of these two frames produces an
image with all background features removed leaving only the
bright red line
delay(due to use of webcam), combined with motion in the
environment, results in some motion noise in the difference
frame

Ke y P r e s s e d D e t e c t i o n C o n t d :
By making the assumption that the laser light is almost pure red,
while motion noise is a mix of colors, we are able to remove a
majority of it by taking only the red component of the difference
frame and subtracting the blue and green components from it.
We finally scale the image and discard any values below a certain
noise threshold.
The image is converted from a large array of pixel values to a
most likely keypress
coordinate by taking the weighted average of pixel coordinates
This can be used as a metric of keypress certainty
If it is above some threshold, we initiate a key press and we stop
the key press when it drops below another threshold.

Advantages:
Optical detection does not suffer from failure due
to repeated wear, and has reduced risk of damage due to
liquids or dust
can be used in environments excessive wear or harsh
condition
The typing does not require a lot of force. So easing the strain
on wrists and
hands.
system requires only a USB Webcam and an ordinary laser
pointer. Therefore, the overall cost is very low compared to
similar products.
small, handy, well-designed and easy to use application, turns
into a perfect solution for cross platform text input.
.

Advantages Contd:
Portability: With the growing interest in tablet computing, portable

keyboards

are becoming a necessary peripheral.

Accuracy
Speed of text entry
Lack of need for flat or large typing surface
Ability to minimize the risk for repetitives train injuries
Flexibility
The Virtual Keyboard is not restricted to the QWERTY touchtyping
paradigm, adjustments can be done to the software to fit
other touch-typing paradigms as well. is easy to be
reconfigured.very minimal re-calibration required.
No driver software necessary, It can be used as a plug and play
device.

APPLICATIONS
1. High-tech and industrial Sectors
2. Used with Smart phones, PDAs,
email, word processing and
spreadsheet tasks.
3. Operation Theatres.
It can be useful in places like
operation theaters where low noise is
essential.
4. As computer/PDA input.
5. Gaming control.
6. TV remote control

Fu t u r e Wo r k
The true application of this idea would be in
developing virtual keyboards for mobile
devices, which would enable us to use a full sized
QWERTY keyboard without the need for
additional physical space or hardware.
the VK can find applications in gaming, 3d
modeling etc
In a country like India, which has a rich
repository of languages, a Virtual Keyboard can
be used to generate
multilingual keyboards, by just changing the
internal mapping of characters, with no change in
hardware.
This can make multilingual keyboards
economically feasible. Finally, such a keyboard
creates the possibility of developing specialized
keyboards especially for the blind, without

Conclusion
Virtual Keyboard uses sensor technology and
Image Processing to let users work on any surface
as if it were a keyboard.
Projection key boards or virtual key boards claim to
provide the convenience of compactness with the
advantages of a full-blown QWERTY keyboard.
The Virtual Keyboard is designed for anyone who's
become frustrated with trying to put information
into a handheld but doesn't want to carry a
notebook computer around.

References:
[1] Kazim Sekeroglu, Virtual Mouse Using a
Webcam July 9, 2012
[2] Y. Sato,Y. Kobayashi,H. Koike Fast tracking
of hands and
fingertip in infrared images for augmented desk
interface,2000
[3] Z. Zhang, Y. Wu, Y.Shan, S. Shafer Visual
panel: Virtual
mouse keyboard detection July, 2003
[4] Shahzad malik Real time hand tracking and
fingertip tracking
for interaction CSC2503E Project Report December
18,2003 [5]
[5] Georg Hackenberg, Rod McCall, and
Wolfgang Broll
Lightweight palm and finger tracking for real

H
T
U

O
Y