1

CHAPTER 1

INTRODUCTION

India constitutes 1.324 billion of the total population, which holds 20% of Deaf
and Dumb population. These people lack the amenities which a normal person should
own. Man is a social being so it is natural for him to interact and communicate.
Communication is a process of exchanging ideas, thoughts, feelings and information in
the form of verbal or non-verbal message. But communication for a person who cannot
hear is visual, but not auditory. The biggest reason behind this is lack of communication
as deaf people are unable to listen and dumb people are unable to speak.

Deaf and Dumb work survey

Deaf & Dumb

Literate D&D

Graduate D&D

Employed D&D

0 20 40 60 80 100 120

Deaf and Dumb work survey

Figure- 1.1 Graphical representation of deaf and dumb population

This decreasing ratio of literate and employed deaf and dumb population is a
result of physical disabilities so it yields lack of communication between normal person
and deaf and dumb Person. It actually becomes the same problem of two persons who
knows two different languages, no one of them know any common language so it
becomes a problem to talk with each other and so they require a translator physically
which may not be always convenient to arrange and this same kind of problem occurs
between the normal person and the deaf person orthe normal person and dumb person.
Hence they cannotstand in race with normal person. This creates a barrier between
normal person’s life and their life.
 2

The World Federation of the Deaf (WFD) is the International non-governmental

organization representing approximately 72 million deaf people worldwide and total 90
billion people with both the disability. It wasestablished in Rome, Italy on 23 September
1951 during the first World Congress of National Deaf Associations.

To overcome this problem, a unique application has been introduced. The

application model is a desirable Interpreter which converts gestures into text and speech
with the help of some electronic components and sensors. This model will help normal
and deaf and dumb communities by removing the communication gap between them.

The Sign Language is an important and only method of communication for deaf
–dumb persons. As sign language is a formal language employing a system of hand
gestures for communication. The sign language symbol is shown in the below figure.

Figure- 1.2 Some common gestures and their functions

By using this sign language a new application has been developed known as
smart glove. The main aim of the proposed system is to develop a cost effective system
which can give voice to voiceless person with the help of Smart Gloves. Use of smart
glove by person with disability makes nation grow and also they will not differ
themselves from the normal people. It is an electronic device that translates sign
language into text or speech in order to make the communication feasible between the
 3

mute communities and with the general public. This glove translates the sign language
gestures according to the American Sign Language Standard. This glove has been
implemented with the help of flex sensors, microcontroller (ArduinoUNO), voice
module and the LCD display.Smart glove is a driving glove which is fitted with the flex
sensors along the length of each finger.When the hand is moved, the movement is
detected and the corresponding function to that valid movement is displayed.
 4

CHAPTER 2

VARIOUS METHODOLOGIES FOR GESTURE

COMMUNICATION

A gesture may be defined as a movement, usually of hand or face that expresses

an idea, sentiment or emotion e.g. rising of eyebrows, shrugging of shoulders are some
of the gestures we use in our day to day life. Sign language is a more organized and
defined way of communication in which every word or alphabet is assigned some
gesture. In American Sign Language (ASL) each alphabet of English vocabulary, A-Z,
is assigned a unique gesture. Sign language is mostly used by the deaf, dumb or people
with any other kind of disabilities. With the rapid advancements in technology, the use
of computers in our daily life has increased manifolds. Our aim is to design a Human
Computer Interface (HCI) system that can understand the sign language accurately so
that the signing people may communicate with the non-signing people without the need
of an interpreter. It can be used to generate speech or text.

Utilising the idea of signals, few endeavours have been made in the past to
perceive the motions made utilising hands yet with confinements of acknowledgement
rate and time which include:
1. Using CMOS camera
2. Leaf-switches-based glove
3. Copper-plate-based glove
4. Flex sensor based glove

2.1 USING CMOS CAMERA:

It transmits image data via UART serial port. Hand Gestures can detect using
CMOS camera by 3 steps
• capturing the image of gesture
• edge detection of that image
• peak detection of that image
Initially hand gesture image is captured by CMOS camera as shown in figure then
we get boundary of hand gesture by detected by edge detection principle as shown in
fig. 3. Finally open figures of hand gestures are detected by peak detection principle as
shown in fig. 3.
 5

There are so many drawbacks on using camera module. They are

• latency, it takes approximately 8 sec to capture image
• highly expensive
• each image occupies nearly 50Kb memory
• programming complexity with microcontrollers.

Figure-2.1 CMOS Camera

2.2 LEAF SWITCH BASED GLOVES:

These are similar to normal switches but these are designed in such a way that
when pressure is applied on the switch, the two ends come into contact and the switch
will be closed. These leaf switches are placed on the fingers on the glove such that the
two terminals of the switch come into contact when the finger is bent. Under normal
condition, when the finger is straight, the supply voltage 5V will pass through the MC
input. But when the finger is bent, the switch will be closed and the supply voltage will
be drained through the ground and a voltage of 0V reaches the MC input indicating that
the finger is closed. Thus appropriate digital patterns are formed similar to the previous
case and it is processed for further detail.

DISADVANTAGE: The Drawback associated with the Leaf switches is that after
prolonged usage, the switch instead of being open when the finger is straight, it will be
closed resulting in improper transmission of gesture.
 6

Figure-2.2 Leaf switch

2.3 COPPER PLATE BASED GLOVES:

This glove can be made using small metal strips that are fixed on the five fingers
of the glove as shown below. A copper plate is fixed on the palm as ground. It is better
to use a ground plate instead of individual metal strips is because the contact area for
ground will be more facilitating easy identification of finger position. The copper strips
indicate a voltage level of logic 1 in rest position. But when they come in contact with
the ground plate, the voltage associated with them is drained and they indicate a voltage
level of logic 0. Thus necessary gestures are formed.

Disadvantage: The use of copper plate makes the glove bulky which makes it
unsuitable to use it for a long time.

Figure-2.3 Copper plate based glove

 7

2.4 FLEX SENSOR BASED GLOVE:

Flex means bend or curve .Sensor refers to a transducer which converts physical
energy into electrical energy. Flex Sensor is a resistive sensor which changes its
resistance as per the change in bend or curvature of it into analog voltage. The flex
sensors were connected to inputs IN0 … IN5 with the voltage divider as shown in figure
2.4.

The resistor R1 is the flex sensor which starts at minimum bend with a resistance
of 10 K. By combining the flex sensor with a static resistor to create a voltage divider,
you can produce a variable voltage that can be read by a microcontroller’s analog-to-
digital converter.

ADVANTAGES:

• Easy to use

• Simple voltage divider circuit is used

Figure-2.4 Flex sensor based glove and its connections to Arduino UNO
 8

CHAPTER 3

BLOCK DIAGRAM AND COMPONENTS OF SMART

GLOVES

3.1 PURPOSE OF SMART GLOVES:

The main aim of the proposed project is to develop a cost effective system which
can give voice to voiceless people with the help of smart gloves. It means that using
smart glove by the deaf person enables them to communicate with others which also
helps to bridge the gap between people with disability and normal people. Problems
faced by the deaf person regarding employment can be overcome by this method. So in
the proposed system Arduino based system using flex sensors will be developed which
is able to:

• To develop a coding for the system so that it receives multiple instructions

from gesture recognition system using Flex sensors.
• To develop aArduino based cost effective system to recognize gesture and
convert into some coded form so that it can be displayed in the display board.

BLOCK DIAGRAM:
POWER SUPPLY

FLEX SENSOR 1 R

D
FLEX SENSOR 2
U
LCD
I
FLEX SENSOR 3
N

FLEX SENSOR 4 O

UNO VOICE SPEAKER

FLEX SENSOR 5 MODULE

Fig -3.1 Block diagram of Smart Gloves

O
 9

Figure-3.1.1 Schematic diagram of smart gloves

 10

3.2 COMPONENTS OF SMART GLOVE:

3.2.1 POWER SUPPLY:-

A power supply is a hardware component that supplies power to an electrical

device. It receives power and converts the current from AC to DC. The input to the
circuit is applied from the regulated power supply. The a.c. input i.e., 230V from the
mains supply is step down by the transformer to 12V and is fed to a rectifier. The output
obtained from the rectifier is a pulsating d.c voltage. So in order to get a pure d.c
voltage, the output voltage from the rectifier is fed to a filter to remove any a.c
components present even after rectification. Now, this voltage is given to a voltage
regulator to obtain a pure constant dc voltage.

3.2.1.1 Transformer:
Usually, DC voltages are required to operate various electronic equipment and
these voltages are 5V, 9V or 12V. But these voltages cannot be obtained directly. Thus
the a.c input available at the mains supply i.e., 230V is to be brought down to the
required voltage level. This is done by a transformer. Thus, a step down transformer is
employed to decrease the voltage to a required level.

Figure-3.2 Components of regulated power supply

 11

3.2.1.2 Rectifier:
The output from the transformer is fed to the rectifier. It converts A.C. into
pulsating D.C. The rectifier may be a half wave or a full wave rectifier. In this project, a
bridge rectifier is used because of its merits like good stability and full wave
rectification.

3.2.1.3 Filter:
Capacitive filter is used in this project. It removes the ripples from the output of
rectifier and smoothens the D.C. Output received from this filter is constant until the
mains voltage and load is maintained constant. However, if either of the two is varied,
D.C. voltage received at this point changes. Therefore a regulator is applied at the
output stage.

3.2.1.4 Voltage Regulator:

As the name itself implies, it regulates the input applied to it. A voltage regulator
is an electrical regulator designed to automatically maintain a constant voltage level. In
this project, power supply of 5V and 12V are required. In order to obtain these voltage
levels, 7805 and 7812 voltage regulators are to be used. The first number 78 represents
positive supply and the numbers 05, 12 represent the required output voltage levels.
The things required to power up the Arduino UNO are:

• An Arduino UNO board

• Standard A-B USB Cable

• AC to DC Adapter

• Jumper wires.
 12

Figure-3.2.1 Power supply barrel connector

The barrel connector can be supplied an input of 7-12V. This is regulated to 5V

by the on-board voltage regulator, and the board is powered on.

3.3 FLEX SENSORS:-

A flex sensor or bend sensor is a sensor that measures the amount

of deflection or bending. Usually, the sensor is stuck to the surface, and resistance of
sensor element is varied by bending the surface. Since the resistance is directly
proportional to the amount of bend it is used as goniometer, and often called
flexible potentiometer.

The Flex Sensor is a unique component that changes resistance when bent. An
inflexed sensor has a nominal resistance of 10,000 ohms (10 K). As the flex sensor is
bent the resistance gradually increases. When the sensor is bent at 90 degrees its
resistance will range between 30-40 K ohms. The sensor measures 1/4 inch wide, 4 1/2
inches long and is only .019 inches thick.

Figure- 3.3 Flex sensor diagram

 13

3.3.1 Features of flex sensors:

• Angle Displacement Measurement

• Bends and Flexes physically with motion device
• Possible Uses
• Low profile
• Simple construction
3.3.2 Specifications of flex sensors:

Parameter Value

Life cycle >1 million

Height <0.43mm

Temperature range -35C to +80C

Table-3.1 Specifications of flex sensors

3.3.3 Working of flex sensors:

Flex sensor work just like variable resistors, in that if you change a ‘variable’,
then it’s resistance will increase or decrease accordingly. If paired up with to an
Arduino or any microcontroller with analogue input pins, the desired output is
obtained. One side of flex sensor is printed with a polymer ink .which has conductive
particles embedded in it. When the sensor is straight, the particles give the ink a
resistance of about 10k Ohms. When the sensor is bent away from the ink, the
conductive particles move further apart, increasing this resistance to approximately
30k to 40k Ohms. This sudden increase in resistance causes variations in voltage,
triggering the output device, which the flex is connected with.

The impedance buffer in the [Basic Flex Sensor Circuit] is a single sided
operational amplifier, used with these sensors because the low bias current of the op
amp reduces error due to source impedance of the flex sensor as a voltage divider.
 14

Figure-3.3.1 Equivalent circuit diagram of flex sensor

3.4 ARDUINO UNO:

The Arduino UNO is the most used and documented board in the
arduinofamily.UNO is a great choice for first Arduino as it is relatively cheap and very
easy to setup and it is the toughest board you can play with. In rare cases even if you
mess up with the board you can just change the ATmega 328p microcontroller for a few
bucks(around 6$/200 INR) as UNO is a surface mount version with DIP package. It is a
huge advantage of Arduino UNO.

3.4.1 ARDUINO UNO -R3:

"UNO" means one in Italian and it is named to mark the release of Arduino
software IDE 1.0.The latest Arduino UNO R3 was released in 2011 and it is the third
revision of UNO boards.

3.4.2Specifications of Arduino UNO:

• Microcontroller : ATmega328p
• Operating Voltage : 5V
• Input Voltage (recommended) : 7-12V
• Input Voltage (limits) : 6-20V
• Digital I/O Pins : 14 (of which 6 provide PWM output)
• Analog Input Pins : 6
• DC Current per I/O Pin : 40 mA
• DC Current for 3.3V Pin : 50 mA
• Flash Memory : 32 KB (ATmega328) of which 0.5 KB used by bootloader
SRAM 2 KB (ATmega328)
• EEPROM : 1 KB (ATmega328)
• Clock Speed : 16 MHZ
 15

3.4.3 Arduino UNO Microcontroller:

Figure-3.4 Arduino UNO microcontroller

The Arduino UNO is based on ATmega 328p microcontroller and it also has
ATmega16U microcontroller.
1. ATmega328p :It is the brain of the Arduino and it is a high performance Atmel
pico power 8bit AVR RISC based microcontroller which is cable of executing powerful
instruction in single clock
2. ATmega16U2 :This microcontroller takes care of the USB connection and ICSP
bootloader.
 16

3.5 VOICE MODULE (aPR33A1):

This voice recognition module is a compact and easy-control speaking

recognition board. This product is a speaker-dependent voice recognition module. It
supports up to 80 voice commands in all. Max 7 voice commands could work at the
same time. Any sound could be trained as a command. The aPR33A series are powerful
audio processor along with the high performance audio, Analog-to-digital converters
(ADCs) and digital-to-analog converters (DACs). The aPR33A series are a fully
integrated solution offering high performance and unparalleled integration with analog
input, digital processing and analog output functionality. The aPR33A series
incorporates all the functionality required to perform demanding audio/voice
applications. High quality audio/voice systems with lower bill-of-material costs can be
implemented with the aPR33A series because of its integrated analog data converters
and full suite of quality-enhancing features such as sample-rate conversion.
The aPR33A series C2.0 is specially designed for simple key trigger, user can
record and playback the message averagely for 1, 2, 4 or 8 voice message(s) by switch,
It is suitable in simple interface or need to limit the length of single message, e.g. toys,
leave messages system, answering machine etc. Meanwhile, this mode provides the
power-management system. Users can let the chip enter power-down mode when
unused. It can effectively reduce electric current consuming to 15uA and increase the
using time in any projects powered by batteries.

Figure-3.5 Voice module (aPR33A)

Today’s consumers demand is to get best audio/voice. They want crystal clear
sound wherever they are in, whatever format they want to use. This delivers the
technology to enhance a listener’s audio/voice experience.
 17

3.5.1 Features of Voice Module:

• Operating Voltage Range: 3V ~ 6.5V.

• Single Chip, High Quality Audio/Voice Recording & Playback Solution.
• No External ICs Required.
• Minimum External Components.
• User Friendly, Easy to Use Operation.
• Programming & Development Systems Not Required.
• 170/ 340/ 680 sec. Voice Recording Length in aPR33A1/aPR33A2/aPR33A3.
• Powerful 16-Bits Digital Audio Processor.
• Nonvolatile Flash Memory Technology.
• No Battery Backup Required.
• External Reset pin.
• Powerful Power Management Unit.
• Very Low Standby Current: 1uA.
• Low Power-Down Current: 15uA.
• Supports Power-Down Mode for Power Saving.
• Built-in Audio-Recording Microphone Amplifier.
• No External OPAMP or BJT Required.
• Easy to PCB layout.
• Configurable analog interface.
• Differential-ended MIC pre-amp for Low Noise.
• High Quality Line Receiver.
• High Quality Analog to Digital, DAC and PWM module.
• Resolution up to 16-bits..
• Averagely 1,2,4 or 8 voice messages record & playback.

3.5.2 Message Modes:

In fixed 1/ 2/ 4/ 8 message mode (C2.0), user can divide the memory averagely
for 1, 2, 4 or 8 message(s). The message mode will be applied after chip reset by the
MSEL0 and MSEL1 pin. Please note the message should be recorded and played in
same message mode, we CAN NOT guarantee the message is complete after message
mode changed. For example, user recorded 8 messages in the 8-message mode, those
 18

messages can be played in 8-message mode only. If user changed to 1, 2 or 4 message

mode, system will discard those messages.

• 8-Message Mode:
The memory will be divided to 8 messages averagely when
both MSEL0 and MSEL1 pin float after chip reset.

Figure-3.5.1 Connection diagram for 8 message mode

• 4-Message Mode:
The memory will be divided to 4 messages averagely when MSEL0 pin
connected to VSS and MSEL1 pin float after chip reset.

Figure-3.5.2 Connection diagram for 4 message mode

 19

• 2-Message Mode:
The memory will be divided to 2 messages averagely when MSEL1 pin
connected to VSS and MSEL0 pin float after chip reset.

Figure-3.5.3 Connection diagram for 2 message mode

• 1-Message Mode:

The memory will be for 1 message when both MSEL0 and MSEL1 pin
connected to VSS after chip reset.

Figure-3.5.4 Connection diagram for 1 message mode

 20

3.5.3 RECORD MESSAGE:

During the /REC pin drove to VIL, chip in the record mode.When the message
pin (M0, M1, M2 … M7) drove to VIL in record mode, the chip will playback “beep”
tone and message record starting.
The message record will continue until message pin released or full of this
message, and the chip will playback “beep” tone 2 times to indicate the message record
finished.
If the message already exists and user record again, the old one’s message will
be replaced.The following fig. showed a typical record circuit for 8-message mode. We
connected a slide-switch between /REC pin and VSS, and connected 8 tact-switches
between M0 ~ M7 pin and VSS. When the slide-switch fixed in VSS side and any tact-
switch will be pressed, chip will start message record and until the user releases the tact-
switch.

Note: After reset, /REC and M0 to M7 pin will be pull-up to VDD by internal
resistor.

Figure-3.5.5 Connection diagram for recording the message

 21

3.5.4 PLAYBACK MESSAGE:

During the /REC pin drove to VIH, chip in the playback mode.When the
message pin (M0, M1, M2 … M7) drove from VIH to VIL in playback mode, the
message playback starting. The message playback will continue until message pin drove
from VIH to VIL again or end of thismessage. The following figure showed a typical
playback circuit for 8-message mode. We connected aslide-switch between /REC and
VSS, and connected 8 tact-switches between M0 ~ M7 and VSS. When the slide-switch
fixed in float side and any tact-switch will be pressed, chip will start message playback
and until the user pressed the tact-switch again or end of message.
Note: After reset, /REC and M0 to M7 pin will be pull-up to VDD by internal
resistor.

Figure-3.5.6 Connection diagram for playback the message

3.6 LIQUID CRYSTAL DISPLAY:

LCD stands for Liquid Crystal Display. It has found wide spread use replacing
LEDs (seven segment LEDs or other multi segment LEDs) because of the following
reasons:

1. The declining prices of LCDs.

2. The ability to display numbers, characters and graphics. This is in contrast to LEDs,
which are limited to numbers and few characters.
3. Incorporation of a refreshing controller into the LCD, thereby relieving the CPU of
the task of refreshing the LCD. In contrast, the LED must be refreshed by the CPU to
keep displaying the data.
 22

4. Ease of programming for characters and graphics.

Figure 3.6 LCD display

3.6.1 LCD Screen:

LCD screen consists of two lines with 16 characters each. Each character
consists of 5x7 dot matrix. Contrast on display depends on the power supply voltage
and whether messages are displayed in one or two lines. For that reason, variable
voltage (0-Vdd) is applied at pin marked as Vee. Trimmer potentiometer is usually used
for that purpose. Some versions of displays have built in backlight (blue or green
diodes).In operation, a resistor for current limitation should be used (like with any LE
diode).
 23

Figure-3.6.1 Interfacing of LCD display board

3.6.2 LCD Basic Commands:

1. All data transferred to the LCD through outputs D0-D7 will be interpreted as
commands or data, which depends on the logic state on pin RS.

2. RS = 1 – (D0 - D7) are addresses of characters that should be displayed. Built in

processor addresses built in “map of characters” and displays corresponding
symbols.

3. Displaying position is determined by DDRAM address. This address is either

previously defined or the address of previously transferred character is
automatically incremented.

4. RS = 0 – (D0 - D7) are commands which determine display mode. List of

commands which LCD recognizes are given in the table below:

3.6.2.1 LCD Commands:

Execution
Command RS RW D7 D6 D5 D4 D3 D2 D1 D0
Time

Clear display 0 0 0 0 0 0 0 0 0 1 1.64Ms

Cursor home 0 0 0 0 0 0 0 0 1 x 1.64mS

Entry mode set 0 0 0 0 0 0 0 1 I/D S 40uS

Display on/off control 0 0 0 0 0 0 1 D U B 40uS

Cursor/Display Shift 0 0 0 0 0 1 D/C R/L x x 40uS

 24

Function set 0 0 0 0 1 DL N F x x 40uS

Set CGRAM address 0 0 0 1 CGRAM address 40uS

Set DDRAM address 0 0 1 DDRAM address 40uS

Read “BUSY” flag (BF) 0 1 BF DDRAM address -

3.6.3 LCD Initialization:

Once the power supply is turned on, the LCD is automatically cleared. This
process is done in approximately 15mS. After that, the display is ready to operate. The
mode of operation is set by default. This means that:

1. The display is cleared

2. Mode

DL = 1 Communication through 8-bit interface

N = 0 Messages are displayed in one line

F = 0 Character font 5 x 8 dots

3. Display/Cursor on/off

D = 0 Display off

U = 0 Cursor off

B = 0 Cursor blink off

4. Character entry

ID = 1 (Addresses on display are automatically incremented by 1)

S = 0 Display shift off

 25

Automatic reset is mainly performed without any problems. If due to any fault,
power supply voltage does not reach full value in thecourse of 10mS, There will be a
unpredictable performance in the start. If voltage supply unit cannot meet this condition,
the process of initialization must be applied.

Algorithm according to the initialization is being performed depends on whether

the connection to the microcontroller is through 4- or 8-bit interface. After that basic
commands are given to display message.The alphanumeric 16 character X 2 line LCD
requires 8 data lines and also 3 control signals and they are interfaced to 3664 by using
2 ports, port 0&3. Data pins are connected to LCD as data bus. Port0 can be basically
used as I/O port i.e. it can be programmed as an input or as an output port.

That means if it is programmed as output port, it is not possible to read data from
LCD immediately. Before reading the data it is required to make the port as an input
port. Data reading from LCD gives an erroneous reading & should not be implemented.
Because of this port 5 is made as input /output port depending on the situation. The
control signals are connected to port 3 pins. They are EN bar, RS bar & RW bar. For
different instance, such as data write / command write / data read, etc. Various signals
are to be provided as indicated by the by the LCD manufacturers.

To interface the LCD, to the Micro controller it require an 8 bit and also three
control signals differentiate the data from the control words send to the LCD. The Micro
controller has to send the necessary control words followed by the data to be
displayed.Depending on the operation to be performed the control words are selected
and passes to the LCD. The data to be displayed on the LCD is to be sent in the ASCII
format. Thus all the character to be displayed are converted into ASCII form and then
sent to the LCD along with different control words. The control word differentiated the
various operations and is executed. It is also possible to read the LCD data if required.
 26

Figure-3.6.1 Procedure for 8-bit initialization.

The control signals to the LCD are also provided by the Micro controller. This is
also done through pins 3.5, 3.6 &3.7.Through program necessary control signals are
passed to the LCD by using the bits of the port. The software controls the necessary
ports and performs the task it is designed for. The software and associated hardware
perform the LCD interface. A liquid crystal is a material (normally organic for LCDs)
 27

that will flow like a liquid , whose molecular structure has some properties. The Liquid
Crystal Display (LCD) is a low power device. The power requirement is in the order of
microwatts for the LCD. However, LCD requires an external or internal light source. It
is limited to a temperature range of about 0C to 60C and lifetime is an area of concern,
because LCDs can chemically degrade.
There are two major types of LCD s which are:
1) Dynamic-scattering LCDs
2) Field-effect LCDs
Field-effect LCDs are normally used in such applications where source of energy is
a prime factor (e.g., watches, portable instrumentation, etc.). They absorb considerably
less power than the light-scattering type. However, the cost of field-effect units is
typically higher, and their height is limited to 2 inches. On the other hand, light-
scattering units are available up to 8 inches in height. The field - effect LCD is used in
the project for displaying appropriate information. The turn-on and turn-off time is an
important consideration in all displays. The response time of LCDs is in the range of
100 to 300ms.The lifetime of the LCD is steadily increasing beyond 10,000 hours limit.
Since the color generated by LCD units is dependent on the source of illumination, there
is a wide range of color choice.

3.7 WORKING OF SMART GLOVES:

Smart gloves needs to be worn on the hand by deaf and dumb people and depending
on the variations of the movements the device will convert it into voice and text. The
messages will be out from the beeper or speaker and LCD display.

When the power supply is given to smart gloves the flex sensors captures the
movement of user and the movement is given to Arduino UNO which converts analog
input into digital output and the Arduino UNO output is connected to voice modulator
and to LCD display. Voice modulator modulates the voice and convert it into speech by
connecting it to the speaker and LCD display displays the corresponding function.

3.5.4.1 Flow chart:

Start
 28

Switch on the
system

Is there any
change in the NO
resistance of flex
sensor

YES

F1 F2 F3 F4 F5

Convert analog signal to

digital

NO
Does signal matches from
predefined code?

YES

Audio system and

LCD

Stop

Figure-3.6.2 Flowchart of operation of Smart Gloves

 29

CHAPTER 4

PIN CONFIGURATION OF VARIOUS MODULES

4.1 ARDUINO UNO:

Figure-4.1Arduino UNO Pin Configuration

4.1.1 Digital Pins:

In addition to the specific functions listed below, the digital pins on an Arduino
board can be used for general purpose input and output via the pinMode
(), digitalRead (), and digitalWrite () commands. Each pin has an internal up
 30

which can be turned on and off using digitalWrite () (w/ a value of HIGH or
LOW, respectively) when the pin is configured as an input. The maximum
current per pin is 40 mA.

Serial: 0 (RX) and 1 (TX). Used to receive (RX) and transmit (TX) TTL serial
data. On the ArduinoDiecimila, these pins are connected to the corresponding
pins of the FTDI USB-to-TTL Serial chip. On the Arduino BT, they are
connected to the corresponding pins of the WT11 Bluetooth module. On the
Arduino Mini and LilyPad Arduino, they are intended for use with an external
TTL serial module (e.g. The Mini-USB Adapter).

Interrupts: 2 and 3. These pins can be configured to trigger an interrupt on a

low value, a rising or falling edge, or a change in value. See the attachInterrupt
() function for details.

PWM: 3, 5, 6, 9, 10, and 11. Provide 8-bit PWM output with

the analogWrite() function. On board with an ATmega8, PWM output is
available only on pins 9, 10, and 11.

BT Reset: 7 (Arduino BT-only) Connected to the reset line of the Bluetooth

module.

SPI: 10 (SS), 11 (MOSI), 12 (MISO), 13 (SCK). These pins support SPI

communication, which, although provided by the underlying hardware, is not
currently included in the Arduino language.

LED: 13. On the Diecimila and LilyPad, there is a built-in LED connected to
digital pin 13. When the pin is HIGH value, the LED is on, when the pin is
LOW, it's off.

4.1.2 Analog Pins:

In addition to the specific functions listed below, the analog input pins support
10-bit analog-to-digital conversion (ADC) using the analogRead() function.
Most of the analog inputs can also be used as digital pins: analog input 0 as
digital pin 14 through analog input 5 as digital pin 19. Analog inputs 6 and 7
(present on the Mini and BT) cannot be used as digital pins.
 31

I2C: 4 (SDA) and 5 (SCL). Support I2C (TWI) communication using the Wire
library (documentation on the Wiring website).

4.1.3 Power Pins:

VIN: You can supply voltage through this pin, or if supplying voltage via the
power jack, access it through this pin. Note that different boards accept different
input voltages ranges. Also note that the Lily Pad has no VIN pin and accepts
only a regulated input.

5V: The regulated power supply used to power the microcontroller and other
components on the board. This can come either from VIN via an on-board
regulator, or be supplied by USB or another regulated 5V supply.

3.3V: (Diecimila-only) A 3.3 volt supply generated by the on-board FTDI chip.

GND: Ground pins.

4.1.4 Other Pins:

AREF: Reference voltage for the analog inputs. Used with analogReference ().

Reset: (Diecimila-only) Bring this line LOW to reset the microcontroller.

Typically used to add a reset button to shields which block the one on the board.
resistor
 32

4.2 VOICE MODULE:

4.2.1PIN CONFIGURATION

Figure- 4.2 Pin configuration of voice module (apR33A)

 33

4.2.2 PIN DESCRIPTION:

VDDP 8
VDD 10 Positive power
VDDA 18 supply.
VDDL 24
VSSP 5
VSSL 11 Power ground.
VSSA 17
VLDO 25 Internal LDO output.
VCORE 16 Positive power supply
for core.
VREF 19 Reference voltage.
VCM 20 Common mode
voltage.
ROSC 26 INPUT Oscillator resistor
input.
RSTB 27 INPUT Reset (Low active).
SRSTB 28 INPUT System reset, Pull
down a resistor to the
VSSL.
MIC+ 21 INPUT Microphone
MIC- 22 INPUT differential input.

MICG 23 OUTPUT Microphone ground.

VOUT1 7 INPUT PWM output to drive
speaker directly.
DAC output.
VOUT2 6 INPUT PWM output to drive
speaker directly.
DAC option.
/REC 12 INPUT Record mode (Low
active).
M0 13 INPUT Message 0.
M1 14 INPUT Message 1.
M2 15 INPUT Message 2.
M3 9 INPUT Message 3.
M4 3 INPUT Message 4.
M5 4 INPUT Message 5.
M6/MSEL0 1 INPUT Message 6, Message
select 0.
M7/MSEL1 2 INPUT Message 7, Message
select 1.
Table-4.1 Pin configuration of voice module(aPR33A)
 34

4.3 LCD DISPLAY:

Figure-4.3 LCD display

 35

4.3.1 PIN DESCRIPTION:

Pin No Function Name

1 Ground (0V) Ground

2 Supply voltage; 5V (4.7V – 5.3V) Vcc

3 Contrast adjustment; through a variable resistor VEE

4 Selects command register when low; and data register when high Register Select

5 Low to write to the register; High to read from the register Read/write

6 Sends data to data pins when a high to low pulse is given Enable

7 DB0

8 DB1

9 DB2

10 DB3
8-bit data pins
11 DB4

12 DB5

13 DB6

14 DB7

15 Backlight VCC (5V) Led+

16 Backlight Ground (0V) Led-

TABLE-4.3 PIN CONFIGURATION OF LCD

 36

CHAPTER: 5

PROTEUS SOFTWARE AND ARDUINO IDE

The Proteus Design Suite is a proprietary software tool suite used primarily for electronic
design automation. The software is used mainly by electronic design engineers and technicians to
create schematics and electronic prints for manufacturing printed circuit boards.It was developed
in Yorkshire, England by Labcenter Electronics Ltd and is available in English, French, Spanish
and Chinese languages.

5.1 HISTORY:

The first version of what is now the Proteus Design Suite was calledPC-B and was
written by the company chairman, John Jameson, for DOS in 1988. Schematic Capture support
followed in 1990, with a port to the Windows environment shortly thereafter. Mixed
mode SPICE Simulation was first integrated into Proteus in 1996 and microcontroller simulation
then arrived in Proteus in 1998. Shape based autorouting was added in 2002 and 2006 saw
another major product update with 3D Board Visualization. More recently, a dedicated IDE for
simulation was added in 2011 and MCAD import/export was included in 2015. Support for high
speed design was added in 2017. Feature led product releases are typically biannual, while
maintenance based service packs are released as required.

5.1.1 PRODUCT MODULES:

The Proteus Design Suite is a Windows application for schematic capture, simulation,
and PCB layout design. It can be purchased in many configurations, depending on the size of
designs being produced and the requirements for microcontroller simulation. All PCB Design
products include an autorouter and basic mixed mode SPICE simulation capabilities.

1. Microcontroller Simulation:
The micro-controller simulation in Proteus works by applying either a hex file or a debug file
to the microcontroller part on the schematic. It is then co-simulated along with any analog and
digital electronics connected to it. This enables its use in a broad spectrum of project prototyping
in areas such as motor control, temperature control and user interface design. It also finds use in
 37

the general hobbyist community] and, since no hardware is required, is convenient to use as a
training or teaching tool. Support is available for co-simulation of:

• Microchip Technologies PIC10, PIC12, PIC16,PIC18, PIC24, PIC33 Microcontrollers.

• Atmel AVR, 8051 and ARM Cortex-M3 Microcontrollers
• NXP 8051, ARM7, ARM Cortex-M0 and ARM Cortex-M3 Microcontrollers.
• Texas Instruments MSP430, PICCOLO DSP and ARM Cortex-M3 Microcontrollers.
• Parallax Basic Stamp, Freescale HC11, 8051 Microcontrollers.

5.2 ARDUINO:

5.2.1 Introduction:

Arduino is an open-source electronics platform based on easy-to-use hardware and

software. Arduino boards are able to read inputs - light on a sensor, a finger on a button, or a
Twitter message - and turn it into an output - activating a motor, turning on an LED, publishing
something online. A set of instructions is fed to the microcontroller on the board. To do
so,Arduino programming language (based on Wiring) is used, and the Arduino Software (IDE),
based on Processing.

Over the years,Arduino has been the brain of thousands of projects, from everyday
objects to complex scientific instruments. Arduino was born at the Ivrea Interaction Design
Institute as an easy tool for fast prototyping, aimed at students without a background in
electronics and programming. As soon as it reached a wider community, the Arduino board
started changing to adapt to new needs and challenges, differentiating its offer from simple 8-bit
boards to products for IoT applications, wearable, 3D printing, and embedded environments.

All Arduino boards are completely open-source, empowering users to build them
independently and eventually adapt them to their particular needs. The software, too, is open-
source, and it is growing through the contributions of users worldwide.Arduino has been used in
thousands of different projects and applications. The Arduino software is easy-to-use for
beginners, yet flexible enough for advanced users.
 38

There are many other microcontrollers and microcontroller platforms available for physical
computing. Parallax Basic Stamp, Netmedia's BX-24, Phidgets, MIT's Handyboard, and many
others offer similar functionality. All of these tools take the messy details of microcontroller
programming and wrap it up in an easy-to-use package. Arduino also simplifies the process of
working with microcontrollers, but it offers some advantage for teachers, students, and interested
amateurs over other systems:

• Inexpensive- Arduino boards are relatively inexpensive compared to other

microcontroller platforms. The least expensive version of the Arduino module can be
assembled by hand, and even the pre-assembled Arduino modules cost less than $50
• Cross-platform - The Arduino Software (IDE) runs on Windows, Macintosh OSX,
and Linux operating systems. Most microcontroller systems are limited to Windows.
• Simple, clear programming environment - The Arduino Software (IDE) is
easy-to-use for beginners, yet flexible enough for advanced users to take advantage of as
well. For teachers, it's conveniently based on the Processing programming environment,
so students learning to program in that environment will be familiar with how the
Arduino IDE works.
• Open source and extensible software - The Arduino software is published as
open source tools, available for extension by experienced programmers. The language
can be expanded through C++ libraries, and people wanting to understand the technical
details can make the leap from Arduino to the AVR C programming language on which
it's based. Similarly, you can add AVR-C code directly into your Arduino programs if
you want to.
• Open source and extensible hardware - The plans of the Arduino boards are
published under a Creative Commons license, so experienced circuit designers can make
their own version of the module, extending it and improving it. Even relatively
inexperienced users can build the breadboard version of the module in order to
understand how it works and save money.
 39

5.2.2 Arduino IDE:

Arduino: consists of both a physical programmable circuit board (often referred to as a

microcontroller) and a piece of software, or IDE (Integrated Development Environment) that
runs on the computer, used to write and upload computer code to the physical board. The
Arduino project provides the Arduino integrated development environment (IDE), which is a
cross-platform application written in the programming language Java. It originated from the IDE
for the languages Processing and Wiring. A program written with the IDE for Arduino is called a
sketch.

IDE is a software application that provides comprehensive facilities to computer

programmers for software development. An IDE normally consists of a source code editor, build
automation tools, and a debugger. Some IDEs, such as NetBeans and Eclipse, contain a
compiler, interpreter, or both; others, such as SharpDevelop and Lazarus, do not. IDEs present a
single program in which all development is done. This program typically provides many features
for authoring, modifying, compiling, deploying and debugging software.

One aim of the IDE is to reduce the configuration necessary to piece together multiple
development utilities, instead providing the same set of capabilities as a cohesive unit. Reducing
that setup time can increase developer productivity, in cases where learning to use the IDE is
faster than manually integrating all of the individual tools. Tighter integration of all development
tasks has the potential to improve overall productivity beyond just helping with setup tasks. For
example, code can be continuously parsed while it is being edited, providing instant feedback
when syntax errors are introduced. That can speed learning a new programming language and its
associated libraries.

Some IDEs are dedicated to a specific programming language, allowing a feature set that
most closely matches the programming paradigms of the language. However, there are many
multiple-language IDEs.While most modern IDEs are graphical, text-based IDEs such as Turbo
Pascal were in popular use before the widespread availability of windowing systems like
Microsoft Windows and the X Window System (X11). They commonly use function keys or
hotkeys to execute frequently used commands or macros
 40

IDEs initially became possible when developing via a console or terminal. Early systems
could not support one, since programs were prepared using flowcharts, entering programs with
punched cards (or paper tape, etc.) before submitting them to a compiler. Dartmouth BASIC was
the first language to be created with an IDE. Its IDE (part of the Dartmouth Time Sharing
System) was command-based, and therefore did not look much like the menu-driven, graphical
IDEs popular after the advent of the Graphical User Interface. However, it integrated editing, file
management, compilation, debugging and execution in a manner consistent with a modern IDE.

Maestro I is a product from Softlab Munich and was the world's first integrated
development environment[1] for software. Maestro I was installed for 22,000
programmersworldwide.One of the first IDEs with a plug-in concept was Softbench. Some IDEs
support multiple languages, such as GNU Emacs based on C and Emacs Lisp, and IntelliJ IDEA,
Eclipse, MyEclipse or NetBeans, all based on Java, or MonoDevelop, based on C.
 41

APPENDICES

APPENDIX –A

PROGRAMMING USING PROTEUS SOFTWARE:

#include <LiquidCrystal.h>

int reading = 0;

int sensorPin1 = A0;

int sensorPin2 = A1;

int sensorPin3 = A2;

int sensorPin4 = A3;

int sensorPin5 = A4;

int hungry =6;

int emergency =7;

int medicine =8;

int help =9;

int sleeping =10;

// initialize the library with the numbers of the interface pins

LiquidCrystallcd(12, 11, 5, 4, 3, 2);

void setup() {
 42

// set up the LCD's number of columns and rows:

lcd.begin(16, 2);

pinMode(hungry,OUTPUT);

pinMode(emergency,OUTPUT);

pinMode(walking,OUTPUT);

pinMode(runing,OUTPUT);

pinMode(sleeping,OUTPUT);

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" WELCOME ");

delay(1000);

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" SMART GLOUSE ");

lcd.setCursor(0,1);

lcd.print(" SYSTEM ");

delay(1000);

lcd.clear();
 43

digitalWrite(6,HIGH);digitalWrite(7,HIGH);digitalWrite(8,HIGH);digitalWrite(9,HIGH);digital
Write(10,HIGH);

void loop()

int f1 = analogRead(sensorPin1);

f1=1023-f1;

int f2 = analogRead(sensorPin2);

f2=1023-f2;

int f3 = analogRead(sensorPin3);

f3=1023-f3;

int f4 = analogRead(sensorPin4);

f4=1023-f4;

int f5 = analogRead(sensorPin5);

f5=1023-f5

lcd.setCursor(1, 0);

lcd.print("f1 f2 f3 f4");

lcd.setCursor(0,1);

lcd.print(f1, DEC);
 44

lcd.setCursor(4,1);

lcd.print(f2, DEC);

lcd.setCursor(8,1);

lcd.print(f3, DEC);

lcd.setCursor(12,1);

lcd.print(f4, DEC);

delay(1000);

lcd.clear();

lcd.setCursor(1, 0);

lcd.print(" f5 ");

lcd.setCursor( 5,1);

lcd.print(f5, DEC);

delay(1000);

if (f1<=30)

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" HUNGRY ");

digitalWrite(6,LOW);
 45

delay(500);

else if (f2>=5)

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" EMERGENCY ");

digitalWrite(7,LOW);

delay(500);

else if (f3<=40)

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" MEDICINE ");

digitalWrite(8,LOW);

delay(500);

else if (f4<=39)
 46

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" HELP");

digitalWrite(9,LOW);

delay(500);

else if (f5< =35)

lcd.clear();

lcd.setCursor(0, 0);

lcd.print(" SLEEPING ");

digitalWrite(10,LOW);

delay(500);

else

digitalWrite(6,HIGH);

digitalWrite(7,HIGH);
 47

digitalWrite(8,HIGH);

digitalWrite(9,HIGH);

digitalWrite(10,HIGH);

delay(500);

lcd.clear();

}
 48

CHAPTER 6

HARDWARE DESIGN

6.1 HARDWARE SETUP:

FIGURE-6.1 Complete Hardware setup

 49

6.2 OUTPUT:

1. When little finger is bent:

2.When ring finger is bent:

3. When middle finger is bent:

 50

4. When index finger is bent:

5. When thumb finger is bent:

 51

CONCLUSION

Gestures are one of the methods used for communication by disabled person. Here the
gestures are converted into text and speech so that communication is not limited between them
only, but also utilizing smart gloves, for communication the barrier between two different
communities is eliminated. It acts as a tongue for the dumb people and as a helping hand for the
paralytic people. The smart gloves has minimal hardware mounted on it which makes it reliable ,
portable and cost effective. Using smart gloves disabled person can also grow in their careeer
and makes nation grow as percentage of disabled persons is millions in count. Making their
future better, helps in making Nation better.
 52

FUTURE SCOPE

• This project mainly focuses on static gestures. This can be improved further to recognize
the temporal gestures, facial expressions by using appropriate algorithms.
• The delay required between two hand gestures for proper functioning of system can be
removed to make system more user friendly.
• This system can be implemented in various application areas for example, accessing
government websites in internet.
 53

REFERENCES

• Vajjarapu Lavanya, Akulapravin, M.S. Madhan Mohan “Hand Gesture Recognition And
Voice Conversion System Using Sign Language Transcription System” 2014
International Journal of Electronics and Communication Engineering BVC Engineering
College, Odalarevu AP, India

• Ms. Pallavi Verma, Mrs. Shimi S.L, “Design of Smart Gloves”, International Journal of
Engineering Research and Technology (IJERT) ISSN: 2278-0181. Vol.3 Issue 11,
November-2014

• Anbarsi Raja Mohan, Hemavathy R., Dhanalakshmi M. “Deaf Mute Communication

Intrepreter” 2013 International Journal of Scientific Engineering and Technology Sri Siva
Subramania Nadar College of Engineering, Chennai, Tamil Nadu, India
.
• Arduino:

https://en.wikipedia.org/wiki/Arduino

• Voice module (apr33A):

www.aplusinc.com.tw/proimages/.../aPR33Ax/aPR33Ax_Q7.0_Datasheet_20140106.