INNNOVATIVE SIGN RECOGNITION SYSTEM

FOR DEAF AND DUMB PEOPLE FOR

REALTIME APPLICATIONS

GUIDED BY PRESENTED BY
 OBJECTIVE
To develop a system for automatic translation
of static gestures used by dumb and deaf persons
into audible speech understandable by a common
person.
 INTRODUCTIO
N
• Sign recognition system act as a interpreter
between common people and socially aided
people.
• It captures the gesture shown by the deaf and
dumb people and convert immediately into
known language.
 EXISTING SYSTEM

• Glove based technique :- It use a glove

different
with type of sensors like optical, electrical etc,
this sensor based glove collects the data according to
the hand and wrist movement and then this data is
analyzed.

• Hybrid technique:-It make the system more reliable

and accurate data from both M E M S a n d t h e F l e x
the technique are collected and analyzed.

4
 Disadvantages

• Although people have previously worked on projects involving

sign language translating devices such as gesture sensing
gloves,
• these are anything but correct solution because the sign
language method has got serious drawbacks mentioned above.
• So we propose a new form of communication mechanism that
aims to eliminate these drawbacks with the help of the latest
technologies available.
 SYSTEM DESIGN
ANDROID APPLICATION

8bit code word

CAMERA generated

VIDEO Gesture recognized

Power Supply

Google Text To
Bluetooth
Speech
Implementation

LM386
Microcontroller
amplifier

Speaker Speech output LCD DISPLAY

6
 SYSTEM DESIGN CONT…….

• Left section of the diagram represent the input part which

contain
Camera and tilt Camera.
• From input unit the hand gesture is captured as an input
data which is fed to the processor unit.
• Arduino Uno which consist of a microcontroller
processes
the input data and generates an 8bit code word for the
particular input hand movement data.
• This code word is matched with the predefined alphabet or
number.
• If the hand gesture is valid then corresponding character is
given to the output unit and displayed on the LCD
dumb). 11
• Another output from the processor goes to the text to
speech converter IC. Which convert the ch.aracter into
speech.

• Speech is amplified by LM386 amplifier and fed to the

speaker.

• The speech output can easily heard by a blind person .

8
HAND GESTURES:

9
 Text to
Speech
• Serial board communication kit is used
to convert Text to Speech.
• This Kit contains PIC Microcontroller,
Selector, Voice recorder, Amplifier, Speaker,
Step down transformer.
Captured image of sign
A
‘’
Captured image of sign
‘B’
Captured image of sign
‘C’
 Database images in the folder
LETTER
A ,D
A

LETTER
D
 database images in the folder
B,C
• LETTER
B
 Text
Result
 Tools
Required
SOFTWARE
MATLAB

HARDWARE
Laptop with external web
camera serial board
communication kit
THANK YOU