HAND GESTURE RECOGNITION SYSTEM BY CONVERTING INTO VOICE

Abstract

In general, sign language is used by dumb people for communication but they usually find difficulty in communicating with other people who do not know sign language. This project aims to reduce this hurdle in communication. It is based on the need of developing an electronic device that can convert sign language into speech in order to simplify the communication that takes place between the mute communities with the general people. In this, wireless data gloves are used in which normal cloth driving gloves are fitted with flex sensors along the thumb’s length and each and every finger. Dumb people can use the gloves to do hand gesture and it will be converted into speech so that normal citizens can understand their expressions. This is a communication skill that will use gestures instead of sound to express meaning simultaneously combining hand shapes, movement of the hands, body or arms and facial expressions and orientations to communicate fluently a speaker’s thoughts. Signs are used to communicate sentences and words to people. A gesture used in sign language is a movement of the hands with a specific shape made out of them. A sign language usually gives signs for whole words. It can also provide signs for letters to perform words that do not have corresponding sign in that language. In this project, Flex Sensor plays the main role. Flex sensors are sensors in which resistance changes based on sensor bending. We used glove based on copper plate to implement final design. Small metal strips are used to make the glove. These metal strips will be fixed on five fingers of a hand. It is better to use a ground plate in place of individual metal strips because the contact area for ground will be more facilitating easy identification of fingerposition. The ground contact area is more providing easy identification of position of the finger. So we can use ground plate in place of metal strips. We are in the process of implementing a prototype by using this process to decrease the communication gap between physically disabled and normal people.