A Real-time Continuous Alphabetic Sign Language to Speech Conversion VR System

dc.contributor.authorLiang, Rung-Hueien_US
dc.contributor.authorOuhyoung, Mingen_US
dc.description.abstractMany ways of communications are used between human and computer, while using gesture is considered to be one of the most natural way in a virtual reality system. Because of its intuitiveness and its capability of helping the hearing impaired or speaking impaired, we develop a gesture recognition system. Considering the world-wide use of ASL (American Sign Language), this system focuses on the recognition of a continuous flow of alphabets in ASL to spell a word followed by the speech synthesis, and adopts a simple and efficient windowed template matching recognition strategy to achieve the goal of a real-time and continuous recognition. In addition to the abduction and the flex information in a gesture, we introduce a concept of contact-point into our system to solve the intrinsic ambiguities of some gestures in ASL. Five tact switches, served as contact-points and sensed by an analogue to digital board, are sewn on a glove cover to enhance the functions of a traditional data glove.en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.publisherBlackwell Science Ltd and the Eurographics Associationen_US
dc.titleA Real-time Continuous Alphabetic Sign Language to Speech Conversion VR Systemen_US