Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text

Abstract

This paper summarizes various algorithms used to design a sign language recognition system. Sign language is the language used by deaf people to communicate among themselves and with normal people. We designed a real time sign language recognition system that can recognize gestures of sign language from videos under complex backgrounds. Segmenting and tracking of non-rigid hands and head of the signer in sign language videos is achieved by using active contour models. Active contour energy minimization is done using signers hand and head skin colour, texture, boundary and shape information. Classification of signs is done by an artificial neural network using error back propagation algorithm. Each sign in the video is converted into a voice and text command. The system has been implemented successfully for 351 signs of Indian Sign Language under different possible video environments. The recognition rates are calculated for different video environments.

Authors and Affiliations

P Kishore

Keywords

Related Articles

Using Business Intelligence Tools for Predictive Analytics in Healthcare System

The scope of this article is to highlight how healthcare analytics can be improved using Business Intelligence tools. Healthcare system has learned from the previous lessons the necessity of using healthcare analytics fo...

Hijaiyah Letter Interactive Learning for Mild Mental Retardation Children using Gillingham Method and Augmented Reality

Assistive technology for children with special needs is a problem that is interesting to study. Collaboration between methods and latest technology can be used as a learning aid for them. Learning of Hijaiyah letters is...

Security Issues in the Internet of Things (IoT): A Comprehensive Study

Wireless communication networks are highly prone to security threats. The major applications of wireless communication networks are in military, business, healthcare, retail, and transportations. These systems use wired,...

Fuzzy-Semantic Similarity for Automatic Multilingual Plagiarism Detection

A word may have multiple meanings or senses, it could be modeled by considering that words in a sentence have a fuzzy set that contains words with similar meaning, which make detecting plagiarism a hard task especially w...

Development of Prediction Model for Endocrine Disorders in the Korean Elderly Using CART Algorithm

The aim of the present cross-sectional study was to analyze the factors that affect endocrine disorders in the Korean elderly. The data were taken from the A Study of the Seoul Welfare Panel Study 2010. The subjects were...

Download PDF file
  • EP ID EP150884
  • DOI -
  • Views 105
  • Downloads 0

How To Cite

P Kishore (2012). Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text. International Journal of Advanced Computer Science & Applications, 3(6), 35-47. https://europub.co.uk./articles/-A-150884