Enhancing Sign Language Understanding through Machine Learning at the Sentence Level
Journal Title: International Journal of Experimental Research and Review - Year 2024, Vol 41, Issue 5
Abstract
The visual language of sign language is based on nonverbal communication, including hand and body gestures. When it comes to communicating, it is the main tool for those who are deaf or hard of hearing all around the globe. Useful for both hearing and deaf persons, this can translate sign language into sentences in real-time or help those who are hard of hearing communicate with others. This work focuses on developing a sentence-level sign language detection system utilizing a custom dataset and Random Forest model. Leveraging tools such as Media Pipe and TensorFlow, we facilitate gesture detection. Through continuous detection of gestures, we generate a list of corresponding labels. These labels are then used to construct sentences automatically. The system seamlessly integrates with ChatGPT, allowing direct access to generate sentences based on the detected gestures. Our custom dataset ensures that the model can accurately interpret a wide range of sign language gestures. Our method helps close the communication gap between people who use sign language and others, with an accuracy of 80%, by merging machine learning with complex language models.
Authors and Affiliations
Ch Sekhar, Juthuka Aruna Devi, Mirtipati Satish Kumar, Kinthali Swathi, Pala Pooja Ratnam, Marada Srinivasa Rao
Keywords
Related Articles
- EP ID EP741625
- DOI 10.52756/ijerr.2024.v41spl.002
- Views 46
- Downloads 0
High Purity Orbital Angular Momentum Modes Reconfiguration Using Uniform Circular Array Antenna to Enhance Channel Capacity and Spectral Efficiency
Technology based on OAM (orbital angular momentum) has great potential for enhancing the bandwidth efficiency of telecommunication systems. Although OAM waves are orthogonal, it is possible to multiplex various modes wit...
Combinatorial impact of Chelerythrine and DADS in the restoration of liver physiology during carcinogenic exposure in mice (Mus musculus)
Investigation of the efficacy of the combined drugs chelerythrine and DADS in restoring chemically induced hepatocellular carcinoma in Swiss albino mice. 4-6 week-old mice were considered for experimentation. The genotox...
Solubility enhancement and evaluation of Cilnidipine using solid Dispersion techniques
The poor solubility of Cilnidipine leads to low bioavailability and limits its therapeutic efficacy. To develop a dosage form that is stable, effective and has a higher bioavailability. It is necessary to increase the so...
Validation of the Teachers AI-TPACK Scale for the Indian Educational Setting
Educators work in extremely dynamic and complex classroom environments where they must continuously alter and update their understanding. Specifically, possession of rich, organised, and integrated knowledge from various...
An optimization-based study of the impact of different parameters on dna degradation
Human remains exposed to various conditions throughout time are frequently utilized for DNA analysis of tissue or bone for identification reasons. The deterioration and loss of DNA in particular environmental settings ha...