Back close

A low-cost wearable Indian sign language interpretation system

Publication Type : Conference Paper

Publisher : International Conference on Robotics and Automation for Humanitarian Applications, RAHA 2016 -

Source : International Conference on Robotics and Automation for Humanitarian Applications, RAHA 2016 - Conference Proceedings, Institute of Electrical and Electronics Engineers Inc. (2017)

Url : https://www.scopus.com/inward/record.uri?eid=2-s2.0-85025583325&doi=10.1109%2fRAHA.2016.7931873&partnerID=40&md5=cf775b9a6e16f281d6722a2e7a53e4e2

ISBN : 9781509052035

Keywords : Artificial intelligence, Decision trees, Education, Impaired people, Indian sign languages, Interpretation systems, Learning systems, Low-cost systems, Machine learning approaches, Naive Bayes, Prototype system, Robotics, Sign language, Wearable technology

Campus : Coimbatore

School : School of Engineering

Center : Amrita Innovation & Research

Department : Electronics and Communication

Verified : Yes

Year : 2016

Abstract : Interpreting sign language gestures is a challenging task for a vast majority of people not accustomed to interacting with the speech-impaired. This also tends to further limit the interaction that the speech-impaired people can have with the society at large. To address this issue, a machine learning based wearable and low-cost system to identify dynamic Indian sign language gestures, is presented. The system uses machine learning to identify the sign made by the wearer and then the audio clip corresponding to that gesture is played out aloud so that the listener is able to identify the meaning of that gesture. A prototype system that can identify and interpret a total of fifty-six dynamic Indian sign language gestures has been designed and tested. Effectiveness of three different machine learning approaches based on Naive Bayes, Decision trees and Support Vector Machines respectively, has also been evaluated. Results indicate that the proposed system is capable of successfully identifying gestures with an accuracy greater than 93%.

Cite this Research Publication : A. K. Singh, John, B. P., Subramanian, S. R. Venkata, A. Kumar, S., and Nair, B. B., “A low-cost wearable Indian sign language interpretation system”, in International Conference on Robotics and Automation for Humanitarian Applications, RAHA 2016 - Conference Proceedings, 2017.


Admissions Apply Now