A Novel Real-Time System For Translating Sign Language Into Braille Through Text Intermediation

Authors: Jeevitha M, Sai Ananya J, Shweta Y Bhajantri, Tejashwini V, Vinutha H V

Abstract: Communication between the hearing-impaired and visually-impaired communities is a significant accessibility challenge due to the lack of a common mode of interaction. This paper presents a novel real-time system that translates sign language into Braille through an intermediate textual representation, with the output displayed visually on a screen. The system uses computer vision and deep learning algorithms to accurately recognize sign language gestures, converts them into text, and then maps the text to corresponding Braille patterns using a visual Braille representation. Unlike traditional systems that require tactile Braille devices, this solution offers a screen-based output, making it cost- effective and accessible for learning and communication.