Text or Audio to Sign – Sign to Text

Text or Audio to Sign – Sign to Text

Authors- Singadi Sravanthi, Chimata vijaya rama raju, G Sirisha, Challa Lakshmipathi, Polepalli Medara Parikshith

Abstract-– The “AUDIO TO SIGN – SIGN TO TEXT” project represents a groundbreaking integration of technology in the field of communication and accessibility. It aims to bridge the gap between audio and sign language, subsequently converting sign language back into text. This bi-directional approach not only promotes inclusivity for the deaf and hard-of-hearing community but also fosters a deeper understanding and integration across different modes of communication. The project leverages advanced technologies like natural language processing (NLP), computer vision, and machine learning to interpret and translate languages. frameworks, enabling communication with hearing-impaired users. To close the communication loop, the system captures hand signs from users using MediaPipe’s real-time hand tracking. The gestures are classified and converted back into text, and then into spoken audio via the TTS module. The proposed system enhances accessibility, especially in public services, classrooms, and healthcare environments, by creating an AI- driven communication bridge between diverse users. It addresses key challenges such as real-time gesture recognition, contextual language understanding, and speech synthesis, all within a scalable and user-friendly framework. Keywords: Accessibility Technology, Sign Language Interpretation, Audio Processing, Speech-to-Text Conversion, Natural Language Processing (NLP), Computer Vision Deep Learning, Artificial Intelligence.

DOI: /10.61463/ijset.vol.13.issue2.359