A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication
Abstract & Details
Research Area
Computer Science and Engineering
Keywords
Sign Language Recognition
Computer Vision
Deep Learning
Media Pipe
Hand Gesture Recognition
Smartphone-Based System
Indian Sign Language (ISL)
Human-Computer Interaction
Real-Time Processing
Assistive Technology
Abstract
Communication barriers between deaf or mute individuals and hearing people remain a major challenge in daily life. Traditional communication methods such as interpreters or sensor-based gloves are often expensive, require specialized hardware, and are not always available in real-time situations. Recent advances in computer vision and mobile computing have opened new possibilities for developing accessible assistive technologies. This paper presents a low-cost smartphone-based sign language translation system designed to facilitate communication between deaf individuals and hearing people. The proposed system utilizes the smartphone camera to capture hand gestures and applies Media Pipe hand tracking for extracting hand landmarks. These features are then processed using a deep learning classification model to recognize sign language gestures. The recognized gestures are converted into text and subsequently transformed into speech using a text-to-speech module, enabling real-time interaction. The proposed approach focuses on affordability, portability, and ease of use by eliminating the need for specialized hardware such as sensor gloves or external devices. Experimental evaluation was performed using a dataset of commonly used Indian Sign Language gestures. The system achieved high recognition accuracy while maintaining real-time performance on a standard smartphone device. The results demonstrate that smartphone-based gesture recognition systems can provide an effective and scalable solution for improving accessibility and enabling inclusive communication through human–computer interaction.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | Harsh Mishra | AKS University, Satna, 485001, MP |
| 2 | Prof. Chandra Shekhar Gautam | AKS University, Satna, 485001, MP |
How to Cite
Use the following formats to cite this article in your research.
APA Style
Mishra, Harsh & Gautam, Prof. Chandra Shekhar (2026). A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication. International Journal of Advance Research and Innovative Ideas In Education, 12(2), 882-891.
MLA Style
Mishra, Harsh, and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 2, 2026, pp. 882-891.
IEEE Style
Harsh Mishra and Prof. Chandra Shekhar Gautam, "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication," International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 2, pp. 882-891, 2026.
Vancouver Style
Mishra Harsh, Gautam Prof. Chandra Shekhar. A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication. International Journal of Advance Research and Innovative Ideas In Education. 2026;12(2):882-891.
Harvard Style
Mishra, Harsh & Gautam, Prof. Chandra Shekhar (2026) 'A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication', International Journal of Advance Research and Innovative Ideas In Education, 12(2), pp. 882-891.
Chicago Style
Mishra, Harsh and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education 12, no. 2 (2026): 882-891.
Turabian Style
Mishra, Harsh and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education 12, no. 2 (2026): 882-891.
Related Research
EduQuest AI: A Gamified Learning Platform for Interactive and Personalized Digital Education
Download PDF
Distributed Real-Time Stream Analytics and Ingestion Engine for High-Velocity Big Data Architectures
Download PDF