A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication

March 2026
Vol-12, Issue-2
Paper ID: 28200
ISSN: 2395-4396
Downloads: 77
Download PDF

Abstract & Details

Research Area
Computer Science and Engineering
Keywords
Sign Language Recognition Computer Vision Deep Learning Media Pipe Hand Gesture Recognition Smartphone-Based System Indian Sign Language (ISL) Human-Computer Interaction Real-Time Processing Assistive Technology
Abstract
Communication barriers between deaf or mute individuals and hearing people remain a major challenge in daily life. Traditional communication methods such as interpreters or sensor-based gloves are often expensive, require specialized hardware, and are not always available in real-time situations. Recent advances in computer vision and mobile computing have opened new possibilities for developing accessible assistive technologies. This paper presents a low-cost smartphone-based sign language translation system designed to facilitate communication between deaf individuals and hearing people. The proposed system utilizes the smartphone camera to capture hand gestures and applies Media Pipe hand tracking for extracting hand landmarks. These features are then processed using a deep learning classification model to recognize sign language gestures. The recognized gestures are converted into text and subsequently transformed into speech using a text-to-speech module, enabling real-time interaction. The proposed approach focuses on affordability, portability, and ease of use by eliminating the need for specialized hardware such as sensor gloves or external devices. Experimental evaluation was performed using a dataset of commonly used Indian Sign Language gestures. The system achieved high recognition accuracy while maintaining real-time performance on a standard smartphone device. The results demonstrate that smartphone-based gesture recognition systems can provide an effective and scalable solution for improving accessibility and enabling inclusive communication through human–computer interaction.

Author Information

# Name Institute / Affiliation
1 Harsh Mishra AKS University, Satna, 485001, MP
2 Prof. Chandra Shekhar Gautam AKS University, Satna, 485001, MP

How to Cite

Use the following formats to cite this article in your research.

APA Style
Mishra, Harsh & Gautam, Prof. Chandra Shekhar (2026). A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication. International Journal of Advance Research and Innovative Ideas In Education, 12(2), 882-891.
MLA Style
Mishra, Harsh, and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 2, 2026, pp. 882-891.
IEEE Style
Harsh Mishra and Prof. Chandra Shekhar Gautam, "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication," International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 2, pp. 882-891, 2026.
Vancouver Style
Mishra Harsh, Gautam Prof. Chandra Shekhar. A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication. International Journal of Advance Research and Innovative Ideas In Education. 2026;12(2):882-891.
Harvard Style
Mishra, Harsh & Gautam, Prof. Chandra Shekhar (2026) 'A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication', International Journal of Advance Research and Innovative Ideas In Education, 12(2), pp. 882-891.
Chicago Style
Mishra, Harsh and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education 12, no. 2 (2026): 882-891.
Turabian Style
Mishra, Harsh and Prof. Chandra Shekhar Gautam. "A Low-Cost Smartphone-Based Sign Language Translator Using Computer Vision for Real-Time Deaf–Hearing Communication." International Journal of Advance Research and Innovative Ideas In Education 12, no. 2 (2026): 882-891.

Export Citation

Related Research

PReFace : AI -Assisted Plausible Facial Restoration and Damage Reconstruction System
Syeda Arbeena Kausar et al. 2026 Computer Science and Engineering (Computer Vision, Deep Learning and Image Processing)
Download PDF
Customer Churn Prediction Using Machine Learning
Dr. Roshni Khlhe et al. 2026 Machine Learning, Artificial Intelligence, Data Analytics, and Customer Churn Prediction.
Download PDF
Automated web vulnerability scanner
Jitendra Sahu et al. 2026 Computer science
Download PDF
BLOOD BANK DEMAND PREDICTION SYSTEM: MACHINE LEARNINGBASED BLOOD DEMAND FORECASTING
Uday Dharmapal Wankhede et al. 2026 Computer Science & Engineering
Download PDF