RSIS Repository Open-access research from RSIS International journals

International Journal of Research and Innovation in Applied Science (IJRIAS)

Real-Time Multilingual Closed Captioning System with Simplified Captions for Deaf Person

byDR.C.Jayasri; E.Nikitha Rajam; P.Gayathri; S.Shivaane; R.Aswini

Published March 10, 2026  •  Vol. 11, Issue 2, pp. 670–674Open Access
DOI: 10.51584/IJRIAS.2026.110200057

Download PDF Browse this issue

Abstract

Real-time closed captioning is essential for improving accessibility for Deaf and Hard-of-Hearing (DHH) users in live communication. This paper presents a low-latency multilingual closed-captioning system designed for Indian languages. The proposed system integrates streaming Automatic Speech Recognition (ASR), automatic language identification, text simplification, punctuation restoration, and speaker segmentation. It supports code-switching and optional translation or transliteration across scripts.
The system is optimized for sub-second end-to-end latency and robustness in noisy environments. Experimental results show that simplified captions significantly improve readability and comprehension while maintaining acceptable recognition accuracy, making the system suitable for real-time educational and public communication applications.

Keywords: Real-time Captioning, Streaming ASR, Multilingual Systems, Accessibility, Deaf and Hard-of-Hearing, Text Simplification

JournalInternational Journal of Research and Innovation in Applied Science (IJRIAS)
ISSN2454-6194
Volume / IssueVolume 11, Issue 2
Pages670–674
Publication dateMarch 10, 2026
DOI10.51584/IJRIAS.2026.110200057
PublisherRSIS International
LicenseOpen Access

How to cite this article

DR.C.Jayasri, E.Nikitha Rajam, P.Gayathri, S.Shivaane, & R.Aswini (2026). Real-Time Multilingual Closed Captioning System with Simplified Captions for Deaf Person. International Journal of Research and Innovation in Applied Science (IJRIAS), 11(2), 670-674. https://doi.org/10.51584/IJRIAS.2026.110200057

BibTeX

@article{DRCJayasri2026,
  title   = {Real-Time Multilingual Closed Captioning System with Simplified Captions for Deaf Person},
  author  = {DR.C.Jayasri and E.Nikitha Rajam and P.Gayathri and S.Shivaane and R.Aswini},
  journal = {International Journal of Research and Innovation in Applied Science (IJRIAS)},
  volume  = {11},
  number  = {2},
  pages   = {670--674},
  year    = {2026},
  doi     = {10.51584/IJRIAS.2026.110200057},
  publisher = {RSIS International}
}