QMX-BdSL49: An Efficient Recognition Approach for Bengali Sign Language with Quantize Modified Xception

Sign language is developed to bridge the com-munication gap between individuals with and without hearing impairment or speech difficulties. Individuals with hearing and speech impairment typically rely on hand signs as a means of expressing themselves. However, people, in general, may not have sufficient knowledge of sign language, thus a sign language recognition system on an embedded device is most needed. Literature related to such systems on embedded devices is scarce as these recognition tasks are very complex and computationally expensive. The limited resources of embedded devices cannot execute complex algorithms like Convolutional Neural Network (CNN) properly. Therefore, in this paper, we propose a novel deep learning architecture based on default Xception architec-ture, named Quantized Modified Xception (QMX) to reduce the model’s size and enhance the computational speed without compromising model accuracy. Moreover, the proposed QMX model is highly optimized due to the weight compression of model quantization. As a result, the footprint of the proposed QMX model is 11 times smaller than the Modified Xception (MX) model. To train the model, BDSL 49 dataset is utilized which includes approximately 14,700 images divided into 49 classes. The proposed QMX model achieves an overall F1 accuracy of 98%. In addition, a comprehensive analysis among QMX, Modified Xception Tiny (MXT), MX, and the default Xception model is provided in this research. Finally, the model has been implemented on Raspberry Pi 4 and a detailed evaluation of its performance has been conducted, including a comparison with existing state-of-the-art approaches in this domain. The results demonstrate that the proposed QMX model outperforms the prior work in terms of performance.

@article{Begum2023,
  title     = {QMX-BdSL49: An Efficient Recognition Approach for Bengali Sign Language with Quantize Modified Xception},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {14},
  number    = {5},
  year      = {2023},
  publisher = {The Science and Information Organization},
  author    = {Nasima Begum and Saqib Sizan Khan and Rashik Rahman and Ashraful Haque and Nipa Khatun and Nusrat Jahan and Tanjina Helaly},
  doi       = {10.14569/IJACSA.2023.01405113},
  url       = {https://doi.org/10.14569/IJACSA.2023.01405113}
}