Detection of Turkish Sign Language Using Deep Learning and Image Processing Methods

AKSOY B., Salman O. K. M., Ekrem Ö.

Applied Artificial Intelligence, cilt.35, sa.12, ss.952-981, 2021 (SCI-Expanded, Scopus) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 35 Sayı: 12
  • Basım Tarihi: 2021
  • Doi Numarası: 10.1080/08839514.2021.1982184
  • Dergi Adı: Applied Artificial Intelligence
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Applied Science & Technology Source, Business Source Elite, Business Source Premier, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, Metadex, Psycinfo, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.952-981
  • Isparta Uygulamalı Bilimler Üniversitesi Adresli: Evet

Özet

Sign language is a physical language that enables people with disabilities to communicate using hand and facial gestures. For this reason, it is very important for people with disabilities to express themselves freely in society and to make the sign language understandable to everyone. In this study, the data set was created by taking 10223 images for 29 letters in the Turkish Sign Language Alphabet. Images are made suitable for education by using image enhancement techniques. In the final stage of the study, classification processes on images were carried out by using CapsNet, AlexNet and ResNet-50, DenseNet, VGG16, Xception, InceptionV3, NasNet, EfficentNet, Hitnet, Squeezenet architectures and TSLNet, which was designed for the study. When the deep learning models were examined, it was found that CapsNet and TSLNet models were the most successful models with 99.7% and 99.6% accuracy rates, respectively.