Sign Language Recognition Based on Hand and Body Skeletal Data

Abstract:


Sign language recognition (SLR) is a challenging, but highly important research field for several computer vision systems that attempt to facilitate the communication among the deaf and hearing impaired people. In this work, we propose an accurate and robust deep learning-based methodology for sign language recognition from video sequences. Our novel method relies on hand and body skeletal features extracted from RGB videos and, therefore, it acquires highly discriminative for gesture recognition skeletal data without the need for any additional equipment, such as data gloves, that may restrict signer’s movements. Experimentation on a large publicly available sign language dataset eveals the superiority of our methodology with respect to other state of the art approaches relying solely on RGB features.


  • D. Konstantinidis, K. Dimitropoulos, P. Daras, "Sign Language Recognition Based on Hand and Body Skeletal Data", 3DTV Conference, IEEE, Stockholm, Helsinki, 3-5 June 2018.

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Principal Researcher Grade Α
    1st km Thermi – Panorama, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164
    Email: daras@iti.gr