Bioinformatics and Medical Applications

14A Complete Overview of Sign Language Recognition and Translation Systems

Kasina Jyothi Swaroop¹*, Janamejaya Channegowda² and Shambhavi Mishra³

¹Indian Institute of Technology (Indian School of Mines), Dhanbad, India

²Ramaiah Institute of Technology, Bangalore, India

³CBP Government Engineering College, Delhi, India

Abstract

Sign Language Recognition and Translation systems involve the usage of the human body pose and hand pose estimation. Sign Language Recognition has been conventionally been performed by some preliminary sensors and later evolved to various advanced Deep Learning–based Computer Vision systems. This chapter deals with the past, present, and future of the Sign Language Recognition systems. Sign Language Translation is also briefly discussed here, giving insights on Natural Language Processing techniques to accurately convert Sign Language to translated sentences.

Keywords: Sign language, sensor-based systems, vision-based

14.1 Introduction

Sign Language is the language of performing signs using hands, human body pose, facial expressions, etc., to communicate with each other. This is prevalent among the deaf and the mute communities which constitute about 5% of the world’s population. With a language that is practiced only among certain communities, the socialization of those community people becomes very difficult. Active research in the fields of Sign Language Recognition and Translation is being taken up over various Sign Languages to help and address the ...