Given the achievements in automatically translating text from one language to another, one would expect to see similar advancements in translating between signed and spoken languages. However, progress in this effort has lagged in comparison. Typically, machine translation consists of processing text from one language to produce text in another. Because signed languages have no generally-accepted written form, translating spoken to signed language requires the additional step of displaying the language visually as animation through the use of a three-dimensional (3D) virtual human commonly known as an avatar. Researchers have been grappling with this problem for over twenty years, and it is still an open question. With the goal of developing a deeper understanding of the challenges posed by this question, this article gives a summary overview of the unique aspects of signed languages, briefly surveys the technology underlying avatars and performs an in-depth analysis of the features in a textual representation for avatar display. It concludes with a comparison of these features and makes observations about future research directions.
Sign Language Machine Translation (SLMT) is an emerging technology that will primarily impact deaf and hard of hearing communities. Historically, these technologies have been developed by hearing scientists, without input from deaf researchers or community representatives. SignON was a three-year project exploring the application of SLMT, and using a co-creation approach which was led by the European Union of the Deaf. Here we describe an art-science method to engage deaf, hard of hearing, and hearing audiences with SLMT through theatre and performance. We also reflect on the insights, perspectives, and feedback shared by audience members.