Given the achievements in automatically translating text from one language to another, one would expect to see similar advancements in translating between signed and spoken languages. However, progress in this effort has lagged in comparison. Typically, machine translation consists of processing text from one language to produce text in another. Because signed languages have no generally-accepted written form, translating spoken to signed language requires the additional step of displaying the language visually as animation through the use of a three-dimensional (3D) virtual human commonly known as an avatar. Researchers have been grappling with this problem for over twenty years, and it is still an open question. With the goal of developing a deeper understanding of the challenges posed by this question, this article gives a summary overview of the unique aspects of signed languages, briefly surveys the technology underlying avatars and performs an in-depth analysis of the features in a textual representation for avatar display. It concludes with a comparison of these features and makes observations about future research directions.
1 January 2012 in Lecture Notes in Computer Science
The DGS Corpus was collected in order to document German Sign Language (DGS) for linguistic research, compile the corpus-based dictionary DW-DGS and provide a cultural resource for the language community. Regional aspects played a key role in participant selection, data collection tasks and procedures, as well as in annotation work. Regional granularity implemented had to be a compromise between research interests, corpus size, and privacy issues of participants. In the lexicographic work maps are used to visualize regional distribution of single signs as well as of groups of competing synonyms. Maps are a tool for data exploration, and they support data interpretation as well as quality assurance of the annotation. As they provide an intuitive access to distributional facts maps are also an important element in the dictionary.
SyncWRITER is an interlinear text editor with a focus on the presentation of transcribed data. As it seamlessly integrates digital video, it is a useful tool for sign language transcription. This article discusses syncWRITER’s limitations in the areas that turn out to be essential in large-scale transcription projects. These are synchronization, multi-user database integration, data retrieval, and coreference handling.