Department of Ambient Intelligence and Interactive Systems (DIASI), French Alternative Energies and Atomic Energy Commission, Paris and Gif-sur-Yvette, France
Computer Science Department, Paris-Saclay University, Orsay, Palaiseau, Paris, France
Prof. Nasredine Semmar
Department of Ambient Intelligence and Interactive Systems (DIASI), French Alternative Energies and Atomic Energy Commission, Paris and Gif-sur-Yvette, France
Computer Science Department, Paris-Saclay University, Orsay, Palaiseau, Paris, France
This work focuses on the rapid development of linguistic annotation tools for low-resource languages (languages that have no labeled training data). We experiment with several cross-lingual annotation projection methods using recurrent neural networks (RNN) models. The distinctive feature of our approach is that our multilingual word representation requires only a parallel corpus between source and target languages. More precisely, our approach has the following characteristics: (a) it does not use word alignment information, (b) it does not assume any knowledge about target languages (one requirement is that the two languages (source and target) are not too syntactically divergent), which makes it applicable to a wide range of low-resource languages, (c) it provides authentic multilingual taggers (one tagger forNlanguages). We investigate both uni and bidirectional RNN models and propose a method to include external information (for instance, low-level information from part-of-speech tags) in the RNN to train higher level taggers (for instance, Super Sense taggers). We demonstrate the validity and genericity of our model by using parallel corpora (obtained by manual or automatic translation). Our experiments are conducted to induce cross-lingual part-of-speech and Super Sense taggers. We also use our approach in a weakly supervised context, and it shows an excellent potential for very low-resource settings (less than 1k training utterances).
Sara Meftah, Nasredine Semmar, Mohamed-Ayoub Tahiri, Youssef Tamaazousti, Hassane Essafi, Fatiha Sadat. Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media. 2020.
Dhouha Bouamor, Adrian Popescu, Nasredine Semmar, Pierre Zweigenbaum. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 2013.