Part of Speech (PoS) tagging is still not very well investigated with respect to the Arabic language. Determining the PoS tags of a word in a particular context is difficult, primarily because there is no use of diacritics in most of contemporary texts. Consequently, the same word may be spelled in different ways. Further, detecting the difference between Arabic derivatives represents a very challenging issue for the majority of PoS taggers. Hence, the task of tagging the correct PoS tags requires advanced processing and the use of considerable resources. This study aims to design detailed hierarchical levels of the Arabic tagset categories and their relationships. These hierarchical levels allow easier expansion when required and produce more accurate and precise results. They are based on a comparative study and important references in Arabic grammar; they are also validated by experts in this field. In addition, the proposed tagset is implemented in a PoS tagger and tested via various experiments. We believe that our study makes a significant contribution to the literature because this work is an advancement in the direction of achieving a standard, rich, and comprehensive tagset for Arabic
The Arabic language is expanding in the world. According to UNESCO, the Arabic language is spoken by more than 422 million native speakers around 29 countries and among 1.6 billion Muslims worldwide use it to perform their daily prayers. The presence of the Arabic language on the internet grew around 6.091% in the last fifteen years (2000-2015), it is the highest growth of the ten top online languages. Therefore, the number of Arabic documents increases rapidly. This calls for the necessity to improve Arabic Information Retrieval (IR) techniques. Many researchers agree on the benefits of both stemming and lemmatization in IR, primarily with highly inflective languages, short documents and limited space for storing data. The chief purpose of the current study is assessing the impact of stemming and lemmatization on Arabic IR. In this paper, we illustrate several concepts of Arabic morphology, including stemming and lemmatization algorithms. Then, we highlight the use of these latter and their benefits for different Arabic IR systems. Finally, an experiment is conducted to calculate the occurrence of all Quranic surface word, stem, and lemma forms by searching their similarities in both Classical and Modern Standard Arabic resources. In doing so, recent and efficient analyzers AlKhalil Morpho Sys and MADAMIRA are used.