The Arabic language belongs to a group of languages that require diacritization over their characters. Modern Standard Arabic (MSA) transcripts omit the diacritics, which are essential for many machine learning tasks like Text-To-Speech (TTS) systems. In this work Arabic diacritics restoration is tackled under a deep learning framework that includes the Confused Sub-set Resolution (CSR) method to improve the classification accuracy, in addition to an Arabic Part-of-Speech (PoS) tagging framework using deep neural nets. Special focus is given to syntactic diacritization, which still suffers low accuracy as indicated in prior works. Evaluation is done versus state-of-the-art systems reported in literature, with quite challenging datasets collected from different domains. Standard datasets like the LDC Arabic Tree Bank are used in addition to custom ones we have made available online to allow other researchers to replicate these results. Results show significant improvement of the proposed techniques over other approaches, reducing the syntactic classification error to 9.9% and morphological classification error to 3% compared to 12.7% and 3.8% of the best reported results in literature, improving the error by 22% over the best reported systems.
31 July 1994 in Computers & Industrial Engineering
Multiple neural network modules cooperating in taking a classification decision are modeled as multiple voters electing one candidate in a single ballot election assuming the availability of votes' preferences and intensities. All modules are considered as candidates as well as voters. Voting bids are the output-activations of the modules forming the cooperative modular structure. Different voting schemes are compared according to the accuracy of defining classification decision boundaries. A higher classification accuracy implies a better representation of the information available at different preferences (output values). The effect of the modules' voting power on the accuracy of the decision is studied and integrated in the network's design strategy.
30 January 2015 in The International Journal of Advanced Manufacturing Technology