Tilahun Yeshambel

Tilahun Yeshambel


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 March 2023 in Information
Verified
Journal Article
Open access
PDF file
TYTilahun Yeshambel
Tilahun Yeshambel
Josiane MotheJosiane Mothe
Josiane Mothe
YAYaregal Assabie
Yaregal Assabie
Over the past few years, word embeddings and bidirectional encoder representations from transformers (BERT) models have brought better solutions to learning text representations for natural language processing (NLP) and other tasks. Many NLP applications rely on pre-trained text representations, leading to the development of a number of neural network language models for various languages. However, this is not the case for Amharic, which is known to be a morphologically complex and under-resourced language. Usable pre-trained models for automatic Amharic text processing are not available. This paper presents an investigation on the essence of learned text representation for information retrieval and NLP tasks using word embeddings and BERT language models. We explored the most commonly used methods for word embeddings, including word2vec, GloVe, and fastText, as well as the BERT model. We investigated the performance of query expansion using word embeddings. We also analyzed the use of a pre-trained Amharic BERT model for masked language modeling, next sentence prediction, and text classification tasks. Amharic ad hoc information retrieval test collections that contain word-based, stem-based, and root-based text representations were used for evaluation. We conducted a detailed empirical analysis on the usability of word embeddings and BERT models on word-based, stem-based, and root-based corpora. Experimental results show that word-based query expansion and language modeling perform better than stem-based and root-based text representations, and fastText outperforms other word embeddings on word-based corpus.

15 September 2020
Verified
Book Chapter
Closed access
PDF file
TYTilahun Yeshambel
Tilahun Yeshambel
JMJosiane Mothe
Josiane Mothe
YAYaregal Assabie
Yaregal Assabie

26 January 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
TYTilahun Yeshambel
Tilahun Yeshambel
Josiane MotheJosiane Mothe
Josiane Mothe
YAYaregal Assabie
Yaregal Assabie
Information retrieval (IR) is one of the most important research and development areas due to the explosion of digital data and the need of accessing relevant information from huge corpora. Although IR systems function well for technologically advanced languages such as English, this is not the case for morphologically complex, under-resourced and less-studied languages such as Amharic. Amharic is a Semitic language characterized by a complex morphology where thousands of words are generated from a single root form through inflection and derivation. This has made the development of Amharic natural language processing (NLP) tools a challenging task. Amharic adhoc retrieval also faces challenges due to scarcity of linguistic resources, tools and standard evaluation corpora. In this research work, we investigate the impact of morphological features on the representation of Amharic documents and queries for adhoc retrieval. We also analyze the effects of stem-based and root-based text representation, and proposed new Amharic IR system architecture. Moreover, we present the resources and corpora we constructed for evaluation of Amharic IR systems and other NLP tools. We conduct various experiments with a TREC-like approach for Amharic IR test collection using a standard evaluation framework and measures. Our findings show that root-based text representation outperforms the conventional stem-based representation on Amharic IR.

2 July 2024 in Language Resources and Evaluation
Verified
Journal Article
Closed access
PDF file
TYTilahun Yeshambel
Tilahun Yeshambel
Josiane MotheJosiane Mothe
Josiane Mothe
YAYaregal Assabie
Yaregal Assabie

13 July 2025
Verified
Conference Paper
Open access
TYTilahun Yeshambel
Tilahun Yeshambel
MGMoncef Garouani
Moncef Garouani
SMSerge Molina
Serge Molina
Josiane MotheJosiane Mothe
Josiane Mothe

7 September 2022
Verified
Book Chapter
Closed access
PDF file
TYTilahun Yeshambel
Tilahun Yeshambel
Josiane MotheJosiane Mothe
Josiane Mothe
YAYaregal Assabie
Yaregal Assabie