Oscar Ondeng

Mr. Oscar Ondeng


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 October 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
OOOscar Ondeng
Oscar Ondeng
Heywood Ouma AbsalomsHeywood Ouma Absaloms
Heywood Ouma Absaloms
PAPeter Akuon
Peter Akuon
Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using vision-language models. The transformer architecture was initially developed in the context of natural language processing and quickly found application in the domain of computer vision. Its recent application to the task of image captioning has resulted in markedly improved performance. In this paper, we briefly look at the transformer architecture and its genesis in attention mechanisms. We more extensively review a number of transformer-based image captioning models, including those employing vision-language pre-training, which has resulted in several state-of-the-art models. We give a brief presentation of the commonly used datasets for image captioning and also carry out an analysis and comparison of the transformer-based captioning models. We conclude by giving some insights into challenges as well as future directions for research in this area.

1 January 2025 in IET Computer Vision
Verified
Journal Article
Open access
OOOscar Ondeng
Oscar Ondeng
PAPeter Akuon
Peter Akuon
HOHeywood Ouma
Heywood Ouma
Transformers have achieved remarkable success in computer vision, but their reliance on self‐attention mechanisms poses challenges for small‐scale datasets due to high computational demands and data requirements. This paper introduces the Multi‐Head Adaptive Filter Frequency Vision Transformer (MAF‐FViT), a Vision Transformer model that replaces self‐attention with frequency‐domain adaptive filters. MAF‐FViT leverages multi‐head adaptive filtering in the frequency domain to capture essential features with reduced computational complexity, providing an efficient alternative for vision tasks on limited data. Training is carried out from scratch without the need for pretraining on large‐scale datasets. The proposed MAF‐FViT model demonstrates strong performance on various image classification tasks, achieving competitive accuracy with a lower parameter count and faster processing times compared to self‐attention‐based models and other models employing alternative token mixers. The multi‐head adaptive filters enable the model to capture complex image features effectively, preserving high classification accuracy while minimising computational load. The results demonstrate that frequency‐domain adaptive filters offer an effective alternative to self‐attention, enabling competitive performance on small‐scale datasets while reducing training time and memory requirements. MAF‐FViT opens avenues for resource‐efficient transformer models in vision applications, making it a promising solution for settings constrained by data or computational resources.

18 December 2024 in Image and Vision Computing
Verified
Journal Article
Closed access
OOOscar Ondeng
Oscar Ondeng
HOHeywood Ouma
Heywood Ouma
PAPeter Akuon
Peter Akuon