Maxim Bonnaerens

Mr. Maxim Bonnaerens

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 May 2022 in Computer Vision and Image Understanding
Verified
Journal Article
Open access
MBMaxim Bonnaerens
Maxim Bonnaerens
MFMatthias Freiberger
Matthias Freiberger
JDJoni Dambre
Joni Dambre

9 December 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
MBMaxim Bonnaerens
Maxim Bonnaerens
MFMatthias Freiberger
Matthias Freiberger
MVMarian Verhelst
Marian Verhelst
JDJoni Dambre
Joni Dambre
In this paper, we propose a methodology to accurately evaluate and compare the performance of efficient neural network building blocks for computer vision in a hardware-aware manner. Our comparison uses pareto fronts based on randomly sampled networks from a design space to capture the underlying accuracy/complexity trade-offs. We show that our approach enables matching of information obtained by previous comparison paradigms, but provides more insights into the relationship between hardware cost and accuracy. We use our methodology to analyze different building blocks and evaluate their performance on a range of embedded hardware platforms. This highlights the importance of benchmarking building blocks as a preselection step in the design process of a neural network. We show that choosing the right building block can speed up inference by up to a factor of two on specific hardware ML accelerators.

17 August 2023 in arXiv
Verified
Preprint
Open access
PDF file
MBMaxim Bonnaerens
Maxim Bonnaerens
JDJoni Dambre
Joni Dambre
Vision transformers have demonstrated remarkable success in a wide range of computer vision tasks over the last years. However, their high computational costs remain a significant barrier to their practical deployment. In particular, the complexity of transformer models is quadratic with respect to the number of input tokens. Therefore techniques that reduce the number of input tokens that need to be processed have been proposed. This paper introduces Learned Thresholds token Merging and Pruning (LTMP), a novel approach that leverages the strengths of both token merging and token pruning. LTMP uses learned threshold masking modules that dynamically determine which tokens to merge and which to prune. We demonstrate our approach with extensive experiments on vision transformers on the ImageNet classification task. Our results demonstrate that LTMP achieves state-of-the-art accuracy across reduction rates while requiring only a single fine-tuning epoch, which is an order of magnitude faster than previous methods. Code is available at https://github.com/Mxbonn/ltmp .