Steven Moonen

Mr. Steven Moonen

IIW: Computer Graphics, Hasselt University, Hasselt, Flanders, Belgium
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 February 2024 in Machines
Verified
Journal Article
Open access
PDF file
PRPeter De Roovere
Peter De Roovere
Steven MoonenSteven Moonen
Steven Moonen
NMNick MICHIELS
Nick MICHIELS
FWFrancis Wyffels
Francis Wyffels
We present a diverse dataset of industrial metal objects with unique characteristics such as symmetry, texturelessness, and high reflectiveness. These features introduce challenging conditions that are not captured in existing datasets. Our dataset comprises both real-world and synthetic multi-view RGB images with 6D object pose labels. Real-world data were obtained by recording multi-view images of scenes with varying object shapes, materials, carriers, compositions, and lighting conditions. This resulted in over 30,000 real-world images. We introduce a new public tool that enables the quick annotation of 6D object pose labels in multi-view images. This tool was used to provide 6D object pose labels for all real-world images. Synthetic data were generated by carefully simulating real-world conditions and varying them in a controlled and realistic way. This resulted in over 500,000 synthetic images. The close correspondence between synthetic and real-world data and controlled variations will facilitate sim-to-real research. Our focus on industrial conditions and objects will facilitate research on computer vision tasks, such as 6D object pose estimation, which are relevant for many industrial applications, such as machine tending. The dataset and accompanying resources are available on the project website.

7 January 2026 in arXiv
Verified
Preprint
Open access
PDF file
Steven MoonenSteven Moonen
Steven Moonen
RSRob Salaets
Rob Salaets
KBKenneth Batstone
Kenneth Batstone
ABAbdellatif Bey-Temsamani
Abdellatif Bey-Temsamani
NMNick Michiels
Nick Michiels
In the manufacturing industry, computer vision systems based on artificial intelligence (AI) are widely used to reduce costs and increase production. Training these AI models requires a large amount of training data that is costly to acquire and annotate, especially in high-variance, low-volume manufacturing environments. A popular approach to reduce the need for real data is the use of synthetic data that is generated by leveraging computer-aided design (CAD) models available in the industry. However, in the agricultural industry these models are not readily available, increasing the difficulty in leveraging synthetic data. In this paper, we present different techniques for substituting CAD files to create synthetic datasets. We measure their relative performance when used to train an AI object detection model to separate stones and potatoes in a bin picking environment. We demonstrate that using highly representative 3D models acquired by scanning or using image-to-3D approaches can be used to generate synthetic data for training object detection models. Finetuning on a small real dataset can significantly improve the performance of the models and even get similar performance when less representative models are used.

29 November 2022 in arXiv
Verified
Preprint
Open access
PDF file
BVBram Vanherle
Bram Vanherle
Steven MoonenSteven Moonen
Steven Moonen
FRFrank Van Reeth
Frank Van Reeth
NMNick MICHIELS
Nick MICHIELS
Recently, the use of synthetic training data has been on the rise as it offers correctly labelled datasets at a lower cost. The downside of this technique is that the so-called domain gap between the real target images and synthetic training data leads to a decrease in performance. In this paper, we attempt to provide a holistic overview of how to use synthetic data for object detection. We analyse aspects of generating the data as well as techniques used to train the models. We do so by devising a number of experiments, training models on the Dataset of Industrial Metal Objects (DIMO). This dataset contains both real and synthetic images. The synthetic part has different subsets that are either exact synthetic copies of the real data or are copies with certain aspects randomised. This allows us to analyse what types of variation are good for synthetic training data and which aspects should be modelled to closely match the target data. Furthermore, we investigate what types of training techniques are beneficial towards generalisation to real data, and how to use them. Additionally, we analyse how real images can be leveraged when training on synthetic images. All these experiments are validated on real data and benchmarked to models trained on real data. The results offer a number of interesting takeaways that can serve as basic guidelines for using synthetic data for object detection. Code to reproduce results is available at https://github.com/EDM-Research/DIMO_ObjectDetection.

28 March 2023
Verified
Conference Paper
Closed access
JHJoris De Hoog
Joris De Hoog
GGGuillaume Grimard
Guillaume Grimard
TBTaoufik Bourgana
Taoufik Bourgana
NMNick MICHIELS
Nick MICHIELS
Steven MoonenSteven Moonen
Steven Moonen
ATAbdellatif Bey Temsamani
Abdellatif Bey Temsamani
With the growing demand for automation in the manufacturing industry, computer vision-based systems have become a popular tool for tasks such as object detection, object picking, and quality control. One of the main challenges in developing such systems is obtaining enough high-quality training data. In this paper, we present a suite of tools that create artificial training data and applies it to solve industrial problems. CAD2Render is a tool for generating synthetic images, starting from a 3D CAD model, which can be used to create large datasets with a large spectrum of controlled variations. CAD2Detect uses these synthetic images to train object detection models. CAD2Pose focuses on estimating the 6 degree of freedom pose of objects in images. Finally, CAD2Defect uses anomaly detection to identify defects in manufactured parts. Overall, the CAD2X suite provides a comprehensive set of tools for training computer vision models for manufacturing applications, while minimizing the need for large amounts of real training data. We demonstrate the effectiveness of our approach on a range of industrial use cases.

30 September 2026 in Agriengineering
Verified
Journal Article
Open access
PDF file
Steven MoonenSteven Moonen
Steven Moonen
Wouter JansenWouter Jansen
Wouter Jansen
WLWenzhi Liao
Wenzhi Liao
Mohammad Hasan RahmaniMohammad Hasan Rahmani
Mohammad Hasan Rahmani
AAAyyoub Ahar
Ayyoub Ahar
NMNick MICHIELS
Nick MICHIELS
The availability of large annotated datasets remains a major bottleneck for deploying computer vision systems in agricultural and agri-food applications, particularly for tasks requiring fine-grained annotations such as defect detection and instance segmentation. Synthetic data generation offers a scalable alternative, but its effectiveness in complex real-world scenarios remains insufficiently understood. In this work, the role of synthetic data is investigated across three representative tasks each posing unique challenges: apple detection in orchard environments, potato–stone classification in industrial sorting, and carrot crack detection for quality inspection. The real and synthetic data, as well as their annotations, are publicly available. The synthetic data is created using a set of tools for fast large-scale procedural scene generation with highly detailed natural assets. For each task, datasets are constructed combining real and synthetically generated images with pixel-level annotations. Training strategies are systematically evaluated using fully real, limited real, synthetic-only, and combined datasets. The results show that synthetic-only training leads to a clear performance gap on real-world data, with mAP50 decreasing from 0.866–0.891 for fully real training to 0.396–0.703 for synthetic-only training across the three use cases. However, combining synthetic data with only 10 real images recovers 75–98% of the gap between training on those 10 real images alone (mAP50 0.194–0.497) and full real training, reaching mAP50 values of 0.723–0.885. These findings highlight the potential of synthetic data for improving data efficiency and provide a reproducible benchmark for future research on sim-to-real transfer in agricultural computer vision.

25 November 2022 in arXiv
Verified
Preprint
Open access
PDF file
Steven MoonenSteven Moonen
Steven Moonen
BVBram Vanherle
Bram Vanherle
JHJoris de Hoog
Joris de Hoog
TBTaoufik Bourgana
Taoufik Bourgana
ATAbdellatif Bey Temsamani
Abdellatif Bey Temsamani
NMNick MICHIELS
Nick MICHIELS
The use of computer vision for product and assembly quality control is becoming ubiquitous in the manufacturing industry. Lately, it is apparent that machine learning based solutions are outperforming classical computer vision algorithms in terms of performance and robustness. However, a main drawback is that they require sufficiently large and labeled training datasets, which are often not available or too tedious and too time consuming to acquire. This is especially true for low-volume and high-variance manufacturing. Fortunately, in this industry, CAD models of the manufactured or assembled products are available. This paper introduces CAD2Render, a GPU-accelerated synthetic data generator based on the Unity High Definition Render Pipeline (HDRP). CAD2Render is designed to add variations in a modular fashion, making it possible for high customizable data generation, tailored to the needs of the industrial use case at hand. Although CAD2Render is specifically designed for manufacturing use cases, it can be used for other domains as well. We validate CAD2Render by demonstrating state of the art performance in two industrial relevant setups. We demonstrate that the data generated by our approach can be used to train object detection and pose estimation models with a high enough accuracy to direct a robot. The code for CAD2Render is available at https://github.com/EDM-Research/CAD2Render.