Six-dimensional object detection of rigid objects is a problem especially relevant for quality control and robotic manipulation in industrial contexts. This work is a survey of the state of the art of 6D object detection with these use cases in mind, specifically focusing on algorithms trained only with 3D models or renderings thereof. Our first contribution is a listing of requirements typically encountered in industrial applications. The second contribution is a collection of quantitative evaluation results for several different 6D object detection methods trained with synthetic data and the comparison and analysis thereof. We identify the top methods for individual requirements that industrial applications have for object detectors, but find that a lack of comparable data prevents large-scale comparison over multiple aspects.
Accurately replicating the appearance of real-world materials in computer graphics is a complex task due to the intricate interactions between light, reflectance, and geometry. In this paper we address the challenges of material representation, acquisition, and editing by leveraging the potential of deep learning algorithms our framework provide. To enable the visualization and generation of material assets from single or multi-view images, allowing for the estimation of materials from real world objects. Additionally, a material asset exporter, enabling the export of materials in widely used formats and facilitating easy editing using common content creator tools. The proposed framework enables designers to effectively collaborate and seamlessly integrate deep learning-based material estimation models into their design pipelines using traditional content creation tools. An analysis of the performance and memory usage of material assets at various texture resolutions shows that our framework can be used plausibly according to the needs of the end-user.
Current state-of-the-art 6d pose estimation is too compute intensive to be deployed on edge devices, such as Microsoft HoloLens (2) or Apple iPad, both used for an increasing number of augmented reality applications. The quality of AR is greatly dependent on its capabilities to detect and overlay geometry within the scene. We propose a synthetically trained client-server-based augmented reality application, demonstrating state-of-the-art object pose estimation of metallic and texture-less industry objects on edge devices. Synthetic data enables training without real photographs, i.e. for yet-to-be-manufactured objects. Our qualitative evaluation on an AR-assisted sorting task, and quantitative evaluation on both renderings, as well as real-world data recorded on HoloLens 2, sheds light on its real-world applicability.