This paper presents a pig carcass cutting dataset, captured from a bespoke frame structure with 6 Intel® RealSense™ Depth Camera D415 cameras attached, and later recorded from a single camera attached to a robotic arm cycling through the positions previously defined by the frame structure. The data is composed of bags files recorded from the Intel’s SDK, which includes RGB-D data and camera intrinsic parameters for each sensor. In addition, ten JSON files with the transformation matrix for each camera in relation to the left/front camera in the structure are provided, five JSON files for the data recorded with the bespoke frame and five JSON files for the data captured with the robotic arm.
Advances in visual sensor devices and computing power are revolutionising the interaction of robots with their environment. Cameras that capture depth information along with a common colour image play a significant role. These devices are cheap, small, and fairly precise. The information provided, particularly point clouds, can be generated in a virtual computing environment, providing complete 3D information for applications. However, off-the-shelf cameras often have a limited field of view, both on the horizontal and vertical axis. In larger environments, it is therefore often necessary to combine information from several cameras or positions. To concatenate multiple point clouds and generate the complete environment information, the pose of each camera must be known in the outer scene, i.e., they must reference a common coordinate system. To achieve this, a coordinate system must be defined, and then every device must be positioned according to this coordinate system. For cameras, a calibration can be performed to find its pose in relation to this coordinate system. Several calibration methods have been proposed to solve this challenge, ranging from structured objects such as chessboards to features in the environment. In this study, we investigate how three different pose estimation methods for multi-camera perspectives perform when reconstructing a scene in 3D. We evaluate the usage of a charuco cube, a double-sided charuco board, and a robot’s tool centre point (TCP) position in a real usage case, where precision is a key point for the system. We define a methodology to identify the points in the 3D space and measure the root-mean-square error (RMSE) based on the Euclidean distance of the actual point to a generated ground-truth point. The reconstruction carried out using the robot’s TCP position produced the best result, followed by the charuco cuboid; the double-sided angled charuco board exhibited the worst performance.
In the last decade, there has been a rising interest in cyber physical systems (CPS), both in civil and military use. Together with the popularization and evolution of navigation sensors, as global position system (GPS) and inertial measurement unit (IMU), has triggered researches in control systems that are more suitable to non-linear systems of an airplane in flight. Classic control systems has been used from simplified mathematical model. As dynamic systems may present complex behaviour, new concepts and technologies of advanced control systems needs to be used. In this work is shown a control method that combine the reasoning of fuzzy logic with the learning of neural network. An adaptive neuro-fuzzy inference system is described to control the heading of an unmanned aerial vehicle (UAV) with a delta type fixed wing with reduced control surfaces called elevens. The UAV has an embedded autopilot board with a micro-controller (mcu) capable of real-time data processing and navigation sensors making this platform suitable for autonomous flight.
This paper presents work relating to the reconstruction of 3D point clouds taken from cameras placed arbitrarily in pairs on either side of an object (a pig carcass in this specific use-case). This poses a challenge for complete object reconstruction since the two sides or halves of the object have little or no overlap and high degree of symmetry. The investigation was part of a data collection inside slaughterhouses for a meat factory cell concept development, where the production line cannot be stopped to perform calibration of the cameras. In addition, the footprint should be small, and the cameras' lenses protected and easy to clean. This work presents the method, or pipeline, used to overcome this challenge along with the performance of the pipeline by comparing real-world and point cloud distance measurements.