When a mobile robotic manipulator interacts with other robots, people, or the environment in general, the end-effector forces need to be measured to assess if a task has been completed successfully. Traditionally used force or torque estimation methods are usually based on observers, which require knowledge of the robot dynamics. Contrary to this, our approach involves two methods based on deep neural networks: robot end-effector force estimation and joint torque estimation. These methods require no knowledge of robot dynamics and are computationally effective but require a force sensor under the robot base. Several different architectures were considered for the tasks, and the best ones were identified among those tested. First, the data for training the networks were obtained in simulation. The trained networks showed reasonably good performance, especially using the LSTM architecture (with a root mean squared error (RMSE) of 0.1533 N for end-effector force estimation and 0.5115 Nm for joint torque estimation). Afterward, data were collected on a real Franka Emika Panda robot and then used to train the same networks for joint torque estimation. The obtained results are slightly worse than in simulation (0.5115 Nm vs. 0.6189 Nm, according to the RMSE metric) but still reasonably good, showing the validity of the proposed approach.

When a robotic manipulator interacts with its environment, the end-effector forces need to be measured to assess if a task has been completed successfully and for safety reasons. Traditionally, these forces are either measured directly by a 6-dimensional (6D) force–torque sensor (mounted on a robot’s wrist) or by estimation methods based on observers, which require knowledge of the robot’s exact model. Contrary to this, the proposed approach is based on using an array of low-cost 1-dimensional (1D) strain gauge sensors mounted beneath the robot’s base in conjunction with time series neural networks, to estimate both the end-effector 3-dimensional (3D) interaction forces as well as robot joint torques. The method does not require knowledge of robot dynamics. For comparison reasons, the same approach was used but with 6D force sensor measurements mounted beneath the robot’s base. The trained networks showed reasonably good performance, using the long-short term memory (LSTM) architecture, with a root mean squared error (RMSE) of 1.945 N (vs. 2.004 N; 6D force–torque sensor-based) for end-effector force estimation and 3.006 Nm (vs. 3.043 Nm; 6D force–torque sensor-based) for robot joint torque estimation. The obtained results for an array of 1D strain gauges were comparable with those obtained with a robot’s built-in sensor, demonstrating the validity of the proposed approach.

In this paper, a novel approach for an automatic object detection and localisation on aerial images is proposed. Proposed model does not use ground control points (GCPs) and consists of three major phases. In the first phase, optimal flight route is planned in order to capture the area of interest and aerial images are acquired using unmanned aerial vehicle (UAV), followed by creating a mosaic of collected images to obtained larger field-of-view panoramic image of the area of interest and using the obtained image mosaic to create georeferenced map. The image mosaic is then also used to detect objects of interest using the approach based on convolutional neural networks.