Industrial robots and associated control methods are continuously developing. With the recent progress in the field of artificial intelligence, new perspectives in industrial robot control strategies have emerged, and prospects towards cognitive robots have arisen. AI-based robotic systems are strongly becoming one of the main areas of focus, as flexibility and deep understanding of complex manufacturing processes are becoming the key advantage to raise competitiveness. This review first expresses the significance of smart industrial robot control in manufacturing towards future factories by listing the needs, requirements and introducing the envisioned concept of smart industrial robots. Secondly, the current trends that are based on different learning strategies and methods are explored. Current computer-vision, deep reinforcement learning and imitation learning based robot control approaches and possible applications in manufacturing are investigated. Gaps, challenges, limitations and open issues are identified along the way.
This paper presents a wearable wireless system for measuring human body activities, consisting of small inertial sensor nodes and the main hub for data transmission via Bluetooth for further analysis. Unlike optical and ultrasonic technologies, the proposed solution has no movement restrictions, such as the requirement to stay in the line of sight, and it provides information on the dynamics of the human body’s poses regardless of its location. The problem of the correct placement of sensors on the body is considered, a simplified architecture of the wearable clothing is described, an experimental set-up is developed and tests are performed. The system has been tested by performing several physical exercises and comparing the performance with the commercially available BTS Bioengineering SMART DX motion capture system. The results show that our solution is more suitable for complex exercises as the system based on digital cameras tends to lose some markers. The proposed wearable sensor clothing can be used as a multi-purpose data acquisition device for application-specific data analysis, thus providing an automated tool for scientists and doctors to measure patient’s body movements.
Reliable facial recognition systems are of crucial importance in various applications from entertainment to security. Thanks to the deep‐learning concepts introduced in the field, a significant improvement in the performance of the unimodal facial recognition systems has been observed in the recent years. At the same time a multimodal facial recognition is a promising approach. This study combines the latest successes in both directions by applying deep learning convolutional neural networks (CNN) to the multimodal RGB, depth, and thermal (RGB‐D‐T) based facial recognition problem outperforming previously published results. Furthermore, a late fusion of the CNN‐based recognition block with various hand‐crafted features (local binary patterns, histograms of oriented gradients, Haar‐like rectangular features, histograms of Gabor ordinal measures) is introduced, demonstrating even better recognition performance on a benchmark RGB‐D‐T database. The obtained results in this study show that the classical engineered features and CNN‐based features can complement each other for recognition purposes.
This paper presents a method for real-time shape sensing of thin and flexible materials, such as fabric. A method is based on three-axial acceleration and magnetic sensor nodes that are embedded into the material and can measure local orientation data. A proposed algorithm for global shape reconstruction from local orientation measurements ensures fast computations for shape reconstruction utilizing data from large number of sensors. This provides basis for the development of portable self-contained real-time systems for free form shape sensing with high resolution that has not been demonstrated before. A method is designed for applications in new emerging fields, such as smart textile and flexible electronics, where it can be used to obtain wearers posture or shape of the device. A method can be implemented with off the shelf low-cost electronic components and conventional portable computing devices, such as smartphone. The practical implementation of the system is demonstrated, also assessment of shape reconstruction performance is done by comparison with commercial Kinect v2 sensor. Impact of different error sources is analyzed, and possible improvements of the method are discussed.
Artificial Neural Networks (ANNs) have become an accepted approach for a wide range of challenges. Meanwhile, the advancement of chip manufacturing processes is approaching saturation which calls for new computing solutions. This work presents a novel approach of an FPGA-based accelerator development for fully connected feed-forward neural networks (FFNNs). A specialized tool was developed to facilitate different implementations, which splits FFNN into elementary layers, allocates computational resources and generates high-level C++ description for high-level synthesis (HLS) tools. Various topologies are implemented and benchmarked, and a comparison with related work is provided. The proposed methodology is applied for the implementation of high-throughput virtual sensor.
Facial images are of critical importance in many real-world applications from gaming to surveillance. The current literature on facial image analysis, from face detection to face and facial expression recognition, are mainly performed in either RGB, Depth (D), or both of these modalities. But, such analyzes have rarely included Thermal (T) modality. This paper paves the way for performing such facial analyzes using synchronized RGB-D-T facial images by introducing a database of 51 persons including facial images of different rotations, illuminations, and expressions. Furthermore, a face recognition algorithm has been developed to use these images. The experimental results show that face recognition using such three modalities provides better results compared to face recognition in any of such modalities in most of the cases.