In this paper, the stability analysis and control synthesis of Interval Type-2 (IT2) Polynomial-Fuzzy-Model-Based (PFMB) networked control systems are investigated under the event-triggered control framework. The nonlinear dynamics in the plant is efficiently represented by an IT2 polynomial fuzzy model that the IT2 membership functions are utilized to capture the uncertainties in the plant. An event-triggered IT2 polynomial fuzzy controller is then designed to stabilize the nonlinear model subject to uncertainties. The stability conditions of the closed-loop control system are summarized in the form of Sum-of-Squares (SOS). Under the Imperfectly Premise Matching (IPM) concept, the Membership-Function-Dependent (MFD) approach is applied to endow the polynomial fuzzy controllers with more flexibility in terms of number of rules and premise membership functions. In the MFD approach under the IPM concept, both the number of rules and the shape of membership functions in the fuzzy models and controllers can be different. Also, the information of IT2 membership functions of the polynomial fuzzy model and controller is considered and adopted to further relax the stability conditions. Furthermore, the intrinsic mismatched issue of the premise variables of the fuzzy model and controllers due to the event-triggering mechanism is handled by the MFD approach. A detailed simulation example is provided to verify the effectiveness of the proposed event-based control strategy.
20 September 2023 in IEEE Transactions on Instrumentation and Measurement
Simultaneous localization and mapping (SLAM) has been widely used in augmented reality (AR), virtual reality (VR), robotics, and autonomous vehicles as the theoretical basis for robots to perceive their environment. Most popular SLAM algorithms assume that objects in the scene are static. Solving dynamic problems in SLAM is now attracting increasing attention. In this paper, we propose a method that combines semantic segmentation information and spatial motion information of associated pixels to cope with dynamic objects based on ORB-SLAM2. We add a deep segmentation network SegNet to segment input image and obtain the semantic information for each feature point. Next, the spatial velocity of feature points between adjacent frames is calculated assuming uniform motion. Finally, the two parts are fused for the final judgment, and the dynamic feature points are removed to improve positioning accuracy. We evaluate our SLAM algorithms using the public KITTI dataset. The proposed algorithm has a similar overall accuracy level to ORB-SLAM2, but it is more accurate in sequences with many dynamic objects. On KITTI’s raw data sequence containing multiple dynamic objects, our pipeline achieves the best performance, improving 39.5% compared with the original ORB-SLAM2 system. We compare our algorithm with other state-of-the-art SLAM systems used to cope with dynamic environments. The results show that the proposed algorithm has better performance.
18 March 2024 in IEEE Transactions on Automation Science and Engineering
The integration of cloud computing and edge computing is an effective way to achieve global consistent and real-time multi-robot Simultaneous Localization and Mapping (SLAM). Cloud computing effectively solves the problem of limited computing, communication and storage capacity of terminal equipment. However, limited bandwidth and extremely long communication links between terminal devices and the cloud result in serious performance degradation of multi-robot SLAM systems. To reduce the computational cost of feature tracking and improve the real-time performance of the robot, a lightweight SLAM method of optical flow tracking based on pyramid IMU prediction is proposed. On this basis, a centralized multi-robot SLAM system based on a robot-edge-cloud layered architecture is proposed to realize real-time collaborative SLAM. It avoids the problems of limited on-board computing resources and low execution efficiency of single robot. In this framework, only the feature points and keyframe descriptors are transmitted and lossless encoding and compression are carried out to realize real-time remote information transmission with limited bandwidth resources. This design reduces the actual bandwidth occupied in the process of data transmission, and does not cause the loss of SLAM accuracy caused by data compression. Through experimental verification on the EuRoC dataset, compared with the current most advanced local feature compression method, our method can achieve lower data volume feature transmission, and compared with the current advanced centralized multi-robot SLAM scheme, it can achieve the same or better positioning accuracy under low computational load. Note to Practitioners —The purpose of this paper is to reduce the communication load of a Cloud-Edge-Robot system by compressing and transmitting of keyframes and non-keyframes, respectively, which is suitable for a multi-robot SLAM system and can realize multi-robot joint localization and sparse map reconstruction under efficient communication. Currently, remote SLAM or centralized multi-robot SLAM is usually implemented by transferring the whole image or the features and descriptors of the image. In this paper, lightweight SLAM optical flow tracking based on pyramid IMU prediction is implemented to track non-keyframes. At the edge server, tracking between non-keyframes is realized only by transmitting keypoints. For keyframes, the pose estimation is realized by transmitting compressed features and descriptors. Multi-robot localization and map fusion are realized in the cloud through key frame feature information. Experiments on public datasets show that this method is feasible and can achieve high-precision joint positioning with a low amount of transmitted data. In future studies, we will apply this framework to more real-world systems, while achieving rich, accurate map fusion with more advanced features.
The most commonly used simultaneous localization and mapping (SLAM) scheme often assumes a static environment, leading to significant errors in pose estimation when operating in highly dynamic scenes. To address this limitation and improve the robustness and accuracy of positioning in dynamic environments, this study proposes CD-SLAM, a real-time stereo vision inertial SLAM system specifically designed for complex dynamic environments, based on ORB-SLAM3. CD-SLAM enhances the tracking thread and introduces a new parallel thread that utilizes YOLOv5 to detect objects in each input frame and extract semantic information. This semantic information, combined with prior information from the inertial measurement unit (IMU), is used for pose estimation, eliminating the pose information of dynamic objects and consequently improving the accuracy and robustness of positioning. Furthermore, CD-SLAM employs scene flow to calculate the distance between adjacent frames and determine the spatial velocity between them, compensating for potential static information through a velocity filtering algorithm. To enhance positioning accuracy in challenging environments with weak textures, CD-SLAM integrates an IMU for motion prediction and coherence detection. Finally, appeal information is integrated to determine the motion status of objects in the scene and filter out dynamic feature points. Experimental tests conducted on the VIODE dataset demonstrate that CD-SLAM outperforms the existing algorithms in terms of accuracy and robustness.