Xiaochun Mai

Xiaochun Mai

Auto-generated profile, based on publicly available information

Xiaochun Mai

College of Electronic and Information Engineering, Shenzhen University, Shenzhen, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 January 2020 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
XJXiao Jia
Xiao Jia
XMXiaochun Mai
Xiaochun Mai
YCYi Cui
Yi Cui
YYYixuan Yuan
Yixuan Yuan
XXXiaohan Xing
Xiaohan Xing
MMMax Q.-H. Meng
Max Q.-H. Meng
Polyp recognition in colonoscopy images is crucial for early colorectal cancer detection and treatment. However, the current manual review requires undivided concentration of the gastroenterologist and is prone to diagnostic errors. In this article, we present an effective, two-stage approach called

30 January 2020 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
XMXiaochun Mai
Xiaochun Mai
HZHong Zhang
Hong Zhang
XJXiao Jia
Xiao Jia
MMMax Q.-H. Meng
Max Q.-H. Meng
Fruit detection is a fundamental task for automatic yield estimation. The goal is to detect all the fruits in images. The-state of the art of fruit detection algorithm, Faster R-CNN, shows a lack of detection advantage on small fruits. One of the reasons is only that single-level features and a classifier are used for localization of proposal candidates. In this article, we propose to incorporate a multiple classifier fusion strategy into a Faster R-CNN network for small fruit detection. We utilize features from three different levels to learn three classifiers for objectness classification in the stage of proposal localization. Probabilities from classifiers are combined by a simple convolutional layer to generate final objectness classification for proposal candidates. During training, in order to train a model with strong generalization capability, we propose to use correlation coefficients to measure the diversity of multiple classifiers. A novel loss function with classifier correlation is introduced to train the region proposal network. We evaluate the proposed model on two data sets of small fruits. Extensive experiments show that the proposed model outperforms the state-of-the-art detectors for fruit detection.

14 September 2020 in IEEE Sensors Journal
Verified
Journal Article
Closed access
JCJiyu Cheng
Jiyu Cheng
CWChaoqun Wang
Chaoqun Wang
XMXiaochun Mai
Xiaochun Mai
ZMZhe Min
Zhe Min
MMMax Q.-H. Meng
Max Q.-H. Meng
In recent decades, semantic mapping has become a hot topic benefited from the maturity of visual simultaneous localization and mapping (visual SLAM) and the success of deep learning. Despite the impressive performance of the current state-of-the-art systems, semantic mapping in dynamic environments is still a challenging task. To address this problem, we propose a framework that fuses geometric information, semantic information, and human activity into a 3D dense map. The accuracy of the map is guaranteed by the reliable camera trajectory estimation and the static pixels used for 3D reconstruction. With the proposed framework, we achieve two objectives. On the one hand, we accurately reconstruct the environment from both geometric and semantic perspectives. On the other hand, we record human activity by tracking the human trajectory during the mapping period. We conduct both qualitative and quantitative experiments on the public TUM dataset. The experimental results demonstrate the feasibility and effectiveness of the proposed framework.

4 December 2020 in IEEE Sensors Journal
Verified
Journal Article
Closed access
JPJin Pan
Jin Pan
XMXiaochun Mai
Xiaochun Mai
CWChaoqun Wang
Chaoqun Wang
ZMZhe Min
Zhe Min
JWJiankun Wang
Jiankun Wang
MMMax Q.-H. Meng
Max Q.-H. Meng
For airports with high passenger and luggage flows, a large number of staff members have to be hired to deploy the scattered passenger luggage trolleys. To release humans from the repetitive and laborious job, we develop an autonomous trolley deployment robot to detect, transport and collect the scattered idle trolleys to recycling points. This paper will firstly illustrate the entire collection pipeline of the deployment robot system and then address the key challenge: partial to full point set registration. With the perception framework, the robot can detect the idle trolleys and acquire the pose of the trolleys on the ground, and then capture the trolley from behind, along the same direction for subsequent grasping and manipulation. With RGB-D camera and a segmentation Convolutional Neural Network, the robot can generate a partial surface point cloud of the detected trolley. The resulting point cloud, data and a pre-scanned full trolley point cloud, model, are matched by an implicit pose. To tackle the low accuracy and long computation time issues, a novel searching space-constrained point set registration algorithm is proposed to register the two overlapping point sets. Based on Branch-and-Bound (BnB) mechanism, the error between data and model is iteratively optimized. The constraint of searching space speeds up the global searching of the optimal pose, by pruning the candidate spaces which is impossible to contain the optimal result. To evaluate the performance, an airport trolley segmentation dataset and a point cloud dataset for registration are constructed. Experimental results on the datasets and synthetic dataset show that our method achieves higher accuracy and success rate than the previous methods. The experiments demonstrated in video clips validate the developed system works in real-world applications.

7 September 2020 in IEEE Sensors Journal
Verified
Journal Article
Closed access
CWChaoqun Wang
Chaoqun Wang
XMXiaochun Maib
Xiaochun Maib
DHDanny Hoc
Danny Hoc
TLTingting Liud
Tingting Liud
CLChenming Lie
Chenming Lie
MMMax Q.-H. Meng
Max Q.-H. Meng
In this study, a systematic solution for mobile manipulation with the application of autonomous trolley collection in the airport is presented. The developed system features a novel integrated hardware and software system, incorporating a specially designed manipulator capable of tightly catching the trolley. Particularly, we innovatively present a supervisory control guided coarse-to-fine visual trolley catching strategy in large-scale airport environments. At the coarsest level, an image-based visual servoing method is utilized to approach the trolley from far to near, where a learning-based object detection method is adopted to identify trolleys in the environment in real-time. At the finest level, we present an accurate point cloud registration based object pose estimation method to promote the object manipulation with a position-based visual servoing controller. The tightly integrated system and the subsystems are evaluated through conducting experiments in the trolley collection task and comparing the key module with the state of the art. Extensive experiments demonstrate that the proposed framework can find and fetch the trolley robustly. Notably, the proposed object detection and pose estimation methods exhibit higher accuracy, providing credible perceptual approaches for mobile manipulation. Moreover, the proposed framework can be easily extended to other mobile manipulation tasks for object search and retrieval.

29 September 2023 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
XMXiaochun Mai
Xiaochun Mai
MZMeilu Zhu
Meilu Zhu
YYYixuan Yuan
Yixuan Yuan
Fruit counting is a fundamental and challenging task of automatic fruit yield estimation in the field of intelligent agriculture. In recent years, to relieve the burden of data annotation, semi-supervised counting methods have been studied. Though significant progress has been achieved, the state-of-the-art method estimates the uncertainty of binary segmentation to guide the consistency training of density maps, being prone to deficient uncertainty estimation. Moreover, the method treats pixels with different difficulty equally in each training iteration, being troubled by inflexible consistency training which results in high supervision loss at the beginning of training and even causes network collapse. To alleviate the above limitations, in this paper, we propose a novel semi-supervised counting method CMCNet for fruit counting. CMCNet designs image colorization as an auxiliary task to estimate the uncertainty for density map consistency. Note that this work is the first effort to utilize image colorization for uncertainty estimation in semi-supervised counting. To obtain accurate uncertainty estimation for density map consistency, CMCNet estimates density uncertainty on density maps to depict the difficulty of fruit pixels from the semantic perspective, while using image colorization for constructing colorization uncertainty to measure the difficulty of part of fruit pixels and background pixels from the visual perspective. Then we obtain a comprehensive uncertainty by mixing density uncertainty and colorization uncertainty. Further, we propose a mix-uncertainty-adaptive consistency (MUAC) module for consistency training of density maps. With mix-uncertainty, uncertainty distribution is estimated. By adaptively adjusting the uncertainty threshold, harder pixels will be selected first and easier ones will be added into consistency training gradually. To evaluate the effectiveness of CMCNet, extensive experiments are conducted on two fruit datasets. Experimental results show that our CMCNet is superior to state-of-the-art semi-supervised counting methods. Note to Practitioners —This work is motivated by the emerging need for semi-supervised counting methods in fruit yield estimation. The difficulty of training semi-supervised counting methods with unlabeled images is exacerbated by the noisy supervision issue that pseudo-labels of unlabeled images are noisy. The proposed colorization-aware uncertainty estimation strategy and mix-uncertainty-adaptive consistency approach help the fruit planter sufficiently utilize the information of a large amount of unlabeled data and save the annotation cost in fruit quantity estimation. The proposed method is generic as it can be employed as a fruit yield estimation component of crop management support systems, while at the same time being applied to counting frameworks of other objects.