Jimin Xiao

Jimin Xiao

Auto-generated profile, based on publicly available information

Jimin Xiao

Department of Intelligent Science, Xian Jiaotong-Liverpool University, Suzhou, China

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 May 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
BZBingfeng Zhang
Bingfeng Zhang
JXJimin Xiao
Jimin Xiao
JJJianbo Jiao
Jianbo Jiao
YWYunchao Wei
Yunchao Wei
YZYao Zhao
Yao Zhao
Weakly supervised semantic segmentation is receiving great attention due to its low human annotation cost. In this paper, we aim to tackle bounding box supervised semantic segmentation, i.e., training accurate semantic segmentation models using bounding box annotations as supervision. To this end, we propose affinity attention graph neural network ( $A^2$A2GNN ). Following previous practices, we first generate pseudo semantic-aware seeds, which are then formed into semantic graphs based on our newly proposed affinity Convolutional Neural Network (CNN). Then the built graphs are input to our $A^2$A2GNN , in which an affinity attention layer is designed to acquire the short- and long- distance information from soft graph edges to accurately propagate semantic labels from the confident seeds to the unlabeled pixels. However, to guarantee the precision of the seeds, we only adopt a limited number of confident pixel seed labels for $A^2$A2GNN , which may lead to insufficient supervision for training. To alleviate this issue, we further introduce a new loss function and a consistency-checking mechanism to leverage the bounding box constraint, so that more reliable guidance can be included for the model optimization. Experiments show that our approach achieves new state-of-the-art performances on Pascal VOC 2012 datasets ( val : 76.5 percent, test : 75.2 percent). More importantly, our approach can be readily applied to bounding box supervised instance segmentation task or other weakly supervised semantic segmentation tasks, with state-of-the-art or comparable performance among almot all weakly supervised tasks on PASCAL VOC or COCO dataset. Our source code will be available at https://github.com/zbf1991/A2GNN .

11 February 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
MSMingjie Sun
Mingjie Sun
JXJimin Xiao
Jimin Xiao
Enggee LimEnggee Lim
Enggee Lim
SLSi Liu
Si Liu
JGJohn Y. Goulermas
John Y. Goulermas
In this paper, we are tackling the weakly-supervised referring expression grounding task, for the localization of a referent object in an image according to a query sentence, where the mapping between image regions and queries are not available during the training stage. In traditional methods, an object region that best matches the referring expression is picked out, and then the query sentence is reconstructed from the selected region, where the reconstruction difference serves as the loss for back-propagation. The existing methods, however, conduct both the matching and the reconstruction approximately as they ignore the fact that the matching correctness is unknown. To overcome this limitation, a discriminative triad is designed here as the basis to the solution, through which a query can be converted into one or multiple discriminative triads in a very scalable way. Based on the discriminative triad, we further propose the triad-level matching and reconstruction modules which are lightweight yet effective for the weakly-supervised training, making it three times lighter and faster than the previous state-of-the-art methods. One important merit of our work is its superior performance despite the simple and neat design. Specifically, the proposed method achieves a new state-of-the-art accuracy when evaluated on RefCOCO (39.21 percent), RefCOCO+ (39.18 percent) and RefCOCOg (43.24 percent) datasets, that is 4.17, 4.08 and 7.8 percent higher than the previous one, respectively. The code is available at https://github.com/insomnia94/DTWREG .

27 May 2022 in IEEE Transactions on Games
Verified
Journal Article
Closed access
JWJialin Wang
Jialin Wang
LHLiang Hai-Ning
Liang Hai-Ning
DMDiego VILELA MONTEIRO
Diego VILELA MONTEIRO
WXWenge Xu
Wenge Xu
JXJimin Xiao
Jimin Xiao
Virtual Reality (VR) technology has progressed rapidly and is used in various domains, particularly games. Simulator Sickness (SS) still represents a significant problem for its wider adoption. The most common way to detect SS is using the Simulator Sickness Questionnaire (SSQ). SSQ is a subjective measurement and is inadequate for real-time applications such as VR games. This research aims to develop a model to predict SS in real time using in-game characters’ movement and users’ eye motion data during gameplay in VR games. To achieve this, we designed an experiment to collect such data with three types of games. We trained a Long Short-Term Memory neural network with the eye-tracking and character movement data to predict SS. Our model can predict SS in real time with an accuracy of 83.4% for players who suffer from severe sensitivity to SS. Our results indicate that, in VR games, our model is an accurate and efficient method to predict SS in real time.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
XZXinqiao Zhao
Xinqiao Zhao
FTFeilong Tang
Feilong Tang
XWXiaoyang Wang
Xiaoyang Wang
JXJimin Xiao
Jimin Xiao
Image-level weakly supervised semantic segmentation has received increasing attention due to its low annotation cost. Existing methods mainly rely on Class Activation Mapping (CAM) to obtain pseudo-labels for training semantic segmentation models. In this work, we are the first to demonstrate that long-tailed distribution in training data can cause the CAM calculated through classifier weights over-activated for head classes and under-activated for tail classes due to the shared features among head- and tail- classes. This degrades pseudo-label quality and further influences final semantic segmentation performance. To address this issue, we propose a Shared Feature Calibration (SFC) method for CAM generation. Specifically, we leverage the class prototypes which carry positive shared features and propose a Multi-Scaled Distribution-Weighted (MSDW) consistency loss for narrowing the gap between the CAMs generated through classifier weights and class prototypes during training. The MSDW loss counterbalances over-activation and under-activation by calibrating the shared features in head-/tail-class classifier weights. Experimental results show that our SFC significantly improves CAM boundaries and achieves new state-of-the-art performances. The project is available at https://github.com/Barrett-python/SFC.

26 April 2023 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
BZBingfeng Zhang
Bingfeng Zhang
JXJimin Xiao
Jimin Xiao
YWYunchao Wei
Yunchao Wei
YZYao Zhao
Yao Zhao

1 September 2023 in Expert Systems with Applications
Verified
Journal Article
Open access
CZChangyu Zeng
Changyu Zeng
Wei WangWei Wang
Wei Wang
ANAnh Nguyen
Anh Nguyen
JXJimin Xiao
Jimin Xiao
YYYutao Max Yue
Yutao Max Yue