Xinyu Wang

Xinyu Wang

Auto-generated profile, based on publicly available information

Xinyu Wang

The University of Adelaide, Adelaide, Australia

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 September 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YLYuliang Liu
Yuliang Liu
JZJiaxin Zhang
Jiaxin Zhang
DPDezhi Peng
Dezhi Peng
MHMingxin Huang
Mingxin Huang
XWXinyu Wang
Xinyu Wang
LJLianwen Jin
Lianwen Jin
End-to-end scene text spotting has made significant progress due to its intrinsic synergy between text detection and recognition. Previous methods commonly regard manual annotations such as horizontal rectangles, rotated rectangles, quadrangles, and polygons as a prerequisite, which are much more expensive than using single-point. Our new framework, SPTS v2, allows us to train high-performing text-spotting models using a single-point annotation. SPTS v2 reserves the advantage of the auto-regressive Transformer with an Instance Assignment Decoder (IAD) through sequentially predicting the center points of all text instances inside the same predicting sequence, while with a Parallel Recognition Decoder (PRD) for text recognition in parallel, which significantly reduces the requirement of the length of the sequence. These two decoders share the same parameters and are interactively connected with a simple but effective information transmission process to pass the gradient and information. Comprehensive experiments on various existing benchmark datasets demonstrate the SPTS v2 can outperform previous state-of-the-art single-point text spotters with fewer parameters while achieving 19× faster inference speed. Within the context of our SPTS v2 framework, our experiments suggest a potential preference for single-point representation in scene text spotting when compared to other representations. Such an attempt provides a significant opportunity for scene text spotting applications beyond the realms of existing paradigms.

6 September 2024 in Scientific Data
Verified
Journal Article
Open access
PDF file
PWPengjie Wang
Pengjie Wang
KZKaile Zhang
Kaile Zhang
XWXinyu Wang
Xinyu Wang
SHShengwei Han
Shengwei Han
YLYongge Liu
Yongge Liu
YLYuliang Liu
Yuliang Liu
Oracle bone script, one of the earliest known forms of ancient Chinese writing, presents invaluable research materials for scholars studying the humanities and geography of the Shang Dynasty, dating back 3,000 years. The immense historical and cultural significance of these writings cannot be overstated. However, the passage of time has obscured much of their meaning, presenting a significant challenge in deciphering these ancient texts. With the advent of Artificial Intelligence (AI), employing AI to assist in deciphering Oracle Bone Characters (OBCs) has become a feasible option. Yet, progress in this area has been hindered by a lack of high-quality datasets. To address this issue, this paper details the creation of the HUST-OBC dataset. This dataset encompasses 77,064 images of 1,588 individual deciphered characters and 62,989 images of 9,411 undeciphered characters, with a total of 140,053 images, compiled from diverse sources. The hope is that this dataset could inspire and assist future research in deciphering those unknown OBCs. All the codes and datasets are available at https://github.com/Pengjie-W/HUST-OBC.

22 March 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
ZLZhe Li
Zhe Li
XWXinyu Wang
Xinyu Wang
YLYuliang Liu
Yuliang Liu
LJLianwen Jin
Lianwen Jin
YHYichao Huang
Yichao Huang
KDKai Ding
Kai Ding
Handwritten mathematical expression recognition (HMER) is an essential task in the OCR community, which consists of two sub-tasks, i.e., symbol recognition and structure parsing. Modern literature treats HMER as a LaTeX sequence predicting problem that simultaneously recognizes symbols and parses the structures of MEs. Although deep learning-based HMER methods have been achieving promising results on public benchmarks, it is admitted that the misclassification error between visually similar symbols still prevents these approaches from more generalized scenes. In this paper, we try to solve this issue from three aspects. 1) We enhanced the feature extraction progress by introducing path signature features, which incorporates local writing details and global spatial information. 2) We developed a language model that uses contextual information to correct the symbols misclassified by vision-only-based recognition models. 3) We solved the misalignment problem in existing ensemble method by designing a dynamic time warping (DTW) based algorithm. By combining the above improvements, our method achieved state-of-the-art results on three CROHME benchmarks, outperforming previous methods by a large margin.

19 June 2019 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
HLHanxi Li
Hanxi Li
XWXinyu Wang
Xinyu Wang
FSFumin Shen
Fumin Shen
YLYi Li
Yi Li
FPFatih Porikli
Fatih Porikli
MWMingWen Wang
MingWen Wang
Visual tracking is one of the fundamental problems in computer vision. Recently, some deep-learning-based tracking algorithms have been illustrating record-breaking performances. However, due to the high complexity of neural networks, most deep trackers suffer from low tracking speed, and thus are impractical in many real-world applications. Some recentlyproposed deep trackers with smaller network structure achieve high efficiency while at the cost of significant decrease on precision. In this paper, we propose to transfer the deep feature which is learned originally for image classification to the visual tracking domain. The domain adaptation is achieved via some “grafted” auxiliary networks which are trained by regressing the object location in tracking frames. This adaptation improves the tracking performance significantly, both on accuracy and efficiency. The yielded deep tracker is real-time and also illustrates the state-ofthe-art accuracies in the experiment involving two well-adopted benchmarks with more than 100 test videos. Furthermore, the adaptation is also naturally used for introducing the objectness concept into visual tracking. This removes a long-standing target ambiguity in visual tracking tasks and we illustrate the empirical superiority of the more well-defined task.

26 June 2019 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
XWXinyu Wang
Xinyu Wang
CSChunhua Shen
Chunhua Shen
HLHanxi Li
Hanxi Li
SXShugong Xu
Shugong Xu
Abstract—Human detection is one of the long-standing computer vision tasks, and it has been a cornerstone for many real-world applications such as photo album organization, video surveillance, and autonomous driving. Benefiting from deep learning technologies such as convolutional neural networks, modern object detectors have been achieving much improved accuracy in generic object detection tasks. In this paper, we aim to improve deep learning based human detection. Our main idea is to exploit semantic context information for human detection by using deep-learnt semantic features provided by semantic segmentation masks. Segmentation masks play as an attention mechanism and enforce the detectors to focus on the image regions where potential object candidates are likely to appear. Meanwhile, the extra segmentation mask channel can also guide the convolutional kernels to automatically learn more discriminative features which make it easier to distinguish the background and foreground. We implement our methods with two popular detection frameworks, i.e., Faster R-CNN and SSD, and experimentally analyze the effectiveness of the proposed methods. Evaluation results on the widely used MS-COCO dataset and the very recent CrowdHuman dataset are provided. Our proposed methods outperform the baseline detectors and achieve better performance on highly occluded human detection.

8 September 2024
Verified
Book Chapter
Closed access
PDF file
PWPengjie Wang
Pengjie Wang
KZKaile Zhang
Kaile Zhang
XWXinyu Wang
Xinyu Wang
SHShengwei Han
Shengwei Han
YLYongge Liu
Yongge Liu
YLYuliang Liu
Yuliang Liu