Xinxin Zhang

Xinxin Zhang

Auto-generated profile, based on publicly available information

Xinxin Zhang

School of Software, Shandong University, Jinan, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 February 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
HFHao Fang
Hao Fang
TZTong Zhang
Tong Zhang
XZXiaofei Zhou
Xiaofei Zhou
XZXinxin Zhang
Xinxin Zhang
Recently, Transformer-based offline video instance segmentation (VIS) solutions have made significant progress by decomposing the whole task into global segmentation map generation and instance discrimination. We argue that the quality of video queries that represent all instances in a video clip is crucial for offline VIS methods. Existing methods typically interact video queries with dense spatio-temporal features, resulting in significant computational complexity and redundant information. Thus, we propose a novel video instance segmentation framework, LBVQ, dedicated to learning better video queries. Specifically, we first obtain the frame queries for each frame independently without any complex inter-frame spatial-temporal association operations. Secondly, we propose an adaptive query initialization module (AQI), which adaptively integrates frame queries to initialize video queries instead of traditional random initialization strategies. This initialization method preserves rich instance clues and accelerates the optimization of the whole model. Finally, to enhance the quality of video queries, we propose a query propagation module (QPM) that captures relevant instance information in frame queries frame by frame, greatly improving the model’s understanding of long videos. By learning higher quality video queries, LBVQ achieves the state-of-the-art on VIS benchmarks with a ResNet-50 backbone: 52.2 AP, 44.8 AP on YouTube-VIS 2019 & 2021. Moreover, LBVQ achieves 39.7 AP on YouTube-VIS 2022 and 22.2 AP on OVIS, demonstrating superior potential for long videos. To further improve the quality of segmentation masks, a large-scale pretrained SAM is employed to refine the segmentation results. Code is available at https://github.com/fanghaook/LBVQ.

20 May 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
DCDa Chen
Da Chen
JZJian Zhu
Jian Zhu
XZXinxin Zhang
Xinxin Zhang
SMShu Minglei
Shu Minglei
LCLaurent D. Cohen
Laurent D. Cohen
Minimal paths are regarded as a powerful and efficient tool for boundary detection and image segmentation due to its global optimality and the well-established numerical solutions such as fast marching method. In this paper, we introduce a flexible interactive image segmentation model based on the Eikonal partial differential equation (PDE) framework in conjunction with region-based homogeneity enhancement. A key ingredient in the introduced model is the construction of local geodesic metrics, which are capable of integrating anisotropic and asymmetric edge features, implicit region-based homogeneity features and/or curvature regularization. The incorporation of the region-based homogeneity features into the metrics considered relies on an implicit representation of these features, which is one of the contributions of this work. Moreover, we also introduce a way to build simple closed contours as the concatenation of two disjoint open curves. Experimental results prove that the proposed model indeed outperforms state-of-the-art minimal paths-based image segmentation approaches.

21 October 2023
Verified
Conference Paper
Open access
XZXu Zhang
Xu Zhang
YGYongshun Gong
Yongshun Gong
XZXinxin Zhang
Xinxin Zhang
XWXiaoming Wu
Xiaoming Wu
CZChengqi Zhang
Chengqi Zhang
XDXiangjun Dong
Xiangjun Dong
As a critical mission of intelligent transportation systems, urban flow prediction (UFP) benefits in many city services including trip planning, congestion control, and public safety. Despite the achievements of previous studies, limited efforts have been observed on simultaneous investigation of the heterogeneity in both space and time aspects. That is, regional correlations would be variable at different timestamps. In this paper, we propose a spatio-temporal learning framework with mask and contrast enhancements to capture spatio-temporal variabilities among city regions. We devise a mask-enhanced pre-training task to learn latent correlations across the spatial and temporal dimensions, and then a graph-based method is developed to extract the significance of regions by using the inter-regional attention weights. To further acquire contrastive correlations of regions, we elaborate a pre-trained contrastive learning task with the global-local cross-attention mechanism. Thereafter, two well-trained encoders have strong capability to capture latent spatio-temporal representations for the flow forecasting with time-varying. Extensive experiments conducted on real-world urban flow datasets demonstrate that our method compares favorably with other state-of-the-art models.

2 December 2024
Verified
Book Chapter
Closed access
PDF file
HFHao Fang
Hao Fang
PWPeng Wu
Peng Wu
YLYawei Li
Yawei Li
XZXinxin Zhang
Xinxin Zhang
Xiankai LuXiankai Lu
Xiankai Lu

7 April 2020 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
XZXinxin Zhang
Xinxin Zhang
CGChristopher Gilliam
Christopher Gilliam
TBThierry Blu
Thierry Blu
Image registration is a required step in many practical applications that involve the acquisition of multiple related images. In this paper, we propose a methodology to deal with both the geometric and intensity transformations in the image registration problem. The main idea is to modify an accurate and fast elastic registration algorithm (Local All-Pass—LAP) so that it returns a parametric displacement field, and to estimate the intensity changes by fitting another parametric expression. Although we demonstrate the methodology using a low-order parametric model, our approach is highly flexible and easily allows substantially richer parametrisations, while requiring only limited extra computation cost. In addition, we propose two novel quantitative criteria to evaluate the accuracy of the alignment of two images (“salience correlation”) and the number of degrees of freedom (“parsimony”) of a displacement field, respectively. Experimental results on both synthetic and real images demonstrate the high accuracy and computational efficiency of our methodology. Furthermore, we demonstrate that the resulting displacement fields are more parsimonious than the ones obtained in other state-of-the-art image registration approaches.

22 November 2024 in Expert Systems with Applications
Verified
Journal Article
Closed access
PYPiao Yu
Piao Yu
XZXu Zhang
Xu Zhang
YGYongshun Gong
Yongshun Gong
JZJian Zhang
Jian Zhang
HSHaoliang Sun
Haoliang Sun
YYYilong Yin
Yilong Yin