Saiping Zhang

Saiping Zhang

Auto-generated profile, based on publicly available information

Saiping Zhang

State Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 January 2022 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SZSaiping Zhang
Saiping Zhang
DJDongyang Jin
Dongyang Jin
YDYuchao Dai
Yuchao Dai
FYFuzheng Yang
Fuzheng Yang
In this paper, we propose a relative pose estimation algorithm for micro-lens array (MLA)-based conventional light field (LF) cameras. First, by employing the matched LF-point pairs, we establish the LF-point-LF-point correspondence model to represent the correlation between LF features of the same 3D scene point in a pair of LFs. Then, we employ the proposed correspondence model to estimate the relative camera pose, which includes a linear solution and a non-linear optimization on manifold. Unlike prior related algorithms, which estimated relative poses based on the recovered depths of scene points, we adopt the estimated disparities to avoid the inaccuracy in recovering depths due to the ultra-small baseline between sub-aperture images of LF cameras. Experimental results on both simulated and real scene data have demonstrated the effectiveness of the proposed algorithm compared with classical as well as state-of-art relative pose estimation algorithms.

22 April 2020 in IEEE Access
Verified
Journal Article
Open access
DJDongyang Jin
Dongyang Jin
SZSaiping Zhang
Saiping Zhang
XHXiao Huo
Xiao Huo
FYFuzheng Yang
Fuzheng Yang
Micro-lens array (MLA) based light field cameras have been commercialized and had a wide range of applications in various fields in recent years. To promote these applications, especially for 3D reconstruction, it is crucial to calibrate light field cameras. Among the calibration steps, it is of great importance to detect corners in checkerboard images and establish the point-to-point correspondence between the checkerboard and its images. However, almost all existing algorithms detect corners in the sub-aperture images instead of raw images for conventional light field cameras. In this paper, a corner detection algorithm that can recognize corners in the raw images of conventional light field cameras was proposed. Firstly, template matching was used to detect the 3D lines in the image space of the main lens. Then, the locations of the corners were obtained by calculating the intersection of 3D line segments and reprojecting it to the raw image again. Experimental results have demonstrated that the algorithm can still achieve good performance in actual datasets with blurred and low resolution micro lens image.

16 August 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
XHXiao Huo
Xiao Huo
SZSaiping Zhang
Saiping Zhang
FYFuzheng Yang
Fuzheng Yang
Point clouds are widely used as representations of 3D objects and scenes in a number of applications, including virtual and mixed reality, autonomous driving, antiques reconstruction. To reduce the cost for transmitting and storing such data, this paper proposes an end-to-end learning-based point cloud attribute compression (PCAC) approach. The proposed network adopts a sparse convolution-based variational autoencoder (VAE) structure to compress the color attribute of point clouds. Considering the difficulty of stacked convolution operations in capturing long range dependencies, the attention mechanism is incorporated in which a non-local attention module is developed to capture the local and global correlations in both spatial and channel dimensions. Towards the practical application, an additional modulation network is offered to achieve the variable rate compression purpose in a single network, avoiding the memory cost of storing multiple networks for multiple bitrates. Our proposed method achieves state-of-the-art compression performance compared to other existing learning-based methods and further reduces the gap with the latest MPEG G-PCC reference software TMC13 version 14.

8 January 2020 in IEEE Access
Verified
Journal Article
Open access
SZSaiping Zhang
Saiping Zhang
FYFuzheng Yang
Fuzheng Yang
SWShuai Wan
Shuai Wan
PDPeiyun Di
Peiyun Di
Panoramic videos provide users with an amazing experience with immersive and interactive viewing, and are now gaining global popularity. Since panoramic videos are spherical in nature while effectively processed in planar projection formats in applications, it is crucial to implement sphere-to-plane projection, where a good interpolation algorithm is of great importance regarding generating high quality planar perspective videos. Moreover, different planar projection formats adapt to different applications according to their own characteristics. It is common to convert one projection format to another, where interpolation algorithms also make a difference on performance. In this paper, an interpolation algorithm named spherical Lanczos (SLAN) is proposed to achieve advanced performance in sphere-to-plane projection or planar projection format conversions of panoramic videos. In SLAN, we fully consider panoramic videos are naturally spherical. Reference pixels are selected carefully, and the weights are calculated correctly. Experimental results demonstrate that the SLAN interpolation algorithm is beneficial for the whole processing chain of panoramic videos both with lossless compression coding and with loss compression coding in terms of the increase in various end-to-end PSNR and the decrease in BD_rate. The cubic projection (CBP) and adjusted cubemap projection (ACP) are also evaluated to illustrate that the proposed algorithm is applicable for all kinds of planar projection format due to their inevitable deformation.

6 September 2024 in Neurocomputing
Verified
Journal Article
Open access
ZLZhaocheng Liu
Zhaocheng Liu
FYFei Yang
Fei Yang
DWDefa Wang
Defa Wang
MBMarc Górriz Blanch
Marc Górriz Blanch
LMLuka Murn
Luka Murn
LHLuis Herranz
Luis Herranz
Deep learning is being increasingly applied to image and video compression in a new paradigm known as neural video compression. While achieving impressive rate–distortion (RD) performance, neural video codecs (NVC) require heavy neural networks, which in turn have large memory and computational costs and often lack important functionalities such as variable rate. These are significant limitations to their practical application. Addressing these problems, recent slimmable image codecs can dynamically adjust their model capacity to elegantly reduce the memory and computation requirements, without harming RD performance. However, the extension to video is not straightforward due to the non-trivial interplay with complex motion estimation and compensation modules in most NVC architectures. In this paper we propose the slimmable video codec framework (SlimVC) that integrates an slimmable autoencoder and a motion-free conditional entropy model. We show that the slimming mechanism is also applicable to the more complex case of video architectures, providing SlimVC with simultaneous control of the computational cost, memory and rate, which are all important requirements in practice. We further provide detailed experimental analysis, and describe application scenarios that can benefit from slimmable video codecs.

27 October 2023 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
XHXiao Huo
Xiao Huo
DJDongyang Jin
Dongyang Jin
SZSaiping Zhang
Saiping Zhang
FYFuzheng Yang
Fuzheng Yang
Hand-held light field (LF) cameras have unique advantages in computer vision such as 3D scene reconstruction and depth estimation. However, the related applications are limited by the ultra-small baseline, leading to the extremely low depth resolution in reconstruction. To solve this problem, we propose to rectify LF to obtain a large baseline. Specifically, the proposed method aligns two LFs captured by two hand-held LF cameras with a random relative pose, and extracts the corresponding row-aligned sub-aperture images (SAIs) to obtain an LF with a large baseline. For an accurate rectification, a method for pose estimation is also proposed, where the relative rotation and translation between the two LF cameras are estimated. The proposed pose estimation minimizes the degree of freedom (DoF) in the LF-point-LF-point correspondence model and explicitly solves this model in a linear way. The proposed pose estimation outperforms the state-of-the-art algorithms by providing more accurate results to support rectification. The row-aligned SAIs and significantly improved depth resolution in 3D reconstruction demonstrate the effectiveness of the proposed LF rectification.