Siyu Ren

Siyu Ren

Auto-generated profile, based on publicly available information

Siyu Ren

School of Precision Instrument & Opto-electronics Engineering, Tianjin University, Key Laboratory of Opto-electronics Information Technology (Tianjin University), Ministry of Education, Tianjin 300072, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 April 2020 in IEEE Access
Verified
Journal Article
Open access
HXHuaiyuan Xu
Huaiyuan Xu
XCXiaodong Chen
Xiaodong Chen
HLHaitao Liang
Haitao Liang
SRSiyu Ren
Siyu Ren
YWYi Wang
Yi Wang
HCHuaiyu Cai
Huaiyu Cai
We present a novel algorithm called crosspatch-based rolling label expansion for accurate stereo matching. This optimization-based approach can effectively estimate the 3D label of each pixel from huge and infinite label space and then generate a continuous disparity map. The algorithm has two obvious characteristics when compared with the traditional label expansion algorithms. The first feature is the cross-based multilayer structure, where each layer contains a series of cross patches with adaptive shapes, reflecting the edge structure of objects on the image. Besides, such cross patches are non-overlapping and independent, satisfying the submodular property for employing graph cuts. The second feature is the rolling optimization, that firstly generates new label proposal by expanding candidate labels within cross patches, then globally updates labels for the whole image using a proposed rolling move. The experimental results show the high matching accuracy of our method, both in pixel level and subpixel level. According to the latest ranking list of Middlebury 3.0 benchmark, our method is one of the best stereo matching algorithms.

5 November 2020 in IEEE Access
Verified
Journal Article
Open access
HLHaitao Liang
Haitao Liang
XCXiaodong Chen
Xiaodong Chen
HXHuaiyuan Xu
Huaiyuan Xu
SRSiyu Ren
Siyu Ren
HCHuaiyu Cai
Huaiyu Cai
YWYi Wang
Yi Wang
View synthesis is an effective method to generate the contents of multiple views based on a limited number of reference views, which can be used in 2D to 3D conversion, free viewpoint video and multiview video rendering. Depth-image-based rendering (DIBR) is a practical technique to generate virtual view by using a 2D reference view and its depth image. However, a critical problem in DIBR process is that disocclusions might be produced in the synthesized image because the background occluded by the foreground objects in the reference view may be exposed in the virtual view. In this paper, a local foreground removal method is proposed for disocclusion filling. Morphology-based depth image preprocessing is performed before DIBR, aiming to correct the depth value of the ghosts and remove ghost artifacts. In the synthesized virtual image, pixels on the disocclusion edge are identified and classified. Then they are positioned in the reference image by inverse 3D warping. Local foreground regions that occlude the corresponding background are removed from both the reference image and its depth image based on the disocclusion edge pixels. Removed region is filled with surrounding background contents, and depth information is used in this process to prevent foreground penetration. The predicted background contents are warped to the disocclusion region, thereby achieving the hole filling. Experimental results show that the proposed method performs better than the other methods in disocclusion filling, and improves the subjective and objective quality of the synthesized view. In the evaluation results of PSNR, SSIM, FSIMc and VSI, our method improves by 0.32-2.43dB, 0.0036-0.0155, 0.0041-0.0198 and 0.0012-0.0057 respectively compared with competitive methods.