Shuo Zhang

Shuo Zhang

Auto-generated profile, based on publicly available information

Shuo Zhang

Beijing Jiaotong University

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 June 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SZShuo Zhang
Shuo Zhang
SCSong Chang
Song Chang
YLYoufang Lin
Youfang Lin
Light Field (LF) cameras are considered to have many potential applications since angular and spatial information is captured simultaneously. However, the limited spatial resolution has brought lots of difficulties in developing related applications and becomes the main bottleneck of LF cameras. In this paper, an end-to-end learning-based method is proposed to simultaneously reconstruct all view images in LFs with higher spatial resolution. Based on the epipolar geometry, view images in one LF are first grouped into several image stacks and fed into different network branches to learn sub-pixel details for each view image. Since LFs have dense sampling in angular domain, sub-pixel details in multiple spatial directions are learned from corresponding angular directions in multiple branches, respectively. Then, sub-pixel details from different directions are further integrated to generate global high-frequency residual details. Combined with the spatially upsampled LF, the final LF with high spatial resolution is obtained. Experimental results on synthetic and real-world datasets demonstrate that the proposed method outperforms other state-of-the-art methods in both visual and numerical evaluations. We also implement the proposed method on LFs with different angular resolution and experiments show that the proposed method achieves superior results than others, especially for LFs with small angular resolution. Furthermore, since the epipolar geometry is fully considered, the proposed network shows good performances in preserving the inherent epipolar property in LF images.

1 February 2023 in IEEE Transactions on Computational Imaging
Verified
Journal Article
Closed access
XWXianglang Wang
Xianglang Wang
YLYoufang Lin
Youfang Lin
SZShuo Zhang
Shuo Zhang
Light Fields (LFs) are easily degraded by noise and low light. Low light LF enhancement and denoising are more challenging than single image tasks because the epipolar information among views should be taken into consideration. In this work, we propose a multiple stream progressive restoration network to restore the whole LF in just one forward pass. To make full use of the multiple views supplementary information and preserve the epipolar information, we design three types of input composed of view stacking. Each type of input corresponds to an restoration stream and provides specific complementary information. In addition, the weights are shared for each type of input in order to better maintain the epipolar information among views. To fully utilize the supplementary information, we then design a multi-stream interaction module to aggregate features from different restoration streams. Finally, the multiple stages restoration is introduced to reconstruct the LF progressively. We carry out extensive experiments to demonstrate that our model outperforms the state-of-the-art techniques on real world low light LF dataset and synthetic noisy LF dataset.

25 August 2017 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
HSHao Sheng
Hao Sheng
SZShuo Zhang
Shuo Zhang
XCXiaochun Cao
Xiaochun Cao
YFYajun Fang
Yajun Fang
ZXZhang Xiong
Zhang Xiong
Unlike traditional multi-view images, sampling in angular domain of light field images is distributed in different directions. Therefore, an angular sampling image (ASI), comprising of possible matching points extracted from each view, is available for each point. In this paper, we analyze the geometric relationship between ASIs and reference sub-aperture images, and then prove the occlusion boundary similarity. Based on the geometric relationship in extreme cases, we show that some points in ASI have higher reliability than other points for depth calculation. An integral guided filter is then built based on the sub-aperture image to predict occlusion probabilities in ASIs. The filter is independent of ASIs and has no requirement for high angular resolution so that it is easy to apply to the cost volume calculation. We integrate the filter into our depth estimation framework and other state-of-the-art depth estimation frameworks. Experimental results demonstrate that the proposed filter is more effective to occluded point detection in ASIs than other methods. Results from different data sets show that our method outperforms the existing state-of-the-art depth estimation methods, especially along occlusion boundaries.

26 July 2021 in IEEE Transactions on Computational Imaging
Verified
Journal Article
Closed access
SZShuo Zhang
Shuo Zhang
SCSong Chang
Song Chang
ZSZeqi Shen
Zeqi Shen
YLYoufang Lin
Youfang Lin
Due to hardware restriction, it is costly to capture densely-sampled Light Fields (LFs) with high angular and spatial resolution, which becomes the main bottleneck of LFs development. In this paper, we propose a learning-based framework to synthesize novel views and reconstruct densely-sampled LFs from sparsely-sampled LFs. In the proposed framework, micro-lens image stacks and view image stacks are separately grouped, in which details in novel views are explored from spatial and angular domain. The two kinds of stacks contain epipolar information and 3D convolution layers are employed to effectively extract features that include structure information. Moreover, an innovative way is proposed to synthesize views by upsampling micro-lens image stacks using deconvolution layers. The parameters in decovolution layers provide the view position information and different interpolation and extrapolation tasks can be explicitly modeled. It is validated that this view synthesis module can be embedded in different frameworks and improve the related performances. Without precise depth estimation and view warping, the proposed method is mainly designed for reconstructing LFs with small baselines. Related experimental results show that the proposed model outperforms other state-of-the-art methods in terms of both visual and numerical evaluations. Furthermore, the consistency between synthesized views and the intrinsic structure information is well preserved in the proposed method.

26 April 2022 in IEEE Transactions on Computational Imaging
Verified
Journal Article
Closed access
YCYangling Chen
Yangling Chen
SZShuo Zhang
Shuo Zhang
SCSong Chang
Song Chang
YLYoufang Lin
Youfang Lin
Limited by sensor resolution, Light Field (LF) images often suffer from an inherent trade-off between angular resolution and spatial resolution. LF reconstruction, including Spatial Super-Resolution (LFSSR) and Angular Super-Resolution (LFASR), upsamples LF in spatial and angular domain based on the complementary information in different views. In this paper, we propose efficient pseudo-4D end-to-end frameworks for LFSSR and LFASR, respectively. Since the epipolar information and spatial-angular information reflect the relationship between views, we propose to fully consider both of them to exploit complementary information thoroughly. Specifically, we first extract epipolar information from horizontally and vertically stacked views separately. Then an Epipolar-Aware Grid (EAG) network composed of Dual Interactive Blocks (DIBs) fully interacts the epipolar information, characterizing the grid-like LF parallax structure. In order to effectively achieve dense interaction between the spatial and angular domain to extract complementary information, several Parallel Spatial-Angular Integration Blocks (PSAIBs) are further introduced. For LFs with large baselines, we also propose a generic shear attention network, which generalizes the model designed for small baselines to large baselines without depth estimation. As compared to the state-of-the-art methods, extensive experiments conducted on both synthetic and real-world datasets demonstrate our superiority in LFSSR tasks and LFASR tasks.

14 January 2023 in Multimedia Tools and Applications
Verified
Journal Article
Closed access
PDF file
SZShuo Zhang
Shuo Zhang
SCShengbing Che
Shengbing Che
ZLZhen Liu
Zhen Liu
XZXu Zhang
Xu Zhang