21 October 2021 in IEEE Transactions on Circuits and Systems for Video Technology
Light field (LF) images can be used to improve the performance of image super-resolution (SR) because both angular and spatial information is available. It is challenging to incorporate distinctive information from different views for LF image SR. Moreover, the long-term information from the previous layers can be weakened as the depth of network increases. In this paper, we propose a dense dual-attention network for LF image SR. Specifically, we design a view attention module to adaptively capture discriminative features across different views and a channel attention module to selectively focus on informative information across all channels. These two modules are fed to two branches and stacked separately in a chain structure for adaptive fusion of hierarchical features and distillation of valid information. Meanwhile, a dense connection is used to fully exploit multi-level information. Extensive experiments demonstrate that our dense dual-attention mechanism can capture informative information across views and channels to improve SR performance. Comparative results show the advantage of our method over state-of-the-art methods on public datasets.
10 July 2019 in IEEE Access
Producing depth maps of a scene is essential in many light field applications. Numerous algorithms have been developed to obtain an accurate depth map on public datasets. However, real-world light field images obtained by cameras have noises produced by hardware limitations. Existing methods do not perform well on noisy scenes. In this paper, we propose a noise-aware light field depth estimation algorithm which is insensitive to noise. First, an optical flow approach is used to compute disparities between the central view and each of the remaining views, then a weighted integration method is used to reduce calculation errors. Second, a refinement framework, which is measured using the refocus image and angular patch, is proposed to handle occlusion and texture-less parts. Third, a K-means clustering-based strategy is used to improve noise capability. Finally, a depth map is regularized by a Markov random field (MRF). Extensive experiments are conducted on synthetic datasets and real-world datasets. Both quantitative and qualitative results have demonstrated the superiority and robustness of our method.