Shishun Tian

Prof. Shishun Tian

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 December 2017 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
STShishun Tian
Shishun Tian
LZLu Zhang
Lu Zhang
LMLuce Morin
Luce Morin
ODOlivier Deforges
Olivier Deforges
Benefiting from Multi-view Video plus Depth (MVD) and Depth-Image-Based-Rendering (DIBR) technologies, only limited views of a real 3D scene need to be captured, compressed and transmitted. However, the quality assessment of synthesized views is very challenging since some new types of distortions, which are inherently different from the texture coding errors, are inevitably produced by view synthesis and depth map compression, and the corresponding original views (reference views) are usually not available. Thus the full-reference quality metrics cannot be used for synthesized views. In this paper, we propose a novel no-reference image quality assessment method for 3D synthesized views ( called NIQSV+). This blind metric can evaluate the quality of synthesized views by measuring the typical synthesis distortions: blurry regions, black holes and stretching, with access to neither the reference image nor the depth map. To evaluate the performance of the proposed method, we compare it with four full-reference 3D (synthesized view dedicated) metrics, five full-reference 2D metrics and three no-reference 2D metrics. In terms of their correlations with subjective scores, our experimental results show that the proposed no-reference metric approaches the best of the state-of-the-art full reference and no-reference 3D metrics; and outperforms the widely used no-reference and full-reference 2D metrics significantly. In terms of its approximation of human ranking, the proposed metric achieves the best performance in the experimental test.

12 October 2018 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
STShishun Tian
Shishun Tian
LZLu Zhang
Lu Zhang
LMLuce Morin
Luce Morin
ODOlivier Deforges
Olivier Deforges
Depth-image-based rendering (DIBR) is a fundamental technology in several 3-D-related applications, such as free viewpoint video, virtual reality, and augmented reality. However, new challenges have also been brought in assessing the quality of DIBR-synthesized views since this process induces some new types of distortions, which are inherently different from the distortion caused by video coding. In this paper, we present a new DIBR-synthesized image database with the associated subjective scores. We also test the performances of the state-of-the-art objective quality metrics on this database. This paper focuses on the distortions only induced by different DIBR synthesis methods. Seven state-of-the-art DIBR algorithms, including inter-view synthesis and single-view-based synthesis methods, are considered in this database. The quality of synthesized views was assessed subjectively by 41 observers and objectively using 14 state-of-the-art objective metrics. Subjective test results show that the interview synthesis methods, having more input information, significantly outperform the single-view-based ones. Correlation results between the tested objective metrics and the subjective scores on this database reveal that further studies are still needed for a better objective quality metric dedicated to the DIBR-synthesized views.

12 July 2021 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Verified
Journal Article
Open access
STShishun Tian
Shishun Tian
MZMinghuo Zheng
Minghuo Zheng
WZWenbin Zou
Wenbin Zou
XLXia Li
Xia Li
LZLu Zhang
Lu Zhang
Independent mobility poses a great challenge to the visually impaired individuals. This paper proposes a novel system to understand dynamic crosswalk scenes, which detects the key objects, such as crosswalk, vehicle, and pedestrian, and identifies pedestrian traffic light status. The indication of where and when to cross the road is provided to the visually impaired based on the crosswalk scene understanding. Our proposed system is implemented on a head-mounted mobile device (SensingAI G1) equipped with an Intel RealSense camera and a cellphone, and provides surrounding scene information to visually impaired individuals through audio signal. To validate the performance of the proposed system, we propose a crosswalk scene understanding dataset which contains three sub-datasets: a pedestrian traffic light dataset with 7447 images, a dataset of key objects on the crossroad with 1006 images and a crosswalk dataset with 3336 images. Extensive experiments demonstrated that the proposed system was robust and outperformed the state-of-the-art approaches. The experiment conducted with the visually impaired subjects shows that the system is practical useful.

22 June 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
YZYuhang Zhang
Yuhang Zhang
STShishun Tian
Shishun Tian
Muxin LiaoMuxin Liao
Muxin Liao
GHGuoguang Hua
Guoguang Hua
WZWenbin Zou
Wenbin Zou
CXChen Xu
Chen Xu
Semantic segmentation assigns a category for each pixel and has achieved great success in a supervised manner. However, it fails to generalize well in new domains due to the domain gap. Domain adaptation is a popular way to solve this issue, but it needs target data and cannot handle unavailable domains. In domain generalization (DG), the model is trained without the target data and DG aims to generalize well in new unavailable domains. Recent works reveal that shape recognition is beneficial for generalization but still lack exploration in semantic segmentation. Meanwhile, the object shapes also exist a discrepancy in different domains, which is often ignored by the existing works. Thus, we propose a Shape-Invariant Learning (SIL) framework to focus on learning shape-invariant representation for better generalization. Specifically, we first define the structural edge, which considers both the object boundary and the inner structure of the object to provide more discrimination cues. Then, a shape perception learning strategy including a texture feature discrepancy reduction loss and a structural feature discrepancy enlargement loss is proposed to enhance the shape perception ability of the model by embedding the structural edge as a shape prior. Finally, we use shape deformation augmentation to generate samples with the same content and different shapes. Essentially, our SIL framework performs implicit shape distribution alignment at the domain-level to learn shape-invariant representation. Extensive experiments show that our SIL framework achieves state-of-the-art performance.

10 November 2023 in Knowledge-Based Systems
Verified
Journal Article
Closed access
MLMuxin Liao
Muxin Liao
STShishun Tian
Shishun Tian
YZYuhang Zhang
Yuhang Zhang
GHGuoguang Hua
Guoguang Hua
WZWenbin Zou
Wenbin Zou
XLXia Li
Xia Li

2 February 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
GHGuoguang Hua
Guoguang Hua
Muxin LiaoMuxin Liao
Muxin Liao
STShishun Tian
Shishun Tian
YZYuhang Zhang
Yuhang Zhang
WZWenbin Zou
Wenbin Zou
Multi-task learning is a successful learning framework which improves the performance of prediction models by leveraging knowledge among related tasks. Referring expression comprehension (REC) and segmentation (RES) are highly relevant tasks, which both are language-guided visual recognition tasks. However, their relations have not yet been fully exploited in previous works. In this paper, a Multiple Relational Learning Network (MRLN) is proposed for multi-task learning of REC and RES. First, a feature-feature interaction learning module is introduced to handle the complicated interactions among features. Moreover, we propose a feature-task dependence learning module, which associates the related features with target tasks. Furthermore, a task-task relationship learning module is designed, which captures the relationships among tasks automatically and guides the REC and RES fine-tuning adaptively. To verify our proposed approach, experiments are conducted on three benchmark datasets, i.e., RefCOCO, RefCOCO+, and RefCOCOg. Extensive experiments demonstrate that the multiple relationships are more appealing since it alleviates the prediction inconsistency issue in multi-task setup. In addition, the experimental results report the significant performance gains of MRLN over most existing methods, i.e., up to 83.46 % for REC and 63.62 % for RES over state-of-the-art methods, which demonstrate the validity and superiority of MRLN.