Shenghao Liu

Mr. Shenghao Liu

Sun Yat-Sen University, Shenzhen, Guangdong, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 July 2024 in IEEE Sensors Journal
Verified
Journal Article
Closed access
SLShenghao Liu
Shenghao Liu
XLXiaoxiong Lan
Xiaoxiong Lan
WCWenyong Chen
Wenyong Chen
ZZZhiyong Zhang
Zhiyong Zhang
CQChangzhen Qiu
Changzhen Qiu
The goal of infrared and visible image fusion is to combine complementary information from the source images. However, owing to the absence of ground truth, most fusion algorithms just utilize information from source images, which cannot provide targeted guidance for network learning, leading to suboptimal outcomes. Moreover, numerous methods focus solely on modifying network architecture to improve fusion performance, without optimizing fusion algorithms from other perspectives. To tackle these problems, we propose a real-time end-to-end infrared and visible image fusion network based on adaptive guidance module (AGMFusion). On the one hand, by combining state-of-the-art methods and best fusion outcomes during the training process, the adaptive guidance module effectively facilitates collaborative guidance for network training. Additionally, based on the adaptive guidance module, we devise a loss function that includes content loss and guidance loss. We further balance these two loss components with the adaptive weight to boost the performance of our framework. On the other hand, AGMFusion is a lightweight image fusion framework that is able to generate highly perceptual fused images while maintaining excellent real-time performance, which can be potentially deployed as a pre-processing unit for various vision tasks. According to extensive comparative and generalization experiments, AGMFusion exceeds existing methods in visual appeal and quantitative metrics. Importantly, performance comparisons of numerous frameworks in running efficiency and object detection highlight the advantages of our approach. The source code will be released at https://github.com/liushh39/AGMFusion.

13 May 2024 in Information Fusion
Verified
Journal Article
Closed access
JYJing Ye
Jing Ye
SLShenghao Liu
Shenghao Liu
CQChangzhen Qiu
Changzhen Qiu
ZZZhiyong Zhang
Zhiyong Zhang

19 May 2025 in IEEE Sensors Journal
Verified
Journal Article
Closed access
XLXiaoxiong Lan
Xiaoxiong Lan
SLShenghao Liu
Shenghao Liu
SZSude Zhang
Sude Zhang
ZZZhiyong Zhang
Zhiyong Zhang
Multimodal object detection by combining multi-sensor data through visible-thermal image pairs has shown significant potential in complex environments. However, the information redundancy and modality conflicts between these modalities limit further performance improvements. Existing methods often fuse features through direct input into CNNs or Transformers, but these approaches fail to sufficiently address the challenges posed by the distinct imaging mechanisms of the modalities. To overcome these limitations, we introduce a novel Steam module, which incorporates two key innovations: the Sparse Attention Module (SAM) and the Explicit Attention Module (EAM). The SAM module extracts local information using CNNs and captures global information while eliminating redundancy through an improved sparse Transformer. The EAM module resolves modality conflicts through an explicit attention mechanism that makes sure to activate the target feature. Based on this module, we propose a new two-stream one-stage multimodal object detection framework named SteamDet. Meanwhile, to reduce the amount of computation, we downsample the feature maps before the fusion module and design an Efficient Upsampling Block (EUB) to recover. Extensive experiments demonstrate that our method achieves state-of-the-art performance across three public datasets, improving mAP by 6.1% on the multimodal-oriented DroneVehicle dataset and achieving optimal results across all categories. Furthermore, on the FLIR and LLVIP datasets, mAP increases by 2.3% and 2.9%, respectively, highlighting the strong generalization ability of our approach in addressing redundant information and modality conflicts. Our code will be released at https://github.com/lanxx314/steam.

12 August 2024 in TechRxiv
Verified
Preprint
Open access
SLShenghao Liu
Shenghao Liu
XLXiaoxiong Lan
Xiaoxiong Lan
WCWenyong Chen
Wenyong Chen
ZZZhiyong Zhang
Zhiyong Zhang
CQChangzhen Qiu
Changzhen Qiu
The goal of infrared and visible image fusion is to combine complementary information from the source images. However, owing to the absence of ground truth, most fusion algorithms just utilize information from source images, which cannot provide targeted guidance for network learning, leading to suboptimal outcomes. Moreover, numerous methods focus solely on modifying network architecture to improve fusion performance, without optimizing fusion algorithms from other perspectives. To tackle these problems, we propose a real-time end-to-end infrared and visible image fusion network based on adaptive guidance module (AGMFusion). On the one hand, by combining state-of-the-art methods and best fusion outcomes during the training process, the adaptive guidance module effectively facilitates collaborative guidance for network training. Additionally, based on the adaptive guidance module, we devise a loss function that includes content loss and guidance loss. We further balance these two loss components with the adaptive weight to boost the performance of our framework. On the other hand, AGMFusion is a lightweight image fusion framework that is able to generate highly perceptual fused images while maintaining excellent real-time performance, which can be potentially deployed as a pre-processing unit for various vision tasks. According to extensive comparative and generalization experiments, AGMFusion exceeds existing methods in visual appeal and quantitative metrics. Importantly, performance comparisons of numerous frameworks in running efficiency and object detection highlight the advantages of our approach. The source code will be released at https://github.com/liushh39/AGMFusion.

19 November 2022 in arXiv
Verified
Preprint
Open access
PDF file
LLLingyun Lu
Lingyun Lu
Bang WangBang Wang
Bang Wang
ZZZizhuo Zhang
Zizhuo Zhang
SLShenghao Liu
Shenghao Liu
XHXu Han
Xu Han
Incorporating knowledge graph as side information has become a new trend in recommendation systems. Recent studies regard items as entities of a knowledge graph and leverage graph neural networks to assist item encoding, yet by considering each relation type individually. However, relation types are often too many and sometimes one relation type involves too few entities. We argue that it is not efficient nor effective to use every relation type for item encoding. In this paper, we propose a VRKG4Rec model (Virtual Relational Knowledge Graphs for Recommendation), which explicitly distinguish the influence of different relations for item representation learning. We first construct virtual relational graphs (VRKGs) by an unsupervised learning scheme. We also design a local weighted smoothing (LWS) mechanism for encoding nodes, which iteratively updates a node embedding only depending on the embedding of its own and its neighbors, but involve no additional training parameters. We also employ the LWS mechanism on a user-item bipartite graph for user representation learning, which utilizes encodings of items with relational knowledge to help training representations of users. Experiment results on two public datasets validate that our VRKG4Rec model outperforms the state-of-the-art methods. The implementations are available at https://github.com/lulu0913/VRKG4Rec.