Tongzhen Si

Tongzhen Si

Auto-generated profile, based on publicly available information

Tongzhen Si

School of Information Science and Engineering, University of Jinan, Jinan, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 January 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
WTWei Tang
Wei Tang
FHFazhi He
Fazhi He
YLYu Liu
Yu Liu
YDYansong Duan
Yansong Duan
TSTongzhen Si
Tongzhen Si
The fusion of infrared and visible images aims to generate a composite image that can simultaneously contain the thermal radiation information of an infrared image and the plentiful texture details of a visible image to detect targets under various weather conditions with a high spatial resolution of scenes. Previous deep fusion models were generally based on convolutional operations, resulting in a limited ability to represent long-range context information. In this paper, we propose a novel end-to-end model for infrared and visible image fusion via a dual attention Transformer termed DATFuse. To accurately examine the significant areas of the source images, a dual attention residual module (DARM) is designed for important feature extraction. To further model long-range dependencies, a Transformer module (TRM) is devised for global complementary information preservation. Moreover, a loss function that consists of three terms, namely, pixel loss, gradient loss, and structural loss, is designed to train the proposed model in an unsupervised manner. This can avoid manually designing complicated activity-level measurement and fusion strategies in traditional image fusion methods. Extensive experiments on public datasets reveal that our DATFuse outperforms other representative state-of-the-art approaches in both qualitative and quantitative assessments. The proposed model is also extended to address other infrared and visible image fusion tasks without fine-tuning, and the promising results demonstrate that it has good generalization ability. The source code is available at https://github.com/tthinking/DATFuse.

11 May 2022 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
TSTongzhen Si
Tongzhen Si
FHFazhi He
Fazhi He
ZZZhong Zhang
Zhong Zhang
YDYansong Duan
Yansong Duan
Unsupervised person re-identification (Re-ID) aims to learn discriminative features without human-annotated labels. Recently, contrastive learning provides a new prospect for unsupervised person Re-ID, and existing methods mainly constrain the feature similarity among easy sample pairs. However, the feature similarity among hard sample pairs is neglected, which causes suboptimal performance in unsupervised person Re-ID. In the paper, we propose a novel Hybrid Contrastive Model (HCM) to perform the identity-level contrastive learning and the image-level contrastive learning for unsupervised person Re-ID, which adequately explores the feature similarity among hard sample pairs. Specifically, for the identity-level contrastive learning, an identity-based memory is constructed to store pedestrian features. Accordingly, we define the dynamic contrast loss to identify identity information with dynamic factor for distinguishing hard/easy samples. As for the image-level contrastive learning, an image-based memory is established to store each image feature. We design the sample constraint loss to explore the similarity relationship between hard positive and negative sample pairs. Furthermore, we optimize the two contrastive learning processes in one unified framework to make use of their own advantages as so to constrain the feature distribution for extracting potential information. Extensive experiments prove that the proposed HCM distinctly outperforms the state-of-the-art methods.

13 November 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
TSTongzhen Si
Tongzhen Si
FHFazhi He
Fazhi He
PLPenglei Li
Penglei Li
MYMang Ye
Mang Ye
Cross-modality visible-infrared person re-identification (VI-ReID) has attracted widespread concern due to its scalability in 24-h video surveillance of the Visual Internet of Things (VIoT). Driven by enough annotated training data, supervised VI-ReID has achieved superior performance. However, annotating a large amount of cross-modality data is extremely time-consuming, which limits its employment in real-world scenarios. Existing several works neglect the image-level discrepancy and could not obtain reliable feature-level heterogeneous correlation. In the paper, we propose a novel Homogeneous and Heterogeneous Optimization with Modality Style Adaptation (HHO) mechanism to eliminate intra-modality and inter-modality discrepancies without any label information for unsupervised VI-ReID. Specifically, we present the modality style adaptation strategy to transfer unlabeled cross-modality pedestrian styles, which not only increases the image diversity but also bridges the inter-modality gap. Meanwhile, we employ the clustering algorithm to generate pseudo labels for each modality. The homogeneous feature optimization is developed to extract intra-modality pedestrian features. Furthermore, we propose heterogeneous feature optimization to eliminate the inter-modality discrepancy. To this end, a heterogeneous feature search (HFS) module is designed to mine reliable cross-modality signals for each identity. These reliable heterogeneous features are constrained to generate the compact feature distribution, while different identities are forced to be separated. The homogeneous and heterogeneous optimization are seamlessly integrated to learn cross-modality robust features. Abundant experiments prove the superiority of HHO, which gains superior performance.

25 December 2023 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Closed access
LFLinkun Fan
Linkun Fan
FHFazhi He
Fazhi He
TSTongzhen Si
Tongzhen Si
RFRubin Fan
Rubin Fan
CYChuanlong Ye
Chuanlong Ye
BLBing Li
Bing Li
3D mesh classification deep neural network (3D DNN) has been widely applied in many safety-critical domains. Backdoor attack is a serious threat that occurs during the training stage. Previous backdoor attacks from 2D image and 3D point cloud domains are not suitable for 3D mesh due to data structure restrictions. Therefore, in a pioneering effort, this paper presents two types of backdoor attacks on 3D mesh. Specifically, the first attack is a Mesh Geometrical Feature guided 3D Mesh Backdoor Attack named MGF-MBA . Most 3D DNNs have to convert 3D mesh to a regular matrix (mesh geometrical feature), which is a refinement of the input 3D mesh. The 3D DNN directly learns the 3D shape from the mesh geometrical feature, which enables attackers to implant backdoor through it. Hence, the proposed MGF-MBA generates a backdoored 3D mesh under the guidance of mesh geometrical feature. The second attack is a Remeshing based 3D Mesh Backdoor Attack named ReMBA . The quality of samples backdoored by exiting backdoor attacks always decrease. Although many efforts have been made to reduce the descent in quality in return for stealthiness, the descent persists. For better stealthiness, we regard the backdoor implantation process as a way to increase the quality of backdoored sample rather than a way to reduce it. Specifically, ReMBA designs a new isotropic remeshing method that attempts to represent a 3D mesh by equilateral triangles while keeping the number of vertices, edges and faces unchanged. Numerous experimental results show that both MGF-MBA and ReMBA achieve guaranteed attack performance on 3D DNNs. Furthermore, transferability experiments demonstrate that ReMBA can even attack 3D point cloud networks with an increased ability to resist defenses.

29 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YSYupeng Song
Yupeng Song
FHFazhi He
Fazhi He
YDYansong Duan
Yansong Duan
TSTongzhen Si
Tongzhen Si
JBJunwei Bai
Junwei Bai
The 3-D point cloud is a common 3-D data representation that has received increasing attention for remote sensing applications. However, processing 3-D point cloud semantics, especially local semantic information, has always been a challenge and has attracted much attention. In this article, we propose a novel enhanced local semantic learning transformer for 3-D point cloud analysis, which aims to enhance the transformer awareness of local semantic features to handle complex point cloud tasks. First, we propose a novel transformer framework, the local semantic learning point cloud transformer (LSLPCT), which not only learns 3-D point clouds of global information, but also enhances the perception of local semantic information end-to-end. Second, we design an efficient local semantic learning self-attention mechanism, namely, LSL-SA, which can parallelize the perception of global contextual information and capture finer grained local semantic features. Third, our proposed LSL-SA is easy to implement and can integrate the existing transformers and convolutional neural network (CNN)-based networks for processing various point cloud tasks. Numerous experiments in different types of point cloud tasks have been conducted, and our method performs better or is competitive with other state-of-the-art methods.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
LFLinkun Fan
Linkun Fan
FHFazhi He
Fazhi He
TSTongzhen Si
Tongzhen Si
WTWei Tang
Wei Tang
BLBing Li
Bing Li
3D point cloud has been wildly used in security crucial domains, such as self-driving and 3D face recognition. Backdoor attack is a serious threat that usually destroy Deep Neural Networks (DNN) in the training stage. Though a few 3D backdoor attacks are designed to achieve guaranteed attack efficiency, their deformation will alarm human inspection. To obtain invisible backdoored point cloud, this paper proposes a novel 3D backdoor attack, named IBAPC, which generates backdoor trigger in the graph spectral domain. The effectiveness is grounded by the advantage of graph spectral signal that it can induce both global structure and local points to be responsible for the caused deformation in spatial domain. In detail, a new backdoor implanting function is proposed whose aim is to transform point cloud to graph spectral signal for conducting backdoor trigger. Then, we design a backdoor training procedure which updates the parameter of backdoor implanting function and victim 3D DNN alternately. Finally, the backdoored 3D DNN and its associated backdoor implanting function is obtained by finishing the backdoor training procedure. Experiment results suggest that IBAPC achieves SOTA attack stealthiness from three aspects including objective distance measurement, subjective human evaluation, graph spectral signal residual. At the same time, it obtains competitive attack efficiency. The code is available at https://github.com/f-lk/IBAPC.