Jie Hong

Jie Hong

Auto-generated profile, based on publicly available information

Jie Hong

Faculty of Engineering, University of Hong Kong, Pokfulam Road, Hong Kong, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 September 2023 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
JHJie Hong
Jie Hong
PFPengfei Fang
Pengfei Fang
WLWeihao Li
Weihao Li
JHJunlin Han
Junlin Han
LPLars Petersson
Lars Petersson
Mehrtash HarandiMehrtash Harandi
Mehrtash Harandi
Learning a latent embedding to understand the underlying nature of data distribution is often formulated in Euclidean spaces with zero curvature. However, the success of the geometry constraints, posed in the embedding space, indicates that curved spaces might encode more structural information, leading to better discriminative power and hence richer representations. In this work, we investigate the benefits of the curved space for analyzing anomalous, open-set, or out-of-distribution (OOD) objects in data. This is achieved by considering embeddings via three geometry constraints, namely, spherical geometry (with positive curvature), hyperbolic geometry (with negative curvature), or mixed geometry (with both positive and negative curvatures). Three geometric constraints can be chosen interchangeably in a unified design, given the task at hand. Tailored for the embeddings in the curved space, we also formulate functions to compute the anomaly score. Two types of geometric modules (i.e., geometric-in-one (GiO) and geometric-in-two (GiT) models) are proposed to plug in the original Euclidean classifier, and anomaly scores are computed from the curved embeddings. We evaluate the resulting designs under a diverse set of visual recognition scenarios, including image detection (multiclass OOD detection and one-class anomaly detection) and segmentation (multiclass anomaly segmentation and one-class anomaly segmentation). The empirical results show the effectiveness of our proposal through consistent improvement over various scenarios. The code is made available at https://github.com/JHome1/GiO-GiT.

23 June 2023 in The Visual Computer
Verified
Journal Article
Open access
PDF file
JHJie Hong
Jie Hong
WLWeihao Li
Weihao Li
JHJunlin Han
Junlin Han
JZJiyang Zheng
Jiyang Zheng
Pengfei FangPengfei Fang
Pengfei Fang
LPLars Petersson
Lars Petersson
In this paper, we extend Open-set Semantic Segmentation (OSS) into a new image segmentation task called Generalized Open-set Semantic Segmentation (GOSS). Previously, with well-known OSS, the intelligent agents only detect unknown regions without further processing, limiting their perception capacity of the environment. It stands to reason that further analysis of the detected unknown pixels would be beneficial for agents’ decision-making. Therefore, we propose GOSS, which holistically unifies the abilities of two well-defined segmentation tasks, i.e. OSS and generic segmentation. Specifically, GOSS classifies pixels as belonging to known classes, and clusters (or groups) of pixels of unknown class are labelled as such. We propose a metric that balances the pixel classification and clustering aspects to evaluate this newly expanded task. Moreover, we build benchmark tests on existing datasets and propose neural architectures as baselines. Our experiments on multiple benchmarks demonstrate the effectiveness of our baselines. Code is made available at https://github.com/JHome1/GOSS_Segmentor.

1 May 2023 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
EGEnhui Gu
Enhui Gu
GXGang Xiao
Gang Xiao
FLFaming Lian
Faming Lian
TMTongyao Mu
Tongyao Mu
JHJie Hong
Jie Hong
JLJun Liu
Jun Liu
Jet fuel leaks not only waste resources and increase costs but also pose a risk of emergency landings and aviation accidents. With the blossom and implementation of deep learning, crack segmentation techniques have been rapidly developed in many fields. However, it is struggle to get accurate and complete crack segmentation results because of images’ complex background environment. To address this issue, we collected and labeled a dataset of 2824 crack images from the surface of aircraft fuel tank, named CAFT2800. And this article presents an atrous spatial pyramid fusion and hybrid attention network based on deep learning to deal with the complicated environment. The backbone of network uses a hierarchical structure Swin Transformer to extract features. In the neck of the network, an atrous spatial pyramid fusion module is proposed to further capture contextual information in multiple scale. Unlike the ASPP module, which aggregates image-level information with pooling, we abandon this operation according to the characteristics of crack. And the neck structure is designed for fusing high-level semantic information to all scales. At the gate between the neck and the decoder head, a SK (selective kernel) block is embedded into the network to recalibrates channel-wise feature responses. Due to the morphological characteristics of crack, we propose an evaluation index, Thinning F1 score (TFscore), which is more meaningful compared to the commonly used F1 score. Sufficient control experiments were conducted on the CAFT2800 dataset and two complicated environment benchmarks (DeepCrack and GAPs) to test the effectiveness of the network, and our method achieved superior performance. Source code and the CAFT2800 are available at https://github.com/Gu-EH/CAFT2800.

7 November 2017 in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
Verified
Journal Article
Closed access
PDF file
JHJie Hong
Jie Hong
Although electroencephalography (EEG) brain-computer interface (BCI) has been quite successful, multi-command control is still one of the key issues for external applications. Multimodal BCI represents the direction of dealing with this problem. In our study, five healthy subjects performed the experiment cooperatively. EEG and electromyography (EMG) were recorded synchronously. For individual EEG, after Laplacian filtering, the C3 and C4 channels were determined. Then, the EEG was decomposed into the third layer by wavelet packet transform (WPT), and the average, sub-band energy and mean square deviation were calculate at particular nodes. Finally, these features were fed into support vector machine (SVM) either singly or in combination, and the EEG classification accuracy was obtained. For individual EMG, the mean absolute value (MAV) and root mean square (RMS) were calculated. Then, probabilistic neural network (PNN) was employed, and the EMG classification accuracy was also obtained. Different mental and gesture tasks were combined to represent multi-class and these commands were ranked depending on their performance. The results showed that the subjects were able to obtain multi-class with satisfactory performance by multimodal BCI. The proposed interface could support multi-command control for external applications.

24 July 2023 in The Visual Computer
Verified
Journal Article
Open access
PDF file
JHJie Hong
Jie Hong
WLWeihao Li
Weihao Li
JHJunlin Han
Junlin Han
JZJiyang Zheng
Jiyang Zheng
PFPengfei Fang
Pengfei Fang
LPLars Petersson
Lars Petersson