Shizhuo Deng

Shizhuo Deng

Auto-generated profile, based on publicly available information

Shizhuo Deng

Northeastern University

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 July 2023 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
SDShizhuo Deng
Shizhuo Deng
JCJiaqi Chen
Jiaqi Chen
DTDa Teng
Da Teng
CYChuangui Yang
Chuangui Yang
DCDongyue Chen
Dongyue Chen
HWHao Wang
Hao Wang
Sensor-based Human Activity Recognition (HAR) is widely used in daily life and is the basic-level bridge to virtual healthcare in the metaverse. The current challenge is the low recognition accuracy for personalized users on smart wearable devices. The limited resource cannot support large deep learning models updated locally. Besides, integrating and transmitting sensor data to the cloud would reduce the efficiency. Considering the tradeoff between performance and complexity, we propose a Lightweight Human Activity Recognition (LHAR) framework. In LHAR, we combine the cross-people HAR task with the lightweight model task. LHAR framework is designed on the teacher-student architecture and the student network consists of multiple depthwise separable convolution layers to achieve fewer parameters. The dark knowledge distilled from the complex teacher model enhances the generalization ability of LHAR. To achieve effective knowledge distillation, we propose two optimization methods. Firstly, we train the teacher model by ensemble learning to promote teacher performance. Secondly, a multi-channel data augmentation method is proposed for the diversity of the dataset, which is a plug-in operation for the ensemble teacher model. In the experiments, we compare LHAR with state-of-art models in comparison evaluation, ablation study and the hyperparameter analysis, which proves the better performance of LHAR in efficiency and effectiveness.

3 December 2024
Verified
Conference Paper
Open access
JCJiaqi Chen
Jiaqi Chen
YYYan Yang
Yan Yang
SDShizhuo Deng
Shizhuo Deng
DTDa Teng
Da Teng
LPLiyuan Pan
Liyuan Pan

24 October 2017 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
SDShizhuo Deng
Shizhuo Deng
BWBotao Wang
Botao Wang
SHShan Huang
Shan Huang
CYChuncheng Yue
Chuncheng Yue
JZJianpeng Zhou
Jianpeng Zhou
GWGuoren Wang
Guoren Wang
In this era of big data, stream data classification which is one of typical data stream applications has become more and more significant and challengeable. In these applications, it is obvious that data classification is much more frequent than model training. The ratio of stream data to be classified is rapid and time-varying, so it is an important problem to classify the stream data efficiently with high throughput. In this paper, we first analyze and categorize the current data stream machine learning algorithms according to their data structures. Then, we propose stream data classification topology (SDC-Topology) on Storm. For the classification algorithms based on the matrix, we propose self-adaptive stream data classification framework (SASDC-Framework) for efficient stream data classification on Storm. In SASDC-Framework, all the data sets arriving at the same unit time are partitioned into subsets with the nearly best partition size and processed in parallel. To select the nearly best partition size for the stream data sets efficiently, we adopt bisection method strategy and inverse distance weighted strategy. Extreme learning machine, which is a fast and accurate machine learning method based on matrix calculating, is used to test the efficiency of our proposals. According to evaluation results, the throughputs based on SASDC-Framework are 8-35 times higher than those based on SDC-Topology and the best throughput is more than 40,000 prediction requests per second in our environment.

10 May 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
FXFangbin Xu
Fangbin Xu
DCDongyue Chen
Dongyue Chen
TJTong Jia
Tong Jia
SDShizhuo Deng
Shizhuo Deng
HWHao Wang
Hao Wang
Machine learning models often suffer from severe performance degradation due to distributional shifts between testing and training data. To address this issue, researchers have focused on domain generalization (DG), which aims to generalize a model trained on source domains to arbitrary unseen target domains. Recently, ensemble learning has emerged as a popular strategy for addressing the DG problem, and domain-specific experts are typically involved. However, the existing methods do not sufficiently consider the generalizability of individual experts or leverage the consistency and diversity among them, thus limiting the generalizability of the constructed models. In this paper, we propose a consistent-but-diverse mixture of experts (CBDMoE) algorithm, which is an improved MoE framework that effectively harnesses ensemble learning for solving the DG problem. Specifically, we introduce individual expert learning (IEL), which incorporates a novel domain-class-balanced subset division (DCBSD)-based sampling strategy to facilitate a generalizable expert learning process. Additionally, we present consistent-but-diverse learning (CBDL), which employs two regularizing losses to encourage consistency and diversity in the predictions of the experts. Our proposed strategy significantly enhances the generalizability of the MoE framework. Extensive experiments conducted on three popular DG benchmark datasets demonstrate that our method outperforms the state-of-the-art approaches.

24 June 2024 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
HWHao Wang
Hao Wang
TJTong Jia
Tong Jia
BMBowen Ma
Bowen Ma
DCDongyue Chen
Dongyue Chen
SDShizhuo Deng
Shizhuo Deng
Prohibited item detection in X-Ray baggage images can efficiently prevent the social security and stability. With the development of deep learning, applying specific methods in computer vision tasks to prohibited item detection has shown promising perspectives, and the resulted intelligent security inspection system can effectively address the limitations of human inspection. Despite several deep learning based methods have been proposed to flourish this researching field, there are still two issues which have not been fully explored. First, most of them suffer from the shortage of dataset and collection of massive and well-annotated samples is extremely laborious and costly. Second, the designation of backbone modules for current prohibited item detection methods shares similar idea with the ones in object detection. While little consideration has been paid to the properties of prohibited item, where most of them are over-lapped and cluttered. To overcome limitations, this paper proposes a cluttered prohibited item detection method for security inspection system. Specifically, our method first generates synthetic X-Ray images through cut-and-paste strategy from the training samples in each training mini-batch, where the strategy effectively and efficiently augments the dataset and quality of the synthetic samples can be guaranteed. Then, a high-order dilated convolution module is developed for enriching the representation ability of the feature, further promoting the localization ability for over-lapped and cluttered prohibited items. Experiments show that our proposed method can be well generalized to various datasets, and achieve clear improvement over state-of-the-art methods.

23 July 2024 in Neurocomputing
Verified
Journal Article
Closed access
JCJiaqi Chen
Jiaqi Chen
SDShizhuo Deng
Shizhuo Deng
DTDa Teng
Da Teng
DCDongyue Chen
Dongyue Chen
TJTong Jia
Tong Jia
HWHao Wang
Hao Wang