Xin Lou

Prof. Xin Lou

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 March 2020 in IEEE Transactions on Circuits and Systems II: Express Briefs
Verified
Journal Article
Closed access
WZWei Zhou
Wei Zhou
SGShengyu Gao
Shengyu Gao
LZLing Zhang
Ling Zhang
XLXin Lou
Xin Lou
This paper studies the redundancy in the image processing pipeline for histogram of oriented gradients (HOG) feature extraction. The impact of demosaicing on the extracted HOG features is analyzed and experimented. It is shown that by taking advantage of the inter-channel correlation of natural images, the HOG features can be directly extracted from the Bayer pattern images with proper gamma compression. Due to the elimination of the image processing pipeline, the power consumption and computational complexity of the detection system can be significantly reduced. Experimental results show that the Bayer pattern image-based HOG features can be used in pedestrian detection systems with little performance degradation.

3 March 2021 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
JZJianping Zhu
Jianping Zhu
XLXin Lou
Xin Lou
WYWenbin Ye
Wenbin Ye
Radar-based human activity recognition (HAR) has great potential in many fields, such as surveillance, smart homes, and human-computer interaction. Complex deep neural networks have brought significant improvement in classification performance but also a surge of computational cost and the number of parameters, which makes it challenging to deploy in mobile devices. However, the existing studies in this area mainly focus on improving the classification accuracy. In this article, we propose an extremely efficient convolutional neural network (CNN) architecture named Mobile-RadarNet, which is specially designed for human activity classification based on micro-Doppler signatures. The new architecture exploits 1-D depthwise convolutions and pointwise convolutions to build lightweight CNN architecture. The experiments on a seven-class human activity data set demonstrate that the proposed Mobile-RadarNet can achieve high classification accuracy meanwhile to keep the computational complexity at an extremely low level, and thus has great potential to be deployed in the mobile devices.

29 July 2021 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
XZXiangyu Zhang
Xiangyu Zhang
LZLing Zhang
Ling Zhang
XLXin Lou
Xin Lou
This paper presents an end-to-end object-detection accelerator that processes raw Bayer images to generate detection results. The accelerator utilizes histogram of oriented gradients (HOG) features in combination with a support vector machine (SVM) classifier. The proposed HOG for raw images (HOGR) skips the image signal processors which consume a significant amount of power (about 2.5X of an accelerator). The proposed architecture temporally partitions the algorithms and time multiplexes the logic such that the accelerator works on the same frequency with the image sensor using affordable resources. The prototype is verified using 1080p ( $1920\times 1080$ ) and VGA ( $640\times 480$ ) raw videos on Altera Arria10 and Cyclone IV field programmable gate array (FPGA) platforms. The accelerator can process 1080p raw videos with a 12-scale pyramid at 60 frames per second (FPS) under the pixel frequency of corresponding image sensor (148.5 MHz), consuming 510 Kbit block memory. To the best knowledge of the authors, this is the first end-to-end HOG+SVM accelerator that takes raw Bayer images as input, skips the ISP pipeline for resource optimization from the system perspective, and is synchronized with the image sensor.

5 January 2021 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
GLGuoji Lai
Guoji Lai
XLXin Lou
Xin Lou
WYWenbin Ye
Wenbin Ye
With the development of the Internet of things, radar-based human activity recognition is becoming more and more important, because they play an indispensable role in fields such as safety and health monitoring. In this work, a novel network named 1-D dense attention neural network (1-D-DAN) is proposed for the radar-based human activity recognition. In the proposed network, a novel attention mechanism network structure specifically designed for radar spectrogram is proposed, equipping 1-D convolutional network with attention mechanism. With the $x$ -axis of the spectrogram represents time and the $y$ -axis represents frequency, the proposed attention mechanism includes two branches: 1) time attention branch and 2) frequency attention branch. Moreover, a dense attention operation that can make full use of features in the network is also introduced in the proposed attention mechanism. Experimental results show that compared with the state-of-the-art methods, our proposed 1-D-DAN achieves the highest accuracy in human activity recognition with the lowest computational complexity.

20 May 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
WZWei Zhou
Wei Zhou
LZLing Zhang
Ling Zhang
SGShengyu Gao
Shengyu Gao
XLXin Lou
Xin Lou
In this paper, the impact of demosaicing on gradient extraction is studied and a gradient-based feature extraction pipeline based on raw Bayer pattern images is proposed. It is shown both theoretically and experimentally that the Bayer pattern images are applicable to the central difference gradient-based feature extraction algorithms with negligible performance degradation, as long as the arrangement of color filter array (CFA) patterns matches the gradient operators. The color difference constancy assumption, which is widely used in various demosaicing algorithms, is applied in the proposed Bayer pattern image-based gradient extraction pipeline. Experimental results show that the gradients extracted from Bayer pattern images are robust enough to be used in histogram of oriented gradients (HOG)-based pedestrian detection algorithms and shift-invariant feature transform (SIFT)-based matching algorithms. By skipping most of the steps in the image signal processing (ISP) pipeline, the computational complexity and power consumption of a computer vision system can be reduced significantly.

27 June 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
JDJunran Ding
Junran Ding
YHYunxiang He
Yunxiang He
BYBinzhe Yuan
Binzhe Yuan
ZYZhechen Yuan
Zhechen Yuan
PZPingqiang Zhou
Pingqiang Zhou
XLXin Lou
Xin Lou
Neural Volume Rendering (NVR) has advanced explosively since the advent of Neural Radiance Field (NeRF), a technique for novel view synthesis of complex scenes based on a finite set of input views. Existing ray casting-based NVR approaches process rays concurrently to leverage parallelism but fails to consider its impact on cache locality, which ultimately undermines the efficiency of corresponding dedicated hardware accelerator designs. We further observed that there exhibits spatial correspondence between features and voxels in NVR that can be exploited by processing in the order of voxel, not ray. This paper introduces a novel approach to meticulously reorder the execution of rays, ensuring that rays with similar memory access patterns are processed in parallel, thereby enhancing cache locality. On the basis of that, we also propose an efficient backend architecture and a corresponding memory subsystem, facilitating accurate data prefetching to hide off-chip memory latency. To validate the proposed architecture, we implement our design in VerilogHDL and evaluate the performance by post-synthesis simulation with real scene data. The evaluation results demonstrate that our design markedly enhances the efficiency of NVR processing, achieving a considerable speedup (1.62×) compared to the state-of-the-art NVR accelerator, while necessitating significantly less silicon area (5.12×) and power (32.79×).