Shixiong Zhang

Mr. Shixiong Zhang

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 August 2022 in Sensors
Verified
Journal Article
Open access
PDF file
SZShixiong Zhang
Shixiong Zhang
WWWenmin Wang
Wenmin Wang
HLHonglei Li
Honglei Li
SZShenyong Zhang
Shenyong Zhang
An event camera is a novel bio-inspired sensor that effectively compensates for the shortcomings of current frame cameras, which include high latency, low dynamic range, motion blur, etc. Rather than capturing images at a fixed frame rate, an event camera produces an asynchronous signal by measuring the brightness change of each pixel. Consequently, an appropriate algorithm framework that can handle the unique data types of event-based vision is required. In this paper, we propose a dynamic object tracking framework using an event camera to achieve long-term stable tracking of event objects. One of the key novel features of our approach is to adopt an adaptive strategy that adjusts the spatiotemporal domain of event data. To achieve this, we reconstruct event images from high-speed asynchronous streaming data via online learning. Additionally, we apply the Siamese network to extract features from event data. In contrast to earlier models that only extract hand-crafted features, our method provides powerful feature description and a more flexible reconstruction strategy for event data. We assess our algorithm in three challenging scenarios: 6-DoF (six degrees of freedom), translation, and rotation. Unlike fixed cameras in traditional object tracking tasks, all three tracking scenarios involve the simultaneous violent rotation and shaking of both the camera and objects. Results from extensive experiments suggest that our proposed approach achieves superior accuracy and robustness compared to other state-of-the-art methods. Without reducing time efficiency, our novel method exhibits a 30% increase in accuracy over other recent models. Furthermore, results indicate that event cameras are capable of robust object tracking, which is a task that conventional cameras cannot adequately perform, especially for super-fast motion tracking and challenging lighting situations.

27 September 2023 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
SZShixiong Zhang
Shixiong Zhang
WWWenmin Wang
Wenmin Wang
HLHonglei Li
Honglei Li
SZShenyong Zhang
Shenyong Zhang
In intelligent transportation systems, various sensors, including radar and conventional frame cameras, are used to improve system robustness in various challenging scenarios. An event camera is a novel bio-inspired sensor that has attracted the interest of several researchers. It provides a form of neuromorphic vision to capture motion information asynchronously at high speeds. Thus, it possesses advantages for intelligent transportation systems that conventional frame cameras cannot match, such as high temporal resolution, high dynamic range, as well as sparse and minimal motion blur. Therefore, this study proposes an E-detector based on event cameras that asynchronously detect moving objects. The main innovation of our framework is that the spatiotemporal domain of the event camera can be adjusted according to different velocities and scenarios. It overcomes the inherent challenges that traditional cameras face when detecting moving objects in complex environments, such as high speed, complex lighting, and motion blur. Moreover, our approach adopts filter models and transfer learning to improve the performance of event-based object detection. Experiments have shown that our method can detect high-speed moving objects better than conventional cameras using state-of-the-art detection algorithms. Thus, our proposed approach is extremely competitive and extensible, as it can be extended to other scenarios concerning high-speed moving objects. The study findings are expected to unlock the potential of event cameras in intelligent transportation system applications.

13 January 2022 in SSRN Electronic Journal
Verified
Preprint
Open access
PDF file
SZShixiong Zhang
Shixiong Zhang
WWWenmin Wang
Wenmin Wang
HLHonglei Li
Honglei Li
SZShenyong Zhang
Shenyong Zhang
The event camera is a novel bio-inspired sensor that has attracted the interest of many researchers. As a neuromorphic vision, the sensor is different from the traditional frame-based cameras. It has such advantages for high-speed object detection that conventional frame-based cameras can’t match, e.g., high temporal resolution, high dynamic range (HDR), sparse and minimal motion blur. In this paper, we propose EventMD an adaptive framework for high-speed moving object detection using event cameras and an event-based dataset collected from real traffic scenes using event-camera Celex-V. The key novelties of our framework are our method overcomes the inability of conventional cameras to detect high-speed moving objects and also provides a framework for event vision that can adapt to any detector. Since event cameras have unique advantages for capturing high-speed moving objects in different scenes, our framework combines bio-inspired sensors and conventional detection algorithms to detect high-speed moving objects and to reduce motion blur and data redundancy. The experiments show that our method can detect high-speed moving objects but some state-of-the-art detection algorithms with the conventional camera are not capable of it and our proposed approach is very competitive and extensible. In addition, our approach can be extended to other scenarios of high-speed moving objects.

10 July 2021 in TechRxiv
Verified
Preprint
Open access
PDF file
SZShixiong Zhang
Shixiong Zhang
WWWenmin Wang
Wenmin Wang
Event-based vision is a novel bio-inspired vision that has attracted the interest of many researchers. As a neuromorphic vision, the sensor is different from the traditional frame-based cameras. It has such advantages that conventional frame-based cameras can’t match, e.g., high temporal resolution, high dynamic range(HDR), sparse and minimal motion blur. Recently, a lot of computer vision approaches have been proposed with demonstrated success. However, there is a lack of some general methods to expand the scope of the application of event-based vision. To be able to effectively bridge the gap between conventional computer vision and event-based vision, in this paper, we propose an adaptable framework for object detection in event-based vision.