Shang-Ching Liu

Shang-Ching Liu

Auto-generated profile, based on publicly available information

Shang-Ching Liu

Technical Aspects of Multimodal Systems Group, Department of Informatics, Universitt Hamburg, Hamburg, Germany

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 May 2024 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
Wenkai ChenWenkai Chen
Wenkai Chen
SLShang-Ching Liu
Shang-Ching Liu
JZJianwei Zhang
Jianwei Zhang
The event-based camera is a novel neuromorphic vision sensor that can perceive different dynamic behaviors due to its low latency, asynchronous data stream, and high dynamic range characteristics. There has been much work based on event cameras to solve problems, such as object tracking, visual odometry, and gesture recognition. However, the adoption of event vision to analyze hand-object action in a dynamic environment, a problem that regular CMOS cameras cannot handle, is still lacking in relevant research. This work presents a richly annotated task-oriented hand-object action dataset consisting of asynchronous event streams, captured by the event-based camera system on different application scenarios. In addition, we design an attention-based residual spiking neural network by learning temporal-wise and spatial-wise attention simultaneously and introducing a particular residual connection structure to achieve dynamic hand-object action recognition. Extensive experiments are validated by comparing with existing baseline methods to form a vision benchmark. We also show that the learned recognition model can be transferred to classify a real robot hand-object action.