Hu Cao

Hu Cao

Auto-generated profile, based on publicly available information

Hu Cao

Southeast University

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 February 2023
Verified
Book Chapter
Closed access
PDF file
HCHu Cao
Hu Cao
YWYueyue Wang
Yueyue Wang
JCJoy Chen
Joy Chen
DJDongsheng Jiang
Dongsheng Jiang
XZXiaopeng Zhang
Xiaopeng Zhang
Manning WangManning Wang
Manning Wang

30 June 2020 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
GCGuang Chen
Guang Chen
HCHu Cao
Hu Cao
JCJörg Conradt
Jörg Conradt
HTHuajin Tang
Huajin Tang
FRFlorian Rohrbein
Florian Rohrbein
AKAlois Knoll
Alois Knoll
As a bio-inspired and emerging sensor, an event-based neuromorphic vision sensor has a different working principle compared to the standard frame-based cameras, which leads to promising properties of low energy consumption, low latency, high dynamic range (HDR), and high temporal resolution. It poses a paradigm shift to sense and perceive the environment by capturing local pixel-level light intensity changes and producing asynchronous event streams. Advanced technologies for the visual sensing system of autonomous vehicles from standard computer vision to event-based neuromorphic vision have been developed. In this tutorial-like article, a comprehensive review of the emerging technology is given. First, the course of the development of the neuromorphic vision sensor that is derived from the understanding of biological retina is introduced. The signal processing techniques for event noise processing and event data representation are then discussed. Next, the signal processing algorithms and applications for event-based neuromorphic vision in autonomous driving and various assistance systems are reviewed. Finally, challenges and future research directions are pointed out. It is expected that this article will serve as a starting point for new researchers and engineers in the autonomous driving field and provide a bird's-eye view to both neuromorphic vision and autonomous driving research communities.

16 May 2024 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Open access
XZXingcheng Zhou
Xingcheng Zhou
MLMingyu Liu
Mingyu Liu
EYEkim Yurtsever
Ekim Yurtsever
BŽBare Luka Žagar
Bare Luka Žagar
WZWalter Zimmer
Walter Zimmer
AKAlois Christian Knoll
Alois Christian Knoll
The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By integrating language data, the driving systems can be able to deeply understand real-world environments, improving driving safety and efficiency. In this work, we present a comprehensive and systematic survey of the advances in language models in this domain, encompassing perception and understanding, navigation and planning, decision-making and control, end-to-end autonomous driving, and data generation. We introduce the mainstream VLM tasks and the commonly utilized metrics. Additionally, we review current studies and applications in various areas and summarize the existing language-enhanced autonomous driving dataset thoroughly. At last, we discuss the benefits and challenges of VLMs in AD, and provide researchers with the current research gaps and future trends. https://github.com/ge25nab/Awesome-VLM-AD-ITS

22 September 2021 in IEEE Sensors Journal
Verified
Journal Article
Closed access
HCHu Cao
Hu Cao
GCGuang Chen
Guang Chen
JXJiahao Xia
Jiahao Xia
GZGenghang Zhuang
Genghang Zhuang
AKAlois Christian Knoll
Alois Christian Knoll
In the field of autonomous vehicles, various heterogeneous sensors, such as LiDAR, Radar, camera, etc, are combined to improve the vehicle ability of sensing accuracy and robustness. Multi-modal perception and learning has been proved to be an effective method to help vehicle understand the nature of complex environments. Event camera is a bio-inspired vision sensor that captures dynamic changes in the scene and filters out redundant information with high temporal resolution and high dynamic range. These characteristics of the event camera make it have a certain application potential in the field of autonomous vehicles. In this paper, we introduce a fully convolutional neural network with feature attention gate component (FAGC) for vehicle detection by combining frame-based and event-based vision. Both grayscale features and event features are fed into the feature attention gate component (FAGC) to generate the pixel-level attention feature coefficients to improve the feature discrimination ability of the network. Moreover, we explore the influence of different fusion strategies on the detection capability of the network. Experimental results demonstrate that our fusion method achieves the best detection accuracy and exceeds the accuracy of the method that only takes single-mode signal as input.

16 December 2022 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
HCHu Cao
Hu Cao
GCGuang Chen
Guang Chen
Zhijun LiZhijun Li
Zhijun Li
QFQian Feng
Qian Feng
JLJianjie Lin
Jianjie Lin
AKAlois Christian Knoll
Alois Christian Knoll
Deep learning methods have achieved excellent results in the field of grasp detection. However, deep learning-based models for general object detection lack the proper balance of accuracy and inference speed, resulting in poor performance in real-time grasp tasks. This work proposes an efficient grasp detection network with n-channel images as inputs for robotic grasp. The proposed network is a lightweight generative structure for grasp detection in one stage. Specifically, a Gaussian kernel-based grasp representation is introduced to encode the training samples, embodying the maximum center that possesses the highest grasp confidence. A receptive field block is plugged into the bottleneck to improve the model's feature discriminability. In addition, pixel-based and channel-based attention mechanisms are used to construct a multidimensional attention fusion network to fuse valuable semantic information, achieved by suppressing noisy features and highlighting object features. The proposed method is evaluated on the Cornell, Jacquard, and extended OCID grasp datasets. The experimental results show that our method achieves excellent balancing accuracy and running speed performance. The network gets a running speed of $\text{6}\,\text{ms}$ , achieving better performance on the Cornell, Jacquard, and extended OCID grasp datasets with 97.8, 95.6, and 76.4% accuracy, respectively. Subsequently, an excellent grasp success rate in a physical environment is obtained using the UR5 robot arm.

2 June 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
HCHu Cao
Hu Cao
GCGuang Chen
Guang Chen
Zhijun LiZhijun Li
Zhijun Li
YHYingbai Hu
Yingbai Hu
AKAlois Christian Knoll
Alois Christian Knoll
Grasp pose estimation is a crucial procedure in robotic manipulation. Most of the current robot grasp manipulation systems are built on frame-based cameras like RGB-D cameras. However, the traditional frame-based grasp pose estimation methods have encountered challenges in scenarios such as low dynamic range and low power consumption. In this work, a neuromorphic vision sensor—dynamic and active-pixel vision sensor (DAVIS)—is introduced to the field of robotic grasp. DAVIS is an event-based bio-inspired vision sensor that records asynchronous streams of local pixel-level light intensity changes, called events. The strengths of DAVIS are it can provide high temporal resolution, high dynamic range, low power consumption, and no motion blur. We construct a neuromorphic vision-based robotic grasp dataset with 154 moving objects, named NeuroGrasp, which is the first RGB-Event multimodality grasp dataset (to the best of our knowledge). This dataset records both RGB frames and the corresponding event streams, providing frame data with rich color and texture information and event streams with high temporal resolution and high dynamic range. Based on the NeuroGrasp dataset, we further develop a multimodal neural network with a specific Euler region regression sub-network (ERRN) to perform grasp pose estimation. Combined with frame-based and event-based vision, the proposed method achieves better performance than the method that only takes RGB frames or event streams as input on the NeuroGrasp dataset.