Huimin Ma

Prof. Dr. Huimin Ma


Research Focus & Metrics

Academic Career Length

20Years (2007-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 May 2017 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
XCXiaozhi Chen
Xiaozhi Chen
KKKaustav Kundu
Kaustav Kundu
YZYukun Zhu
Yukun Zhu
HMHuimin Ma
Huimin Ma
SFSanja Fidler
Sanja Fidler
RURaquel Urtasun
Raquel Urtasun
The goal of this paper is to perform 3D object detection in the context of autonomous driving. Our method aims at generating a set of high-quality 3D object proposals by exploiting stereo imagery. We formulate the problem as minimizing an energy function that encodes object size priors, placement of objects on the ground plane as well as several depth informed features that reason about free space, point cloud densities and distance to the ground. We then exploit a CNN on top of these proposals to perform object detection. In particular, we employ a convolutional neural net (CNN) that exploits context and depth information to jointly regress to 3D bounding box coordinates and object pose. Our experiments show significant performance gains over existing RGB and RGB-D object proposal methods on the challenging KITTI benchmark. When combined with the CNN, our approach outperforms all existing results in object detection and orientation estimation tasks for all three KITTI object classes. Furthermore, we experiment also with the setting where LIDAR information is available, and show that using both LIDAR and stereo leads to the best result.

10 June 2022 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
BZBochao Zou
Bochao Zou
JHJiali Han
Jiali Han
YWYingxue Wang
Yingxue Wang
RLRui Liu
Rui Liu
SZShenghui Zhao
Shenghui Zhao
HMHuimin Ma
Huimin Ma
Depression is a common psychiatric disorder worldwide. However, in China, a considerable number of patients with depression are not diagnosed, and most of them are not aware of their depression. Despite increasing efforts, the goal of automatic depression screening from behavioral indicators has not been achieved. A major limitation is the lack of available multimodal depression corpus in Chinese since linguistic knowledge is crucial in clinical practice. Therefore, we first carried out a comprehensive survey with psychiatrists from a renowned psychiatric hospital to identify key interview topics which are highly related to the diagnosis of depression. Then, a semi-structural interview study was conducted over a year with subjects who have undergone clinical diagnosis and professional assessment. After that, Visual, acoustic, and textual features were extracted and analyzed between the two groups, statistically significant differences were observed in all three modalities. Benchmark evaluations of both single modal and multimodal fusion methods of depression assessment were also performed. A multimodal transformer-based fusion approach achieved the best performance. Finally, the proposed Chinese Multimodal Depression Corpus (CMDC) was made publicly available after de-identification and annotation. Hopefully, the release of this corpus would promote the research progress and practical applications of automatic depression screening.

26 September 2017 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
XWXiang Wang
Xiang Wang
HMHuimin Ma
Huimin Ma
XCXiaozhi Chen
Xiaozhi Chen
SYShaodi You
Shaodi You
In this paper, we propose a novel edge preserving and multi-scale contextual neural network for salient object detection. The proposed framework is aiming to address two limits of the existing CNN based methods. First, region-based CNN methods lack sufficient context to accurately locate salient object since they deal with each region independently. Second, pixel-based CNN methods suffer from blurry boundaries due to the presence of convolutional and pooling layers. Motivated by these, we first propose an end-to-end edge-preserved neural network based on Fast R-CNN framework (named RegionNet) to efficiently generate saliency map with sharp object boundaries. Later, to further improve it, multi-scale spatial context is attached to RegionNet to consider the relationship between regions and the global scenes. Furthermore, our method can be generally applied to RGB-D saliency detection by depth refinement. The proposed framework achieves both clear detection boundary and multi-scale contextual robustness simultaneously for the first time, and thus achieves an optimized performance. Experiments on six RGB and two RGB-D benchmark datasets demonstrate that the proposed method achieves state-of-the-art performance.

30 January 2020 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
XWXiang Wang
Xiang Wang
SLSifei Liu
Sifei Liu
HMHuimin Ma
Huimin Ma
MYMing Yang
Ming Yang

26 October 2023
Verified
Conference Paper
Open access
JLJiawei Li
Jiawei Li
JCJiansheng Chen
Jiansheng Chen
JLJinyuan Liu
Jinyuan Liu
HMHuimin Ma
Huimin Ma
Infrared and visible image fusion has gradually proved to be a vital fork in the field of multi-modality imaging technologies. In recent developments, researchers not only focus on the quality of fused images but also evaluate their performance in downstream tasks. Nevertheless, the majority of methods seldom put their eyes on mutual learning from different modalities, resulting in fused images lacking significant details and textures. To overcome this issue, we propose an interactive graph neural network (GNN)-based architecture between cross modality for fusion, called IGNet. Specifically, we first apply a multi-scale extractor to achieve shallow features, which are employed as the necessary input to build graph structures. Then, the graph interaction module can construct the extracted intermediate features of the infrared/visible branch into graph structures. Meanwhile, the graph structures of two branches interact for cross-modality and semantic learning, so that fused images can maintain the important feature expressions and enhance the performance of downstream tasks. Besides, the proposed leader nodes can improve information propagation in the same modality. Finally, we merge all graph features to get the fusion result. Extensive experiments on different datasets (i.e. TNO, MFNet, and M3FD) demonstrate that our IGNet can generate visually appealing fused images while scoring averagely 2.59% [email protected] and 7.77% mIoU higher in detection and segmentation than the compared state-of-the-art methods. The source code of the proposed IGNet can be available at https://github.com/lok-18/IGNet.

2 October 2017 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
XLXi Li
Xi Li
HMHuimin Ma
Huimin Ma
XWXiang Wang
Xiang Wang
XZXiaoqin Zhang
Xiaoqin Zhang
Traffic light recognition is one of the important tasks in the studies of intelligent transport system. In this paper, a robust traffic light recognition model based on vision information is introduced for on-vehicle camera applications. Our contribution mainly includes three aspects. First, in order to reduce computational redundancy, the aspect ratio, area, location, and context of traffic lights are utilized as prior information, which establishes a task model for traffic light recognition. Second, in order to improve the accuracy, we propose a series of improved methods based on an aggregate channel feature method, including modifying the channel feature for each types of traffic light and establishing a structure of fusion detectors. Third, we introduce a method of inter-frame information analysis, utilizing detection information of previous frame to modify original proposal regions, which makes the accuracy further improved. In the comparison of other traffic light detection algorithms, our model achieves competitive results on the complex scene VIVA data set. Furthermore, an analysis of small target luminous object detection tasks is given.