Yingjie Cai

Yingjie Cai


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 February 2022 in Machine Vision and Applications
Verified
Journal Article
Closed access
PDF file
ZJZeyu Jiao
Zeyu Jiao
HLHuan Lei
Huan Lei
HZHengshan Zong
Hengshan Zong
YCYingjie Cai
Yingjie Cai
ZZZhenyu Zhong
Zhenyu Zhong

6 June 2021 in arXiv
Verified
Preprint
Open access
PDF file
YCYingjie Cai
Yingjie Cai
XCXuesong Chen
Xuesong Chen
CZChao Zhang
Chao Zhang
KLKwan-Yee Lin
Kwan-Yee Lin
XWXiaogang Wang
Xiaogang Wang
HLHongsheng Li
Hongsheng Li
Semantic Scene Completion aims at reconstructing a complete 3D scene with precise voxel-wise semantics from a single-view depth or RGBD image. It is a crucial but challenging problem for indoor scene understanding. In this work, we present a novel framework named Scene-Instance-Scene Network (\textit{SISNet}), which takes advantages of both instance and scene level semantic information. Our method is capable of inferring fine-grained shape details as well as nearby objects whose semantic categories are easily mixed-up. The key insight is that we decouple the instances from a coarsely completed semantic scene instead of a raw input image to guide the reconstruction of instances and the overall scene. SISNet conducts iterative scene-to-instance (SI) and instance-to-scene (IS) semantic completion. Specifically, the SI is able to encode objects' surrounding context for effectively decoupling instances from the scene and each instance could be voxelized into higher resolution to capture finer details. With IS, fine-grained instance information can be integrated back into the 3D scene and thus leads to more accurate semantic scene completion. Utilizing such an iterative mechanism, the scene and instance completion benefits each other to achieve higher completion accuracy. Extensively experiments show that our proposed method consistently outperforms state-of-the-art methods on both real NYU, NYUCAD and synthetic SUNCG-RGBD datasets. The code and the supplementary material will be available at \url{https://github.com/yjcaimeow/SISNet}.

9 June 2021 in arXiv
Verified
Preprint
Open access
PDF file
YCYingjie Cai
Yingjie Cai
BLBuyu Li
Buyu Li
ZJZeyu Jiao
Zeyu Jiao
HLHongsheng Li
Hongsheng Li
XZXingyu Zeng
Xingyu Zeng
XWXiaogang Wang
Xiaogang Wang
Monocular 3D object detection task aims to predict the 3D bounding boxes of objects based on monocular RGB images. Since the location recovery in 3D space is quite difficult on account of absence of depth information, this paper proposes a novel unified framework which decomposes the detection problem into a structured polygon prediction task and a depth recovery task. Different from the widely studied 2D bounding boxes, the proposed novel structured polygon in the 2D image consists of several projected surfaces of the target object. Compared to the widely-used 3D bounding box proposals, it is shown to be a better representation for 3D detection. In order to inversely project the predicted 2D structured polygon to a cuboid in the 3D physical world, the following depth recovery task uses the object height prior to complete the inverse projection transformation with the given camera projection matrix. Moreover, a fine-grained 3D box refinement scheme is proposed to further rectify the 3D detection results. Experiments are conducted on the challenging KITTI benchmark, in which our method achieves state-of-the-art detection accuracy.

1 January 2024 in International Journal of Agricultural and Biological Engineering
Verified
Journal Article
Open access
PDF file
ZJZeyu Jiao
Zeyu Jiao
YCYingjie Cai
Yingjie Cai
QZQi Zhang
Qi Zhang
ZZZhenyu Zhong
Zhenyu Zhong
Method for the multi-view estimation of fish mass using a two-stage neural network with edge-sensitive module

10 February 2025 in arXiv
Verified
Preprint
Open access
PDF file
TXTianshuo Xu
Tianshuo Xu
HLHao Lu
Hao Lu
XYXu Yan
Xu Yan
YCYingjie Cai
Yingjie Cai
BLBingbing Liu
Bingbing Liu
YCYingcong Chen
Yingcong Chen
Large Language Models (LLMs) have made substantial advancements in the field of robotic and autonomous driving. This study presents the first Occupancy-based Large Language Model (Occ-LLM), which represents a pioneering effort to integrate LLMs with an important representation. To effectively encode occupancy as input for the LLM and address the category imbalances associated with occupancy, we propose Motion Separation Variational Autoencoder (MS-VAE). This innovative approach utilizes prior knowledge to distinguish dynamic objects from static scenes before inputting them into a tailored Variational Autoencoder (VAE). This separation enhances the model's capacity to concentrate on dynamic trajectories while effectively reconstructing static scenes. The efficacy of Occ-LLM has been validated across key tasks, including 4D occupancy forecasting, self-ego planning, and occupancy-based scene question answering. Comprehensive evaluations demonstrate that Occ-LLM significantly surpasses existing state-of-the-art methodologies, achieving gains of about 6\% in Intersection over Union (IoU) and 4\% in mean Intersection over Union (mIoU) for the task of 4D occupancy forecasting. These findings highlight the transformative potential of Occ-LLM in reshaping current paradigms within robotic and autonomous driving.