Siyuan Qi

Siyuan Qi

Auto-generated profile, based on publicly available information

Siyuan Qi

Dept. of Computer Science UCLA

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 October 2018
Verified
Book Chapter
Closed access
PDF file
SQSiyuan Qi
Siyuan Qi
Wenguan WangWenguan Wang
Wenguan Wang
BJBaoxiong Jia
Baoxiong Jia
JSJianbing Shen
Jianbing Shen
SZSong-Chun Zhu
Song-Chun Zhu

18 December 2019 in Science Robotics
Verified
Journal Article
Open access
PDF file
MEMark Edmonds
Mark Edmonds
FGFeng Gao
Feng Gao
HLHangxin Liu
Hangxin Liu
XXXu Xie
Xu Xie
SQSiyuan Qi
Siyuan Qi
SZSong-Chun Zhu
Song-Chun Zhu
Forms of explanation that are best suited to foster trust do not necessarily correspond to those components contributing to the best task performance.

6 October 2018
Verified
Book Chapter
Closed access
PDF file
SHSiyuan Huang
Siyuan Huang
SQSiyuan Qi
Siyuan Qi
YZYixin Zhu
Yixin Zhu
YXYinxue Xiao
Yinxue Xiao
YXYuanlu Xu
Yuanlu Xu
SZSong-Chun Zhu
Song-Chun Zhu

5 January 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
Tianfei ZhouTianfei Zhou
Tianfei Zhou
SQSiyuan Qi
Siyuan Qi
Wenguan WangWenguan Wang
Wenguan Wang
JSJianbing Shen
Jianbing Shen
SZSong-Chun Zhu
Song-Chun Zhu
This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images. Considering the intrinsic complexity and structural nature of the task, we introduce a cascaded parsing network (CP-HOI) for a multi-stage, structured HOI understanding. At each cascade stage, an instance detection module progressively refines HOI proposals and feeds them into a structured interaction reasoning module. Each of the two modules is also connected to its predecessor in the previous stage, enabling efficient cross-stage information propagation. The structured interaction reasoning module is built upon a graph parsing neural network (GPNN), which efficiently models potential HOI structures as graphs and mines rich context for comprehensive relation understanding. In particular, GPNN infers a parse graph that i) interprets meaningful HOI structures by a learnable adjacency matrix, and ii) predicts action (edge) labels. Within an end-to-end, message-passing framework, GPNN blends learning and inference, iteratively parsing HOI structures and reasoning HOI representations ( i.e ., instance and relation features). Further beyond relation detection at a bounding-box level, we make our framework flexible to perform fine-grained pixel-wise relation segmentation; this provides a new glimpse into better relation modeling. A preliminary version of our CP-HOI model reached 1 st place in the ICCV2019 Person in Context Challenge, on both relation detection and segmentation. In addition, our CP-HOI shows promising results on two popular HOI recognition benchmarks, i.e ., V-COCO and HICO-DET.

29 January 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
Wenguan WangWenguan Wang
Wenguan Wang
Tianfei ZhouTianfei Zhou
Tianfei Zhou
SQSiyuan Qi
Siyuan Qi
JSJianbing Shen
Jianbing Shen
SZSong-Chun Zhu
Song-Chun Zhu
Human parsing is for pixel-wise human semantic understanding. As human bodies are hierarchically structured, how to model human structures is the central theme in this task. We start with analyzing three inference processes over the human hierarchy: direct inference (directly predicting human semantic parts using image information), bottom-up inference (assembling knowledge from constituent parts), and top-down inference (leveraging context from parent nodes). We then formulate the problem as a compositional neural information fusion (CNIF) framework, which assembles the information from the three inference processes in a conditional manner, i.e., considering the confidence of the sources. Based on CNIF, we further present a part-relation aware human parser (PRHP), which precisely describes three kinds of human part relations, i.e., decomposition, composition, and dependency, by three distinct relation networks. Expressive relation information can be captured by imposing the parameters in the relation networks to satisfy specific geometric characteristics of different relations. By assimilating generic message-passing networks with their edge-typed, convolutional counterparts, PRHP performs iterative reasoning over the human hierarchy. With these efforts, PRHP provides a more general and powerful form of CNIF, and lays the foundation for more sophisticated and flexible human relation patterns of reasoning. Experiments on five datasets demonstrate that our two human parsers outperform the state-of-the-arts in all cases.

28 February 2020 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
SQSiyuan Qi
Siyuan Qi
BJBaoxiong Jia
Baoxiong Jia
SHSiyuan Huang
Siyuan Huang
PWPing Wei
Ping Wei
SZSong-Chun Zhu
Song-Chun Zhu
Detection, parsing, and future predictions on sequence data (e.g., videos) require the algorithms to capture non-Markovian and compositional properties of high-level semantics. Context-free grammars are natural choices to capture such properties, but traditional grammar parsers (e.g., Earley parser) only take symbolic sentences as inputs. In this paper, we generalize the Earley parser to parse sequence data which is neither segmented nor labeled. Given the output of an arbitrary probabilistic classifier, this generalized Earley parser finds the optimal segmentation and labels in the language defined by the input grammar. Based on the parsing results, it makes top-down future predictions. The proposed method is generic, principled, and widely applicable. Experiment results clearly show the benefit of our method for both human activity parsing and prediction on three video datasets.