Kaiyue Sun

Kaiyue Sun

Auto-generated profile, based on publicly available information

Kaiyue Sun

Beijing Key Laboratory of Intelligent Processing for Building Big Data, Beijing University of Civil Engineering and Architecture, Beijing, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 July 2022 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
Xiaoping ZhouXiaoping Zhou
Xiaoping Zhou
KSKaiyue Sun
Kaiyue Sun
JWJia Wang
Jia Wang
JZJichao Zhao
Jichao Zhao
CFChiyuan Feng
Chiyuan Feng
WZWei Zhou
Wei Zhou
A Building Digital Twin (BDT) can maintain an up-to-date digital model reflecting physical world conditions and has become necessary for building applications. Recent studies on the BDT employed the Internet of Things to sense physical-world conditions. Although cameras are one of the most widely-used facilities in buildings, their adoption in the BDT remains unexplored. This study proposes a novel computer-vision(CV)-enabled BDT scheme using Building Information Modelling (BIM) taking camera videos as input, which addresses the dimension, coordinate system, and object inconsistencies between BIM and camera videos. Firstly, the proposed BDT scheme detects objects’ locations and rotations jointly using a two-dimensional (2D) object detection network and a three-dimensional (3D) object estimation network. Then, Theorem and Lemmas are presented to compute the 3D locations in BIM coordinate system using detected 2D locations. Thirdly, both cold-start object matching and run-time object matching schemes are proposed to address the object inconsistency between camera videos and BIM. Finally, experiments were conducted in the real-world environment. The experiment results showed that the proposed BDT scheme maintained average location errors of 0.181$m$ with distortions preserved and 0.165$m$ with distortions removed in the manual calibration scenario, 0.166$m$ with distortions preserved, and 0.195$m$ with distortions removed in automatic calibration scenario. This finding proved the effectiveness of the proposed BDT scheme. This study is the first to explore a BDT scheme on top of BIM using CV. It is anticipated that this study will inspire more intelligent studies in smart buildings jointly employing both CV and BIM.