Shunkun Liang

Shunkun Liang

Auto-generated profile, based on publicly available information

Shunkun Liang

College of Aerospace Science and Engineering, National University of Defense Technology, Changsha, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 February 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
ZFZicheng Feng
Zicheng Feng
WZWenlong Zhang
Wenlong Zhang
SLShunkun Liang
Shunkun Liang
QYQifeng Yu
Qifeng Yu
High-resolution high-frame-rate videos can record motion scenes detailedly and smoothly, but usually only professional cameras have enough transmission bandwidth to meet the video capture requirement. The conventional solutions use video processing methods such as video super-resolution (VSR) and video frame interpolation (VFI), but their results suffer from unreal spatial-temporal details in complex dynamic cases. To address this problem, we reconstruct a more real high-resolution high-frame-rate video using a hybrid video input, including a low-resolution high-frame-rate video (main video) and a high-resolution low-frame-rate video (auxiliary video). We propose a deep learning model named HIS-VSR, which consists of three parts: super-resolution of the main video, detail feature extraction of the auxiliary video and hybrid video information aggregation. Among them, the first part processes the main video to generate preliminary high-resolution frames; the second part warps the auxiliary frames for alignment and extracts their high-resolution detail features; the last part uses a weighted aggregation method to fuse the results of the first and second part. We train our model on synthetic datasets and demonstrate its excellent performance of reconstructing dynamic scenes by comparing it with Deep-SloMo on synthetic and real videos.

23 July 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
ZYZhenbao Yu
Zhenbao Yu
BGBanglei Guan
Banglei Guan
SLShunkun Liang
Shunkun Liang
ZLZibin Liu
Zibin Liu
YSYang Shang
Yang Shang
QYQifeng Yu
Qifeng Yu
Mobile devices equipped with a multi-camera system and an inertial measurement unit (IMU) are widely used nowadays, such as self-driving cars. The task of relative pose estimation using visual and inertial information has important applications in various fields. To improve the accuracy of relative pose estimation of multi-camera systems, we propose a globally optimal solver using affine correspondences to estimate the generalized relative pose with a known vertical direction. First, a cost function about the relative rotation angle is established after decoupling the rotation matrix and translation vector, which minimizes the algebraic error of geometric constraints from affine correspondences. Then, the global optimization problem is converted into two polynomials with two unknowns based on the characteristic equation and its first derivative is zero. Finally, the relative rotation angle can be solved using the polynomial eigenvalue solver, and the translation vector can be obtained from the eigenvector. Besides, a new linear solution is proposed when the relative rotation is small. The proposed solver is evaluated on synthetic data and real-world datasets. The experiment results demonstrate that our method outperforms comparable state-of-the-art methods in accuracy.

1 December 2024
Verified
Book Chapter
Closed access
PDF file
SLShunkun Liang
Shunkun Liang
BGBanglei Guan
Banglei Guan
ZYZhenbao Yu
Zhenbao Yu
PSPengju Sun
Pengju Sun
YSYang Shang
Yang Shang

8 May 2023 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
ZYZhenbao Yu
Zhenbao Yu
BGBanglei Guan
Banglei Guan
SLShunkun Liang
Shunkun Liang
ZLZhang Li
Zhang Li
SYShirong Ye
Shirong Ye
QYQifeng Yu
Qifeng Yu
For self-driving cars, smartphones, and unmanned aerial vehicles, cameras are typically used in combination with inertial measurement units (IMUs). The vertical direction of camera views can be determined based on partial IMU measurements—that is, the relative orientation of two views is reduced to a single degree of freedom. In this paper, we propose a globally optimal solver using affine correspondences to estimate the relative pose of two views with a known vertical direction. First, the relative pose estimation problem is formalized as a cost function optimization, which minimizes algebraic error in the least-squares sense. Then, the cost function optimization is converted into two polynomials with only two unknowns, which are represented by the parameter of the rotation angle. Finally, we use the eigenvalue polynomial solver to calculate the parameter of the rotation angle. The proposed solver is evaluated using synthetic data and real-world scenes from the KITTI and EuRoC benchmarks. The experimental results show that our method performs better than existing state-of-the-art solvers.

28 October 2024
Verified
Conference Paper
Open access
ZLZibin Liu
Zibin Liu
BGBanglei Guan
Banglei Guan
YSYang Shang
Yang Shang
SLShunkun Liang
Shunkun Liang
ZYZhenbao Yu
Zhenbao Yu
QYQifeng Yu
Qifeng Yu
Object pose tracking is one of the pivotal technologies in multimedia, attracting ever-growing attention in recent years. Existing methods employing traditional cameras encounter numerous challenges such as motion blur, sensor noise, partial occlusion, and changing lighting conditions. The emerging bio-inspired sensors, particularly event cameras, possess advantages such as high dynamic range and low latency, which hold the potential to address the aforementioned challenges. In this work, we present an optical flow-guided 6DoF object pose tracking method with an event camera. A 2D-3D hybrid feature extraction strategy is firstly utilized to detect corners and edges from events and object models, which characterizes object motion precisely. Then, we search for the optical flow of corners by maximizing the event-associated probability within a spatio-temporal window, and establish the correlation between corners and edges guided by optical flow. Furthermore, by minimizing the distances between corners and edges, the 6DoF object pose is iteratively optimized to achieve continuous pose tracking. Experimental results of both simulated and real events demonstrate that our methods outperform event-based state-of-the-art methods in terms of both accuracy and robustness.

6 April 2026 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
SLShunkun Liang
Shunkun Liang
BGBanglei Guan
Banglei Guan
BLBin Li
Bin Li
QYQifeng Yu
Qifeng Yu
YSYang Shang
Yang Shang
Multi-camera systems offer rich observation capabilities for visual navigation and 3D scene reconstruction; however, the resulting feature redundancy often compromises computational efficiency. This challenge is particularly pronounced during bundle adjustment, where the non-linear optimization of both system poses and scene points incurs substantial computational overhead. To address this challenge, this paper introduces a pose-only geometric constraint for multi-camera systems and proposes a corresponding pose adjustment algorithm. Specifically, we use generalized camera model to establish a unified representation of the multi-camera system. Building upon this model, we formulate the multi-camera pose-only constraint, which implicitly represents a 3D scene point using two base observations and their associated poses, thereby achieving a pose-only representation of the projection geometry. Subsequently, we introduce a multi-camera pose adjustment algorithm that eliminates 3D points from the parameter space, thereby achieving efficient and focused pose optimization. Experimental results on both synthetic and real-world datasets demonstrate that the proposed algorithm outperforms baseline bundle adjustment methods in computational efficiency, while maintaining or even improving pose estimation accuracy