Ju Shen

Dr. Ju Shen

orcid

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 August 2023 in ACM Computing Surveys
Verified
Journal Article
Open access
CZCe Zheng
Ce Zheng
WWWenhan Wu
Wenhan Wu
CCChen Chen
Chen Chen
TYTaojiannan Yang
Taojiannan Yang
SZSijie Zhu
Sijie Zhu
MSMubarak Shah
Mubarak Shah
Human pose estimation aims to locate the human body parts and build human body representation (e.g., body skeleton) from input data such as images and videos. It has drawn increasing attention during the past decade and has been utilized in a wide range of applications including human-computer interaction, motion analysis, augmented reality, and virtual reality. Although the recently developed deep learning-based solutions have achieved high performance in human pose estimation, there still remain challenges due to insufficient training data, depth ambiguities, and occlusion. The goal of this survey article is to provide a comprehensive review of recent deep learning-based solutions for both 2D and 3D pose estimation via a systematic analysis and comparison of these solutions based on their input data and inference procedures. More than 260 research papers since 2014 are covered in this survey. Furthermore, 2D and 3D human pose estimation datasets and evaluation metrics are included. Quantitative performance comparisons of the reviewed methods on popular datasets are summarized and discussed. Finally, the challenges involved, applications, and future research directions are concluded. A regularly updated project page is provided: https://github.com/zczcwh/DL-HPE .

15 January 2018 in Sensors
Verified
Journal Article
Open access
PDF file
PSPo-Chang Su
Po-Chang Su
JSJu Shen
Ju Shen
WXWanxin Xu
Wanxin Xu
SCSen-Ching S. Cheung
Sen-Ching S. Cheung
YLYing Luo
Ying Luo
From object tracking to 3D reconstruction, RGB-Depth (RGB-D) camera networks play an increasingly important role in many vision and graphics applications. Practical applications often use sparsely-placed cameras to maximize visibility, while using as few cameras as possible to minimize cost. In general, it is challenging to calibrate sparse camera networks due to the lack of shared scene features across different camera views. In this paper, we propose a novel algorithm that can accurately and rapidly calibrate the geometric relationships across an arbitrary number of RGB-D cameras on a network. Our work has a number of novel features. First, to cope with the wide separation between different cameras, we establish view correspondences by using a spherical calibration object. We show that this approach outperforms other techniques based on planar calibration objects. Second, instead of modeling camera extrinsic calibration using rigid transformation, which is optimal only for pinhole cameras, we systematically test different view transformation functions including rigid transformation, polynomial transformation and manifold regression to determine the most robust mapping that generalizes well to unseen data. Third, we reformulate the celebrated bundle adjustment procedure to minimize the global 3D reprojection error so as to fine-tune the initial estimates. Finally, our scalable client-server architecture is computationally efficient: the calibration of a five-camera system, including data capture, can be done in minutes using only commodity PCs. Our proposed framework is compared with other state-of-the-arts systems using both quantitative measurements and visual alignment results of the merged point clouds.

22 March 2021 in Journal of Real-Time Image Processing
Verified
Journal Article
Closed access
PDF file
SBSumanta Bhattacharyya
Sumanta Bhattacharyya
JSJu Shen
Ju Shen
SWStephen Welch
Stephen Welch
CCChen Chen
Chen Chen

20 January 2017 in Computers
Verified
Journal Article
Open access
PDF file
Qingquan SunQingquan Sun
Qingquan Sun
JSJu Shen
Ju Shen
HQHaiyan Qiao
Haiyan Qiao
Xin-Lin HuangXin-Lin Huang
Xin-Lin Huang
CCChen Chen
Chen Chen
FHFei Hu
Fei Hu
Conventional wearable sensors are mainly used to detect the physiological and activity information of individuals who wear them, but fail to perceive the information of the surrounding environment. This paper presents a wearable thermal sensing system to detect and perceive the information of surrounding human subjects. The proposed system is developed based on a pyroelectric infrared sensor. Such a sensor system aims to provide surrounding information to blind people and people with weak visual capability to help them adapt to the environment and avoid collision. In order to achieve this goal, a low-cost, low-data-throughput binary sampling and analyzing scheme is proposed. We also developed a conditioning sensing circuit with a low-noise signal amplifier and programmable system on chip (PSoC) to adjust the amplification gain. Three statistical features in information space are extracted to recognize static humans and human scenarios in indoor environments. The results demonstrate that the proposed wearable thermal sensing system and binary statistical analysis method are efficient in static human detection and human scenario perception.

15 October 2014 in Journal of Cyber Security and Mobility
Verified
Journal Article
Closed access
JSJu Shen
Ju Shen
JYJianjun Yang
Jianjun Yang
STSami Taha-Abusneineh
Sami Taha-Abusneineh
BPBryson Payne
Bryson Payne
MHMarkus Hitz
Markus Hitz
With the explosive growth of web-based cameras and mobile devices, billions of photographs are uploaded to the internet. We can trivially collect a huge number of photo streams for various goals, such as image clustering, 3D scene reconstruction, and other big data applications. However, such tasks are not easy due to the fact the retrieved photos can have large variations in their view perspectives, resolutions, lighting, noises, and distortions. Furthermore, with the occlusion of unexpected objects like people, vehicles, it is even more challenging to find feature correspondences and reconstruct realistic scenes. In this paper, we propose a structure-based image completion algorithm for object removal that produces visually plausible content with consistent structure and scene texture. We use an edge matching technique to infer the potential structure of the unknown region. Driven by the estimated structure, texture synthesis is performed automatically along the estimated curves. We evaluate the proposed method on different types of images: from highly structured indoor environment to natural scenes. Our experimental results demonstrate satisfactory performance that can be potentially used for subsequent big data processing, such as image localization, object retrieval, and scene reconstruction. Our experiments show that this approach achieves favorable results that outperform existing state-of-the-art techniques.

4 August 2015
Verified
Book Chapter
Open access
PDF file
JSJu Shen
Ju Shen
JYJianjun Yang
Jianjun Yang
3D character with human motion offers a high end technology for creating compelling contents in graphics. In this paper, we present an automatic system to animate a 3D character with human motion streamed from a single video camera. The traditional mesh animation process is laborious and requires high skills from the users. To mitigate this limitation, a new way for bringing 3D objects to life is introduced that does not need explicit mesh positioning. In our framework, the animation is driven by the captured motion from an ordinary RGB camera. In order to reduce the ambiguity of the estimated 3D pose, a modified spatio-temporal constraint based algorithm is used for articulated gesture estimation across frames while maintaining temporal coherence. Our approach demonstrates promising performance on par with state-of-the-art techniques. We believe the presented animation system will allow a new audience of novice users to easily and efficiently create animation for arbitrary 3D characters.