Jie Zhao

Jie Zhao

Auto-generated profile, based on publicly available information

Jie Zhao

Chinese University of Hong Kong, Hong Kong

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 March 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
XWXiaoman Wang
Xiaoman Wang
JZJie Zhao
Jie Zhao
XJXin Jiang
Xin Jiang
YLYunhui Liu
Yunhui Liu
Manipulation of deformable objects is an essential task in surgery, the textile industry, and household tasks, such as washing, hanging, and folding clothes. However, current studies on fabric manipulation, have rarely considered the scenes in which rigid objects have to be wrapped by fabrics. This type of operation is widely adopted in the logistic packaging and packaging of surgical instrument baskets. In this study, we propose a method to perform this operation, which can be used in fabric folding or wrapping a box with fabric. Owing to the complex dynamics and configuration spaces of fabric, our method is based on deep imitation learning to estimate pick-place points and the phase of the manipulation process. The dataset was completely generated from an open-source physical simulator. To make the data as realistic as that in actual scenarios, we adopted domain randomization and rendered the texture of fabric and box from the real world to simulation data. This not only helps in transferring the learned policies to a physical robot, but also allows the robot to wrap a box with complex patterns. The experiments demonstrate the efficiency of the developed method for accomplishing complex manipulation tasks. The results also showed that it could be generalized to fabrics with different colors and boxes with different sizes, textures, or geometric shapes.

13 July 2020 in IEEE Access
Verified
Journal Article
Open access
XWXiaoman Wang
Xiaoman Wang
XJXin Jiang
Xin Jiang
JZJie Zhao
Jie Zhao
SWShengfan Wang
Shengfan Wang
YLYunhui Liu
Yunhui Liu
In logistics warehouse sorting, rubbish classification, and household services, scenarios exist in which rigid and soft objects are randomly piled together. In such situations, two major challenges arise in robotic picking tasks: the first is to distinguish rigid objects from soft objects, and the second is to grasp one object of each type at a time. In this study, we propose a novel robotic picking methodology for the grasping of objects mixed with towels. The proposed approach is based on a novel object detection method that can identify a rigid object placed in different directions using a rotational bounding box. Rigid objects can be separated from the mixed scene without object segmentation. Moreover, the grasping pose of a rigid object can be generated directly along its principal axis, without using a CAD model or specific pose detection method. The gripper opening width is determined according to the object size. Therefore, our method can detect whether other objects, particularly soft ones, exist around a rigid object. If no suitable grasping pose is available for the rigid objects, the grasping pose on a wrinkle of the towel is selected. The experiments demonstrate that our method can accomplish the picking task in scenes with mixed rigid and soft objects, thereby indicating its significance in robotic object detection and sorting.

10 February 2019 in Sensors
Verified
Journal Article
Open access
PDF file
XWXiaoman Wang
Xiaoman Wang
XJXin Jiang
Xin Jiang
JZJie Zhao
Jie Zhao
SWShengfan Wang
Shengfan Wang
TYTao Yang
Tao Yang
YLYunhui Liu
Yunhui Liu
Picking clothing has always been a great challenge in laundry or textile industry automation, especially when some clothes are of the same colors, material and entangled with each other. In order to solve the problem, we present a grasp pose determination method to pick towels placed in a laundry basket or on a table. In our method, it is not needed to segment towels into independent items and the target towels are not necessarily distinguishable in color. The proposed algorithm firstly segments point clouds into several convex wrinkles, and then selects the appropriate grasp point on the candidate convex wrinkle. Moreover, we plan the grasp orientation with respect to the wrinkle which can effectively reduce the grasp failure caused by the inappropriate grasp direction. We evaluate our method on picking white towels and square towels, respectively, and achieved an average success rate of about 80%.

10 January 2023 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
JZJie Zhao
Jie Zhao
XWXiaoman Wang
Xiaoman Wang
SHShao Hu
Shao Hu
XJXin Jiang
Xin Jiang
YLYunhui Liu
Yunhui Liu
Achieving in-hand manipulation of a grasped object is challenging in robotic communities. This article proposes a planar intrinsic in-hand manipulation approach based on isometric transformation. We demonstrate that the isometric transformation (excluding reflections) can be reduced to rotations with two fixed centers, if more than two rotations around two different centers are performed. Furthermore, this article applies this theory to reposition and reorient a grasped object by performing three or more primitive rotations sequentially. We further analyze the feasible manipulation space, where the desired position and orientation of a grasped object can be attained. The theoretical results have been verified through simulations and experiments. In addition, we performed several real-world tasks using a novel robotic hand with two rotational degrees of freedom at each finger, demonstrating that the proposed in-hand manipulation method can reposition and reorient different grasped objects in $\text{SE}(2)$ .

27 March 2025 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
YSYanshu Song
Yanshu Song
JZJie Zhao
Jie Zhao
THTianyu Huang
Tianyu Huang
DLDarwin Lau
Darwin Lau
YLYunhui Liu
Yunhui Liu
Loading and unloading goods in narrow cuboid spaces (e.g., truck carriages) is a critical task in logistics transportation. It is often time-consuming, labor-intensive, risky, and therefore is valuable and necessary to be automated. However, due to the complexity of operational scenarios, most existing robots struggle to simultaneously integrate: small size and weight, sufficient load capacity, high robustness, high picking flexibility and efficiency, and good adaptability to narrow cuboid spaces. In this work, we present a light-weight robotic system capable of achieving flexible, efficient, and heavy-load palletizing in constrained cuboid spaces. We propose a novel adsorption-tray hybrid gripper which can significantly reduce the required adsorption area (by 64%) while maintaining high picking flexibility without affecting load capacity. Based on it, we propose the lift-then-pick picking method, and provide the design method of an adjustable picking trajectory, as well as an optimization strategy for the quantity of suction nozzles. Furthermore, we successfully introduce the time-optimal control idea into the picking process based on its unique dynamic constraints, which improves efficiency by 46%. We also implement a compliance control mechanism that significantly enhances the robustness (i.e., nearly doubling the picking success rate). In addition, we develop a specially designed manipulator to carry the gripper. The horizontally arranged degree of freedom configuration and the new rotational joint construction method enable the arm to maintain light-weight while sufficient load capacity. And its coverage of cuboid spaces far exceeds that of traditional industrial arms (100% vs. 53%). Finally, we manufacture a prototype and validate the above advantages through both simulation and real-world tests, confirming its potential for applications.