Grasping with anthropomorphic robotic hands involves much more hand-object interactions compared to parallel-jaw grippers. Modeling hand-object interactions is essential to the study of multi-finger hand dextrous manipulation. This work presents DVGG, an efficient grasp generation network that takes single-view observation as input and predicts high-quality grasp configurations for unknown objects. In general, our generative model consists of three components: 1) Point cloud completion for the target object based on the partial observation; 2) Diverse sets of grasps generation given the complete point cloud; 3) Iterative grasp pose refinement for physically plausible grasp optimization. To train our model, we build a large-scale grasping dataset that contains about 300 common object models with 1.5 M annotated grasps in simulation. Experiments in simulation show that our model can predict robust grasp poses with a wide variety and high success rate. Real robot platform experiments demonstrate that the model trained on our dataset performs well in the real world. Remarkably, our method achieves a grasp success rate of 70.7% for novel objects in the real robot platform, which is a significant improvement over the baseline methods.

This article investigates the challenge of enabling multi-finger hands to perform human-like functional grasping for various intentions. However, accomplishing functional grasping in real robot hands present many challenges, including handling generalization ability for kinematically diverse robot hands, generating intention-conditioned grasps for a large variety of objects, and incomplete perception from a single-view camera. In this work, we first propose a six-step functional grasp synthesis algorithm based on fine-grained contact modeling. With the fine-grained contact-based optimization and learned dense shape correspondence, the algorithm is adaptable to various objects of the same category and a wide range of multi-finger hands using few demonstrations. Secondly, over 10K functional grasps are synthesized to train our neural network, named DexFG-Net, which generates intention-conditioned grasps based on reconstructed object. Extensive experiments in the simulation and physical grasps indicate that the grasp synthesis algorithm can produce human-like functional grasp with robust stability and functionality, and the DexFG-Net can generate plausible and human-like intention-conditioned grasping postures for anthropomorphic hands. Project page and video demonstration is available at https://v-wewei.github.io/sr_dexgrasp .

Frequent bad weather at sea severely damages the quality of visual images captured by imaging equipment. Ship instance segmentation in adverse weather conditions remains a major challenge because of poor visibility at sea. Existing approaches for instance segmentation are primarily designed for clear days and rarely consider the aforementioned severe weather. Blurred ship objects can easily cause missed ship detection and decrease the instance segmentation performance on ship images, especially in the case of frequent fog at sea. To this end, we propose a ship instance segmentation framework (IRDCLNet) based on Interference Reduction and Dynamic Contour Learning in foggy scenes. The Interference Reduction Module is proposed to reduce the interference caused by fog and solves the problem of missed ship detection. Meanwhile, we present Dynamic Contour Learning to predict the overall contour of the blurred ships to assist in mask prediction. To handle the scarcity of ocean data in foggy weather, we build the Foggy ShipInsseg dataset, which contains 5,739 real and simulated foggy ship images with 10,900 fine instance mask annotations. Experiments on the Foggy ShipInsseg dataset show that our IRDCLNet outperforms the Mask R-CNN and CondInst baselines and achieves the state-of-the-art performance.

Human-robot object handovers are essential for robots to effectively serve human needs in various domains of human–robot interaction and collaboration, yet remain a significant challenge. Remarkable progress has been made by parallel-jaw gripper robots in grasp generation and motion planning for handovers, while few studies address this issue using anthropomorphic hands, necessitating the ability to handle higher collision probabilities and lower approaching space under occluded situations. In this article, we present a reactive human-to-robot dexterous handover framework for anthropomorphic hands. The closed-loop framework employs an effective collision detection and grasp selection approach to ensure safe and smooth motion in unstructured environments. We implement a handover system using a UR5 robot arm and a Schunk SVH Hand based on the presented framework, which can react to human motion during the handover process, generalize to diverse objects with different 6-DoF poses, and execute suitable grasp configurations. The generalizability, reliability, and efficiency of our method are demonstrated through the handover of 30 novel objects, a system ablation study for submodule evaluation, and a user study assessment involving eight participants.

Multiple ship tracking (MST) is an important task in marine surveillance and ship situational awareness systems. Considerable work has been conducted on multiple object tracking in recent years, but it has focused primarily on pedestrians and automobiles, leaving a gap in studies on MST due to the particularities of complex marine scenes, such as ship scale variations, the long-tailed distribution of ships, and long-term occlusions caused by ship movements. In this article, we present a robust deep affinity network (RoDAN) for MST. To overcome the above difficulties in MST, we start with the basic deep affinity network (DAN) and improve it in three aspects: scale, region, and motion. For the scale dimension, we integrate an atrous spatial pyramid pooling (ASPP) module to improve the modeling ability for multiscale ships. For the region dimension, we propose the joint global region modeling (JGRM) module, which further strengthens the modeling ability of DAN and exploit it to overcome the long-tailed distribution property of ships. For the motion dimension, we propose the motion-matching optimization (MMO) module to fine-tune the tracking results and make our tracker more robust, less reliant on the front-end detector, and ameliorate long-term occlusions. The experimental results demonstrate that our MST method outperforms the state-of-the-art methods. In particular, it reduces the number of ID switches (IDSs) and trajectory fragmentations (FMs), achieving holistically preferable performance. Meanwhile, our method achieves a comparable speed.