This article explores a specialized problem of safely manipulating a moving object on a surface concerning moving obstacles with an industrial manipulator. To address this challenge, we formulate it as an optimal trajectory optimization problem to yield a safe, smooth, and locally time-optimal trajectory. Specifically, we propose a task-oriented trajectory planning algorithm that enables reaching and controlling a moving target on the surface as quickly as possible without specifying the reaching moment. Then we formally construct a spatiotemporal safe manifold to handle time-varying obstacles on the surface. The initially planned trajectory is projected onto this manifold, generating a safe but nonsmooth and time-consuming result. Finally, we leverage this result as an initial estimate for the optimization problem to efficiently generate a preferable trajectory while keeping the constraints not violated. Simulations and practical experiments in a production environment demonstrate the approaches presented. The results confirm the effectiveness of our algorithms, which offers an efficient solution to the challenge of manipulating a moving object on a surface.
13 May 2026 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Forecasting how human hands move in egocentric views is critical for applications like augmented reality, human-robot policy transfer, and service/assistive technologies. Recently, several hand trajectory prediction (HTP) methods have been developed to generate future possible hand waypoints, which still suffer from insufficient prediction targets, inherent modality gaps, entangled hand-head motion, and limited validation in downstream tasks. To address these limitations, we present Uni-Hand, a universal hand motion forecasting framework considering multi-modal input, multi-dimensional and multi-target prediction patterns, and multi-task affordances for downstream applications. We harmonize multiple modalities by vision-language fusion, global context incorporation, and task-aware text embedding injection, to forecast hand waypoints in both 2D and 3D spaces. A novel dual-branch diffusion is proposed to concurrently predict human head and hand movements, capturing their motion synergy in egocentric vision. By introducing target indicators, the prediction model can forecast the specific joint waypoints of the wrist or the fingers, besides the widely studied hand center points. In addition, we enable Uni-Hand to additionally predict hand-object interaction states (contact/separation) to facilitate downstream tasks better. To incorporate comprehensive downstream task evaluations in the literature, we build novel benchmarks to assess the real-world applicability of hand motion forecasting algorithms. The experimental results on multiple publicly available datasets and our newly proposed benchmarks demonstrate that Uni-Hand achieves the state-of-the-art performance in multi-dimensional and multi-target hand motion forecasting. Extensive validation in multiple downstream tasks also presents its impressive human-robot policy transfer to enable robotic manipulation, and effective feature enhancement for action anticipation/recognition.