Excavation is one of the broadest activities in the construction industry, often affected by safety and productivity. To address these problems, it is necessary for construction sites to automatically monitor the poses of excavator manipulators in real time. Based on computer vision (CV) technology, an approach, through a monocular camera and marker, was proposed to estimate the pose parameters (including orientation and position) of the excavator manipulator. To simulate the pose estimation process, a measurement system was established with a common camera and marker. Through comprehensive experiments and error analysis, this approach showed that the maximum detectable depth of the system is greater than 11 m, the orientation error is less than 8.5°, and the position error is less than 22 mm. A prototype of the system that proved the feasibility of the proposed method was tested. Furthermore, this study provides an alternative CV technology for monitoring construction machines.

In this paper, we propose a novel trajectory generation method for autonomous excavator teach-and-plan applications. Rather than controlling the excavator to precisely follow the teaching path, the proposed method transforms the arbitrary slow and jerky trajectory of human excavation into a topologically equivalent path that is guaranteed to be fast, smooth and dynamically feasible. This method optimizes trajectories in both time and jerk aspects. A spline is used to connect these waypoints, which are topologically equivalent to the human teaching path. Then the trajectory is reparametrized to obtain the minimum time-jerk trajectory with the kinodynamic constraints. The optimal time-jerk trajectory generation method is both formulated using nonlinear programming and conducted iteratively. The framework proposed in this paper was integrated into a complete autonomous excavation platform and was validated to achieve aggressive excavation in a field environment.