In this paper, two iterative learning control methods are proposed for the different high-order systems with arbitrary initial shifts. The tracking errors caused by nonzero initial shifts are easily detected when applying conventional learning algorithms. But this defect is overcome through applying a step-bystep rectifying controller with initial initial rectifying action introduced in a small interval. It demonstrates the improvement of tracking performance and shows the robustness with respect to the stochastic initial shifts. Finally, simulation results are presented to illustrate the effectiveness of the stated algorithms.