Applications of a metallic material highly depend on its mechanical properties, which greatly depend on the material’s grain sizes. Reducing grain sizes by severe plastic deformation is one of the efficient approaches to enhance the mechanical properties of a metallic material. In this paper, severe plastic deformation of equal channel angular pressing (ECAP) will be reviewed to illustrate its effects on the grain refinement of some common metallic materials such as titanium alloys, aluminum alloys, and magnesium alloys. In the ECAP process, the materials can be processed severely and repeatedly in a designed ECAP mold to accumulate a large amount of plastic strain. Ultrafine grains with diameters of submicron meters or even nanometers can be achieved through severe plastic deformation of the ECAP. In detail, this paper will give state-of-the-art details about the influences of ECAP processing parameters such as passes, temperature, and routes on the evolution of the microstructure of metallic materials. The evolution of grain sizes, grain boundaries, and phases of different metallic materials during the ECAP process are also analyzed. Besides, the plastic deformation mechanism during the ECAP process is discussed from the perspectives of dislocation slipping and twinning.