High-strength dissimilar aluminum alloys are difficult to connect by fusion welding, while they can be successfully joined by friction stir welding (FSW). However, the asymmetrical deformation and heat input that occur during FSW result in the formation of a heterogeneous microstructure in their welded zone. In this work, the grain structure and texture evolution in the bottom zones of dissimilar FSW AA2024-T351 and AA7075-T651 joints at different welding speeds (feeding speeds) were quantitatively investigated. The results indicated that dynamic recrystallization occurs in the bottom zones of dissimilar FSW joints, and equiaxed grains with low grain sizes are formed at the welding speed of 60–240 mm/min. A high fraction of the recrystallized grains were generated in the bottom zones of the joints at a low welding speed, while a high fraction of the substructured grains are produced at a high welding speed. Different types of shear textures are produced in the bottom zones of the joints; the number fraction of shear texture types depends on different welding speeds. This study helps to understand the mechanism of microstructure homogenization in dissimilar FSW joints and provides a basis for further improving the microstructure of the welded zone for engineering applications.