The present study delved into the effect of impactor diameter on low velocity impact response and damage characteristics of CFRP. Moreover, the phased array ultrasonic technique (PAUT) was adopted to identify the impact damages based on double-sided scanning. Low-velocity impact tests were carried out using three hemispherical impactors with different diameters. The relationship of impact response and impactor diameters was analyzed by ultrasonic C-scans and S-scans, combined with impact response parameters. Subsequently, the damage characteristics were assessed in terms of dent depth, delamination area and extension shape via the thickness, and the relationships between absorbed energy, impactor displacement, dent depth and delamination area were elucidated. As revealed from experiment results, double-sided PAUT is capable of representing the internal damage characteristics more accurately. Moreover, the impactor diameter slightly affects the impact response under small impact energy, whereas it significantly affects the impact response under large impact energy.