Highly branched poly(β-amino ester) (HPAE) has become one of the most promising non-viral gene delivery vector candidates. When compared to other gene delivery vectors, HPAE has a broad molecular weight distribution (MWD). Despite significant efforts to optimize HPAE targeting enhanced gene delivery, the effect of different molecular weight (MW) components on transfection has rarely been studied. In this work, a new structural optimization strategy was proposed targeting enhanced HPAE gene transfection. A series of HPAE with different MW components was obtained through a stepwise precipitation approach and applied to plasmid DNA delivery. It was demonstrated that the removal of small MW components from the original HPAE structure could significantly enhance its transfection performance (e.g., GFP expression increased 7 folds at w/w of 10/1). The universality of this strategy was proven by extending it to varying HPAE systems with different MWs and different branching degrees, where the transfection performance exhibited an even magnitude enhancement after removing small MW portions. This work opened a new avenue for developing high-efficiency HPAE gene delivery vectors and provided new insights into the understanding of the HPAE structure–property relationship, which would facilitate the translation of HPAEs in gene therapy clinical applications.