The vulnerability curve serves as a precise evaluation metric for structural seismic performance and a critical component in earthquake loss assessment. In this study, the orthogonal expansion method for random ground motion generation is integrated with the probability density evolution method (PDEM) to address the dynamic reliability and vulnerability of general Multi-Degree of Freedom (MDOF) nonlinear structures. By employing dynamic reliability as a constraint and vulnerability as an evaluation index, the guided firework algorithm (GFWA) is introduced to optimize the design of viscoelastic damper (VED) structure systems. To validate the proposed methods, several examples are presented, including the generation of artificial waves, the vulnerability analysis of a five-story reinforced concrete (RC) structure, and a comparative study of GFWA and genetic algorithm (GA) optimization for VED parameters to assess the optimization efficiency. The results demonstrate that the proposed vulnerability method achieves satisfactory accuracy and is well suited for evaluating damper structure optimization designs. Furthermore, GFWA outperforms GA significantly in terms of efficiency and feasibility, offering a promising approach for optimization design in architectural structures.