Aiming at the problem that traditional design methods make it difficult to control the polarization aberration distribution of optical systems quickly and accurately, this study proposes an automatic optimization design method for polarization optical systems based on deep learning. The unsupervised training model based on ray tracing and polarized ray tracing was constructed by learning the reference lens structural feature data from the optical lens library, and the generalization ability of the deep neural network model was improved to achieve the automatic optimization design of the polarized optical system. The design results show that the optical system structure optimized by the network model is close to the reference lens in the full field of view and the full spectrum and that the optical system structure can be designed for different focal length requirements. The success rate of 1 million groups of initial structures designed is better than 96.403%, and the polarization effect of the optical system is effectively controlled. The proposed deep learning approach to optical design provides a new solution for future complex optical systems and also provides an effective way to improve the design accuracy of special optical systems such as polarization optical systems.