Lithium-ion battery charging involves many factors such as electricity, heat, aging, etc. Shortening the charging time of lithium-ion batteries while limiting aging and temperature rise is an urgent issue that needs to be addressed. In order to solve this problem, the pseudo-two-dimensions (P2D) model is used to describe the electrical behavior of batteries. Then, a parameter identification method is proposed using a deep deterministic policy gradient for P2D model. Besides, a multi-objective charging model considering time, health loss, and temperature rise is constructed by combining P2D, equivalent heat, and aging mechanism models. A multi- objective charging optimization strategy is proposed using Deep Q-Network algorithm. Under the condition of strong coupling of multiple parameters in the P2D model, the identification accuracy is improved by more than 20% compared to traditional optimization algorithms. Under fast charging conditions, the charging time decreases by 19%, and the health loss only increased by 2.5%. Finally, the impact of multi-stage current variance on battery health loss is discussed.