Oil spill SAR images are characterized by high noise, low contrast, and irregular boundaries, which lead to the problems of overfitting and insufficient capturing of detailed features of the oil spill region in the current method when processing oil spill SAR images. An improved DeepLabV3+ model is proposed to address the above problems. First, the original backbone network Xception is replaced by the lightweight MobileNetV2, which significantly improves the generalization ability of the model while drastically reducing the number of model parameters and effectively addresses the overfitting problem. Further, the spatial and channel Squeeze and Excitation module (scSE) is introduced and the joint loss function of Bce + Dice is adopted to enhance the sensitivity of the model to the detailed parts of the oil spill area, which effectively solves the problem of insufficient capture of the detailed features of the oil spill area. The experimental results show that the mIOU and F1-score of the improved model in an oil spill region in the Gulf of Mexico reach 80.26% and 88.66%, respectively. In an oil spill region in the Persian Gulf, the mIOU and F1-score reach 81.34% and 89.62%, respectively, which are better than the metrics of the control model.