As the traditional methods for the recognition of air visibility level have the disadvantages of high cost, complicated operation, and the need to set markers, this paper proposes a novel method for the recognition of air visibility level based on an optimal binary tree support vector machine (SVM) using image processing techniques. Firstly, morphological processing is performed on the image. Then, whether the region of interest (ROI) is extracted is determined by the extracted feature values, that is, the contrast features and edge features are extracted in the ROI. After that, the transmittance features of red, green and blue channels (RGB) are extracted throughout the whole image. These feature values are used to construct the visibility level recognition model based on optimal binary tree SVM. The experiments are carried out to verify the proposed method. The experimental results show that the recognition accuracies of the proposed method for four levels of visibility, i.e., good air quality, mild pollution, moderate pollution, and heavy pollution, are 92.00%, 92%, 88.00%, and 100.00%, respectively, with an average recognition accuracy of 93.00%. The proposed method is compared with one-to-one SVM and one-to-many SVM in terms of training time and recognition accuracy. The experimental results show that the proposed method can distinguish four levels of visibility at a relatively satisfactory level, and it performs better than the other two methods in terms of training time and recognition accuracy. This proposed method provides an effective solution for the recognition of air visibility level.