The eye is one of our five sense organs, where optical and neural structures are integrated. It works in synchrony with the brain, enabling the formation of meaningful images. However, lack of function, complete absence or structural abnormalities of cone cells in the cone cells in the retina causes the emergence of types of Color Vision Deficiency (CVD). This deficiency is characterized by the lack of clear vision in the use of colors in the same region of the spectrum, and greatly affects the quality of life of the patient. Therefore, it is important to develop filters that enable colors to be combined successfully. In this study, an original filter design was improved, built on a five-stage systematic structure that complements and supports itself. But optimization regarding performance value needs to be tested with objective methods independent of human decision. Therefore, in order to provide performance analyses based on objective evaluation criteria, original and enhanced images simulated by patients with seven different Color Vision Deficiency (CVD) types were classified with the MobileNet transfer learning model. The classification results show that the developed final filter greatly improves the differences in color perception levels in both eyes. Thus, color stimulation between the two eyes is more balanced, and perceptual symmetry is created. With perceptual symmetry, environmental colors are perceived more consistently and distinguishably, and the visual difficulties encountered by color blind individuals in daily life are reduced.