A binary semantic segmentation of nuclei cells in hematoxylin and eosin (H&E)-stained histopathological images is a fundamental yet challenging task in computational pathology, primarily due to significant color variability. This study presents a comprehensive evaluation of the impact of various color spaces on the performance of a U-Net model for this binary segmentation task. It is systematically trained and assessed the model using images represented in red–green–blue (RGB); grayscale; hue–saturation–value (HSV); hue–lightness–saturation (HLS); lightness, green–red opponent, blue–yellow opponent (CIE lαβ); lightness, u*, v* (LUV); and luminance, red-difference chrominance, blue-difference chrominance (YCrCb) color spaces; coupled with different optimizers (stochastic gradient descent [SGD], Adam, AdamW, NAdam). A robust multicriteria decision-making (MCDM) framework, employing the D-CRITIC method, was utilized for model evaluation. Our results demonstrate that nonconventional color spaces, particularly HSV with the AdamW optimizer, yield superior segmentation accuracy, achieving a DICE coefficient of 0.844 and an Intersection over Union (IoU) of 0.731. Furthermore, driven by these findings, it is proposed that a preprocessing pipeline (Denoising Vanilla Autoencoder with Contrast Enhancement [DVACE] + SwinIR‑based Contrast Limited Adaptive Histogram Equalization [SCLA]) leverages color spaces such as HSV, HLS, LUV, CIE lαβ, or YCrCb to construct enhanced RGB images. For example, when evaluated on a U-Net model trained from scratch with the AdamW optimizer using the YCrCb color space as a base, this pipeline achieved a DICE coefficient of 0.821 and an IoU of 0.697, substantially outperforming the baseline model trained on original RGB images without preprocessing (DICE: 0.802, IoU: 0.671). The study confirms that deliberate color space selection and targeted preprocessing are critical for developing robust and accurate deep learning (DL) solutions in digital pathology (DG).