1 January 2023 in International Journal of Intelligent Systems
Data‐hunger is a persistent challenge in machine learning, particularly in the field of image processing based on convolutional neural networks (CNNs). This study systematically investigates the factors contributing to data‐hunger in machine‐learning‐based image‐processing algorithms. The results revealed that the proliferation of model parameters, the lack of interpretability, and the complexity of model structure are significant factors influencing data‐hunger. Based on these findings, this paper introduces a novel semi‐white‐box neural network model construction strategy. This approach effectively reduces the number of model parameters while enhancing the interpretability of model components. It accomplishes this by constraining uninterpretable processes within the model and leveraging prior knowledge of image processing for model. Rather than relying on a single all‐in‐one model, a semi‐white‐box model is composed of multiple smaller models, each responsible for extracting fundamental semantic features. The final output is derived from these features and prior knowledge. The proposed strategy holds the potential to substantially decrease data requirements under specific data source conditions while improving the interpretability of model components. Validation experiments are conducted on well‐established datasets, including MNIST, Fashion MNIST, CIFAR, and generated data. The results demonstrate the superiority of the semi‐white‐box strategy over the traditional all‐in‐one approach in terms of accuracy when trained with equivalent data volumes. Impressively, on the tested datasets, a simplified semi‐white‐box model achieves performance close to that of ResNet while utilizing a small number of parameters. Furthermore, the semi‐white‐box strategy offers improved interpretability and parameter reusability features that are challenging to achieve with the all‐in‐one approach. In conclusion, this paper contributes to mitigating data‐hunger challenges in machine‐learning‐based image processing through the introduction of a novel semi‐white‐box model construction strategy, backed by empirical evidence of its effectiveness.
21 May 2024 in IET Image Processing
Doctors typically use non‐contrast‐enhanced computed tomography (NCECT) in the treatment of kidney cancer to map kidney and tumour structural information to functional imaging single‐photon emission computed tomography, which is then used to assess patient kidney function and predict postoperative recovery. However, the assessment of kidney function and formulation of surgical plans is constrained by the low contrast of tumours in NCECT, which hinders the acquisition of accurate tumour boundaries. Therefore, this study designed a radiomics feature‐enhanced level‐set evolution (RFLSE) to precisely segment small‐sample low‐contrast kidney tumours. Integration of high‐dimensional radiomics features into the level‐set energy function enhances the edge detection capability of low‐contrast kidney tumours. The use of sensitive radiomics features to control the regional term parameters achieves adaptive adjustment of the curve evolution amplitude, improving the level‐set segmentation process. The experimental data used low‐contrast, limited‐sample tumours provided by hospitals, as well as the public datasets BUSI18 and KiTS19. Comparative results with advanced energy functionals and deep learning models demonstrate the precision and robustness of RFLSE segmentation. Additionally, the application value of RFLSE in assisting doctors with accurately marking tumours and generating high‐quality pseudo‐labels for deep learning datasets is demonstrated.
1 March 2024 in Journal of Electronic Imaging
In capturing images, cameras often encounter color-cast problems owing to variations in the illumination of different scenes. Existing algorithms attempt to estimate the illuminant information from the raw image data captured by a camera sensor to address color-casting problems. However, these algorithms tend to overlook the potential interference of scene brightness information present in the raw data. Therefore, we introduce a novel illuminant estimation architecture, Retinex color constancy generative adversarial network (ReCC-GAN). ReCC-GAN aims to mitigate the impact of scene brightness information on illuminant estimation tasks, enhance global illuminant estimation accuracy, and resolve color-cast problems. The ReCC-GAN architecture initially separates the reflectance component from the raw data using the Retinex module, reducing the interference caused by the scene brightness information. Subsequently, a specially designed GAN for illuminant estimation was employed to estimate the illuminant vector from this component more effectively. This approach improved illumination estimation accuracy. Experimental results on the Cube++ and NUS-8 dataset demonstrated that the proposed algorithm achieves competitive results compared with other solutions, with outstanding performance on the worst 25% metric. Additionally, tests on various datasets confirmed that the ReCC-GAN exhibited strong generalization performance, further validating its effectiveness and rationality in scene-wide illuminant estimation tasks.
25 August 2026 in Pattern Recognition