Colorectal cancer (CRC) is the third most common type of cancer with the liver being the most common site for cancer spread. A precise understanding of patient liver anatomy and pathology, as well as surgical planning based on that, plays a critical role in the treatment process. In some cases, surgeons request a 3D reconstruction, which requires a thorough analysis of the available images to be converted into 3D models of relevant objects through a segmentation process. Liver vessel segmentation is challenging due to the large variations in size and directions of the vessel structures as well as difficult contrasting conditions. In recent years, deep learning-based methods had been outperforming the conventional image analysis methods in the field of medical imaging. Though Convolutional Neural Networks (CNN) have been proved to be efficient for the task of medical image segmentation, the way of handling the image data and the preprocessing techniques play an important role in segmentation. Our work focuses on the combination of different vesselness enhancement filters and preprocessing methods to enhance the hepatic vessels prior to segmentation. In the first experiment, the effect of enhancement using individual vesselness filters was studied. In the second experiment, the effect of gamma correction on vesselness filters was studied. Lastly, the effect of fused vesselness filters over individual filters was studied. The methods were evaluated on clinical CT data. The quantitative analysis of the results in terms of different evaluation metrics from experiments can be summed up as (i) each of the filtered methods shows an improvement as compared to unenhanced with the best mean DICE score of 0.800 in comparison to 0.740 for unenhanced; (ii) applied gamma correction provides a statistically significant improvement in the performance of each filter with improvement in mean DICE of around 2%; (iii) both the fused filtered images and fused segmentation give the best results (mean DICE score of 0.818 and 0.830, respectively) with the statistically significant improvement compared to the individual filters with and without Gamma correction. The results have further been verified by qualitative analysis and hence show the importance of our proposed fused filter and segmentation approaches.
Medical image segmentation has gained greater attention over the past decade, especially in the field of image-guided surgery. Here, robust, accurate and fast segmentation tools are important for planning and navigation. In this work, we explore the Convolutional Neural Network (CNN) based approaches for multi-dataset segmentation from CT examinations. We hypothesize that selection of certain parameters in the network architecture design critically influence the segmentation results. We have employed two different CNN architectures, 3D-UNet and VGG-16, given that both networks are well accepted in the medical domain for segmentation tasks. In order to understand the efficiency of different parameter choices, we have adopted two different approaches. The first one combines different weight initialization schemes with different activation functions, whereas the second approach combines different weight initialization methods with a set of loss functions and optimizers. For evaluation, the 3D-UNet was trained with the Medical Segmentation Decathlon dataset and VGG-16 using LiTS data. The quality assessment done using eight quantitative metrics enhances the probability of using our proposed strategies for enhancing the segmentation results. Following a systematic approach in the evaluation of the results, we propose a few strategies that can be adopted for obtaining good segmentation results. Both of the architectures used in this work were selected on the basis of general acceptance in segmentation tasks for medical images based on their promising results compared to other state-of-the art networks. The highest Dice score obtained in 3D-UNet for the liver, pancreas and cardiac data was 0.897, 0.691 and 0.892. In the case of VGG-16, it was solely developed to work with liver data and delivered a Dice score of 0.921. From all the experiments conducted, we observed that two of the combinations with Xavier weight initialization (also known as Glorot), Adam optimiser, Cross Entropy loss () and LeCun weight initialization, cross entropy loss and Adam optimiser worked best for most of the metrics in a 3D-UNet setting, while Xavier together with cross entropy loss and Tanh activation function () worked best for the VGG-16 network. Here, the parameter combinations are proposed on the basis of their contributions in obtaining optimal outcomes in segmentation evaluations. Moreover, we discuss that the preliminary evaluation results show that these parameters could later on be used for gaining more insights into model convergence and optimal solutions.The results from the quality assessment metrics and the statistical analysis validate our conclusions and we propose that the presented work can be used as a guide in choosing parameters for the best possible segmentation results for future works.
Laparoscopic videos can be affected by different distortions which may impact the performance of surgery and introduce surgical errors. In this work, we propose a framework for automatically detecting and identifying such distortions and their severity using video quality assessment. There are three major contributions presented in this work (i) a proposal for a novel video enhancement framework for laparoscopic surgery; (ii) a publicly available database for quality assessment of laparoscopic videos evaluated by expert as well as non-expert observers and (iii) objective video quality assessment of laparoscopic videos including their correlations with expert and non-expert scores.
Video quality assessment is a challenging problem having a critical significance in the context of medical imaging. For instance, in laparoscopic surgery, the acquired video data suffers from different kinds of distortion that not only hinder surgery performance but also affect the execution of subsequent tasks in surgical navigation and robotic surgeries. For this reason, we propose in this paper neural network-based approaches for distortion classification as well as quality prediction. More precisely, a Residual Network (ResNet) based approach is firstly developed for simultaneous ranking and classification task. Then, this architecture is extended to make it appropriate for the quality prediction task by using an additional Fully Connected Neural Network (FCNN). To train the overall architecture (ResNet and FCNN models), transfer learning and end-to-end learning approaches are investigated. Experimental results, carried out on a new laparoscopic video quality database, have shown the efficiency of the proposed methods compared to recent conventional and deep learning based approaches.