This paper describes an approach to be used for medical image segmentation evaluation. The process for segmenting organs and structures from medical images is gaining increased importance in the diagnosis of diseases and in guiding minimally invasive surgical and therapeutic procedures. While investigators are continuing to develop novel new segmentation approaches, little attention has been given to the development of a uniform and common framework for and performance metrics to be used in comparing different algorithms, in optimizing algorithms and in evaluating their performance. Choosing an appropriate effectiveness measure of object segmentation is a difficult task and weighting the importance of different possible performance metrics requires matching the metrics to the segmentation objectives. However, in all tasks, it is now believed that three types of metrics must be measured and reported: accuracy, precision and efficiency. In this paper, we review some of these metrics

Atherosclerotic plaques are focal and tend to occur at arterial bends and bifurcations. To quantitatively monitor the local changes in the carotid vessel-wall-plus-plaque thickness (VWT) and compare the VWT distributions for different patients or for the same patients at different ultrasound scanning sessions, a mapping technique is required to adjust for the geometric variability of different carotid artery models. In this work, we propose a novel method called density-equalizing reference map (DERM) for mapping 3D carotid surfaces to a standardized 2D carotid template, with an emphasis on preserving the local geometry of the carotid surface by minimizing the local area distortion. The initial map was generated by a previously described arc-length scaling (ALS) mapping method, which projects a 3D carotid surface onto a 2D non-convex L-shaped domain. A smooth and area-preserving flattened map was subsequently constructed by deforming the ALS map using the proposed algorithm that combines the density-equalizing map and the reference map techniques. This combination allows, for the first time, one-to-one mapping from a 3D surface to a standardized non-convex planar domain in an area-preserving manner. Evaluations using 20 carotid surface models show that the proposed method reduced the area distortion of the flattening maps by over 80% as compared to the ALS mapping method. The proposed method is capable of improving the accuracy of area estimation for plaque regions without compromising inter-scan reproducibility.