The purpose of this study is to evaluate the performance variations in commercial deformable image registration (DIR) tools for adaptive radiation therapy and further to interpret the differences using clinically available terms. Three clinical examples (prostate, head and neck (HN), and cranial spinal irradiation (CSI) with L‐spine boost) were evaluated in this study. Firstly, computerized deformed CT images were generated using simulation QA software with virtual deformations of bladder filling (prostate), neck flexion/bite‐block repositioning/tumor shrinkage (HN), and vertebral body rotation (CSI). The corresponding transformation matrices served as a “reference” for the following comparisons. Three commercialized DIR algorithms: the free‐form deformation from MIMVista 5.5 and the RegRefine from MIMMaestro 6.0, the multipass B‐spline from VelocityAI v3.0.1, and the adaptive demons from OnQ rts 2.1.15, were applied between the initial images and the deformed CT sets. The generated adaptive contours and dose distributions were compared with the “reference” and among each other. The performance in transferring contours was comparable among all three tools with an average Dice similarity coefficient of 0.81 for all the organs. However, the dose warping accuracy appeared to rely on the evaluation end points and methodologies. Point‐dose differences could show a difference of up to 23.3 Gy inside the PTVs and to overestimate up to 13.2 Gy for OARs, which was substantial for a 72 Gy prescription dose. Dosevolume histogram‐based evaluation might not be sensitive enough to illustrate all the detailed variations, while isodose assessment on a slice‐by‐slice basis could be tedious. We further explored the possibility of using 3D gamma index analysis for warping dose variation assessment, and observed differences in dose warping using different DIR tools. Overall, our results demonstrated that evaluation based only on the performance of contour transformation could not guarantee the accuracy in dose warping, while dose‐transferring validation strongly relied on the evaluation endpoint. As dose‐transferring errors could cause misinterpretations when attempting to accumulate dose for adaptive radiation therapy and more DIR tools are available for clinical use, a standard and clinically meaningful quality assurance criterion should be established for DIR QA in the near future.PACS number(s): 87.57
Purpose: This study was conducted in order to determine the reproducibility and repeatability of cone-beam computed tomography (CBCT) radiomics features.Methods: The first-, second-, and fifth-day CBCT images from 10 head and neck (H&N) cancer patients and 10 pelvic cancer patients were retrospectively collected for this study. Eighteen common radiomics features were extracted from the longitudinal CBCT images using two radiomics packages. The reproducibility of CBCT-derived radiomics features was assessed using the first-day image as input and compared across the two software packages. The site-specific intraclass correlation coefficient (ICC) was used to quantitatively assess the agreement between packages. The repeatability of CBCT-based radiomics features was evaluated by comparing the following days of CBCT to the first-day image and quantified using site-specific concordance correlation coefficient (CCC). Furthermore, the correlation with volume for all the features was assessed with linear regression and R2 as correlation parameters.Results: The first-order histogram-based features such as skewness and entropy showed good agreement computed in either software package (ICCs ≥ 0.80), while the kurtosis measurements were consistent in H&N patients between the two software tools but not in pelvic cases. The ICCs for GLCM-based features showed good agreement (ICCs ≥ 0.80) between packages in both H&N and pelvic groups except for the GLCM-correction. The GLRLM-based texture features were overall less consistent as calculated by the two different software packages compared with the GLCM-based features. The CCC values of all first-order and second-order GLCM features (except GLCM-energy) were all above 0.80 from the 2-day part test–retest set, while the CCC values all dropped below the cutoff after 5-day treatment scans. All first-order histogram-based and GLCM-texture-based features were not highly correlated with volume, while two GLRLM features, in both H&N and pelvic cohorts, showed R2 ≥0.8, meaning a high correlation with volume.Conclusion: The reproducibility and repeatability of CBCT-based radiomics features were assessed and compared for the first time on both H&N and pelvic sites. There were overlaps of stable features in both disease sites, yet the overall stability of radiomics features may be disease-/protocol-specific and a function of time between scans.