Radiomic model reliability is a central premise for its clinical translation. Presently, it is assessed using test–retest or external data, which, unfortunately, is often scarce in reality. Therefore, we aimed to develop a novel image perturbation-based method (IPBM) for the first of its kind toward building a reliable radiomic model. We first developed a radiomic prognostic model for head-and-neck cancer patients on a training (70%) and evaluated on a testing (30%) cohort using C-index. Subsequently, we applied the IPBM to CT images of both cohorts (Perturbed-Train and Perturbed-Test cohort) to generate 60 additional samples for both cohorts. Model reliability was assessed using intra-class correlation coefficient (ICC) to quantify consistency of the C-index among the 60 samples in the Perturbed-Train and Perturbed-Test cohorts. Besides, we re-trained the radiomic model using reliable RFs exclusively (ICC > 0.75) to validate the IPBM. Results showed moderate model reliability in Perturbed-Train (ICC: 0.565, 95%CI 0.518–0.615) and Perturbed-Test (ICC: 0.596, 95%CI 0.527–0.670) cohorts. An enhanced reliability of the re-trained model was observed in Perturbed-Train (ICC: 0.782, 95%CI 0.759–0.815) and Perturbed-Test (ICC: 0.825, 95%CI 0.782–0.867) cohorts, indicating validity of the IPBM. To conclude, we demonstrated capability of the IPBM toward building reliable radiomic models, providing community with a novel model reliability assessment strategy prior to prospective evaluation.

Background: Using high robust radiomic features in modeling is recommended, yet its impact on radiomic model is unclear. This study evaluated the radiomic model’s robustness and generalizability after screening out low-robust features before radiomic modeling. The results were validated with four datasets and two clinically relevant tasks.Materials and methods: A total of 1,419 head-and-neck cancer patients’ computed tomography images, gross tumor volume segmentation, and clinically relevant outcomes (distant metastasis and local-regional recurrence) were collected from four publicly available datasets. The perturbation method was implemented to simulate images, and the radiomic feature robustness was quantified using intra-class correlation of coefficient (ICC). Three radiomic models were built using all features (ICC > 0), good-robust features (ICC > 0.75), and excellent-robust features (ICC > 0.95), respectively. A filter-based feature selection and Ridge classification method were used to construct the radiomic models. Model performance was assessed with both robustness and generalizability. The robustness of the model was evaluated by the ICC, and the generalizability of the model was quantified by the train-test difference of Area Under the Receiver Operating Characteristic Curve (AUC).Results: The average model robustness ICC improved significantly from 0.65 to 0.78 (P< 0.0001) using good-robust features and to 0.91 (P< 0.0001) using excellent-robust features. Model generalizability also showed a substantial increase, as a closer gap between training and testing AUC was observed where the mean train-test AUC difference was reduced from 0.21 to 0.18 (P< 0.001) in good-robust features and to 0.12 (P< 0.0001) in excellent-robust features. Furthermore, good-robust features yielded the best average AUC in the unseen datasets of 0.58 (P< 0.001) over four datasets and clinical outcomes.Conclusions: Including robust only features in radiomic modeling significantly improves model robustness and generalizability in unseen datasets. Yet, the robustness of radiomic model has to be verified despite building with robust radiomic features, and tightly restricted feature robustness may prevent the optimal model performance in the unseen dataset as it may lower the discrimination power of the model.

Purpose: The inherent characteristics of lung tissue independent of breathing maneuvers may provide fundamental information for function assessment. This paper attempted to correlate textural signatures from computed tomography (CT) with pulmonary function measurements. Materials and Methods: Twenty-one lung cancer patients with thoracic 4-dimensional CT, DTPA-single-photon emission CT ventilation (V _NM) scans, and available spirometry measurements (forced expiratory volume in 1 s, FEV₁; forced vital capacity, FVC; and FEV₁/FVC) were collected. In subregional feature discovery, function-correlated candidates were identified from 79 radiomic features based on the statistical strength to differentiate defected/nondefected lung regions. Feature maps (FMs) of selected candidates were generated on 4-dimensional CT phases for a voxel-wise feature distribution study. Quantitative metrics were applied for validations, including the Spearman correlation coefficient (SCC) and the Dice similarity coefficient for FM-V _NM spatial agreement assessments, intraclass correlation coefficient for FM interphase robustness evaluations, and FM-spirometry comparisons. Results: At the subregion level, 8 function-correlated features were identified (effect size>0.330). The FMs of candidates yielded moderate-to-strong voxel-wise correlations with the reference V _NM. The FMs of gray level dependence matrix dependence nonuniformity showed the highest robust (intraclass correlation coefficient=0.96 and P<0.0001) spatial correlation, with median SCCs ranging from 0.54 to 0.59 throughout the 10 breathing phases. Its phase-averaged FM achieved a median SCC of 0.60, a median Dice similarity coefficient of 0.60 (0.65) for high (low) functional lung volumes, and a correlation of 0.565 (0.646) between the spatially averaged feature values and FEV₁ (FEV₁/FVC). Conclusions: The results provide further insight into the underlying association of specific pulmonary textures with both local (V _NM) and global (FEV₁/FVC, FEV₁) functions. Further validations of the FM generalizability and the standardization of implementation protocols are warranted before clinically relevant investigations.

This study aims to evaluate the repeatability of radiomics and dosiomics features via image perturbation of patients with cervical cancer. A total of 304 cervical cancer patients with planning CT images and dose maps were retrospectively included. Random translation, rotation, and contour randomization were applied to CT images and dose maps before radiomics feature extraction. The repeatability of radiomics and dosiomics features was assessed using intra-class correlation of coefficient (ICC). Pearson correlation coefficient (r) was adopted to quantify the correlation between the image characteristics and feature repeatability. In general, the repeatability of dosiomics features was lower compared with CT radiomics features, especially after small-sigma Laplacian-of-Gaussian (LoG) and wavelet filtering. More repeatable features (ICC > 0.9) were observed when extracted from the original, Large-sigma LoG filtered, and LLL-/LLH-wavelet filtered images. Positive correlations were found between image entropy and high-repeatable feature number in both CT and dose (r = 0.56, 0.68). Radiomics features showed higher repeatability compared to dosiomics features. These findings highlight the potential of radiomics features for robust quantitative imaging analysis in cervical cancer patients, while suggesting the need for further refinement of dosiomics approaches to enhance their repeatability.