Accurately classifying colorectal polyps, or differentiating malignant from benign ones, has a significant clinical impact on early detection and identifying optimal treatment of colorectal cancer. Convolution neural network (CNN) has shown great potential in recognizing different objects (e.g. human faces) from multiple slice (or color) images, a task similar to the polyp differentiation, given a large learning database. This study explores the potential of CNN learning from multiple slice (or feature) images to differentiate malignant from benign polyps from a relatively small database with pathological ground truth, including 32 malignant and 31 benign polyps represented by volumetric computed tomographic (CT) images. The feature image in this investigation is the gray-level co-occurrence matrix (GLCM). For each volumetric polyp, there are 13 GLCMs, computed from each of the 13 directions through the polyp volume. For comparison purpose, the CNN learning is also applied to the multi-slice CT images of the volumetric polyps. The comparison study is further extended to include Random Forest (RF) classification of the Haralick texture features (derived from the GLCMs). From the relatively small database, this study achieved scores of 0.91/0.93 (two-fold/leave-one-out evaluations) AUC (area under curve of the receiver operating characteristics) by using the CNN on the GLCMs, while the RF reached 0.84/0.86 AUC on the Haralick features and the CNN rendered 0.79/0.80 AUC on the multiple-slice CT images. The presented CNN learning from the GLCMs can relieve the challenge associated with relatively small database, improve the classification performance over the CNN on the raw CT images and the RF on the Haralick features, and have the potential to perform the clinical task of differentiating malignant from benign polyps with pathological ground truth.

Markov random field (MRF) has been widely used to incorporate a priori knowledge as penalty or regularizer to preserve edge sharpness while smoothing the region enclosed by the edge for pieces-wise smooth image reconstruction. In our earlier study, we proposed a type of MRF reconstruction method for low-dose CT (LdCT) scans using tissue-specific textures extracted from the same patient’s previous full-dose CT (FdCT) scans as prior knowledge. It showed advantages in clinical applications. This paper aims to remove the constraint of using previous data of the same patient. We investigated the feasibility of extracting the tissue-specific MRF textures from an FdCT database to reconstruct a LdCT image of another patient. This feasibility study was carried out by experiments designed as follows. We constructed a tissue-specific MRF-texture database from 3990 FdCT scan slices of 133 patients who were scheduled for lung nodule biopsy. Each patient had one FdCT scan (120 kVp/100 mAs) and one LdCT scan (120 kVp/20 mAs) prior to biopsy procedure. When reconstructing the LdCT image of one patient among the 133 patients, we ranked the closeness of the MRF-textures from the other 132 patients saved in the database and used them as the a prior knowledge. Then, we evaluated the reconstructed image quality using Haralick texture measures. For any patient within our database, we found more than eighteen patients’ FdCT MRF texures can be used without noticeably changing the Haralick texture measures on the lung nodules (to be biopsied). These experimental outcomes indicate it is promising that a sizable FdCT texture database could be used to enhance Bayesian reconstructions of any incoming LdCT scans.

Photon-counting spectral computed tomography (CT) is capable of material characterization and can improve diagnostic performance over traditional clinical CT. However, it suffers from photon count starving for each individual energy channel which may cause severe artifacts in the reconstructed images. Furthermore, since the images in different energy channels describe the same object, there are high correlations among different channels. To make full use of the inter-channel correlations and minimize the count starving effect while maintaining clinically meaningful texture information, this paper combines a region-specific texture model with a low-rank correlation descriptor as an a priori regularization to explore a superior texture preserving Bayesian reconstruction of spectral CT. Specifically, the inter-channel correlations are characterized by the low-rank representation, and the inner-channel regional textures are modeled by a texture preserving Markov random field. In other words, this paper integrates the spectral and spatial information into a unified Bayesian reconstruction framework. The widely-used Split-Bregman algorithm is employed to minimize the objective function because of the non-differentiable property of the low-rank representation. To evaluate the tissue texture preserving performance of the proposed method for each channel, three references are built for comparison: one is the traditional CT image from energy integration detection. The second one is spectral images from dual-energy CT. The third one is individual channels images from custom-made photon-counting spectral CT. As expected, the proposed method produced promising results in terms of not only preserving texture features but also suppressing image noise in each channel, comparing to existing methods of total variation (TV), low-rank TV and tensor dictionary learning, by both visual inspection and quantitative indexes of root mean square error, peak signal to noise ratio, structural similarity and feature similarity.

Photon-counting computed tomography (PCCT) reconstructs multiple energy-channel images to describe the same object, where there exists a strong correlation among different channel images. In addition, reconstruction of each channel image suffers photon count starving problem. To make full use of the correlation among different channel images to suppress the data noise and enhance the texture details in reconstructing each channel image, this paper proposes a tensor neural network (TNN) architecture to learn a multi-channel texture prior for PCCT reconstruction. Specifically, we first learn a spatial texture prior in each individual channel image by modeling the relationship between the center pixels and its corresponding neighbor pixels using a neural network. Then, we merge the single channel spatial texture prior into multi-channel neural network to learn the spectral local correlation information among different channel images. Since our proposed TNN is trained on a series of unpaired small spatial-spectral cubes which are extracted from one single reference multi-channel image, the local correlation in the spatial-spectral cubes is considered by TNN. To boost the TNN performance, a low-rank representation is also employed to consider the global correlation among different channel images. Finally, we integrate the learned TNN and the low-rank representation as priors into Bayesian reconstruction framework. To evaluate the performance of the proposed method, four references are considered. One is simulated images from ultra-high-resolution CT. One is spectral images from dual-energy CT. The other two are animal tissue and preclinical mouse images from a custom-made PCCT systems. Our TNN prior Bayesian reconstruction demonstrated better performance than other state-of-the-art competing algorithms, in terms of not only preserving texture feature but also suppressing image noise in each channel image.

Objective: As an effective lesion heterogeneity depiction, texture information extracted from computed tomography has become increasingly important in polyp classification. However, variation and redundancy among multiple texture descriptors render a challenging task of integrating them into a general characterization. Considering these two problems, this work proposes an adaptive learning model to integrate multi-scale texture features. Methods: To mitigate feature variation, the whole feature set is geometrically split into several independent subsets that are ranked by a learning evaluation measure after preliminary classifications. To reduce feature redundancy, a bottom-up hierarchical learning framework is proposed to ensure monotonic increase of classification performance while integrating these ranked sets selectively. Two types of classifiers, traditional (random forest + support vector machine)- and convolutional neural network (CNN)-based, are employed to perform the polyp classification under the proposed framework with extended Haralick measures and gray-level co-occurrence matrix (GLCM) as inputs, respectively. Experimental results are based on a retrospective dataset of 63 polyp masses (defined as greater than 3 cm in largest diameter), including 32 adenocarcinomas and 31 benign adenomas, from adult patients undergoing first-time computed tomography colonography and who had corresponding histopathology of the detected masses. Results: We evaluate the performance of the proposed models by the area under the curve (AUC) of the receiver operating characteristic curve. The proposed models show encouraging performances of an AUC score of 0.925 with the traditional classification method and an AUC score of 0.902 with CNN. The proposed adaptive learning framework significantly outperforms nine well-established classification methods, including six traditional methods and three deep learning ones with a large margin. Conclusions: The proposed adaptive learning model can combat the challenges of feature variation through a multiscale grouping of feature inputs, and the feature redundancy through a hierarchal sorting of these feature groups. The improved classification performance against comparative models demonstrated the feasibility and utility of this adaptive learning procedure for feature integration.

Localizing and characterizing clinically significant lung nodules, a potential precursor to lung cancer, at the lowest achievable radiation dose is demanded to minimize the stochastic radiation effects from X-ray computed tomography (CT). A minimal dose level is heavily dependent on the image reconstruction algorithms and clinical task, in which the tissue texture always plays an important role. This article aims to investigate the dependence through a task-based evaluation at multiple dose levels and variable textures in reconstructions with prospective patient studies. One hundred and thirty three patients with a suspicious pulmonary nodule scheduled for biopsy were recruited and the data was acquired at 120 kVp with three different dose levels of 100, 40, and 20 mAs. Three reconstruction algorithms were implemented: 1) analytical filtered back-projection (FBP) with optimal noise filtering; 2) statistical Markov random field (MRF) model with optimal Huber weighting (MRF-H) for piecewise smooth reconstruction; and 3) tissue-specific texture model (MRF-T) for texture preserved statistical reconstruction. Experienced thoracic radiologists reviewed and scored all images at random, blind to the CT dose and reconstruction algorithms. The radiologists identified the nodules in each image, including the 133 biopsy target nodules and 66 other nontarget nodules. For target nodule characterization, only MRF-T at 40 mAs showed no statistically significant difference from FBP at 100 mAs. For localizing both the target nodules and the nontarget nodules, some as small as 3 mm, MRF-T at 40 and 20 mAs levels showed no statistically significant difference from FBP at 100 mAs, respectively. MRF-H and FBP at 40 and 20 mAs levels performed statistically differently from FBP at 100 mAs. This investigation concluded that: 1) the textures in the MRF-T reconstructions improves both the tasks of localizing and characterizing nodules at low-dose CT and 2) the task of characterizing nodules is more challenging than the task of localizing nodules and needs more dose or enhanced textures from the reconstruction.