4 April 2018 in IEEE/ACM Transactions on Computational Biology and Bioinformatics
The emergence of deep learning has impacted numerous machine learning based applications and research. The reason for its success lies in two main advantages: 1) it provides the ability to learn very complex non-linear relationships between features and 2) it allows one to leverage information from unlabeled data that does not belong to the problem being handled. This paper presents a transfer learning procedure for cancer classification, which uses feature selection and normalization techniques in conjunction with stacked sparse auto-encoders on gene expression data. While classifying any two tumor types, data of other tumor types were used in unsupervised manner to improve the feature representation. The performance of our algorithm was tested on 36 two-class benchmark datasets from the GEMLeR repository. On performing statistical tests, it is clearly ascertained that our algorithm statistically outperforms several generally used cancer classification approaches. The deep learning based molecular disease classification can be used to guide decisions made on the diagnosis and treatment of diseases, and therefore may have important applications in precision medicine.
12 February 2018 in IEEE Transactions on Fuzzy Systems
This paper proposes a novel adaptive Type-2 fuzzy filter for removing salt and pepper noise from the images. The filter removes noise in two steps. In the first step, the pixels are categorized as good or bad based on their primary membership function (MF) values in the respective filter window. In this paper, two approaches have been proposed for finding threshold between good or bad pixels by designing primary MFs. a) MFs with distinct Means and same Variance and b) MFs with distinct Means and distinct Variances. The primary MFs of the Type-2 fuzzy set is chosen as Gaussian membership functions (GMFs). Whereas, in the second step, the pixels categorized as bad are denoised. For denoising, a novel Type-1 fuzzy approach based on a weighted mean of good pixels is presented in the paper. The proposed filter is validated for several standard images with the noise level as low as 20% to as high as 99%. The results show that the proposed filter performs better in terms of peak signal-noise-ratio (PSNR) values compared to other state-of-the-art algorithms.
9 July 2019 in IEEE Sensors Journal
Several data-driven methods such as signal processing and machine learning exist separately to analyze non-linear and non-stationary data but their performance degrades due to insufficient information in the real-time application. In order to improve the performance, this paper proposes a novel feature extraction method using fusion of hand-crafted (low-level) features and high-level features, followed by feature extraction/selection on fused features. Local energy based hand-crafted features have been derived from Empirical Mode Decomposition, and high-level features have been extracted from the deep neural network. A method is also proposed for reduction of massive data points in the samples. The proposed scheme has studied the effect of variation in the number of extracted/selected features. The effectiveness of the proposed scheme is validated through three case studies: a) on acoustic dataset collected from the reciprocating type air compressor, b) on vibration dataset collected from deep groove ball bearing, and c) on steel plate faults dataset. The classification accuracy on acoustic dataset are obtained as high as 100.0 %, 99.78 %, and 99.78 % using the random forest, linear support vector machine, and radial basis function support vector machine respectively with 5-fold cross-validation. Similarly, on vibration dataset obtained accuracies are 100.0 %. The proposed scheme has been compared with ten conventional methods on 5-fold cross-validation. These experimental results show considerable improvement in the prediction performance of machine conditions using the proposed scheme.
16 October 2020 in IEEE Transactions on Automation Science and Engineering
Traditional machine learning methods assume that training and testing data must be from the same machine running condition (MRC) and drawn from the same distribution. However, in several real-time industrial applications, this assumption does not hold. The traditional methods work satisfactorily in steady-state conditions but fail in time-varying conditions. In order to utilize time-varying data in variable MRCs, this article proposes a novel low-level knowledge transfer framework using a deep neural network (DNN) model for condition monitoring of machines in variable running conditions. The low-level features have been extracted in time, frequency, and time-frequency domains. These features are extracted from the source data to train the DNN. The trained DNN-based parameters are then transferred to another DNN, which is modified according to the low-level features extracted from the target data. The proposed approach is validated through three case studies on: 1) the air compressor acoustic data set; 2) the Case Western Reserve University bearing data set; and 3) the intelligent maintenance system bearing data set. The prediction accuracy obtained for the above case studies is as high as 100%, 93.07%, and 100%, respectively, with fivefold cross-validation. These real-time results show considerable improvement in the prediction performance using the proposed approach.
4 September 2020 in IEEE Sensors Journal
In recent years, intelligent condition-based monitoring of rotary machinery systems has become a major research focus of machine fault diagnosis. In condition-based monitoring, it is challenging to form a large-scale well-annotated dataset due to the expense of data acquisition and costly annotation. The generated data have a large number of redundant features which degraded the performance of the machine learning models. To overcome this, we have utilized the advantages of minimum redundancy maximum relevance (mRMR) and transfer learning with a deep learning model. In this work, mRMR is combined with deep learning and deep transfer learning framework to improve the fault diagnostics performance in terms of accuracy and computational complexity. The mRMR reduces the redundant information from data and increases the deep learning performance, whereas transfer learning, reduces a large amount of data dependency for training the model. In the proposed work, two frameworks, i.e., mRMR with deep learning and mRMR with deep transfer learning, have explored and validated on CWRU and IMS rolling element bearings datasets. The analysis shows that the proposed frameworks can obtain better diagnostic accuracy compared to existing methods and can handle the data with a large number of features more quickly.
20 May 2019 in IEEE Transactions on Nanobioscience
Machine learning is becoming a powerful tool for cancer diagnosis and prognosis based on classification using high dimensional molecular data. However, extracting classification features from high-dimensional datasets remains a challenging problem. Principal component analysis (PCA) is a widely used method for dimensionality reduction. However, it is well-known that PCA and most PCA-based feature extraction methods are sensitive to noise, which may affect the accuracy of the subsequent classification. To address this problem, here we proposed a robust fuzzy principal component analysis (PCA) with interval type-2 (IT-2) fuzzy membership functions for feature extraction. We tested the performance of three widely used classifiers using the features extracted by proposed approaches and other feature extraction methods -PCA-based feature extraction methods (i.e. conventional PCA and fuzzy PCA), linear discriminant analysis (LDA), support vector machine recursive feature elimination (SVM-RFE). The proposed feature extraction approaches showed better performance on cancer transcriptome and proteome datasets.