Skin cancer, particularly melanoma, has been recognized as one of the most lethal forms of cancer. Detecting and diagnosing skin lesions accurately can be challenging due to the striking similarities between the various types of skin lesions, such as melanoma and nevi, especially when examining the color images of the skin. However, early diagnosis plays a crucial role in saving lives and reducing the burden on medical resources. Consequently, the development of a robust autonomous system for skin cancer classification becomes imperative. Convolutional neural networks (CNNs) have been widely employed over the past decade to automate cancer diagnosis. Nonetheless, the emergence of the Vision Transformer (ViT) has recently gained a considerable level of popularity in the field and has emerged as a competitive alternative to CNNs. In light of this, the present study proposed an alternative method based on the off-the-shelf ViT for identifying various skin cancer diseases. To evaluate its performance, the proposed method was compared with 11 CNN-based transfer learning methods that have been known to outperform other deep learning techniques that are currently in use. Furthermore, this study addresses the issue of class imbalance within the dataset, a common challenge in skin cancer classification. In addressing this concern, the proposed study leverages the vision transformer and the CNN-based transfer learning models to classify seven distinct types of skin cancers. Through our investigation, we have found that the employment of pre-trained vision transformers achieved an impressive accuracy of 92.14%, surpassing CNN-based transfer learning models across several evaluation metrics for skin cancer diagnosis.
In response to the rapid advancements in facial manipulation technologies, particularly facilitated by Generative Adversarial Networks (GANs) and Stable Diffusion-based methods, this paper explores the critical issue of deepfake content creation. The increasing accessibility of these tools necessitates robust detection methods to curb potential misuse. In this context, this paper investigates the potential of Vision Transformers (ViTs) for effective deepfake image detection, leveraging their capacity to extract global features. Objective: The primary goal of this study is to assess the viability of ViTs in detecting multiclass deepfake images compared to traditional Convolutional Neural Network (CNN)-based models. By framing the deepfake problem as a multiclass task, this research introduces a novel approach, considering the challenges posed by Stable Diffusion and StyleGAN2. The objective is to enhance understanding and efficacy in detecting manipulated content within a multiclass context. Novelty: This research distinguishes itself by approaching the deepfake detection problem as a multiclass task, introducing new challenges associated with Stable Diffusion and StyleGAN2. The study pioneers the exploration of ViTs in this domain, emphasizing their potential to extract global features for enhanced detection accuracy. The novelty lies in addressing the evolving landscape of deepfake creation and manipulation. Results and Conclusion: Through extensive experiments, the proposed method exhibits high effectiveness, achieving impressive detection accuracy, precision, and recall, and an F1 rate of 99.90% on a multiclass-prepared dataset. The results underscore the significant potential of ViTs in contributing to a more secure digital landscape by robustly addressing the challenges posed by deepfake content, particularly in the presence of Stable Diffusion and StyleGAN2. The proposed model outperformed when compared with state-of-the-art CNN-based models, i.e., ResNet-50 and VGG-16.
In this modern age of technology, the Internet of things has covered all aspects of life including smart situations, smart homes, and smart spaces. Smart homes have a large number of IoT objects that are working continuously without any interruption. Better security and authentication of these smart devices can provide peaceful environments to live in such spaces. It is important to monitor the activities of smart IoT devices to make them work fault free. Such devices are small, consume relatively less power and resources, and are easily attackable by attackers. It is crucial to protect the integrity and characteristics of the smart home environment from external attacks. Machine Learning played a vital role in recognizing such malicious activities and attempts. Several Machine Learning approaches are available to detect the normal and abnormal behavior of IoT device traffic. This study proposed a machine learning-based anomaly detection approach for smart homes using different classifiers. Testing and evaluation are performed using the University of New South Wales (UNSW) BoT IoT dataset. Machine learning models based on four classifiers are built using an IoT devices dataset. For the Test dataset, the Weighted Precision, Recall and F1 score of Random forest, decision tree, and AdaBoost is 1 as compared to ANN which has 0.98, 0.96, and 0.96 respectively Results show that high performance, precision, and robustness can be achieved using the proposed methodology. In this way, smart homes’ security and identity of devices can be monitored and anomalies can be detected with high accuracy. Attack categories include binary class, multiclass class, and subclasses. Results show Random Forest algorithm outperforms enough to use this methodology in smart environments.
Recommendation services become a critical and hot research topic for researchers. A recommendation agent that automatically suggests products to users according to their tastes or preferences instead of wandering in a huge corpus for a product. Social data such as Reviews play an important role in the recommendation of products. Improvement was achieved by neural network methods for capturing user and product information from a short text. However, such approaches do not fairly and efficiently incorporate users’ preferences and product characteristics. We are proposing the novel Hybrid Neural Collaborative Filtering (HNCF) model that combines deep learning capabilities and deep interaction modelling for recommender systems with a rating matrix. To overcome the cold start problem, we use the new overall rating by aggregating the multivariate rating MR (votes, likes, stars and sentiment scores of reviews) from different external data sources because different sites have different rating scores about the same product. The propose novel model consists of four major modules HUAPA-DCF+NSC+MR (Hierarchical User Attention and Hierarchical Product Attention, Deep Collaborative Filtering, Neural Sentiment Classifier, and multivariant rating) to solve the addressed problems. Initially, the HUAPA module is based on BiLSTM’s hierarchical user attention (HUA) and hierarchical product attention (HPA) to embed the user preferences and product characteristics respectively. Further, these are combined nonlinear representations and fed as input to the interaction module. Secondly, the deep collaborative filtering module is implemented to find the explicit interaction between user and product. Thirdly, NSC module will extract the user’s semantic about products by incorporating the user’s preferences and product characteristics. Finally, the module uses explicit information (multivariant rating) to the maximum extent for final classification. Experimental results demonstration that our novel model is outperforming than state-of-the-art at IMDb, Yelp2013 and Yelp2014 datasets for the true recommendation of top-n products using HNCF (HUAPA+DCF+NSC+MR) to increase the accuracy, confidence, and trust on recommendation services.
With the development of image-generating technologies, significant progress has been made in the field of facial manipulation techniques. These techniques allow people to easily modify media information, such as videos and images, by substituting the identity or facial expression of one person with the face of another. This has significantly increased the availability and accessibility of such tools and manipulated content termed ‘deepfakes’. Developing an accurate method for detecting fake images needs time to prevent their misuse and manipulation. This paper examines the capabilities of the Vision Transformer (ViT), i.e., extracting global features to detect deepfake images effectively. After conducting comprehensive experiments, our method demonstrates a high level of effectiveness, achieving a detection accuracy, precision, recall, and F1 rate of 99.5 to 100% for both the original and mixture data set. According to our existing understanding, this study is a research endeavor incorporating real-world applications, specifically examining Snapchat-filtered images.
The periodic inspection of railroad tracks is very important to find structural and geometrical problems that lead to railway accidents. Currently, in Pakistan, rail tracks are inspected by an acoustic-based manual system that requires a railway engineer as a domain expert to differentiate between different rail tracks’ faults, which is cumbersome, laborious, and error-prone. This study proposes the use of traditional acoustic-based systems with deep learning models to increase performance and reduce train accidents. Two convolutional neural networks (CNN) models, convolutional 1D and convolutional 2D, and one recurrent neural network (RNN) model, a long short-term memory (LSTM) model, are used in this regard. Initially, three types of faults are considered, including superelevation, wheel burnt, and normal tracks. Contrary to traditional acoustic-based systems where the spectrogram dataset is generated before the model training, the proposed approach uses on-the-fly feature extraction by generating spectrograms as a deep learning model’s layer. Different lengths of audio samples are used to analyze their performance with each model. Each audio sample of 17 s is split into 3 variations of 1.7, 3.4, and 8.5 s, and all 3 deep learning models are trained and tested against each split time. Various combinations of audio data augmentation are analyzed extensively to investigate models’ performance. The results suggest that the LSTM with 8.5 split time gives the best results with the accuracy of 99.7%, the precision of 99.5%, recall of 99.5%, and F1 score of 99.5%.