Variational Auto-Encoders (VAEs) are deep latent space generative models which have been immensely successful in many applications such as image generation, image captioning, protein design, mu-tation prediction, and language models among others. The fundamental idea in VAEs is to learn the distribu-tion of data in such a way that new meaningful data can be generated from the encoded distribution. This concept has led to tremendous research and variations in the design of VAEs in the last few years creating a field of its own, referred to as unsupervised representation learning. This paper provides a much-needed comprehensive evaluation of the variations of the VAEs based on their end goals and resulting architectures. It further provides intuition as well as mathematical formulation and quantitative results of each popular variation, presents a concise comparison of these variations, and concludes with challenges and future oppor-tunities for research in VAEs.
16 March 2012 in Journal of Intelligent & Robotic Systems
Machine and deep learning techniques are two branches of artificial intelligence that have proven very efficient in solving advanced human problems. The automotive industry is currently using this technology to support drivers with advanced driver assistance systems. These systems can assist various functions for proper driving and estimate drivers’ capability of stable driving behavior and road safety. Many studies have proved that the driver’s emotions are the significant factors that manage the driver’s behavior, leading to severe vehicle collisions. Therefore, continuous monitoring of drivers’ emotions can help predict their behavior to avoid accidents. A novel hybrid network architecture using a deep neural network and support vector machine has been developed to predict between six and seven driver’s emotions in different poses, occlusions, and illumination conditions to achieve this goal. To determine the emotions, a fusion of Gabor and LBP features has been utilized to find the features and been classified using a support vector machine classifier combined with a convolutional neural network. Our proposed model achieved better performance accuracy of 84.41%, 95.05%, 98.57%, and 98.64% for FER 2013, CK+, KDEF, and KMU-FED datasets, respectively.
18 March 2019 in IEEE Transactions on Engineering Management
The concept of efficiency has always been and will continue to be important for competitive business environments where limited resources exist. Owing to the growing complexity of organizations and economy in general, this trend is expected to continue to remain a high priority for organizations. Continuous performance evaluations that utilize both qualitative and quantitative information play a significant role in sustaining efficient and effective business processes. Therefore, the literature offers a wide range of performance evaluation methodologies to assess the operational efficiency in various industries. Majority of these models, however, focus solely on quantitative criteria, avoiding the interrelations and dependencies between qualitative and quantitative measurements. Furthermore, these methodologies tend to utilize discrete and contemporary information eliminating historical performance data. With these motivations, this paper proposes an integrated approach combining fuzzy decision-making trial and evaluation laboratory (DEMATEL), analytic network process (ANP), and artificial neural network (ANN) methodologies for performance evaluation. In the proposed model, DEMATEL and ANP methodologies are utilized in a group decision-making concept to obtain priorities of the evaluation criteria. Following this, an ANN model is designed and trained with historical performance data collected from the organization and the results of the fuzzy DEMATEL-ANP model. The outcomes include the relational data among the criteria and alternatives used in the model in addition to their relative rankings. A food industry case study is presented to demonstrate the steps of the proposed model.
The effectiveness of existing AI detectors is notably hampered when processing Arabic texts. This study introduces a novel AI text classifier designed specifically for Arabic, tackling the distinct challenges inherent in processing this language. A particular focus is placed on accurately recognizing human-written texts (HWTs), an area where existing AI detectors have demonstrated significant limitations. To achieve this goal, this paper utilized and fine-tuned two Transformer-based models, AraELECTRA and XLM-R, by training them on two distinct datasets: a large dataset comprising 43,958 examples and a custom dataset with 3078 examples that contain HWT and AI-generated texts (AIGTs) from various sources, including ChatGPT 3.5, ChatGPT-4, and BARD. The proposed architecture is adaptable to any language, but this work evaluates these models’ efficiency in recognizing HWTs versus AIGTs in Arabic as an example of Semitic languages. The performance of the proposed models has been compared against the two prominent existing AI detectors, GPTZero and OpenAI Text Classifier, particularly on the AIRABIC benchmark dataset. The results reveal that the proposed classifiers outperform both GPTZero and OpenAI Text Classifier with 81% accuracy compared to 63% and 50% for GPTZero and OpenAI Text Classifier, respectively. Furthermore, integrating a Dediacritization Layer prior to the classification model demonstrated a significant enhancement in the detection accuracy of both HWTs and AIGTs. This Dediacritization step markedly improved the classification accuracy, elevating it from 81% to as high as 99% and, in some instances, even achieving 100%.