Human activity recognition requires both visual and temporal cues, making it challenging to integrate these important modalities. The usual schemes for integration are averaging and fixing the weights of both features for all samples. However, how much weight is needed for each sample and modality, is still an open question. A mixture of experts via a gating Convolutional Neural Network (CNN) is one promising architecture for adaptively weighting every sample within a dataset. In this paper, rather than just averaging or using fixed weights, we investigate how a natural associative cortex such as a network integrates expert networks to form a gating CNN scheme. Starting from Red Green Blue color model (RGB) values and optical flows, we show that with proper treatment, the gating CNN scheme works well, indicating future approaches to information integration in future activity recognition.
The rich diversity of herbal plants in Indonesia holds immense potential as alternative resources for traditional healing and ethnobotanical practices. However, the dwindling recog-nition of herbal plants due to modernization poses a significant challenge in preserving this valuable heritage. The accurate identification of these plants is crucial for the continuity of traditional practices and the utilization of their nutritional benefits. Nevertheless, the manual identification of herbal plants remains a time-consuming task, demanding expert knowledge and meticulous examination of plant characteristics. In response, the application of computer vision emerges as a promising solution to facilitate the efficient identification of herbal plants. This research addresses the task of classifying Indonesian herbal plants through the implementation of transfer learning of Convolutional Neural Networks (CNN). To support our study, we curated an extensive dataset of herbal plant images from Indonesia with careful manual selection. Subsequently, we conducted rigorous data preprocessing, and classification utilizing transfer learning methodologies with five distinct models: ResNet, DenseNet, VGG, ConvNeXt, and Swin Transformer. Our comprehensive analysis revealed that ConvNeXt achieved the highest accuracy, standing at an impressive 92.5 %. Additionally, we conducted testing using a scratch model, resulting in an accuracy of 53.9 %. The experimental setup featured essential hyperparameters, including the ExponentialLR scheduler with a gamma value of 0.9, a learning rate of 0.001, the Cross-Entropy Loss function, the Adam optimizer, and a training epoch count of 50. This study's outcomes offer valuable insights and practical implications for the automated identification of Indonesian medicinal plants, contributing not only to the preservation of ethnobotanical knowledge but also to the enhancement of agricultural practices through the cultivation of these valuable resources. The Indonesia Medicinal Plant Dataset utilized in this research is openly accessible at the following link: https://github.com/Salmanim20/indomedicinalplant.
In the world of modern energy, Lithium-Ion batteries reign supreme, offering rechargeability, sustainability, and long-term energy storage. However, their lifespan is not infinite, calling for accurate prediction of remaining life under various conditions. Deep learning shines in this domain, with the Transformer architecture blossoming as a powerful tool for time series forecasting. This research dives into data collection, processing, model design, training, and evaluation, making key methodological contributions to battery life prediction. Notably, the SGEformer model, a Transformer enhanced with growth and seasonal embedding, emerges as a groundbreaking innovation. Comparing SGEformer to ETSformer, Informer, Reformer, Transformer, and LSTM reveals its unique strengths. With an impressive MSE score of 0.000117, SGEformer establishes itself as a highly effective tool for battery life prediction, highlighting the value of growth and seasonal embedding in boosting accuracy. This research propels the state-of-the-art Lithium-Ion battery state-of-health prediction, offering a robust methodological foundation for precise and reliable forecasts. Code can be accessed at https://github.com/MRifqiFz/SGEformer .
10 December 2021 in EXPERT: Jurnal Manajemen Sistem Informasi dan Teknologi