12 April 2021 in IEEE Access
Attentive learning is an important feature of the learning process. It provides a beneficial learning experience and plays a key role in generating positive learning outcomes. Most studies widely applied electroencephalogram (EEG) to measure human attention level. Although most studies use EEG handcrafted features and statistical methods to classify attention level, a more effective feature learning technique is still needed. In this paper, we aim to analyze participants' EEG signals through a deep learning model and classify those signals as showing either attentive or inattentive behaviors. To carry out this research, we initially conducted a background study on attention and its detection in EEG. After that, we design a Troxler's fading experiment and use an EEG device to collect data on participants' attentive and inattentive behaviors during the test. The collected EEG data will be analyzed using a Convolution Attention Memory Neural Network (CAMNN) model to classify participants' attention level. The proposed CAMNN model is optimized with Vector-to-Vector (Vec2Vec) modeling, where the model can be learned through deep neural networks in an end-to-end approach. The result shows that our model can achieve 92% accuracy and 0.92 F1 score which outperforms several existing neural network models such as Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), and Convolutional Neural Network (CNN), Deep Learning with Convolutional Neural Networks (deep ConvNets), and Compact Convolutional Network for EEG-based BCIs (EEGNet). This research can be useful for those who are interested in developing attention level monitoring or biofeedback system in areas such as educational classroom learning, medical research, and industrial operator.
31 August 2023 in Soft Computing
30 April 2023 in International Journal on Robotics, Automation and Sciences
This paper presents the development of augmented reality (AR) based brain memory training to improve the memorizing capability of the student. The AR visual memory training application is built on top of the mobile phone by utilizing the Unity and Vuforia platform. The developed visual memory test is a flipping card test that can measure a person’s memory capability to retain visual images and spatial perception in the mind. In this study, it is aimed to prove that AR technology is suitable to be employed in the education field. The results are justified based on the visual memory test score and the engaging level of the user computed from the electroencephalogram (EEG) signal. The results are assessed by comparing with the physical mode and computer-based mode. As result, it is shown that the student performed better in the AR-based visual memory test compared to physical and computer-based modes. Besides, the EEG signals also show that students are more engaged and attentive while using AR technology.
30 September 2023 in International Journal on Robotics, Automation and Sciences
In this project, a new learning platform was developed. This project uses the technology of Augmented Reality (AR) to develop a graphic animation platform for learning purposes. By applying virtual objects with animations for learning, it helps to engage users and increase their learning efficiency. Besides, the AR platform combines hardware (i.e.s smartphone, headset, and target marker) and software (i.e., Unity, Vuforia, and C#) for the operation. The AR application allow the interaction of the virtual objects by grabbing target marker toward each other or touching the virtual button in real environment. This can increase the immersion and interaction of the user when learning chemistry. In additional, the “Chemical Learn” experiments was designed to study the effectiveness of the AR platform compared to traditional platform as well as to conduct user satisfaction surveys. The overall results showed that the AR learning platform can improved learning efficiency of users in chemistry compared to traditional learning methods. Moreover, users who participate in the survey are generally satisfied with the AR. It is believed that with the rising trend of technology, it is only a matter of time before people become familiar with the AR platform. (Submitted: 1 December 2021 | Accepted: 24 April 2022 | Published: 30 September 2023)
16 October 2024 in Journal of Informatics and Web Engineering
This paper proposes a virtual reality based Left Brain System named BrainUp World to improve left brain thinking. The left-brain system was employed with mobile virtual reality technology, hand motion tracking and haptic feedback system. The implementation of these systems is to enhance the experience and sense of embodiment. BrainUp World includes virtual reality-based brain training games to improve a person’s attention level, reasoning skill, auditory cognition, arithmetic skill, sequencing skill and memory. The hand tracking system was utilized with an IR camera to capture the hand orientation and return the gesture data to the VR application. A low-cost and lightweight haptic glove was invented which provides the sense of touch using vibrations while interacting with VR contents. An experimental study was conducted to assess the efficacy of BrainUp World compared to traditional PC-based training approaches. Participants were randomly assigned to either the VR-based or PC-based training group and underwent 6 different games to test a person’s attention level, reasoning skill, auditory cognition, arithmetic skill, sequencing skill, and memory. The results revealed a statistically significant improvement in left brain function in the VR-based training group compared to the PC-based group, with a T-score growth of 4.73. Analysis using ANOVA confirmed the significance of this difference (p-Value = 0.04). Notably, the study also identified age-related differences in thinking fluency, highlighting the importance of personalized cognitive training interventions. In conclusion, BrainUp World demonstrates the potential of VR technology in promoting left brain development, as evidenced by empirical findings from the conducted study. By offering immersive and interactive cognitive training experiences, VR-based systems hold promise for enhancing various aspects of cognitive function associated with left hemisphere dominance. Further research in this area is encouraged to explore the full potential of VR-based interventions for cognitive enhancement.