16 August 2023 in IEEE Transactions on Multimedia
Quality of experience (QoE) has been widely recognized as the primary metric to evaluate user experience in multimedia applications. However, the QoE assessment of tactile virtual environments is still highly dependent on subjective measures. Inspired by the fact that physiological signals can characterize the user's emotional state, we propose a QoE measurement method for virtual reality (VR) with vibrotactile feedback based on frontal lobe power asymmetry (FLPA). The subjective score of vibrotactile experience in VR is used as the ground truth of QoE. The selection of QoE measurement indicators consists of two steps. First, the relationship between FLPA phenomenon and scores of QoE is preliminarily established by statistical methods and Spearman Correlation Coefficient. Then, the most important FLPA feature is selected by random forest, which is the best indicator for QoE measurement. The brain neural images show that vibrotactile feedback in VR can evoke FLPA phenomenon. Correlation analysis shows that there is a significant correlation between subjective scores of QoE and FLPA features. The classification results show that the selected best FLPA feature can be used as a physiological indicator to measure and predict QoE. We achieve mutual interpretation of EEG-based physiological measurements and subjective cognitive outcomes of QoE.
19 December 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
We investigate the feasibility of a vibrotactile device that is both battery-free and electronic-free. Our approach leverages lasers as a wireless power transfer and haptic control mechanism, which can drive small actuators commonly used in AR/VR and mobile applications with DC or AC signals. To validate the feasibility of our method, we developed a proof-of-concept prototype that includes low-cost eccentric rotating mass (ERM) motors and linear resonant actuators (LRAs) connected to photovoltaic (PV) cells. This prototype enabled us to capture laser energy from any distance across a room and analyze the impact of critical parameters on the effectiveness of our approach. Through a user study, testing 16 different vibration patterns rendered using either a single motor or two motors, we demonstrate the effectiveness of our approach in generating vibration patterns of comparable quality to a baseline, which rendered the patterns using a signal generator.