Despite the convenience offered by e-commerce, online apparel shopping presents various product-related risks, as consumers can neither physically see nor try products on themselves. Augmented reality (AR) and virtual reality (VR) technologies have been used to improve the shopping online experience. Therefore, we propose an AR- and VR-based try-on system that provides users a novel shopping experience where they can view garments fitted onto their personalized virtual body. Recorded personalized motions are used to allow users to dynamically interact with their dressed virtual body in AR. We conducted two user studies to compare the different roles of VR- and AR-based try-ons and validate the impact of personalized motions on the virtual try-on experience. In the first user study, the mobile application with the AR- and VR-based try-on is compared to a traditional e-commerce interface. In the second user study, personalized avatars with pre-defined motion and personalized motion is compared to a personalized no-motion avatar with AR-based try-on. The result shows that AR- and VR-based try-ons can positively influence the shopping experience, compared with the traditional e-commerce interface. Overall, AR-based try-on provides a better and more realistic garment visualization than VR-based try-on. In addition, we found that personalized motions do not directly affect the user’s shopping experience.
In marker-based augmented reality (AR) systems, markers are usually relatively independent and predefined by the system creator in advance. Users can only use these predefined markers to complete the construction of certain specified content. Such systems usually lack flexibility and cannot allow users to create content freely. In this paper, we propose a virtual marker technique to build a marker-based AR system framework, where multiple AR markers including virtual and physical markers work together. Information from multiple markers can be merged, and virtual markers are used to provide user-defined information. We conducted a pilot study to understand the multi-marker cooperation framework based on virtual markers. The pilot study shows that the virtual marker technique will not significantly increase the user’s time and operational burdens, while actively improving the user’s cognitive experience.
Biometric authentication is popular in authentication systems, and gesture as a carrier of behavior characteristics has the advantages of being difficult to imitate and containing abundant information. This research aims to use three-dimensional (3D) depth information of gesture movement to perform authentication with less user effort. We propose an approach based on depth cameras, which satisfies three requirements: Can authenticate from a single, customized gesture; achieves high accuracy without an excessive number of gestures for training; and continues learning the gesture during use of the system. To satisfy these requirements respectively: We use a sparse autoencoder to memorize the single gesture; we employ data augmentation technology to solve the problem of insufficient data; and we use incremental learning technology for allowing the system to memorize the gesture incrementally over time. An experiment has been performed on different gestures in different user situations that demonstrates the accuracy of one-class classification (OCC), and proves the effectiveness and reliability of the approach. Gesture authentication based on 3D depth cameras could be achieved with reduced user effort.
A loyalty program is an important link between consumers and merchants in daily consumption. While new technologies (e.g. gamification, social networks, augmented reality, and so on) make it possible to strengthen this bond, their potential has not yet been fully exploited. In our research, we explore a novel approach to integrate gamification and social interaction into a loyalty program based on augmented reality (AR). We propose an AR-based gamified point system which supports users in obtaining pet-based dynamic feedback on mobile devices and provides a multi-user environment for social interaction. Compared to traditional point systems, pet-based designs help to establish an emotional connection between users and the system. The multi-user environment is designed to increase the user’s motivation through the positive effects of social interactions. Our system provides interpersonal communication channels between users, including competitive and non-competitive interactions. We performed an evaluation consisting of two experiments to examine the effects of game elements (mission and feedback) and social cues (competitive and non-competitive interactions). In the first experiment, we analyze the change in online shopping behavior before and after adding game elements. The results show that gamification can increase user participation in online shopping. In the second experiment, we study the effects of social cues. The results show that social cues can motivate users to participate in the use of a gamified point system.
31 March 2014 in Journal of Information Processing Systems