Despite the convenience offered by e-commerce, online apparel shopping presents various product-related risks, as consumers can neither physically see nor try products on themselves. Augmented reality (AR) and virtual reality (VR) technologies have been used to improve the shopping online experience. Therefore, we propose an AR- and VR-based try-on system that provides users a novel shopping experience where they can view garments fitted onto their personalized virtual body. Recorded personalized motions are used to allow users to dynamically interact with their dressed virtual body in AR. We conducted two user studies to compare the different roles of VR- and AR-based try-ons and validate the impact of personalized motions on the virtual try-on experience. In the first user study, the mobile application with the AR- and VR-based try-on is compared to a traditional e-commerce interface. In the second user study, personalized avatars with pre-defined motion and personalized motion is compared to a personalized no-motion avatar with AR-based try-on. The result shows that AR- and VR-based try-ons can positively influence the shopping experience, compared with the traditional e-commerce interface. Overall, AR-based try-on provides a better and more realistic garment visualization than VR-based try-on. In addition, we found that personalized motions do not directly affect the user’s shopping experience.
27 January 2025 in IEEE Transactions on Industrial Informatics
In the traditional data-driven fault diagnosis task, gathering training samples for all possible fault classes poses a significant challenge. There are many target faults that cannot be collected in advance, which potentially limiting the performance of fault diagnosis models. Zero-shot learning has emerged as a viable solution to this problem. However, it often encounters the issue of domain shift. In this article, an attribute-consistent generative adversarial network with feature generation (ACGAN-FG) is proposed for zero-shot fault diagnosis. ACGAN-FG introduces a discriminative classifier and a binary comparator to construct the attribute-consistent losses, which can alleviate the issue that the generated features may deviate from real faults. To generate fault features with greater diversity and enhance the robustness of the proposed model, a cycle rank loss is designed. Besides, this method also introduces feature concatenation to build new training data and testing data. This concatenation can transform the generated features into more discriminative representation for further fault diagnosis. The effectiveness of the proposed method is validated on two cases for fault diagnosis purpose. The results also indicate that the proposed method is outperforms other state-of-art zero-shot fault diagnosis methods.
15 July 2024 in IEEE Transactions on Instrumentation and Measurement
The rise of industrial progress has advanced the growth of deep learning (DL)-driven smart fault diagnosis techniques, particularly for condition-based maintenance (CBM). However, the training of these DL methods relies on large dataset, which is unrealistic to collect because fault signal is not practically viable in real case. To address this issue, this article proposes a conditional auxiliary classier cycle-consistent generative adversarial network restrained by Wasserstein distance with gradient penalty (CAC-CycleGAN-WGP). This model can generate superior-quality signals of the minority classes with stability from majority class. In the experimental section, a stacked autoencoder (AE)-based evaluator is proposed to evaluate the quality of these generated sample, and then imbalanced fault diagnosis is conducted at varying balance ratios based on two benchmarked datasets. The outcomes indicate that the proposed approach is adept at generating fault signals, leading to a notable enhancement in fault diagnosis accuracy as the generated samples are added. Additionally, the efficacy of the proposed framework was benchmarked against other commonly employed techniques. Among them, CAC-CycleGAN-WGP stands out with superior performance.
13 March 2025 in IEEE Transactions on Instrumentation and Measurement
In conventional data-driven fault diagnosis scenarios, it is often challenging to acquire sufficient training instances for every potential fault category. Because many target faults cannot be collected in advance, these gaps can constrain the effectiveness of existing diagnostic models. Zero-shot learning has gained prominence as a viable solution to this problem. However, it often encounters the issue of domain shift and insufficient learning of semantic space. In this study, a novel approach named the cycle-consistent generative adversarial network with semantic distance (CycleGAN-SD) is proposed for zero-shot fault diagnosis. By defining the semantic distance between different fault classes in attribute feature space, CycleGAN-SD facilitates the transformation of fault data from seen to unseen classes. To alleviate the issue that the generated features may deviate from real faults, an attribute regressor is introduced to construct the attribute-consistent loss. Besides, this method also introduces feature concatenation to build new training data and testing data. By merging the synthesized features, a more distinctive representation is achieved, thereby enhancing subsequent fault diagnosis. To validate the effectiveness of the proposed method, three fault diagnosis scenarios were investigated. Furthermore, the experimental results demonstrate that the proposed method surpasses other state-of-the-art zero-shot fault diagnosis techniques.