Intelligent wearable systems have been widely used in health monitoring, motion tracking, and engineering safety. However, the single function of current wearable systems cannot satisfy the requirements of complex scenarios, and the wearable systems cannot establish a relationship with the virtual 3-D visualization platform. To address these issues, this article proposes a novel intelligent wearable system with motion and emotion recognition. Multiple sensors are integrated into the system to collect motion and emotion information. In order to achieve accurate classification and recognition of multiple sensor information, we propose a novel human action recognition network called the three-branch spatial–temporal feature extraction network (TB-SFENet), which can obtain more robust features and achieve an accuracy of 97.04% on the UCI-HAR data set and 92.68% on the UniMiB SHAR data set. To establish the relationship between the real entity and virtual space, we use digital twin (DT) technology to establish the 3-D display DT platform. The platform enables real-time information interaction, such as activity, emotion, location, and monitoring information. Additionally, we establish the TGAM electroencephalogram emotion classification (TEEC) data set, which contains 120 000 pieces of data, for the proposed system. Experimental results indicate that the proposed system realizes virtual reality (VR) information interaction between the personal digital human and actual person based on the intelligent wearable system, which has great potential for applications in intelligent healthcare, VR, and other fields.

Smart clothing is widely used for social safety, health monitoring, and sports monitoring. Current research focuses on the use of various materials or sensors to implement smart clothes with different functions, which implies that the functionality of smart clothing depends on the number of sensors used. For existing smart clothing systems, the greatest attention has been given to information processing algorithms and assembly of sensors, and the interaction between users and systems is ignored. To address this gap, this paper considers a multifunctional smart clothing system constructed with several sensors. The smart clothing system proposed in this paper mainly consists of a hardware module and a software module. Four types of sensors are incorporated into the hardware module to monitor heart rate, blood oxygen saturation, body temperature, locating information, and activity states; the software module includes the three-dimensional model based on the user and the feedback system based on digital twin technology. The digital twin technology can map the fundamental states of users in terms of the monitoring indexes from the hardware module, and give correspondent advice to users. This novel smart clothing system overcomes the lack of an interaction function in existing methods and introduces digital twin technology into smart wearable devices for the first time.

An image-based virtual try-on system transfers an in-shop garment to the corresponding garment region of a reference person, which has huge application potential and commercial value in online clothing shopping. Existing methods have difficulty preserving garment texture and body details because of rough garment alignment and imperfect detail-retention strategies. To address this problem, we propose a virtual try-on network based on semantic constraints and flow alignment. The key idea of the framework is as follows: 1) a global-local semantic predictor (GLSP) is proposed to generate a reasonable target semantic map, which clearly guides the correct alignment of the in-shop garment with the body and the generation of try-on result; and 2) a novel appearance flow-based garment alignment network (AFGAN) is proposed to align the in-shop garment with the body, which is important to preserve maximum garment detail and ensure natural and realistic warping; and 3) we propose a synthesis strategy to integrate the aligned garment and the human body to preserve maximum body detail for generating a realistic result and preventing cross-occlusion and pixel confusion between different body parts. Experiments on the existing benchmark dataset demonstrate that the proposed method achieves the best performance on qualitative and quantitative experiments among the state-of-the-art virtual try-on techniques.

Multi-pose virtual try-on has become a research focus for online clothes shopping due to the fixed-pose virtual try-on methods that cannot provide a different pose try-on effect. The challenge of multi-pose virtual try-on is that the detailed information of a generated image is difficult to obtain in the pose transformation and garment distortion. To solve the issue, we propose a multi-pose virtual try-on method via appearance flow and feature filtering (VTON-MP). First, a segmentation generation network of 2D keypoints about the target pose is used to predict the body semantic distribution of the target pose. Second, the desired garment is distorted to correspond to the body posture using the appearance flow figure alignment network (AFFAN). Third, latent useless feature weights are restrained using a filtering-enhancement block (FEB), and effective appearance feature weights are enhanced. Finally, the spatial relationship of body parts in the resulting image is further optimized using spatially-adaptive instance normalization (SAIN). Compared to state-of-the-art methods of subjective and objective experiments on the MPV dataset, the proposed VTONMP achieves the best performance in terms of SSIM, PSNR and FID. The experimental results demonstrate that the proposed algorithm can better retain image details (head, hands, arms, and trousers).

Clothing parsing is a challenging task. In this task, there are two main inherent challenges, which are the fine-grained parsing of small clothing components and the missegmentation of similar clothing categories. To address these challenges, this paper proposes a phase contour enhancement network for clothing parsing. It achieves improved accuracy while maintaining a relatively small network complexity. Leveraging the distinctive features of phase maps, we introduce the phase contour enhancement attention (PCEA) module to augment the encoder’s object edge information. To further enrich the model’s feature extraction capacity, we present the dilated convolution pyramid (DCP) module, combining it with a lightweight decoder to achieve improved global context modeling. The synergistic integration of the PCEA and DCP modules enhances the network with remarkable capabilities in capturing intricate contours, effectively surmounting the challenges of fine-grained parsing for small clothing components and mitigating the missegmentation of similar clothing categories. Through extensive experiments on the CFP, Modanet, and DeepFashion2 datasets and further expansion experiments on the LIP dataset, our method demonstrates outstanding performance across multiple evaluation metrics, surpassing state-of-the-art methods for clothing parsing. In conclusion, our phase contour enhancement network exhibits remarkable performance in both clothing parsing tasks and extended human parsing tasks.