12 July 2024 in IEEE Signal Processing Letters
Integrating haptic feedback with audio and video not only expands the perceptual dimensions of multimedia applications but also enhances user engagement and experience. However, higher signal sampling rates and multi-degree-freedom in haptic interaction increase data significantly. For low-latency and reliable transmission of haptic signal (i.e. tactile and kinesthetic signals), efficient haptic coding is crucial. Existing algorithms overlook haptic signal characteristics, leaving room for improvement. We analyze the statistical characteristics of kinesthetic signals in-depth. Based on the local linear characteristics of position and velocity signals, and the sparse distribution of force signal, we propose an improved kinesthetic coding algorithm by combining dead-zone coding with segmented linear prediction. Extensive experiments on the standard datasets of the IEEE P1918.1.1 Haptic Codecs Task Group demonstrate the superior performance compared to state-of-the-art methods, achieving a more than halved reduction in data transmission rates with high signal-to-noise ratios and structural similarity
9 October 2024 in IEEE Signal Processing Letters
Within the domain of multimodal communication, the compression of audio, image, and video information is well-established, but compressing haptic signals, including vibrotactile signals, remains challenging. Particularly with the enhancement of haptic signal sampling rate and degrees of freedom, there is a substantial increase in data volume. While existing algorithms have made progress in vibrotactile codecs, there remains significant room for improvement in compression ratios. We propose an innovative Nbeats Network-based Vibrotactile Codec (NNVC) that leverages the statistical characteristics of vibrotactile data. This advanced codec integrates the Nbeats network for precise vibrotactile prediction, residual quantization, efficient Run-Length Encoding, and Huffman coding. The algorithm not only captures the intricate details of vibrotactile signals but also ensures high-efficiency data compression. It exhibits robust overall performance in terms of Signal-to-Noise Ratio (SNR) and Peak Signal-to-Noise Ratio (PSNR), significantly surpassing the state-of-the-art.
30 April 2023 in Virtual Reality
14 October 2024 in Journal of Real-Time Image Processing