Sixian Wang

Sixian Wang

Auto-generated profile, based on publicly available information

Sixian Wang

Shanghai Jiao Tong University

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 June 2022 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
JDJincheng Dai
Jincheng Dai
SWSixian Wang
Sixian Wang
KTKailin Tan
Kailin Tan
ZSZhongwei Si
Zhongwei Si
XQXiaoqi Qin
Xiaoqi Qin
PZPing Zhang
Ping Zhang
In this paper, we propose a class of high-efficiency deep joint source-channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear transform source-channel coding (NTSCC). In the considered model, the transmitter first learns a nonlinear analysis transform to map the source data into latent space, then transmits the latent representation to the receiver via deep joint source-channel coding. Our model incorporates the nonlinear transform as a strong prior to effectively extract the source semantic features and provide side information for source-channel coding. Unlike existing conventional deep joint source-channel coding methods, the proposed NTSCC essentially learns both the source latent representation and an entropy model as the prior on the latent representation. Accordingly, novel adaptive rate transmission and hyperprior-aided codec refinement mechanisms are developed to upgrade deep joint source-channel coding. The whole system design is formulated as an optimization problem whose goal is to minimize the end-to-end transmission rate-distortion performance under established perceptual quality metrics. Across test image sources with various resolutions, we find that the proposed NTSCC transmission method generally outperforms both the analog transmission using the standard deep joint source-channel coding and the classical separation-based digital transmission. Notably, the proposed NTSCC method can potentially support future semantic communications due to its content-aware ability and perceptual optimization goal.

16 November 2022 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
SWSixian Wang
Sixian Wang
JDJincheng Dai
Jincheng Dai
ZLZijian Liang
Zijian Liang
Kai NiuKai Niu
Kai Niu
ZSZhongwei Si
Zhongwei Si
PZPing Zhang
Ping Zhang
In this paper, we design a new class of high-efficiency deep joint source-channel coding methods to achieve end-to-end video transmission over wireless channels. The proposed methods exploit nonlinear transform and conditional coding architecture to adaptively extract semantic features across video frames, and transmit semantic feature domain representations over wireless channels via deep joint source-channel coding. Our framework is collected under the name deep video semantic transmission (DVST). In particular, benefiting from the strong temporal prior provided by the feature domain context, the learned nonlinear transform function becomes temporally adaptive, resulting in a richer and more accurate entropy model guiding the transmission of current frame. Accordingly, a novel rate adaptive transmission mechanism is developed to customize deep joint source-channel coding for video sources. It learns to allocate the limited channel bandwidth within and among video frames to maximize the overall transmission performance. The whole DVST design is formulated as an optimization problem whose goal is to minimize the end-to-end transmission rate-distortion performance under perceptual quality metrics or machine vision task performance metrics. Across standard video source test sequences and various communication scenarios, experiments show that our DVST can generally surpass traditional wireless video coded transmission schemes. The proposed DVST framework can well support future semantic communications due to its video content-aware and machine vision task integration abilities.

8 July 2024 in IEEE Transactions on Cognitive Communications and Networking
Verified
Journal Article
Closed access
KYKe Yang
Ke Yang
SWSixian Wang
Sixian Wang
JDJincheng Dai
Jincheng Dai
XQXiaoqi Qin
Xiaoqi Qin
Kai NiuKai Niu
Kai Niu
PZPing Zhang
Ping Zhang
As one of the key techniques to realize semantic communications, end-to-end optimized neural joint source-channel coding (JSCC) has made great progress over the past few years. A general trend in many recent works pushing the model adaptability or the application diversity of neural JSCC is based on the convolutional neural network (CNN) backbone, whose model capacity is yet limited, inherently leading to inferior system coding gain against traditional coded transmission systems. In this paper, we establish a new neural JSCC backbone that can also adapt flexibly to diverse channel conditions and transmission rates within a single model, our open-source project aims to promote the research in this field. Specifically, we show that with elaborate design, neural JSCC codec built on the emerging Swin Transformer backbone achieves superior performance than conventional neural JSCC codecs built upon CNN, while also requiring lower end-to-end processing latency. Paired with two spatial modulation modules that scale latent representations based on the channel state information and target transmission rate, our baseline SwinJSCC can further upgrade to a versatile version, which increases its capability to adapt to diverse channel conditions and rate configurations. Extensive experimental results show that our SwinJSCC achieves better or comparable performance versus the state-of-the-art engineered BPG + 5G LDPC coded transmission system with much faster end-to-end coding speed, especially for high-resolution images, in which case traditional CNN-based JSCC yet falls behind due to its limited model capacity.

21 June 2023 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
JDJincheng Dai
Jincheng Dai
SWSixian Wang
Sixian Wang
KYKe Yang
Ke Yang
KTKailin Tan
Kailin Tan
XQXiaoqi Qin
Xiaoqi Qin
PZPing Zhang
Ping Zhang
The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior performance than the established source and channel coding methods. While, so far, research efforts mainly concentrated on architecture and model improvements toward a static target domain. Despite their successes, such learned models are still suboptimal due to the limitations in model capacity and imperfect optimization and generalization, particularly when the testing data distribution or channel response is different from that adopted for model training, as is likely to be the case in real-world. To tackle this, in this paper, we propose a novel online learned joint source and channel coding approach that leverages the deep learning model’s overfitting property. Specifically, we update the off-the-shelf pre-trained models after deployment in a lightweight online fashion to adapt to the distribution shifts in source data and environment domain. We take the overfitting concept to the extreme, proposing a series of implementation-friendly methods to adapt the codec model or representations to an individual data or channel state instance, which can further lead to substantial gains in terms of the end-to-end rate-distortion performance. Accordingly, the streaming ingredients include both the semantic representations of source data and the online updated decoder model parameters. The system design is formulated as a joint optimization problem whose goal is to minimize the loss function, a tripartite trade-off among the data stream bandwidth cost, model stream bandwidth cost, and end-to-end distortion. The proposed methods enable the communication-efficient adaptation for all parameters in the network without sacrificing decoding speed. Extensive experiments, including user study, on continually changing target source data and wireless channel environments, demonstrate the effectiveness and efficiency of our approach, on which we outperform existing state-of-the-art engineered transmission scheme (VVC combined with 5G LDPC coded transmission).

20 July 2022 in IEEE Transactions on Cognitive Communications and Networking
Verified
Journal Article
Closed access
SYShengshi Yao
Shengshi Yao
Kai NiuKai Niu
Kai Niu
SWSixian Wang
Sixian Wang
JDJincheng Dai
Jincheng Dai
We consider the wireless text transmission using joint source-channel coding (JSCC). Classical source coding only considers the syntactic information based on probabilistic models, ignoring the meaning of source messages. Neural network based joint source and channel coders handle the source semantic information more efficiently. However, existing semantic transmission using end-to-end neural networks do not generalize well under varying channel conditions. To tackle this, we propose a semi-neural framework with an iterative architecture, named iterative semantic JSCC (IS-JSCC). Specifically, at each iteration, the remaining semantics is extracted from the intermediate decoded text and is then used as a priori information for the channel decoder in the next iteration. Instead of reconstructing text explicitly, we synthesize the semantics of candidate words in the embedding space, weighted by their posterior probability. This soft semantic synthesis alleviates the error propagation and reduces the complexity of iterative decoding as well. Results show that compared to full-neural designs, the proposed framework can improve the quality of text reconstruction by joint iterative decoding and exhibit better robustness over wireless channels.

10 August 2023 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
SWSixian Wang
Sixian Wang
JDJincheng Dai
Jincheng Dai
XQXiaoqi Qin
Xiaoqi Qin
ZSZhongwei Si
Zhongwei Si
Kai NiuKai Niu
Kai Niu
PZPing Zhang
Ping Zhang
Recent deep learning methods have led to increased interest in solving high-efficiency end-to-end transmission problems. These methods, we call nonlinear transform source-channel coding (NTSCC) , extract the semantic latent features of source signal, and learn entropy model to guide the joint source-channel coding with variable rate to transmit latent features over wireless channels. In this paper, we propose a comprehensive framework for improving NTSCC, thereby higher system coding gain, better model compatibility, more flexible adaptation strategy aligned with semantic guidance are all achieved. This new sophisticated NTSCC model is now ready to support large-size data interaction in emerging XR, which catalyzes the application of semantic communications. Specifically, we propose three useful improvement approaches. First, we introduce a contextual entropy model to better capture the spatial correlations among the semantic latent features, thereby more accurate rate allocation and contextual joint source-channel coding method are developed accordingly to enable higher coding gain. On that basis, we further propose a response network architecture to formulate compatible NTSCC, i.e., once-learned model supports various bandwidth ratios and channel states that benefits practical deployment greatly. Following this, we propose an online latent feature editing mechanism to enable more flexible coding rate allocation aligned with some specific semantic guidance. By comprehensively applying the above three improvement methods for NTSCC, a deployment-friendly semantic coded transmission system stands out finally. Our improved NTSCC system has been experimentally verified to achieve a better rate-distortion efficiency versus the state-of-the-art engineered VTM + 5G LDPC coded transmission system with lower processing latency. Our code is available at https://semcomm.github.io/ntscc_plus/