Phase unwrapping in interferometric synthetic aperture radar (InSAR) aims to recover a continuous phase field from wrapped observations, which enable accurate topographic reconstruction and surface deformation measurements. With the recent advances in deep learning (DL), several DL-based unwrapping approaches have shown promising performance. However, deep learning networks suffer from inconsistent feature representations between encoder and decoder stages. This leads to incompatible skip connections that provide limited benefits and even degrade reconstruction quality. To overcome this limitation, we propose ResUCTransNet that integrates residual learning with transformer-based feature modeling. The network employs a multi-scale residual backbone derived from Res_UNet to extract stable deep features. Then, to replace conventional skip connections, a channel transformer (CTrans) module is introduced that composed of channel-wise cross fusion transformer (CCT) and channel-wise cross attention (CCA). This design effectively reduces the semantic gap in different network stages, which allows adaptive integration of local CNN features and global transformer representations. Experiments on the public InSAR-DLPU dataset demonstrate that ResUCTransNet effectively reduces model complexity and achieves substantial improvements over existing deep learning models and classical unwrapping algorithms. Specifically, the proposed method attains the best performance in terms of RMSE and SSIM (RMSE = 1.6247, SSIM = 0.7741). Compared with the second-best model, Res_Unet (RMSE = 2.8409, SSIM = 0.7733), ResUCTransNet achieves an approximately 42.8% reduction in RMSE while maintaining nearly identical structural similarity. The proposed method provides higher reconstruction accuracy and better structural fidelity, while maintaining strong robustness and generalization in complex terrain or severe noise conditions.