The hybrid architecture of CNNs and Transformers has gained popularity in medical image segmentation. However, in this hybrid architecture, the semantic gaps between multi-scale CNN and Transformer branch features hinder the segmentation performance. To address this issue, we propose a new pipeline for medical image segmentation, named FCT-Net. Firstly, we employ large kernel convolutions in CNN branch and shift-window self-attention mechanism in Transformer branch to construct a parallel three-branch architecture for efficiently capturing global and local information. Secondly, to better fuse CNN and Transformer features, we introduce the Bridge Fusion Module (BFM), to effectively extract local features and global representations at different semantic scales by integrating semantic information from different branches, thereby reducing the semantic gap between features. Lastly, to capture multi-scale information during the encoding process, we design the Multi-Scale Feature Compilation Module (MFCM) to adaptively fuse features from different stages of the encoder. Additionally, we introduce Residual Attention (RA) to enhance the features obtained after encoding, further boosting the network’s representational capacity. FCT-Net is evaluated on four different medical image segmentation benchmarks, achieving Dice scores of 83.56%, 90.87%, 92.21%, and 91.92% on COVID-19 Lung dataset, ISIC-2018, SegPC-2021, and ACDC, respectively, outperforming other state-of-the-art methods. Source code will be available at https://github.com/ZBW830/FCTNethttps://github.com/ZBW830/FCTNet.