Scene text detection in arbitrary shapes remains a critical challenge in computer vision due to complex backgrounds, irregular geometric layouts, and extreme scale variations. Existing segmentation-based methods typically employ feature pyramids for multi-scale representation but suffer from long information paths between low-level details and high-level semantics, while attention mechanisms often introduce significant parameter overhead. In this paper, we propose CSPA-Net, which incorporates three main components: First, we introduce a Cross-Scale Morphology-Semantic Alignment (CMSA) mechanism that establishes bidirectional feature pathways, combining top-down semantic propagation with bottom-up morphological enhancement to effectively shorten the fusion path and preserve fine-grained boundary information. Second, we adopt a Parameter-Free 3-D Attention (PFA-3D) module following the formulation of SimAM [28], which derives attention weights from neuron energy optimization. This yields a lightweight attention mechanism that captures spatial, channel, and depth correlations without introducing any learnable parameters. Third, CSPA-Net achieves a favorable efficiency-accuracy trade-off: it performs competitively with Transformer-based methods in accuracy while maintaining CNN-like inference speed. Integrated with differentiable binarization [23], our method is extensively evaluated on five benchmarks: ICDAR2015 [6], CTW1500 [7], Total-Text [8], ICDAR2017 [61], and SynthText [55]. Experimental results demonstrate that CSPA-Net achieves new state-of-the-art F-measures of 88.5%, 86.1%, 86.7%, and 74.8% on these datasets, respectively. Comprehensive ablation studies validate the contribution of each component, and complexity analysis shows that CSPA-Net runs at 85 FPS with only 12.3M parameters, significantly outperforming recent Transformer-based methods [72, 75] in efficiency. Our code will be made publicly available.