Signals generated during tool wear are nonlinear, non-stationary, and easily affected by machining noise, which makes reliable tool condition monitoring difficult in intelligent manufacturing. To address this issue, this study proposes a tool wear degree classification framework, FCTrans-CA, that fuses time-domain and frequency-domain information through a lightweight cross-attention (CA) bridge. Fast Fourier transform (FFT) is first used to obtain frequency-domain representations. The raw time-domain signals are processed by a multi-scale one-dimensional convolutional neural network (MS-CNN) to extract temporal wear features, while the FFT-derived representations provide complementary spectral cues. These two feature streams are fused by an asymmetric CA module in which frequency-domain features guide the selection of wear-sensitive temporal features. K-means clustering is used to divide the measured flank wear (VB) trajectory of each tool into initial-, normal-, and severe-wear stages, thereby reducing subjectivity in label generation. Experiments on the PHM2010 milling dataset show that FCTrans-CA achieves 99.43% classification accuracy on 40,648 test samples. The results indicate that cross-domain feature interaction improves the separability of wear states and provides a reproducible data-driven route for tool wear monitoring.