The uneven surface of the weld seam makes eddy current testing more susceptible to the lift-off effect of the probe. Therefore, the defect of carbon steel plate welds has always been a difficult problem in eddy current testing. This study aimed to design a new type of eddy current orthogonal axial probe and establish the finite element simulation model of the probe. The effect of the probe structure, coil turns, and coil size on the detection sensitivity was simulated. Further, a designed orthogonal axial probe was used to conduct a systematic experiment on the weld of carbon steel specimens, and the 0.2 mm width and 1 mm depth of weld defects of carbon steel plates were effectively detected. The experimental results showed that the new orthogonal axial eddy current probe effectively suppressed the unevenness effect of the weld surface on the lift-off effect during the detection process.