With the digital transformation of the manufacturing industry, data monitoring and collecting in the manufacturing process become essential. Pointer meter reading recognition (PMRR) is a key element in data monitoring throughout the manufacturing process. However, existing PMRR methods have low accuracy and insufficient robustness due to issues such as blur, uneven illumination, tilt, and complex backgrounds in meter images. To address these challenges, we propose an end-to-end PMRR method based on a decoupled circle head detection algorithm (YOLOX-DC) and a Unet-like pure Transformer segmentation network (PM-SwinUnet). First, according to the characteristics of the pointer dial, the YOLOX-DC detection algorithm is designed based on the exceeding you only look once detector (YOLOX). The decoupled circle head of YOLOX-DC detects the pointer meter dial more accurately than the commonly used rectangular detection head. Second, the window multi-head attention of the PM-SwinUnet network enhances the feature extraction ability of pointer meter images and solves problems of missed scale detection and incomplete pointer segmentation. Additionally, the scale and pointer fitting module is introduced into the PM-SwinUnet to locate the accurate position of the scale and pointer. Finally, through the angle relationship between the pointer and the first two main scale lines, the pointer meter reading is accurately calculated by the improved angle method. Experimental results demonstrate the effectiveness and superiority of the proposed end-to-end method across three-pointer meter datasets. Furthermore, it provides a rapid and robust approach to the digital transformation of manufacturing systems.