With the digital transformation of the manufacturing industry, data monitoring and collecting in the manufacturing process become essential. Pointer meter reading recognition (PMRR) is a key element in data monitoring throughout the manufacturing process. However, existing PMRR methods have low accuracy and insufficient robustness due to issues such as blur, uneven illumination, tilt, and complex backgrounds in meter images. To address these challenges, we propose an end-to-end PMRR method based on a decoupled circle head detection algorithm (YOLOX-DC) and a Unet-like pure Transformer segmentation network (PM-SwinUnet). First, according to the characteristics of the pointer dial, the YOLOX-DC detection algorithm is designed based on the exceeding you only look once detector (YOLOX). The decoupled circle head of YOLOX-DC detects the pointer meter dial more accurately than the commonly used rectangular detection head. Second, the window multi-head attention of the PM-SwinUnet network enhances the feature extraction ability of pointer meter images and solves problems of missed scale detection and incomplete pointer segmentation. Additionally, the scale and pointer fitting module is introduced into the PM-SwinUnet to locate the accurate position of the scale and pointer. Finally, through the angle relationship between the pointer and the first two main scale lines, the pointer meter reading is accurately calculated by the improved angle method. Experimental results demonstrate the effectiveness and superiority of the proposed end-to-end method across three-pointer meter datasets. Furthermore, it provides a rapid and robust approach to the digital transformation of manufacturing systems.
As a practical application of Optical Character Recognition (OCR) for the digital situation, the digital instrument recognition is significant to achieve automatic information management in real-industrial scenarios. However, different from the normal digital recognition task such as license plate recognition, CAPTCHA recognition and handwritten digit recognition, the recognition task of multi-type digital instruments faces greater challenges due to the reading strings are variable-length with different fonts, different spacing and aspect ratios. In order to overcome this shortcoming, we propose a novel short-memory sequence-based model for variable-length reading recognition. First, we involve shortcut connection strategy into traditional convolutional structure to form a feature extractor for capturing effective features from characters with different fonts of multi-type digital instruments images. Then, we apply an RNN-based sequence module, which strengthens short-distance dependencies while reducing the long-distance trending memory of the reading string, to greatly improve the robustness and generalization of the model for invisible data. Finally, a novel short-memory sequence-based model consisting of a feature extractor, an RNN-based sequence module and the CTC, is proposed for variable-length reading recognition of multi-type digital instruments. Experimental results show that this method is effective on variable-length instrument reading recognition task, especially for invisible data, which proves that our method has outstanding generalization and robustness in real-industrial applications.
Instrument reading detection in industrial scenarios poses significant challenges due to reading contour distortion caused by perspective transformation in the instrument images. However, existing methods fail to accurately read the display automatically due to incorrect labeling of the target box vertices, which arises from the vertex entanglement problem. To address these challenges, a novel Quadrilateral Contour Disentangled Detection Network (QCDNet) is proposed in this paper, which utilizes the quadrilateral disentanglement idea. First, a Multi-scale Feature Pyramid Network (MsFPN) is proposed for effective feature extraction to improve model accuracy. Second, we propose a Polar Coordinate Decoupling Representation (PCDR), which models each side of the instrument contour using polar coordinates. Additionally, a loss function for the polar coordinate parameters is designed to aid the PCDR in more effectively decoupling the instrument reading contour. Finally, the experimental results on the instrument dataset demonstrate that QCDNet outperforms existing quadrilateral detection algorithms, with improvements of 4.07%, 1.8%, and 2.89% in Precision, Recall, and F-measure, respectively. These results confirm the effectiveness of QCDNet for instrument reading detection tasks.