Rice, a staple food crop worldwide, is pivotal in agricultural productivity and public health. Automatic classification of typical rice pests and diseases is crucial for optimizing rice yield and quality in practical production. However, infrequent occurrences of specific pests and diseases lead to uneven dataset samples and similar early-stage symptoms, posing challenges for effective identification methods. In this study, we employ four image enhancement techniques—flipping, modifying saturation, modifying contrast, and adding blur—to balance dataset samples throughout the classification process. Simultaneously, we enhance the basic RepVGG model by incorporating the ECA attention mechanism within the Block and after the Head, resulting in the proposal of a new classification model, RepVGG_ECA. The model successfully classifies six categories: five types of typical pests and diseases, along with healthy rice plants, achieving a classification accuracy of 97.06%, outperforming ResNet34, ResNeXt50, Shufflenet V2, and the basic RepVGG by 1.85%, 1.18%, 3.39%, and 1.09%, respectively. Furthermore, the ablation study demonstrates that optimal classification results are attained by integrating the ECA attention mechanism after the Head and within the Block of RepVGG. As a result, the classification method presented in this study provides a valuable reference for identifying typical rice pests and diseases.