In unstructured environments, terrain perception is essential for stability and environmental awareness of Quadruped robot locomotion. Existing approaches primarily rely on visual or proprioceptive signals, but their effectiveness is limited under conditions of visual occlusion or ambiguous terrain features. To address this, this study proposes a multimodal terrain perception method that integrates acoustic features with proprioceptive signals. This terrain perception method collects environmental acoustic information through an externally mounted sound sensor, and combines the sound signal with proprioceptive sensor data from IMU and joint encoder of the quadruped robot. The method was deployed on the quadruped robot Lite2 platform developed by Deep Robotics, and experiments were conducted on four representative terrain types: concrete, gravel, sand, and carpet. Mel-spectrogram features are extracted from the acoustic signals and concatenated with the IMU and joint encoder to form feature vectors, which are subsequently fed into a support vector machine for terrain classification. For each terrain type, 400 s of data were collected. Experimental results show that the terrain classification accuracy reaches 78.28% without using acoustic signals, while increasing to 82.52% when acoustic features are incorporated. To further enhance the classification performance, this study performs a combined exploration of the SVM hyperparameters and as well as the time-window length . The final results demonstrate that the classification accuracy can be improved to as high as 99.53% across all four terrains.
Robotic visual perception and terrain recognition are critical for autonomous locomotion and adaptive control in complex environments. However, existing models often extract weak features, confuse classes, and deliver unstable recognition. Most prior studies use end-to-end convolutional networks or single-stream feature extraction, which limits the balance between fine-grained visual representation and adaptive discrimination of confusing samples. To solve this problem, this paper proposes a vision model that blends attention mechanisms with a confusion augmentation strategy. Using an improved ResNet50 backbone, we add a local feature sharpening module and a channel–spatial attention module to strengthen edge texture and global context representation. We also design a confusion augmentation strategy based on the similarity of hard samples. It generates mixed samples through cross-perturbation in feature space, thereby improving the discrimination of highly similar terrains. Experiments show that our model achieves an accuracy of over 98.19% on various terrains, including cement, asphalt, sand, and snow. t-SNE visualization and Grad-CAM analysis demonstrate clear class separability and good interpretability, confirming the effectiveness and robustness of the approach for robotic terrain recognition.