The present work aimed to investigate the dry sliding wear behaviors of hybrid polymer matrix composites made up of Kevlar, bamboo, palm, and Aloe vera as reinforcement materials of varying stacking sequences, along with epoxy as the matrix material. Three combinations of composite laminates with different stacking sequences such as AB, BC, and CA were fabricated by a vacuum-assisted compression molding process. The influence of composite laminates fabricated through various stacking sequences and dry sliding wear test variables such as load, sliding distance, and sliding velocity on the specific wear rate and co-efficient of friction were investigated. Experiments were designed and statistical validation was performed through response surface methodology-based D-optimal design and analysis of variance. The optimization was performed using grey relational analysis (GRA) to identify the optimal parameters to enhance the wear resistance of hybrid polymer composites under dry sliding conditions. The optimal parameters, such as composite combinations of CA, a load of 5 N, a sliding velocity of 3 m/s, and a sliding distance of 1500 m, were obtained. Furthermore, the morphologies of worn-out surfaces were investigated using SEM analysis.