To investigate and analyze the influence of different stress environments on the deformation and destabilization of the rocks surrounding laminated roadways under high stress, this study conducted numerical simulations of coal–rock combination under different circumferential pressures and of the surrounding rocks of highly stressed laminated roadways under different lateral pressure coefficients. In addition, a new custom constitutive structure model was constructed based on the Mohr–Coulomb criterion and realized in FLAC3D software by combining field working conditions. The model was then developed in FLAC3D software for a second time. The results show that the calculated results of the model in this study are in good agreement with the experimental results and the errors are small, while the calculated results of the Mohr–Coulomb model differ from the experimental values under two types of surrounding rock pressure. The deformation of the Mohr–Coulomb model is significantly smaller than that of the customized model, which verifies the reasonableness and superiority of the self-built model in combination with the field conditions. This provides theoretical and practical bases for the design and optimization of stratigraphic roadway support in underground coal mines.

To investigate the deformation and damage characteristics of internal coal bodies of small pillars under different pressures, rock–coal–rock assemblage samples were subjected to the conventional triaxial compression test to analyze the mechanical behavior characteristics under different pressures. The results showed that, with the increase in peripheral pressure, the peak strength and modulus of elasticity of the assemblage specimens increased, the range of fracture compaction stage gradually decreased, and the specimen was gradually transformed from brittle to ductile. With an increase in peripheral pressure, the residual strength gradually increased, and the strength decay coefficient gradually decreased. The strength decay coefficient decreased the most at 0–10 MPa, and this decrease slowed down after exceeding 15 MPa. When the peripheral pressure was 0 MPa, the damage degree of the coal pillar was larger. With the increase in peripheral pressure, the number of cracks in the coal column increased, the damage degree increased more, and mixed damage characteristics of tension–shear were found. Based on the Hoek–Brown criterion, the strength criterion applicable to the specimen of rock–coal–rock combination was obtained through numerical fitting iteration, which provides an experimental and theoretical basis for realizing the stability control of small coal columns.