Yellow phosphorus slag has been considered as a potential cement substitute for mine filling material due to its cementing activity; however, its slow setting and low early strength have limited broader use. This study investigates the grading, compactness, and strength of yellow phosphorus slag combined with tailing sand. Using yellow phosphorus slag as an aggregate, cement as a binder, and mixing tailing sand in different ratios, this study evaluates its feasibility as a coarse aggregate in mine backfill. The key findings are as follows. (1) The grading index of tailing sand was 0.5, aligning with Fuller grading, but it required mixing with coarse aggregates to enhance strength and reduce cement consumption. Yellow phosphorus slag, with a grading index of 0.97, does not match Fuller’s curve and thus benefits from mixing with tailing sand. (2) For mixtures of waste rock and tailings, the 5:5 ratio aligned closely with Fuller’s theory, showing optimal packing density and strength. Mixtures of yellow phosphorus slag and tailings at ratios of 3:7, 4:6, and 5:5 had R² values of 0.73, 0.80, and 0.85, respectively, confirming reliable fit. The 5:5 mixture provided the best packing density and strength. (3) A new strength prediction model, accounting for aggregate, cement, and water effects, suggests that a 5:5 ratio with a 71% mass concentration and 1/7 ash–sand ratio meets industrial strength requirements. FLAC3D simulations indicated that cemented backfill reduces stress concentrations caused by excavation and supports stability during mining while also absorbing energy through compaction, creating favorable conditions for safe mining operations.

As open-pit mining extends to greater depths, slope stability is becoming a critical factor in ensuring safe production. This issue is particularly pronounced in geological settings with weak interlayers, where sudden slope failures are more likely to occur, demanding precise and reliable stability assessment methods. In this study, a typical open-pit slope with weak interlayers was investigated. Acoustic testing and ground-penetrating radar were employed to identify rock mass structural features and delineate loose zones, enabling detailed rock mass zoning and the development of numerical simulation models for stability analysis. The results indicate that (1) the slope exhibits poor overall integrity, dominated by blocky to fragmented structures with well-developed joints and significant weak interlayers, posing a severe threat to stability; (2) in the absence of support, the slope’s dissipated energy, displacement, and plastic zone volume all exceeded the failure threshold (Δ < 0), and the safety factor was only 0.962, indicating a near-failure state; after implementing support measures, the safety factor increased to 1.31, demonstrating a significant improvement in stability; (3) prior to excavation, the energy damage index (ds) in the 1195–1240 m platform zone reached 0.82, which dropped to 0.48 after reinforcement, confirming the effectiveness of support in reducing energy damage and enhancing slope stability; (4) field monitoring data of displacement and anchor rod forces further validated the stabilizing effect of the support system, providing strong assurance for safe mine operation. By integrating cusp catastrophe theory with energy-based analysis, this study establishes a comprehensive evaluation framework for slope stability under complex geological conditions, offering substantial practical value for deep open-pit mining projects.