Rock fracture behavior is strongly influenced by grain size and boundary effects, which complicate the determination of fracture parameters and the interpretation of size-dependent failure. This study investigates the fracture behavior of sandstone and diorite within the framework of the boundary effect model (BEM) using three-point bending tests, acoustic emission (AE), and digital image correlation (DIC). By varying the prefabricated crack length, different values of the structural geometric parameters a_e were obtained, and the fracture toughness K_IC and tensile strength f_t were identified by regression analysis. The results show that K_IC = 0.6841 MPa·m^0.5 and f_t = 4.5625 MPa for sandstone, whereas K_IC = 2.7233 MPa·m^0.5 and f_t = 21.8218 MPa for diorite. Increasing the prefabricated crack length reduces the peak load and prolongs the pre-peak damage evolution stage. Diorite, with a larger average grain size, exhibits higher AE energy release, a higher proportion of high-energy AE events, and a larger fracture process zone (FPZ) than sandstone. Moreover, the AE energy distribution along the crack propagation direction shows a distinct “three-stage” characteristic, consistent with the non-uniform distribution of local fracture energy g_f predicted by boundary effect theory. The results indicate that BEM can reasonably characterize the fracture behavior of rocks with different grain sizes, and the identified material parameters can be used to construct a BEM-based structural failure curve for estimating nominal failure stress over a wider range of structural geometric parameters.