Rising cocoa prices and supply instability have increased interest in alternative ingredients for chocolate-flavored foods. This study evaluated olive pomace flour (OPF), obtained from Arbequina olive pomace by drying, milling and sieving (<0.60 mm), as a partial replacer of cocoa powder in chocolate muffins. Compared with cocoa powder, OPF contained 49% more insoluble fiber (46.09 g 100 g−1), 76% more lipids (21.31 g 100 g−1) and about half the protein (12.37 g 100 g−1). A control and a formulation with 25% of the cocoa powder replaced by OPF were produced in three independent batches and compared for physical properties, crumb structure and sensory acceptance (206 consumers). No significant differences were detected in baking loss, volume, water activity, springiness or crumb cell parameters. OPF muffins showed higher moisture (32.5 vs. 30.4%) and lower firmness during storage. The OPF crumb tended to be lighter and more yellowish (ΔE* ≈ 3.1), but this difference was not significant after correction for multiple comparisons, and the crust color difference was below the visual perception threshold (ΔE* ≈ 0.4). Sensory acceptance was statistically equivalent between formulations (7.23 vs. 7.13; equivalence margin ±0.5 points), and 90% of consumers scored the OPF muffin in the acceptance zone (6–9). Under the conditions evaluated, partial replacement of cocoa powder with OPF was technologically feasible and well accepted.