Lignin is crucial to the formation of fruit texture quality. Here, we aimed to explore the relationship between lignin metabolism and fruit texture by investigating the lignin content, total phenols and their related enzyme activities among three Chinese olive (Canarium album (Lour.) Raeusch) genotypes. Our results showed that lignin deposition moved from the exocarp to the flesh in Chinese olive fruit. The lignin, total phenols and enzyme activities were all different between the three Chinese olive cultivars at each developmental stage. The lignin content was positively correlated with the PAL, 4CL and POD activities. These results demonstrated that lignin metabolism was regulated through the related enzyme activities. Therefore, our findings may provide insight to facilitate further improvement in fruit texture quality in Chinese olive.