(1) Background: Islands are relatively independent and fragile ecosystems with unique habitats. Studying the relatively stable semi-natural plant communities on islands can enrich island vegetation data and provide an understanding of the factors affecting species diversity and distribution. (2) Methods: The semi-natural plant communities on Langqi Island (LI) in Fujian Province were sampled, and the redundancy method was used to analyze the correlation between species diversity, community distribution, and environmental factors. (3) Results: (i) There were 432 species of vascular plants, with 306 genera and 110 families; (ii) the semi-natural plant communities consisted of three vegetation types, 10 formations, and 10 clusters; (iii) the species diversity indices of the semi-natural plant communities presented a trend of gradually decreasing along the shrub, tree, and herb layers. Different formations varied in terms of the species diversity index; and (iv) the soil total potassium and nitrogen contents significantly affected the species diversity of the LI semi-natural plant communities, whereas the pH, soil TN content, organic matter content, AK content, and altitude significantly affected the community distribution. (4) Conclusions: Selecting appropriate tree species for mixed forests based on plant characteristics and regional conditions, together with regulating the soil nutrient content, can improve the species diversity of semi-natural plant communities.