Soil characteristics, land management practices, and plant genotypes influence arbuscular mycorrhizal fungi (AMF) communities, leading to the proliferation of AMF taxa with different growth and nutritional outcomes in their hosts. However, the specific patterns driving these relationships are still not well understood. This study aimed to (1) evaluate the influence of soil characteristics, land use, and rootstock on AMF diversity and community structure and (2) assess the effect of those AMF communities on grapevine growth and nutrition. Soil samples were collected from vineyard and non-agricultural areas in Lisbon and Pegões, Portugal, and trap cultures established using Richter 110 and 1103 Paulsen rootstocks. After 3.5 months growth under greenhouse conditions, root-associated AMF communities were assessed by amplicon metagenomic sequencing using AMF-specific primers. Alpha diversity was only influenced by the soil type, while in β-diversity, an interaction was found between the soil type and land use. Both diversity measures were positively correlated with foliar K and negatively with leaf Mn and Mg. Notably, the concentrations of these nutrients were highly correlated with the relative abundance of operational taxonomic units (OTUs) within the genera Glomus, Rhizophagus, and Claroideoglomus. These results are valuable for supporting AMF selection for improved plant nutrition based on varying soil types and land uses.