Microbiomes are important for crop performance. However, a deeper knowledge of crop-associated microbial communities is needed to harness beneficial host-microbe interactions. Here, by assessing the assembly and functions of maize microbiomes across soil types, climate zones, and genotypes, we found that the stem xylem selectively recruits highly conserved microbes dominated by Gammaproteobacteria. We showed that the proportion of bacterial taxa carrying the nitrogenase gene (nifH) was larger in stem xylem than in other organs such as root and leaf endosphere. Of the 25 core bacterial taxa identified in xylem sap, several isolated strains were confirmed to be active nitrogen-fixers or to assist with biological nitrogen fixation. On this basis, we established synthetic communities (SynComs) consisting of two core diazotrophs and two helpers. GFP-tagged strains and ¹⁵N isotopic dilution method demonstrated that these SynComs do thrive and contribute, through biological nitrogen fixation, 11.8% of the total N accumulated in maize stems. These core taxa in xylem sap represent an untapped resource that can be exploited to increase crop productivity.