Summary: Although protists occupy a vast range of habitats and are known to interact with plants among other things via disease suppression, competition or growth stimulation, their contributions to the ‘phytobiome’ are not well described. To contribute to a more comprehensive picture of the plant holobiont, we examined cercozoan and oomycete taxa living in association with the model plant Arabidopsis thaliana grown in two different soils. Soil, roots, leaves and wooden toothpicks were analysed before and after surface sterilization. Cercozoa were identified using 18S rRNA gene metabarcoding, whereas the Internal Transcribed Spacer 1 was used to determine oomycetes. Subsequent analyses revealed strong spatial structuring of protist communities between compartments, although oomycetes appeared more specialized than Cercozoa. With regards to oomycetes, only members of the Peronosporales and taxa belonging to the genus Globisporangium were identified as shared members of the A. thaliana microbiome. This also applied to cercozoan taxa belonging to the Glissomonadida and Cercomonadida. We identified a strong influence by edaphic factors on the rhizosphere, but not for the phyllosphere. Distinct differences of Cercozoa found preferably in wood or fresh plant material imply specific niche adaptations. Our results highlight the importance of micro‐eukaryotes for the plant holobiont.