The impacts of plant species on the microbial communities and physico-chemical characteristics of soil are well documented for many herbs, grasses and legumes but much less so for tree species. Here, we investigate by rRNA and ITS amplicon sequencing the diversity of microorganisms from the three domains of life (Archaea, Bacteria and Eukaryota: Fungi) in soil samples taken from the forest experimental site of Breuil-Chenue (France). We discovered significant differences in the abundance, composition and structure of the microbial communities associated with two phylogenetically distant tree species of the same age, deciduous European beech (Fagus sylvatica) and coniferous Norway spruce (Picea abies Karst), planted in the same soil. Our results suggest a significant effect of tree species on soil microbiota though in different ways for each of the three microbial groups. Fungal and archaeal community structures and compositions are mainly determined according to tree species, whereas bacterial communities differ to a great degree between rhizosphere and bulk soils, regardless of the tree species. These results were confirmed by quantitative PCR, which revealed significant enrichment of specific bacterial genera, such as Burkholderia and Collimonas, known for their ability to weather minerals within the tree root vicinity.