Soil is composed of a mosaic of different rocks and minerals, usually considered as an inert substrata for microbial colonization. However, recent findings suggest that minerals, in soils and elsewhere, favour the development of specific microbial communities according to their mineralogy, nutritive content, and weatherability. Based upon recent studies, we highlight how bacterial communities are distributed on the surface of, and in close proximity to, minerals. We also consider the potential role of the mineral-associated bacterial communities in mineral weathering and nutrient cycling in soils, with a specific focus on nutrient-poor and acidic forest ecosystems. We propose to define this microbial habitat as the mineralosphere, where key drivers of the microbial communities are the physicochemical properties of the minerals.