SummaryLandscape heterogeneity impacts community assembly in animals and plants, but it is not clear if this ecological concept extends to microbes. To examine this question, we chose to investigate polar soil environments from the Antarctic and Arctic, where microbes often form the major component of biomass. We examined soil environments that ranged in connectivity from relatively well‐connected slopes to patchy, fragmented landforms that comprised isolated frost boils. We found landscape connectedness to have a significant correlation with microbial community structure and connectivity, as measured by co‐occurrence networks. Soils from within fragmented landforms appeared to exhibit less local environmental heterogeneity, harboured more similar communities, but fewer biological associations than connected landforms. This effect was observed at both poles, despite the geographical distances and ecological differences between them. We suggest that microbial communities inhabiting well‐connected landscape elements respond consistently to regional‐scale gradients in biotic and edaphic factors. Conversely, the repeated freeze thaw cycles that characterize fragmented landscapes create barriers within the landscape and act to homogenize the soil environment within individual frost boils and consequently the microbial communities. We propose that lower microbial connectivity in the fragmented landforms is a function of smaller patch size and continual disturbances following soil mixing.