Studies addressing the role of large herbivores on nitrogen cycling in grasslands have suggested that the direction of effects depends on soil fertility. Via selection for high quality plant species and input of dung and urine, large herbivores have been shown to speed up nitrogen cycling in fertile grassland soils while slowing down nitrogen cycling in unfertile soils. However, recent studies show that large herbivores can reduce nitrogen mineralization in some temperate fertile soils, but not in others. To explain this, we hypothesize that large herbivores can reduce nitrogen mineralization in loamy or clay soils through soil compaction, but not in sandy soils. Especially under wet conditions, strong compaction in clay soils can lead to periods of soil anoxia, which reduces decomposition of soil organic matter and, hence, N mineralization. In this study, we use a long-term (37-year) field experiment on a salt marsh to investigate the hypothesis that the effect of large herbivores on nitrogen mineralization depends on soil texture. Our results confirm that the presence of large herbivores decreased nitrogen mineralization rate in a clay soil, but not in a sandy soil. By comparing a hand-mown treatment with a herbivore-grazed treatment, we show that these differences can be attributed to herbivore-induced changes in soil physical properties rather than to above-ground biomass removal. On clay soil, we find that large herbivores increase the soil water-filled porosity, induce more negative soil redox potentials, reduce soil macrofauna abundance, and reduce decomposition activity. On sandy soil, we observe no changes in these variables in response to grazing. We conclude that effects of large herbivores on nitrogen mineralization cannot be understood without taking soil texture, soil moisture, and feedbacks through soil macrofauna into account.