This study investigated the influence of broadleaf and conifer vegetation on soil microbial communities in a distinct vertical distribution belt in Northeast China. Soil samples were taken at 0-5, 5-10 and 10-20 cm depths from four vegetation types at different altitudes, which were characterized by poplar (Populus davidiana) (1250-1300 m), poplar (P. davidiana) mixed with birch (Betula platyphylla) (1370-1550 m), birch (B. platyphylla) (1550-1720 m), and larch (Larix principis-rupprechtii) (1840-1890 m). Microbial biomass and community structure were determined using the fumigation-extraction method and phospholipid fatty acid (PLFA) analysis, and soil fungal community level physiological profiles (CLPP) were characterized using Biolog FF Microplates. It was found that soil properties, especially soil organic carbon and water content, contributed significantly to the variations in soil microbes. With increasing soil depth, the soil microbial biomass, fungal biomass, and fungal catabolic ability diminished; however, the ratio of fungi to bacteria increased. The fungal ratio was higher under larch forests compared to that under poplar, birch, and their mixed forests, although the soil microbial biomass was lower. The direct contribution of vegetation types to the soil microbial community variation was 12%. If the indirect contribution through soil organic carbon was included, variations in the vegetation type had substantial influences on soil microbial composition and diversity.