Clay brick is a commonly used building material in China. Due to the enormous land destruction and excessive consumption of resources, such as materials and energy in the manufacture of clay brick, it is important to study its overall sustainability, i.e., in terms of impact on the environment, services, and economy. In this study, emergy analysis is employed, which offers a holistic perspective, unlike typical environmental studies. A series of emergy indices such as renewability rate (R%), nonrenewability rate (N%), unit emergy values (UEVs), emergy yield ratio (EYR), environmental loading ratio (ELR), and emergy sustainability index (ESI) were used to study manufacturing of clay brick. In addition to calculating UEVs of clay brick manufacturing in China (7.18 × 1012 sej/kg), our detailed analysis shows that the nonrenewable resources and imported energy have a dominant impact on the emergy contribution (50.6%) and within the nonrenewable resources, clay is the foremost item, accounting for 33.5% of local emergy inputs. Given different electricity UEVs, the change ranges of clay brick system UEVs are 14.9% (scenario 1), 7.24% (scenario 2), 8.91% (scenario 3), and 6.94% (scenario 4). Furthermore, several policy suggestions are discussed for improving the sustainability of the evaluated system, involving the energy structure adjustment, recycling material replacement, and promotion of energy-saving systems.