In this work, we propose a distributed user association and resource allocation scheme for the wireless virtualized information-centric networks with hybrid energy supply, where the base station (BS) equipped with caching and energy harvesting capabilities to reduce the COPEX and OPEX cost. In particular, with the objective to obtain the utility maximization for the network operators, a joint user association, caching, spectrum and power problem is presented. To tackle the formulated mixed combinatorial and non-convex optimization problem with low complexity, the original problem is divided into two subproblems and we propose an alternating direction method of multipliers (ADMM)-based distributed algorithm to address them efficiently and effectively. Extensive simulation studies demonstrate the advantages of our presented system architecture and proposed schemes.