Radiative cooling (RC) is attracting more interest from building engineers and architects. Using the sky as the heat sink, a radiative cooling material can be passively cooled by emitting heat to the sky. As a result of the development of material technology, RC research has been revived, with the aim of increasing the materials’ cooling power as well as finding reliable ways to utilize it in cooling for buildings. This review identifies some issues in the current implementation of RC technologies in buildings from an architectural point of view. Besides the technical performance of the RC technologies, some architectural aspects, such as integration with architectural features, aesthetic requirements, as well as fully passive implementations of RC, also need to be considered for building application. In addition, performance evaluation of a building-integrated RC system should begin to account for its benefit to the occupant’s health and comfort alongside the technical performance. In conclusion, this review on RC implementation in buildings provides a meaningful discussion in regard to the direction of the research.