In the present work, a novel hybrid solar-based smart building energy system is introduced and studied. The system comprises innovative photovoltaic-thermal-cooling (PVTC) panels integrated with hot and cold storages with two-way interaction with electricity, heat, and cooling networks (if any). The proposed system is compared with PV-based systems integrated with battery and heat pump for a case study complex building in Aarhus, Denmark. The comparison is conducted by evaluating the performance and economic indicators and investigating the effect of significant parameters on each scenario via a parametric study. Furthermore, the optimal operating conditions and sizing of the proposed system are determined using the genetic algorithm method considering initial cost and traded energy with local energy networks as the objective functions. The comparison results show that the proposed solution is the most cost-effective scenario with the lowest initial cost of about 457,000 $ and a payback period of 6.6 years. This is mainly due to the simultaneous interaction with electricity/heat/cooling networks as well as the elimination of the battery and the heat pump, which are offered by the proposed scenario. It is shown that, in comparison to PV panels, the PVTC can produce 328.7 MWh and 125.6 MWh extra heat and cooling annually. The scatter distribution of significant parameters shows that the panel area and heat storage capacity are not sensitive parameters, and keeping the cold storage capacity at the lower bound is a techno-economically better option.