A scalable approach for real-world implementation of deep reinforcement learning controllers in buildings based on online transfer learning: The HiLo case study
Copyright policy )A scalable approach for real-world implementation of deep reinforcement learning controllers in buildings based on online transfer learning: The HiLo case study
In recent years, Transfer Learning (TL) has emerged as a promising solution to scale Deep Reinforcement Learning (DRL) controllers for building energy management, addressing challenges related to DRL implementation as high data requirements and reliance on surrogate models. Moreover, most TL applications are limited to simulations, not revealing their real performance in actual buildings. This paper explores the implementation of an online TL methodology combining imitation learning and fine-tuning to transfer a DRL controller between two real office environments. Pre-trained in simulation using a calibrated digital twin, the DRL controller reduces energy consumption and improves indoor temperature control when managing the operation of a Thermally Activated Building System in one of the two offices both in simulation and in the real field. Afterwards, the DRL controller is transferred to the other office following the online TL methodology. The proposed approach outperforms a DRL controller implemented without pre-training, and Rule-Based and Proportional-Integral controllers, achieving energy savings between 6 and 40% and improving indoor temperature control between 30 and 50%. These findings underscore the efficacy of the online TL methodology as a viable solution to enhance the scalability of DRL controllers in real buildings.
Energy and Buildings, 329
ISSN:0378-7788
ISSN:1872-6178
- Technical University of Denmark Denmark
- ETH Zurich Switzerland
- University of California System United States
- Polytechnic University of Turin Italy
Real implementation, Deep reinforcement learning, Building & Construction, Built environment and design, Building HVAC control; Deep reinforcement learning; Energy efficiency; Real implementation; Transfer learning, Transfer learning; Real implementation; Deep reinforcement learning; Building HVAC control; Energy efficiency, Transfer learning, Engineering, /dk/atira/pure/sustainabledevelopmentgoals/affordable_and_clean_energy; name=SDG 7 - Affordable and Clean Energy, Energy efficiency, Building HVAC control, Built Environment and Design, Clinical Research, Architecture
Real implementation, Deep reinforcement learning, Building & Construction, Built environment and design, Building HVAC control; Deep reinforcement learning; Energy efficiency; Real implementation; Transfer learning, Transfer learning; Real implementation; Deep reinforcement learning; Building HVAC control; Energy efficiency, Transfer learning, Engineering, /dk/atira/pure/sustainabledevelopmentgoals/affordable_and_clean_energy; name=SDG 7 - Affordable and Clean Energy, Energy efficiency, Building HVAC control, Built Environment and Design, Clinical Research, Architecture
citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).2 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Average influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Average impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Average
Citations provided by BIP!Popularity provided by BIP!