• Energy Research

The efficient control of HVAC devices in building structures is mandatory for achieving energy savings and comfort. To balance these objectives efficiently, it is essential to incorporate adequate advanced control strategies to adapt to varying environmental conditions and occupant preferences. Model-free control approaches for building HVAC systems have gained significant interest due to their flexibility and ability to adapt to complex, dynamic systems without relying on explicit mathematical models. The current review presents the recent advancements in HVAC control, with an emphasis on reinforcement learning, artificial neural networks, fuzzy logic control, and their hybrid integration with other model-free algorithms. The main focus of this study is a literature review of the most notable research from 2015 to 2023, highlighting the most highly cited applications and their contributions to the field. After analyzing the concept of each work according to its control strategy, a detailed evaluation across different thematic areas is conducted. To this end, the prevalence of methodologies, utilization of different HVAC equipment, and diverse testbed features, such as building zoning and utilization, are further discussed considering the entire body of work to identify different patterns and trends in the field of model-free HVAC control. Last but not least, based on a detailed evaluation of the research in the field, the current work provides future directions for model-free HVAC control considering different aspects and thematic areas.

The current paper presents a comprehensive review analysis of Multi-agent control methodologies for Integrated Building Energy Management Systems (IBEMSs), considering combinations of multi-diverse equipment such as Heating, Ventilation, and Air conditioning (HVAC), domestic hot water (DHW), lighting systems (LS), renewable energy sources (RES), energy storage systems (ESS) as well as electric vehicles (EVs), integrated at the building level. Grounded in the evaluation of key control methodologies—such as Model Predictive Control (MPC) and reinforcement learning (RL) along with their synergistic hybrid integration—the current study integrates a large number of impactful applications of the last decade and evaluates their contribution to the field of energy management in buildings. To this end, over seventy key scholarly papers from the 2014–2024 period have been integrated and analyzed to provide a holistic evaluation on different areas of interest, including the utilized algorithms, agent interactions, energy system types, building typologies, application types and simulation tools. Moreover, by analyzing the latest advancements in the field, a fruitful trend identification is conducted in the realm of multi-agent control for IBEMS frameworks, highlighting the most prominent solutions to achieve sustainability and energy efficiency.

Abstract Considerable research efforts in Building Optimization and Control (BOC) have been directed toward the development of “plug-and-play” BOC systems that can achieve energy efficiency without compromising thermal comfort and without the need of qualified personnel engaged in a tedious and time-consuming manual fine-tuning phase. In this paper, we report on how a recently introduced Parametrized Cognitive Adaptive Optimization – abbreviated as PCAO – can be used toward the design of both model-based and model-free “plug-and-play” BOC systems, with minimum human effort required to accomplish the design. In the model-based case, PCAO assesses the performance of its control strategy via a simulation model of the building dynamics; in the model-free case, PCAO optimizes its control strategy without relying on any model of the building dynamics. Extensive simulation and real-life experiments performed on a 10-office building demonstrate the effectiveness of the PCAO–BOC system in providing significant energy efficiency and improved thermal comfort. The mechanisms embedded within PCAO render it capable of automatically and quickly learning an efficient BOC strategy either in the presence of complex nonlinear simulation models of the building dynamics (model-based) or when no model for the building dynamics is available (model-free). Comparative studies with alternative state-of-the-art BOC systems show the effectiveness of the PCAO–BOC solution.

Abstract Building energy consumption used for internal heating and cooling purposes is one of the most viral research topics. Retrofitting and renovation activities in building applications aim towards utilizing modern construction materials, with improved thermal and insulation characteristics. It is more than evident that such an approach leads to an improved thermal shield for the building (improving passive building elements). In addition well calibrated rule based control designs are also being adopted in the last decades as a way to improve the energy efficiency in buildings (improving active elements management). Both of the above approaches though are considered as time static since disturbances with high uncertainty (weather conditions, human presence and activity) along with the unavoidable construction material aging phenomena affect building behavior and HVAC dynamics. As a result control recalibration activities seem more than necessary to maintain energy efficiency. Followed by the rapid evolution in the computing machines sector and simulation software kits, research effort has been focused on model-assisted and co-simulation based control strategies which utilize the available computational power of modern machines towards improving energy efficiency and comfort levels through appropriate design Building Optimization and Control (BOC) systems, utilizing available system models. However the main drawback in model-assisted strategies is the fact that they heavily rely on the available building model which requires a tedious offline pre-application period including many simulation tests and/or field experiments so as to fine tune and tailor manually the model and consequently the control logic implemented. Moreover, no matter how elaborate the building model is, aging characteristics and uncertain disturbances are factors which call for re-designing (periodically) the available simulation model and the respective control strategies. This paper considers an alternative approach to BOC system design. The main attribute of the proposed methodology is that it can provide automated fine-tuning of the BOC system: no human intervention or a simulation model are required for the initial deployment of the controller as well as for the continuously applied fine-tuning procedure. Real-life experiments performed in a highly energy demanding building in Tel Aviv Israel, during spring time, demonstrate that the proposed approach can effectively provide intelligent decisions that none of the currently employed rule/event-based strategy can replicate.

Abstract A variety of novel, recyclable and reusable, construction materials has already been studied within literature during the past years, aiming at improving the overall energy efficiency ranking of the building envelope. However, several studies show that a delicate control of indoor climating elements can lead to a significant performance improvement by exploiting the building’s savings potential via smart adaptive HVAC regulation to exogenous uncertain disturbances (e.g. weather, occupancy). Building Optimization and Control (BOC) systems can be categorized into two different groups: centralized (requiring high data transmission rates at a central node from every corner of the overall system) and decentralized 1 (assuming an intercommunication among neighboring constituent systems). Moreover, both approaches can be further divided into two subcategories, respectively: model-assisted (usually introducing modeling oversimplifications) and model-free (typically presenting poor stability and very slow convergence rates). This paper presents the application of a novel, decentralized, agent-based , model-free BOC methodology (abbreviated as L4GPCAO) to a modern non-residential building (E.ON. Energy Research Center’s main building), equipped with controllable HVAC systems and renewable energy sources by utilizing the existing Building Management System (BES). The building testbed is located inside the RWTH Aachen University campus in Aachen, Germany. A combined rule criterion composed of the non-renewable energy consumption (NREC) and the thermal comfort index – aligned to international comfort standards – was adopted in all cases presented herein. Besides the limited availability of the specified building testbed, real-life experiments demonstrated operational effectiveness of the proposed approach in BOC applications with complex, emerging dynamics arising from the building’s occupancy and thermal characteristics. L4GPCAO outperformed the control strategy that was designed by the planers and system provider, in a conventional manner, requiring no more than five test days.

Modern literature exhibits numerous centralized control approaches—event-based or model assisted—for tackling poor energy performance in buildings. Unfortunately, even novel building optimization and control (BOC) strategies commonly suffer from complexity and scalability issues as well as uncertain behavior as concerns large-scale building ecosystems—a fact that hinders their practical compatibility and broader applicability. Moreover, decentralized optimization and control approaches trying to resolve scalability and complexity issues have also been proposed in literature. Those approaches usually suffer from modeling issues, utilizing an analytically available formula for the overall performance index. Motivated by the complications in existing strategies for BOC applications, a novel, decentralized, optimization and control approach—referred to as Local for Global Parameterized Cognitive Adaptive Optimization (L4GPCAO)—has been extensively evaluated in a simulative environment, contrary to previous constrained real-life studies. The current study utilizes an elaborate simulative environment for evaluating the efficiency of L4GPCAO; extensive simulation tests exposed the efficiency of L4GPCAO compared to the already evaluated centralized optimization strategy (PCAO) and the commercial control strategy that is adopted in the BOC practice (common reference case). L4GPCAO achieved a quite similar performance in comparison to PCAO (with 25% less control parameters at a local scale), while both PCAO and L4GPCAO significantly outperformed the reference BOC practice.

The existing literature on energy saving focuses on large-scale buildings, wherein the energy-saving potential is substantially larger than smaller-scale buildings. However, the research intensity is significantly less for small-scale deployments and their capacities to regulate energy use individually, directly and without depreciating users’ comfort and needs. The current research effort focused on energy saving and user satisfaction, concerning a low-cost—yet technically sophisticated—methodology for controlling conventional residential HVAC units through cheap yet reliable actuation and sensing and auxiliary IoT equipment. The basic ingredients of the proposed experimental methodology involve a conventional A/C unit, an Arduino microcontroller, typical wireless IoT sensors and actuators, a configured graphical environment and a sophisticated, model-free, optimization-and-control algorithm (PCAO) that portrays the ground basis for achieving improved performance results in comparison with conventional methods. The main goal of this study was to produce a system that would adequately and expeditiously achieve energy savings by utilizing minimal hardware/equipment (affordability). The system was designed to be easily expandable in terms of new units or thermal equipment (expandability) and also to be autonomous, requiring zero user interventions at the experimental site (automation). The real-life measurements were collected over two different seasonal periods of the year (winter, summer) and concerned a conventional apartment in the city of Xanthi, Northern Greece, where summers and winters exhibit quite diverse climate characteristics. The final results revealed the increased efficiency of PCAO’s optimization in comparison with a conventional rule-based control strategy (RBC), as concerns energy savings and user satisfaction.

ANNs have become a cornerstone in efficiently managing building energy management systems (BEMSs) as they offer advanced capabilities for prediction, control, and optimization. This paper offers a detailed review of recent, significant research in this domain, highlighting the use of ANNs in optimizing key energy systems, such as HVAC systems, domestic water heating (DHW) systems, lighting systems (LSs), and renewable energy sources (RESs), which have been integrated into the building environment. After illustrating the conceptual background of the most common ANN architectures for controlling BEMSs, the current work dives deep into relative research applications, thereby exhibiting their methodology and outcomes. By summarizing the numerous impactful applications during 2015–2023, this paper categorizes the predominant ANN-based techniques according to their methodological approach, specific energy equipment, and experimental setups. Grounded in the different perspectives that the integrated studies illustrate, the primary focus of this paper is to evaluate the overall status of ANN-driven control in building energy management, as well as to offer a deep understanding of the prevailing trends at the building level. Leveraging detailed graphical depictions and comparisons between different concepts, future directions, and fruitful conclusions are drawn, and the upcoming innovations of ANN-based control frameworks in BEMSs are highlighted.

Microgrids equipped with small-scale renewable-energy generation systems and energy storage units offer challenging opportunity from a control point of view. In fact, in order to improve resilience and enable islanded mode, micro-grid energy management systems must dynamically manage controllable loads by considering not only matching energy generation and consumption, but also thermal comfort of the occupants. Thermal comfort, which is often neglected or oversimplified, plays a major role in dynamic demand response, especially in front of intermittent behavior of the renewable energy sources. This paper presents a novel control algorithm for joint demand response management and thermal comfort optimization in a microgrid composed of a block of buildings, a photovoltaic array, a wind turbine, and an energy storage unit. In order to address the large-scale nature of the problem, the proposed control strategy adopt a two-level supervisory strategy: at the lower level, each building employs a local controller that processes only local measurements; at the upper level, a centralized unit supervises and updates the three controllers with the aim of minimizing the aggregate energy cost and thermal discomfort of the microgrid. Comparisons with alternative strategies reveal that the proposed supervisory strategy efficiently manages the demand response so as to sensibly improve independence of the microgrid with respect to the main grid, and guarantees at the same time thermal comfort of the occupants.