• Energy Research
• Restricted close
• Embargo close
• DE close
• EU close
• BE close

Effectively incorporating external advice is an important problem in reinforcement learning, especially as it moves into the real world. Potential-based reward shaping is a way to provide the agent with a specific form of additional reward, with the guarantee of policy invariance. In this work we give a novel way to incorporate an arbitrary reward function with the same guarantee, by implicitly translating it into the specific form of dynamic advice potentials, which are maintained as an auxiliary value function learnt at the same time. We show that advice provided in this way captures the input reward function in expectation, and demonstrate its efficacy empirically.

Shallow Geothermal Systems (SGS) are widely used to provide low-cost heating and cooling of residential and commercial buildings. SGS can be an economically-viable solution even for commercial buildings, where controlled temperature is fundamental for the production processes. To assess the thermal resistance of the soil and the performance of a SGS, Thermal Response Tests (TRT) must be performed. TRT machines are today designed mainly for short term monitoring, for relatively deep SGS (up to 200 m) and for being used by expert operators. Lightweight, low-cost machines for both fast and long term, reliable and unattended TRT for very Shallow Geothermal Systems (vSGS) are not available today. This paper describes the design of a micro-TRT machine (mTRT) for vSGS, which is gaining interest in the civil engineering, environmental, energy and food chain sectors. The paper describes the features of the wireless monitoring system, the design choices to achieve the required accuracy and the software developed for adding remote control capability. Experimental validation in a real test field demonstrates the quality of measurements collected for analysing the TRT data.

China joined the ICOM in 1983. Joining such an international community of museological experts and scholars implied sharing the standards and founding principles, however if we consider the development and the status quo of the art museum system in China, it is possible to point out some contradictions and peculiarities. Since the early 1980s, following a renovation process of the entirety of Chinese national institutions, the museum system has been enjoying an unprecedented development. As well, a more general discourse on the cultural heritage of the country has increasingly gained a prominent position in the cultural policy agenda. As far as art museums are concerned, since the end of the 1990s, the country has been experiencing a rapid and unprecedented development as well, encompassing both the state-owned and private sector. However, today the proliferation of art museums appears to be more driven by the compulsion for a status symbol rather than pursuing a cultural mission. Therefore, a key question arises concerning the quality of these art institutions, their effective role in the promotion of art, and their cultural impact. This study aims to enrich the debate on museums of contemporary art, and intends to offer a parameter of sustainability in order to evaluate the Chinese art museum system.

Nordhaus (1973) has in his seminal contribution addressed two emerging questions in the field of energy economics. First, how do current market prices of natural resources reflect true scarcity fro...

Abstract Water transport control is the major issue of direct methanol fuel cell. High water flow rates through the fuel cell imply extra water feeding at the anode and flooding at the cathode. In the present work, water transport and flooding in the direct methanol fuel cell are investigated through both experimental and modeling analyses and an interpretation of such phenomena is proposed. The model is validated on the experimental data of two different fuel cells in an extensive range of operating conditions. The analysis elucidates that water transport through the cathode diffusion layer is determined by vapor diffusion, slightly affected by current density, and by liquid water permeation proportional to current density, that occurs when liquid pressure in the electrode exceeds a threshold value. To simulate the effects of cathode diffusion layer flooding two mechanisms must be considered simultaneously: superficial pore obstruction, proportional to liquid water concentration in cathode channel, and bulk pore obstruction, proportional to liquid water permeation. The modeling analysis proposes the correlations to reproduce the effects of cathode flooding and permits to discuss the onset and magnitude of such phenomenon and the influence of micro-porous layer.

Urban environments provide opportunities for greater resource efficiency and the fostering of urban ecosystems. Brownfield areas are a typical example of underused land resources. Brownfield redevelopment projects that include green infrastructure allow for further ecosystems to be accommodated in urban environments. Green infrastructure also deliver important urban ecosystem services (UES) to local residents, which can greatly contribute to improving quality of life in cities. In this case study, we quantify and assess the economic value of five UES for a brownfield redevelopment project in Antwerp, Belgium. The assessment is carried out using the “Nature Value Explorer” modelling tool. The case includes three types of green infrastructure (green corridor,infiltration gullies and green roofs) primarily intended to connect nature reserves on the urban periphery and to avoid surface runoff. The green infrastructure also provides air filtration, climate regulation, carbon sequestration and recreation ecosystem services. The value of recreation far exceeds other values, including the value of avoided runoff. The case study raises crucial questions as to whether existing UES valuation approaches adequately account for the range of UES provided and whether such approaches can be improved to achieve more accurate and reliable value estimates in future analyses.

The determination of minimum free energy pathways (MFEP) is one of the most widely used strategies to study reactive processes. For chemical reactions in complex environments, the combination of quantum mechanics (QM) with a molecular mechanics (MM) representation is usually necessary in a hybrid QM/MM framework. However, even within the QM/MM approximation, the affordable sampling of the phase space is, in general, quite restricted. To reduce drastically the computational cost of the simulations, several methods such as umbrella sampling require performing a priori a selection of a reaction coordinate. The quality of the computed results, in an affordable computational time, is intimately related to the reaction coordinate election which is, in general, a nontrivial task. In this work, we provide an approach to model reactive processes in complex environments that does not require the a priori selection of a reaction coordinate. The proposed methodology combines QM/MM simulations with an extrapolation of the nudged elastic bands (NEB) method to the free energy surface (FENEB). We present and apply our own FENEB scheme to optimize MFEP in different reactive processes, using QM/MM frameworks at semiempirical and density functional theory levels. Our implementation is based on performing the FENEB optimization by uncoupling the optimization of the band in a perpendicular and tangential direction. In each step, a full optimization with the spring force is performed, which guarantees that the images remain evenly distributed. The robustness of the method and the influence of sampling on the quality of the optimized MFEP and its associated free energy barrier are studied. We show that the FENEB method provides a good estimation of the reaction barrier even with relatively short simulation times, supporting that its combination with QM/MM frameworks provides an adequate tool to study chemical processes in complex environments.