
You have already added 0 works in your ORCID record related to the merged Research product.
You have already added 0 works in your ORCID record related to the merged Research product.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://beta.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=undefined&type=result"></script>');
-->
</script>
Double Deep $Q$ -Learning-Based Distributed Operation of Battery Energy Storage System Considering Uncertainties

$Q$ -learning-based operation strategies are being recently applied for optimal operation of energy storage systems, where, a $Q$ -table is used to store $Q$ -values for all possible state-action pairs. However, $Q$ -learning faces challenges when it comes to large state space problems, i.e., continuous state space problems or problems with environment uncertainties. In order to address the limitations of $Q$ -learning, this paper proposes a distributed operation strategy using double deep $Q$ -learning method. It is applied to managing the operation of a community battery energy storage system (CBESS) in a microgrid system. In contrast to $Q$ -learning, the proposed operation strategy is capable of dealing with uncertainties in the system in both grid-connected and islanded modes. This is due to the utilization of a deep neural network as a function approximator to estimate the $Q$ -values. Moreover, the proposed method can mitigate the overestimation that is the major drawback of the standard deep $Q$ -learning. The proposed method trains the model faster by decoupling the selection and evaluation processes. Finally, the performance of the proposed double deep $Q$ -learning-based operation method is evaluated by comparing its results with a centralized approach-based operation.
- Incheon National University Korea (Republic of)
- Incheon National University Korea (Republic of)
citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).174 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Top 1% influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Top 1% impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Top 0.1%
