This paper presents a comparison of a Reinforcement-Learning (RL) based wave energy conversion controller against standard reactive damping and model predictive control (MPC) approaches, in the presence of modeling errors. Wave energy converters (WECs) are under the influence of many non-linear hydrodynamic forces, yet for ease and expediency, it is common to formulate linear WEC models and control laws. Therefore it is expected that significant modeling errors may be present, which may degrade model-based control performance. Model-free RL approaches to control may offer a significant advantage in robustness to modeling errors, in that the model is learned by the controller by experience. It is shown that, for an annual average sea state, RL-based controllers can outperform model-based control – reactive control and MPC – by 19% and 16%, respectively, when significant modeling error is present. Furthermore, compared to similar studies of RL-based control, the proposed model can reduce the training time from 8.4 hr to 1.5 hr.© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Deposited by shareyourpaper.org and openaccessbutton.org. We've taken reasonable steps to ensure this content doesn't violate copyright. However, if you think it does you can request a takedown by emailing help@openaccessbutton.org.