The advancement of sustainable energy sources necessitates the development of robust forecasting tools for efficient energy management. A prominent player in this domain, solar power, heavily relies on accurate energy yield predictions to optimize production, minimize costs, and maintain grid stability. This paper explores an innovative application of tiny machine learning to provide real-time, low-cost forecasting of solar energy yield on resource-constrained edge internet of things devices, such as micro-controllers, for improved residential and industrial energy management. To further contribute to the domain, we conduct a comprehensive evaluation of four prominent machine learning models, namely unidirectional long short-term memory, bidirectional gated recurrent unit, bidirectional long short-term memory, and simple bidirectional recurrent neural network, for predicting solar farm energy yield. Our analysis delves into the impacts of tuning the machine learning model hyperparameters on the performance of these models, offering insights to improve prediction accuracy and stability. Additionally, we elaborate on the challenges and opportunities presented by the implementation of machine learning on low-cost energy management control systems, highlighting the benefits of reduced operational expenses and enhanced grid stability. The results derived from this study offer significant implications for energy management strategies at both household and industrial scales, contributing to a more sustainable future powered by accurate and efficient solar energy forecasting.