Wheat yield variability will increase in the future due to the projected increase in extreme weather events and long-term climate change effects. Currently, regional agricultural statistics are used to monitor wheat yield. Remotely sensed vegetation indices have a higher spatio-temporal resolution and could give more insight into crop yield. In this paper, we (i) evaluate the possibility to use Normalized Difference Vegetation Index (NDVI) time series to estimate wheat yield in Latvia and (ii) determine which weather variables impact wheat yield changes using both ALARO-0 and REMO Regional Climate Models (RCM) output. The integral from NDVI series (aNDVI) for winter and spring wheat fields is used as a predictor to model regional wheat yield from 2014 to 2018. A correlation analysis between weather variables, wheat yield and aNDVI was used to elucidate which weather variables impact wheat yield changes in Latvia. Our results indicate that high temperatures in June for spring wheat and in July for winter wheat had a negative correlation with yield. A linear regression yield model explained 71% of the variability with a residual standard error of 0.55 Mg/ha. When RCM data were added as predictor variables to the wheat yield empirical model a random forest approach resulted in better results compared to a linear regression approach, the explained variance increased up to 97% and the residual standard error decreased to 0.17 Mg/ha. We conclude that NDVI time series and RCM output enabled regional crop yield and weather impact monitoring at higher spatio-temporal resolutions than regional statistics.