Thanks for the great suggestion, I wasn't aware it was on top of Raspbian Lite. Now that I know that, it doesn't make sense for me to have two versions of Raspbian!
Cheers for the speedy responses.