For the Stretch image I found myself having to do it manually:

sudo apt-get install raspberrypi-ui-mods
sudo apt-get install xinit
startx

Then fine from the ports menu from then on.