The order is alphabetical by default, and EmulationStation shows them in the order they appear in the configuration file (es_systems.cfg). You can create your own es_systems.cfg and re-arrange them in the file as you want - see https://retropie.org.uk/docs/EmulationStation/#es_systemscfg-edits.