Please fill out the info requested in https://retropie.org.uk/forum/topic/3/read-this-first - what Pi model ? RetroPie version ? Power source used ? etc.

The only crash I've seen in the last few years with EmulationStation was related to controllers disconnecting/reconnecting due to faulty USB connection or due to insufficient power fed to the Pi. Run emulationstation by typing emulationstation --debug at the prompt (after it crashes) and then post the error that it prints on the terminal after it crashes the 2nd time.