Sounds like retrogame isn't installed, or it isn't loading when booting, or isn't configured properly.
If you open the terminal (press F4) and push your buttons and see if the corresponding letters appear.
If you see no letters when moving the joystick or pushing buttons, then retrogame isn't working