Hello and welcom to this forum.Did you configure the controller via Emulation Station correctly? Maybe do it again to be sure. There's a script to assign controllers to players. It works very well for me. Maybe it's worth a try for you.
If all of that doesn't help, please give us the information that's asked for in https://retropie.org.uk/forum/topic/3/read-this-first.