@mitu
I did as told, emulationstation auto config was disabled. I enabled it and also removed xboxdrv.
And it finally works! I could configure both controller, the configuration is kept in the game and even when rebooting I don't need to re-configure it again.
Thanks a lot, the auto config settings were an eye-opener!