Although strange, I have only declared one controller in ES.
By this way, I have no more strange behaviour on some buttons. So it's better now.
Still have the controller 1 or 2 swapping in some emulators...
Try to manage with joystick-selection, but not sure it could handle this 100%, as name and reference are always the same.